EP2397386A1 - Status monitoring apparatus of railway vehicle - Google Patents
Status monitoring apparatus of railway vehicle Download PDFInfo
- Publication number
- EP2397386A1 EP2397386A1 EP10252104A EP10252104A EP2397386A1 EP 2397386 A1 EP2397386 A1 EP 2397386A1 EP 10252104 A EP10252104 A EP 10252104A EP 10252104 A EP10252104 A EP 10252104A EP 2397386 A1 EP2397386 A1 EP 2397386A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- image
- train
- railway vehicle
- function
- vehicle
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000012544 monitoring process Methods 0.000 title claims description 31
- 238000003384 imaging method Methods 0.000 claims abstract description 52
- 238000012545 processing Methods 0.000 claims description 26
- 238000006243 chemical reaction Methods 0.000 claims description 21
- 238000001514 detection method Methods 0.000 description 21
- 238000000034 method Methods 0.000 description 9
- 239000004020 conductor Substances 0.000 description 7
- 238000004891 communication Methods 0.000 description 3
- 238000010586 diagram Methods 0.000 description 3
- 230000002159 abnormal effect Effects 0.000 description 2
- 230000015572 biosynthetic process Effects 0.000 description 2
- 238000012937 correction Methods 0.000 description 2
- 230000002708 enhancing effect Effects 0.000 description 2
- 238000009434 installation Methods 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 238000003786 synthesis reaction Methods 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
Images
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B61—RAILWAYS
- B61K—AUXILIARY EQUIPMENT SPECIALLY ADAPTED FOR RAILWAYS, NOT OTHERWISE PROVIDED FOR
- B61K13/00—Other auxiliaries or accessories for railways
- B61K13/04—Passenger-warning devices attached to vehicles; Safety devices for preventing accidents to passengers when entering or leaving vehicles
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B61—RAILWAYS
- B61L—GUIDING RAILWAY TRAFFIC; ENSURING THE SAFETY OF RAILWAY TRAFFIC
- B61L23/00—Control, warning or like safety means along the route or between vehicles or trains
- B61L23/04—Control, warning or like safety means along the route or between vehicles or trains for monitoring the mechanical state of the route
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B61—RAILWAYS
- B61L—GUIDING RAILWAY TRAFFIC; ENSURING THE SAFETY OF RAILWAY TRAFFIC
- B61L23/00—Control, warning or like safety means along the route or between vehicles or trains
- B61L23/04—Control, warning or like safety means along the route or between vehicles or trains for monitoring the mechanical state of the route
- B61L23/041—Obstacle detection
Definitions
- the present invention relates to a status monitoring apparatus of a railway vehicle for monitoring passengers and the like positioned close to a side of the railway vehicle on the outer side and the inner side of the vehicle.
- Patent document 1 Japanese patent application laid-open publication No. 2002-104189 discloses a train operation support system, a ground apparatus for train operation support, and a vehicle apparatus for train operation support.
- the train operation support system, ground apparatus for train operation support and vehicle apparatus for train operation support disclosed in patent document 1 uses cameras mounted on a platform to pick up images of the vicinity of a boundary between the platform and the train and transmits the picked-up images to the train via radio communication.
- the train receives the picked-up images and displays the images on a liquid crystal display unit installed on the driver's seat of the train, and the train driver monitors the displayed images and operates the train while confirming its safety.
- patent document 2 Japanese patent application re-publication No. W02007/015446 discloses a device and method for monitoring vehicle surroundings.
- the device and method for monitoring vehicle surroundings disclosed in patent document 2 comprises at least one camera installed on an own vehicle to take a video of the image around the own vehicle, an obstacle sensor for detecting an obstacle within an imaging range of the camera, a pixel synthesis unit for receiving a camera image taken by the camera and converting the camera image into a view point converted image seen from a virtual view point above the own vehicle, and a display device for displaying the view point conversion image converted by the pixel synthesis unit, wherein when a warning is given by a warning sound upon entry of an obstacle within an obstacle detection range of the obstacle sensor, an image of the obstacle detection range is synthesized with an obstacle image taken by the camera and included in the view point converted image to be in contact therewith.
- the train operation support system, ground apparatus for train operation support and vehicle apparatus for train operation support disclosed in patent document 1 requires multiple cameras to be mounted on platforms and the picked-up images must be transmitted to the train via radio communication, so that the cost for installing multiple cameras on respective platforms becomes excessive, and devices must be installed in addition for transmitting the picked-up images to the train via radio communication .
- the device and method for monitoring vehicle surroundings disclosed in patent document 2 comprises multiple cameras installed on the front, back and sides of a vehicle to take a video around the own vehicle and converting the camera image into a view point converted image seen from a virtual view point above the own vehicle, and specifically, when an obstacle enters the an obstacle detection range of the obstacle sensor, the image of the obstacle detection range is synthesized with the obstacle image imaged by the camera and included in the view point converted image to be in contact therewith.
- the patent document does not consider applying the art to a train formed by connecting multiple railway vehicles.
- the present invention aims at solving the problems of the prior art by providing a status monitoring apparatus for enabling a crew (such as a driver or a conductor) operating the train to monitor through a monitor disposed on a driver's cabin (driver's seat) the status of passengers positioned close to a side of the railway vehicle on an outer side and an inner side of the train exiting the train onto the platform or entering the train from the platform.
- a crew such as a driver or a conductor
- the status monitoring apparatus of a railway vehicle of the present invention comprises a detecting apparatus attached to a side of a vehicle constituting a train, and a signal processing function for processing each of a plurality of signals indicating a status of the side of the train detected via the detecting apparatus, characterized in that the signal processing function comprises a signal converting function for converting the plurality of signals, an image merging function for merging the converted signals to generate an integrated image, and a display function for displaying the merged image on a monitor disposed on the vehicle.
- the status monitoring apparatus of a railway vehicle further characterizes in comprising an imaging apparatus disposed on an upper portion on an outer side of the side of the vehicle for acquiring an image, a function for subjecting the image obtained via the imaging apparatus to overhead view conversion, and a function for matching the overhead-view-converted image to form a continuous panoramic image.
- the status monitoring apparatus of a railway vehicle characterizes in comprising a reference detecting function for detecting as reference a width-direction end portion of a platform on which the vehicle stops from the image when displaying the image as a panoramic image, and an image merging function for merging the converted signals using the end portion as reference to form an integrated image.
- the status monitoring apparatus of the railway vehicle according to the present invention further characterizes in that a moving body within the image is detected, and the detected moving-body is highlighted on the monitor.
- the status monitoring apparatus of the railway vehicle further characterizes in that a sensor for detecting approximation of a moving body within an imaging range of the imaging apparatus to the vehicle is disposed on an outer side of the side of the vehicle.
- the status monitoring apparatus of the railway vehicle further comprises an imaging apparatus attached to an outer side of the vehicle above a door formed on a side of the vehicle constituting the train, an overhead view conversion function for subjecting images of an outer side and an inner side of a side of the vehicle taken via the imaging apparatus to overhead view conversion, an image emerging function for matching images converted via the overhead view conversion function to merge a continuous panoramic image, and a display function for displaying a merged image on the monitor disposed in the vehicle.
- the status monitoring apparatus of a railway vehicle further comprises a sensor disposed on an outer side of a side of the vehicle constituting the train, and a signal processing function for processing a plurality of signals each indicating statuses of the side of the train detected via the sensor, wherein the signal processing function comprises an image converting function for converting the plurality of signals into image, and a display function for displaying the image converted from the signals via the image converting function on a monitor disposed on the train.
- the status monitoring apparatus of the railway vehicle characterizes in that the image displayed on the monitor is highlighted.
- the status monitoring apparatus of the railway vehicle characterizes in that a rate of change of signals of the sensor detecting the status of the side of the train is calculated, and when the rate of change is greater than a predetermined threshold, highlights the image on the monitor converted from the signals.
- the crew such as the driver or the conductor operating the train can smoothly recognize the statuses of passengers exiting or entering the train by observing the monitor disposed on the driver's cabin when the train is stopped at a station.
- FIG. 1 shows a train 100 composed of railway vehicles 101 and 102, wherein the railway vehicle 101 is equipped with a driver's cabin in which the driver or the conductor of the train works.
- each railway vehicle is composed of an underframe constituting a floor surface, side structures erected on both width direction ends of the underframe and constituting side walls of the vehicle, end structures erected on both longitudinal ends of the underframe, and a roof structure disposed on the upper ends of side structures and end structures.
- Cameras 103a, 104a, 105a and 106a are disposed on an outer side of the vehicle on one side wall of the railway vehicle above the doors 202 of the railway vehicles 101 and 102.
- the imaging range of cameras 103a, 104a, 105a and 106a are set to the outer side of the railway vehicle along the longitudinal direction of the railway vehicle 101, and the cameras take images of passengers 107, 108, 109 and 110 on a platform 200 when a train 100 is stopped at a station. Although not shown, cameras are disposed also on the other outer side of the railway vehicles 101 and 102 constituting the train 100.
- FIG. 1 shows an example in which cameras 103a, 104a, 105a and 106a are disposed on the side wall of the railway vehicle above the doors 202, but the positions in which cameras or sensors are disposed in embodiments 1 through 3 of the present invention are not restricted to the area above the doors 202, and can be selected from any position capable of covering the required imaging range on the outer side of the railway vehicle close to the connecting sections between the side structure and the roof structure constituting the railway vehicle.
- the imaging range on the outer side of the railway vehicle can be covered by using only a small number of cameras if wide angle cameras having an imaging angle of approximately 180 degrees in the lateral direction (longitudinal direction of the railway vehicle 101) are adopted as cameras 103a, 104a, 105a and 106a.
- a monitor 111 disposed in the driver' s cabin displays an image formed by subjecting the images taken by the cameras 103a, 104a, 105a, 106a and other cameras disposed on the railway vehicle to correction for correcting lens distortion, converting the corrected image to overhead view, and then composing a panoramic image therefrom.
- the images taken by the cameras 103a and 104a are subjected to overhead view conversion and displayed on the monitor 111 as an image 112.
- the images taken by the cameras 105a and 106a are subjected to overhead view conversion and displayed on the monitor 111.
- Images 112, 113 and 114 are merged continuously so that there is no leak in the imaging range covered by the cameras, and displayed on the monitor 111 as an integrated panoramic image as if the image taken by a single camera is subjected to overhead view conversion.
- all the overhead view images other than images 112 and 113 taken by the cameras on the railway vehicle disposed on the platform 200 side are converted into a continuous panoramic image and displayed. If the overhead view images of all the cameras cannot be displayed due to the imitation of size of the monitor 111 in the width direction (lateral direction), the images can be displayed as a multiple column image 119 having multiple columns in the vertical direction (height direction) of the monitor 111.
- FIG. 2 is an explanatory view of the overhead view conversion.
- Overhead view conversion refers to converting the actual image taken by the camera 103a disposed on the other side of the upper portion of the door 202 of the railway vehicle 101 to a virtual image as if the image is taken by a camera 201 disposed virtually above (approximately directly above) the platform 200.
- the image having been subjected to lens distortion correction is converted from an image having the camera view point on the upper outer side of the side wall of the railway vehicle to a camera view point virtually moved to a position directly above the imaging range.
- the overhead view conversion is performed by relocating the pixel positions of the actually taken image via geometrical coordinate transformation to pixel positions supposedly obtained via a camera view point directly above the imaging range based on the installation angle of the camera (depression angle), the installation height of the camera and the focal distance of the camera, assuming that all subjects within the imaging range are planar objects capable of having their heights ignored.
- FIG. 3 is a planar view showing the positions of cameras disposed on the railway vehicle and the imaging ranges thereof.
- Two doors 202 are disposed on each side wall of the railway vehicle 101, and cameras 103a, 104a, 103b and 104b are disposed on the side walls on the outer side of the railway vehicle 101 above each door 202.
- FIG. 3 illustrates an example in which the direction of optical axis of each camera 103a, 104a, 103b and 104b corresponds to the outer direction of the railway vehicle.
- the imaging range 301 corresponds to camera 103a, and together with imaging ranges 302, 303 and 304 of cameras 104a, 103b and 104b, the installed cameras have imaging angles capable of covering the outer side of the car body on both sides of the railway vehicle 101.
- FIG. 4 is a side view showing the positions of cameras disposed on the railway vehicle and imaging ranges thereof.
- FIG. 4 is a view in which the railway vehicle 101 of FIG. 3 is viewed from the outer direction in the width direction of the vehicle.
- the vehicle 101 has doors 202 and 202 and windows 203, wherein cameras 103a and 104a are disposed on outer side walls of the railway vehicle above the doors 202.
- the boundary section between the imaging range 301 of camera 103a and the imaging range 302 of camera 104a has an overlapped portion belonging to both imaging ranges, so that the passengers or the like on the platform 200 can be taken by the camera without fail.
- FIG. 5 is an A-A cross-sectional view of the railway vehicle shown in FIG. 4 , wherein the position and the imaging range of the camera are shown.
- a camera 103a is disposed on the outer side of the vehicle above the door 202 disposed on one side wall of the vehicle 101.
- the imaging range 301 of the camera 103a is set on the platform 200, so that the passengers and the like on the platform 200 are taken via the camera.
- a camera 103b is disposed on the outer side of the vehicle above the door 202 disposed on the other side of the vehicle 101, and when the platform 200 is positioned on the other side of the railway vehicle 101, the above-mentioned image can be taken via this camera.
- the crew such as the driver driving the train or the conductor can check the monitor disposed in the driver's cabin to promptly recognize the statuses of passengers exiting the train onto the platform and passengers entering the train from the platform, thereby enhancing the safety of the train.
- FIG. 6 shows another plan view showing the positions and imaging ranges of cameras disposed on the railway vehicle.
- FIG. 7 is another side view showing the positions and imaging ranges of the cameras disposed on the railway vehicle. Doors 202 and 202 are disposed on the side of the railway vehicle 101, and cameras 103a and 104a are disposed on the outer side wall of the railway vehicle 101 above the respective doors 202.
- the imaging range of the camera 103a includes the imaging range 305 on the outer side of the vehicle and the imaging range 306 on the inner side of the vehicle (refer to FIG. 6 ), wherein the imaging ranges 305 and 306 are set to the platform 200 on the outer side of the door 202 and to the inner side of the door 202.
- the imaging range of the camera 104a also includes both the inner side and the outer side of the railway vehicle 101.
- FIG. 8 is a B-B cross-section of the railway vehicle shown in FIG. 7 , which is another cross-sectional view showing the positions and imaging ranges of the cameras.
- a camera 103a is disposed on the outer side wall above the door 202 disposed on one side wall of the railway vehicle 101.
- the imaging range of the camera 103a includes the imaging range 305 of the upper side of the platform 200 on the outer side of the door 202 and the imaging range 306 on the inner side of the door 202, so that both the passengers on the platform 200 outside the vehicle and the passengers in the vehicle can be taken in the image via one camera at the same time.
- a camera 103b is disposed on the upper outer side of the door 202 on the other side of the vehicle 101, so that when the platform 200 is positioned on the other side of the railway vehicle 101, a similar image can be acquired.
- FIG. 9 is a display example of the monitor arranged in the driver's cabin of the railway vehicle, wherein the passengers detected on the monitor are highlighted.
- the passengers on the platform 200 positioned close to the doors 202 of the railway vehicle 101 can be highlighted via frame borders 901, 902 and 903.
- the corresponding passengers can be highlighted.
- the crew can recognize the status easily and with further accuracy by adopting a function to display an enlarged view of the highlighted section when the crew touches the highlighted sections 901, 902 and 903 on the screen of the monitor 111 to confirm the status of highlighted passengers.
- FIG. 10 is another display example of the monitor in the driver's cabin of the railway vehicle.
- the highlighting conditions can be set arbitrarily, such as when the distance between the passenger and the railway vehicle falls within a given value (such as 1 m or shorter). Further, by highlighting only the sections 1001 and 1002 regarding the railway vehicle where passengers are positioned close to the vehicle by detecting the amount and direction of movement of the passengers per unit time, it becomes possible to promptly recognize which vehicle the passenger may dash into.
- the crew can recognize the status easily and with further accuracy by adopting a function to display an enlarged view of the highlighted sections 1001 and 1002 then the crew touches the highlighted sections 1001 and 1002 on the screen of the monitor 111 to confirm the status of highlighted passengers.
- FIG. 11 shows yet another display example of the monitor in the driver's cabin of the railway vehicle, wherein an image having corrected the vibration amplitude caused by vibration of the railway vehicle or the like is displayed on the monitor.
- each railway vehicle when the video image taken via the camera is subjected to overhead view conversion and merged into a panoramic image, it may not be possible to obtain a smooth panoramic image by removing the lens distortion from the images taken at each vehicle and displaying a merged panoramic image of the images subjected to overhead view conversion, due to the vibration or tilt of the respective vehicles 101 composing the train 100 or the influence of the distance between the respective vehicles 101 of the train 100 and the platform 200.
- characteristic points such as the width-direction ends of the platform 200
- image recognition from images obtained from each railway vehicle
- the images are merged so that these characteristic points are connected smoothly to obtain a panoramic image 1101.
- sensors such as infrared sensors or ultrasonic sensors can be disposed close to the doors of the vehicle to detect the approximation of passengers or the like via the sensors, to specify the railway vehicle having detected signals from the sensors and to display the same on the monitor 111, so that the crew can recognize with even higher accuracy the level of approximation of the passengers to the doors 202 of the vehicle 101.
- FIG. 12 is a system configuration of the status monitoring apparatus of the railway vehicle using cameras. Images taken via cameras 103a, 104a, 103b and 104b disposed on the railway vehicle 101 constituting the train 100 are subjected to lens distortion removal process and overhead view conversion process in an image processing LSI 1201, and these images are merged to form a panoramic image via a CPU (central processing unit) 1202, which is displayed on the monitor 111 of the driver's seat via a transmission line equipped on the train 100.
- a CPU central processing unit
- FIG. 13 is a system configuration of another status monitoring apparatus of a railway vehicle using cameras. Images taken via cameras 103a, 104a, 103b and 104b disposed on the respective railway vehicles 101 constituting the train 100 are connected to image processing LSI 1301 disposed in each railway vehicle where lens distortion removal process and overhead view conversion process are performed.
- both the images from cameras disposed on one side of the railway vehicle and the images from cameras disposed on the other side of the railway vehicle are subjected to image conversion via a single image processing LSI 1301, so that the number of necessary image processing LSIs is small and the costs for forming the image processing system are low.
- the crew such as the driver or the conductor operating the train can recognize the statuses of passengers exiting the train onto the platform or of passengers entering the train from the platform promptly by checking the monitor disposed in the driver' s cabin, thereby enhancing the safety of the train.
- FIG. 14 shows an example of a system for detecting signals from a plurality of sensors disposed on the railway vehicle and to display the same on a screen of a monitor in the driver's cabin.
- the train 100 is composed of railway vehicles 101 and 102, and on the railway vehicle 101 is disposed a driver's cabin in which the driver or the conductor of the train is seated. Since sensors 403a, 404a, 405a and 406a are not required to acquire a wide range of images like cameras, there is no restriction in the height in which the sensors are disposed, as long as they are disposed on the outer side of the vehicle on the side wall of the railway vehicle 101. For example, the sensors can be disposed at positions corresponding to a height of 500 mm on the side wall of the vehicle from the upper surface of the platform 200.
- sensors 403a, 404a, 405a and 406a are set on the outer side of the railway vehicle, and the sensors sense the passengers or the like 107, 108, 109 and 110 on the platform 200 when the train 100 stops at a station. Further, sensors are similarly positioned at the opposite side walls (not shown) of the railway vehicles 101 and 102 constituting the train 100 shown in FIG. 14 .
- FIG. 14 shows an example where only the sensors 403a, 404a, 405a and 406a are disposed on the outer side wall of the vehicles 101 and 102, but the sensors can also be disposed in an additional manner to vehicles equipped with cameras as shown in embodiments 1 and 2.
- the outer side of the railway vehicle can be covered as the detection area by only a small number of sensors.
- the monitors 111 are equipped in the driver's cabin disposed on the railway vehicle 101, wherein the image created by processing signals detected by the sensors 403a, 404a, 405a and 406a is displayed.
- An oval-shaped dashed line image 412 displayed on the monitor 111 is an image created based on the detected signal from the sensor 403, and similarly, images 413 and 414 are images formed by processing detection signals from the sensor 404a and image 415 is formed by processing signals from the sensor 406a.
- sensors are disposed at similar areas of all the vehicles other than the vehicles 101 and 102 constituting the train 100, wherein the image corresponding to one side of the train 100 where the platform 200 is positioned is also similarly displayed continuously on the monitor 111. If the images from the sensor disposed on the train 100 cannot be displayed continuously in the longitudinal direction of the train 100 due to the limited width-direction size of the monitor 111, the images can be displayed as a multiple column image as shown in image 119.
- the passengers 107, 108, 109 and 110 on the platform 200 are displayed as images 412, 413, 414 and 415 on the monitor 111, and the car number and the positions of doors are also displayed on the monitor, so that the crew can easily specify the railway vehicle corresponding to images 412, 413, 414 and 415.
- FIG. 15 is a plan view showing the positions and detection ranges of sensors disposed on the railway vehicle. Sensors 403a, 404a, 403b and 404b are disposed above the respective doors 202, and the detection direction of the sensors are set to the outer side of the railway vehicle 101. In this case, the detection range corresponds to the frame border 501 of FIG. 15 , wherein together with detection ranges 502, 503 and 504 of other sensors, the outer side of the vehicle can be covered by the detection ranges.
- FIG. 16 is a side view showing the position and detection ranges of sensors disposed on the railway vehicle.
- the vehicle 101 has doors 202 and 202, and above the doors 202 are respectively disposed sensors 403a and 404a.
- Sensor 403a has a detection range 501 and sensor 404a has a detection range 502 as the detection object range.
- the detection ranges 501 and 502 have an overlapped portion, by which the passengers and the like on the platform 200 can be detected without fail.
- FIG. 17 is a system configuration diagram of the status monitoring apparatus of the rail way vehicle equipped with sensors. Signals detected via sensors 403, 404, 405 and 406 disposed on the respective vehicles 101 of the train 100 are each subjected to signal processing via signal processing LSI 1601 of sensor signals, and the image crated via signal processing is merged in CPU 1602 and displayed on the monitor 111 in the driver's cabin.
- the crew such as the driver or the conductor operating the train can promptly recognize the statuses of passengers exiting the train onto the platform and passengers entering the train from the platform by checking the monitor disposed in the driver's cabin to thereby enhance the safety of the train.
- the rate of change of the signal or the like can be calculated to detect the area where the rate of change is high in the positive direction, to thereby check the abnormal approximation of passengers possibly dashing onto the train and to highlight the image where abnormal approximation is recognized.
- the settings related to the positions and detection ranges of sensors on the railway vehicles constituting the train are not restricted to those shown in the drawings, and can be modified in various ways similar to the positions and imaging ranges of cameras. Further, the system configurations for realizing the present invention are not restricted to the illustrated examples, and can be modified in various ways.
Landscapes
- Engineering & Computer Science (AREA)
- Mechanical Engineering (AREA)
- Train Traffic Observation, Control, And Security (AREA)
- Electric Propulsion And Braking For Vehicles (AREA)
Abstract
Description
- The present invention relates to a status monitoring apparatus of a railway vehicle for monitoring passengers and the like positioned close to a side of the railway vehicle on the outer side and the inner side of the vehicle.
- Patent document 1 (Japanese patent application laid-open publication No.
2002-104189 - The train operation support system, ground apparatus for train operation support and vehicle apparatus for train operation support disclosed in
patent document 1 uses cameras mounted on a platform to pick up images of the vicinity of a boundary between the platform and the train and transmits the picked-up images to the train via radio communication. The train receives the picked-up images and displays the images on a liquid crystal display unit installed on the driver's seat of the train, and the train driver monitors the displayed images and operates the train while confirming its safety. - Further, patent document 2 (Japanese patent application re-publication No.
W02007/015446 ) discloses a device and method for monitoring vehicle surroundings. The device and method for monitoring vehicle surroundings disclosed inpatent document 2 comprises at least one camera installed on an own vehicle to take a video of the image around the own vehicle, an obstacle sensor for detecting an obstacle within an imaging range of the camera, a pixel synthesis unit for receiving a camera image taken by the camera and converting the camera image into a view point converted image seen from a virtual view point above the own vehicle, and a display device for displaying the view point conversion image converted by the pixel synthesis unit, wherein when a warning is given by a warning sound upon entry of an obstacle within an obstacle detection range of the obstacle sensor, an image of the obstacle detection range is synthesized with an obstacle image taken by the camera and included in the view point converted image to be in contact therewith. - The train operation support system, ground apparatus for train operation support and vehicle apparatus for train operation support disclosed in
patent document 1 requires multiple cameras to be mounted on platforms and the picked-up images must be transmitted to the train via radio communication, so that the cost for installing multiple cameras on respective platforms becomes excessive, and devices must be installed in addition for transmitting the picked-up images to the train via radio communication . - Moreover, the device and method for monitoring vehicle surroundings disclosed in
patent document 2 comprises multiple cameras installed on the front, back and sides of a vehicle to take a video around the own vehicle and converting the camera image into a view point converted image seen from a virtual view point above the own vehicle, and specifically, when an obstacle enters the an obstacle detection range of the obstacle sensor, the image of the obstacle detection range is synthesized with the obstacle image imaged by the camera and included in the view point converted image to be in contact therewith. The patent document does not consider applying the art to a train formed by connecting multiple railway vehicles. - In the case of a train composed of multiple railway vehicles, it is important to ensure the safety of passengers entering and exiting the train from the time the train reaches the platform of a station to the time the train departs therefrom. If some passengers dash into the train, it is necessary to recognize such status smoothly and to ensure the safety of passengers.
- The present invention aims at solving the problems of the prior art by providing a status monitoring apparatus for enabling a crew (such as a driver or a conductor) operating the train to monitor through a monitor disposed on a driver's cabin (driver's seat) the status of passengers positioned close to a side of the railway vehicle on an outer side and an inner side of the train exiting the train onto the platform or entering the train from the platform.
- The status monitoring apparatus of a railway vehicle of the present invention comprises a detecting apparatus attached to a side of a vehicle constituting a train, and a signal processing function for processing each of a plurality of signals indicating a status of the side of the train detected via the detecting apparatus, characterized in that the signal processing function comprises a signal converting function for converting the plurality of signals, an image merging function for merging the converted signals to generate an integrated image, and a display function for displaying the merged image on a monitor disposed on the vehicle.
- The status monitoring apparatus of a railway vehicle according to the present invention further characterizes in comprising an imaging apparatus disposed on an upper portion on an outer side of the side of the vehicle for acquiring an image, a function for subjecting the image obtained via the imaging apparatus to overhead view conversion, and a function for matching the overhead-view-converted image to form a continuous panoramic image.
- Even further, the status monitoring apparatus of a railway vehicle according to the present invention characterizes in comprising a reference detecting function for detecting as reference a width-direction end portion of a platform on which the vehicle stops from the image when displaying the image as a panoramic image, and an image merging function for merging the converted signals using the end portion as reference to form an integrated image.
- The status monitoring apparatus of the railway vehicle according to the present invention further characterizes in that a moving body within the image is detected, and the detected moving-body is highlighted on the monitor.
- The status monitoring apparatus of the railway vehicle according to the present invention further characterizes in that a sensor for detecting approximation of a moving body within an imaging range of the imaging apparatus to the vehicle is disposed on an outer side of the side of the vehicle.
- Moreover, the status monitoring apparatus of the railway vehicle according the present invention further comprises an imaging apparatus attached to an outer side of the vehicle above a door formed on a side of the vehicle constituting the train, an overhead view conversion function for subjecting images of an outer side and an inner side of a side of the vehicle taken via the imaging apparatus to overhead view conversion, an image emerging function for matching images converted via the overhead view conversion function to merge a continuous panoramic image, and a display function for displaying a merged image on the monitor disposed in the vehicle.
- The status monitoring apparatus of a railway vehicle according to the present invention further comprises a sensor disposed on an outer side of a side of the vehicle constituting the train, and a signal processing function for processing a plurality of signals each indicating statuses of the side of the train detected via the sensor, wherein the signal processing function comprises an image converting function for converting the plurality of signals into image, and a display function for displaying the image converted from the signals via the image converting function on a monitor disposed on the train.
- Further, the status monitoring apparatus of the railway vehicle according to the present invention characterizes in that the image displayed on the monitor is highlighted.
- Even further, the status monitoring apparatus of the railway vehicle according to the present invention characterizes in that a rate of change of signals of the sensor detecting the status of the side of the train is calculated, and when the rate of change is greater than a predetermined threshold, highlights the image on the monitor converted from the signals.
- According to the present invention, the crew such as the driver or the conductor operating the train can smoothly recognize the statuses of passengers exiting or entering the train by observing the monitor disposed on the driver's cabin when the train is stopped at a station.
-
-
FIG. 1 is a view showing an outline of a system for converting images from multiple cameras disposed on the railway vehicle to overhead view and displaying the same on a monitor disposed in a driver's cabin as a panoramic image; -
FIG. 2 is an explanatory view of the overhead view conversion; -
FIG. 3 is a plan view showing the positions and imaging ranges of cameras disposed on the railway vehicle; -
FIG. 4 is a side view showing the positions and imaging ranges of cameras disposed on the railway vehicle; -
FIG. 5 is an A-A cross-section of the railway vehicle shown inFIG. 4 , illustrating the position and imaging range of each camera; -
FIG. 6 is another plan view showing the positions and imaging ranges of cameras disposed on the railway vehicle; -
FIG. 7 is another side view showing the positions and imaging ranges of cameras disposed on the railway vehicle; -
FIG. 8 is a B-B cross-section of the railway vehicle shown inFIG. 7 , illustrating the position and imaging range of each camera; -
FIG. 9 is a display example of a monitor disposed in the driver's cabin of the railway vehicle; -
FIG. 10 is another display example of a monitor disposed in the driver's cabin of the railway vehicle; -
FIG. 11 is another display example of the monitor disposed in the driver's cabin of the railway vehicle; -
FIG. 12 is a system configuration diagram of the status monitoring apparatus of a railway vehicle using cameras; -
FIG. 13 shows another system configuration of a status monitoring apparatus of a railway vehicle using cameras; -
FIG. 14 is an example of a system for detecting signals from multiple sensors disposed on the railway vehicle and displaying the same as image on the monitor in the driver' s cabin; -
FIG. 15 is a plan view showing the positions and detection ranges of sensors disposed on the railway vehicle; -
FIG. 16 is a side view showing the positions and detection ranges of sensors disposed on the railway vehicle; and -
FIG. 17 is a system configuration diagram of the status monitoring apparatus of the railway vehicle using sensors. - The preferred embodiments of the present invention will now be described with reference to the drawings.
- Now, we will describe a preferred embodiment in which the present invention is applied to a system for converting images from a plurality of cameras disposed on a railway vehicle to an overhead view and displaying the same on a monitor in a driver' s cabin as a panoramic image.
-
FIG. 1 shows atrain 100 composed ofrailway vehicles railway vehicle 101 is equipped with a driver's cabin in which the driver or the conductor of the train works. Although not shown, each railway vehicle is composed of an underframe constituting a floor surface, side structures erected on both width direction ends of the underframe and constituting side walls of the vehicle, end structures erected on both longitudinal ends of the underframe, and a roof structure disposed on the upper ends of side structures and end structures.Cameras doors 202 of therailway vehicles - The imaging range of
cameras railway vehicle 101, and the cameras take images ofpassengers platform 200 when atrain 100 is stopped at a station. Although not shown, cameras are disposed also on the other outer side of therailway vehicles train 100. - Further,
FIG. 1 shows an example in whichcameras doors 202, but the positions in which cameras or sensors are disposed inembodiments 1 through 3 of the present invention are not restricted to the area above thedoors 202, and can be selected from any position capable of covering the required imaging range on the outer side of the railway vehicle close to the connecting sections between the side structure and the roof structure constituting the railway vehicle. - The imaging range on the outer side of the railway vehicle can be covered by using only a small number of cameras if wide angle cameras having an imaging angle of approximately 180 degrees in the lateral direction (longitudinal direction of the railway vehicle 101) are adopted as
cameras monitor 111 disposed in the driver' s cabin displays an image formed by subjecting the images taken by thecameras - The images taken by the
cameras monitor 111 as an image 112. Similarly, the images taken by thecameras monitor 111.Images monitor 111 as an integrated panoramic image as if the image taken by a single camera is subjected to overhead view conversion. - Similarly, all the overhead view images other than
images 112 and 113 taken by the cameras on the railway vehicle disposed on theplatform 200 side are converted into a continuous panoramic image and displayed. If the overhead view images of all the cameras cannot be displayed due to the imitation of size of themonitor 111 in the width direction (lateral direction), the images can be displayed as amultiple column image 119 having multiple columns in the vertical direction (height direction) of themonitor 111. -
Individuals platform 200 are subjected to overhead view conversion and displayed asimages monitor 111. Further, since themonitor 111 displays images showing the car numbers and positions of doors of the railway vehicles together with the overhead image of the railway vehicles, the operator can specify the respective railway vehicles corresponding to the overhead-view-convertedimages -
FIG. 2 is an explanatory view of the overhead view conversion. Overhead view conversion refers to converting the actual image taken by thecamera 103a disposed on the other side of the upper portion of thedoor 202 of therailway vehicle 101 to a virtual image as if the image is taken by acamera 201 disposed virtually above (approximately directly above) theplatform 200. - Now, a method for composing a panoramic image from the camera images subjected to overhead view conversion and obtaining a final panoramic image will be described. At first, all the pixels constituting the image taken via the camera disposed on the upper outer side of the
door 202 formed on the side wall of thevehicle 101 are relocated to positions having removed lens distortion by referring to a datasheet disclosing lens distortion. - Next, the image having been subjected to lens distortion correction is converted from an image having the camera view point on the upper outer side of the side wall of the railway vehicle to a camera view point virtually moved to a position directly above the imaging range. The overhead view conversion is performed by relocating the pixel positions of the actually taken image via geometrical coordinate transformation to pixel positions supposedly obtained via a camera view point directly above the imaging range based on the installation angle of the camera (depression angle), the installation height of the camera and the focal distance of the camera, assuming that all subjects within the imaging range are planar objects capable of having their heights ignored.
-
FIG. 3 is a planar view showing the positions of cameras disposed on the railway vehicle and the imaging ranges thereof. Twodoors 202 are disposed on each side wall of therailway vehicle 101, andcameras railway vehicle 101 above eachdoor 202.FIG. 3 illustrates an example in which the direction of optical axis of eachcamera imaging range 301 corresponds tocamera 103a, and together with imaging ranges 302, 303 and 304 ofcameras railway vehicle 101. -
FIG. 4 is a side view showing the positions of cameras disposed on the railway vehicle and imaging ranges thereof.FIG. 4 is a view in which therailway vehicle 101 ofFIG. 3 is viewed from the outer direction in the width direction of the vehicle. Thevehicle 101 hasdoors windows 203, whereincameras doors 202. - The boundary section between the
imaging range 301 ofcamera 103a and theimaging range 302 ofcamera 104a has an overlapped portion belonging to both imaging ranges, so that the passengers or the like on theplatform 200 can be taken by the camera without fail. -
FIG. 5 is an A-A cross-sectional view of the railway vehicle shown inFIG. 4 , wherein the position and the imaging range of the camera are shown. Acamera 103a is disposed on the outer side of the vehicle above thedoor 202 disposed on one side wall of thevehicle 101. Theimaging range 301 of thecamera 103a is set on theplatform 200, so that the passengers and the like on theplatform 200 are taken via the camera. - Similarly, a
camera 103b is disposed on the outer side of the vehicle above thedoor 202 disposed on the other side of thevehicle 101, and when theplatform 200 is positioned on the other side of therailway vehicle 101, the above-mentioned image can be taken via this camera. - Therefore, the crew such as the driver driving the train or the conductor can check the monitor disposed in the driver's cabin to promptly recognize the statuses of passengers exiting the train onto the platform and passengers entering the train from the platform, thereby enhancing the safety of the train.
-
FIG. 6 shows another plan view showing the positions and imaging ranges of cameras disposed on the railway vehicle. By arranging the optical axis of thecamera 103a illustrated inFIG. 3 in a perpendicular direction along the side wall of therailway vehicle 101 and by setting a large depression angle of the installedcamera 103a, it becomes possible to take an image of both the subjects in animaging range 305 on the outer side of therailway vehicle 101 and the subjects in animaging range 306 on the inner side of therailway vehicle 101. -
FIG. 7 is another side view showing the positions and imaging ranges of the cameras disposed on the railway vehicle.Doors railway vehicle 101, andcameras railway vehicle 101 above therespective doors 202. - The imaging range of the
camera 103a includes theimaging range 305 on the outer side of the vehicle and theimaging range 306 on the inner side of the vehicle (refer toFIG. 6 ), wherein the imaging ranges 305 and 306 are set to theplatform 200 on the outer side of thedoor 202 and to the inner side of thedoor 202. Although not shown, the imaging range of thecamera 104a also includes both the inner side and the outer side of therailway vehicle 101. -
FIG. 8 is a B-B cross-section of the railway vehicle shown inFIG. 7 , which is another cross-sectional view showing the positions and imaging ranges of the cameras. Acamera 103a is disposed on the outer side wall above thedoor 202 disposed on one side wall of therailway vehicle 101. The imaging range of thecamera 103a includes theimaging range 305 of the upper side of theplatform 200 on the outer side of thedoor 202 and theimaging range 306 on the inner side of thedoor 202, so that both the passengers on theplatform 200 outside the vehicle and the passengers in the vehicle can be taken in the image via one camera at the same time. - Similarly, a
camera 103b is disposed on the upper outer side of thedoor 202 on the other side of thevehicle 101, so that when theplatform 200 is positioned on the other side of therailway vehicle 101, a similar image can be acquired. -
FIG. 9 is a display example of the monitor arranged in the driver's cabin of the railway vehicle, wherein the passengers detected on the monitor are highlighted. The passengers on theplatform 200 positioned close to thedoors 202 of therailway vehicle 101 can be highlighted via frame borders 901, 902 and 903. In this case, when the distance between thedoors 202 and the passengers is smaller than a given distance, that is, when the passengers are positioned close to therailway vehicle 101 and attention-seeking of the crew is necessary, for example, the corresponding passengers can be highlighted. Further, it is possible to detect the amount and direction of movement of the passengers per unit time and highlight the passengers possibly dashing into the train so that the crew can recognize such passengers promptly. - The crew can recognize the status easily and with further accuracy by adopting a function to display an enlarged view of the highlighted section when the crew touches the highlighted
sections monitor 111 to confirm the status of highlighted passengers. -
FIG. 10 is another display example of the monitor in the driver's cabin of the railway vehicle. As shown inFIG. 10 , when the passengers and the like on theplatform 200 are positioned close to thedoors railway vehicle sections railway vehicles sections - Similar to
FIG. 9 , the crew can recognize the status easily and with further accuracy by adopting a function to display an enlarged view of the highlightedsections sections monitor 111 to confirm the status of highlighted passengers. -
FIG. 11 shows yet another display example of the monitor in the driver's cabin of the railway vehicle, wherein an image having corrected the vibration amplitude caused by vibration of the railway vehicle or the like is displayed on the monitor. - In each railway vehicle, when the video image taken via the camera is subjected to overhead view conversion and merged into a panoramic image, it may not be possible to obtain a smooth panoramic image by removing the lens distortion from the images taken at each vehicle and displaying a merged panoramic image of the images subjected to overhead view conversion, due to the vibration or tilt of the
respective vehicles 101 composing thetrain 100 or the influence of the distance between therespective vehicles 101 of thetrain 100 and theplatform 200. - In that case, characteristic points, such as the width-direction ends of the
platform 200, are extracted via image recognition from images obtained from each railway vehicle, and the images are merged so that these characteristic points are connected smoothly to obtain a panoramic image 1101. By adopting this method, it becomes possible to enhance the accuracy for calculating the distance between the passengers or the like on theplatform 200 and the railway vehicles, so that the crew can recognize with further accuracy the level of approximation of the passengers to thedoors 202 of therailway vehicles - Although not shown, either in replacement of the images taken via multiple cameras, or in addition to these images, sensors such as infrared sensors or ultrasonic sensors can be disposed close to the doors of the vehicle to detect the approximation of passengers or the like via the sensors, to specify the railway vehicle having detected signals from the sensors and to display the same on the
monitor 111, so that the crew can recognize with even higher accuracy the level of approximation of the passengers to thedoors 202 of thevehicle 101. -
FIG. 12 is a system configuration of the status monitoring apparatus of the railway vehicle using cameras. Images taken viacameras railway vehicle 101 constituting thetrain 100 are subjected to lens distortion removal process and overhead view conversion process in an image processing LSI 1201, and these images are merged to form a panoramic image via a CPU (central processing unit) 1202, which is displayed on themonitor 111 of the driver's seat via a transmission line equipped on thetrain 100. -
FIG. 13 is a system configuration of another status monitoring apparatus of a railway vehicle using cameras. Images taken viacameras respective railway vehicles 101 constituting thetrain 100 are connected toimage processing LSI 1301 disposed in each railway vehicle where lens distortion removal process and overhead view conversion process are performed. - These images are merged into a panoramic image via the
CPU 1302 and displayed on themonitor 111 in the driver's seat. According to the system shown inFIG. 13 , both the images from cameras disposed on one side of the railway vehicle and the images from cameras disposed on the other side of the railway vehicle are subjected to image conversion via a singleimage processing LSI 1301, so that the number of necessary image processing LSIs is small and the costs for forming the image processing system are low. - Based on the above-described arrangement, the crew such as the driver or the conductor operating the train can recognize the statuses of passengers exiting the train onto the platform or of passengers entering the train from the platform promptly by checking the monitor disposed in the driver' s cabin, thereby enhancing the safety of the train.
-
FIG. 14 shows an example of a system for detecting signals from a plurality of sensors disposed on the railway vehicle and to display the same on a screen of a monitor in the driver's cabin. - The
train 100 is composed ofrailway vehicles railway vehicle 101 is disposed a driver's cabin in which the driver or the conductor of the train is seated. Sincesensors railway vehicle 101. For example, the sensors can be disposed at positions corresponding to a height of 500 mm on the side wall of the vehicle from the upper surface of theplatform 200. The detection ranges ofsensors platform 200 when thetrain 100 stops at a station. Further, sensors are similarly positioned at the opposite side walls (not shown) of therailway vehicles train 100 shown inFIG. 14 . -
FIG. 14 shows an example where only thesensors vehicles embodiments - When wide angle sensors with a sensing angle of approximately 180 degrees along the longitudinal direction of the
railway vehicle 101 are selected as detection areas ofsensors monitors 111 are equipped in the driver's cabin disposed on therailway vehicle 101, wherein the image created by processing signals detected by thesensors - An oval-shaped dashed
line image 412 displayed on themonitor 111 is an image created based on the detected signal from the sensor 403, and similarly,images sensor 404a andimage 415 is formed by processing signals from thesensor 406a. - Although not shown, sensors are disposed at similar areas of all the vehicles other than the
vehicles train 100, wherein the image corresponding to one side of thetrain 100 where theplatform 200 is positioned is also similarly displayed continuously on themonitor 111. If the images from the sensor disposed on thetrain 100 cannot be displayed continuously in the longitudinal direction of thetrain 100 due to the limited width-direction size of themonitor 111, the images can be displayed as a multiple column image as shown inimage 119. - The
passengers platform 200 are displayed asimages monitor 111, and the car number and the positions of doors are also displayed on the monitor, so that the crew can easily specify the railway vehicle corresponding toimages -
FIG. 15 is a plan view showing the positions and detection ranges of sensors disposed on the railway vehicle.Sensors respective doors 202, and the detection direction of the sensors are set to the outer side of therailway vehicle 101. In this case, the detection range corresponds to theframe border 501 ofFIG. 15 , wherein together with detection ranges 502, 503 and 504 of other sensors, the outer side of the vehicle can be covered by the detection ranges. -
FIG. 16 is a side view showing the position and detection ranges of sensors disposed on the railway vehicle. Thevehicle 101 hasdoors doors 202 are respectively disposedsensors -
Sensor 403a has adetection range 501 andsensor 404a has adetection range 502 as the detection object range. The detection ranges 501 and 502 have an overlapped portion, by which the passengers and the like on theplatform 200 can be detected without fail. -
FIG. 17 is a system configuration diagram of the status monitoring apparatus of the rail way vehicle equipped with sensors. Signals detected via sensors 403, 404, 405 and 406 disposed on therespective vehicles 101 of thetrain 100 are each subjected to signal processing viasignal processing LSI 1601 of sensor signals, and the image crated via signal processing is merged inCPU 1602 and displayed on themonitor 111 in the driver's cabin. Thus, the crew such as the driver or the conductor operating the train can promptly recognize the statuses of passengers exiting the train onto the platform and passengers entering the train from the platform by checking the monitor disposed in the driver's cabin to thereby enhance the safety of the train. - When the sensor signal is processed via the
signal processing LSI 1601, the rate of change of the signal or the like can be calculated to detect the area where the rate of change is high in the positive direction, to thereby check the abnormal approximation of passengers possibly dashing onto the train and to highlight the image where abnormal approximation is recognized. - The settings related to the positions and detection ranges of sensors on the railway vehicles constituting the train are not restricted to those shown in the drawings, and can be modified in various ways similar to the positions and imaging ranges of cameras. Further, the system configurations for realizing the present invention are not restricted to the illustrated examples, and can be modified in various ways.
Claims (9)
- A status monitoring apparatus of a railway vehicle comprising:a detecting apparatus attached to a side of a vehicle constituting a train; anda signal processing function for processing each of a plurality of signals indicating a status of the side of the train detected via the detecting apparatus;characterized in that the signal processing function comprisesa signal converting function for converting the plurality of signals;an image merging function for merging the converted signals to generate an integrated image; anda display function for displaying the merged image on a monitor disposed on the vehicle.
- The status monitoring apparatus of a railway vehicle according to claim 1, wherein
the detecting apparatus is an imaging apparatus disposed on an outer upper portion of the side of the vehicle for acquiring an image;
the signal converting function is a function for converting the image obtained via the imaging apparatus to an overhead view; and
the image merging function is a function to match the overhead-view-converted image to form a continuous panoramic image. - The status monitoring apparatus of a railway vehicle according to claim 2, wherein
the signal processing function comprises:a reference detecting function for detecting as reference a width-direction end portion of a platform on which the vehicle stops from the image when displaying the image as a panoramic image; andan image merging function for merging the converted signals using the end portion as reference to form an integrated image. - The status monitoring apparatus of the railway vehicle according to any one of claims 1 through 3, characterized in that
a moving body within the image is detected, and the detected moving body is highlighted on the monitor. - The status monitoring apparatus of the railway vehicle according to any one of claims 2 through 4, wherein
a sensor for detecting approximation of a moving body within an imaging range of the imaging apparatus to the vehicle is disposed on an outer side of the side of the vehicle. - The status monitoring apparatus of the railway vehicle according to claim 1, further comprising
an imaging apparatus attached to an outer side of the vehicle above a door formed on a side of the vehicle constituting the train;
an overhead view conversion function for converting images of an outer side and an inner side of a side of the vehicle taken via the imaging apparatus to an overhead view;
an image merging function for matching images converted via the overhead view conversion function to merge a continuous panoramic image; and
a display function for displaying a merged image on the monitor disposed in the vehicle. - The status monitoring apparatus of a railway vehicle according to claim 1, further comprising:a sensor disposed on an outer side of a side of the vehicle constituting the train; anda signal processing function for processing a plurality of signals each indicating a status of the side of the train detected via the sensor;wherein the signal processing function comprises:an image converting function for converting the plurality of signals into image; anda display function for displaying the image converted from the signals via the image converting function on a monitor disposed on the train.
- The status monitoring apparatus of the railway vehicle according to claim 7, characterized in that
the image displayed on the monitor is highlighted. - The status monitoring apparatus of the railway vehicle according to claim 8, characterized in that
a rate of change of signals of the sensor detecting the status of the side of the train is calculated; and
when the rate of change is greater than a predetermined threshold, the apparatus highlights the image converted from the signal on the monitor.
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2010140926A JP5520142B2 (en) | 2010-06-21 | 2010-06-21 | Railway vehicle status monitoring device |
Publications (2)
Publication Number | Publication Date |
---|---|
EP2397386A1 true EP2397386A1 (en) | 2011-12-21 |
EP2397386B1 EP2397386B1 (en) | 2018-08-15 |
Family
ID=44652073
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP10252104.4A Active EP2397386B1 (en) | 2010-06-21 | 2010-12-13 | Status monitoring apparatus of railway vehicle |
Country Status (2)
Country | Link |
---|---|
EP (1) | EP2397386B1 (en) |
JP (1) | JP5520142B2 (en) |
Cited By (12)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP3053801A1 (en) * | 2015-02-06 | 2016-08-10 | ALSTOM Transport Technologies | Public transport vehicle with panoramic view |
US20170013237A1 (en) * | 2014-03-28 | 2017-01-12 | Hitachi Kokusai Electric Inc. | Monitoring system and monitoring method |
GB2558694A (en) * | 2017-01-12 | 2018-07-18 | Hitachi Int Electric Inc | Monitoring system and monitoring method |
CN108382304A (en) * | 2018-02-09 | 2018-08-10 | 上海市城市建设设计研究总院(集团)有限公司 | Subway platform door work monitoring device based on LTE communication and its operation method |
CN109584586A (en) * | 2018-12-20 | 2019-04-05 | 铜陵有色金属集团铜冠物流有限公司 | A kind of level crossing security multi-angle of view auxiliary monitoring device |
US10462448B2 (en) | 2015-11-09 | 2019-10-29 | Mitsubishi Electric Corporation | Image generation system and image generation method |
EP2922293B1 (en) * | 2014-03-20 | 2020-01-08 | MAN Truck & Bus SE | Method for monitoring the vehicle interior and the vehicle exterior |
EP3663161A4 (en) * | 2017-07-31 | 2021-06-23 | Hitachi Kokusai Electric Inc. | Video display system and video display method |
GB2591278A (en) * | 2020-01-24 | 2021-07-28 | Bombardier Transp Gmbh | A monitoring system of a rail vehicle, a method for monitoring and a rail vehicle |
WO2021156060A1 (en) * | 2020-02-04 | 2021-08-12 | Siemens Mobility GmbH | Method and system for monitoring the surroundings of a means of transportation |
GB2597561A (en) * | 2020-02-18 | 2022-02-02 | Mtr Corporation Ltd | Monitoring railway nodes |
US11335036B2 (en) | 2018-01-10 | 2022-05-17 | Hitachi, Ltd. | Image synthesizing system and image synthesizing method |
Families Citing this family (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP6307795B2 (en) * | 2013-05-17 | 2018-04-11 | オムロン株式会社 | Image processing apparatus, image processing method, and image processing program |
JP6281249B2 (en) * | 2013-11-09 | 2018-02-21 | 富士通株式会社 | Information processing apparatus, information processing system, program, and information processing method |
KR101766241B1 (en) * | 2015-12-15 | 2017-08-09 | 한국철도기술연구원 | Platform screen door system |
JP6587253B2 (en) * | 2016-03-02 | 2019-10-09 | シャープ株式会社 | Image processing apparatus and image processing method |
JP6943986B2 (en) | 2018-01-31 | 2021-10-06 | 株式会社日立製作所 | Vehicle information control device |
JP2019191853A (en) * | 2018-04-24 | 2019-10-31 | クラリオン株式会社 | Image processing device and image processing method |
WO2021106112A1 (en) * | 2019-11-27 | 2021-06-03 | 株式会社日立製作所 | Vehicle state monitoring device and state monitoring method |
TWI735201B (en) * | 2020-04-09 | 2021-08-01 | 台灣高速鐵路股份有限公司 | Vehicle end wall display device for railway vehicle |
JP2021002835A (en) * | 2020-09-01 | 2021-01-07 | 株式会社日立国際電気 | Monitoring system and monitoring method |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2002104189A (en) | 2000-09-28 | 2002-04-10 | Matsushita Electric Ind Co Ltd | Train operation support system, ground apparatus for train operation support, and vehicle apparatus for train operation support |
EP1382506A1 (en) * | 2002-07-18 | 2004-01-21 | Safecom Engineering Ag | Security device for monitoring the area of the vehicle doors and part of the platform |
WO2004078552A1 (en) * | 2003-03-05 | 2004-09-16 | Walter Lorenz | Method and device for monitoring the entry zone of vehicles |
WO2007015446A1 (en) | 2005-08-02 | 2007-02-08 | Nissan Motor Co., Ltd. | Device for monitoring around vehicle and method for monitoring around vehicle |
Family Cites Families (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH0993565A (en) * | 1995-09-20 | 1997-04-04 | Fujitsu General Ltd | Safety monitor for boarding and alighting passengers |
JP4726586B2 (en) * | 2005-09-20 | 2011-07-20 | 鈴木 旭 | Car drive recorder |
JP4847913B2 (en) * | 2007-03-30 | 2011-12-28 | 日立建機株式会社 | Work machine periphery monitoring device |
JP5182566B2 (en) * | 2008-03-14 | 2013-04-17 | サクサ株式会社 | Monitoring device |
-
2010
- 2010-06-21 JP JP2010140926A patent/JP5520142B2/en active Active
- 2010-12-13 EP EP10252104.4A patent/EP2397386B1/en active Active
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2002104189A (en) | 2000-09-28 | 2002-04-10 | Matsushita Electric Ind Co Ltd | Train operation support system, ground apparatus for train operation support, and vehicle apparatus for train operation support |
EP1382506A1 (en) * | 2002-07-18 | 2004-01-21 | Safecom Engineering Ag | Security device for monitoring the area of the vehicle doors and part of the platform |
WO2004078552A1 (en) * | 2003-03-05 | 2004-09-16 | Walter Lorenz | Method and device for monitoring the entry zone of vehicles |
WO2007015446A1 (en) | 2005-08-02 | 2007-02-08 | Nissan Motor Co., Ltd. | Device for monitoring around vehicle and method for monitoring around vehicle |
Cited By (18)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP2922293B1 (en) * | 2014-03-20 | 2020-01-08 | MAN Truck & Bus SE | Method for monitoring the vehicle interior and the vehicle exterior |
US20170013237A1 (en) * | 2014-03-28 | 2017-01-12 | Hitachi Kokusai Electric Inc. | Monitoring system and monitoring method |
AU2016200631B2 (en) * | 2015-02-06 | 2021-08-19 | Alstom Holdings | A public transport vehicle with a panoramic view |
EP3053801A1 (en) * | 2015-02-06 | 2016-08-10 | ALSTOM Transport Technologies | Public transport vehicle with panoramic view |
EP3053801B1 (en) | 2015-02-06 | 2020-08-05 | ALSTOM Transport Technologies | Public transport vehicle with panoramic view |
US10462448B2 (en) | 2015-11-09 | 2019-10-29 | Mitsubishi Electric Corporation | Image generation system and image generation method |
GB2558694A (en) * | 2017-01-12 | 2018-07-18 | Hitachi Int Electric Inc | Monitoring system and monitoring method |
GB2558694B (en) * | 2017-01-12 | 2020-03-25 | Hitachi Int Electric Inc | Monitoring system and monitoring method |
EP3663161A4 (en) * | 2017-07-31 | 2021-06-23 | Hitachi Kokusai Electric Inc. | Video display system and video display method |
US11394885B2 (en) | 2017-07-31 | 2022-07-19 | Hitachi Kokusai Electric Inc. | Image display system and image display method |
US11335036B2 (en) | 2018-01-10 | 2022-05-17 | Hitachi, Ltd. | Image synthesizing system and image synthesizing method |
CN108382304A (en) * | 2018-02-09 | 2018-08-10 | 上海市城市建设设计研究总院(集团)有限公司 | Subway platform door work monitoring device based on LTE communication and its operation method |
CN109584586A (en) * | 2018-12-20 | 2019-04-05 | 铜陵有色金属集团铜冠物流有限公司 | A kind of level crossing security multi-angle of view auxiliary monitoring device |
CN109584586B (en) * | 2018-12-20 | 2021-07-13 | 铜陵有色金属集团铜冠物流有限公司 | Digital safety multi-view auxiliary monitoring device for railway crossing |
WO2021148499A1 (en) * | 2020-01-24 | 2021-07-29 | Bombardier Transportation Gmbh | A fish eye camera based monitoring system of a rail vehicle, corresponding method for monitoring and a rail vehicle with such a system |
GB2591278A (en) * | 2020-01-24 | 2021-07-28 | Bombardier Transp Gmbh | A monitoring system of a rail vehicle, a method for monitoring and a rail vehicle |
WO2021156060A1 (en) * | 2020-02-04 | 2021-08-12 | Siemens Mobility GmbH | Method and system for monitoring the surroundings of a means of transportation |
GB2597561A (en) * | 2020-02-18 | 2022-02-02 | Mtr Corporation Ltd | Monitoring railway nodes |
Also Published As
Publication number | Publication date |
---|---|
EP2397386B1 (en) | 2018-08-15 |
JP2012001191A (en) | 2012-01-05 |
JP5520142B2 (en) | 2014-06-11 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP2397386B1 (en) | Status monitoring apparatus of railway vehicle | |
KR102395276B1 (en) | Apparatus for inspecting driver assistance system of vehicle and method for controlling the same | |
JP4639753B2 (en) | Driving assistance device | |
US20170140542A1 (en) | Vehicular image processing apparatus and vehicular image processing system | |
US6693518B2 (en) | Surround surveillance system for mobile body, and mobile body, car, and train using the same | |
KR100917330B1 (en) | Top view monitor system and method of vehicle | |
JP4832321B2 (en) | Camera posture estimation apparatus, vehicle, and camera posture estimation method | |
JP6196444B2 (en) | Peripheral vehicle position tracking apparatus and method | |
KR101547415B1 (en) | Monitoring the close vicinity around a commercial vehicle | |
CN114423670B (en) | Roof for a motor vehicle comprising a sensor module | |
JP2008141578A (en) | Visual recognizing apparatus for vehicle surrounding | |
US10861192B2 (en) | Vehicle device, calibration result determination method, and non-transitory storage medium | |
JP6902109B2 (en) | Display devices, imaging display systems, and trains | |
KR101980966B1 (en) | Method and device for representing the surroundings of a motor vehicle | |
JP6684219B2 (en) | Device and method for visual background viewing with electronic display for vehicles | |
JP4501708B2 (en) | Driver's face orientation determination device | |
EP4344953A1 (en) | Movable apparatus and installation method for imaging device | |
US20160129838A1 (en) | Wide angle rear and side view monitor | |
JP6052194B2 (en) | Mobile management device | |
KR101665590B1 (en) | Lane Recognition Apparatus and Method using Blackbox and AVM | |
US10933812B1 (en) | Outside-vehicle environment monitoring apparatus | |
JP2016013888A (en) | Obstacle notification system of crane vehicle | |
WO2021148499A1 (en) | A fish eye camera based monitoring system of a rail vehicle, corresponding method for monitoring and a rail vehicle with such a system | |
US20240217452A1 (en) | Imaging system, movable apparatus, and storage medium | |
EP4344952A1 (en) | Movable apparatus and installation method for imaging device |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
17P | Request for examination filed |
Effective date: 20101223 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
AX | Request for extension of the european patent |
Extension state: BA ME |
|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
17Q | First examination report despatched |
Effective date: 20170810 |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
INTG | Intention to grant announced |
Effective date: 20180514 |
|
GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: EP Ref country code: GB Ref legal event code: FG4D Ref country code: AT Ref legal event code: REF Ref document number: 1029396 Country of ref document: AT Kind code of ref document: T Effective date: 20180815 |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: FG4D |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R096 Ref document number: 602010052720 Country of ref document: DE |
|
REG | Reference to a national code |
Ref country code: NL Ref legal event code: MP Effective date: 20180815 |
|
REG | Reference to a national code |
Ref country code: LT Ref legal event code: MG4D |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: MK05 Ref document number: 1029396 Country of ref document: AT Kind code of ref document: T Effective date: 20180815 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: NL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180815 Ref country code: RS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180815 Ref country code: LT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180815 Ref country code: FI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180815 Ref country code: SE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180815 Ref country code: BG Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20181115 Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20181116 Ref country code: NO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20181115 Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20181215 Ref country code: AT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180815 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: HR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180815 Ref country code: LV Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180815 Ref country code: ES Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180815 Ref country code: AL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180815 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CZ Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180815 Ref country code: RO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180815 Ref country code: EE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180815 Ref country code: PL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180815 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R097 Ref document number: 602010052720 Country of ref document: DE |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180815 Ref country code: SM Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180815 Ref country code: DK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180815 |
|
PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
26N | No opposition filed |
Effective date: 20190516 |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: PL |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180815 Ref country code: LU Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20181213 Ref country code: MC Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180815 |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: MM4A |
|
REG | Reference to a national code |
Ref country code: BE Ref legal event code: MM Effective date: 20181231 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20181213 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: BE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20181231 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LI Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20181231 Ref country code: CH Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20181231 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MT Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20181213 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: TR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180815 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: PT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180815 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MK Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20180815 Ref country code: CY Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180815 Ref country code: HU Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO Effective date: 20101213 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: IT Payment date: 20221111 Year of fee payment: 13 Ref country code: FR Payment date: 20221110 Year of fee payment: 13 Ref country code: DE Payment date: 20221102 Year of fee payment: 13 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: GB Payment date: 20231102 Year of fee payment: 14 |