CN112088139A - Passenger conveyor point inspection system for determining cycle time of handrail - Google Patents
Passenger conveyor point inspection system for determining cycle time of handrail Download PDFInfo
- Publication number
- CN112088139A CN112088139A CN201880093223.3A CN201880093223A CN112088139A CN 112088139 A CN112088139 A CN 112088139A CN 201880093223 A CN201880093223 A CN 201880093223A CN 112088139 A CN112088139 A CN 112088139A
- Authority
- CN
- China
- Prior art keywords
- time
- series data
- similarity
- handrail
- cycle time
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000007689 inspection Methods 0.000 title claims abstract description 54
- 238000004364 calculation method Methods 0.000 claims abstract description 50
- 238000003384 imaging method Methods 0.000 claims abstract description 47
- 238000000605 extraction Methods 0.000 claims abstract description 35
- 239000000284 extract Substances 0.000 claims abstract description 18
- 238000012545 processing Methods 0.000 description 11
- 230000006870 function Effects 0.000 description 9
- 238000010586 diagram Methods 0.000 description 6
- 230000000737 periodic effect Effects 0.000 description 4
- 239000013598 vector Substances 0.000 description 4
- 238000001514 detection method Methods 0.000 description 3
- 238000012423 maintenance Methods 0.000 description 3
- 238000005259 measurement Methods 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 238000012935 Averaging Methods 0.000 description 1
- 238000009825 accumulation Methods 0.000 description 1
- 238000005311 autocorrelation function Methods 0.000 description 1
- 239000002131 composite material Substances 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000001788 irregular Effects 0.000 description 1
- 239000003550 marker Substances 0.000 description 1
- 238000000034 method Methods 0.000 description 1
- 239000000523 sample Substances 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
Images
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B66—HOISTING; LIFTING; HAULING
- B66B—ELEVATORS; ESCALATORS OR MOVING WALKWAYS
- B66B25/00—Control of escalators or moving walkways
- B66B25/006—Monitoring for maintenance or repair
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B66—HOISTING; LIFTING; HAULING
- B66B—ELEVATORS; ESCALATORS OR MOVING WALKWAYS
- B66B31/00—Accessories for escalators, or moving walkways, e.g. for sterilising or cleaning
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B66—HOISTING; LIFTING; HAULING
- B66B—ELEVATORS; ESCALATORS OR MOVING WALKWAYS
- B66B31/00—Accessories for escalators, or moving walkways, e.g. for sterilising or cleaning
- B66B31/02—Accessories for escalators, or moving walkways, e.g. for sterilising or cleaning for handrails
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/20—Analysis of motion
- G06T7/254—Analysis of motion involving subtraction of images
Landscapes
- Engineering & Computer Science (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Multimedia (AREA)
- Escalators And Moving Walkways (AREA)
- Image Analysis (AREA)
Abstract
The invention aims to provide a passenger conveyor spot inspection system (1) capable of judging the cycle time of one week of a handrail (6) without marks. A point inspection system (1) is provided with an imaging device (10), an extraction unit (112), a calculation unit (113), and a determination unit (114). The imaging device (10) images the 1 st handrail which moves in a circulating manner. An extraction unit (112) extracts, as 1 st time series data, time series data of the feature amount of the 1 st armrest portion of an image captured by an imaging device (10). A calculation unit (113) calculates the 1 st similarity as the similarity between the 1 st time-series data and data obtained by shifting the 1 st time-series data by a shift time. A determination unit (114) determines the cycle time of one turn of the 1 st handrail as the 1 st cycle time on the basis of the change in the 1 st similarity with respect to the shift time.
Description
Technical Field
The invention relates to a spot inspection system of a passenger conveyor.
Background
Documents of the prior art
Patent document
Patent document 1: japanese laid-open patent publication No. 10-338447
Disclosure of Invention
Problems to be solved by the invention
However, the spot inspection system described in patent document 1 determines the moving speed of the handrail based on the moving speed of the mark provided on the handrail. Therefore, it cannot be applied to an armrest having no sign.
The present invention has been made to solve the above problems. The invention aims to provide a passenger conveyor point inspection system capable of judging the cycle time of one week of a handrail without marks.
Means for solving the problems
The passenger conveyor spot inspection system of the present invention comprises: an imaging device which images a 1 st handrail which moves in a circulating manner; an extraction unit that extracts, as 1 st time-series data, time-series data of a feature amount of a 1 st armrest portion of an image captured by an imaging device; a calculation unit that calculates a 1 st similarity as a similarity between the 1 st time-series data and data obtained by shifting the 1 st time-series data by a shift time; and a determination unit that determines the cycle time of the 1 st handrail for one week as the 1 st cycle time based on a change in the 1 st similarity with respect to the shift time.
Effects of the invention
According to the present invention, the spot inspection system includes an imaging device, an extraction unit, a calculation unit, and a determination unit. The imaging device photographs the circularly moving 1 st handrail. The extraction unit extracts a feature amount of a 1 st armrest portion of an image captured by the imaging device as 1 st time series data. The calculation unit calculates a similarity between the 1 st time-series data and data obtained by shifting the 1 st time-series data by the shift time as a 1 st similarity. The determination unit determines the cycle time of the 1 st handrail as the 1 st cycle time based on the 1 st similarity change with respect to the shift time. This makes it possible to determine the cycle time of one week of the handrail without the mark.
Drawings
Fig. 1 is a configuration diagram of a spot inspection system according to embodiment 1.
Fig. 2 is a diagram showing an example of determining the cycle time of the handrail by the spot inspection device according to embodiment 1.
Fig. 3 is a flowchart showing an example of the operation of the spot inspection device according to embodiment 1.
Fig. 4 is a diagram showing a hardware configuration of a main part of the spot inspection device according to embodiment 1.
Detailed Description
A mode for carrying out the present invention will be described with reference to the accompanying drawings. The same or corresponding portions are denoted by the same reference numerals in the respective drawings, and overlapping description is appropriately simplified or omitted.
Fig. 1 is a configuration diagram of a spot inspection system according to embodiment 1.
The spot inspection system 1 is applied to an escalator 2. The escalator 2 is an example of a passenger conveyor.
In the escalator 2, an upper landing entrance 3a is provided at an upper floor. The lower landing entrance 3b is provided on the lower floor.
The escalator 2 includes a main frame 4, a plurality of steps 5, a pair of handrails 6, a drive device 7, and a pair of handrail drive devices 8.
The main frame 4 is installed between the upper landing port 3a and the lower landing port 3 b. The main frame 4 has an upper machine room 9a and a lower machine room 9 b. The upper machine room 9a is provided at the upper end of the main frame 4. The upper machine room 9a is provided below the upper boarding/alighting port 3 a. The lower machine room 9b is provided at the lower end portion of the main frame 4. The lower machine room 9b is provided below the lower landing port 3 b.
The plurality of steps 5 are arranged in a ring shape. Each of the plurality of steps 5 has a boundary mark 5a at the edge of the upper surface. The boundary mark 5a is formed of a different color from the center portion of the step, for example, so that the edge of the upper surface can be shown to the passenger.
The pair of handrails 6 are provided on the left and right of the plurality of steps 5, respectively. The pair of armrests 6 are each formed in a ring shape. One of the pair of handrails 6 is an example of the 1 st handrail. The other of the pair of handrails 6 is an example of the 2 nd handrail.
The drive means 7 are arranged in the upper machine room 9 a. The driving device 7 is configured to cyclically move each of the plurality of steps 5 with the upper side as the outward path.
The pair of handrail driving devices 8 are configured to be capable of interlocking with the driving devices 7, respectively. The pair of handrail driving devices 8 are configured to be able to circulate the pair of handrails 6, respectively.
When the escalator 2 is operated, the drive device 7 circulates and moves each of the plurality of steps 5 with the upper side as the outward path. The steps 5 moving in the outward route are arranged in a step shape on the fixed inclined portion of the escalator 2. The drive 7 interlocks each handrail drive device 8 of a pair of handrail drive devices 8. The pair of handrail driving devices 8 cyclically move the pair of handrails 6 with the upper sides thereof as outward paths, respectively. The pair of handrails 6 cyclically move in synchronization with the plurality of steps 5, respectively.
During the upward movement of the escalator 2, a user grips one of the pair of handrails 6 and ascends the upper surface of the steps 5 through the lower landing entrance 3 b. The user gets on the steps 5 moving on the way and moves from the lower floor to the upper floor. The user lets go of the handrail 6 held by the user and gets out of the step 5 at the upper landing entrance 3 a.
When the escalator 2 is moving downward, a user grips one of the pair of handrails 6 and ascends the upper surface of the steps 5 from the upper landing entrance 3 a. The user gets on the steps 5 moving in the outward route and moves from the upper floor to the lower floor. The user lets go of the handrail 6 held by the user and gets out of the step 5 at the lower landing entrance 3 b.
The spot inspection system 1 includes an imaging device 10 and a spot inspection device 11.
The imaging device 10 is provided at the lower landing entrance 3 b. The image pickup device 10 is fixedly provided. The imaging device 10 is configured to be able to capture an image in a direction in which the image is directed. The imaging device 10 faces the pair of handrails 6 and the plurality of steps 5.
The pointing device 11 includes an input unit 111, an extraction unit 112, a calculation unit 113, a determination unit 114, and a display notification unit 115.
The input unit 111 is connected to the imaging device 10 so as to be able to acquire image data representing an image captured by the imaging device 10. The image data is, for example, moving image data composed of a sequence of frames corresponding to a plurality of times at predetermined time intervals. The frame is, for example, data representing a still image.
The extraction unit 112 is connected to the input unit 111 so as to be able to acquire image data. The extraction unit 112 is configured to be able to extract time series data of feature amounts from an image portion represented by image data. The time-series data is a data series corresponding to a plurality of times at predetermined time intervals. The time-series data extracted from the 1 st handrail portion of the image is the 1 st time-series data. The time-series data extracted from the 2 nd handrail portion of the image is the 2 nd time-series data.
The calculation unit 113 is connected to the extraction unit 112 so as to be able to acquire time series data. The calculation unit 113 is configured to be able to calculate the similarity between the time-series data and the time-series data obtained by shifting the time-series data by an offset time. The offset time is the time between two instants of time series data. The similarity calculated from the 1 st time series data is the 1 st similarity. The similarity calculated from the 2 nd time series data is the 2 nd similarity.
The determination unit 114 is connected to the calculation unit 113 so as to be able to acquire data of the similarity calculated by the calculation unit 113. The determination unit 114 is configured to be able to determine the cycle time of each of the pair of armrests 6 in one week based on the data of the similarity. The cycle time of one week of the 1 st handrail is the 1 st cycle time. The cycle time of one week of the 2 nd handrail is the 2 nd cycle time.
The display notification unit 115 is connected to the determination unit 114 so as to be able to acquire the cycle time data determined by the determination unit 114. The display notification unit 115 is configured to display the cycle time based on the acquired data.
Next, the function of the spot detection system 1 will be described.
Fig. 2 is a diagram showing an example of determining the cycle time of the handrail by the spot inspection device according to embodiment 1.
After the start of the operation, the imaging device 10 images each of the pair of handrails 6 and the plurality of steps 5 that are circulating at a predetermined speed. The imaging device 10 images the surfaces of the pair of handrails 6, respectively. That is, the pair of armrests 6 are cyclically moved to sequentially capture different portions of the surface by the imaging device 10. Here, the surfaces of the pair of handrails 6 have damage, dirt, and the like that naturally adhere to the surfaces of the escalator 2. Images obtained by imaging different portions of the surfaces of the pair of armrests 6 have different feature amounts depending on damage, dirt, and the like. Therefore, the feature amounts of the respective portions of the pair of armrests 6 in the image captured by the imaging device 10 sequentially change. On the other hand, when the pair of armrests 6 make exactly one turn by circulating movement, the same portion of the surface is photographed by the imaging device 10. Therefore, the feature amount of each portion of the pair of handrails 6 of the image captured by the imaging device 10 periodically changes with the cycle time of one week of each of the pair of handrails 6 as a period.
The input unit 111 acquires image data captured by the imaging device 10. The input unit 111 acquires image data until the time indicated by the acquired image data exceeds the set cycle time by at least 2 times. The set cycle time is, for example, a cycle time of one revolution of the pair of handrails 6 set according to the specification of the escalator 2. The set cycle time is set in common for each of the pair of armrests 6. The set cycle time is calculated by dividing the length of one revolution of the pair of handrails 6 by the moving speed set for the pair of handrails 6. The length of one turn of the pair of handrails 6 is, for example, the length in the specification of the escalator 2. The moving speed set for the pair of handrails 6 is, for example, a rated speed for normal operation of the escalator 2.
The extraction unit 112 initializes each of the pair of temporary data sequences by setting the pair of temporary data sequences as a null sequence, for example. The extraction unit 112 acquires one frame corresponding to the time from the image data. The extraction unit 112 extracts feature amounts from respective portions of the pair of armrests 6 in the image represented by the acquired frame. The feature amount is, for example, a luminance integrated value of pixels constituting a target image portion. The extraction unit 112 adds the feature amounts extracted from the respective portions of the pair of armrests 6 to the respective data series of the pair of data series. Similarly, the extraction unit 112 adds the extracted feature amount of each of the pair of armrests 6 to each of the pair of data sequences for the frame corresponding to the next time. The extraction unit 112 extracts a pair of data sequences obtained from feature values of a plurality of frames constituting the acquired image data as 1 st time-series data and 2 nd time-series data, respectively.
The 1 st time series data indicates the feature amount of the 1 st handrail portion of the image captured by the imaging device 10. That is, the 1 st time-series data is periodic time-series data in which the 1 st cycle time is a period. Likewise, the 2 nd time-series data indicates the feature amount of the 2 nd handrail portion of the image captured by the imaging device 10. That is, the 2 nd time-series data is periodic time-series data in which the 2 nd cycle time is a period.
The calculation unit 113 acquires the 1 st time-series data and the 2 nd time-series data from the extraction unit 112. The calculation unit 113 calculates the similarity between the acquired 1 st time-series data and the time-series data obtained by shifting the 1 st time-series data by the shift time while changing the shift time. Similarly, the calculation unit 113 calculates the similarity between the 2 nd time-series data and the time-series data obtained by shifting the 2 nd time-series data by the shift time while changing the shift time.
When the offset time is included in the 1 st time range, the calculation unit 113 does not calculate the 1 st similarity and the 2 nd similarity. The 1 st time range is, for example, a range from 0 to a time shorter than the set cycle time. The 1 st time range does not include the set cycle time. That is, the calculation unit 113 does not calculate the 1 st similarity and the 2 nd similarity with respect to the shift time shorter than the predetermined time.
The calculation unit 113 calculates the similarity between the range from the start time of the 1 st time series data to the time after the offset time and the range obtained by offsetting the range of the 1 st time series data by the offset time. Similarly, the calculation unit 113 calculates the similarity between the range from the start time of the 2 nd time-series data to the time after the offset time and the range obtained by offsetting the range of the 2 nd time-series data by the offset time.
The calculation unit 113 calculates the 1 st similarity for the 1 st time series data, for example, as follows. The calculation unit 113 similarly calculates the 2 nd similarity with respect to the 2 nd time series data. For example, for an offset time t1The calculation unit 113 calculates the 1 st similarity as the similarity between the first half time-series data and the second half time-series data with respect to the 1 st time-series data. The time sequence data of the first half part is that an offset time t passes from the starting time to the beginning time1Time series data of the time of day. The second half of the time-series data is the time after the beginning time and the offset time t1To a time 2t after the start time by 2 times the offset time1Time series data of the time of day. That is, the time-series data of the front half and the rear half have N, respectively1In the case of dot data, the calculation unit 113 calculates the 1 st to N th dot1Characteristic quantity of1+1 to 2N1The similarity between the feature quantities of individuals was taken as the 1 st similarity. The calculation unit 113 calculates, for example, the reciprocal of the mean square value of the difference between the first half time-series data and the second half time-series data as the similarity.
At an offset time t1Number of first half of the cycle time less than 1 st cycle timeThe starting point and the starting point of the time series data of the latter half represent the feature quantities of mutually different parts of the surface of the 1 st handrail. That is, the first half of the time series data is not similar to the second half of the time series data. At this time, for the offset time t1The value of the 1 st similarity calculated by the calculation unit 113 is small.
At an offset time t2In the case of the 1 st cycle time, the start point of the first half of the time series data and the start point of the second half of the time series data indicate the feature values of the same portion of the 1 st handrail surface. That is, the first half of the time series data is similar to the second half of the time series data. At this time, for the offset time t2The 1 st similarity calculated by the calculation unit 113 has a large value.
At an offset time t3When the time is longer than the 1 st cycle time, the start point of the first half of the time series data and the start point of the second half of the time series data indicate the feature values of mutually different portions of the 1 st handrail surface. That is, the first half of the time series data is not similar to the second half of the time series data. At this time, for the offset time t3The value of the 1 st similarity calculated by the calculation unit 113 is small.
For example, when the input unit 111 acquires image data having a length 2 times or more and less than 3 times the set cycle time, the calculation unit 113 calculates the 1 st similarity and the 2 nd similarity with respect to the offset time up to 1.5 times or less of the set cycle time. In the relationship between the 1 st similarity and the shift time, the 1 st similarity is maximum when the shift time is the 1 st cycle time.
Also, in the relationship between the 2 nd similarity and the shift time, when the shift time is the 2 nd cycle time, the 2 nd similarity becomes the maximum value.
The determination unit 114 acquires data of the 1 st similarity and the 2 nd similarity calculated by the calculation unit 113. The determination unit 114 searches for a shift time in which the 1 st similarity is the maximum in the 2 nd time range. The 2 nd time range is, for example, a range of time exceeding at least one time of the set cycle time. The 2 nd time range includes the set cycle time. The determination unit 114 determines the searched offset time as the 1 st cycle time. Similarly, the determination unit 114 determines the shift time searched for as the shift time at which the 2 nd similarity is the maximum as the 2 nd cycle time.
The determination unit 114 determines the cycle time of one cycle of the steps 5, for example, as described below. The determination unit 114 counts the number of steps 5 captured in the image captured by the imaging device 10, for example, using the boundary mark 5a as a marker. The determination unit 114 determines the time until the number of captured steps 5 becomes the number of steps 5 of one circle as the cycle time of one circle of the steps 5.
The determination unit 114 measures the difference between the 1 st cycle time and the 2 nd cycle time. The determination unit 114 determines the moving speed of each of the pair of handrails 6 by dividing the length of one turn of the pair of handrails 6 by the 1 st cycle time or the 2 nd cycle time. The determination unit 114 measures a difference in the moving speed of the pair of handrails 6.
The determination unit 114 measures the difference between the 1 st cycle time or the 2 nd cycle time and the cycle time of one cycle of the step 5. The determination unit 114 measures the movement speed of the steps 5 by dividing the length of one turn of the track in which the steps 5 circulate by the circulation time of the steps 5. The determination unit 114 measures a difference between the moving speed of each of the pair of handrails 6 and the moving speed of the steps 5.
The display notification unit 115 acquires data of the 1 st cycle time, the 2 nd cycle time, and the cycle time of one cycle of the step 5 determined by the determination unit 114. The display notification unit 115 acquires data on the difference between the 1 st cycle time and the 2 nd cycle time measured by the determination unit 114, the difference between the 1 st cycle time and the cycle time of one cycle of the step 5, and the difference between the 2 nd cycle time and the cycle time of one cycle of the step 5. The display notification unit 115 stores the acquired data. The display notification unit 115 displays the 1 st cycle time, the 2 nd cycle time, and the cycle time of one cycle of the step 5, respectively, based on the acquired data. The display notification unit 115 displays the difference between the 1 st cycle time and the 2 nd cycle time, the difference between the 1 st cycle time and the cycle time of one cycle of the step 5, and the difference between the 2 nd cycle time and the cycle time of one cycle of the step 5, respectively, based on the acquired data.
Next, an example of the operation of the spot inspection device 11 according to embodiment 1 will be described with reference to fig. 3.
Fig. 3 is a flowchart showing an example of the operation of the spot inspection device according to embodiment 1.
In step S1, the input unit 111 acquires one frame of image data from the imaging device 10. Then, the operation of the spot inspection device 11 proceeds to step S2.
In step S2, the extraction unit 112 extracts time series data of the feature amount of the already acquired frame. Then, the operation of the spot inspection device 11 proceeds to step S3.
In step S3, the calculation unit 113 determines whether or not the number of frames already acquired is an even number. If the determination result is "no", the operation of the spot inspection device 11 proceeds to step S1. If the determination result is yes, the operation of the spot inspection device 11 proceeds to step S4.
In step S4, the calculation unit 113 determines whether or not the offset time is not included in the 1 st time range, using half of the time corresponding to the number of frames already acquired as the offset time. If the determination result is "no", the operation of the spot inspection device 11 proceeds to step S1. If the determination result is yes, the operation of the spot inspection device 11 proceeds to step S5.
In step S5, the calculation unit 113 calculates the similarity between the first half of the time-series data and the second half of the time-series data, using half of the time corresponding to the number of frames that have already been acquired as the offset time. Then, the operation of the spot inspection device 11 proceeds to step S6.
In step S6, the determination unit 114 determines whether or not the shift time exceeds the upper limit of the 2 nd time range, with half the time corresponding to the number of frames that have already been acquired as the shift time. If the determination result is "no", the operation of the spot inspection device 11 proceeds to step S1. If the determination result is yes, the operation of the spot inspection device 11 proceeds to step S7.
In step S7, the determination unit 114 searches for a shift time having the greatest similarity in the 2 nd time range. Then, the operation of the spot inspection device 11 proceeds to step S8.
In step S8, the determination unit 114 determines the searched offset time as the cycle time. Then, the display notification unit 115 displays the determined cycle time. Then, the operation of the spot inspection device 11 is ended.
As described above, the spot inspection system 1 according to embodiment 1 includes the imaging device 10, the extraction unit 112, the calculation unit 113, and the determination unit 114. The imaging device 10 photographs the 1 st handrail that moves cyclically. The extraction unit 112 extracts time series data of the feature amount of the 1 st armrest portion of the image captured by the imaging device 10 as the 1 st time series data. The calculation unit 113 calculates the 1 st similarity as the similarity between the 1 st time-series data and the data obtained by shifting the 1 st time-series data by the shift time. The determination unit 114 determines the cycle time of the 1 st handrail for one round as the 1 st cycle time based on the 1 st similarity change with respect to the shift time.
The damage or dirt that naturally adheres to the surface of the first handrail 1 due to the operation of the escalator 2 is an irregular pattern. On the other hand, the same portion of the 1 st handrail is imaged by the imaging device 10 by the circulating movement of the 1 st handrail for one round. Therefore, the 1 st time series data of the feature amount extracted from the 1 st handrail part becomes periodic time series data with the 1 st cycle time as a period. Here, the determination unit 114 obtains the cycle of the 1 st time series data indicating the feature amount that changes according to the dirt or the like on the 1 st handrail surface, from the relationship between the shift time and the 1 st similarity. In this case, the spot inspection device 11 does not need prior information about the portion of the 1 st handrail surface where damage or dirt is present. Therefore, the determination unit 114 can determine the cycle time of the 1 st handrail without the mark.
The determination unit 114 does not need a known mark or a periodic pattern such as a shape, a color, and a position. Therefore, the spot check system 1 can be applied regardless of the model of the passenger conveyor and the shape of the 1 st handrail.
The determination unit 114 determines the 1 st cycle time based on the image captured by the imaging device 10. Therefore, the spot inspection system 1 can measure the 1 st cycle time without contacting the 1 st handrail. Thus, the spot inspection system 1 does not newly damage the 1 st handrail by contact of a probe for measuring the moving speed of the 1 st handrail. In addition, the imaging device 10 as a measuring device does not require high accuracy in the arrangement with respect to the 1 st hand rail as compared with an optical noncontact type speedometer such as a laser doppler speedometer, for example. Thus, the maintenance personnel can easily measure the 1 st cycle time.
The calculation unit 113 calculates the 1 st similarity as the similarity between the range from the start time of the 1 st time-series data to the time after the offset time and the range obtained by offsetting the range of the 1 st time-series data by the offset time. The determination unit 114 determines the shift time at which the 1 st similarity is the maximum as the 1 st cycle time.
The calculation unit 113 divides a part of the 1 st time-series data into first half time-series data and second half time-series data according to the offset time. The time length of each time series data obtained by division corresponds to the offset time. The calculation unit 113 calculates the similarity between the time-series data obtained by the division as the 1 st similarity. The 1 st similarity is the greatest when the first half of the time-series data and the second half of the time-series data are the most similar. At this time, the offset time corresponds to the time of one week of the 1 st handrail. Therefore, if there is time-series data exceeding the length of two-week time, the determination unit 114 can determine the 1 st cycle time. Thus, the determination unit 114 does not need long time-series data having a plurality of cycles to detect the cycle of the time-series data.
In addition, the determination unit 114 searches for a shift time in which the 1 st similarity is the maximum in the 2 nd time range. The 2 nd time range is a predetermined time range including the set cycle time. The set cycle time is set for the normal operation of the escalator 2.
The time range that can be determined as the 1 st cycle time can be narrowed to the 2 nd time range based on the set cycle time according to the specification of the escalator 2 or the like. The determination unit 114 can efficiently search for the shift time in which the 1 st similarity is the maximum with respect to the narrowed search range.
The 1 st similarity may become extremely large in a plurality of offset times. The determination unit 114 can exclude the shift time that cannot be determined as the 1 st cycle time from the shift times in which the 1 st similarity is maximum. Therefore, the determination unit 114 can suppress erroneous detection of the 1 st cycle time.
Further, the calculation section 113 does not calculate the 1 st similarity for the offset time of the 1 st time range. The 1 st time range is a predetermined time range not including the set cycle time.
The time range that cannot be determined as the 1 st cycle time can be determined as the 1 st time range based on the set cycle time according to the specification of the escalator 2 and the like. The calculation unit 113 does not calculate the 1 st similarity and the 2 nd similarity for the shift time included in the 1 st time range. This reduces the amount of calculation by the calculation unit 113.
Further, the imaging device 10 images the cyclically moving steps 5. The determination unit 114 determines the cycle time of one cycle of the step 5. The determination unit 114 measures the difference between the cycle time and the 1 st cycle time.
Thus, the determination unit 114 can measure the difference between the cycle time of the step 5 and the 1 st cycle time by using one imaging device 10.
Further, the imaging device 10 images the 2 nd handrail that moves cyclically. The extraction unit 112 extracts time series data of the feature amount of the 2 nd handrail portion of the image as the 2 nd time series data. The calculation unit 113 calculates the similarity between the 2 nd time-series data and the data obtained by shifting the 2 nd time-series data by the shift time as the 2 nd similarity. The determination unit 114 determines the cycle time of the 2 nd handrail for one week as the 2 nd cycle time based on the change of the 2 nd similarity with respect to the shift time.
Thus, the determination unit 114 can simultaneously determine the cycle time of one cycle of each of the pair of armrests 6 by one imaging device 10.
The determination unit 114 measures the difference between the 1 st cycle time and the 2 nd cycle time.
Thus, the determination unit 114 can measure the difference between the 1 st cycle time and the 2 nd cycle time by using one imaging device 10.
The extraction unit 112 may extract time-series data having a plurality of components corresponding to a plurality of feature values of the 1 st handrail portion of the image as the 1 st time-series data.
The extraction unit 112 initializes each of the pair of temporary data sequences. The extraction unit 112 acquires one frame corresponding to the time from the image data. The extraction unit 112 extracts a plurality of feature values from each of the pair of armrests 6 in the image represented by the acquired frame. The plurality of feature amounts are, for example, luminance integrated values for each color of pixels constituting an image portion as a target. The extraction unit 112 generates a feature vector having a plurality of components including the extracted plurality of feature quantities. The extraction unit 112 adds each feature vector generated from each of the pair of armrests 6 to each of the pair of data sequences. Similarly, the extraction unit 112 adds the extracted feature vector of each of the pair of armrests 6 to each of the pair of data sequences for the frame corresponding to the next time. The extraction unit 112 extracts each of a pair of data sequences obtained from feature vectors of a plurality of frames constituting the acquired image data as the 1 st time-series data and the 2 nd time-series data.
Thus, the spot inspection system 1 can flexibly select and switch the appropriate type of feature amount according to the model, color, or state of the pair of armrests 6 for measuring the cycle time, or the measurement environment.
The extraction unit 112 may extract a feature amount other than the luminance integrated value. The extraction unit 112 may extract, for example, a coefficient of discrete cosine transform of an image portion from which a feature amount is to be extracted, as the feature amount. The extraction unit 112 may extract a change rate with respect to the preceding and following frames as the feature amount.
When the extracting unit 112 extracts a plurality of feature amounts, the determining unit 114 may automatically select an appropriate type of feature amount. For example, the determination unit 114 may select the optimum feature amount based on the width and height of the peak around the shift time at which the 1 st similarity is the maximum. The determination unit 114 may determine the 1 st cycle time by averaging the cycle times of the 1 st handrail in one week, which are independently determined from the plurality of feature amounts.
The calculation unit 113 may calculate the autocorrelation function as the similarity from an average of products of the residuals of the average values of the time series data from the first half and the residuals of the average values of the time series data from the second half. The calculation unit 113 may calculate the similarity using other quantities. The calculation unit 113 may calculate the similarity by comparing a frequency distribution, moment (moment), or accumulation amount with respect to the time series data of the first half and the time series data of the second half, for example.
For example, the calculation unit 113 may normalize the first-half time-series data and the second-half time-series data by using an average value of the first-half time-series data and the second-half time-series data. Thus, the calculation unit 113 can eliminate the influence of the luminance change in the measurement environment.
The determination unit 114 may search for a shift time in which the 1 st similarity is the maximum, for example, by fitting a gaussian function or the like.
The display notification unit 115 may transmit the data acquired from the determination unit 114 to an external device of the pointing device 11. The external device of the spot inspection device 11 is, for example, a maintenance terminal. The maintenance terminal displays the cycle time according to the received data. The external device of the pointing device 11 may acquire data from the determination unit 114 instead of the display notification unit 115.
The imaging device 10 may be provided at the upper landing entrance 3 a. The camera device 10 may also be provided at the ceiling above the escalator 2. The imaging device 10 may be any of a temporary setting or a permanent setting. The imaging device 10 may be provided inside the upper machine room 9a or the lower machine room 9 b. In this case, the imaging device 10 may image the back surface of at least one of the pair of armrests 6.
The input unit 111 may acquire image data from the imaging device 10 in real time. The input unit 111 may acquire image data recorded in advance by the imaging device 10.
The image data may be in the form of moving Picture data encoded by a video encoding method such as MPEG (Motion Picture Expert Group) -2 or h.264.
The passenger conveyor may also be a travelator.
Next, an example of the hardware configuration of the spot detection device 11 will be described with reference to fig. 4.
Fig. 4 is a diagram showing a hardware configuration of a main part of the spot inspection device according to embodiment 1.
The functions of the pointing device 11 can be implemented by a processing circuit. The processing circuit is provided with at least one processor 11b and at least one memory 11 c. The processing circuit may include the processor 11b and the memory 11c, or may include at least one dedicated hardware 11a instead of these.
When the processing circuit includes the processor 11b and the memory 11c, each function of the pointing device 11 is realized by software, firmware, or a combination of software and firmware. At least one of the software and the firmware is described as a program. The program is stored in the memory 11 c. The processor 11b realizes each function of the pointing device 11 by reading out and executing a program stored in the memory 11 c.
The processor 11b is also called a CPU (Central Processing Unit), a Processing device, an arithmetic device, a microprocessor, a microcomputer, or a DSP. The memory 11c is constituted by, for example, a nonvolatile or volatile semiconductor memory such as a RAM, a ROM, a flash memory, an EPROM, or an EEPROM, a magnetic disk, a flexible disk, an optical disk, a compact disk, a mini disk, or a DVD.
In the case where the processing Circuit includes the dedicated hardware 11a, the processing Circuit is realized by, for example, a single Circuit, a composite Circuit, a programmed processor, a parallel programmed processor, an ASIC (Application Specific Integrated Circuit), an FPGA (Field Programmable Gate Array), or a combination thereof.
The functions of the pointing device 11 can be implemented by the processing circuit. Alternatively, the functions of the spot inspection device 11 may be realized collectively by the processing circuit. The functions of the pointing device 11 may be implemented partially by dedicated hardware 11a and partially by software or firmware. In this way, the processing circuit implements the functions of the spot inspection device 11 by hardware 11a, software, firmware, or a combination thereof.
Industrial applicability
The spot inspection system of the present invention can be applied to a passenger conveyor having a handrail that moves in a circulating manner.
Description of the reference symbols
1: a point inspection system; 2: an escalator; 3 a: an upper landing port; 3 b: a lower landing port; 4: a main frame; 5: a step; 5 a: a demarcation sign; 6: a handrail; 7: a drive device; 8: a handrail drive device; 9 a: an upper machine room; 9 b: a lower machine room; 10: a camera device; 11: a point inspection device; 111: an input section; 112: an extraction unit; 113: a calculation section; 114: a determination unit; 115: a display notification unit; 11 a: hardware; 11 b: a processor; 11 c: a memory.
Claims (8)
1. A passenger conveyor spot inspection system, comprising:
an imaging device which images a 1 st handrail which moves in a circulating manner;
an extraction unit that extracts, as 1 st time-series data, time-series data of a feature amount of the 1 st armrest portion of an image captured by the imaging device;
a calculation unit that calculates a 1 st similarity as a similarity between the 1 st time-series data and data obtained by shifting the 1 st time-series data by a shift time; and
and a determination unit that determines the cycle time of one revolution of the 1 st handrail as the 1 st cycle time based on a change in the 1 st similarity with respect to the shift time.
2. The passenger conveyor spot inspection system of claim 1,
the calculation unit calculates a similarity between a range from a start time of the 1 st time-series data to a time after an offset time and a range obtained by offsetting the range of the 1 st time-series data by the offset time as the 1 st similarity,
the determination unit determines the 1 st cycle time as the offset time at which the 1 st similarity is the maximum.
3. The passenger conveyor spot inspection system of claim 2,
the determination unit searches for a shift time in which the 1 st similarity is the maximum within a predetermined time range including a set cycle time set for a normal operation of the passenger conveyor.
4. The spot inspection system of a passenger conveyor according to any one of claims 1 to 3,
the calculation unit does not calculate the 1 st similarity for an offset time in a predetermined time range that does not include a set cycle time set for a normal operation of the passenger conveyor.
5. The spot inspection system of a passenger conveyor according to any one of claims 1 to 4,
the extraction unit extracts, as the 1 st time-series data, time-series data having a plurality of components corresponding to a plurality of feature quantities of the 1 st handrail portion of the image.
6. The spot inspection system of a passenger conveyor according to any one of claims 1 to 5,
the camera device shoots the steps which move circularly,
the determination unit determines a cycle time of one cycle of the steps, and measures a difference between the cycle time and the 1 st cycle time.
7. The spot inspection system of a passenger conveyor according to any one of claims 1 to 6,
the camera device shoots a circularly moving No. 2 handrail,
the extraction section extracts time-series data of a feature amount of the 2 nd handrail portion of the image as 2 nd time-series data,
the calculation unit calculates a similarity between the 2 nd time-series data and data obtained by shifting the 2 nd time-series data by a shift time as a 2 nd similarity,
the determination unit determines the cycle time of one revolution of the 2 nd handrail as the 2 nd cycle time based on the change of the 2 nd similarity with respect to the shift time.
8. The passenger conveyor spot inspection system of claim 7,
the determination unit measures a difference between the 1 st cycle time and the 2 nd cycle time.
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| PCT/JP2018/020314 WO2019229794A1 (en) | 2018-05-28 | 2018-05-28 | Passenger conveyor inspection system that determines circulation time of handrail |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112088139A true CN112088139A (en) | 2020-12-15 |
| CN112088139B CN112088139B (en) | 2023-04-18 |
Family
ID=68691983
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201880093223.3A Active CN112088139B (en) | 2018-05-28 | 2018-05-28 | Passenger conveyor point inspection system for determining cycle time of handrail |
Country Status (5)
| Country | Link |
|---|---|
| JP (1) | JP6610830B1 (en) |
| KR (1) | KR102246761B1 (en) |
| CN (1) | CN112088139B (en) |
| TW (1) | TWI763980B (en) |
| WO (1) | WO2019229794A1 (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116867723A (en) * | 2021-02-16 | 2023-10-10 | 三菱电机楼宇解决方案株式会社 | Point inspection device for point inspecting state of position relation between comb teeth and clamping plates of passenger conveyor |
| CN116888061A (en) * | 2021-02-16 | 2023-10-13 | 三菱电机楼宇解决方案株式会社 | Point inspection device for point inspecting state of position relation between comb teeth and clamping plates of passenger conveyor |
| CN116917222A (en) * | 2021-02-16 | 2023-10-20 | 三菱电机楼宇解决方案株式会社 | Inspection device for inspecting position relationship between comb teeth and anti-slip strips of passenger conveyor |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2021234825A1 (en) * | 2020-05-19 | 2021-11-25 | 三菱電機株式会社 | Passenger conveyor |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH10338447A (en) * | 1997-06-06 | 1998-12-22 | Hitachi Ltd | Man conveyor controller |
| JP2004361328A (en) * | 2003-06-06 | 2004-12-24 | Hitachi Building Systems Co Ltd | Diagnostic method and device for operation of moving object |
| KR20070044096A (en) * | 2005-10-24 | 2007-04-27 | 티센크루프 동양엘리베이터 주식회사 | People moving apparatus |
| JP2008137752A (en) * | 2006-11-30 | 2008-06-19 | Hitachi Building Systems Co Ltd | Passenger conveyor control method |
| JP2009173364A (en) * | 2008-01-22 | 2009-08-06 | Toshiba Elevator Co Ltd | Failure diagnostic system of passenger conveyer |
| JP2012030952A (en) * | 2010-08-02 | 2012-02-16 | Taisei Corp | Belt conveyor monitoring system |
| JP2014012576A (en) * | 2012-07-04 | 2014-01-23 | Hitachi Building Systems Co Ltd | Moving handrail deterioration diagnostic system |
| CN107207216A (en) * | 2015-02-27 | 2017-09-26 | 三菱电机株式会社 | Passenger conveyors point inspection device, passenger conveyors detecting method and program |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH0570077A (en) * | 1991-09-11 | 1993-03-23 | Hitachi Building Syst Eng & Service Co Ltd | Moving handrail speed detecting device for passenger conveyor |
| SG11201604494RA (en) * | 2013-12-20 | 2016-07-28 | Inventio Ag | Arrangement of a monitoring sensor in an escalator or in a moving walkway |
| JP6262287B2 (en) * | 2016-05-31 | 2018-01-17 | 東芝エレベータ株式会社 | Passenger conveyor |
-
2018
- 2018-05-28 KR KR1020207034796A patent/KR102246761B1/en active IP Right Grant
- 2018-05-28 JP JP2019500686A patent/JP6610830B1/en not_active Expired - Fee Related
- 2018-05-28 CN CN201880093223.3A patent/CN112088139B/en active Active
- 2018-05-28 WO PCT/JP2018/020314 patent/WO2019229794A1/en active Application Filing
-
2019
- 2019-02-21 TW TW108105758A patent/TWI763980B/en not_active IP Right Cessation
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH10338447A (en) * | 1997-06-06 | 1998-12-22 | Hitachi Ltd | Man conveyor controller |
| JP2004361328A (en) * | 2003-06-06 | 2004-12-24 | Hitachi Building Systems Co Ltd | Diagnostic method and device for operation of moving object |
| KR20070044096A (en) * | 2005-10-24 | 2007-04-27 | 티센크루프 동양엘리베이터 주식회사 | People moving apparatus |
| JP2008137752A (en) * | 2006-11-30 | 2008-06-19 | Hitachi Building Systems Co Ltd | Passenger conveyor control method |
| JP2009173364A (en) * | 2008-01-22 | 2009-08-06 | Toshiba Elevator Co Ltd | Failure diagnostic system of passenger conveyer |
| JP2012030952A (en) * | 2010-08-02 | 2012-02-16 | Taisei Corp | Belt conveyor monitoring system |
| JP2014012576A (en) * | 2012-07-04 | 2014-01-23 | Hitachi Building Systems Co Ltd | Moving handrail deterioration diagnostic system |
| CN107207216A (en) * | 2015-02-27 | 2017-09-26 | 三菱电机株式会社 | Passenger conveyors point inspection device, passenger conveyors detecting method and program |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116867723A (en) * | 2021-02-16 | 2023-10-10 | 三菱电机楼宇解决方案株式会社 | Point inspection device for point inspecting state of position relation between comb teeth and clamping plates of passenger conveyor |
| CN116888061A (en) * | 2021-02-16 | 2023-10-13 | 三菱电机楼宇解决方案株式会社 | Point inspection device for point inspecting state of position relation between comb teeth and clamping plates of passenger conveyor |
| CN116917222A (en) * | 2021-02-16 | 2023-10-20 | 三菱电机楼宇解决方案株式会社 | Inspection device for inspecting position relationship between comb teeth and anti-slip strips of passenger conveyor |
| CN116917222B (en) * | 2021-02-16 | 2024-03-01 | 三菱电机楼宇解决方案株式会社 | Inspection device for inspecting position relationship between comb teeth and anti-slip strips of passenger conveyor |
Also Published As
| Publication number | Publication date |
|---|---|
| KR102246761B1 (en) | 2021-04-30 |
| KR20200142087A (en) | 2020-12-21 |
| JP6610830B1 (en) | 2019-11-27 |
| TW202004562A (en) | 2020-01-16 |
| TWI763980B (en) | 2022-05-11 |
| WO2019229794A1 (en) | 2019-12-05 |
| JPWO2019229794A1 (en) | 2020-06-11 |
| CN112088139B (en) | 2023-04-18 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN112088139B (en) | Passenger conveyor point inspection system for determining cycle time of handrail | |
| CN104008371B (en) | Regional suspicious target tracking and recognizing method based on multiple cameras | |
| US8655078B2 (en) | Situation determining apparatus, situation determining method, situation determining program, abnormality determining apparatus, abnormality determining method, abnormality determining program, and congestion estimating apparatus | |
| US20190149770A1 (en) | Information processing system, information processing method, and program | |
| EP3279131A1 (en) | Speed detection system and method for a passenger conveyor | |
| EP3859394A1 (en) | Depth acquisition device, depth acquisition method, and program | |
| US10089535B2 (en) | Depth camera based detection of human subjects | |
| JP6335011B2 (en) | Measuring apparatus and method | |
| US9697421B2 (en) | Stereoscopic camera apparatus | |
| US20190258852A1 (en) | Image processing apparatus, image processing system, image processing method, and program | |
| CN102706319A (en) | Distance calibration and measurement method and system based on image shoot | |
| US20190384969A1 (en) | Image processing apparatus, image processing system, image processing method, and program | |
| KR102096230B1 (en) | Determining source lane of moving item merging into destination lane | |
| CN110612264B (en) | System and method for determining the position of an elevator car of an elevator installation | |
| US20170084048A1 (en) | Measurement device and measurement method | |
| RU2655467C1 (en) | Method of measuring distance on digital video camera with target | |
| JP3702260B2 (en) | Target angular velocity measuring device and target angular velocity measuring method | |
| JP5955404B2 (en) | Distance measuring device and vehicle using the same | |
| US8965048B2 (en) | Heuristic motion detection methods and systems for interactive applications | |
| US9978155B2 (en) | Method and apparatus for counting number of persons | |
| KR100887942B1 (en) | System for sensing abnormal phenomenon on realtime and method for controlling the same | |
| EP3190779A1 (en) | Periodic motion observation system | |
| US20180107870A1 (en) | Human body detection apparatus, control method for human body detection apparatus | |
| JP3947456B2 (en) | Stride measuring device and stride measuring method | |
| US8000499B2 (en) | Automated determination of cross-stream wind velocity from an image series |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information |
Address after: Tokyo, Japan Applicant after: Mitsubishi Electric Building Solutions Co.,Ltd. Address before: Tokyo, Japan Applicant before: MITSUBISHI ELECTRIC BUILDING TECHNO-SERVICE Co.,Ltd. |
|
| CB02 | Change of applicant information | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |