WO2010044186A1 - 動線作成システム、動線作成装置及び3次元動線表示装置 - Google Patents
動線作成システム、動線作成装置及び3次元動線表示装置 Download PDFInfo
- Publication number
- WO2010044186A1 WO2010044186A1 PCT/JP2009/004293 JP2009004293W WO2010044186A1 WO 2010044186 A1 WO2010044186 A1 WO 2010044186A1 JP 2009004293 W JP2009004293 W JP 2009004293W WO 2010044186 A1 WO2010044186 A1 WO 2010044186A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- flow line
- unit
- line
- movement
- rounding
- Prior art date
Links
- 238000001514 detection method Methods 0.000 claims abstract description 38
- 238000003384 imaging method Methods 0.000 claims description 110
- 239000013598 vector Substances 0.000 claims description 80
- 238000000034 method Methods 0.000 claims description 71
- 230000008569 process Effects 0.000 claims description 39
- 230000000007 visual effect Effects 0.000 claims description 13
- 230000002159 abnormal effect Effects 0.000 claims description 8
- 230000008859 change Effects 0.000 claims description 6
- 238000000605 extraction Methods 0.000 claims description 3
- 238000010586 diagram Methods 0.000 description 13
- 238000006243 chemical reaction Methods 0.000 description 7
- 230000010354 integration Effects 0.000 description 7
- 238000013500 data storage Methods 0.000 description 5
- 230000004044 response Effects 0.000 description 5
- 230000007613 environmental effect Effects 0.000 description 4
- 230000006870 function Effects 0.000 description 4
- 238000004458 analytical method Methods 0.000 description 3
- 238000004364 calculation method Methods 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 238000012544 monitoring process Methods 0.000 description 3
- 206010000117 Abnormal behaviour Diseases 0.000 description 2
- 230000005856 abnormality Effects 0.000 description 2
- 238000006073 displacement reaction Methods 0.000 description 2
- 101100043635 Solanum tuberosum SS2 gene Proteins 0.000 description 1
- 102100029860 Suppressor of tumorigenicity 20 protein Human genes 0.000 description 1
- 230000009471 action Effects 0.000 description 1
- 230000006835 compression Effects 0.000 description 1
- 238000007906 compression Methods 0.000 description 1
- 230000003247 decreasing effect Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 239000000284 extract Substances 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000010606 normalization Methods 0.000 description 1
- 239000002245 particle Substances 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/20—Analysis of motion
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S13/00—Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
- G01S13/86—Combinations of radar systems with non-radar systems, e.g. sonar, direction finder
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S13/00—Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
- G01S13/86—Combinations of radar systems with non-radar systems, e.g. sonar, direction finder
- G01S13/867—Combination of radar systems with cameras
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10016—Video; Image sequence
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30196—Human being; Person
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30232—Surveillance
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30241—Trajectory
Definitions
- the present invention relates to a flow line creation system that creates a flow line that is a movement trajectory of an object, a flow line creation apparatus, a flow line creation method and a three-dimensional flow line display apparatus.
- Patent Document 1 Conventionally, there have been devices disclosed in Patent Document 1 and Patent Document 2 as this kind of flow line creation device.
- Patent Document 1 discloses a technique of obtaining a trajectory of a moving object in an image by image processing, and superimposing the trajectory on a moving image for display.
- Patent Document 2 discloses a technique for obtaining positioning data of a mobile using a wireless ID tag attached to the mobile, obtaining a movement locus from the positioning data, and superimposing the locus on a moving image for display. There is.
- JP 2006-350618 A JP, 2005-71252, A Japanese Patent Application Laid-Open No. 4-71083
- Non-Patent Document 1 As a technique for detecting whether or not the moving object has entered an object shadow, there is, for example, a Z buffer method as described in Non-Patent Document 1.
- the Z buffer method uses a 3D model of the imaging space.
- the present invention provides a flow line creation system, a flow line creation apparatus, and a three-dimensional flow line display apparatus that can display the movement trajectory of a tracking object in an easy-to-understand manner without using 3D model information.
- One aspect of the flow line creation system of the present invention is an imaging unit for obtaining a captured image of a region including a tracking target, a positioning unit for positioning the tracking target, and outputting positioning data of the tracking target, A flow line type selection unit that selects a display type of a flow line corresponding to each time point according to whether or not the tracking target is captured in the captured image at each time point, the positioning data, and the flow line type A display for displaying a flow line creation unit that forms flow line data based on the flow line display type selected by the selection unit, an image based on the captured image, and a flow line based on the flow line data Have a department.
- the flow line type selection for selecting the display type of the flow line corresponding to each time point according to whether or not the tracking target is shown in the captured image at each time point
- a flow line generation unit that forms flow line data based on the positioning data of the tracking target and the flow line display type selected by the flow line type selection unit.
- One aspect of the three-dimensional flow line display device of the present invention is an image pickup unit for obtaining a picked-up image including a target, and three-dimensional information including horizontal direction component, depth direction component and height direction component.
- a display unit configured to combine and display the captured image and the rounded movement line on a two-dimensional display.
- a flow line creation system a flow line creation device, and a three-dimensional flow line display device capable of displaying the movement trajectory of a tracking object in an easy-to-understand manner without using 3D model information.
- FIG. 5A is a figure which shows the flow line when a person walks in front of an object
- FIG. 5A is a figure which shows the flow line when a person walks in front of an object
- FIG. 13A is a diagram showing an example of a display image according to the third embodiment, and FIG.
- FIG. 13B is a diagram showing a mouse wheel Block diagram showing the configuration of the three-dimensional flow line display device of the third embodiment Diagram showing movement vector Diagram showing the relationship between the gaze vector and the movement vector 17A and 17B show cases where the gaze vector and the movement vector are close to parallel, and FIG. 17C shows a case where the gaze vector and the movement vector are close to vertical.
- Block diagram showing the configuration of the three-dimensional flow line display device of the fourth embodiment A figure showing an example of a display image of Embodiment 5 Block diagram showing the configuration of the three-dimensional flow line display device of the sixth embodiment
- the figure which shows the example of a display image of Embodiment 6 Block diagram showing the configuration of the three-dimensional flow line display device of the sixth embodiment
- the figure which shows the example of a display image of Embodiment 7 The figure which shows the example of a display image of Embodiment 7
- the figure which shows the example of a display image of Embodiment 7 The figure which shows the example of a display image of Embodiment 7
- the figure which shows the example of a display image of Embodiment 8 Block diagram showing the configuration of the three-dimensional flow line display device of the eighth embodiment
- a tracking object is a person
- the tracking object is not limited to a person, and may be, for example, a vehicle.
- FIG. 1 shows the configuration of a flow line creation system according to an embodiment of the present invention.
- the movement line creation system 100 includes a camera unit 101, a tag reader unit 102, a display unit 103, a data holding unit 104, a movement line type selection unit 105, and a movement line creation unit 106.
- the camera unit 101 includes an imaging unit 101-1 and an image tracking unit 101-2.
- the imaging unit 101-1 captures an area including a tracking target, and sends the captured image S1 to the display unit 103 and the image tracking unit 101-2.
- the image tracking unit 101-2 tracks a person who is a tracking object using the captured image S1 obtained at each time point by the imaging unit 101-1.
- the image tracking unit 101-2 forms a detection flag S2 indicating whether or not a person is detected in the image at each time point as tracking status data, and the detection flag S2 is a data holding unit Send to 104.
- the tag reader unit 102 converts the obtained position coordinates into XY coordinates on the display image, the wireless receiving unit that receives a wireless signal from the wireless tag, the positioning unit that obtains the positional coordinates of the wireless tag based on the received wireless signal, And a coordinate conversion unit.
- the tag reader unit 102 sends the converted coordinate data S3 of the wireless tag to the data holding unit 104.
- the wireless tag itself may be equipped with a positioning function such as GPS, and the result of the positioning itself may be transmitted as a wireless signal to the wireless receiving unit of the tag reader unit 120.
- the tag reader unit 102 may not have a positioning unit.
- the coordinate conversion unit may be provided in the data holding unit 104 instead of being provided in the tag reader unit 102.
- the data holding unit 104 outputs the detection flag S2-1 at each point of time and the coordinate data S3-1 at the same time with respect to the object to be tracked.
- the detection flag S2-1 is input to the flow line type selection unit 105, and the coordinate data S3-1 is input to the flow line creation unit 106.
- the movement line type selection unit 105 determines, based on the detection flag S2-1, whether or not the object to be tracked is behind each time. Specifically, when the detection flag S2-1 is ON (when the tracking target is detected by the camera unit 101, that is, when the tracking target is captured in the captured image), the flow line type selection unit 105 ) Determines that the tracking object is not in shadow. On the other hand, when the detection flag S2-1 is OFF (the tracking unit is not detected by the camera unit 101, that is, the tracking unit is not shown in the captured image) In the case of), it is determined that the object to be tracked is behind the scenes.
- the flow line type selection unit 105 forms a flow line type indication signal S4 based on the determination result, and sends this to the flow line creation unit 106.
- a "solid line” is instructed when the object to be tracked is captured, and a movement line type designating signal S4 instructing "dotted line” is formed when the object to be tracked is not captured.
- the movement line creation unit 106 forms the movement line data S5 by connecting the coordinate data S3-1 at each time point. At this time, the flow line creation unit 106 forms the flow line data S5 by selecting the type of flow line for each line segment based on the flow line type designation signal S4. The flow line data S5 is sent to the display unit 103.
- the display unit 103 superimposes and displays an image based on the captured image S1 input from the camera unit 101 and a flow line based on the flow line data S5 input from the flow line creation unit 106. As a result, in the image captured by the camera unit 101, a movement line that is a movement trajectory of the tracking target is superimposed and displayed.
- step ST10 the camera unit 101 performs imaging by the imaging unit 101-1 in step ST11, and outputs a captured image S1 to the display unit 103 and the image tracking unit 101-2.
- step ST12 the image tracking unit 101-2 detects a person to be tracked from the captured image S1 using a method such as pattern matching.
- step ST13 it is determined whether the image tracking unit 101-2 has detected a person. If a person can be detected, the process proceeds to step ST14, and tracking condition data in which the detection flag S2 is turned on is output. On the other hand, when a person can not be detected, the process proceeds to step ST15, and tracking condition data in which the detection flag S2 is set to OFF is output.
- the camera unit 101 performs a timer process in step ST16 to wait for a predetermined time, and then returns to step ST11.
- the waiting time in the timer process in step ST16 may be set in accordance with the moving speed of the tracking object or the like. For example, the imaging interval may be shortened by setting the standby time to be shorter as the movement speed of the tracking object is faster.
- FIG. 3 shows the operation of the flow line type selection unit 105.
- the flow line type selection unit 105 determines whether the detection flag is ON in step ST21. If the flow line type selection unit 105 determines that the detection flag is ON, the process proceeds to step ST22 and instructs the flow line generation unit 106 to set the flow line type to “solid line”. On the other hand, if it is determined that the detection flag is OFF, the process proceeds to step ST23, and the flow line creation unit 106 is instructed to set the flow line type to "dotted line”. Next, the flow line type selection unit 105 returns to step ST21 after waiting for a predetermined time by performing timer processing in step ST24. The standby time may be set to coincide with the shooting interval of the camera unit 101.
- FIG. 4 shows the operation of the flow line creation unit 106.
- the flow line generation unit 106 acquires the flow line type by inputting the flow line type designation signal S4 from the flow line type selection unit 105 in step ST31, and holds data in step ST32.
- the coordinate data S3-1 of the tracking target is acquired by inputting the coordinate data S3-1 from the unit 104.
- the flow line creation unit 106 creates a flow line by connecting the end point of the flow line created up to the previous time and the coordinate point acquired this time by the flow line of the type acquired this time.
- the flow line creation unit 106 performs a timer process in step ST34 to wait for a predetermined time, and then returns to steps ST31 and ST32.
- the standby time may be set to coincide with the shooting interval of the camera unit 101.
- the standby time in step ST34 may be set to the positioning time interval using the wireless tag (the interval at which the coordinate data S3 at each time point is output from the tag reader unit 102), or even as a predetermined time set in advance. Good. Usually, since the imaging interval of the camera unit 101 is shorter than the positioning interval using the wireless tag, it is preferable to set the standby time to a fixed time longer than the positioning time interval using the wireless tag.
- FIG. 5 shows the flow lines created and displayed by the flow line creating system 100 according to the present embodiment.
- the flow line at the position of the object 110 is “solid line”.
- the flow line at the position of the object 110 is “dotted”.
- the user can easily grasp from the flow line whether the person has moved in front of the object 110 or has moved behind the object 110 (object shadow).
- the camera unit 101 forms a detection flag (tracking condition data) S2 indicating whether or not the tracking object can be detected from the captured image S1, and the flow line type
- the selection unit 105 determines the display type of the flow line based on the detection flag S2, and the flow line creation unit 106 determines the coordinate data S3 acquired by the tag reader unit 102 and the flow line type determined by the flow line type selection unit 105.
- a flow line is created based on the instruction signal S4.
- the movement locus is formed only by the coordinate data S3 obtained by the tag reader unit 102
- the movement locus is complementarily used by the coordinate data obtained by the image tracking unit 101-2. You may ask for
- Second Embodiment While using the configuration described in the first embodiment as a basic configuration, a preferred embodiment is presented when there are a plurality of tracking objects.
- FIG. 6 shows the configuration of the flow line creation system 200 according to the present embodiment.
- the camera unit 201 includes an imaging unit 201-1 and an imaging coordinate acquisition unit 201-2.
- the imaging unit 201-1 captures an area including the tracking target, and sends the captured image S10 to the image holding unit 210 and the captured coordinate acquisition unit 201-2.
- the image holding unit 210 temporarily holds the pickup image S10, and outputs the pickup image S10-1 whose timing has been adjusted to the display unit 203.
- the imaging coordinate acquisition unit 201-2 acquires the coordinates of a person, which is a tracking target, using the captured image S10 obtained at each point in time by the imaging unit 201-1.
- the imaging coordinate acquisition unit 201-2 sends coordinate data of a person detected in an image at each time point to the data holding unit 204 as imaging coordinate data S11.
- the imaging coordinate acquisition unit 201-2 tracks the plurality of persons and outputs imaging coordinate data S11 for a plurality of persons.
- the tag reader unit 202 has a wireless reception unit that wirelessly receives information from the wireless tag.
- the tag reader unit 202 has a positioning function of obtaining position coordinates of the wireless tag based on the received wireless signal, and a tag ID receiving function. Note that, as described in the first embodiment, the wireless tag itself may be equipped with a positioning function, and the tag reader unit 202 may receive the positioning result.
- the tag reader unit 202 sends the tag coordinate data S12 of the wireless tag and the tag ID data S13 as a pair to the data holding unit 204.
- the data holding unit 204 stores imaging coordinate data S11, tag ID data S13, and tag coordinate data S12 corresponding to the tag ID.
- imaging coordinate data S11, tag ID data S13, and tag coordinate data S12 respectively corresponding to each tag ID Stored.
- the data integration unit 211 reads the data stored in the data holding unit 204, and performs integration of persons and integration of coordinates.
- the integration of persons is to integrate the imaging coordinates of the corresponding person and the tag coordinates from among the imaging coordinates and tag coordinates of a plurality of persons.
- the data integration unit 211 specifies a person corresponding to each imaging coordinate using a method of human image recognition, and associates the specified person with the person indicated by the tag ID.
- the imaging coordinates of the person and the tag coordinates may be integrated.
- imaging coordinates and tag coordinates that are close to each other may be integrated as imaging coordinates of the corresponding person and tag coordinates.
- the data integration unit 211 further integrates the imaging coordinates and the tag coordinates into the XY plane coordinates for flow line creation by normalizing the imaging coordinates and the tag coordinates.
- the normalization includes a process of performing interpolation at tag coordinates when the imaging coordinates are missing, using both the imaging coordinates of the corresponding person and the tag coordinates.
- Coordinate data S14 of each person integrated and normalized is sent to the flow line creation unit 206 via the data storage unit 204.
- the movement line creation unit 206 sequentially connects vectors from the coordinates at the previous time point to the coordinates at the next time to form the movement line vector data S15 indicating the tracking result up to the current time, and selects this as the flow line type selection. Send to the unit 205.
- the movement line type selection unit 205 inputs the movement line vector data S15 and the imaging coordinate data S11-1.
- the flow line type selection unit 205 divides the flow line vector into fixed sections, and the flow line indicated by the flow line vector for each section according to the presence or absence of the imaging coordinate data S11-1 in a period corresponding to each section. Determine the type of The movement line type selection unit 205 transmits, to the display unit 203, movement line data S16 including the movement line vector and the movement line vector type information for each section.
- the flow line type selection unit 205 determines that the tracking target is present in front of the object, and the flow line vector selection unit 205 Flow line data S16 instructing to display the indicated flow line as "solid line” is output.
- the flow line type selection unit 205 determines that the tracking target is present behind the object, and the flow line vector selection unit 205 Flow line data S16 instructing to display the shown flow line by "dotted line” is output.
- the processing of the flow line creation unit 206 and the flow line type selection unit 205 described above is performed for each person who is a tracking target.
- FIG. 7 shows the flow line type determination operation of the flow line type selection unit 205.
- the flow line type selection unit 205 initializes the section of the flow line vector to be determined in step ST41 (set to section 1).
- step ST42 it is determined whether or not there are imaging coordinates using imaging coordinate data S11-1 of a period corresponding to the set flow line vector section. If there are no imaging coordinates, the process proceeds to step ST45-4, where it is determined that the person is behind the scene, and at step ST46-4, the flow line indicated by the flow line vector is displayed as a "dotted line". On the other hand, if there is a captured image, the process proceeds from step ST42 to step ST43.
- step ST43 it is determined whether the ratio at which the imaging coordinates can be acquired is equal to or more than a threshold value, using imaging coordinate data S11-1 of a period corresponding to the set flow line vector section. If the ratio at which the imaging coordinates can be acquired is equal to or more than the threshold value, the process proceeds to step ST45-3, where it is determined that a person can be seen on the image, and at step ST46-3 the flow line indicated by the flow line vector Display with "solid line". On the other hand, when the ratio at which the imaging coordinates can be acquired is less than the threshold value, the process proceeds from step ST43 to step ST44.
- step ST44 it is determined whether or not imaging coordinates are continuously lost using imaging coordinate data S11-1 of a period corresponding to the set flow line vector section.
- that the imaging coordinates are continuously missing means that the imaging image in which the object to be tracked is not captured is continuous with the threshold th (th ⁇ 2) or more. If the imaging coordinates are continuously missing, the process proceeds to step ST45-2, where it is determined that the person is in the shadow, and in step ST46-2, the flow line indicated by the flow line vector is "Display".
- step ST44 determines that a person can be seen on the image (the imaging failure or the person detection (tracking) It is determined that the imaging coordinate data S11-1 has not been obtained due to a failure), and in step ST46-1, the flow line indicated by the flow line vector is displayed as a "solid line".
- the flow line type selection unit 205 comprehensively determines the flow line type based on the presence or absence of imaging coordinates for each section and the degree of omission of the imaging coordinates in steps ST42, ST43, and ST44. It can be avoided that a section in which acquisition of imaging coordinates has failed is erroneously judged to be a shadow. Thereby, an appropriate flow line type can be selected.
- the case of selecting the flow line type by the three-step process of steps ST42, ST43, and ST44 has been described, but the two-step process using any two of steps ST42, ST43, and ST44
- the flow line type may be selected by the above method, or the flow line type may be selected by a one-step process using any one of ST43 and ST44.
- the flow line for each tracking object is created.
- a section in which acquisition of imaging coordinates fails because it is determined that the tracking object is not captured in the captured image only when the captured image in which the tracking object is not captured continues continuously at the threshold th (th ⁇ 2) or more. It is possible to avoid falsely determining that the object is shady. Similarly, in a plurality of captured images that are continuous in time, it is determined that the captured object does not appear in the captured image only when the ratio of the captured image in which the tracked object is not captured is equal to or greater than the threshold value. It can be avoided that the section in which the acquisition of the coordinates has failed can be erroneously judged to be a shadow.
- a three-dimensional flow line is presented to the user in an easy-to-understand manner by improving visibility when displaying a flow line having three-dimensional information on a two-dimensional image.
- a three-dimensional flow line display device is presented.
- the inventors of the present invention considered visibility when displaying a flow line having three-dimensional information on a two-dimensional image.
- Patent Document 1 discloses a technique of combining a moving trajectory of an object detected using an image recognition process with a camera image and displaying it.
- the three-dimensional coordinates of the object are represented by the coordinate axes shown in FIG. That is, the three-dimensional coordinates of the object are the x-axis (horizontal direction), the y-axis (depth direction), and the z-axis (height direction) in FIG.
- Patent Document 1 combines a two-dimensional movement trajectory in a camera image (screen) of an object with a camera image and displays the combined image, and a three-dimensional movement including movement in the depth direction as viewed from the camera. It does not display the movement track. Therefore, when the object is hidden behind objects or objects overlap with each other, the movement trajectory of the object can not be sufficiently grasped, for example, the movement trajectory displayed is interrupted.
- Patent Document 3 discloses a display method devised so that a moving trajectory of an object can be viewed three-dimensionally. Specifically, in Patent Document 3, movement of the object in the depth direction is expressed by displaying the movement trajectory of the object (particle) in a ribbon shape and performing hidden surface processing.
- the inventors examined a conventional problem in the case where a camera image in which a three-dimensional movement trajectory is synthesized is displayed on a two-dimensional display. The examination result will be described with reference to FIGS. 8 and 9.
- FIG. 8 shows an example in which a camera image is displayed on a two-dimensional display, and a movement line (moving locus) L0 having three-dimensional information on the object OB1 is combined with the camera image and displayed on the two-dimensional display.
- the flow line L0 is obtained by connecting the history of the positioning point of the object OB1 indicated by a black circle in the drawing.
- FIG. 8 is an example in which an image of a person who is the object OB1 is displayed together with a flow line.
- the user may say that the displacement of the flow line in the screen vertical direction on the screen is due to the object OB1 moving in the height direction Alternatively, it can not be distinguished whether the object OB1 is the one moved in the depth direction, and it becomes difficult to grasp the movement of the object from the displayed movement locus.
- the positioning result includes an error in the height direction (for example, in positioning using a wireless tag, an error occurs according to the incidental position of the wireless tag or the radio wave environment of the wireless)
- the user may say that the displacement of the flow line in the vertical direction of the screen is due to the movement of the object OB1 in the height direction, the movement of the object OB1 in the depth direction, or the height Since it can not be distinguished whether it is due to the positioning error of the direction, it becomes more difficult to grasp the movement of the object from the movement trajectory.
- Patent Document 3 the technology disclosed in Patent Document 3 is not based on the premise that the moving image is combined with the camera image and displayed, but if it is assumed that the moving image by the ribbon is superimposed on the camera image, the ribbon is As a result, the image is hidden, which may prevent the camera image and the flow line from being checked at the same time.
- FIG. 10 shows a display image showing a rounded flow line L1 in which an actual flow line (hereinafter referred to as a driving line) L0 based on the positioning data is attached (projected) to the floor surface.
- the rounding flow line is the movement line obtained by projecting the driving line onto the floor surface, but it is essential that the rounding movement line is the flow line projected onto the movement plane of the object OB1.
- the predetermined coordinate component related to the positioning data may be fixed to a constant value.
- FIG. 11 shows a display image showing a rounded movement line L1 in which the driving line L0 based on the positioning data is attached (projected) to the wall surface.
- FIG. 12 shows a display image showing a rounded movement line L1 obtained by pasting (projecting) the driving line L0 based on the positioning data on a plane F1 which is an average value of height components in a predetermined period of the movement line L0. Show.
- FIG. 13A generates a rounded movement line in which the height direction component in the positioning data is fixed to a fixed value, and a plurality of parallel moved in the height direction (z direction) by changing the fixed value.
- the rounding movement lines L1 and L2 are generated and the plurality of rounding movement lines L1 and L1 are sequentially displayed to display the rounding movement lines parallelly moving in the height direction with time. It shows the appearance of the displayed image.
- FIG. 13A only two rounding flow lines L1-1 and L1-2 are illustrated to simplify the drawing, but the rounding movement is also performed between the rounding flow lines L1-1 and L1-2.
- a line is generated, and the rounding movement line is translated in the height direction and displayed between the rounding movement lines L1-1 to L1-2.
- the control of the parallel movement may be performed according to the amount of operation of the mouse wheel 10 by the user, for example, as shown in FIG. 13B.
- the control of the parallel movement may be performed according to the operation amount of the slider bar or the like by the user, the number of depressions of a predetermined key (arrow key) of the keyboard, or the like.
- the amount of fluctuation per unit time of the horizontal direction component or the height direction component in the positioning data is threshold-determined, and the rounding flow line L1 is used when the amount of fluctuation is equal to or more than the threshold. It is proposed to display the driving line L0 which is not subjected to the rounding process when the fluctuation amount is less than the threshold. By doing this, it is possible to display the rounding movement line L1 only when the visibility is actually reduced when the driving line L0 is displayed.
- the rounding movement line L1 In the present embodiment, as shown in FIG. 10, FIG. 11 and FIG. 12, as a preferable example, the rounding movement line L1, the driving line L0 without rounding, the rounding movement line L1 and the driving line L0. It is proposed to simultaneously display line segments (dotted lines in the figure) connecting between corresponding points of and. By doing this, it becomes possible to artificially present the three-dimensional movement direction of the object OB1 without concealing the captured image. That is, when displaying the rounded movement line L1 in which the height direction (z direction) component is fixed to a constant value as shown in FIGS. 10 and 12, the movement of the object OB1 in the xy plane can be confirmed by the rounded movement line L1.
- the movement of the object OB1 in the height direction (z direction) can be confirmed by the length of the line connecting the corresponding portions of the rounding flow line L1 and the driving line L0.
- the movement of the object OB1 in the yz plane can be confirmed by the rounding movement line L1.
- the movement of the object OB1 in the horizontal direction (x direction) can be confirmed by the length of the line segment connecting the corresponding portions of the line L1 and the driving line L0.
- FIG. 14 shows the configuration of the three-dimensional flow line display device of the present embodiment.
- the three-dimensional motion line display device 300 includes an imaging device 310, a position detection device 320, a display motion line generation device 330, an input device 340, and a display device 350.
- the imaging device 310 is a video camera including a lens, an imaging element, a circuit for moving image encoding, and the like.
- the imaging device 310 may be a stereo video camera.
- the coding method is not particularly limited, and, for example, MPEG2, MPEG4, MPEG4 / AVC (H.264) or the like is used.
- the position detection device 320 measures the three-dimensional position of the wireless tag attached to the object by radio waves, thereby providing positioning data of the object having three-dimensional information including horizontal direction components, depth direction components, and height direction components.
- the position detection device 320 may measure the three-dimensional position of the object from the stereoscopic parallax of the captured image obtained by the imaging device 310. Further, the position detection device 320 may measure the three-dimensional position of the object using a radar, infrared light, ultrasonic waves or the like. The point is that the position detection device 320 is any device as long as it can obtain target positioning data having three-dimensional information consisting of horizontal direction components, depth direction components and height direction components. May be
- the image reception unit 331 receives the captured image (moving image data) output from the imaging device 310 in real time, and outputs the moving image data to the image reproduction unit 333 according to a request from the image reproduction unit 333. Further, the image reception unit 331 outputs the received moving image data to the image storage unit 332.
- the image reception unit 331 decodes the received moving image data once and re-encodes the moving image data re-encoded by the encoding method with higher compression efficiency. You may output to 332.
- the image storage unit 332 stores the moving image data output from the image reception unit 331. Further, the image storage unit 332 outputs the moving image data to the image reproduction unit 333 according to the request from the image reproduction unit 333.
- the image reproduction unit 333 decodes the moving image data acquired from the image reception unit 331 or the image storage unit 332 in accordance with a user instruction (not shown) from the input device 340 received via the input reception unit 338, and the decoded moving image The data is output to the display device 350.
- the display device 350 is a two-dimensional display that combines and displays an image based on moving image data and a flow line based on the flow line data obtained by the flow line creation unit 337.
- the position storage unit 334 stores the position detection result (positioning data) output from the position detection device 320 as a position history.
- the time, target ID, and position coordinates (x, y, z) are stored as one record. That is, position coordinates (x, y, z) at each time are stored in the position storage unit 334 for each object.
- the imaging condition acquisition unit 336 acquires PTZ (pan / tilt / zoom) information of the imaging device 310 from the imaging device 310 as imaging condition information.
- the imaging condition acquisition unit 336 receives the imaging condition information changed each time the imaging condition is changed, and stores the changed imaging condition information as a history along with the change time information. Do.
- the position variation determination unit 335 is used to select whether or not to display the rounding flow line according to the variation amount as described in (V) above.
- the position variation determination unit 335 extracts a plurality of records relating to the same ID within a predetermined time from the position history stored in the position storage unit 334, and height direction on the screen
- the fluctuation range (difference between the maximum value and the minimum value) of the (z direction) coordinate is calculated, and it is determined whether the fluctuation range is equal to or more than a threshold.
- the position variation determination unit 335 uses the imaging condition (information on PTZ of the imaging device 310) acquired from the imaging condition acquisition unit 336 to set the coordinates (x, y, z) of the position history to the visual field coordinate system of the camera. After conversion to the above, the fluctuation range in the height direction (z direction) of the object is calculated, and the calculation result is determined as a threshold. In the case of performing determination in the horizontal direction (x direction), similarly, the position variation determination unit 335 uses the horizontal direction (x direction) coordinates converted to the visual field coordinate system of the camera to calculate the horizontal variation width. The calculation may be performed, and the calculation result may be determined as a threshold.
- the coordinate direction in the height direction (z direction) or horizontal direction (x direction) of the coordinate system in which the positioning result of the position detection device 320 is expressed is the height direction or horizontal direction of the coordinate system in the visual field coordinate system of the camera. It goes without saying that the above-mentioned coordinate conversion is not required when the coordinate axes coincide.
- the input device 340 is a pointing device such as a mouse, a keyboard or the like, and is a device for inputting a user operation.
- the input receiving unit 338 receives an operation input signal of the user from the input device 340, and detects the position of the mouse (pointing device), the amount of dragging, the amount of wheel rotation, the click event, the number of depressions of the keyboard (arrow key etc.) Get user device information and output it.
- the flow line generation unit 337 receives, from the input reception unit 338, an event corresponding to the start of flow line generation (period designation information for specifying a time period for displaying the flow line in the past image by mouse click, menu selection, etc.) Receive a command event to specify line display.
- the flow line generation process is roughly divided into a process of displaying a flow line corresponding to a past image and a process of displaying a flow line corresponding to a real-time image. explain.
- the movement line generation unit 337 inquires of the position variation determination unit 335 whether or not the variation range in the period T designated by the period designation information is equal to or larger than the reference value, and inputs the determination result.
- the movement line generation unit 337 receives a determination result indicating that the fluctuation range is the threshold or more from the position change determination unit 335, the position history data (x (t) of the period T read from the position storage unit 334 , Y (t), z (t)) are converted into flow line coordinate data for displaying rounding flow lines.
- the flow line generation unit 337 receives a determination result indicating that the fluctuation range is less than the threshold from the position variation determination unit 335, the position history data of the period T read from the position storage unit 334 (x ( Let t), y (t), z (t)) be used as flow line coordinate data.
- the movement line generation unit 337 generates movement line data by connecting the coordinate points indicated by the movement line coordinate data, and outputs this to the display device 350.
- the flow line generation unit 337 may generate flow line data by performing curve interpolation on a polygonal line connecting coordinate points by spline interpolation or the like.
- the movement line generation unit 337 reads the latest record at the time T1 at which the command event is received from the position history of the position storage unit 334, and starts generation of the movement line.
- the movement line generation unit 337 initially inquires the position fluctuation determination unit 335 of the judgment result of the fluctuation width in the periods T1 to T2 at time T2 when a fixed period has elapsed without performing coordinate conversion processing according to the fluctuation width. According to the determination result, the flow line is sequentially generated in real time by performing the same process as the above-mentioned "when the flow line corresponding to the past image is displayed".
- the movement line generation unit 337 is between coordinate points at which the horizontal direction component (x direction component) or the height direction component (z direction component) in position history data is fixed to a constant value.
- Generate rounding flow line data that connects the two, original driving line data that directly connects the coordinate points of the position history data, and combined line segment data that connects the corresponding points of the rounding movement line and the original movement line. Are output to the display device 350.
- the movement line generation unit 337 is proportional to (x (t), y (t), z (t)) ⁇ (x) in proportion to the user operation amount such as the movement amount of the mouse wheel acquired from the input reception unit 338.
- the height of the rounding movement line is varied.
- the variation of the height of the rounding movement line in the screen is larger on the near side (that is, the side closer to the camera) and smaller as it goes to the far side (that is, the side farther from the camera).
- the height of only the flow line of the target specified by the user using a graphical user interface (GUI) or the like may be moved. In this way, it is possible to easily confirm which flow line the specified target flow line is.
- GUI graphical user interface
- the user uses the rounding movement line L1 to measure the height direction of the object OB1 (z direction Can be distinguished from the movement of the object OB1 in the depth direction (y direction).
- the three-dimensional flow line display device 300 that allows the observer to easily grasp the three-dimensional motion of the target and can improve the visibility by the observer.
- Embodiment 4 In the present embodiment, whether to perform the flow line rounding processing described in the third embodiment is selected based on the relationship between the line-of-sight vector of the imaging device (camera) 310 and the movement vector of the object OB1.
- FIG. 15 shows the movement vectors V1 and V2 of the object OB1 on the display image. Further, FIG. 16 shows the relationship between the movement vector V of the object OB1 and the gaze vector CV of the camera 310 in the shooting environment.
- the rounding process as described in the third embodiment is performed on the original movement line parallel to the line-of-sight vector CV.
- FIGS. 17A and 17B show a case where the gaze vector CV and the movement vector V of the object are close to parallel.
- FIG. 17C shows a case where the sight line vector CV and the target motion vector V are close to vertical.
- the absolute value of the inner product of the vector Ucv obtained by normalizing the line-of-sight vector CV and the vector Uv obtained by normalizing the movement vector V is equal to or greater than a predetermined value, it is determined that the line-of-sight vector CV and the driving line are nearly parallel.
- a predetermined value such as 1 / ⁇ 2 may be used as the predetermined value.
- the display flow line generation device 410 of the three-dimensional flow line display device 400 includes a movement vector determination unit 411.
- the movement vector determination unit 411 receives an inquiry from the flow line generation unit 412 (period information etc. for generating a flow line), and in response to this inquiry, imaging condition information from the imaging condition acquisition unit 336 (PTZ information of the imaging device 310) To get The movement vector determination unit 411 calculates a line-of-sight vector of the imaging device 310 (the magnitude of the vector is 1) from the imaging condition information. Further, the movement vector determination unit 411 acquires position history data of the corresponding period from the position storage unit 334, and calculates a movement vector (the magnitude of the vector is 1) which is a vector between position coordinates. As described above, the movement vector determination unit 411 performs threshold determination on the absolute value of the inner product of the gaze vector and the movement vector, and outputs the determination result to the flow line generation unit 412.
- the movement line generation unit 412 generates a rounding movement line in which the height direction component of the position history data is fixed to a constant value when the absolute value of the inner product is equal to or greater than the threshold, and the absolute value of the inner product is less than the threshold In the above, without using the rounding process, the position history data is used as it is to generate the driving line.
- Whether or not rounding processing should be performed may be determined by thresholding an angle formed by a straight line parallel to the vector CV and a straight line parallel to the movement vector V. Specifically, when the angle formed is less than the threshold, the height direction component in the positioning data, or the height direction component when each direction component in the positioning data is converted to the visual field coordinate system of the imaging device 310, A rounding movement line fixed to a constant value is generated, and if the above-mentioned angle is equal to or more than a threshold, a driving line not to be rounded is generated.
- FIG. 19 shows an example of a display image proposed in the present embodiment.
- the rounding movement line in addition to generating and displaying a rounding movement line in which the height direction component (z direction component) in the positioning data as described in the third embodiment is fixed to a constant value, the rounding movement line It is proposed to generate and display the auxiliary plane F1 at the height where there exist.
- the observer can recognize that the movement in the height direction (z direction) is fixed (pasted) on the auxiliary plane F1.
- the fact that the rounding movement line indicates only movement in the horizontal direction (x direction) and the depth direction (y direction) can be visually perceived.
- the user moves the object OB1 actually from the relationship between the captured image and the auxiliary plane F1.
- the relationship between the trajectory and the movable area can be easily viewed.
- FIG. 20 in which parts corresponding to those in FIG. 14 are assigned the same reference numerals, shows the configuration of the three-dimensional flow line display device of the present embodiment.
- the display flow line generation unit 510 of the three-dimensional flow line display device 500 includes an auxiliary plane generation unit 511 and an environment data storage unit 512.
- the auxiliary plane generation unit 511 generates an auxiliary plane F1 as a plane on which the rounding movement line exists, in accordance with the position information of the rounding movement line output from the movement line generation unit 337. At that time, the auxiliary plane generation unit 511 inquires the environment data storage unit 512 to acquire three-dimensional position information on an environmental object (a wall, a pillar, a fixture, etc.), and inquires the imaging condition acquisition unit 336 to obtain an imaging device. Acquire 310 PTZ information. Then, the auxiliary plane generation unit 511 determines the anteroposterior relationship between the auxiliary plane F1 and the environment within the field of view of the imaging device 310, and performs hidden surface processing of the auxiliary plane F1.
- the environmental data storage unit 512 stores three-dimensional position information such as position information of a building structure such as a wall or a pillar, layout information of a fixture, etc. present in the detection and imaging range of an object by the position detection device 320 and the imaging device 310 Do.
- the environmental data storage unit 512 outputs this three-dimensional environmental information in response to the inquiry from the auxiliary plane generation unit 511.
- FIG. 21 shows an example of a display image proposed in the present embodiment.
- the object OB1 is a person
- FIG. 22 in which parts corresponding to those in FIG. 14 are assigned the same reference numerals, shows the configuration of the three-dimensional flow line display device of the present embodiment.
- the display flow line generation device 610 of the three-dimensional flow line display device 600 includes a head position detection unit 611 and a head position fluctuation determination unit 612.
- the head position detection unit 611 acquires moving image data from the image reception unit 331 or the image storage unit 332 in response to an inquiry (designation period) from the head position fluctuation determination unit 612, and analyzes the data.
- the head position of the target when the target is a person is detected, and the detection result is output to the head position variation determination unit 611.
- the detection of the head position can be realized by the known image recognition technology described in, for example, Non-Patent Document 2 or the like, so the description thereof is omitted here.
- the head position fluctuation determination unit 612 makes an inquiry to the head position detection unit 611 in response to an inquiry (designated period) from the movement line generation unit 613, acquires the position of the head in the period, and The fluctuation range of z coordinate (in-screen height direction) is calculated. Specifically, the amount of fluctuation from the average height of the head position is calculated. The head position fluctuation determination unit 612 determines whether the fluctuation amount of the head position in the period is equal to or more than a predetermined threshold value, and outputs the determination result to the flow line generation unit 613.
- the position history data of the period T read from the position storage unit 334 (x Let (t), y (t), z (t)) be H, if the average head position of the period T is H, then (x (t), y (t), z (t)) ⁇ (x (t) Convert as t), y (t), H), t ⁇ T, and so on.
- the movement line generation unit 613 inputs the determination result indicating that the fluctuation range of the head position is smaller than the threshold from the head position fluctuation determination unit 612, (x (t), y (t), z ( t)) ⁇ (x (t), y (t), A), t ⁇ T, and so on.
- Seventh Embodiment 23 to 26 show examples of display images proposed in the present embodiment.
- FIG. 23 shows a display image generated by displaying rounding flow lines L1 to L3 in which fixed values in the height direction (z direction) are made different for each of the objects OB1 to OB3.
- a plurality of strongly related persons may be displayed on the same plane (the same height). Also, the height may be automatically set in accordance with the heights of the objects OB1 to OB3. In addition, while the object is on a forklift, for example, in a factory, the rounding flow may be displayed at a high position accordingly.
- FIGS. 24 and 25 display a GUI screen (flow line display setting window in the figure) in addition to the display described in FIG. 23, and move the person icon on this GUI screen to The display image which enables setting of the fixed value for every person by an observer) is shown.
- the heights of the rounded flow lines L1 to L3 can be set in conjunction with the position of the person icon on the GUI, intuitive operation and display become possible. For example, when the height of the person icon is changed in the GUI, the heights of the rounding flow line and the auxiliary plane corresponding to the person icon are also changed by the same amount as the height of the person icon.
- FIG. 25 hides the rounding movement line L2 and auxiliary plane F2 of "Mr. B” from the state of FIG. 24, and rounding movement lines L3 and L1 and an auxiliary plane F3 of "Mr. C” and “Mr. A”. , And F1 are replaced with each other, and an example is shown in which the heights of the rounding line L3 of the "Mr. C” and the auxiliary plane F3 are changed.
- FIG. 26 shows a display image in which the abnormal / dangerous condition section is highlighted in addition to the display described in FIG.
- a suspicious person, dangerous walking condition travelling in the office, etc.
- entry into a restricted zone, etc. are detected based on image recognition, flow line analysis, sensing results by other sensors, etc.
- By highlighting and displaying the section it is possible to present the warning to the observer (user) in an easy-to-understand manner.
- Mr. A has walked in danger
- the rounding flow line L1-2 of that section is highlighted by being displayed at a position higher than the rounding flow line L1 of the other sections.
- the auxiliary plane F1-2 is newly displayed so as to correspond to the highlighted rounding flow line L1-2.
- FIG. 27 in which parts corresponding to those in FIG. 14 are assigned the same reference numerals, shows the configuration of the three-dimensional flow line display device of the present embodiment.
- the display flow line generation unit 710 of the three-dimensional flow line display device 700 includes an abnormal section extraction unit 711 and an operation screen generation unit 712.
- the abnormal section extraction unit 711 detects the abnormal behavior of the target from the position history of the target stored in the position storage unit 334, the captured image captured by the imaging device 310, and the like, and the position related to the position of the section in which the abnormal behavior is detected.
- the history record is extracted, and this is output to the flow line generation unit 713.
- a standard flow line of interest is set and stored in advance as a standard flow line, and an abnormality is detected by comparison with the standard flow line.
- a prohibited area where the object is not permitted to enter is set and stored in advance, and it is detected whether the object has entered the prohibited area.
- an abnormality is detected.
- the operation screen generation unit 712 generates an operation auxiliary screen including a person icon for setting the height of the flow line for each target (person) and a check box for switching between display and non-display.
- the operation screen generation unit 712 moves the position of the person icon or switches the check box On / Off according to the mouse position, the click event, the mouse drag amount, etc. output from the input reception unit 338.
- Generate The process of the operation screen generation unit 712 is the same as the process of generating an operation window in a known GUI.
- FIG. 28 shows an example of a display image proposed in the present embodiment.
- it is proposed to display an auxiliary flow line circularly moving around the driving line L0 at a radius perpendicular to the movement vector V of the object OB1. Accordingly, it is possible to present a flow line having a pseudo sense of depth without concealing the captured image.
- the driving line L0 and the auxiliary driving line circularly moving around the driving line L0 at a radius perpendicular to the movement vector V of the object may be generated and displayed.
- a rounding movement line and an auxiliary movement line that circularly moves around the rounding movement line at a radius perpendicular to the target movement vector V may be generated and displayed.
- such an auxiliary flow line is a movement vector (a movement line coordinate point next to the movement line coordinate point Can be displayed by generating an auxiliary flow line circularly moving at a radius perpendicular to the vector
- the auxiliary motion line may be a spline curve which moves circularly at a radius perpendicular to the spline curve after interpolation.
- the present invention is not limited to this and the tag reader units 102 and 202 may be replaced. It is possible to apply various positioning means capable of positioning the tracking target.
- positioning means for replacing the tag reader units 102 and 202 a radar, an ultrasonic sensor, a camera, etc. provided at a position where the tracking object can be positioned when the tracking object is seen behind the camera units 101 and 201. Is considered.
- the tracking target may be positioned by providing a large number of sensors on the floor.
- the measuring means may be any means as long as it can measure the position of the object to be tracked when it enters the shadow of the camera as seen from the camera units 101 and 201.
- the camera units 101 and 201 include the image tracking unit 101-2 and the imaging coordinate acquisition unit 201-2
- the flow line type selection unit 105 and 205 include the image tracking unit 101-. 2.
- the present invention is not limited to this.
- the display type of the flow line corresponding to each time may be selected according to whether or not the object to be tracked appears in the captured image at each time.
- solid line is selected as the type of flow line when it is determined that the tracking target is not in the shadow, and “dotted line” is determined in the shadow.
- the present invention is not limited thereto. For example, if it is determined that the tracking target is not in the shadow, "thick line” is selected, and if it is determined that the tracking is in the shadow, "the thick line” is selected. “Thin line” may be selected. Alternatively, the color of the flow line may be changed depending on whether it is determined that the tracking target is not behind or behind. The point is that different types of flow lines may be selected between the case where the object to be tracked is not behind the camera and the case where it is behind the camera.
- the display type of the flow line may be changed according to the state of the wireless tag. For example, when the information indicating that the battery remaining amount is low is received from the wireless tag, if the color of the flow line is changed, the user can know that the battery remaining amount is decreased from the color of the flow line. It can be used as a standard for battery replacement.
- the image tracking unit 101-2, imaging coordinate acquisition unit 201-2, flow line type selection unit 105, 205, and flow line creation unit 106, 206 used in the first and second embodiments are implemented by a general-purpose computer such as a personal computer.
- the processes included in the image tracking unit 101-2, imaging coordinate acquisition unit 201-2, flow line type selection units 105 and 205, and flow line creation units 106 and 206 are stored in the memory of the computer. This is realized by reading out a software program corresponding to the processing of the processing unit and executing the processing by the CPU.
- display flow line generation devices 330, 410, 510, 610, and 710 used in the embodiment 3-8 can be implemented by a general-purpose computer such as a personal computer, and display flow line generation devices 330, 410, 510, and 610.
- the respective processes included in 710 are realized by reading out a software program corresponding to the process of each processing unit stored in the memory of the computer and executing the process by the CPU.
- the display flow line generation devices 330, 410, 510, 610, and 710 may be realized by a dedicated device on which an LSI chip corresponding to each processing unit is mounted.
- the present invention is suitable for use in a system that displays movement trajectories of a person or an object by a flow line, for example, a monitoring system.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Image Analysis (AREA)
- Processing Or Creating Images (AREA)
- Image Processing (AREA)
- Radar Systems Or Details Thereof (AREA)
Abstract
Description
図1に、本発明の実施の形態に係る動線作成システムの構成を示す。動線作成システム100は、カメラ部101と、タグリーダ部102と、表示部103と、データ保持部104と、動線種別選択部105と、動線作成部106と、を有する。
本実施の形態では、実施の形態1で説明した構成を基本構成としつつ、さらに追跡対象物が複数存在する場合に好適な形態を提示する。
本実施の形態及び続く実施の形態4-8では、3次元情報を持つ動線を2次元画像上に表示する際の視認性を向上させることで、3次元動線をユーザに分かり易く提示する3次元動線表示装置を提示する。
動線生成部337は、位置変動判定部335に、期間指定情報で指定される期間Tにおける変動幅が基準値以上か否かを問い合わせて、その判定結果を入力する。動線生成部337は、位置変動判定部335から変動幅が閾値以上であることを示す判定結果を入力した場合には、位置記憶部334から読み出した期間Tの位置履歴データ(x(t),y(t),z(t))を、丸め動線を表示するための動線用座標データに変換する。一方、動線生成部337は、位置変動判定部335から変動幅が閾値未満であることを示す判定結果を入力した場合には、位置記憶部334から読み出した期間Tの位置履歴データ(x(t),y(t),z(t))を、そのまま動線用座標データとする。
(x(t),y(t),z(t)) → (x(t),y(t),A) , t∈T, Aは所定値
のように変換することで、丸め動線を表示するための動線用座標データを得る。このときA=0に設定すれば、図10に示したように、床面に固定された丸め動線L1を生成することができる。
動線生成部337は、コマンドイベントを受けた時刻T1での最新のレコードを位置記憶部334の位置履歴から読み出して、動線生成を開始する。動線生成部337は、最初は、変動幅に応じた座標変換処理は行わずに、一定期間経過した時点T2で、期間T1~T2での変動幅の判定結果を位置変動判定部335に問い合わせ、判定結果に応じて、上述した“過去画像に対応した動線を表示する場合”と同様の処理を行うことで、リアルタイムに順次動線を生成していく。
動線生成部337は、位置履歴データにおける水平方向成分(x方向成分)又は高さ方向成分(z方向成分)を一定値に固定した座標点間を結んだ丸め動線データと、位置履歴データの座標点間をそのまま結んだ原動線データと、丸め動線と原動線との対応箇所間を結合する結合線分データと、を生成し、これらを表示装置350に出力する。
本実施の形態では、撮像装置(カメラ)310の視線ベクトルと、対象OB1の移動ベクトルとの関係に基づいて、実施の形態3で説明した動線の丸め処理を行うか否かを選択する。
図19に、本実施の形態で提案する表示画像の例を示す。本実施の形態では、実施の形態3で説明したような測位データにおける高さ方向成分(z方向成分)を一定値に固定した丸め動線を生成して表示することに加えて、丸め動線が存在する高さに補助平面F1を生成して表示することを提案する。このように、丸め動線の存在する補助平面F1を明示することで、観察者は、高さ方向(z方向)の移動は補助平面F1上に固定(貼り付け)されていることを認識でき、丸め動線は水平方向(x方向)及び奥行き方向(y方向)の移動のみを示していることを、感覚的に視認することができるようになる。
図21に、本実施の形態で提案する表示画像の例を示す。本実施の形態では、実施の形態3で説明したような測位データにおける高さ方向成分(z方向成分)を一定値に固定した丸め動線L1-1を生成して表示することに加えて、対象OB1が人物である場合に、人物の頭部位置が大きく変動した区間の丸め動線L1-2の高さを実際の頭部位置の高さにすることを提案する。このような、丸め動線L1-2を表示することにより、ユーザは、例えば人物のしゃがみ動作などを認識できるようになる。
図23~図26に、本実施の形態で提案する表示画像の例を示す。
(2)対象が立ち入りを許可されない禁止区域を予め設定・保存しておき、禁止区域に対象が立ち入ったか否かを検出する。
(3)撮像装置310の撮像画像を用いて画像認識を行うことで、異常を検出する。
図28に、本実施の形態で提案する表示画像の例を示す。本実施の形態では、対象OB1の移動ベクトルVに垂直な動径で、原動線L0の周囲を円運動する補助動線を表示させることを提案する。これにより、撮像画像を隠蔽することなく、擬似的な奥行き感を持たせた動線を提示できる。
なお、上述の実施の形態1、2では、タグリーダ部102、202を用いて無線タグからの座標データを取得する場合について述べたが、本発明はこれに限らず、タグリーダ部102、202に換えて、追跡対象物を測位し得る種々の測位手段を適用可能である。タグリーダ部102、202に換わる測位手段としては、追跡対象物がカメラ部101、201から見て物陰に入ったときに、追跡対象物を測位できる位置に設けられたレーダー、超音波センサ、カメラ等が考えられる。また、屋内の場合には、床に多数のセンサを設けることで、追跡対象物を測位してもよい。要するに、測定手段は、追跡対象物がカメラ部101、201から見て物陰に入ったときに、その位置を測位できるものであればよい。
Claims (32)
- 追跡対象物を含む領域の撮像画像を得る撮像部と、
前記追跡対象物を測位し、前記追跡対象物の測位データを出力する測位部と、
各時点の前記撮像画像に前記追跡対象物が写っているか否かに応じて、前記各時点に対応する動線の表示種別を選択する動線種別選択部と、
前記測位データと前記動線種別選択部によって選択された動線表示種別とに基づいて、動線データを形成する動線作成部と、
前記撮像画像に基づく画像と、前記動線データに基づく動線とを重ねて表示する表示部と、
を具備する動線作成システム。 - 前記測位部は、前記追跡対象物に付された無線タグから受信した無線信号に基づいて、前記測位データを得る、
請求項1に記載の動線作成システム。 - 前記撮像部は、撮像画像を得る撮像部と、前記各時点の撮像画像内に前記追跡対象物が写っているか否かを示す追跡状況データを得る画像追跡部と有し、
前記動線種別選択部は、前記追跡状況データに基づいて、動線の表示種別を選択する、
請求項1に記載の動線作成システム。 - 前記撮像部は、撮像画像を得る撮像部と、前記各時点の撮像画像における前記追跡対象物の撮像座標データを得る撮像座標取得部と有し、
前記動線種別選択部は、前記各時点の撮像画像における前記撮像座標データの有無に基づいて、動線の表示種別を選択する、
請求項1に記載の動線作成システム。 - 前記動線種別選択部は、前記撮像画像内に前記追跡対象物が写っている場合は実線を選択し、前記撮像画像内に前記追跡対象物が写っていない場合は点線を選択する、
請求項1に記載の動線作成システム。 - 前記動線種別選択部は、前記追跡対象物が写っていない撮像画像が閾値th(th≧2)以上連続した場合にのみ、前記撮像画像に前記追跡対象物が写っていないと判断する、
請求項1に記載の動線作成システム。 - 前記動線種別選択部は、時間的に連続する複数の撮像画像において、前記追跡対象物が写っていない撮像画像の割合が閾値以上の場合にのみ、前記撮像画像に前記追跡対象物が写っていないと判断する、
請求項1に記載の動線作成システム。 - 各時点の撮像画像に追跡対象物が写っているか否かに応じて、前記各時点に対応する動線の表示種別を選択する動線種別選択部と、
前記追跡対象物の測位データと前記動線種別選択部によって選択された動線表示種別とに基づいて、動線データを形成する動線作成部と、
を具備する動線作成装置。 - 前記動線種別選択部は、前記撮像画像内に前記追跡対象物が写っている場合は実線を選択し、前記撮像画像内に前記追跡対象物が写っていない場合は点線を選択する、
請求項8に記載の動線作成装置。 - 前記動線種別選択部は、前記追跡対象物が写っていない撮像画像が閾値th(th≧2)以上連続した場合にのみ、前記撮像画像に前記追跡対象物が写っていないと判断する、
請求項8に記載の動線作成装置。 - 前記動線種別選択部は、時間的に連続する複数の撮像画像において、前記追跡対象物が写っていない撮像画像の割合が閾値以上の場合にのみ、前記撮像画像に前記追跡対象物が写っていないと判断する、
請求項8に記載の動線作成装置。 - 各時点の追跡対象物の測位データを利用して、前記追跡対象物の移動軌跡である動線を形成し、
前記各時点の撮像画像中に前記追跡対象物が写っているか否かに応じて、前記動線の種別を線分毎に選択する、
動線作成方法。 - 対象を含む撮像画像を得る撮像部と、
水平方向成分、奥行き方向成分及び高さ方向成分からなる3次元の情報を有する、前記対象の測位データを得る位置検出部と、
前記測位データを用いて前記対象の移動軌跡である動線を生成する手段であり、前記測位データに関する所定の座標成分を一定値に固定した丸め動線を生成する動線生成部と、
前記撮像画像と前記丸め動線とを2次元ディスプレイに合成して表示する表示部と、
を具備する3次元動線表示装置。 - 前記所定の座標成分は、前記測位データにおける高さ方向成分又は水平方向成分である、
請求項13に記載の3次元動線表示装置。 - 前記所定の座標成分は、前記測位データにおける各方向成分を、前記撮像部の視野座標系に変換した際の高さ方向成分又は水平方向成分である、
請求項13に記載の3次元動線表示装置。 - 前記所定の座標成分の単位時間当たりの変動量を閾値判定する位置変動判定部を、さらに具備し、
前記動線生成部は、前記変動量が閾値以上の場合に前記丸め動線を生成し、前記変動量が閾値未満の場合に丸め処理を行わない原動線を生成する、
請求項13に記載の3次元動線表示装置。 - 前記動線生成部は、前記丸め動線と、丸め処理を行わない原動線と、前記丸め動線と前記原動線との対応箇所間を結合する線分と、を生成し、
前記表示部は、前記撮像画像に、前記丸め動線と、前記原動線と、前記線分とを、2次元ディスプレイに合成して表示する、
請求項13に記載の3次元動線表示装置。 - 前記動線生成部は、前記丸め動線が、丸め処理を行わない原動線を前記対象が移動する平面に投影した動線となるように、前記測位データに関する所定の座標成分を一定値に固定する、
請求項13に記載の3次元動線表示装置。 - 前記動線生成部は、前記測位データにおける高さ方向成分、又は前記測位データにおける各方向成分を前記撮像部の視野座標系に変換した際の高さ方向成分を、一定値に固定した丸め動線を生成し、かつ前記一定値を変化させることで、高さ方向に平行移動された複数の丸め動線を生成し、
前記表示部は、前記複数の丸め動線を順次表示することで、高さ方向に経時的に平行移動する丸め動線を表示する、
請求項13に記載の3次元動線表示装置。 - 前記動線生成部は、前記一定値を、ユーザの操作量に応じて変化させ、
前記表示部は、ユーザの操作量に応じた分だけ高さ方向に平行移動する丸め動線を表示する、
請求項19に記載の3次元動線表示装置。 - 前記位置検出部は、複数の対象についての測位データを得、
前記動線生成部は、前記複数の対象について、前記測位データにおける高さ方向成分、又は前記測位データにおける各方向成分を前記撮像部の視野座標系に変換した際の高さ方向成分を、一定値に固定した丸め動線を生成し、かつ、ユーザにより選択された対象の丸め動線について、前記一定値を変化させることで高さ方向に平行移動された複数の丸め動線を生成し、
前記表示部は、前記複数の対象の丸め動線を同時に表示すると共に、前記ユーザにより選択された対象の丸め動線を高さ方向に経時的に平行移動させて表示する、
請求項13に記載の3次元動線表示装置。 - 前記撮像部の視線ベクトルに平行な直線と、前記対象の移動ベクトルに平行な直線とのなす角度を閾値判定する移動ベクトル判定部を、さらに具備し、
前記動線生成部は、前記角度が閾値未満の場合に、前記測位データにおける高さ方向成分、又は前記測位データにおける各方向成分を前記撮像部の視野座標系に変換した際の高さ方向成分を、一定値に固定した丸め動線を生成し、前記角度が閾値以上の場合に、丸め処理を行わない原動線を生成する、
請求項13に記載の3次元動線表示装置。 - 前記撮像部の視線ベクトルと、前記対象の移動ベクトルとの内積の絶対値を閾値判定する移動ベクトル判定部を、さらに具備し、
前記動線生成部は、前記内積の絶対値が閾値以上の場合に、前記測位データにおける高さ方向成分、又は前記測位データにおける各方向成分を前記撮像部の視野座標系に変換した際の高さ方向成分を、一定値に固定した丸め動線を生成し、前記内積の絶対値が閾値未満の場合に丸め処理を行わない原動線を生成する、
請求項13に記載の3次元動線表示装置。 - 前記丸め動線が存在する平面を生成する補助平面生成部を、さらに具備し、
前記表示部は、前記撮像画像と前記丸め動線に加えて、前記平面を表示する、
請求項13に記載の3次元動線表示装置。 - 前記対象である人物の頭部位置を検出する頭部位置検出部と、
前記頭部位置の平均高さからの変動量を閾値判定する頭部位置変動判定部と、
をさらに具備し、
前記動線生成部は、前記変動量が閾値以上の区間は、高さ方向成分が頭部位置に固定された丸め動線を生成する、
請求項13に記載の3次元動線表示装置。 - 前記動線生成部は、前記測位データにおける高さ方向成分、又は前記測位データにおける各方向成分を前記撮像部の視野座標系に変換した際の高さ方向成分が、一定値に固定され、かつ、前記高さ方向成分の固定値が対象毎に異なる、複数対象分の丸め動線を生成し、
前記表示部は、前記高さ方向成分が異なる複数対象分の丸め動線を表示する、
請求項13に記載の3次元動線表示装置。 - 前記対象のアイコンを含む操作画面を生成する操作画面生成部を、さらに具備し、
前記表示部は、表示画面上に、前記丸め動線と前記操作画面とを並べて表示し、
前記動線生成部は、前記高さ方向成分の固定値を、ユーザによって上下移動された前記アイコンの高さに応じて設定する、
請求項26に記載の3次元動線表示装置。 - 前記対象が異常又は危険な動きをした区間を抽出する異常区間抽出部を、さらに具備し、
前記動線生成部は、前記測位データにおける高さ方向成分、又は前記測位データにおける各方向成分を前記撮像部の視野座標系に変換した際の高さ方向成分を、一定値に固定し、かつ、前記異常又は危険な動きをした区間における前記高さ方向成分の固定値を、他の区間における前記高さ方向成分の固定値よりも大きくする、
請求項13に記載の3次元動線表示装置。 - 対象を含む撮像画像を得る撮像部と、
水平方向成分、奥行き方向成分及び高さ方向成分からなる3次元の情報を有する、前記対象の測位データを得る位置検出部と、
前記測位データを用いて前記対象の移動軌跡である動線を生成すると共に、前記対象の移動ベクトルに垂直な動径で前記動線の周囲を円運動する補助動線を生成する動線生成部と、
前記撮像画像と、前記動線と、前記補助動線とを2次元ディスプレイに合成して表示する表示部と、
を具備する3次元動線表示装置。 - 水平方向成分、奥行き方向成分及び高さ方向成分からなる3次元の情報を有する、対象の測位データに関する所定の座標成分を一定値に固定した丸め動線を生成するステップと、
撮像画像と前記丸め動線とを合成して表示するステップと、
を含む3次元動線表示方法。 - 水平方向成分、奥行き方向成分及び高さ方向成分からなる3次元の情報を有する、対象の測位データを入力し、前記測位データに関する所定の座標成分を一定値に固定した丸め動線を生成し、当該丸め動線を表示装置に出力する動線生成部を、具備する、
表示動線生成装置。 - 撮像装置から前記対象を含む撮像画像を入力する入力部を、さらに具備し、
前記所定の座標成分は、前記測位データにおける各方向成分を、前記撮像部の視野座標系に変換した際の高さ方向成分又は水平方向成分である、
請求項31に記載の表示動線生成装置。
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2010533787A JP5634266B2 (ja) | 2008-10-17 | 2009-09-01 | 動線作成システム、動線作成装置及び動線作成方法 |
US13/123,788 US20110199461A1 (en) | 2008-10-17 | 2009-09-01 | Flow line production system, flow line production device, and three-dimensional flow line display device |
Applications Claiming Priority (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2008268687 | 2008-10-17 | ||
JP2008-268687 | 2008-10-17 | ||
JP2009018740 | 2009-01-29 | ||
JP2009-018740 | 2009-01-29 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2010044186A1 true WO2010044186A1 (ja) | 2010-04-22 |
Family
ID=42106363
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2009/004293 WO2010044186A1 (ja) | 2008-10-17 | 2009-09-01 | 動線作成システム、動線作成装置及び3次元動線表示装置 |
Country Status (3)
Country | Link |
---|---|
US (1) | US20110199461A1 (ja) |
JP (1) | JP5634266B2 (ja) |
WO (1) | WO2010044186A1 (ja) |
Cited By (21)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2011254289A (ja) * | 2010-06-02 | 2011-12-15 | Toa Corp | 移動体軌跡表示装置および移動体軌跡表示プログラム |
JP2012099975A (ja) * | 2010-10-29 | 2012-05-24 | Keyence Corp | 動画追尾装置、動画追尾方法および動画追尾プログラム |
JP2015018340A (ja) * | 2013-07-09 | 2015-01-29 | キヤノン株式会社 | 画像処理装置、画像処理方法 |
JP2015070354A (ja) * | 2013-09-27 | 2015-04-13 | パナソニックIpマネジメント株式会社 | 移動体追跡装置、移動体追跡システムおよび移動体追跡方法 |
WO2015108236A1 (ko) * | 2014-01-14 | 2015-07-23 | 삼성테크윈 주식회사 | 요약 영상 브라우징 시스템 및 방법 |
JP5909712B1 (ja) * | 2015-07-30 | 2016-04-27 | パナソニックIpマネジメント株式会社 | 動線分析システム、カメラ装置及び動線分析方法 |
JP5909708B1 (ja) * | 2015-05-22 | 2016-04-27 | パナソニックIpマネジメント株式会社 | 動線分析システム、カメラ装置及び動線分析方法 |
JP5909710B1 (ja) * | 2015-06-05 | 2016-04-27 | パナソニックIpマネジメント株式会社 | 動線分析システム、カメラ装置及び動線分析方法 |
JP5909711B1 (ja) * | 2015-06-15 | 2016-04-27 | パナソニックIpマネジメント株式会社 | 動線分析システム及び動線表示方法 |
JP5909709B1 (ja) * | 2015-05-29 | 2016-04-27 | パナソニックIpマネジメント株式会社 | 動線分析システム、カメラ装置及び動線分析方法 |
JP5915960B1 (ja) * | 2015-04-17 | 2016-05-11 | パナソニックIpマネジメント株式会社 | 動線分析システム及び動線分析方法 |
JP2016129295A (ja) * | 2015-01-09 | 2016-07-14 | キヤノン株式会社 | 情報処理装置、情報処理方法及びプログラム |
JP2017046023A (ja) * | 2015-08-24 | 2017-03-02 | 三菱電機株式会社 | 移動体追跡装置及び移動体追跡方法及び移動体追跡プログラム |
WO2018180040A1 (ja) * | 2017-03-31 | 2018-10-04 | 日本電気株式会社 | 映像処理装置、映像解析システム、方法およびプログラム |
JP2019008507A (ja) * | 2017-06-23 | 2019-01-17 | 株式会社東芝 | 変換行列算出装置、位置推定装置、変換行列算出方法および位置推定方法 |
KR20190085620A (ko) * | 2018-01-11 | 2019-07-19 | 김영환 | 공간 내의 물체 운동 분석 장치 및 그 제어 방법 |
US10497130B2 (en) | 2016-05-10 | 2019-12-03 | Panasonic Intellectual Property Management Co., Ltd. | Moving information analyzing system and moving information analyzing method |
US10621423B2 (en) | 2015-12-24 | 2020-04-14 | Panasonic I-Pro Sensing Solutions Co., Ltd. | Moving information analyzing system and moving information analyzing method |
JP2021176033A (ja) * | 2020-05-01 | 2021-11-04 | ピクシーダストテクノロジーズ株式会社 | 情報処理装置、情報処理方法、およびプログラム |
CN113850836A (zh) * | 2021-09-29 | 2021-12-28 | 平安科技(深圳)有限公司 | 基于行为轨迹的员工行为识别方法、装置、设备及介质 |
JP7451798B2 (ja) | 2016-05-13 | 2024-03-18 | グーグル エルエルシー | スマートデバイスでレーダを利用するためのシステム、方法およびデバイス |
Families Citing this family (32)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8121361B2 (en) | 2006-05-19 | 2012-02-21 | The Queen's Medical Center | Motion tracking system for real time adaptive imaging and spectroscopy |
KR20100062575A (ko) * | 2008-12-02 | 2010-06-10 | 삼성테크윈 주식회사 | 감시 카메라의 제어 방법 및 이를 사용한 제어 장치 |
KR101634355B1 (ko) * | 2009-09-18 | 2016-06-28 | 삼성전자주식회사 | 동작 검출 장치 및 방법 |
US9046413B2 (en) | 2010-08-13 | 2015-06-02 | Certusview Technologies, Llc | Methods, apparatus and systems for surface type detection in connection with locate and marking operations |
CA2811639A1 (en) * | 2010-09-17 | 2012-03-22 | Jeffrey Farr | Methods and apparatus for tracking motion and/or orientation of a marking device |
EP2447882B1 (en) * | 2010-10-29 | 2013-05-15 | Siemens Aktiengesellschaft | Method and device for assigning sources and sinks to routes of individuals |
US8193909B1 (en) * | 2010-11-15 | 2012-06-05 | Intergraph Technologies Company | System and method for camera control in a surveillance system |
US9606209B2 (en) | 2011-08-26 | 2017-03-28 | Kineticor, Inc. | Methods, systems, and devices for intra-scan motion correction |
US20130170760A1 (en) * | 2011-12-29 | 2013-07-04 | Pelco, Inc. | Method and System for Video Composition |
US9239965B2 (en) * | 2012-06-12 | 2016-01-19 | Electronics And Telecommunications Research Institute | Method and system of tracking object |
US9305365B2 (en) | 2013-01-24 | 2016-04-05 | Kineticor, Inc. | Systems, devices, and methods for tracking moving targets |
US9717461B2 (en) | 2013-01-24 | 2017-08-01 | Kineticor, Inc. | Systems, devices, and methods for tracking and compensating for patient motion during a medical imaging scan |
US10327708B2 (en) | 2013-01-24 | 2019-06-25 | Kineticor, Inc. | Systems, devices, and methods for tracking and compensating for patient motion during a medical imaging scan |
CN105392423B (zh) | 2013-02-01 | 2018-08-17 | 凯内蒂科尔股份有限公司 | 生物医学成像中的实时适应性运动补偿的运动追踪*** |
JP6273685B2 (ja) | 2013-03-27 | 2018-02-07 | パナソニックIpマネジメント株式会社 | 追尾処理装置及びこれを備えた追尾処理システム並びに追尾処理方法 |
US9437000B2 (en) * | 2014-02-20 | 2016-09-06 | Google Inc. | Odometry feature matching |
US10004462B2 (en) | 2014-03-24 | 2018-06-26 | Kineticor, Inc. | Systems, methods, and devices for removing prospective motion correction from medical imaging scans |
EP3188660A4 (en) | 2014-07-23 | 2018-05-16 | Kineticor, Inc. | Systems, devices, and methods for tracking and compensating for patient motion during a medical imaging scan |
US20180025175A1 (en) * | 2015-01-15 | 2018-01-25 | Nec Corporation | Information output device, camera, information output system, information output method, and program |
US9943247B2 (en) | 2015-07-28 | 2018-04-17 | The University Of Hawai'i | Systems, devices, and methods for detecting false movements for motion correction during a medical imaging scan |
EP3380007A4 (en) | 2015-11-23 | 2019-09-04 | Kineticor, Inc. | SYSTEMS, DEVICES, AND METHODS FOR MONITORING AND COMPENSATING A MOVEMENT OF A PATIENT DURING MEDICAL IMAGING SCAN |
US10134146B2 (en) * | 2016-01-14 | 2018-11-20 | RetailNext, Inc. | Detecting, tracking and counting objects in videos |
US10062176B2 (en) * | 2016-02-24 | 2018-08-28 | Panasonic Intellectual Property Management Co., Ltd. | Displacement detecting apparatus and displacement detecting method |
JP2017173252A (ja) * | 2016-03-25 | 2017-09-28 | オリンパス株式会社 | 画像処理装置、画像処理方法および画像処理プログラム |
JP2017174273A (ja) * | 2016-03-25 | 2017-09-28 | 富士ゼロックス株式会社 | 動線生成装置及びプログラム |
JP6798549B2 (ja) | 2016-03-31 | 2020-12-09 | 日本電気株式会社 | 動線表示システム、動線表示方法および動線表示プログラム |
JP6659524B2 (ja) * | 2016-11-18 | 2020-03-04 | 株式会社東芝 | 移動体追跡装置、表示装置および移動体追跡方法 |
EP3606055A4 (en) * | 2017-03-31 | 2020-02-26 | Nec Corporation | VIDEO PROCESSING DEVICE, VIDEO ANALYSIS SYSTEM, METHOD AND PROGRAM |
CN109102530B (zh) * | 2018-08-21 | 2020-09-04 | 北京字节跳动网络技术有限公司 | 运动轨迹绘制方法、装置、设备和存储介质 |
JP2020102135A (ja) * | 2018-12-25 | 2020-07-02 | 清水建設株式会社 | 追跡システム、追跡処理方法、及びプログラム |
WO2022000210A1 (zh) * | 2020-06-29 | 2022-01-06 | 深圳市大疆创新科技有限公司 | 对场地中的目标对象的分析方法和装置 |
US20220268918A1 (en) * | 2021-02-24 | 2022-08-25 | Amazon Technologies, Inc. | Techniques for generating motion information for videos |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH09304526A (ja) * | 1996-05-15 | 1997-11-28 | Nec Corp | ターミナル管制用3次元情報表示方法 |
JP2000293668A (ja) * | 1999-04-07 | 2000-10-20 | Matsushita Electric Ind Co Ltd | 3次元立体地図描画装置及び描画方法 |
JP2006313111A (ja) * | 2005-05-09 | 2006-11-16 | Nippon Telegr & Teleph Corp <Ntt> | 測位装置、識別情報発信装置、受信装置、測位システム、測位方法及びコンピュータプログラム並びに記録媒体 |
US20070022376A1 (en) * | 2005-07-25 | 2007-01-25 | Airbus | Process of treatment of data with the aim of the determination of visual motifs in a visual scene |
WO2007030168A1 (en) * | 2005-09-02 | 2007-03-15 | Intellivid Corporation | Object tracking and alerts |
Family Cites Families (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH0816790A (ja) * | 1994-06-28 | 1996-01-19 | Matsushita Electric Works Ltd | 移動物体検出方法およびその装置 |
JP2000357177A (ja) * | 1999-06-16 | 2000-12-26 | Ichikawa Jin Shoji Kk | 店舗内の動線把握システム |
US7394916B2 (en) * | 2003-02-10 | 2008-07-01 | Activeye, Inc. | Linking tracked objects that undergo temporary occlusion |
JP4272966B2 (ja) * | 2003-10-14 | 2009-06-03 | 和郎 岩根 | 3dcg合成装置 |
JP4424031B2 (ja) * | 2004-03-30 | 2010-03-03 | 株式会社日立製作所 | 画像生成装置、システムまたは画像合成方法。 |
US7804981B2 (en) * | 2005-01-13 | 2010-09-28 | Sensis Corporation | Method and system for tracking position of an object using imaging and non-imaging surveillance devices |
GB0502371D0 (en) * | 2005-02-04 | 2005-03-16 | British Telecomm | Identifying spurious regions in a video frame |
US20100013935A1 (en) * | 2006-06-14 | 2010-01-21 | Honeywell International Inc. | Multiple target tracking system incorporating merge, split and reacquisition hypotheses |
US20080074494A1 (en) * | 2006-09-26 | 2008-03-27 | Harris Corporation | Video Surveillance System Providing Tracking of a Moving Object in a Geospatial Model and Related Methods |
JP4980260B2 (ja) * | 2008-02-05 | 2012-07-18 | 東芝テック株式会社 | 動線認識システム |
-
2009
- 2009-09-01 WO PCT/JP2009/004293 patent/WO2010044186A1/ja active Application Filing
- 2009-09-01 US US13/123,788 patent/US20110199461A1/en not_active Abandoned
- 2009-09-01 JP JP2010533787A patent/JP5634266B2/ja not_active Expired - Fee Related
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH09304526A (ja) * | 1996-05-15 | 1997-11-28 | Nec Corp | ターミナル管制用3次元情報表示方法 |
JP2000293668A (ja) * | 1999-04-07 | 2000-10-20 | Matsushita Electric Ind Co Ltd | 3次元立体地図描画装置及び描画方法 |
JP2006313111A (ja) * | 2005-05-09 | 2006-11-16 | Nippon Telegr & Teleph Corp <Ntt> | 測位装置、識別情報発信装置、受信装置、測位システム、測位方法及びコンピュータプログラム並びに記録媒体 |
US20070022376A1 (en) * | 2005-07-25 | 2007-01-25 | Airbus | Process of treatment of data with the aim of the determination of visual motifs in a visual scene |
WO2007030168A1 (en) * | 2005-09-02 | 2007-03-15 | Intellivid Corporation | Object tracking and alerts |
Cited By (30)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2011254289A (ja) * | 2010-06-02 | 2011-12-15 | Toa Corp | 移動体軌跡表示装置および移動体軌跡表示プログラム |
JP2012099975A (ja) * | 2010-10-29 | 2012-05-24 | Keyence Corp | 動画追尾装置、動画追尾方法および動画追尾プログラム |
JP2015018340A (ja) * | 2013-07-09 | 2015-01-29 | キヤノン株式会社 | 画像処理装置、画像処理方法 |
JP2015070354A (ja) * | 2013-09-27 | 2015-04-13 | パナソニックIpマネジメント株式会社 | 移動体追跡装置、移動体追跡システムおよび移動体追跡方法 |
WO2015108236A1 (ko) * | 2014-01-14 | 2015-07-23 | 삼성테크윈 주식회사 | 요약 영상 브라우징 시스템 및 방법 |
US10032483B2 (en) | 2014-01-14 | 2018-07-24 | Hanwha Techwin Co., Ltd. | Summary image browsing system and method |
JP2016129295A (ja) * | 2015-01-09 | 2016-07-14 | キヤノン株式会社 | 情報処理装置、情報処理方法及びプログラム |
WO2016166990A1 (ja) * | 2015-04-17 | 2016-10-20 | パナソニックIpマネジメント株式会社 | 動線分析システム及び動線分析方法 |
JP5915960B1 (ja) * | 2015-04-17 | 2016-05-11 | パナソニックIpマネジメント株式会社 | 動線分析システム及び動線分析方法 |
US10567677B2 (en) | 2015-04-17 | 2020-02-18 | Panasonic I-Pro Sensing Solutions Co., Ltd. | Flow line analysis system and flow line analysis method |
US10602080B2 (en) | 2015-04-17 | 2020-03-24 | Panasonic I-Pro Sensing Solutions Co., Ltd. | Flow line analysis system and flow line analysis method |
WO2016189785A1 (ja) * | 2015-05-22 | 2016-12-01 | パナソニックIpマネジメント株式会社 | 動線分析システム、カメラ装置及び動線分析方法 |
JP5909708B1 (ja) * | 2015-05-22 | 2016-04-27 | パナソニックIpマネジメント株式会社 | 動線分析システム、カメラ装置及び動線分析方法 |
JP5909709B1 (ja) * | 2015-05-29 | 2016-04-27 | パナソニックIpマネジメント株式会社 | 動線分析システム、カメラ装置及び動線分析方法 |
JP5909710B1 (ja) * | 2015-06-05 | 2016-04-27 | パナソニックIpマネジメント株式会社 | 動線分析システム、カメラ装置及び動線分析方法 |
JP5909711B1 (ja) * | 2015-06-15 | 2016-04-27 | パナソニックIpマネジメント株式会社 | 動線分析システム及び動線表示方法 |
JP5909712B1 (ja) * | 2015-07-30 | 2016-04-27 | パナソニックIpマネジメント株式会社 | 動線分析システム、カメラ装置及び動線分析方法 |
JP2017046023A (ja) * | 2015-08-24 | 2017-03-02 | 三菱電機株式会社 | 移動体追跡装置及び移動体追跡方法及び移動体追跡プログラム |
US10621423B2 (en) | 2015-12-24 | 2020-04-14 | Panasonic I-Pro Sensing Solutions Co., Ltd. | Moving information analyzing system and moving information analyzing method |
US10956722B2 (en) | 2015-12-24 | 2021-03-23 | Panasonic I-Pro Sensing Solutions Co., Ltd. | Moving information analyzing system and moving information analyzing method |
US10497130B2 (en) | 2016-05-10 | 2019-12-03 | Panasonic Intellectual Property Management Co., Ltd. | Moving information analyzing system and moving information analyzing method |
JP7451798B2 (ja) | 2016-05-13 | 2024-03-18 | グーグル エルエルシー | スマートデバイスでレーダを利用するためのシステム、方法およびデバイス |
JPWO2018180040A1 (ja) * | 2017-03-31 | 2019-12-19 | 日本電気株式会社 | 映像処理装置、映像解析システム、方法およびプログラム |
WO2018180040A1 (ja) * | 2017-03-31 | 2018-10-04 | 日本電気株式会社 | 映像処理装置、映像解析システム、方法およびプログラム |
US10846865B2 (en) | 2017-03-31 | 2020-11-24 | Nec Corporation | Video image processing device, video image analysis system, method, and program |
JP2019008507A (ja) * | 2017-06-23 | 2019-01-17 | 株式会社東芝 | 変換行列算出装置、位置推定装置、変換行列算出方法および位置推定方法 |
KR20190085620A (ko) * | 2018-01-11 | 2019-07-19 | 김영환 | 공간 내의 물체 운동 분석 장치 및 그 제어 방법 |
KR102028726B1 (ko) * | 2018-01-11 | 2019-10-07 | 김영환 | 공간 내의 물체 운동 분석 장치 및 그 제어 방법 |
JP2021176033A (ja) * | 2020-05-01 | 2021-11-04 | ピクシーダストテクノロジーズ株式会社 | 情報処理装置、情報処理方法、およびプログラム |
CN113850836A (zh) * | 2021-09-29 | 2021-12-28 | 平安科技(深圳)有限公司 | 基于行为轨迹的员工行为识别方法、装置、设备及介质 |
Also Published As
Publication number | Publication date |
---|---|
US20110199461A1 (en) | 2011-08-18 |
JPWO2010044186A1 (ja) | 2012-03-08 |
JP5634266B2 (ja) | 2014-12-03 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2010044186A1 (ja) | 動線作成システム、動線作成装置及び3次元動線表示装置 | |
US10013795B2 (en) | Operation support method, operation support program, and operation support system | |
EP3627446B1 (en) | System, method and medium for generating a geometric model | |
KR102111935B1 (ko) | 표시 제어장치, 표시 제어방법 및 프로그램 | |
JP5323910B2 (ja) | 移動ロボットの遠隔操縦のための衝突防止装置及び方法 | |
Koyasu et al. | Real-time omnidirectional stereo for obstacle detection and tracking in dynamic environments | |
KR101916467B1 (ko) | Avm 시스템의 장애물 검출 장치 및 방법 | |
CN103171552A (zh) | 基于avm俯视图的停车辅助*** | |
WO2010073929A1 (ja) | 人判定装置、方法およびプログラム | |
WO2014162554A1 (ja) | 画像処理システムおよび画像処理用プログラム | |
JP2011128838A (ja) | 画像表示装置 | |
JP2023502239A (ja) | 広視野角のステレオカメラ装置およびこれを利用した深度画像処理方法 | |
JP7428139B2 (ja) | 画像処理装置、画像処理方法および画像処理システム | |
JP2006318062A (ja) | 画像処理装置、画像処理方法、および画像処理用プログラム | |
JP7444073B2 (ja) | 画像処理装置、画像処理方法および画像処理システム | |
JP4699056B2 (ja) | 自動追尾装置及び自動追尾方法 | |
KR101611427B1 (ko) | 영상 처리 방법 및 이를 수행하는 영상 처리 장치 | |
EP3896961B1 (en) | Image processing device, image processing method, and image processing system | |
KR20130071842A (ko) | 차량의 주변 정보 제공 장치 및 방법 | |
KR100550430B1 (ko) | 3차원 정보를 이용한 이동체의 주행 안내장치 및 방법 | |
JP2006033188A (ja) | 監視装置および監視方法 | |
EP3675502A1 (en) | Method for street view service and apparatus for performing same method | |
KR20180041525A (ko) | 차량의 물체 트래킹 시스템 및 그 제어 방법 | |
CN111968157B (zh) | 一种应用于高智能机器人的视觉定位***及方法 | |
KR100434877B1 (ko) | 변이 움직임 벡터를 이용한 스테레오 물체 추적 방법 및장치 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 09820365 Country of ref document: EP Kind code of ref document: A1 |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2010533787 Country of ref document: JP |
|
WWE | Wipo information: entry into national phase |
Ref document number: 13123788 Country of ref document: US |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 09820365 Country of ref document: EP Kind code of ref document: A1 |