CN116524026B - Dynamic vision SLAM method based on frequency domain and semantics - Google Patents
Dynamic vision SLAM method based on frequency domain and semantics Download PDFInfo
- Publication number
- CN116524026B CN116524026B CN202310505675.0A CN202310505675A CN116524026B CN 116524026 B CN116524026 B CN 116524026B CN 202310505675 A CN202310505675 A CN 202310505675A CN 116524026 B CN116524026 B CN 116524026B
- Authority
- CN
- China
- Prior art keywords
- image
- mask
- motion
- frame
- dynamic
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 35
- 230000033001 locomotion Effects 0.000 claims abstract description 60
- 238000001514 detection method Methods 0.000 claims abstract description 17
- 230000003068 static effect Effects 0.000 claims abstract description 11
- 230000011218 segmentation Effects 0.000 claims abstract description 7
- 230000009466 transformation Effects 0.000 claims description 16
- 230000004044 response Effects 0.000 claims description 12
- 238000003708 edge detection Methods 0.000 claims description 9
- 238000001914 filtration Methods 0.000 claims description 9
- 238000010586 diagram Methods 0.000 claims description 8
- YBJHBAHKTGYVGT-ZKWXMUAHSA-N (+)-Biotin Chemical compound N1C(=O)N[C@@H]2[C@H](CCCCC(=O)O)SC[C@@H]21 YBJHBAHKTGYVGT-ZKWXMUAHSA-N 0.000 claims description 6
- 206010047571 Visual impairment Diseases 0.000 claims description 6
- 238000000605 extraction Methods 0.000 claims description 6
- FEPMHVLSLDOMQC-UHFFFAOYSA-N virginiamycin-S1 Natural products CC1OC(=O)C(C=2C=CC=CC=2)NC(=O)C2CC(=O)CCN2C(=O)C(CC=2C=CC=CC=2)N(C)C(=O)C2CCCN2C(=O)C(CC)NC(=O)C1NC(=O)C1=NC=CC=C1O FEPMHVLSLDOMQC-UHFFFAOYSA-N 0.000 claims description 6
- 238000010276 construction Methods 0.000 claims description 4
- 230000008569 process Effects 0.000 claims description 4
- 230000008030 elimination Effects 0.000 claims description 3
- 238000003379 elimination reaction Methods 0.000 claims description 3
- 230000006870 function Effects 0.000 claims description 3
- 238000005286 illumination Methods 0.000 abstract description 10
- 230000008859 change Effects 0.000 abstract description 7
- 238000013507 mapping Methods 0.000 abstract description 6
- IKGXIBQEEMLURG-NVPNHPEKSA-N rutin Chemical compound O[C@@H]1[C@H](O)[C@@H](O)[C@H](C)O[C@H]1OC[C@@H]1[C@@H](O)[C@H](O)[C@@H](O)[C@H](OC=2C(C3=C(O)C=C(O)C=C3OC=2C=2C=C(O)C(O)=CC=2)=O)O1 IKGXIBQEEMLURG-NVPNHPEKSA-N 0.000 abstract description 2
- 238000012360 testing method Methods 0.000 abstract description 2
- 230000000694 effects Effects 0.000 description 7
- 230000000007 visual effect Effects 0.000 description 5
- 230000004807 localization Effects 0.000 description 4
- 230000015556 catabolic process Effects 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 3
- 238000006731 degradation reaction Methods 0.000 description 2
- 230000007613 environmental effect Effects 0.000 description 2
- 230000006872 improvement Effects 0.000 description 2
- 238000005457 optimization Methods 0.000 description 2
- 238000011160 research Methods 0.000 description 2
- 230000001360 synchronised effect Effects 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000013135 deep learning Methods 0.000 description 1
- 238000011156 evaluation Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012216 screening Methods 0.000 description 1
- 230000002123 temporal effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/70—Determining position or orientation of objects or cameras
- G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
- G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
- G01C21/20—Instruments for performing navigational calculations
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/10—Segmentation; Edge detection
- G06T7/13—Edge detection
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/20—Analysis of motion
- G06T7/246—Analysis of motion using feature-based methods, e.g. the tracking of corners or segments
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/20—Analysis of motion
- G06T7/254—Analysis of motion involving subtraction of images
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/30—Determination of transform parameters for the alignment of images, i.e. image registration
- G06T7/33—Determination of transform parameters for the alignment of images, i.e. image registration using feature-based methods
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/30—Determination of transform parameters for the alignment of images, i.e. image registration
- G06T7/37—Determination of transform parameters for the alignment of images, i.e. image registration using transform domain methods
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/50—Depth or shape recovery
- G06T7/55—Depth or shape recovery from multiple images
- G06T7/579—Depth or shape recovery from multiple images from motion
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/20—Image preprocessing
- G06V10/26—Segmentation of patterns in the image field; Cutting or merging of image elements to establish the pattern region, e.g. clustering-based techniques; Detection of occlusion
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Multimedia (AREA)
- Radar, Positioning & Navigation (AREA)
- Remote Sensing (AREA)
- Automation & Control Theory (AREA)
- Image Analysis (AREA)
Abstract
Description
Claims (1)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202310505675.0A CN116524026B (en) | 2023-05-08 | 2023-05-08 | Dynamic vision SLAM method based on frequency domain and semantics |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202310505675.0A CN116524026B (en) | 2023-05-08 | 2023-05-08 | Dynamic vision SLAM method based on frequency domain and semantics |
Publications (2)
Publication Number | Publication Date |
---|---|
CN116524026A CN116524026A (en) | 2023-08-01 |
CN116524026B true CN116524026B (en) | 2023-10-27 |
Family
ID=87402762
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202310505675.0A Active CN116524026B (en) | 2023-05-08 | 2023-05-08 | Dynamic vision SLAM method based on frequency domain and semantics |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN116524026B (en) |
Families Citing this family (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN117036408B (en) * | 2023-08-22 | 2024-03-29 | 哈尔滨理工大学 | Object SLAM method combining multi-target tracking under dynamic environment |
Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102970528A (en) * | 2012-12-28 | 2013-03-13 | 北京航空航天大学 | Video object division method based on change detection and frame difference accumulation |
CN106127801A (en) * | 2016-06-16 | 2016-11-16 | 乐视控股(北京)有限公司 | A kind of method and apparatus of moving region detection |
CN110334762A (en) * | 2019-07-04 | 2019-10-15 | 华南师范大学 | A kind of feature matching method combining ORB and SIFT based on quaternary tree |
CN110942484A (en) * | 2019-11-26 | 2020-03-31 | 福州大学 | Camera self-motion estimation method based on occlusion perception and feature pyramid matching |
CN112465858A (en) * | 2020-12-10 | 2021-03-09 | 武汉工程大学 | Semantic vision SLAM method based on probability grid filtering |
JP2021082265A (en) * | 2019-11-15 | 2021-05-27 | 広東工業大学Guangdong University Of Technology | Drone visual travel distance measuring method based on depth point line feature |
CN114140527A (en) * | 2021-11-19 | 2022-03-04 | 苏州科技大学 | Dynamic environment binocular vision SLAM method based on semantic segmentation |
-
2023
- 2023-05-08 CN CN202310505675.0A patent/CN116524026B/en active Active
Patent Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102970528A (en) * | 2012-12-28 | 2013-03-13 | 北京航空航天大学 | Video object division method based on change detection and frame difference accumulation |
CN106127801A (en) * | 2016-06-16 | 2016-11-16 | 乐视控股(北京)有限公司 | A kind of method and apparatus of moving region detection |
CN110334762A (en) * | 2019-07-04 | 2019-10-15 | 华南师范大学 | A kind of feature matching method combining ORB and SIFT based on quaternary tree |
JP2021082265A (en) * | 2019-11-15 | 2021-05-27 | 広東工業大学Guangdong University Of Technology | Drone visual travel distance measuring method based on depth point line feature |
CN110942484A (en) * | 2019-11-26 | 2020-03-31 | 福州大学 | Camera self-motion estimation method based on occlusion perception and feature pyramid matching |
CN112465858A (en) * | 2020-12-10 | 2021-03-09 | 武汉工程大学 | Semantic vision SLAM method based on probability grid filtering |
CN114140527A (en) * | 2021-11-19 | 2022-03-04 | 苏州科技大学 | Dynamic environment binocular vision SLAM method based on semantic segmentation |
Also Published As
Publication number | Publication date |
---|---|
CN116524026A (en) | 2023-08-01 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN103325112B (en) | Moving target method for quick in dynamic scene | |
CN106780576B (en) | RGBD data stream-oriented camera pose estimation method | |
JP6095018B2 (en) | Detection and tracking of moving objects | |
CN114782691A (en) | Robot target identification and motion detection method based on deep learning, storage medium and equipment | |
CN109767454B (en) | Unmanned aerial vehicle aerial video moving target detection method based on time-space-frequency significance | |
CN104036524A (en) | Fast target tracking method with improved SIFT algorithm | |
CN116524026B (en) | Dynamic vision SLAM method based on frequency domain and semantics | |
CN111914832B (en) | SLAM method of RGB-D camera under dynamic scene | |
Yang et al. | Robust RGB-D SLAM in dynamic environment using faster R-CNN | |
CN111950599B (en) | Dense visual odometer method for fusing edge information in dynamic environment | |
CN116894876A (en) | 6-DOF positioning method based on real-time image | |
CN113837243B (en) | RGB-D camera dynamic visual odometer method based on edge information | |
CN116067374A (en) | Dynamic scene SLAM positioning method based on target detection algorithm YOLOv4 and geometric constraint | |
CN113592947B (en) | Method for realizing visual odometer by semi-direct method | |
CN111798506B (en) | Image processing method, terminal and computer readable storage medium | |
CN115272450A (en) | Target positioning method based on panoramic segmentation | |
Mei et al. | An Algorithm for Automatic Extraction of Moving Object in the Image Guidance | |
Wang et al. | Semi-direct Sparse Odometry with Robust and Accurate Pose Estimation for Dynamic Scenes | |
Zhu et al. | Toward the ghosting phenomenon in a stereo-based map with a collaborative RGB-D repair | |
Salehi et al. | Stereo-RSSF: stereo robust sparse scene-flow estimation | |
Wei et al. | Matching filter-based vslam optimization in indoor environments | |
Wang et al. | An improved particle filter tracking algorithm based on motion and appearance features | |
Adachi et al. | Improvement of Visual Odometry Using Classic Features by Semantic Information | |
Pan et al. | A Novel RGB-D SLAM for Recognizing Features on Static Objects | |
Zong et al. | An improved method of real-time camera pose estimation based on descriptor tracking |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant | ||
TR01 | Transfer of patent right |
Effective date of registration: 20240510 Address after: 518000 1002, Building A, Zhiyun Industrial Park, No. 13, Huaxing Road, Henglang Community, Longhua District, Shenzhen, Guangdong Province Patentee after: Shenzhen Wanzhida Technology Co.,Ltd. Country or region after: China Address before: 150080 No. 52, Xuefu Road, Nangang District, Heilongjiang, Harbin Patentee before: HARBIN University OF SCIENCE AND TECHNOLOGY Country or region before: China |
|
TR01 | Transfer of patent right | ||
TR01 | Transfer of patent right |
Effective date of registration: 20240603 Address after: Room 301, Unit 3, 101 Century Road (New Area Hotel Complex Building), Hebei Street, Jiaohe City, Jilin Province, 132500 Patentee after: Jilin Yuntou Laisengou Digital Technology Co.,Ltd. Country or region after: China Address before: 518000 1002, Building A, Zhiyun Industrial Park, No. 13, Huaxing Road, Henglang Community, Longhua District, Shenzhen, Guangdong Province Patentee before: Shenzhen Wanzhida Technology Co.,Ltd. Country or region before: China |
|
TR01 | Transfer of patent right |