CN113129372B - 基于HoloLens空间映射的三维场景语义分析方法 - Google Patents
基于HoloLens空间映射的三维场景语义分析方法 Download PDFInfo
- Publication number
- CN113129372B CN113129372B CN202110331289.5A CN202110331289A CN113129372B CN 113129372 B CN113129372 B CN 113129372B CN 202110331289 A CN202110331289 A CN 202110331289A CN 113129372 B CN113129372 B CN 113129372B
- Authority
- CN
- China
- Prior art keywords
- hololens
- data
- scene
- dimensional
- training
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000013507 mapping Methods 0.000 title claims abstract description 37
- 238000004458 analytical method Methods 0.000 title claims abstract description 33
- 238000012549 training Methods 0.000 claims abstract description 47
- 238000013528 artificial neural network Methods 0.000 claims abstract description 22
- 238000002372 labelling Methods 0.000 claims abstract description 14
- 238000000034 method Methods 0.000 claims abstract description 14
- 238000007781 pre-processing Methods 0.000 claims abstract description 5
- 230000003930 cognitive ability Effects 0.000 claims abstract description 4
- 238000001914 filtration Methods 0.000 claims description 15
- 238000005070 sampling Methods 0.000 claims description 10
- 230000004927 fusion Effects 0.000 claims description 7
- 230000005484 gravity Effects 0.000 claims description 6
- 238000011176 pooling Methods 0.000 claims description 6
- 238000004519 manufacturing process Methods 0.000 claims description 5
- 230000002146 bilateral effect Effects 0.000 claims description 4
- 238000010276 construction Methods 0.000 claims description 3
- 238000011161 development Methods 0.000 claims description 3
- 238000011068 loading method Methods 0.000 claims description 3
- 239000011159 matrix material Substances 0.000 claims description 3
- 230000000007 visual effect Effects 0.000 claims description 3
- 230000008447 perception Effects 0.000 abstract 1
- 230000019771 cognition Effects 0.000 description 3
- 238000010586 diagram Methods 0.000 description 3
- 238000004364 calculation method Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 238000000605 extraction Methods 0.000 description 2
- 230000003190 augmentative effect Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 239000011521 glass Substances 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 238000002360 preparation method Methods 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/70—Determining position or orientation of objects or cameras
- G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/24—Classification techniques
- G06F18/243—Classification techniques relating to the number of classes
- G06F18/2433—Single-class perspective, e.g. one-against-all classification; Novelty detection; Outlier detection
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/25—Fusion techniques
- G06F18/253—Fusion techniques of extracted features
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/08—Learning methods
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10028—Range image; Depth image; 3D point clouds
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20024—Filtering details
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20024—Filtering details
- G06T2207/20028—Bilateral filtering
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20081—Training; Learning
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20084—Artificial neural networks [ANN]
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- Data Mining & Analysis (AREA)
- General Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Life Sciences & Earth Sciences (AREA)
- Artificial Intelligence (AREA)
- Evolutionary Computation (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Computational Linguistics (AREA)
- Biophysics (AREA)
- Biomedical Technology (AREA)
- General Health & Medical Sciences (AREA)
- Molecular Biology (AREA)
- Computing Systems (AREA)
- Health & Medical Sciences (AREA)
- Mathematical Physics (AREA)
- Software Systems (AREA)
- Bioinformatics & Cheminformatics (AREA)
- Bioinformatics & Computational Biology (AREA)
- Evolutionary Biology (AREA)
- Processing Or Creating Images (AREA)
Abstract
Description
Claims (4)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202110331289.5A CN113129372B (zh) | 2021-03-29 | 2021-03-29 | 基于HoloLens空间映射的三维场景语义分析方法 |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202110331289.5A CN113129372B (zh) | 2021-03-29 | 2021-03-29 | 基于HoloLens空间映射的三维场景语义分析方法 |
Publications (2)
Publication Number | Publication Date |
---|---|
CN113129372A CN113129372A (zh) | 2021-07-16 |
CN113129372B true CN113129372B (zh) | 2023-11-03 |
Family
ID=76774300
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202110331289.5A Active CN113129372B (zh) | 2021-03-29 | 2021-03-29 | 基于HoloLens空间映射的三维场景语义分析方法 |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN113129372B (zh) |
Families Citing this family (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN113589929A (zh) * | 2021-07-29 | 2021-11-02 | 和舆图(北京)科技有限公司 | 一种基于HoloLens设备的空间距离测量方法及*** |
CN113706689B (zh) * | 2021-08-04 | 2022-12-09 | 西安交通大学 | 一种基于Hololens深度数据的装配指导方法及*** |
CN113470095B (zh) * | 2021-09-03 | 2021-11-16 | 贝壳技术有限公司 | 室内场景重建模型的处理方法和装置 |
Citations (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103985155A (zh) * | 2014-05-14 | 2014-08-13 | 北京理工大学 | 基于映射法的散乱点云Delaunay三角剖分曲面重构方法 |
CN110353806A (zh) * | 2019-06-18 | 2019-10-22 | 北京航空航天大学 | 用于微创全膝关节置换手术的增强现实导航方法及*** |
CN111680542A (zh) * | 2020-04-17 | 2020-09-18 | 东南大学 | 基于多尺度特征提取和Pointnet神经网络的钢卷点云识别与分类方法 |
CN111753698A (zh) * | 2020-06-17 | 2020-10-09 | 东南大学 | 一种多模态三维点云分割***和方法 |
CN111798475A (zh) * | 2020-05-29 | 2020-10-20 | 浙江工业大学 | 一种基于点云深度学习的室内环境3d语义地图构建方法 |
CN111968121A (zh) * | 2020-08-03 | 2020-11-20 | 电子科技大学 | 一种基于实例嵌入与语义融合的三维点云场景分割方法 |
CN112287939A (zh) * | 2020-10-29 | 2021-01-29 | 平安科技(深圳)有限公司 | 三维点云语义分割方法、装置、设备及介质 |
EP3789965A1 (en) * | 2019-09-09 | 2021-03-10 | apoQlar GmbH | Method for controlling a display, computer program and mixed reality display device |
Family Cites Families (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP3340187A1 (en) * | 2016-12-26 | 2018-06-27 | Thomson Licensing | Device and method for generating dynamic virtual contents in mixed reality |
-
2021
- 2021-03-29 CN CN202110331289.5A patent/CN113129372B/zh active Active
Patent Citations (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103985155A (zh) * | 2014-05-14 | 2014-08-13 | 北京理工大学 | 基于映射法的散乱点云Delaunay三角剖分曲面重构方法 |
CN110353806A (zh) * | 2019-06-18 | 2019-10-22 | 北京航空航天大学 | 用于微创全膝关节置换手术的增强现实导航方法及*** |
EP3789965A1 (en) * | 2019-09-09 | 2021-03-10 | apoQlar GmbH | Method for controlling a display, computer program and mixed reality display device |
CN111680542A (zh) * | 2020-04-17 | 2020-09-18 | 东南大学 | 基于多尺度特征提取和Pointnet神经网络的钢卷点云识别与分类方法 |
CN111798475A (zh) * | 2020-05-29 | 2020-10-20 | 浙江工业大学 | 一种基于点云深度学习的室内环境3d语义地图构建方法 |
CN111753698A (zh) * | 2020-06-17 | 2020-10-09 | 东南大学 | 一种多模态三维点云分割***和方法 |
CN111968121A (zh) * | 2020-08-03 | 2020-11-20 | 电子科技大学 | 一种基于实例嵌入与语义融合的三维点云场景分割方法 |
CN112287939A (zh) * | 2020-10-29 | 2021-01-29 | 平安科技(深圳)有限公司 | 三维点云语义分割方法、装置、设备及介质 |
Non-Patent Citations (5)
Title |
---|
Mesorasi: Architecture Support for Point Cloud Analytics via Delayed-Aggregation;Yu Feng;《2020 53rd Annual IEEE/ACM International Symposium on Microarchitecture (MICRO)》;20201111;1037-1050页 * |
PointNet Plus Plus: Deep llierarchical feature Learning on Point Sets in a Metric Space;Qi C R;《2017 31st Annual Conference on Neural lnformation Processing Systems(N1PS)》;20170607;30-38页 * |
动态多光照三维光场采集***设计与实现;任浩然;《杭州电子科技大学学报》;20130228;65-68页 * |
基于多尺度特征和PointNet的LiDAR点云地物分类方法;赵中阳;《激光与光电子学进展》;20190614;243-250页 * |
适用宇航智能交互场景的混合现实技术研究;李林瞳;《计算机测量与控制》;20180122;255-258页 * |
Also Published As
Publication number | Publication date |
---|---|
CN113129372A (zh) | 2021-07-16 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN113129372B (zh) | 基于HoloLens空间映射的三维场景语义分析方法 | |
Zhang et al. | Image engineering | |
CN108319957A (zh) | 一种基于超点图的大规模点云语义分割方法 | |
CN112784736B (zh) | 一种多模态特征融合的人物交互行为识别方法 | |
CN109241871A (zh) | 一种基于视频数据的公共区域人流跟踪方法 | |
CN112818925B (zh) | 一种城市建筑和树冠识别方法 | |
TW200945253A (en) | Geospatial modeling system providing simulated tree trunks and branches for groups of tree crown vegetation points and related methods | |
CN106651900A (zh) | 一种基于轮廓分割的高架原位草莓三维建模方法 | |
CN109886153A (zh) | 一种基于深度卷积神经网络的实时人脸检测方法 | |
CN111062260B (zh) | 一种面部整容推荐方案自动生成方法 | |
CN110490959A (zh) | 三维图像处理方法及装置、虚拟形象生成方法以及电子设备 | |
CN115082254A (zh) | 一种变电站精益管控数字孪生*** | |
CN112001293A (zh) | 结合多尺度信息和编解码网络的遥感影像地物分类方法 | |
CN115661404A (zh) | 一种多细粒度树木实景参数化建模方法 | |
CN115375857A (zh) | 三维场景重建方法、装置、设备及存储介质 | |
CN114627017B (zh) | 一种基于多层次注意力感知的点云去噪方法 | |
CN112396655A (zh) | 一种基于点云数据的船舶目标6d位姿估计方法 | |
He | Application of local color simulation method of landscape painting based on deep learning generative adversarial networks | |
CN110717978A (zh) | 基于单张图像的三维头部重建方法 | |
CN109164444A (zh) | 一种基于遥感数据的自然景观重构方法 | |
CN113144613A (zh) | 基于模型的体积云生成的方法 | |
CN108805095A (zh) | 图片处理方法、装置、移动终端及计算机可读存储介质 | |
CN116721345A (zh) | 一种马尾松苗木的形态指标无损测量方法 | |
CN115861532A (zh) | 基于深度学习的植被地物模型重建方法与*** | |
CN116246184A (zh) | 一种应用于无人机航拍图像的罂粟智能识别方法及*** |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
TA01 | Transfer of patent application right | ||
TA01 | Transfer of patent application right |
Effective date of registration: 20230921 Address after: C217-2, Tsinghua University Research Institute, No. 019 Gaoxin South 7th Road, Gaoxin Community, Yuehai Street, Nanshan District, Shenzhen City, Guangdong Province, 518000 Applicant after: Shenzhen Qingyuan Cultural Technology Co.,Ltd. Address before: 518000 1002, Building A, Zhiyun Industrial Park, No. 13, Huaxing Road, Henglang Community, Longhua District, Shenzhen, Guangdong Province Applicant before: Shenzhen Wanzhida Technology Co.,Ltd. Effective date of registration: 20230921 Address after: 518000 1002, Building A, Zhiyun Industrial Park, No. 13, Huaxing Road, Henglang Community, Longhua District, Shenzhen, Guangdong Province Applicant after: Shenzhen Wanzhida Technology Co.,Ltd. Address before: 710048 Shaanxi province Xi'an Beilin District Jinhua Road No. 5 Applicant before: XI'AN University OF TECHNOLOGY |
|
GR01 | Patent grant | ||
GR01 | Patent grant |