CN115461785A - 生成非线性人类形状模型 - Google Patents

生成非线性人类形状模型 Download PDF

Info

Publication number
CN115461785A
CN115461785A CN202080100318.0A CN202080100318A CN115461785A CN 115461785 A CN115461785 A CN 115461785A CN 202080100318 A CN202080100318 A CN 202080100318A CN 115461785 A CN115461785 A CN 115461785A
Authority
CN
China
Prior art keywords
shape
model
learned
training
machine
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202080100318.0A
Other languages
English (en)
Chinese (zh)
Inventor
C.斯明奇塞斯库
徐鸿燚
E.G.巴扎万
A.赞菲尔
W.T.弗里曼
R.苏克坦卡尔
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Google LLC
Original Assignee
Google LLC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Google LLC filed Critical Google LLC
Publication of CN115461785A publication Critical patent/CN115461785A/zh
Pending legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
    • G06T17/20—Finite element generation, e.g. wire-frame surface description, tesselation
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N20/00—Machine learning
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/045—Combinations of networks
    • G06N3/0455—Auto-encoder networks; Encoder-decoder networks
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G06T19/20—Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20081—Training; Learning
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2219/00—Indexing scheme for manipulating 3D models or images for computer graphics
    • G06T2219/20—Indexing scheme for editing of 3D models
    • G06T2219/2021—Shape modification

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Software Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Computer Graphics (AREA)
  • Evolutionary Computation (AREA)
  • Mathematical Physics (AREA)
  • General Health & Medical Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Computing Systems (AREA)
  • Artificial Intelligence (AREA)
  • Data Mining & Analysis (AREA)
  • Geometry (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Biophysics (AREA)
  • Molecular Biology (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Computational Linguistics (AREA)
  • Biomedical Technology (AREA)
  • Multimedia (AREA)
  • Computer Hardware Design (AREA)
  • Architecture (AREA)
  • Medical Informatics (AREA)
  • Human Computer Interaction (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Processing Or Creating Images (AREA)
  • Image Processing (AREA)
  • Image Analysis (AREA)
  • Image Generation (AREA)
CN202080100318.0A 2020-04-30 2020-04-30 生成非线性人类形状模型 Pending CN115461785A (zh)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/US2020/030712 WO2021221657A1 (en) 2020-04-30 2020-04-30 Generative nonlinear human shape models

Publications (1)

Publication Number Publication Date
CN115461785A true CN115461785A (zh) 2022-12-09

Family

ID=70802929

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202080100318.0A Pending CN115461785A (zh) 2020-04-30 2020-04-30 生成非线性人类形状模型

Country Status (6)

Country Link
US (1) US20230169727A1 (ja)
EP (1) EP4128168A1 (ja)
JP (1) JP7378642B2 (ja)
KR (1) KR20230004837A (ja)
CN (1) CN115461785A (ja)
WO (1) WO2021221657A1 (ja)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116434347A (zh) * 2023-06-12 2023-07-14 中山大学 一种基于掩码图自编码器的骨架序列识别方法及***

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111260774B (zh) * 2020-01-20 2023-06-23 北京百度网讯科技有限公司 生成3d关节点回归模型的方法和装置
CN114333069B (zh) * 2022-03-03 2022-05-17 腾讯科技（深圳）有限公司 对象的姿态处理方法、装置、设备及存储介质
CN117409161A (zh) * 2022-07-06 2024-01-16 戴尔产品有限公司 点云处理方法和电子设备
CN116452755B (zh) * 2023-06-15 2023-09-22 成就医学科技(天津)有限公司 一种骨骼模型构建方法、***、介质及设备
CN116740820B (zh) * 2023-08-16 2023-10-31 南京理工大学 基于自动增广的单视角点云三维人体姿态与形状估计方法

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11127163B2 (en) * 2015-06-24 2021-09-21 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Skinned multi-infant linear body model
US10297065B2 (en) * 2016-11-09 2019-05-21 Disney Enterprises, Inc. Methods and systems of enriching blendshape rigs with physical simulation
EP3330927A1 (en) * 2016-12-05 2018-06-06 THOMSON Licensing Method and apparatus for sculpting a 3d model
US10943383B2 (en) 2017-01-26 2021-03-09 Sony Corporation Information processing apparatus and information processing method
JP6244593B1 (ja) 2017-01-30 2017-12-13 株式会社コロプラ 情報処理方法、装置、および当該情報処理方法をコンピュータに実行させるためのプログラム
US10546433B2 (en) * 2017-08-03 2020-01-28 The University Of North Carolina At Chapel Hill Methods, systems, and computer readable media for modeling garments using single view images
US11989976B2 (en) 2018-02-16 2024-05-21 Nippon Telegraph And Telephone Corporation Nonverbal information generation apparatus, nonverbal information generation model learning apparatus, methods, and programs

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116434347A (zh) * 2023-06-12 2023-07-14 中山大学 一种基于掩码图自编码器的骨架序列识别方法及***
CN116434347B (zh) * 2023-06-12 2023-10-13 中山大学 一种基于掩码图自编码器的骨架序列识别方法及***

Also Published As

Publication number Publication date
EP4128168A1 (en) 2023-02-08
WO2021221657A1 (en) 2021-11-04
KR20230004837A (ko) 2023-01-06
US20230169727A1 (en) 2023-06-01
JP2023524252A (ja) 2023-06-09
JP7378642B2 (ja) 2023-11-13

Similar Documents

Publication Publication Date Title
CN115461785A (zh) 生成非线性人类形状模型
Ichim et al. Dynamic 3D avatar creation from hand-held video input
CN111784821B (zh) 三维模型生成方法、装置、计算机设备及存储介质
CN109829972B (zh) 一种面向连续帧点云的三维人体标准骨架提取方法
US12026892B2 (en) Figure-ground neural radiance fields for three-dimensional object category modelling
CN115346000A (zh) 三维人体重建方法、装置、计算机可读介质及电子设备
Le et al. Marker optimization for facial motion acquisition and deformation
CN111260702B (zh) 激光三维点云与ct三维点云配准方法
CN115951784A (zh) 一种基于双神经辐射场的穿衣人体运动捕捉和生成方法
CN115830241A (zh) 一种基于神经网络的真实感三维人脸纹理重建方法
Madadi et al. Deep unsupervised 3D human body reconstruction from a sparse set of landmarks
Gan et al. Fine-grained multi-view hand reconstruction using inverse rendering
Saint et al. 3dbooster: 3d body shape and texture recovery
Garcia-D’Urso et al. Accurate estimation of parametric models of the human body from 3D point clouds
AU2022241513B2 (en) Transformer-based shape models
CN116452715A (zh) 动态人手渲染方法、装置及存储介质
Duveau et al. Cage-based motion recovery using manifold learning
Biswas et al. Physically plausible 3D human-scene reconstruction from monocular RGB image using an adversarial learning approach
Huang et al. Detail-preserving controllable deformation from sparse examples
CN113077383A (zh) 一种模型训练方法及模型训练装置
Zeitvogel et al. Towards end-to-end 3D human avatar shape reconstruction from 4D data
US20240212279A1 (en) Detailed 3d object reconstruction method and apparatus using laplacian coordinates
KR20240103980A (ko) 라플라시안 좌표를 이용하는 디테일 3차원 객체 복원 방법 및 장치
CN116912433B (zh) 三维模型骨骼绑定方法、装置、设备及存储介质
US20240161470A1 (en) Machine-Learned Models for Implicit Object Representation

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination