CN109215102A - 影像处理方法及*** - Google Patents
影像处理方法及*** Download PDFInfo
- Publication number
- CN109215102A CN109215102A CN201810695642.6A CN201810695642A CN109215102A CN 109215102 A CN109215102 A CN 109215102A CN 201810695642 A CN201810695642 A CN 201810695642A CN 109215102 A CN109215102 A CN 109215102A
- Authority
- CN
- China
- Prior art keywords
- value
- image
- angle
- determined
- flag information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 89
- 238000012545 processing Methods 0.000 claims description 30
- 230000009471 action Effects 0.000 claims description 11
- 238000010606 normalization Methods 0.000 claims description 7
- 238000000605 extraction Methods 0.000 claims description 6
- 230000008921 facial expression Effects 0.000 abstract description 15
- 238000004590 computer program Methods 0.000 abstract description 11
- 238000009434 installation Methods 0.000 abstract description 8
- 230000008569 process Effects 0.000 description 41
- 230000014509 gene expression Effects 0.000 description 22
- 210000004709 eyebrow Anatomy 0.000 description 15
- 238000004891 communication Methods 0.000 description 13
- 239000003550 marker Substances 0.000 description 13
- 230000008859 change Effects 0.000 description 7
- 230000006870 function Effects 0.000 description 6
- 230000004397 blinking Effects 0.000 description 4
- 238000004422 calculation algorithm Methods 0.000 description 4
- 230000000694 effects Effects 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 4
- 230000005611 electricity Effects 0.000 description 3
- 230000006855 networking Effects 0.000 description 3
- 239000011800 void material Substances 0.000 description 3
- 238000006243 chemical reaction Methods 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 235000013399 edible fruits Nutrition 0.000 description 2
- 230000000193 eyeblink Effects 0.000 description 2
- 238000013507 mapping Methods 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 241000406668 Loxodonta cyclotis Species 0.000 description 1
- 235000008331 Pinus X rigitaeda Nutrition 0.000 description 1
- 235000011613 Pinus brutia Nutrition 0.000 description 1
- 241000018646 Pinus brutia Species 0.000 description 1
- 230000001133 acceleration Effects 0.000 description 1
- 230000002730 additional effect Effects 0.000 description 1
- 230000003139 buffering effect Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 239000006185 dispersion Substances 0.000 description 1
- 210000000887 face Anatomy 0.000 description 1
- 230000001815 facial effect Effects 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 238000012805 post-processing Methods 0.000 description 1
- 210000001747 pupil Anatomy 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T11/00—2D [Two Dimensional] image generation
- G06T11/60—Editing figures and text; Combining figures or text
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/168—Feature extraction; Face representation
- G06V40/171—Local features and components; Facial parts ; Occluding parts, e.g. glasses; Geometrical relationships
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/013—Eye tracking input arrangements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T13/00—Animation
- G06T13/20—3D [Three Dimensional] animation
- G06T13/40—3D [Three Dimensional] animation of characters, e.g. humans, animals or virtual beings
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/012—Head tracking input arrangements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T3/00—Geometric image transformations in the plane of the image
- G06T3/60—Rotation of whole images or parts thereof
- G06T3/604—Rotation of whole images or parts thereof using coordinate rotation digital computer [CORDIC] devices
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/20—Analysis of motion
- G06T7/246—Analysis of motion using feature-based methods, e.g. the tracking of corners or segments
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/174—Facial expression recognition
- G06V40/176—Dynamic expression
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
- G06F2203/01—Indexing scheme relating to G06F3/01
- G06F2203/011—Emotion or mood input determined on the basis of sensed human body parameters such as pulse, heart rate or beat, temperature of skin, facial expressions, iris, voice pitch, brain activity patterns
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30204—Marker
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Human Computer Interaction (AREA)
- Health & Medical Sciences (AREA)
- Oral & Maxillofacial Surgery (AREA)
- General Health & Medical Sciences (AREA)
- Multimedia (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Processing Or Creating Images (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
Description
Claims (20)
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR1020170082472A KR101966384B1 (ko) | 2017-06-29 | 2017-06-29 | 영상 처리 방법 및 시스템 |
KR10-2017-0082472 | 2017-06-29 |
Publications (2)
Publication Number | Publication Date |
---|---|
CN109215102A true CN109215102A (zh) | 2019-01-15 |
CN109215102B CN109215102B (zh) | 2023-08-18 |
Family
ID=64738694
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201810695642.6A Active CN109215102B (zh) | 2017-06-29 | 2018-06-29 | 影像处理方法及*** |
Country Status (4)
Country | Link |
---|---|
US (1) | US10878224B2 (zh) |
JP (1) | JP7182919B2 (zh) |
KR (1) | KR101966384B1 (zh) |
CN (1) | CN109215102B (zh) |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN110443872A (zh) * | 2019-07-22 | 2019-11-12 | 北京科技大学 | 一种具备动态纹理细节的表情合成方法 |
WO2021083028A1 (zh) * | 2019-11-01 | 2021-05-06 | 北京字节跳动网络技术有限公司 | 图像的处理方法、装置、电子设备及存储介质 |
CN114642886A (zh) * | 2020-12-17 | 2022-06-21 | 丰田自动车株式会社 | 移动体 |
Families Citing this family (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2020129959A1 (ja) * | 2018-12-18 | 2020-06-25 | グリー株式会社 | コンピュータプログラム、サーバ装置、端末装置及び表示方法 |
KR102667064B1 (ko) | 2019-02-19 | 2024-05-20 | 삼성전자 주식회사 | 전자 장치 및 이를 이용한 카메라 기능과 연동하여 이모지 편집을 위한 사용자 인터페이스를 제공하는 방법 |
CN109948542B (zh) | 2019-03-19 | 2022-09-23 | 北京百度网讯科技有限公司 | 手势识别方法、装置、电子设备和存储介质 |
CN110136231B (zh) * | 2019-05-17 | 2023-02-24 | 网易(杭州)网络有限公司 | 虚拟角色的表情实现方法、装置及存储介质 |
CN111291674B (zh) * | 2020-02-04 | 2023-07-14 | 清华珠三角研究院 | 一种虚拟人物表情动作的提取方法、***、装置及介质 |
CN111367580B (zh) * | 2020-02-28 | 2024-02-13 | Oppo(重庆)智能科技有限公司 | 一种应用启动方法、装置及计算机可读存储介质 |
WO2022024274A1 (ja) * | 2020-07-29 | 2022-02-03 | 日本電気株式会社 | 画像処理装置、画像処理方法、及び、記録媒体 |
CN113223126A (zh) * | 2021-05-19 | 2021-08-06 | 广州虎牙科技有限公司 | 虚拟对象的表情生成方法、应用程序、设备及存储介质 |
KR102547358B1 (ko) * | 2022-11-15 | 2023-06-23 | 엠앤앤에이치 주식회사 | 볼류메트릭 동영상을 이용한 아바타 퍼포밍 장치 및 방법 |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2006202188A (ja) * | 2005-01-24 | 2006-08-03 | Oki Electric Ind Co Ltd | 画像合成装置およびそのパターン確認方法 |
CN101098241A (zh) * | 2006-06-26 | 2008-01-02 | 腾讯科技(深圳)有限公司 | 虚拟形象实现方法及其*** |
JP2011070623A (ja) * | 2009-08-31 | 2011-04-07 | Sony Corp | 画像処理装置および画像処理方法、並びにプログラム |
CN103907137A (zh) * | 2011-08-31 | 2014-07-02 | 岩石国际集团私人有限公司 | 虚拟广告平台 |
CN105654778A (zh) * | 2014-12-01 | 2016-06-08 | 星克跃尔株式会社 | 电子装置、电子装置的控制方法 |
KR20160149959A (ko) * | 2015-06-19 | 2016-12-28 | 라인 가부시키가이샤 | 사용자들간의 협업을 통해 컨텐츠를 생성하는 방법 및 시스템 |
Family Cites Families (13)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7203340B2 (en) * | 2003-09-03 | 2007-04-10 | National Research Council Of Canada | Second order change detection in video |
KR20050078757A (ko) * | 2004-02-02 | 2005-08-08 | 주식회사 비즈모델라인 | 게임 캐릭터 대체 방법과 게임 캐릭터 대체 시스템과 게임서버 또는 게임 장치 및 기록매체 |
KR20060104980A (ko) * | 2006-09-26 | 2006-10-09 | 주식회사 비즈모델라인 | 이모티콘과 아바타 연동처리 방법 및 시스템 |
JP4886645B2 (ja) * | 2007-09-20 | 2012-02-29 | 日本放送協会 | 仮想顔モデル変形装置及び仮想顔モデル変形プログラム |
JP2011528948A (ja) * | 2008-07-22 | 2011-12-01 | ソニー オンライン エンタテインメント エルエルシー | シミュレーションにおいて永続的なキャラクター個性を提供するためのシステム及び方法 |
KR20110021330A (ko) * | 2009-08-26 | 2011-03-04 | 삼성전자주식회사 | 3차원 아바타 생성 장치 및 방법 |
KR101630304B1 (ko) * | 2010-02-04 | 2016-06-14 | 삼성전자주식회사 | 디지털 촬영 장치, 그 제어 방법, 및 컴퓨터 판독가능 매체 |
KR20120059994A (ko) | 2010-12-01 | 2012-06-11 | 삼성전자주식회사 | 표정 제어점을 이용한 아바타 제어 장치 및 방법 |
US9049355B2 (en) * | 2012-09-21 | 2015-06-02 | Htc Corporation | Methods for image processing of face regions and electronic devices using the same |
CN106104633A (zh) * | 2014-03-19 | 2016-11-09 | 英特尔公司 | 面部表情和/或交互驱动的化身装置和方法 |
KR102314274B1 (ko) * | 2014-08-18 | 2021-10-20 | 삼성전자주식회사 | 컨텐츠 처리 방법 및 그 전자 장치 |
KR102205498B1 (ko) * | 2014-09-18 | 2021-01-20 | 삼성전자주식회사 | 입력 영상으로부터 특징을 추출하는 방법 및 장치 |
EP3198558A4 (en) * | 2014-09-25 | 2018-04-18 | Intel Corporation | Facilitating efficient free in-plane rotation landmark tracking of images on computing devices |
-
2017
- 2017-06-29 KR KR1020170082472A patent/KR101966384B1/ko active IP Right Grant
-
2018
- 2018-06-27 US US16/020,269 patent/US10878224B2/en active Active
- 2018-06-29 JP JP2018124807A patent/JP7182919B2/ja active Active
- 2018-06-29 CN CN201810695642.6A patent/CN109215102B/zh active Active
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2006202188A (ja) * | 2005-01-24 | 2006-08-03 | Oki Electric Ind Co Ltd | 画像合成装置およびそのパターン確認方法 |
CN101098241A (zh) * | 2006-06-26 | 2008-01-02 | 腾讯科技(深圳)有限公司 | 虚拟形象实现方法及其*** |
JP2011070623A (ja) * | 2009-08-31 | 2011-04-07 | Sony Corp | 画像処理装置および画像処理方法、並びにプログラム |
CN103907137A (zh) * | 2011-08-31 | 2014-07-02 | 岩石国际集团私人有限公司 | 虚拟广告平台 |
CN105654778A (zh) * | 2014-12-01 | 2016-06-08 | 星克跃尔株式会社 | 电子装置、电子装置的控制方法 |
KR20160149959A (ko) * | 2015-06-19 | 2016-12-28 | 라인 가부시키가이샤 | 사용자들간의 협업을 통해 컨텐츠를 생성하는 방법 및 시스템 |
Non-Patent Citations (2)
Title |
---|
戴振龙等: "基于MPEG-4的人脸表情图像变形研究", 《中国图象图形学报》 * |
蓝娟等: "基于MPEG-4和PCA的人脸动画合成方法", 《计算机工程与应用》 * |
Cited By (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN110443872A (zh) * | 2019-07-22 | 2019-11-12 | 北京科技大学 | 一种具备动态纹理细节的表情合成方法 |
WO2021083028A1 (zh) * | 2019-11-01 | 2021-05-06 | 北京字节跳动网络技术有限公司 | 图像的处理方法、装置、电子设备及存储介质 |
US20220172418A1 (en) * | 2019-11-01 | 2022-06-02 | Beijing Bytedance Network Technology Co., Ltd. | Image processing method and apparatus, electronic device, and storage medium |
US11593983B2 (en) * | 2019-11-01 | 2023-02-28 | Beijing Bytedance Network Technology Co., Ltd. | Image processing method and apparatus, electronic device, and storage medium |
CN114642886A (zh) * | 2020-12-17 | 2022-06-21 | 丰田自动车株式会社 | 移动体 |
Also Published As
Publication number | Publication date |
---|---|
CN109215102B (zh) | 2023-08-18 |
US20190005309A1 (en) | 2019-01-03 |
JP2019012526A (ja) | 2019-01-24 |
JP7182919B2 (ja) | 2022-12-05 |
US10878224B2 (en) | 2020-12-29 |
KR20190002081A (ko) | 2019-01-08 |
KR101966384B1 (ko) | 2019-08-13 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN109215102A (zh) | 影像处理方法及*** | |
US11830118B2 (en) | Virtual clothing try-on | |
EP4058987A1 (en) | Image generation using surface-based neural synthesis | |
WO2022093939A1 (en) | Side-by-side character animation from realtime 3d body motion capture | |
US11660022B2 (en) | Adaptive skeletal joint smoothing | |
US11620829B2 (en) | Visual matching with a messaging application | |
US11991469B2 (en) | Skeletal tracking for real-time virtual effects | |
US11645798B1 (en) | Facial animation transfer | |
US11736717B2 (en) | Video compression system | |
US11832015B2 (en) | User interface for pose driven virtual effects | |
US11583779B2 (en) | Message interface expansion system | |
US20240185879A1 (en) | Neural networks for changing characteristics of vocals | |
US20240184853A1 (en) | Neural networks for accompaniment extraction from songs | |
US11562548B2 (en) | True size eyewear in real time | |
KR102238036B1 (ko) | 영상 처리 방법 및 시스템 | |
US20240087266A1 (en) | Deforming real-world object using image warping | |
WO2024058966A1 (en) | Deforming real-world object using image warping |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
TA01 | Transfer of patent application right |
Effective date of registration: 20190121 Address after: Tokyo, Japan Applicant after: LINE Corp. Address before: Seoul, South Kerean Applicant before: Lian (Pulai) Co.,Ltd. |
|
TA01 | Transfer of patent application right | ||
CB02 | Change of applicant information |
Address after: Tokyo Applicant after: AI Holding Co.,Ltd. Address before: Tokyo Applicant before: LINE Corp. |
|
CB02 | Change of applicant information | ||
TA01 | Transfer of patent application right |
Effective date of registration: 20220121 Address after: Tokyo Applicant after: LINE Corp. Address before: Tokyo Applicant before: AI Holding Co.,Ltd. |
|
TA01 | Transfer of patent application right | ||
GR01 | Patent grant | ||
GR01 | Patent grant | ||
CP03 | Change of name, title or address |
Address after: Tokyo, Japan Patentee after: From Zhongzhong Global Co.,Ltd. Country or region after: Japan Address before: Tokyo, Japan Patentee before: LINE Corp. Country or region before: Japan |
|
TR01 | Transfer of patent right |
Effective date of registration: 20240701 Address after: Tokyo, Japan Patentee after: Aiwanwai Co.,Ltd. Country or region after: Japan Address before: Tokyo, Japan Patentee before: From Zhongzhong Global Co.,Ltd. Country or region before: Japan |