JP2011085686A - Three-dimensional display method and device - Google Patents
Three-dimensional display method and device Download PDFInfo
- Publication number
- JP2011085686A JP2011085686A JP2009237126A JP2009237126A JP2011085686A JP 2011085686 A JP2011085686 A JP 2011085686A JP 2009237126 A JP2009237126 A JP 2009237126A JP 2009237126 A JP2009237126 A JP 2009237126A JP 2011085686 A JP2011085686 A JP 2011085686A
- Authority
- JP
- Japan
- Prior art keywords
- face
- dimensional
- image
- screen
- person
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Landscapes
- Projection Apparatus (AREA)
- Controls And Circuits For Display Device (AREA)
- Overhead Projectors And Projection Screens (AREA)
Abstract
Description
本発明は、映像を立体的に表示させる立体表示方法およびその装置に関する。 The present invention relates to a stereoscopic display method and apparatus for stereoscopically displaying an image.
従来、映像を表示させる装置としては、スクリーン等の平面的な投影面に対して、プロジェクター等の投影装置から映像を投影していた。しかし平面的な投影面に対して映像を投影するだけでは、立体的な映像表示を作り出すことができなかった。そこで、投影される映像を立体的なものとして、投影内容を視覚的に印象付けることができるようにした簡便な立体表示装置として特開平８−６１８５号公報に記載された発明が提案されている。この発明に依れば、簡易的な人体の顔を模した立体スクリーンに対して投影装置から映像を投影することで、立体的かつ動きのある映像を表示することができる。また特開平８−３１４４０１号公報に記載された発明に依れば、人形の形態に構成された中空の組立体の顔部に立体でなる透過型スクリーンを形成し、該透過型スクリーンに画像を投影し、眼、口、眉毛および顔部の表情を映出するディスプレイ装置が提案されている。 Conventionally, as a device for displaying an image, an image is projected from a projection device such as a projector onto a planar projection surface such as a screen. However, it was not possible to produce a three-dimensional video display simply by projecting a video onto a flat projection surface. In view of this, the invention described in Japanese Patent Laid-Open No. 8-6185 has been proposed as a simple three-dimensional display device in which the projected image is stereoscopic and the projection content can be visually impressed. . According to the present invention, a three-dimensional and moving image can be displayed by projecting an image from the projection device onto a three-dimensional screen imitating a simple human face. According to the invention described in Japanese Patent Laid-Open No. 8-314401, a three-dimensional transmission screen is formed on the face of a hollow assembly configured in the form of a doll, and an image is displayed on the transmission screen. There has been proposed a display device that projects and displays facial expressions of the eyes, mouth, eyebrows, and face.
特開平８−６１８５号公報や特開平８−３１４４０１号公報に記載された発明では、立体的な表示を得ることはできるが人間の顔を映し出す場合、人間の顔の大きさ、形、目鼻口の位置に個体差があるため、簡易的な人体の顔を模した立体スクリーンへの投影では顔の特徴が表現しきれず、本物の顔に近づけるには困難であった。
そこで本発明が解決しようとする課題は、より実際の顔に近い、リアルな立体映像を表示することである。
In the inventions described in Japanese Patent Application Laid-Open Nos. 8-6185 and 8-314401, a three-dimensional display can be obtained. Since there are individual differences in the position of the human face, projection onto a three-dimensional screen simulating a simple human face cannot express the facial features, making it difficult to bring it close to a real face.
Therefore, the problem to be solved by the present invention is to display a realistic stereoscopic image that is closer to an actual face.
課題を解決するための手段として本発明では、スクリーンに映像を投影し立体表示させる立体表示方法において、非接触3次元測定装置にて人物の顔形状を顔立体形状情報として取り込む工程と、前記顔立体形状情報に基づいて前記人物の形状である立体顔スクリーンを、光造型機によって作製する工程と、前記人物の顔映像を映像撮影手段にて取り込む工程と、前記立体顔スクリーンに、前記映像を映し出すステップを有することを特徴とする立体表示方法を用いた。 As means for solving the problems, in the present invention, in a stereoscopic display method for projecting an image on a screen and displaying stereoscopically, a step of capturing a human face shape as facial stereoscopic shape information with a non-contact three-dimensional measuring device; A step of producing a three-dimensional face screen that is the shape of the person based on the three-dimensional shape information by an optical molding machine, a step of capturing the face image of the person by video photographing means, and the image on the three-dimensional face screen A stereoscopic display method characterized by having a projecting step was used.
本発明の効果によれば、完全な個人の複製映像化が可能で、より実際の人物の顔に近い立体表示映像が得られる。 According to the effect of the present invention, it is possible to make a complete personal duplicate image, and a stereoscopic display image closer to an actual person's face can be obtained.
以下、図を参照して本発明の実施例を説明する。 Embodiments of the present invention will be described below with reference to the drawings.
図１に本実施例の装置全体の構成図を示す。立体映像表示装置１は、映し出す対象個人の顔を非接触三次元測定装置にて形状測定を行い光造形機にて透明樹脂を用いて形状を作製した対象個人の立体顔スクリーン２、対象個人の映像を投影するための投影手段３、映像を投影手段から投射し、反射させて立体顔スクリーンに映し出すための反射手段４、投影手段で映像を再生した時に同時に音声を再生させるための音発生手段５、及び投影手段の映像と音発生手段の音を制御するための電子計算機６から構成されている。なお電子計算機と投影手段、電子計算機と音声再生装置は図示されていない配線で接続されている。本構成で用いる投影手段はプロジェクタであるが、オーバーヘッドプロジェクタ （ＯＨＰ）を用いても構わない。ただしＯＨＰを用いた場合は電子計算機から投影手段への制御は不要となる。プロジェクタを用いた場合の方がＯＨＰシートの取り替え等の作業を減らせるので、より簡易に行え、手間も省けるので望ましい。 FIG. 1 shows a configuration diagram of the entire apparatus of this embodiment. The stereoscopic image display device 1 measures the shape of a target individual's face to be projected with a non-contact three-dimensional measuring device and forms the shape using a transparent resin with an optical modeling machine. Projection means 3 for projecting an image, reflection means 4 for projecting an image from the projection means, reflecting the image onto a stereoscopic face screen, and sound generation means for reproducing sound simultaneously when the image is reproduced by the projection means 5 and an electronic computer 6 for controlling the image of the projection means and the sound of the sound generation means. Note that the electronic computer and the projecting means, and the electronic computer and the sound reproducing device are connected by wiring not shown. The projection means used in this configuration is a projector, but an overhead projector (OHP) may be used. However, when OHP is used, control from the computer to the projection means is not necessary. The use of a projector is preferable because it can reduce the work such as replacement of the OHP sheet, which can be performed more easily and can save labor.
反射手段は鏡を用いる。これは投影手段からスクリーンまである程度の距離が必要なためである。従って、この反射手段は凹レンズに変えることもできる。この場合、映像投影手段は顔スクリーンと一直線上に配置されることになる。従って凹レンズとした場合、よりコンパクトな表示方法を提供することができる。電子計算機にはＰＣを用いたがDVDプレーヤーを用いても良い。DVDプレーヤーの場合、別途ＤＶＤメディアが必要となり作業手順が増えるが、コストを安く抑えた立体表示方法が得られる。また、図1の立体顔スクリーンはポンチ絵で示した。図3以降において実施の立体顔スクリーンは示す。 A mirror is used as the reflecting means. This is because a certain distance is required from the projection means to the screen. Therefore, the reflecting means can be changed to a concave lens. In this case, the image projection means is arranged in line with the face screen. Therefore, when a concave lens is used, a more compact display method can be provided. A PC is used for the electronic computer, but a DVD player may be used. In the case of a DVD player, a separate DVD medium is required and the number of work procedures increases, but a stereoscopic display method with reduced costs can be obtained. In addition, the three-dimensional face screen in FIG. In FIG. 3 and subsequent figures, the three-dimensional face screen is shown.
図２に立体顔スクリーンに映像を投影した時の様子を図示する。映像投影手段から投影した映像は、反射手段を介して立体顔スクリーンに映し出される。この時、立体スクリーンに映し出される映像の人物の形状と、立体スクリーンの形状は同一の形状とすることができる。従って、立体顔スクリーン上では、映像投影手段から映し出される映像があたかも実際の人物がいるかのように見せられる。 FIG. 2 illustrates a state when an image is projected on the stereoscopic face screen. The image projected from the image projection unit is projected on the stereoscopic face screen via the reflection unit. At this time, the shape of the person in the image displayed on the stereoscopic screen and the shape of the stereoscopic screen can be the same. Therefore, on the 3D face screen, the image projected from the image projection means can be seen as if there is an actual person.
図３に光造形機にて作製した立体顔スクリーンを図示する。この立体顔スクリーンを作成するために、まず、映し出す対象個人の顔を非接触三次元測定方法にて形状測定を行う。図４に非接触三次元測定方法に用いる機器の構成図を記載する。非接触三次元測定装置６にて個人の顔立体形状情報を測定し、電子計算機７では測定データを受信し、適宜データベースに３Ｄデータとして顔立体形状情報を保存する。電子計算機では表示画面より３DCADデータとして顔立体形状情報を確認できる。従って、測定が失敗した場合等その都度確認が行える。本実施例では測定対象８は説明のため人物の顔ではない例を記載している。その後、電子計算機では、顔立体形状情報に顔スクリーンを作製するため必要な厚みの肉厚を付けを行った加工顔立体形状情報を光造形機９へ送信し、受信した光造形機では、加工顔立体形状情報に基づいて加工顔立体形状情報から精密な立顔スクリーンを作製する。なお光造形機では液状の紫外線硬化樹脂（紫外線に反応し、硬化する液体） を光造形機の紫外線レーザーを使用して硬化させ、積層することで３Ｄのデーターと寸分違わぬ精密な立体物を、短時間で作成する。これにより、映像投影手段から投影される画像の人物と同一の形状を有した立体顔スクリーンが得られる。また立体顔スクリーンにはスクリーン裏面に白色スプレーを塗布し、散光面とする。 FIG. 3 shows a three-dimensional face screen produced by an optical modeling machine. In order to create this three-dimensional face screen, first, the shape of the face of the individual to be projected is measured by a non-contact three-dimensional measurement method. FIG. 4 shows a configuration diagram of equipment used in the non-contact three-dimensional measurement method. The non-contact three-dimensional measuring device 6 measures individual face three-dimensional shape information, and the electronic computer 7 receives the measurement data and appropriately stores the face three-dimensional shape information as 3D data in a database. The electronic computer can confirm the face shape information as 3D CAD data from the display screen. Therefore, it can be confirmed each time the measurement fails. In this embodiment, an example in which the measurement object 8 is not a person's face is described for explanation. Thereafter, the electronic computer transmits the processed face solid shape information to which the thickness required for producing the face screen is added to the face solid shape information to the optical modeling machine 9. A precise standing screen is produced from the processed face three-dimensional shape information based on the face three-dimensional shape information. In stereolithography machines, liquid UV curable resin (liquid that reacts and cures with UV rays) is cured using the UV laser of the stereolithography machine and laminated to create a precise three-dimensional object that is exactly the same as 3D data. Create in a short time. Thereby, a three-dimensional face screen having the same shape as the person of the image projected from the video projection means is obtained. In addition, a white spray is applied to the back of the 3D face screen to make it a diffuse surface.
次に投影するための映像取得について記載する。映像撮影装置（デジタルビデオ等）にて対象個人の顔画像や個人の会話、複数の表情を撮影する。この際、複数の顔の表情、さまざま音声、会話を取り込むことで、後に投影した時にリアルな画像の取得ができる。撮影する映像の例として、病気で短命で子供の成長を見れない母親が将来の子供に向けてメッセージを残した映像や、おじいちゃんが元気なときの映像が挙げられる。これらの映像を取り込み保存し、必要な時に顔スクリーン投影することで、亡くなった後でも、墓参りに来たおばあちゃんとお話ができる等の効果を奏する。なお顔スクリーンと映し出す映像の人物の顔の形状は同一の形状である。 Next, video acquisition for projection will be described. The subject's face image, personal conversation, and multiple facial expressions are shot with a video camera (digital video, etc.). At this time, by capturing a plurality of facial expressions, various sounds, and conversations, a realistic image can be obtained when projected later. Examples of images that can be taken include images of mothers who are sick, short-lived and unable to see their children's growth, leaving messages for future children, and images of when Grandpa is fine. By capturing and storing these images, and projecting them on the face screen when necessary, it is possible to talk with the grandma who came to the grave even after his death. It should be noted that the shape of the human face in the image projected on the face screen is the same.
図６に映像投影装置より撮影した映像を立体顔スクリーンに裏面より投影した図を記載する。図７には別角度からの映像を図示する。表面のあらゆる方向から顔立体形状を見ると、撮影した動画、会話、表情の変化が散光面上に表示される。この時、目鼻口や小さな変化の表情がそのまま個人の顔に投影されることで、個人の顔の形に忠実な立体形状の映像が見れる。あたかもその場に本人がいるように印象づけられる。 FIG. 6 is a diagram in which an image taken by the image projection device is projected onto the stereoscopic face screen from the back side. FIG. 7 shows images from different angles. If you look at the 3D shape of the face from any direction on the surface, you can see the changes in the captured video, conversation, and facial expression on the diffuse surface. At this time, the eyes, nose and mouth and small changes in the expression are projected onto the individual face as they are, so that a three-dimensional image faithful to the shape of the individual face can be seen. Impressed as if the person is on the spot.
１ 体映像表示装置
２ 立体顔スクリーン
３ 投影手段
４ 反射手段
５ 音発生手段
６ 電子計算機
７ 電子計算機
８ 測定対象
９ 光造形機
DESCRIPTION OF SYMBOLS 1 Body image display apparatus 2 3D face screen 3 Projection means 4 Reflection means 5 Sound generation means 6 Electronic computer 7 Electronic computer 8 Measurement object 9 Stereolithography machine
Claims (2)
非接触３次元測定装置にて人物の顔形状を顔立体形状情報として取り込む工程と、
前記顔立体形状情報に基づいて前記人物の形状である立体顔スクリーンを、光造型機によって作製する工程と、
前記人物の顔映像を映像撮影手段にて取り込む工程と、
前記立体顔スクリーンに、前記映像を映し出すステップを有することを特徴とする立体表示方法。 In the stereoscopic display method of projecting video on the screen and displaying stereoscopically,
Capturing the face shape of a person as face three-dimensional shape information with a non-contact three-dimensional measuring device;
Producing a three-dimensional face screen which is the shape of the person based on the three-dimensional face shape information by an optical molding machine;
Capturing the face image of the person with video photographing means;
A stereoscopic display method comprising the step of projecting the video on the stereoscopic face screen.
非接触3次元測定装置にて人物の顔形状を顔立体形状情報として取り込み光造型機によって作製した前記人物の形状である立体顔スクリーンと、
前記人物の顔映像を前記映像を立体顔スクリーンに映し出すための映像投影手段と、
前期立体顔スクリーンに映し出す映像を制御するための電子計算機を有することを特徴とする立体表示装置。 In a stereoscopic display device that projects images on a screen and displays them stereoscopically,
A three-dimensional face screen that is the shape of the person produced by a photo molding machine that captures the face shape of the person as face three-dimensional shape information with a non-contact three-dimensional measuring device;
Image projection means for projecting the person's face image on a stereoscopic face screen;
A three-dimensional display device comprising an electronic computer for controlling an image projected on a three-dimensional face screen in the previous period.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP2009237126A JP2011085686A (en) | 2009-10-14 | 2009-10-14 | Three-dimensional display method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP2009237126A JP2011085686A (en) | 2009-10-14 | 2009-10-14 | Three-dimensional display method and device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| JP2011085686A true JP2011085686A (en) | 2011-04-28 |
Family
ID=44078691
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| JP2009237126A Pending JP2011085686A (en) | 2009-10-14 | 2009-10-14 | Three-dimensional display method and device |
Country Status (1)
| Country | Link |
|---|---|
| JP (1) | JP2011085686A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2015163317A1 (en) * | 2014-04-22 | 2015-10-29 | 日本電信電話株式会社 | Video display device, video projection device, dynamic illusion presentation device, video generation device, method thereof, data construct, and program |
| JP2017136809A (en) * | 2016-01-29 | 2017-08-10 | 株式会社ニコン | Molding system, molding method, display device, display method, advertisement device and advertisement method |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH0714762U (en) * | 1993-08-06 | 1995-03-10 | 快兒 豊島 | Stereoscopic image receiving device |
| JPH086158A (en) * | 1994-06-17 | 1996-01-12 | Hitachi Ltd | Projection type display device |
| JPH08205197A (en) * | 1995-01-27 | 1996-08-09 | Hitachi Ltd | Human interface device |
| JP2000076460A (en) * | 1998-06-18 | 2000-03-14 | Minolta Co Ltd | Monitor display device |
| JP2005139593A (en) * | 2003-11-10 | 2005-06-02 | Mic:Kk | Method for producing mask and method for producing mold |
| JP2006338181A (en) * | 2005-05-31 | 2006-12-14 | Fuji Xerox Co Ltd | Stereoscopic display apparatus |
| JP2009069789A (en) * | 2007-09-12 | 2009-04-02 | Ishikawa Kogaku Zokei Kenkyusho:Kk | Face image display device |
-
2009
- 2009-10-14 JP JP2009237126A patent/JP2011085686A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH0714762U (en) * | 1993-08-06 | 1995-03-10 | 快兒 豊島 | Stereoscopic image receiving device |
| JPH086158A (en) * | 1994-06-17 | 1996-01-12 | Hitachi Ltd | Projection type display device |
| JPH08205197A (en) * | 1995-01-27 | 1996-08-09 | Hitachi Ltd | Human interface device |
| JP2000076460A (en) * | 1998-06-18 | 2000-03-14 | Minolta Co Ltd | Monitor display device |
| JP2005139593A (en) * | 2003-11-10 | 2005-06-02 | Mic:Kk | Method for producing mask and method for producing mold |
| JP2006338181A (en) * | 2005-05-31 | 2006-12-14 | Fuji Xerox Co Ltd | Stereoscopic display apparatus |
| JP2009069789A (en) * | 2007-09-12 | 2009-04-02 | Ishikawa Kogaku Zokei Kenkyusho:Kk | Face image display device |
Cited By (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2015163317A1 (en) * | 2014-04-22 | 2015-10-29 | 日本電信電話株式会社 | Video display device, video projection device, dynamic illusion presentation device, video generation device, method thereof, data construct, and program |
| JPWO2015163317A1 (en) * | 2014-04-22 | 2017-04-20 | 日本電信電話株式会社 | Video presentation device, dynamic illusion presentation device, video generation device, method thereof, data structure, program |
| JP2018078660A (en) * | 2014-04-22 | 2018-05-17 | 日本電信電話株式会社 | Video presentation device, method thereof, data structure, program |
| US10571794B2 (en) | 2014-04-22 | 2020-02-25 | Nippon Telegraph And Telephone Corporation | Video presentation device, dynamic illusion presentation device, video generation device, method thereof, data structure, and program |
| CN110996080A (en) * | 2014-04-22 | 2020-04-10 | 日本电信电话株式会社 | Video presentation device, video presentation method, data structure, and program |
| CN110989285A (en) * | 2014-04-22 | 2020-04-10 | 日本电信电话株式会社 | Video generation device, video generation method, data structure, and program |
| CN110989284A (en) * | 2014-04-22 | 2020-04-10 | 日本电信电话株式会社 | Video presentation device, video presentation method, and program |
| EP3637410A1 (en) * | 2014-04-22 | 2020-04-15 | Nippon Telegraph And Telephone Corporation | Video presentation device, dynamic illusion presentation device, video generation device, method thereof, data structure, and program |
| US11036123B2 (en) | 2014-04-22 | 2021-06-15 | Nippon Telegraph And Telephone Corporation | Video presentation device, method thereof, and recording medium |
| CN110996080B (en) * | 2014-04-22 | 2021-10-08 | 日本电信电话株式会社 | Video presentation device, video presentation method, and recording medium |
| JP2017136809A (en) * | 2016-01-29 | 2017-08-10 | 株式会社ニコン | Molding system, molding method, display device, display method, advertisement device and advertisement method |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP7068562B2 (en) | Techniques for recording augmented reality data | |
| US10657727B2 (en) | Production and packaging of entertainment data for virtual reality | |
| JP6785282B2 (en) | Live broadcasting method and equipment by avatar | |
| EP3096208B1 (en) | Image processing for head mounted display devices | |
| Schmalstieg et al. | Augmented reality: principles and practice | |
| US9538167B2 (en) | Methods, systems, and computer readable media for shader-lamps based physical avatars of real and virtual people | |
| US9810975B2 (en) | Rear-projected life-like robotic head | |
| CN109416842A (en) | Geometric match in virtual reality and augmented reality | |
| TW201202746A (en) | Participant collaboration on a displayed version of an object | |
| JP2001166810A (en) | Device and method for providing solid model | |
| KR20190112799A (en) | Rendering of Extended Video in Virtual Reality | |
| JP2015125448A (en) | Stereoscopic screen, stereoscopic image projecting method, and stereoscopic display apparatus | |
| JP2011085686A (en) | Three-dimensional display method and device | |
| KR101192314B1 (en) | System for Realistic 3D Game | |
| KR20150092844A (en) | System and Method for Recording Lecture Video Using Transparent Board | |
| JPH09134118A (en) | Production of relief photograph image | |
| KR102331828B1 (en) | Physical 3d renderer | |
| JP2009069789A (en) | Face image display device | |
| CN205810231U (en) | Double Imaing projectors | |
| Pang et al. | Design considerations of a robotic head for telepresence applications | |
| Zhang et al. | Face animation making method based on facial motion capture | |
| JP6937803B2 (en) | Distribution A video distribution system, video distribution method, and video distribution program that delivers live video including animation of character objects generated based on the movement of the user. | |
| TWM529189U (en) | Dual image projection device | |
| Balcı | Technological construction of performance: case of Andy Serkis | |
| CN107293201B (en) | Double Imaing projectors |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| A621 | Written request for application examination |
Free format text: JAPANESE INTERMEDIATE CODE: A621 Effective date: 20121012 |
|
| RD03 | Notification of appointment of power of attorney |
Free format text: JAPANESE INTERMEDIATE CODE: A7423 Effective date: 20121015 |
|
| A977 | Report on retrieval |
Free format text: JAPANESE INTERMEDIATE CODE: A971007 Effective date: 20130729 |
|
| A131 | Notification of reasons for refusal |
Free format text: JAPANESE INTERMEDIATE CODE: A131 Effective date: 20131001 |
|
| A02 | Decision of refusal |
Free format text: JAPANESE INTERMEDIATE CODE: A02 Effective date: 20140218 |