JP2002024856A - Display system of solid object and receiver thereof - Google Patents

Display system of solid object and receiver thereof

Info

Publication number
JP2002024856A
JP2002024856A JP2000201935A JP2000201935A JP2002024856A JP 2002024856 A JP2002024856 A JP 2002024856A JP 2000201935 A JP2000201935 A JP 2000201935A JP 2000201935 A JP2000201935 A JP 2000201935A JP 2002024856 A JP2002024856 A JP 2002024856A
Authority
JP
Japan
Prior art keywords
dimensional object
viewpoint
observer
viewpoint position
receiving
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
JP2000201935A
Other languages
Japanese (ja)
Other versions
JP4141620B2 (en
Inventor
Hiroyuki Imaizumi
浩幸 今泉
Makoto Tadenuma
眞 蓼沼
Yoshikazu Katayama
美和 片山
Yasuaki Kanetsugu
保明 金次
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Japan Broadcasting Corp
Original Assignee
Nippon Hoso Kyokai NHK
Japan Broadcasting Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nippon Hoso Kyokai NHK, Japan Broadcasting Corp filed Critical Nippon Hoso Kyokai NHK
Priority to JP2000201935A priority Critical patent/JP4141620B2/en
Publication of JP2002024856A publication Critical patent/JP2002024856A/en
Application granted granted Critical
Publication of JP4141620B2 publication Critical patent/JP4141620B2/en
Anticipated expiration legal-status Critical
Expired - Fee Related legal-status Critical Current

Links

Landscapes

  • Processing Or Creating Images (AREA)
  • Digital Computer Display Output (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
  • Controls And Circuits For Display Device (AREA)

Abstract

PROBLEM TO BE SOLVED: To provide a display system of a solid object which enables display with intended composition of person who produced it in a solid object display system, regardless of an observer's viewpoint. SOLUTION: A viewpoint sensor 21 senses an observer's viewpoint and a viewpoint holder 22 holds the observer's instant viewpoint of which discontinuous status is sensed by a discontinuous sensor of viewpoint or view direction. A coordinate transformer 25 transforms the position of the solid object into a three-dimensional coordinate system, of which the origin is the observer's instant viewpoint at the time of sensing the discontinuous status. A perspective projector 27 projects the solid object, which is transformed by coordinate transformer 25 into a two-dimensional plane.

Description

【発明の詳細な説明】DETAILED DESCRIPTION OF THE INVENTION

【０００１】[0001]

【発明の属する技術分野】本発明は、３次元物体の立体
物を２次元のスクリーン上に投影して表示する立体物表
示システム及びその受信装置に関するものであり、特
に、視点移動に追従して、運動視差によって生じる立体
感を再現する任意視点画像表示システム、任意視点画像
表示方法及び任意視点画像表示システムの受信装置に関
するものである。BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a three-dimensional object display system for projecting and displaying a three-dimensional object as a three-dimensional object on a two-dimensional screen and a receiving apparatus therefor. The present invention relates to an arbitrary viewpoint image display system that reproduces a three-dimensional effect caused by motion parallax, an arbitrary viewpoint image display method, and a receiver of the arbitrary viewpoint image display system.

【０００２】[0002]

【従来の技術】視点移動に追従する立体物表示装置とし
て、大画面スクリーンを複数用いた取り囲み型立体表示
装置であるＣＡＶＥ（ＴＭ）システム(Cruz-Neira,C.,S
andin,D.J., and DeFanti, T.A., Virtual Reality: ”
The Design and Implementation of the CAVE”, in Pr
oceedings of SIGGRAPH ’93 Computer Graphicis Conf
erence, ACM SIGGRAPH, August 1993, pp.135-142)など
がある。2. Description of the Related Art A CAVE (TM) system (Cruz-Neira, C., S), which is an encircling three-dimensional display device using a plurality of large screens, as a three-dimensional object display device that follows a viewpoint movement.
andin, DJ, and DeFanti, TA, Virtual Reality: ”
The Design and Implementation of the CAVE ”, in Pr
oceedings of SIGGRAPH '93 Computer Graphicis Conf
erence, ACM SIGGRAPH, August 1993, pp.135-142).

【０００３】[0003]

【発明が解決しようとする課題】しかしながら、従来の
視点移動に追従する任意視点画像表示装置では、部屋に
固定された世界座標系又は表示装置に固定されたスクリ
ーン座標系で３次元物体の位置を定義しているので、立
体物の制作者の意図した構図で３次元物体を鑑賞するた
めには、観察者はある特定の位置で観察する必要があ
る。However, in the conventional arbitrary viewpoint image display device that follows the movement of the viewpoint, the position of the three-dimensional object is determined by the world coordinate system fixed to the room or the screen coordinate system fixed to the display device. Since it is defined, in order to appreciate the three-dimensional object with the composition intended by the creator of the three-dimensional object, the observer needs to observe at a specific position.

【０００４】また、画像を完全に再現できる視点移動の
範囲が制限されている場合、制作者の意図した視点移動
範囲を超えて視点を移動させると、画像を正確に再生で
きないことがある。[0004] In addition, when the range of viewpoint movement that can completely reproduce an image is limited, if the viewpoint is moved beyond the viewpoint movement range intended by the creator, the image may not be accurately reproduced.

【０００５】本発明の目的は、観察者の視点位置に関係
なく、制作者の意図した構図で立体物を表示する立体物
表示システム及びその受信装置を提供することである。It is an object of the present invention to provide a three-dimensional object display system for displaying a three-dimensional object in a composition intended by a creator, regardless of the observer's viewpoint position, and a receiving device therefor.

【０００６】本発明の他の目的は、表示可能な観察者の
視点移動範囲が制限されている場合でも、観察者が表示
可能な視点の移動範囲を逸脱しにくくする立体物表示シ
ステム及びその受信装置を提供することである。Another object of the present invention is to provide a three-dimensional object display system which makes it difficult for the observer to deviate from the displayable viewpoint movement range even when the displayable observer's viewpoint movement range is limited, and to receive the three-dimensional object display system. It is to provide a device.

【０００７】[0007]

【課題を解決するための手段】本発明による立体物表示
システムは、送信側観察者の視点位置又は視線方向の不
連続状態を検出する不連続検出手段と、立体物の位置を
所定の３次元座標系で設定する位置設定手段と、受信側
観察者の視点位置を検出する視点位置検出手段と、前記
不連続状態を検出した瞬時の受信側観察者の視点位置を
保持する視点位置保持手段と、前記立体物の位置を、前
記不連続状態を検出した瞬時の受信側観察者の視点位置
を原点とする３次元座標系に変換する座標変換手段と、
その座標変換手段によって変換された立体物を、逐次更
新される受信側観察者の視点位置を視点として２次元面
に投影する投影手段とを具えることを特徴とするもので
ある。SUMMARY OF THE INVENTION A three-dimensional object display system according to the present invention comprises a discontinuity detecting means for detecting a discontinuity in a viewpoint position or a line-of-sight direction of a transmitting observer, and a predetermined three-dimensional position of a three-dimensional object. Position setting means for setting in the coordinate system, viewpoint position detecting means for detecting the viewpoint position of the receiving observer, and viewpoint position holding means for holding the viewpoint position of the receiving observer at the moment when the discontinuous state is detected. Coordinate conversion means for converting the position of the three-dimensional object into a three-dimensional coordinate system having the origin at the viewpoint position of the receiving observer at the moment of detecting the discontinuous state;
And a projection means for projecting the three-dimensional object converted by the coordinate conversion means onto a two-dimensional surface with the viewpoint position of the receiving observer updated sequentially as a viewpoint.

【０００８】本発明によれば、送信側観察者の視点位置
又は視線方向の不連続状態を検出すると、立体物の位置
を、その瞬時の受信側観察者の視点位置を原点とする３
次元座標系に変換する。その結果、受信側観察者の視点
移動に応じて画像を切り替えて、運動視差による立体感
を再現する際に、送信側観察者の視点位置に関係なく、
制作者の意図した構図で立体物を表示することができ
る。According to the present invention, when the viewpoint position of the transmitting observer or the discontinuous state of the line of sight is detected, the position of the three-dimensional object is set to the instantaneous viewpoint position of the receiving observer.
Convert to a dimensional coordinate system. As a result, when switching the image according to the viewpoint movement of the receiving observer and reproducing the stereoscopic effect due to the motion parallax, regardless of the viewpoint position of the transmitting observer,
A three-dimensional object can be displayed with the composition intended by the creator.

【０００９】例えば、前記不連続検出手段が、送信側観
察者の視点位置の変化の割合が所定の値を超えた場合に
不連続状態を検出する。これによって、不連続状態を適
切に検出することができる。For example, the discontinuity detecting means detects a discontinuous state when the rate of change in the viewpoint position of the transmitting observer exceeds a predetermined value. Thus, the discontinuous state can be appropriately detected.

【００１０】前記視点位置保持手段によって保持された
視点位置をリセットするリセット手段を更に具えること
もできる。[0010] The apparatus may further comprise reset means for resetting the viewpoint position held by the viewpoint position holding means.

【００１１】好適には、前記視線方向のオフセット量を
設定するオフセット量設定手段と、そのオフセット量を
前記立体物の位置に付加して、前記立体物の新たな位置
を設定するオフセット位置設定手段とを更に具える。Preferably, an offset amount setting means for setting the offset amount in the line of sight direction, and an offset position setting means for adding the offset amount to the position of the three-dimensional object to set a new position of the three-dimensional object. And more.

【００１２】観察者と立体物表示面との間の距離が比較
的長く、立体物の制作者が意図した画角に比べて立体物
表面を見込む画角が小さい場合、立体物の一部が表示さ
れないいわゆる見切れが生じる。しかしながら、オフセ
ット量を立体物の位置に付加して、立体物の新たな位置
を設定することによって、このような不都合がなくな
る。If the distance between the observer and the three-dimensional object display surface is relatively long and the angle of view that looks into the three-dimensional object surface is smaller than the angle of view intended by the creator of the three-dimensional object, a part of the three-dimensional object is A so-called cut-off that is not displayed occurs. However, such an inconvenience is eliminated by adding the offset amount to the position of the three-dimensional object and setting a new position of the three-dimensional object.

【００１３】本発明による立体物表示システムの受信装
置は、受信側観察者の視点位置を検出する視点位置検出
手段と、送信側観察者の視点位置又は視線方向の不連続
状態を検出した瞬時の受信側観察者の視点位置を保持す
る視点位置保持手段と、立体物の位置を、前記不連続状
態を検出した瞬時の受信側観察者の視点位置を原点とす
る３次元座標系に変換する座標変換手段と、その座標変
換手段によって変換された立体物を、逐次更新される受
信側観察者の視点位置を視点として２次元面に投影する
投影手段とを具えることを特徴とするものである。[0013] The receiving apparatus of the three-dimensional object display system according to the present invention includes a viewpoint position detecting means for detecting a viewpoint position of a receiving observer, and an instantaneous state of detecting a discontinuous state of a viewpoint position or a line of sight of a transmitting observer. Viewpoint position holding means for holding the viewpoint position of the receiving observer, and coordinates for converting the position of the three-dimensional object into a three-dimensional coordinate system having the origin as the viewpoint position of the receiving observer at the moment of detecting the discontinuous state And a projection means for projecting the three-dimensional object converted by the coordinate conversion means onto a two-dimensional surface with the viewpoint position of the receiving observer updated sequentially as a viewpoint. .

【００１４】本発明によれば、受信側観察者の視点移動
に応じて画像を切り替えて、運動視差による立体感を再
現する際に、送信側観察者の視点位置に関係なく、制作
者の意図した構図で立体物を表示することができる。According to the present invention, when the image is switched according to the viewpoint movement of the receiving observer and the stereoscopic effect due to the motion parallax is reproduced, the creator's intention is obtained regardless of the viewpoint position of the transmitting observer. A three-dimensional object can be displayed with the composition as shown.

【００１５】例えば、送信側観察者の視点位置の変化の
割合が所定の値を超えた場合に不連続状態を検出する。
これによって、不連続状態を適切に検出することができ
る。For example, when the rate of change of the viewpoint position of the transmitting observer exceeds a predetermined value, a discontinuous state is detected.
Thus, the discontinuous state can be appropriately detected.

【００１６】この場合も、前記視点位置保持手段によっ
て保持された視点位置をリセットするリセット手段を更
に具えてもよい。In this case, the apparatus may further comprise reset means for resetting the viewpoint position held by the viewpoint position holding means.

【００１７】好適には、前記視線方向のオフセット量を
設定するオフセット量設定手段と、そのオフセット量を
前記立体物の位置に付加して、立体物の新たな位置を設
定するオフセット位置設定手段とを更に具える。Preferably, the offset amount setting means sets the offset amount in the line of sight direction, and the offset position setting means adds the offset amount to the position of the three-dimensional object to set a new position of the three-dimensional object. Is further provided.

【００１８】このようにオフセット量を立体物の位置に
付加して、立体物の新たな位置を設定することによっ
て、いわゆる見切れが生じなくなる。By setting the new position of the three-dimensional object by adding the offset amount to the position of the three-dimensional object in this way, so-called cut-off does not occur.

【００１９】本発明による他の立体物表示システムは、
送信側観察者の視点位置又は視線方向の不連続状態を検
出する不連続検出手段と、立体物の位置を所定の３次元
座標系で設定する位置設定手段と、受信側観察者の右眼
及び左眼の視点位置をそれぞれ検出する第１及び第２視
点位置検出手段と、前記不連続状態を検出した瞬時の受
信側観察者の右眼及び左眼の視点位置をそれぞれ保持す
る第１及び第２視点位置保持手段と、前記立体物の位置
を、前記不連続状態を検出した瞬時の受信側観察者の右
眼及び左眼の視点位置を原点とする３次元座標系にそれ
ぞれ変換する第１及び第２座標変換手段と、これら第１
及び第２座標変換手段によって変換された立体物をそれ
ぞれ、逐次更新される受信側観察者の視点位置を視点と
して２次元面に投影する第１及び第２投影手段とを具え
ることを特徴とするものである。Another three-dimensional object display system according to the present invention comprises:
Discontinuity detecting means for detecting a discontinuous state of a viewpoint position or a line-of-sight direction of a transmitting observer; position setting means for setting a position of a three-dimensional object in a predetermined three-dimensional coordinate system; First and second viewpoint position detecting means for detecting the viewpoint position of the left eye, respectively, and first and second viewpoint positions of the right and left eyes of the receiving observer at the moment when the discontinuous state is detected, respectively. A two-viewpoint position holding unit, and a first conversion unit that converts the position of the three-dimensional object into a three-dimensional coordinate system whose origin is the viewpoint positions of the right and left eyes of the receiving observer at the moment when the discontinuous state is detected. And second coordinate conversion means,
And first and second projecting means for projecting the three-dimensional object transformed by the second coordinate transforming means onto a two-dimensional surface with the viewpoint position of the sequentially updated receiving observer as a viewpoint. Is what you do.

【００２０】本発明によれば、送信側観察者の視点移動
に応じて画像を切り替えて、運動視差による立体感を再
現する際に、受信側観察者の右眼及び左眼の視点位置に
関係なく、制作者の意図した構図で立体物を表示するこ
とができる。According to the present invention, when the image is switched according to the viewpoint movement of the transmitting observer and the stereoscopic effect due to the motion parallax is reproduced, the image is related to the viewpoint positions of the right and left eyes of the receiving observer. Instead, a three-dimensional object can be displayed with the composition intended by the creator.

【００２１】例えば、送信側観察者の視点位置の変化の
割合が所定の値を超えた場合に不連続状態を検出する。
これによって、不連続状態を適切に検出することができ
る。For example, when the rate of change of the viewpoint position of the transmitting observer exceeds a predetermined value, a discontinuous state is detected.
Thus, the discontinuous state can be appropriately detected.

【００２２】この場合、前記第１及び第２視点位置保持
手段によって保持された視点位置をそれぞれリセットす
る第１及び第２リセット手段を更に具える。In this case, the apparatus further comprises first and second reset means for resetting the viewpoint positions held by the first and second viewpoint position holding means, respectively.

【００２３】好適には、観察者の右眼及び左眼の視線方
向のオフセット量をそれぞれ設定する第１及び第２オフ
セット量設定手段と、そのオフセット量を、対応する立
体物の位置にそれぞれ付加して、前記立体物の新たな位
置をそれぞれ設定する第１及び第２オフセット位置設定
手段とを更に具える。Preferably, first and second offset amount setting means for respectively setting the offset amounts of the right and left eyes of the observer in the line of sight, and the offset amounts are respectively added to the positions of the corresponding three-dimensional objects. And first and second offset position setting means for respectively setting a new position of the three-dimensional object.

【００２４】このようにオフセット量を、対応する立体
物の位置にそれぞれ付加して、立体物の新たな位置をそ
れぞれ設定することによって、右眼及び左眼に対するい
わゆる見切れが生じなくなる。In this way, by adding the offset amounts to the positions of the corresponding three-dimensional objects and setting new positions of the three-dimensional objects, so-called cut-offs for the right eye and the left eye do not occur.

【００２５】本発明による他の立体物表示システムの受
信装置は、受信側観察者の右眼及び左眼の視点位置をそ
れぞれ検出する第１及び第２視点位置検出手段と、送信
側観察者の視点位置又は視線方向の不連続状態を検出し
た瞬時の受信側観察者の右眼及び左眼の視点位置をそれ
ぞれ保持する第１及び第２視点位置保持手段と、右眼及
び左眼に対する立体物の位置を、前記不連続状態を検出
した瞬時の受信側観察者の右眼及び左眼の視点位置を原
点とする３次元座標系にそれぞれ変換する第１及び第２
座標変換手段と、これら第１及び第２座標変換手段によ
って変換された立体物をそれぞれ、逐次更新される受信
側観察者の視点位置を視点として２次元面に投影する第
１及び第２投影手段とを具えることを特徴とするもので
ある。[0025] A receiving apparatus of another three-dimensional object display system according to the present invention comprises first and second viewpoint position detecting means for detecting the viewpoint positions of the right and left eyes of the receiving observer, respectively. First and second viewpoint position holding means for holding the viewpoint positions of the right and left eyes of the receiving observer at the moment of detecting the discontinuous state of the viewpoint position or the line of sight, and a three-dimensional object for the right and left eyes Are respectively converted into a three-dimensional coordinate system whose origin is the viewpoint positions of the right and left eyes of the receiving observer at the moment when the discontinuous state is detected.
Coordinate transforming means, and first and second projecting means for projecting the three-dimensional object transformed by the first and second coordinate transforming means onto a two-dimensional surface with the viewpoint position of the receiving observer updated sequentially as a viewpoint. It is characterized by comprising.

【００２６】本発明によれば、送信側観察者の視点移動
に応じて画像を切り替えて、運動視差による立体感を再
現する際に、受信側観察者の右眼及び左眼の視点位置に
関係なく、制作者の意図した構図で立体物を表示するこ
とができる。According to the present invention, when the image is switched in accordance with the viewpoint movement of the transmitting observer and the stereoscopic effect due to the motion parallax is reproduced, there is a relation between the viewpoint positions of the right and left eyes of the receiving observer. Instead, a three-dimensional object can be displayed with the composition intended by the creator.

【００２７】例えば、受信側観察者の視点位置の変化の
割合が所定の値を超えた場合、不連続状態を検出する。
これによって、不連続状態を適切に検出することができ
る。For example, when the rate of change of the viewpoint position of the receiving observer exceeds a predetermined value, a discontinuous state is detected.
Thus, the discontinuous state can be appropriately detected.

【００２８】この場合、前記第１及び第２視点位置保持
手段によって保持された視点位置をそれぞれリセットす
る第１及び第２リセット手段を更に具えてもよい。In this case, the apparatus may further comprise first and second reset means for resetting the viewpoint positions held by the first and second viewpoint position holding means, respectively.

【００２９】好適には、観察者の右眼及び左眼の視線方
向のオフセット量をそれぞれ設定する第１及び第２オフ
セット量設定手段と、そのオフセット量を、対応する立
体物の位置にそれぞれ付加して、前記立体物の新たな位
置をそれぞれ設定する第１及び第２オフセット位置設定
手段とを更に具える。Preferably, first and second offset amount setting means for respectively setting the offset amounts of the observer's right eye and left eye in the line-of-sight direction, and the offset amounts are respectively added to the positions of the corresponding three-dimensional objects. And first and second offset position setting means for respectively setting a new position of the three-dimensional object.

【００３０】[0030]

【発明の実施の形態】本発明による立体物表示システム
及びその受信装置の実施の形態を、図面を参照して詳細
に説明する。図１は、本発明による立体物表示システム
を示す図であり、図２は、その送信側座標系（図２Ａ）
及び受信側座標系（図２Ｂ）を説明するための図であ
る。この立体物表示システムは、送信側情報処理ブロッ
ク１と、受信側情報処理ブロック２とを具える。DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Embodiments of a three-dimensional object display system and a receiver thereof according to the present invention will be described in detail with reference to the drawings. FIG. 1 is a diagram showing a three-dimensional object display system according to the present invention, and FIG. 2 is a transmission-side coordinate system thereof (FIG. 2A).
FIG. 2 is a diagram for explaining a receiving side coordinate system (FIG. 2B). This three-dimensional object display system includes a transmission-side information processing block 1 and a reception-side information processing block 2.

【００３１】送信側情報処理ブロック１は、視点位置又
は視線方向不連続検出部１１と、立体物情報設定部１２
と、座標変換部１３とを有する。受信側情報処理ブロッ
ク２は、視点位置検出部２１と、視点位置保持部２２
と、オフセット設定部２３と、オフセット付加部２４
と、座標変換部２５と、スクリーン位置設定部２６と、
透視投影部２７と、リセット信号発生スイッチ２８とを
有する。The transmitting-side information processing block 1 includes a viewpoint position or line-of-sight direction discontinuity detecting unit 11 and a three-dimensional object information setting unit 12.
And a coordinate conversion unit 13. The receiving-side information processing block 2 includes a viewpoint position detecting unit 21 and a viewpoint position holding unit 22.
, An offset setting unit 23 and an offset adding unit 24
A coordinate conversion unit 25, a screen position setting unit 26,
It has a perspective projection unit 27 and a reset signal generation switch 28.

【００３２】視点位置又は視線方向不連続検出部１１
は、制作者が意図した立体物３１を観察する視点位置Ｏ
１と視線方向を規定する。実際に立体物３１をカメラ３
２で撮影する場合には、カメラ３２の位置及び向きを視
点位置又は視線方向不連続検出部１１に設定し、視点位
置Ｏ１又は視線方向が不連続となる場合には、視点をリ
セットする信号ａを視点位置保持部２２に出力するとと
もに、送信側実視点座標系を規定する信号ｂを座標変換
部１３に出力する。View point position or line-of-sight direction discontinuity detector 11
Is the viewpoint position O for observing the three-dimensional object 31 intended by the creator.
1 and the line-of-sight direction are defined. The three-dimensional object 31 is actually
2, the position and orientation of the camera 32 are set to the viewpoint position or the line-of-sight direction discontinuity detecting unit 11, and if the viewpoint position O1 or the line-of-sight direction becomes discontinuous, a signal a for resetting the viewpoint is used. Is output to the viewpoint position holding unit 22, and a signal b defining the transmitting-side real viewpoint coordinate system is output to the coordinate conversion unit 13.

【００３３】送信側実視点座標系は、視点位置Ｏ１を原
点とし、視線方向をｚ軸とし、ｚ軸を含む鉛直な平面上
でｚ軸に直交する軸をｙ軸とし、ｙ軸及びｚ軸に直交す
る軸をx軸とする座標系であり、立体物３１の位置はこ
の座標系を用いて示される。図２Ａにおいて、送信側実
視点座標系のｘ軸、ｙ軸及びｚ軸をそれぞれ、Ｘｖｓ，
Ｙｖｓ，Ｚｖｓで表す。The transmitting-side real viewpoint coordinate system has a viewpoint position O1 as an origin, a line-of-sight direction as a z-axis, an axis perpendicular to the z-axis on a vertical plane including the z-axis as a y-axis, a y-axis and a z-axis. Is a coordinate system in which an axis orthogonal to the coordinate system is the x-axis, and the position of the three-dimensional object 31 is indicated using this coordinate system. In FIG. 2A, the x-axis, y-axis, and z-axis of the transmission-side real viewpoint coordinate system are represented by Xvs,
Expressed as Yvs and Zvs.

【００３４】なお、立体物３１の位置をこのような送信
側実視点座標系に変換できる場合には、立体物３１を他
の表現形式で表現することができ、例えば、後に説明す
るような、スタジオに固定された送信側世界座標系で示
された立体物３１の位置座標、視点位置Ｏ２及び視線方
向（ｚ軸）を用いることができる。図２Ａにおいて、送
信側世界座標系のｘ軸、ｙ軸及びｚ軸をそれぞれＸｗ
ｓ，Ｙｗｓ及びＺｗｓで表す。If the position of the three-dimensional object 31 can be converted into such a transmitting-side real viewpoint coordinate system, the three-dimensional object 31 can be expressed in another expression format. The position coordinates, the viewpoint position O2, and the line-of-sight direction (z-axis) of the three-dimensional object 31 indicated in the transmission-side world coordinate system fixed in the studio can be used. In FIG. 2A, the x-axis, the y-axis, and the z-axis of the transmitting side world coordinate system are represented by Xw
Expressed as s, Yws and Zws.

【００３５】立体物情報設定部１２は、送信側世界座標
系によって示された立体物３１の位置情報及び色情報を
有する信号ｃを座標変換部１３に出力する。立体物３１
の位置情報を、点群、三角パッチ、ＮＵＲＢＳサーフェ
ス(L.A.Piegl. On NURBS:A Survey. IEEE Computer Gra
phics and Applications, 11(1):55-71, January 1991
参照)等によって表現する。The three-dimensional object information setting unit 12 outputs to the coordinate conversion unit 13 a signal c having position information and color information of the three-dimensional object 31 indicated by the transmitting world coordinate system. Three-dimensional object 31
Point information, triangular patches, NURBS surfaces (LAPiegl. On NURBS: A Survey. IEEE Computer Gra
phics and Applications, 11 (1): 55-71, January 1991
See).

【００３６】座標変換部１３は、送信側世界座標系で示
された立体物３１の位置情報を送信側実視点座標系に座
標変換する。座標変換は、信号ｂによって決定される変
換行列Ｍを用いて、式（１）によって行われる。The coordinate conversion unit 13 converts the position information of the three-dimensional object 31 shown in the transmitting world coordinate system to the transmitting real viewpoint coordinate system. The coordinate conversion is performed by Expression (1) using a conversion matrix M determined by the signal b.

【数１】 座標変換部１３は、送信側実視点座標系による立体物３
１の位置情報及び色情報を有する信号ｄをオフセット付
加部２４に出力する。(Equation 1) The coordinate conversion unit 13 converts the three-dimensional object 3 in the transmitting-side real viewpoint coordinate system.
The signal d having the position information and the color information of No. 1 is output to the offset adding unit 24.

【００３７】受信側情報処理ブロック２において、先
ず、観察者４１ａ，４１ｂが居る部屋に固定された受信
側世界座標系を定義し、スクリーン４２の位置（範囲）
及び観察者の視点位置を受信側世界座標で表す。図２Ｂ
において、受信側世界座標系のｘ軸、ｙ軸、ｚ軸及び原
点をそれぞれＸｗ，Ｙｗ，Ｚｗ及びＯ５で表す。In the receiving side information processing block 2, first, a receiving side world coordinate system fixed to the room where the observers 41a and 41b are located is defined, and the position (range) of the screen 42 is defined.
And the viewpoint position of the observer are represented by receiving side world coordinates. FIG. 2B
, The x-axis, y-axis, z-axis and origin of the receiving world coordinate system are represented by Xw, Yw, Zw and O5, respectively.

【００３８】次に、信号ａの受信時すなわち視点位置又
は視線方向の不連続状態の検出時における観察者の実視
点の位置Ｏ３を原点とし、この原点と表示スクリーン４
２の上の一点、例えば、表示スクリーン４２の中心Ｏ６
を結ぶ直線をｚ軸とし、ｚ軸を含む鉛直な平面上でｚ軸
に直交する軸をｙ軸とし、ｙ軸及びｚ軸に直交する軸を
x軸とする受信側初期視点座標系も定義する。図２Ｂに
おいて、受信側実視点座標系のｘ軸、ｙ軸及びｚ軸をそ
れぞれ、Ｘｉ，Ｙｉ，Ｚｉで表す。Next, the position O3 of the observer's actual viewpoint at the time of receiving the signal a, that is, at the time of detecting the viewpoint position or the discontinuous state of the line of sight, is defined as the origin.
2, for example, the center O6 of the display screen 42
Is a z-axis, an axis orthogonal to the z-axis on a vertical plane including the z-axis is a y-axis, and an axis orthogonal to the y-axis and the z-axis is
The receiving-side initial viewpoint coordinate system for the x-axis is also defined. In FIG. 2B, the x-axis, y-axis, and z-axis of the receiving-side real viewpoint coordinate system are represented by Xi, Yi, and Zi, respectively.

【００３９】さらに、視点位置（実視点位置）Ｏ４を原
点とし、視線方向をｚ軸とし、ｚ軸を含む鉛直な平面上
でｚ軸に直交する軸をｙ軸とし、ｙ軸及びｚ軸に直交す
る軸をx軸とする受信側実視点座標系を定義する。図２
Ｂにおいて、受信側実視点座標系のｘ軸、ｙ軸及びｚ軸
をそれぞれ、Ｘｖ，Ｙｖ，Ｚｖで表す。Further, the viewpoint position (actual viewpoint position) O4 is set as the origin, the line of sight is set as the z-axis, the axis orthogonal to the z-axis on a vertical plane including the z-axis is set as the y-axis, and the y-axis and the z-axis are set as the y-axis. Define the receiving-side real viewpoint coordinate system with the orthogonal axis as the x-axis. FIG.
In B, the x-axis, y-axis, and z-axis of the receiving-side real viewpoint coordinate system are represented by Xv, Yv, and Zv, respectively.

【００４０】なお、図２Ｂにおいて、送信側実視点座標
系で示された立体物３１の位置データを受信側初期視点
座標系で定位した立体物４３ａと、表示スクリーン４２
の面に実視点位置を視点として透視撮影された立体物４
３ｂの像とを示す。このように定位された立体物４３ａ
は、制作者の意図した視点位置すなわち構図で観察者４
１ａによって観察される。In FIG. 2B, the three-dimensional object 43a obtained by localizing the position data of the three-dimensional object 31 shown in the transmitting-side real viewpoint coordinate system in the receiving-side initial viewpoint coordinate system, and the display screen 42
Three-dimensional object 4 that is perspectively photographed with the actual viewpoint position as the viewpoint
3b. The three-dimensional object 43a thus localized
Is the observer 4 at the viewpoint position or composition intended by the creator.
Observed by 1a.

【００４１】視点位置検出部２１は、観察者４１ａの視
点位置Ｏ３を計測し、図２Ｂに示すような受信側世界座
標系による位置情報を有する信号ｅを逐次視点位置保持
部２２に出力する。The viewpoint position detector 21 measures the viewpoint position O3 of the observer 41a, and sequentially outputs a signal e having position information in the receiving side world coordinate system as shown in FIG. 2B to the viewpoint position holder 22.

【００４２】視点位置保持部２２は、信号ａを受信して
から次の信号ａを受信するまでの間、信号ｅを保持し、
受信側初期視点座標系を規定する信号ｆを座標変換部２
５に出力する。The viewpoint position holding unit 22 holds the signal e from when the signal a is received until the next signal a is received,
A signal f defining the receiving-side initial viewpoint coordinate system is converted to a coordinate conversion unit 2.
5 is output.

【００４３】オフセット設定部２３は、観察者４１ａが
設定したｚ座標Ｚｉのオフセット値の情報を有する信号
ｇをオフセット付加部２４に出力する。オフセット付加
部２４は、立体物４３ａの位置情報のｚ座標Ｚｉにオフ
セット値を加算し、加算後の位置情報及び色情報を有す
る信号ｈを座標変換部２５に出力する。The offset setting section 23 outputs to the offset adding section 24 a signal g having information on the offset value of the z coordinate Zi set by the observer 41a. The offset adding unit 24 adds an offset value to the z coordinate Zi of the position information of the three-dimensional object 43a, and outputs a signal h having the added position information and color information to the coordinate conversion unit 25.

【００４４】観察者４１ａと表示スクリーン４２との距
離が比較的長く、制作者が意図した画角に比べて表示ス
クリーン４２を見込む画角が小さい場合でも、受信側初
期視点座標系で立体物４３ｂの位置のｚ座標Ｚｉにオフ
セット値を付加することによって、いわゆる見切れが生
じるおそれがなくなる。Even when the distance between the observer 41a and the display screen 42 is relatively long and the angle of view that looks into the display screen 42 is smaller than the angle of view intended by the creator, the three-dimensional object 43b in the receiving-side initial viewpoint coordinate system. By adding an offset value to the z coordinate Zi of the position, there is no possibility that a so-called cut-off occurs.

【００４５】座標変換部２５は、立体物４３ａの位置情
報を受信側実視点座標系に座標変換する。座標変換は、
信号ｅ及びｆによって決定される変換行列Ｍ’を用い
て、式（２）によって行われる。The coordinate conversion section 25 converts the position information of the three-dimensional object 43a into a coordinate system of the receiving-side real viewpoint. The coordinate transformation is
This is performed according to equation (2) using a transformation matrix M ′ determined by the signals e and f.

【数２】 座標変換部２５は、立体物４３ａの受信側実視点座標系
における位置情報及び色情報を有する信号ｉを透視撮影
部２７に出力する。(Equation 2) The coordinate conversion unit 25 outputs a signal i having position information and color information of the three-dimensional object 43a in the receiving-side real viewpoint coordinate system to the fluoroscopic imaging unit 27.

【００４６】したがって、信号ａを受信してから次の信
号ａを受信するまでの間に視点位置又は視線方向が変化
しても、立体物４３ａが受信側初期視点座標系を用いて
定位されているので、制作者が意図した視点位置からず
れた位置で立体物４３ａを観察することができる。この
ような視点位置からのずれが、制作者が設計した視点移
動可能な範囲内にある場合、受信側実視点位置に応じた
画像を再現することができる。Therefore, even if the viewpoint position or the line-of-sight direction changes between the reception of the signal a and the reception of the next signal a, the three-dimensional object 43a is localized using the reception-side initial viewpoint coordinate system. Therefore, the three-dimensional object 43a can be observed at a position shifted from the viewpoint position intended by the creator. When such a deviation from the viewpoint position is within the range in which the viewpoint can be moved by the creator, an image corresponding to the actual viewpoint position on the receiving side can be reproduced.

【００４７】スクリーン位置設定部２６は、図示しない
表示装置の画素位置と受信側世界座標系による表示スク
リーン４２の位置及び範囲とを規定する信号ｊを出力す
る。The screen position setting section 26 outputs a signal j for defining the pixel position of the display device (not shown) and the position and range of the display screen 42 in the receiving side world coordinate system.

【００４８】透視投影部２７は、実視点位置Ｏ４を透視
変換の視点とする透視投影によって、立体物４３ａの表
示スクリーン４２への投影位置を算出し、それを画素位
置に換算する。また、透視投影部２７は、換算した画素
位置に立体物４３ａの色情報によって規定される色信号
ｋを出力する。これによって、立体物４３ａの像４３ｂ
が表示スクリーン４２に表示される。The perspective projection unit 27 calculates the projection position of the three-dimensional object 43a on the display screen 42 by the perspective projection using the actual viewpoint position O4 as the viewpoint of the perspective transformation, and converts it to the pixel position. In addition, the perspective projection unit 27 outputs a color signal k defined by the color information of the three-dimensional object 43a to the converted pixel position. Thereby, the image 43b of the three-dimensional object 43a
Is displayed on the display screen 42.

【００４９】立体物４３ａを表示するには、観察者４１
ｂの視点Ｏ４による透視投影変換を用いて、表示スクリ
ーン３２の面上に投影する。このような透視投影変換に
よって、受信側初期視点座標系で表現された立体物４３
ａの位置と、世界座標で表現された表示スクリーン３２
の位置（範囲）とを受信側実視点座標系に座標変換した
後、それを透視投影することによって、容易に表示画像
４３ｂを取得することができる。To display the three-dimensional object 43a, the viewer 41
The projection is performed on the surface of the display screen 32 using the perspective projection transformation from the viewpoint O4 of b. The three-dimensional object 43 represented in the receiving-side initial viewpoint coordinate system by such perspective projection transformation.
a and the display screen 32 expressed in world coordinates
After the position (range) is coordinate-transformed into the receiving-side real viewpoint coordinate system, the display image 43b can be easily obtained by perspective projection.

【００５０】なお、表示スクリーン４２が部屋に固定さ
れている場合には、世界座標の原点を表示スクリーン４
２の一点にとり、ｚ軸を表示スクリーン４２の面に対す
る垂線とし、ｘ軸及びｙ軸をそれぞれ表示スクリーン４
２の面の垂直方向及び水平方向にそれぞれ定義すると、
受信側実視点座標系の代わりに、立体物４３ａの位置及
び実視点の位置Ｏ４を世界座標に変換した後、それを透
視投影することによって、容易に表示画像を取得するこ
とができる。When the display screen 42 is fixed to the room, the origin of the world coordinates is displayed on the display screen 4.
2, the z-axis is a perpendicular to the surface of the display screen 42, and the x-axis and the y-axis are
Defining the vertical and horizontal directions of the surface 2 respectively,
A display image can be easily acquired by transforming the position of the three-dimensional object 43a and the position O4 of the real viewpoint into world coordinates instead of the receiving-side real viewpoint coordinate system, and then performing perspective projection.

【００５１】本実施の形態によれば、観察者の視点位置
に関係なく、制作者の意図した構図で立体物を表示する
ことができ、かつ、表示可能な観察者の視点移動範囲が
制限されている場合でも、観察者が表示可能な視点の移
動範囲を逸脱しにくくなる。According to the present embodiment, a three-dimensional object can be displayed with the composition intended by the creator, regardless of the observer's viewpoint position, and the observer's viewpoint movement range that can be displayed is limited. Even if the display is performed, it becomes difficult for the observer to deviate from the range of movement of the viewpoint that can be displayed.

【００５２】本発明は、上記実施の形態に限定されるも
のではなく、幾多の変更及び変形が可能である。例え
ば、受信側情報処理ブロック２を２式設け、右眼及び左
眼のそれぞれに対応した視点での透視投影画像を表示
し、両眼による立体視を提供することもできる。The present invention is not limited to the above-described embodiment, and various changes and modifications are possible. For example, two sets of receiving-side information processing blocks 2 may be provided to display a perspective projection image from a viewpoint corresponding to each of the right eye and the left eye, thereby providing stereoscopic viewing with both eyes.

【００５３】また、視点位置又は視線方向の不連続状態
を検出するに際し、視点位置又は視線方向不連続検出部
１１が信号ａを出力する代わりに、視点位置及び視点方
向に関する情報を有する信号を、送信側情報処理ブロッ
ク１から受信側情報処理ブロック２に連続的に送信し、
受信側情報処理ブロック２において、しきい値処理によ
って視点位置又は視線方向の不連続状態を検出すること
もできる。この場合、視点位置又は視線方向の変化を監
視し、その変化がしきい値を超える場合、視点位置保持
部２２は信号ｅを保持する。また、信号ａを出力する代
わりに、リセット信号発生スイッチ２８から信号ｌを視
点位置保持部２２に出力することによって、視点位置保
持部２２が信号ｅを保持するようにしてもよい。In detecting a discontinuity in the viewpoint position or the line-of-sight direction, instead of outputting the signal a from the viewpoint position or line-of-sight direction discontinuity detecting unit 11, a signal having information on the viewpoint position and the viewpoint direction is output. The information is continuously transmitted from the information processing block 1 on the transmission side to the information processing block 2 on the reception side,
In the receiving-side information processing block 2, a discontinuity state in the viewpoint position or the line-of-sight direction can be detected by threshold processing. In this case, a change in the viewpoint position or the line of sight is monitored, and if the change exceeds a threshold, the viewpoint position holding unit 22 holds the signal e. Further, instead of outputting the signal a, the viewpoint signal holding unit 22 may hold the signal e by outputting the signal 1 from the reset signal generation switch 28 to the viewpoint position holding unit 22.

【００５４】さらに、立体物３１の情報を記録媒体（例
えば、ＣＤ−ＲＯＭ）に記録する場合には、信号ａ及び
ｄを記録媒体に記録し、再生時にそれを読み出すことも
できる。Further, when the information of the three-dimensional object 31 is recorded on a recording medium (for example, a CD-ROM), the signals a and d can be recorded on the recording medium and read out at the time of reproduction.

【図面の簡単な説明】[Brief description of the drawings]

【図１】 本発明による立体物表示システムを示す図で
ある。FIG. 1 is a diagram showing a three-dimensional object display system according to the present invention.

【図２】 本発明による立体物表示システムの送信側座
標系及び受信側座標系を説明するための図である。FIG. 2 is a diagram for explaining a transmitting side coordinate system and a receiving side coordinate system of the three-dimensional object display system according to the present invention.

【符号の説明】[Explanation of symbols]

１ 送信側情報処理ブロック ２ 受信側情報処理ブロック １１ 視点位置又は視線方向不連続検出部 １２ 立体物情報設定部 １３，２５ 座標変換部 ２１ 視点位置検出部 ２２ 視点位置保持部 ２３ オフセット設定部 ２４ オフセット付加部 ２６ スクリーン位置設定部 ２７ 透視撮影部 ２８ リセット信号発生スイッチ ３１，４３ａ 立体物 ３２ カメラ ４１ａ 観察者の初期位置 ４１ｂ 観察者の実際の位置 ４２ スクリーン ４３ｂ 撮影された立体物の像 ａ，ｂ，ｃ，ｄ，ｅ，，ｆ，ｇ，ｈ，ｉ，ｊ，ｋ，ｌ
信号Reference Signs List 1 information processing block on transmission side 2 information processing block on reception side 11 viewpoint position or line-of-sight direction discontinuity detection unit 12 three-dimensional object information setting unit 13, 25 coordinate conversion unit 21 viewpoint position detection unit 22 viewpoint position holding unit 23 offset setting unit 24 offset Additional unit 26 Screen position setting unit 27 Perspective photographing unit 28 Reset signal generation switch 31, 43a Solid object 32 Camera 41a Initial position of observer 41b Actual position of observer 42 Screen 43b Image of solid object photographed a, b, c, d, e, f, g, h, i, j, k, l
signal

───────────────────────────────────────────────────── フロントページの続き (72)発明者 片山 美和 東京都世田谷区砧１丁目10番11号 日本放 送協会 放送技術研究所内 (72)発明者 金次 保明 東京都世田谷区砧１丁目10番11号 日本放 送協会 放送技術研究所内 Ｆターム(参考） 5B050 BA09 CA07 EA27 FA02 FA06 5B069 AA01 BA03 DD09 5C061 AA06 AA23 AB03 AB08 AB12 AB14 AB16 5C082 AA27 BA46 CA31 CA81 CA85 CB01 DA51 MM10  ──────────────────────────────────────────────────続 き Continuing from the front page (72) Miwa Katayama 1-10-11 Kinuta, Setagaya-ku, Tokyo Japan Broadcasting Research Institute, Japan Broadcasting Corporation (72) Yasuaki Kinji 1-10 Kinuta, Setagaya-ku, Tokyo No. 11 Japan Broadcasting Corporation F-Term in the Broadcasting Technology Laboratory (Reference) 5B050 BA09 CA07 EA27 FA02 FA06 5B069 AA01 BA03 DD09 5C061 AA06 AA23 AB03 AB08 AB12 AB14 AB16 5C082 AA27 BA46 CA31 CA81 CA85 CB01 DA51 MM10

Claims (20)

【特許請求の範囲】[Claims] 【請求項１】 送信側観察者の視点位置又は視線方向の
不連続状態を検出する不連続検出手段と、 立体物の位置を所定の３次元座標系で設定する位置設定
手段と、 受信側観察者の視点位置を検出する視点位置検出手段
と、 前記不連続状態を検出した瞬時の受信側観察者の視点位
置を保持する視点位置保持手段と、 前記立体物の位置を、前記不連続状態を検出した瞬時の
受信側観察者の視点位置を原点とする３次元座標系に変
換する座標変換手段と、 その座標変換手段によって変換された立体物を、逐次更
新される受信側観察者の視点位置を視点として２次元面
に投影する投影手段とを具えることを特徴とする立体物
表示システム。1. A discontinuity detecting means for detecting a discontinuity in a viewpoint position or a line-of-sight direction of a transmission-side observer; a position setting means for setting a position of a three-dimensional object in a predetermined three-dimensional coordinate system; Viewpoint position detecting means for detecting the viewpoint position of the observer; viewpoint position holding means for holding the viewpoint position of the receiving observer at the moment when the discontinuous state is detected; and Coordinate conversion means for converting the detected instantaneous viewpoint position of the receiving observer into a three-dimensional coordinate system having the origin as the origin, and the three-dimensional object converted by the coordinate converting means is sequentially updated with the viewpoint position of the receiving observer And a projecting means for projecting the image on a two-dimensional surface from a viewpoint. 【請求項２】 前記不連続検出手段が、送信側観察者の
視点位置の変化の割合が所定の値を超えた場合に不連続
状態を検出するように構成したことを特徴とする請求項
１記載の立体物表示システム。2. The apparatus according to claim 1, wherein said discontinuity detecting means detects a discontinuous state when a rate of change of a viewpoint position of a transmitting observer exceeds a predetermined value. The three-dimensional object display system described. 【請求項３】 前記視点位置保持手段によって保持され
た視点位置をリセットするリセット手段を更に具えるこ
とを特徴とする請求項１又は２記載の立体物表示システ
ム。3. The three-dimensional object display system according to claim 1, further comprising reset means for resetting a viewpoint position held by said viewpoint position holding means. 【請求項４】 前記視線方向のオフセット量を設定する
オフセット量設定手段と、 そのオフセット量を前記立体物の位置に付加して、前記
立体物の新たな位置を設定するオフセット位置設定手段
とを更に具えることを特徴とする請求項１から３のうち
のいずれか１項に記載の立体物表示システム。4. An offset amount setting means for setting the offset amount in the line of sight direction, and an offset position setting means for adding the offset amount to the position of the three-dimensional object to set a new position of the three-dimensional object. The three-dimensional object display system according to any one of claims 1 to 3, further comprising: 【請求項５】 受信側観察者の視点位置を検出する視点
位置検出手段と、 送信側観察者の視点位置又は視線方向の不連続状態を検
出した瞬時の受信側観察者の視点位置を保持する視点位
置保持手段と、 立体物の位置を、前記不連続状態を検出した瞬時の受信
側観察者の視点位置を原点とする３次元座標系に変換す
る座標変換手段と、 その座標変換手段によって変換された立体物を、逐次更
新される受信側観察者の視点位置を視点として２次元面
に投影する投影手段とを具えることを特徴とする立体物
表示システムの受信装置。5. A viewpoint position detecting means for detecting a viewpoint position of a reception-side observer, and holding a viewpoint position of the transmission-side observer or a viewpoint position of the reception-side observer instantaneously when a discontinuous state in a line-of-sight direction is detected. Viewpoint position holding means, coordinate transformation means for transforming the position of the three-dimensional object into a three-dimensional coordinate system having the origin at the viewpoint position of the receiving observer at the moment of detecting the discontinuity, and transformation by the coordinate transformation means And a projecting means for projecting the obtained three-dimensional object on a two-dimensional surface with the viewpoint position of the receiving observer updated sequentially as a viewpoint. 【請求項６】 送信側観察者の視点位置の変化の割合が
所定の値を超えた場合に不連続状態を検出するように構
成したことを特徴とする請求項５記載の立体物表示シス
テムの受信装置。6. The three-dimensional object display system according to claim 5, wherein a discontinuous state is detected when the rate of change of the viewpoint position of the transmitting observer exceeds a predetermined value. Receiver. 【請求項７】 前記視点位置保持手段によって保持され
た視点位置をリセットするリセット手段を更に具えるこ
とを特徴とする請求項５又は６記載の立体物表示システ
ムの受信装置。7. The three-dimensional object display system receiving apparatus according to claim 5, further comprising reset means for resetting a viewpoint position held by said viewpoint position holding means. 【請求項８】 前記視線方向のオフセット量を設定する
オフセット量設定手段と、 そのオフセット量を前記立体物の位置に付加して、立体
物の新たな位置を設定するオフセット位置設定手段とを
更に具えることを特徴とする請求項５から７のうちのい
ずれか１項に記載の立体物表示システムの受信装置。8. An offset amount setting means for setting the offset amount in the line of sight direction, and an offset position setting means for adding the offset amount to the position of the three-dimensional object to set a new position of the three-dimensional object. The receiving device of the three-dimensional object display system according to claim 5, wherein the receiving device is provided. 【請求項９】 受信側観察者の視点位置を検出する視点
位置検出手段と、 所定の瞬時の受信側観察者の視点位置を保持する視点位
置保持手段と、 立体物の位置を、前記所定の瞬時の受信側観察者の視点
位置を原点とする３次元座標系に変換する座標変換手段
と、 その座標変換手段によって変換された立体物を、逐次更
新される受信側観察者の視点位置を視点として２次元面
に投影する投影手段と、 前記視点位置保持手段によって保持された視点位置をリ
セットするリセット手段とを具えることを特徴とする立
体物表示システムの受信装置。9. A viewpoint position detecting means for detecting a viewpoint position of a receiving-side observer; a viewpoint position holding means for holding a predetermined instantaneous viewpoint position of the receiving-side observer; A coordinate transformation means for transforming into a three-dimensional coordinate system with the instantaneous viewpoint position of the receiving observer as an origin, and a three-dimensional object transformed by the coordinate transforming means, the viewpoint position of the receiving observer being updated successively. And a resetting means for resetting the viewpoint position held by the viewpoint position holding means. 【請求項１０】 前記視線方向のオフセット量を設定す
るオフセット量設定手段と、 そのオフセット量を前記立体物の位置に付加して、立体
物の新たな位置を設定するオフセット位置設定手段とを
更に具えることを特徴とする請求項９記載の立体物表示
システムの受信装置。10. An offset amount setting means for setting the offset amount in the line of sight direction, and an offset position setting means for adding the offset amount to the position of the three-dimensional object to set a new position of the three-dimensional object. The receiving device of the three-dimensional object display system according to claim 9, wherein the receiving device is provided. 【請求項１１】 送信側観察者の視点位置又は視線方向
の不連続状態を検出する不連続検出手段と、 立体物の位置を所定の３次元座標系で設定する位置設定
手段と、 受信側観察者の右眼及び左眼の視点位置をそれぞれ検出
する第１及び第２視点位置検出手段と、 前記不連続状態を検出した瞬時の受信側観察者の右眼及
び左眼の視点位置をそれぞれ保持する第１及び第２視点
位置保持手段と、 前記立体物の位置を、前記不連続状態を検出した瞬時の
受信側観察者の視点位置を原点とする３次元座標系にそ
れぞれ変換する第１及び第２座標変換手段と、 これら第１及び第２座標変換手段によって変換された立
体物をそれぞれ、逐次更新される受信側観察者の右眼及
び左眼の視点位置を視点として２次元面に投影する第１
及び第２投影手段とを具えることを特徴とする立体物表
示システム。11. A discontinuity detecting unit for detecting a discontinuous state of a viewpoint position or a line-of-sight direction of a transmission-side observer; a position setting unit for setting a position of a three-dimensional object in a predetermined three-dimensional coordinate system; First and second viewpoint position detecting means for respectively detecting the viewpoint positions of the right and left eyes of the observer, and holding the viewpoint positions of the right and left eyes of the receiving observer at the moment when the discontinuous state is detected. First and second viewpoint position holding means for converting the position of the three-dimensional object into a three-dimensional coordinate system whose origin is the viewpoint position of the receiving observer at the moment when the discontinuous state is detected. A second coordinate conversion unit, and projecting the three-dimensional object converted by the first and second coordinate conversion units onto a two-dimensional surface using the sequentially updated viewpoint positions of the right and left eyes of the receiving observer as viewpoints. First
And a second projection unit. 【請求項１２】 前記不連続検出手段が、送信側観察者
の視点位置の変化の割合が所定の値を超えた場合に不連
続状態を検出するように構成したことを特徴とする請求
項１１記載の立体物表示システム。12. The discontinuity detecting means is configured to detect a discontinuous state when a rate of change of a viewpoint position of a transmitting observer exceeds a predetermined value. The three-dimensional object display system described. 【請求項１３】 前記第１及び第２視点位置保持手段に
よって保持された視点位置をそれぞれリセットする第１
及び第２リセット手段を更に具えることを特徴とする請
求項１１又は１２記載の立体物表示システム。13. A first method for resetting a viewpoint position held by said first and second viewpoint position holding means, respectively.
13. The three-dimensional object display system according to claim 11, further comprising a second reset unit. 【請求項１４】 受信側観察者の右眼及び左眼の視線方
向のオフセット量をそれぞれ設定する第１及び第２オフ
セット量設定手段と、 そのオフセット量を、対応する前記立体物の位置にそれ
ぞれ付加して、前記立体物の新たな位置をそれぞれ設定
する第１及び第２オフセット位置設定手段とを更に具え
ることを特徴とする請求項１１から１３のうちのいずれ
か１項に記載の立体物表示システム。14. A first and second offset amount setting means for respectively setting an offset amount in a line-of-sight direction of a right eye and a left eye of a reception-side observer, and the offset amounts are respectively set to corresponding positions of the three-dimensional object. The three-dimensional object according to any one of claims 11 to 13, further comprising first and second offset position setting means for additionally setting a new position of the three-dimensional object, respectively. Object display system. 【請求項１５】 受信側観察者の右眼及び左眼の視点位
置をそれぞれ検出する第１及び第２視点位置検出手段
と、 送信側観察者の視点位置又は視線方向の不連続状態を検
出した瞬時の受信側観察者の右眼及び左眼の視点位置を
それぞれ保持する第１及び第２視点位置保持手段と、 右眼及び左眼に対する立体物を、前記不連続状態を検出
した瞬時の受信側観察者の右眼及び左眼の視点位置を原
点とする３次元座標系にそれぞれ変換する第１及び第２
座標変換手段と、 これら第１及び第２座標変換手段によって変換された立
体物をそれぞれ、逐次更新される受信側観察者の視点位
置を視点として２次元面に投影する第１及び第２投影手
段とを具えることを特徴とする立体物表示システムの受
信装置。15. A first and second viewpoint position detecting means for detecting a viewpoint position of a right eye and a left eye of a receiving observer, respectively, and detecting a discontinuous state of a viewpoint position or a line-of-sight direction of the transmitting observer. First and second viewpoint position holding means for holding the viewpoint positions of the right eye and the left eye of the receiving observer at an instant, and a three-dimensional object for the right eye and the left eye, at the instant of detecting the discontinuous state. First and second transforming into a three-dimensional coordinate system with the viewpoint positions of the right and left eyes of the side observer as origins, respectively
Coordinate conversion means; and first and second projection means for projecting the three-dimensional object converted by the first and second coordinate conversion means onto a two-dimensional surface with the viewpoint position of the receiving observer updated sequentially as a viewpoint. A receiving device for a three-dimensional object display system, comprising: 【請求項１６】 送信側観察者の視点位置の変化の割合
が所定の値を超えた場合、に不連続状態を検出するよう
に構成したことを特徴とする請求項１５記載の立体物表
示システムの受信装置。16. The three-dimensional object display system according to claim 15, wherein a discontinuous state is detected when the rate of change of the viewpoint position of the transmitting observer exceeds a predetermined value. Receiving device. 【請求項１７】 前記第１及び第２視点位置保持手段に
よって保持された視点位置をそれぞれリセットする第１
及び第２リセット手段を更に具えることを特徴とする請
求項１５又は１６記載の立体物表示システムの受信装
置。17. A first method for resetting a viewpoint position held by the first and second viewpoint position holding means, respectively.
17. The receiving device of the three-dimensional object display system according to claim 15, further comprising a second reset unit. 【請求項１８】 受信側観察者の右眼及び左眼の視線方
向のオフセット量をそれぞれ設定する第１及び第２オフ
セット量設定手段と、 そのオフセット量を、対応する立体物の位置にそれぞれ
付加して、前記立体物の新たな位置をそれぞれ設定する
第１及び第２オフセット位置設定手段とを更に具えるこ
とを特徴とする請求項１５から１７のうちのいずれか１
項に記載の立体物表示システムの受信装置。18. A first and second offset amount setting means for respectively setting an offset amount in a line-of-sight direction of a right eye and a left eye of a receiving observer, and adding the offset amount to a position of a corresponding three-dimensional object. 18. The apparatus according to claim 15, further comprising first and second offset position setting means for respectively setting a new position of the three-dimensional object.
Item 3. The receiving device of the three-dimensional object display system according to Item. 【請求項１９】 受信側観察者の右眼及び左眼の視点位
置をそれぞれ検出する第１及び第２視点位置検出手段
と、 所定の瞬時の受信側観察者の右眼及び左眼の視点位置を
それぞれ保持する第１及び第２視点位置保持手段と、 右眼及び左眼に対する立体物を、前記所定の瞬時の受信
側観察者の右眼及び左眼の視点位置を原点とする３次元
座標系にそれぞれ変換する第１及び第２座標変換手段
と、 これら第１及び第２座標変換手段によって変換された立
体物をそれぞれ、逐次更新される受信側観察者の視点位
置を視点として２次元面に投影する第１及び第２投影手
段と、 前記第１及び第２視点位置保持手段によって保持された
視点位置をそれぞれリセットする第１及び第２リセット
手段とを具えることを特徴とする立体物表示システムの
受信装置。19. First and second viewpoint position detecting means for respectively detecting the viewpoint positions of the right eye and the left eye of the receiving observer, and the viewpoint positions of the right and left eyes of the receiving observer at a predetermined moment. First and second viewpoint position holding means for respectively holding the three-dimensional object for the right eye and the left eye, and three-dimensional coordinates having the origin at the viewpoint positions of the right and left eyes of the predetermined instantaneous receiving observer. First and second coordinate conversion means for converting the three-dimensional object converted by the first and second coordinate conversion means, respectively, into a two-dimensional plane using the viewpoint position of the receiving observer, which is sequentially updated, as a viewpoint A three-dimensional object, comprising: first and second projecting means for projecting an image onto the object; and first and second reset means for respectively resetting the viewpoint position held by the first and second viewpoint position holding means. Display system receiver . 【請求項２０】 受信側観察者の右眼及び左眼の視線方
向のオフセット量をそれぞれ設定する第１及び第２オフ
セット量設定手段と、 そのオフセット量を、対応する立体物の位置にそれぞれ
付加して、前記立体物の新たな位置をそれぞれ設定する
第１及び第２オフセット位置設定手段とを更に具えるこ
とを特徴とする請求項１９記載の立体物表示システムの
受信装置。20. First and second offset amount setting means for respectively setting an offset amount in a line-of-sight direction of a right eye and a left eye of a reception-side observer, and adding the offset amounts to the positions of the corresponding three-dimensional objects, respectively. 20. The three-dimensional object display system receiving apparatus according to claim 19, further comprising first and second offset position setting means for respectively setting a new position of the three-dimensional object.
JP2000201935A 2000-07-04 2000-07-04 Three-dimensional object display system and receiving device thereof Expired - Fee Related JP4141620B2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2000201935A JP4141620B2 (en) 2000-07-04 2000-07-04 Three-dimensional object display system and receiving device thereof

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP2000201935A JP4141620B2 (en) 2000-07-04 2000-07-04 Three-dimensional object display system and receiving device thereof

Publications (2)

Publication Number Publication Date
JP2002024856A true JP2002024856A (en) 2002-01-25
JP4141620B2 JP4141620B2 (en) 2008-08-27

Family

ID=18699535

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2000201935A Expired - Fee Related JP4141620B2 (en) 2000-07-04 2000-07-04 Three-dimensional object display system and receiving device thereof

Country Status (1)

Country Link
JP (1) JP4141620B2 (en)

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2007020142A (en) * 2005-07-05 2007-01-25 Samsung Sdi Co Ltd 3-d graphic processing device, and stereoscopic image display device using the same
JP2011004054A (en) * 2009-06-17 2011-01-06 Sharp Corp Image processing system and method
KR101036600B1 (en) 2009-12-18 2011-05-24 주식회사 비전소프트텍 3d virtual reality system and virtual image displaying method using transparent screen
US8154543B2 (en) 2005-07-05 2012-04-10 Samsung Mobile Display Co., Ltd. Stereoscopic image display device
US8279221B2 (en) 2005-08-05 2012-10-02 Samsung Display Co., Ltd. 3D graphics processor and autostereoscopic display device using the same
JP2013114570A (en) * 2011-11-30 2013-06-10 Toshiba Corp Image reproducing device, image reproducing method and data structure
JP2015008394A (en) * 2013-06-25 2015-01-15 Kddi株式会社 Information terminal device
US9552063B2 (en) 2013-11-29 2017-01-24 Samsung Electronics Co., Ltd. Electronic device including transparent display and method of controlling the electronic device

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2007020142A (en) * 2005-07-05 2007-01-25 Samsung Sdi Co Ltd 3-d graphic processing device, and stereoscopic image display device using the same
US8154543B2 (en) 2005-07-05 2012-04-10 Samsung Mobile Display Co., Ltd. Stereoscopic image display device
US8207961B2 (en) 2005-07-05 2012-06-26 Samsung Mobile Display Co., Ltd. 3D graphic processing device and stereoscopic image display device using the 3D graphic processing device
US8279221B2 (en) 2005-08-05 2012-10-02 Samsung Display Co., Ltd. 3D graphics processor and autostereoscopic display device using the same
JP2011004054A (en) * 2009-06-17 2011-01-06 Sharp Corp Image processing system and method
KR101036600B1 (en) 2009-12-18 2011-05-24 주식회사 비전소프트텍 3d virtual reality system and virtual image displaying method using transparent screen
JP2013114570A (en) * 2011-11-30 2013-06-10 Toshiba Corp Image reproducing device, image reproducing method and data structure
JP2015008394A (en) * 2013-06-25 2015-01-15 Kddi株式会社 Information terminal device
US9552063B2 (en) 2013-11-29 2017-01-24 Samsung Electronics Co., Ltd. Electronic device including transparent display and method of controlling the electronic device

Also Published As

Publication number Publication date
JP4141620B2 (en) 2008-08-27

Similar Documents

Publication Publication Date Title
US5625408A (en) Three-dimensional image recording/reconstructing method and apparatus therefor
EP0830034B1 (en) Image processing for three dimensional display of image data on the display of an image sensing apparatus
US10606347B1 (en) Parallax viewer system calibration
JP2002157607A (en) System and method for image generation, and storage medium
EP1919219A1 (en) Video transmitting apparatus, video display apparatus, video transmitting method and video display method
JP2006128818A (en) Recording program and reproducing program corresponding to stereoscopic video and 3d audio, recording apparatus, reproducing apparatus and recording medium
JP6512575B2 (en) Method of distributing or broadcasting three-dimensional shape information
JP2012216077A (en) Augmented reality providing device and superimposition method of virtual object
JP2007158680A (en) Tracking imaging apparatus and tracking imaging system utilizing it
JP2002024856A (en) Display system of solid object and receiver thereof
CN113382224B (en) Interactive handle display method and device based on holographic sand table
JP2849313B2 (en) Image recording and playback device
JP2018033107A (en) Video distribution device and distribution method
JPH0340591A (en) Method and device for image pickup and display of stereoscopic image
JP3848092B2 (en) Image processing apparatus and method, and program
CN113891063B (en) Holographic display method and device
KR20110025083A (en) Apparatus and method for displaying 3d image in 3d image system
KR102048381B1 (en) Method And System for Rendering for Binocular Disparity Image
US11388378B2 (en) Image processing apparatus, image processing method and projection system
KR101315398B1 (en) Apparatus and method for display 3D AR information
CN113206991A (en) Holographic display method, system, computer program product and storage medium
JP5367747B2 (en) Imaging apparatus, imaging method, and imaging system
US20240087157A1 (en) Image processing method, recording medium, image processing apparatus, and image processing system
WO2012035927A1 (en) Remote video monitoring system
JP5200141B2 (en) Video presentation system, video presentation method, program, and recording medium

Legal Events

Date Code Title Description
A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20050509

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20080213

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20080226

RD03 Notification of appointment of power of attorney

Free format text: JAPANESE INTERMEDIATE CODE: A7423

Effective date: 20080328

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20080424

RD03 Notification of appointment of power of attorney

Free format text: JAPANESE INTERMEDIATE CODE: A7423

Effective date: 20080424

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20080520

A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20080611

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20110620

Year of fee payment: 3

R150 Certificate of patent or registration of utility model

Free format text: JAPANESE INTERMEDIATE CODE: R150

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20120620

Year of fee payment: 4

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20120620

Year of fee payment: 4

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20130620

Year of fee payment: 5

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20140620

Year of fee payment: 6

LAPS Cancellation because of no payment of annual fees