JPH07288791A - Three-dimensional virtual space sharing device - Google Patents
Three-dimensional virtual space sharing deviceInfo
- Publication number
- JPH07288791A JPH07288791A JP6079994A JP7999494A JPH07288791A JP H07288791 A JPH07288791 A JP H07288791A JP 6079994 A JP6079994 A JP 6079994A JP 7999494 A JP7999494 A JP 7999494A JP H07288791 A JPH07288791 A JP H07288791A
- Authority
- JP
- Japan
- Prior art keywords
- virtual space
- user
- face image
- terminals
- terminal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Landscapes
- Processing Or Creating Images (AREA)
- Information Transfer Between Computers (AREA)
- Computer And Data Communications (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Small-Scale Networks (AREA)
Abstract
Description
【０００１】[0001]
【産業上の利用分野】本発明は、利用者が自分の意志で
自由に移動できるような３次元仮想空間と当該３次元仮
想空間内に他の利用者の分身とを表現できる端末を複数
台、通信網を介してスター型に接続し、端末から受信し
た利用者の顔映像と３次元仮想空間内の位置情報とを他
の端末に分配することによって、複数の利用者が同一の
３次元仮想空間を遠隔地で共有し、各利用者端末に他の
利用者の顔映像がマッピングされた分身を表現できる仮
想空間共有技術に関するものである。BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a plurality of terminals capable of expressing a three-dimensional virtual space in which a user can freely move at will, and the alternations of other users in the three-dimensional virtual space. , A star-type connection via a communication network, and by distributing the face image of the user and the position information in the three-dimensional virtual space received from the terminal to other terminals, a plurality of users can obtain the same three-dimensional image. The present invention relates to a virtual space sharing technology capable of sharing a virtual space at a remote location and expressing a personality in which a face image of another user is mapped to each user terminal.
【０００２】[0002]
【従来の技術】一般に複数の端末間で映像を相互に送り
あう場合、使用するネットワークによっていくつかの方
式がある。2. Description of the Related Art Generally, when a plurality of terminals send images to each other, there are several methods depending on the network used.
【０００３】（１）ＬＡＮ（例えばイーサネット）を使
用する場合 （ａ）論理的メッシュ接続方式 本方式は、端末間を論理的にメッシュ接続する方式であ
る。そのトポロジを図７に示す。本方式では、各端末１
が自分の映像をパケット化し、相手の端末１の宛先を指
定して、接続端末数分コピーして送信する。同時に通信
する端末１の台数をｎ、映像の単位時間当たりのデータ
量をｍとすると、端末１から見て送信用の必要回線容
量、受信用の必要回線容量は共に、ｍ×（ｎ−１）であ
る。本方式は一番簡易な方式であり、同時に通信する端
末１の台数がＬＡＮ２の輻輳のない範囲なら本メッシュ
構成で問題はない。(1) When using a LAN (for example, Ethernet) (a) Logical mesh connection system This system is a system in which terminals are logically mesh-connected. The topology is shown in FIG. In this method, each terminal 1
Packetizes its own image, specifies the destination of the terminal 1 of the other party, copies the number of connected terminals and transmits. Assuming that the number of terminals 1 communicating at the same time is n and the amount of video data per unit time is m, the required line capacity for transmission and the required line capacity for reception are both m × (n-1). ). This method is the simplest method, and there is no problem with this mesh configuration as long as the number of terminals 1 communicating at the same time is within a range where there is no congestion on the LAN 2.
【０００４】（ｂ）論理的スター接続方式 輻輳を緩和する方式として、端末間を論理的にスター接
続する方式がある。そのトポロジを図８に示す。本方式
は、ＬＡＮ２に映像サーバ３を設けて、各端末１が自分
の映像を映像サーバ３に送信し、映像サーバ３が他の端
末１に分配する方式である。本方式では、端末１から見
て送信用の必要回線容量はｍで、受信用の必要回線容量
はｍ×（ｎ−１）となり、上記メッシュ接続方式より輻
輳を緩和できる。(B) Logical Star Connection System As a system for alleviating congestion, there is a system for logical star connection between terminals. The topology is shown in FIG. In this system, a video server 3 is provided on the LAN 2, each terminal 1 transmits its own video to the video server 3, and the video server 3 distributes the video to other terminals 1. In this method, the required line capacity for transmission is m when viewed from the terminal 1, and the required line capacity for reception is m × (n−1), and congestion can be alleviated as compared with the above mesh connection method.
【０００５】（２）公衆網（例えばＩＮＳ６４）を使用
する場合 （ａ）物理的メッシュ接続方式 本方式は、公衆網により端末間を物理的にメッシュ接続
する方式である。そのトポロジを図９に示す。本方式で
は、各端末１がｎ−１本の回線５を収容し、自分の映像
をパケット化して接続端末数分コピーし、公衆網４の回
線５に送信する。本方式では、接続端末数分の回線５を
使用するので、輻輳は問題にはならない （ｂ）物理的スター接続方式 収容回線を減らす方式として、公衆網により端末間を物
理的にスター接続する方式がある。そのトポロジを図１
０に示す。本方式では、映像サーバ３を設けて、各端末
１は回線５と公衆網４を通して自分の映像を映像サーバ
３に送信し、映像サーバ３が他の端末１に公衆網４を通
して分配する方式である。本方式では各端末は１回線で
よい。しかし、公衆網４では上りと下りの回線容量は同
一で、たとえばＩＮＳ６４では６４ｋｂｉｔ／秒である
ので、端末１から６４ｋｂｉｔ／秒の映像を映像サーバ
３に送ると、映像サーバ３は６４×（ｎ−１）ｋｂｉｔ
／秒の下りの回線容量が必要になり、送信できないとい
う問題が生じる。この問題を回避するには、下りの回線
容量が６４ｋｂｉｔ／秒となるように、上りの映像のデ
ータ量を減らす方法がある。例えば、９台の端末１が同
時接続されている場合、各端末１は６４÷（９−１）＝
８ｋｂｉｔ／秒の映像を映像サーバ３に送る。映像サー
バ３は他の８台の端末１から受信した８ｋｂｉｔ／秒の
映像をパケット多重して８×８＝６４ｋｂｉｔ／秒のデ
ータを各端末１に送信する。(2) When a public network (for example, INS64) is used (a) Physical mesh connection system This system is a system in which terminals are physically mesh-connected by a public network. The topology is shown in FIG. In this method, each terminal 1 accommodates n-1 lines 5, packetizes its own image, copies the number of connected terminals, and transmits the same to the line 5 of the public network 4. In this method, since the lines 5 for the number of connected terminals are used, congestion does not become a problem. (B) Physical star connection method As a method to reduce the number of accommodated lines, a method of physically star-connecting terminals via a public network There is. Figure 1 shows the topology
It shows in 0. In this method, a video server 3 is provided, each terminal 1 transmits its own video to the video server 3 through the line 5 and the public network 4, and the video server 3 distributes it to other terminals 1 through the public network 4. is there. In this system, each terminal needs only one line. However, in the public network 4, the upstream and downstream line capacities are the same, and for example, INS64 has 64 kbit / sec. Therefore, when a video of 64 kbit / sec is sent from the terminal 1 to the video server 3, the video server 3 produces 64 × (n -1) kbit
Since a downlink line capacity of / sec is required, there arises a problem that transmission cannot be performed. In order to avoid this problem, there is a method of reducing the amount of upstream video data so that the downstream line capacity becomes 64 kbit / sec. For example, when 9 terminals 1 are simultaneously connected, each terminal 1 is 64 ÷ (9-1) =
The video of 8 kbit / sec is sent to the video server 3. The video server 3 packet-multiplexes 8 kbit / sec video received from the other eight terminals 1 and transmits 8 × 8 = 64 kbit / sec data to each terminal 1.
【０００６】[0006]
【発明が解決しようとする課題】複数の端末間で相互に
映像を送り合う上記従来の方式では、それぞれ、以下の
ような問題点があった。However, each of the above-mentioned conventional systems in which images are mutually sent between a plurality of terminals has the following problems.
【０００７】（１）ＬＡＮ（例えばイーサネット）を使
用する場合 （ａ）論理的メッシュ接続方式 本方式は一番簡易な方式であり、先に述べたとおり同時
に通信する端末の台数がＬＡＮが輻輳しない範囲なら本
メッシュ構成で問題はない。しかし、端末数が多くなる
と輻輳が問題になる。(1) When using a LAN (for example, Ethernet) (a) Logical mesh connection method This method is the simplest method, and as described above, the number of terminals simultaneously communicating does not cause congestion of the LAN. If it is within the range, there is no problem with this mesh configuration. However, as the number of terminals increases, congestion becomes a problem.
【０００８】（ｂ）論理的スター接続方式 本方式は、上記メッシュ接続方式より輻輳を緩和でき
る。しかし、接続端末数がさらに増えて、ＬＡＮの輻輳
が問題になる場合には、本スター接続方式でも解決でき
ないという問題がある。(B) Logical Star Connection System This system can reduce congestion more than the mesh connection system. However, if the number of connected terminals further increases and LAN congestion becomes a problem, there is a problem that this star connection method cannot solve the problem.
【０００９】（２）公衆網（例えばＩＮＳ６４）を使用
する場合 （ａ）物理的メッシュ接続方式 本方式は接続端末数分の回線を使用するので、輻輳は問
題にはならないが、通信料が収容回線数に比例して高く
なるので、端末数が多くなると実用的でない。(2) When using a public network (for example, INS64) (a) Physical mesh connection system Since this system uses lines for the number of connection terminals, congestion does not become a problem, but communication charges are accommodated. Since it increases in proportion to the number of lines, it becomes impractical when the number of terminals increases.
【００１０】（ｂ）物理的スター接続方式 この方式では、接続端末数が増えるにつれて映像の品質
が画一的に劣化するとう問題がある。(B) Physical Star Connection System This system has a problem that the quality of the image deteriorates uniformly as the number of connected terminals increases.
【００１１】本発明は、上記の問題点を解決するために
なされたものであり、その目的は、接続端末数が多い場
合に有利なスター接続型の映像サーバにおいて、各端末
から受信した顔画像を他の端末に分配する時に、映像品
質の画一的な劣化を生じることなく、経済的に公衆網に
適用可能とし、ＬＡＮ等における網輻輳を回避すること
にある。The present invention has been made to solve the above problems, and an object of the present invention is to provide a face image received from each terminal in a star connection type video server which is advantageous when the number of connected terminals is large. Is to be economically applicable to a public network without causing uniform deterioration of video quality when distributed to other terminals, and to avoid network congestion in a LAN or the like.
【００１２】[0012]
【課題を解決するための手段】上記の目的を達成するた
め、請求項１の発明では、利用者が自分の意志で自由に
移動できるような３次元仮想空間と当該３次元仮想空間
内に他の利用者の分身とを表現できる端末を複数台、通
信網を介してスター型に接続し、前記端末から受信した
利用者の顔映像と前記３次元仮想空間内の位置情報とを
他の端末に分配することによって、複数の利用者が同一
の３次元仮想空間を遠隔地で共有できる３次元仮想空間
共有装置であって、端末から受信する各利用者の分身の
位置情報から顔映像の分配先利用者と他の利用者との３
次元仮想空間内の距離を計算する手段と、前記距離が近
い利用者の顔映像から順に解像度もしくはフレーム数ま
たはそれら両方を多く割り当てて前記顔映像の分配先利
用者の端末に送信する手段と、を有することを特徴とす
る３次元仮想空間共有装置を手段とする。In order to achieve the above-mentioned object, in the invention according to claim 1, a user can freely move in a three-dimensional virtual space and the other three-dimensional virtual space. A plurality of terminals capable of expressing the user's alter ego are connected in a star shape via a communication network, and the face image of the user and the position information in the three-dimensional virtual space received from the terminal are connected to another terminal. Is a three-dimensional virtual space sharing device that enables a plurality of users to share the same three-dimensional virtual space at remote locations, and distributes facial images from the position information of each user's alter ego received from the terminal. 3 with the previous user and other users
A means for calculating a distance in the dimensional virtual space, and means for allocating a large number of resolutions or the number of frames or both in order from the face image of the user having a short distance, and transmitting the same to the terminals of the distribution destination users of the face image, A three-dimensional virtual space sharing device having the above is used as means.
【００１３】また、請求項２の発明では、利用者が自分
の意志で自由に移動できるような３次元仮想空間と当該
３次元仮想空間内に他の利用者の分身とを表現できる端
末を複数台、通信網を介してスター型に接続し、前記端
末から受信した利用者の顔映像と前記３次元仮想空間内
の位置情報とを他の端末に分配することによって、複数
の利用者が同一の３次元仮想空間を遠隔地で共有できる
３次元仮想空間共有装置であって、端末から受信する各
利用者の分身の位置情報から顔映像の分配先利用者と他
の利用者との３次元仮想空間内の視線の一致度を計算す
る手段と、前記視線の一致度が大きい利用者の顔映像か
ら順に解像度もしくはフレーム数またはそれら両方を多
く割り当てて前記顔映像の分配先利用者の端末に送信す
る手段と、を有することを特徴とする３次元仮想空間共
有装置を手段とする。According to the second aspect of the present invention, a plurality of terminals capable of expressing a three-dimensional virtual space in which the user can freely move at will, and the altercations of other users in the three-dimensional virtual space are provided. A plurality of users are the same by connecting to the other terminals in a star shape via a stand and a communication network, and distributing the face image of the user received from the terminal and the position information in the three-dimensional virtual space to other terminals. 3D virtual space sharing device capable of sharing the 3D virtual space of a user at a remote location, the 3D between the user to whom the face image is distributed and other users based on the position information of each user's alter ego received from the terminal. A means for calculating the degree of coincidence of the line of sight in the virtual space, and the resolution and / or the number of frames or both of them are allocated in order from the face image of the user having a large degree of coincidence of the line of sight to the terminals of the user to whom the face image is distributed. And means for sending And means a three-dimensional virtual space sharing apparatus characterized by.
【００１４】また、請求項３の発明では、利用者が自分
の意志で自由に移動できるような３次元仮想空間と当該
３次元仮想空間内に他の利用者の分身とを表現できる端
末を複数台、通信網を介してスター型に接続し、前記端
末から受信した利用者の顔映像と前記３次元仮想空間内
の位置情報とを他の端末に分配することによって、複数
の利用者が同一の３次元仮想空間を遠隔地で共有できる
３次元仮想空間共有装置であって、端末から受信する各
利用者の分身の位置情報から顔映像の分配先利用者と他
の利用者との３次元仮想空間内の距離と視線の一致度を
計算する手段と、前記距離と視線の一致度の両方を評価
してその評価が高い利用者の顔映像から順に解像度もし
くはフレーム数またはそれら両方を多く割り当てて前記
顔映像の分配先利用者の端末に送信する手段と、を有す
ることを特徴とする３次元仮想空間共有装置を手段とす
る。According to the third aspect of the invention, a plurality of terminals capable of expressing a three-dimensional virtual space in which the user can freely move at will, and the altercations of other users in the three-dimensional virtual space are provided. A plurality of users are the same by connecting to the other terminals in a star shape via a stand and a communication network, and distributing the face image of the user received from the terminal and the position information in the three-dimensional virtual space to other terminals. 3D virtual space sharing device capable of sharing the 3D virtual space of a user at a remote location, the 3D between the user to whom the face image is distributed and other users based on the position information of each user's alter ego received from the terminal. A means for calculating the degree of coincidence between the distance and the line of sight in the virtual space, and both the distance and the degree of coincidence of the line of sight are evaluated and the resolution and / or the number of frames or both of them are assigned in order from the face image of the user with a high evaluation. Distributing interest of the face image And means a three-dimensional virtual space sharing apparatus characterized by having a means for transmitting to the user terminal.
【００１５】さらに、請求項４の発明では、上記の３次
元仮想空間共有装置において、送信する手段が、距離の
評価値として該距離に逆比例する値を与え視線一致度の
評価値として視線の角度に逆比例するような値を与えそ
れらの評価値の積が大きい利用者の顔映像から順に解像
度もしくはフレーム数またはそれら両方を多く割り当て
て顔映像の分配先利用者の端末に送信するものであるこ
とを特徴とする３次元仮想空間共有装置を手段とする。Further, according to the invention of claim 4, in the above-mentioned three-dimensional virtual space sharing device, the transmitting means gives a value inversely proportional to the distance as an evaluation value of the distance, and an evaluation value of the line-of-sight matching degree of the line-of-sight. A value that is inversely proportional to the angle is given, and the resolution and / or the number of frames or both are assigned in order from the face image of the user whose evaluation value is large, and the face image is transmitted to the terminal of the user to whom the face image is distributed. A three-dimensional virtual space sharing device characterized by the above is used.
【００１６】[0016]
【作用】本発明では、接続端末数が多い場合に網輻輳の
点で有利なスター接続型とし、各端末から受信した映像
と３次元仮想空間内の位置情報を他の端末に分配する時
に、端末から受信する各利用者の分身の位置情報から、
顔映像の分配先利用者と他の利用者との仮想空間内の距
離と視線の一致度を計算し、距離が近く、もしくは視線
の一致度が大きい、またはそれら両方が大きい利用者の
顔映像から順に、解像度やフレーム数を多く割り当てる
ような間引き処理を適用することにより、例えば、自分
との距離が近い人により品質のよい映像を与えて、距離
が遠い人の映像の品質を下げたり、また自分の方を向い
ている人に品質のよい映像を与えて、自分の方を向いて
いない人の映像の品質を下げたりすることで、映像品質
の画一的な劣化を生じさせることなく、経済的に公衆網
に適用可能とし、ＬＡＮ等における網輻輳を回避する。According to the present invention, when the number of connected terminals is large, the star connection type is advantageous in terms of network congestion, and when distributing the video received from each terminal and the position information in the three-dimensional virtual space to other terminals, From the position information of each user's alter ego received from the terminal,
Face image of a user who has a close distance or a large degree of line-of-sight matching, or the distance between the user to whom the face image is distributed and other users in the virtual space is calculated. By applying a thinning process such as assigning a large number of resolutions and frames in order from, for example, by giving a better quality image to a person who is close to him, or lowering the image quality of a person who is far away, Also, by giving a good quality image to the person who is facing him and lowering the quality of the image of the person who is not facing him, there is no uniform deterioration of the image quality. It is economically applicable to public networks and avoids network congestion in LANs and the like.
【００１７】[0017]
【実施例】本発明の実施例を図１、図２、図３、図４、
図５、図６に示す。DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Embodiments of the present invention are shown in FIGS.
This is shown in FIGS.
【００１８】すべての端末は仮想空間を共有するものと
する。そのために、例えば、各端末で同一のソフトウェ
アを用いるなどして、同一の仮想空間モデルを保有す
る。各利用者は、マウスなどを用いてオブジェクトを操
作することで自分の意志で自由に仮想空間内を移動で
き、顔の向きを設定できる。他の利用者も同じ仮想空間
内を移動し顔の向きを設定できるので、それを認知する
ため、映像サーバとして仮想空間共有装置を設け、各端
末を接続端末数が多い場合に網輻輳の点で有利なスター
型に接続し、３次元仮想空間内に各端末の利用者の分身
を用意する。各利用者は、ビデオカメラで撮影した自分
の顔映像と位置情報（仮想空間内の位置座標と顔の向
き）を常時送信する。３次元仮想空間共有装置は、受信
した各利用者の位置情報から、仮想空間内の該当位置に
当該利用者の分身を移動させ、当該利用者の映像を顔の
向きを考慮して分身にマッピングする。仮想空間共有装
置は、各端末へ、その端末以外の他の端末の仮想空間内
での位置情報と顔画像を分配する時、顔画像に関して、
当該端末とそれ以外の端末との距離およびその分身の視
線の一致度に応じて特殊な間引き処理を用い、フレーム
数や解像度を変えることにより、映像品質を画一的に劣
化させることなく他の端末の顔画像の分配を行う。All terminals share a virtual space. Therefore, the same virtual space model is held by using the same software in each terminal, for example. Each user can freely move in the virtual space by himself or herself by manipulating the object using the mouse or the like, and can set the direction of the face. Since other users can move in the same virtual space and set the direction of the face, a virtual space sharing device is installed as a video server to recognize it, and when each terminal has a large number of connected terminals, the point of network congestion By connecting to a star type, which is advantageous in, a user's altercation of each terminal is prepared in the three-dimensional virtual space. Each user constantly transmits his / her face image captured by a video camera and position information (position coordinates in the virtual space and face orientation). The three-dimensional virtual space sharing device moves the user's alter ego to the corresponding position in the virtual space based on the received position information of each user, and maps the image of the user to the alternation in consideration of the face direction. To do. The virtual space sharing device, when distributing position information and face images in the virtual space of terminals other than the terminal to each terminal, regarding the face image,
Special thinning processing is used according to the distance between the terminal and other terminals and the degree of coincidence of the line of sight of the other person, and the number of frames and the resolution are changed so that the image quality does not deteriorate uniformly. Distributing face images of terminals.
【００１９】本実施例では、通信網としてＩＮＳ６４を
例にとり、全部で５人の利用者が同一の仮想空間を共有
する場合について説明する。ＩＮＳ６４の伝送ビットレ
ートは上り下りとも６４ｋｂｉｔ／秒である。各利用者
は自分の映像をビデオカメラで撮影し、パケット化して
６４ｋｂｉｔ／秒で仮想空間共有装置に送信する。仮想
空間共有装置は各端末に対して、送信先の利用者以外の
４人分の映像をパケット多重して送信するが、このまま
では６４ｋｂｉｔ／秒×４＝２５６ｋｂｉｔ／秒とな
り、下りの回線容量６４ｋｂｉｔ／秒を越えてしまう。
そこで、４人分の映像パケットの合計が６４ｋｂｉｔ／
秒になるように間引き処理を行う。間引き処理として、
送信先の利用者と他の利用者との距離、視線の一致度を
利用する。In this embodiment, INS64 is taken as an example of a communication network, and a case where all five users share the same virtual space will be described. The transmission bit rate of the INS 64 is 64 kbit / sec both upstream and downstream. Each user shoots his / her image with a video camera, packetizes it, and transmits it to the virtual space sharing device at 64 kbit / sec. The virtual space sharing device packet-multiplexes and transmits video of four people other than the destination user to each terminal, but as it is, it becomes 64 kbit / sec × 4 = 256 kbit / sec, and the downlink line capacity is 64 kbit. / Sec will be exceeded.
Therefore, the total of the video packets for 4 people is 64 kbit /
Decimation processing is performed so that the time becomes 2 seconds. As thinning processing,
The distance between the destination user and other users and the degree of line-of-sight matching are used.
【００２０】図１は仮想空間内の自分と他の利用者との
距離を４段階に分ける例を示している。自分からの距離
が近い利用者から順に、４，３，２，１の値を与える。
これは距離に逆比例するような評価値を与える例である
が、自分と他の利用者の距離の二乗に逆比例するような
評価値を与えても良い。FIG. 1 shows an example in which the distance between oneself and another user in the virtual space is divided into four stages. The values 4, 3, 2, and 1 are given in order from the users who are closer to themselves.
This is an example of giving an evaluation value that is inversely proportional to the distance, but an evaluation value that is inversely proportional to the square of the distance between the user and another user may be given.
【００２１】図２は、自分の視線の向きに対して他の利
用者の顔の向きを４段階に分ける例を示している。自分
の視線と他の利用者の視線に重なりがある場合には、そ
の利用者に値３を与える。重なりがない場合には、他の
利用者の視線を回転させる。FIG. 2 shows an example in which the direction of the face of another user is divided into four stages with respect to the direction of his or her line of sight. When there is an overlap between the user's line of sight and the line of sight of another user, the user is given a value of 3. When there is no overlap, the line of sight of another user is rotated.
【００２２】図３は、ある２人の利用者を上から見た図
で、上記の４段階により視線一致度を評価する一例を示
す図である。本例では、着目する利用者Ｕ１の視野角を
α、他の利用者Ｕ２の視野角をβとした場合、利用者Ｕ
１の顔が利用者Ｕ２の視野に入るまで、利用者２の顔の
向きを回転させ、その回転角θの大小により、回転角が
０＜θ≦４５度なら値２を、４５＜θ≦９０度なら値１
を、９０度＜θ＜１８０度なら値０を与える。FIG. 3 is a diagram of a certain two users viewed from above, and is a diagram showing an example of evaluating the degree of line-of-sight matching by the above-described four steps. In this example, if the viewing angle of the user U1 of interest is α and the viewing angle of another user U2 is β, the user U
The direction of the face of the user 2 is rotated until the face of No. 1 enters the field of view of the user U2, and if the rotation angle is 0 <θ ≦ 45 degrees, the value 2 is set to 45 <θ ≦, depending on the magnitude of the rotation angle θ. Value 90 if 90 degrees
And 90 ° <θ <180 ° gives a value of 0.
【００２３】図４は、距離と視線一致度の両方を合わせ
て評価する場合の一例を説明するための図である。自分
に対する距離と向きを上記の値の積で表した値を示して
いる。例えば、ある利用者から見た仮想空間内の他の利
用者の距離と顔の向きが図５である場合、自分からの距
離が近い人から順に、値１２，６，２，３が与えられ
る。この値で比例配分して合計が６４ｋｂｉｔ／秒にな
るようにする。すなわち、自分からの距離が近い人から
順に、 ６４×１２／（１２＋６＋２＋３）＝３３．４ｋｂｉｔ
／秒 ６４× ６／（１２＋６＋２＋３）＝１６．７ｋｂｉｔ
／秒 ６４× ２／（１２＋６＋２＋３）＝ ５．６ｋｂｉｔ
／秒 ６４× ３／（１２＋６＋２＋３）＝ ８．３ｋｂｉｔ
／秒 の伝送ビットレートを与えるように間引きする。間引き
はフレーム数／秒を減らすか、解像度を減らすか、両方
減らすかのいずれかの手段をとる。FIG. 4 is a diagram for explaining an example in which both distance and line-of-sight coincidence are evaluated together. It shows the value of the distance and direction to oneself expressed by the product of the above values. For example, when the distance and the direction of the face of another user in the virtual space seen from a certain user are as shown in FIG. 5, the values 12, 6, 2, and 3 are given in order from the person with the shortest distance from himself. . This value is proportionally distributed so that the total becomes 64 kbit / sec. That is, 64 × 12 / (12 + 6 + 2 + 3) = 33.4 kbit, in order from the person closest to him / herself.
/ Sec 64 × 6 / (12 + 6 + 2 + 3) = 16.7 kbit
/ Sec 64 × 2 / (12 + 6 + 2 + 3) = 5.6 kbit
/ Sec 64 × 3 / (12 + 6 + 2 + 3) = 8.3 kbit
Decimate to give a transmission bit rate of / sec. Decimation is performed by either reducing the number of frames / second, reducing the resolution, or reducing both.
【００２４】図６は仮想空間共有装置の構成例を示して
いる。この構成例では簡単のため、仮想共有装置が３台
の端末を収容する場合について示している。図におい
て、１０は仮想空間共有装置、１１，１２，１３は回線
インタフェース部、１４は位置情報分配部、１５は距離
計算部、１６は視線一致度計算部、１７は映像間引き率
決定部、１８は映像間引き・分配部、１９，２３，２７
は映像受信用内部バス、２０，２４，２８は映像送信用
内部バス、２１，２５，２９は位置情報受信用内部バ
ス、２２，２６，３０は位置情報送信用内部バス、３１
は距離計算結果転送用内部バス、３２は視線一致度計算
結果転送用内部バス、３３は映像間引き率通知用内部バ
ス、３４，３５，３６は通信回線を示す。FIG. 6 shows a configuration example of the virtual space sharing apparatus. In this configuration example, for simplicity, the case where the virtual shared device accommodates three terminals is shown. In the figure, 10 is a virtual space sharing device, 11, 12 and 13 are line interface units, 14 is a position information distribution unit, 15 is a distance calculation unit, 16 is a line-of-sight coincidence calculation unit, 17 is a video thinning rate determination unit, 18 Is a video thinning / distributing unit, 19, 23, 27
Is an internal bus for video reception, 20, 24 and 28 are internal buses for video transmission, 21, 25 and 29 are internal buses for receiving positional information, 22, 26 and 30 are internal buses for transmitting positional information, and 31.
Is an internal bus for transferring a distance calculation result, 32 is an internal bus for transferring a line-of-sight matching degree calculation result, 33 is an internal bus for notifying a video thinning rate, and 34, 35 and 36 are communication lines.
【００２５】仮想空間共有装置１０は、端末とはＩＮＳ
６４、回線３４，３５，３６を介して映像と位置情報の
送受信を行う。まず、回線３４，３５，３６から受信し
たデータは、それぞれ回線インタフェース部１１，１
２，１３で受信する。回線インタフェース部１１，１
２，１３は、受信したデータを解析し、映像であれば、
内部バス１９，２３，２７を介して映像を映像間引き・
分配部１８へ転送する。回線インタフェース部１１，１
２，１３は、受信したデータが位置情報であれば、内部
バス２１，２５，２９を介して位置情報を位置情報分配
部１４、距離計算部１５、視線一致度計算部１６へ転送
する。位置情報分配部１４は内部バス２１から受けた位
置情報をコピーして内部バス２６，３０を介して回線イ
ンタフェース部１２，１３へ転送する。また、位置情報
分配部１４は内部バス２５から受けた位置情報をコピー
して内部バス２２，３０を介して回線インタフェース部
１１，１３へ転送する。また、位置情報分配部１４は内
部バス２９から受けた位置情報をコピーして内部バス２
２，２６を介して回線インタフェース部１１，１２へ転
送する。距離計算部１５は内部バス２１，２５，２９を
介して受けた位置情報から、相互の距離ｄを計算する。
その距離が仮想空間の奥行きの長さＬと比較し、０＜ｄ
≦Ｌ／４なら値４を、Ｌ／４＜ｄ≦Ｌ／２なら値３を、
Ｌ／２＜ｄ≦３Ｌ／４なら値２を、３Ｌ／４≦ｄ≦Ｌな
ら値１を与え、内部バス３１を介して映像間引き率決定
部１７へ転送する。視線一致度計算部１６は内部バス２
１，２５，２９を介して受けた位置情報から、利用者間
の視線の交差角度θを計算する。ある一人の利用者の視
野と、他の利用者の視野に重なりがある場合にはその利
用者に値３を、重なりがない場合には、０＜θ≦４５度
なら値２を、４５度＜θ≦９０度なら値１を、９０度＜
θ＜１８０度なら値０を与え、内部バス３２を介して映
像間引き率決定部１７へ転送する。映像間引き率決定部
１７は上述した方法により、ｄとθによる値の積を求め
て転送ビットレートの配分を決定し、内部バス３３を介
して映像間引き・分配部１８へ転送する。映像間引き・
分配部１８は、内部バス２０には内部バス２３，２７か
ら受けた映像を、内部バス２４には内部バス１９，２７
から受けた映像を、内部バス２８には内部バス１９，２
３から受けた映像を、それぞれ映像間引き率決定部１７
より内部バス３３を介して受けた伝送ビットレート配分
に基づいて間引き処理を行い転送する。回線インタフェ
ース部１１，１２，１３は、内部バス２２，２６，３０
から受けた位置情報と、内部バス２０，２４，２８から
受けた映像を回線３４，３５，３６へ送出する。The virtual space sharing apparatus 10 is an INS with a terminal.
Video and position information are transmitted and received via 64 and lines 34, 35 and 36. First of all, the data received from the lines 34, 35, 36 are the line interface parts 11, 1 respectively.
Receive at 2 and 13. Line interface section 11, 1
2 and 13 analyze the received data, and if it is a video,
Images are thinned out via the internal buses 19, 23, 27.
Transfer to the distribution unit 18. Line interface section 11, 1
If the received data is position information, 2 and 13 transfer the position information to the position information distribution unit 14, the distance calculation unit 15, and the line-of-sight coincidence calculation unit 16 via the internal buses 21, 25 and 29. The position information distribution unit 14 copies the position information received from the internal bus 21 and transfers it to the line interface units 12 and 13 via the internal buses 26 and 30. The position information distribution unit 14 also copies the position information received from the internal bus 25 and transfers it to the line interface units 11 and 13 via the internal buses 22 and 30. Further, the position information distribution unit 14 copies the position information received from the internal bus 29 to copy the internal bus 2
The data is transferred to the line interface units 11 and 12 via 2, 26. The distance calculator 15 calculates the mutual distance d from the position information received via the internal buses 21, 25 and 29.
The distance is compared with the length L of the depth of the virtual space, and 0 <d
If ≦ L / 4, then the value 4; if L / 4 <d ≦ L / 2, then the value 3;
If L / 2 <d ≦ 3L / 4, the value 2 is given, and if 3L / 4 ≦ d ≦ L, the value 1 is given and the value is transferred to the video thinning rate determination unit 17 via the internal bus 31. The line-of-sight coincidence calculation unit 16 uses the internal bus 2
From the position information received via 1, 25, 29, the intersection angle θ of the line of sight between the users is calculated. If there is an overlap between the visual field of one user and the visual field of another user, the value 3 is assigned to that user, and if there is no overlap, the value 2 is assigned if 0 <θ ≦ 45 degrees, and 45 degrees. <If θ ≤ 90 degrees, value 1 is set, 90 degrees <
If θ <180 degrees, the value 0 is given and the value is transferred to the image thinning rate determination unit 17 via the internal bus 32. The video thinning rate determination unit 17 determines the distribution of the transfer bit rate by obtaining the product of the values of d and θ by the method described above, and transfers the transfer bit rate to the video thinning / distribution unit 18 via the internal bus 33. Video thinning
The distribution unit 18 causes the internal bus 20 to receive the video received from the internal buses 23 and 27, and the internal bus 24 to the internal buses 19 and 27.
The images received from the internal buses 28, 19
The video received from 3 is respectively reduced to the video thinning rate determination unit 17
Further, thinning processing is performed based on the transmission bit rate distribution received via the internal bus 33, and the data is transferred. The line interface units 11, 12, and 13 have internal buses 22, 26, and 30.
The position information received from the device and the video received from the internal buses 20, 24 and 28 are sent to the lines 34, 35 and 36.
【００２６】本実施例では、複数の利用者が共有できる
３次元仮想空間を対象にしており、仮想空間共有装置が
映像サーバに該当する。各利用者は自分の意志で自由に
仮想空間内を移動できるため、自分と相手の位置関係や
顔の向きが常時変化する。この位置情報を利用して自分
との距離が近い人により品質の良い映像を与えて、距離
が遠い人の映像の品質を下げたり、また自分の方を向い
ている人に品質のよい映像を与えて、自分の方を向いて
いない人の映像の品質を下げたりすることにより、映像
品質の画一的な劣化を生じさせることなく、経済的に公
衆網に適用可能とし、スター型接続と相俟ってＬＡＮ等
における網輻輳を回避する。In this embodiment, a three-dimensional virtual space that can be shared by a plurality of users is targeted, and the virtual space sharing device corresponds to a video server. Since each user can freely move in the virtual space by his / her own will, the positional relationship between the user and the other party and the orientation of the face constantly change. By using this position information, you can give a person with a close distance to yourself a better quality image, reduce the quality of the image of a person who is far away, or give a better quality image to someone who is facing you. By making the quality of the image of the person not facing to him / herself lower, it can be economically applied to the public network without causing uniform deterioration of the image quality, and can be connected to the star-type connection. Together, they avoid network congestion in LANs and the like.
【００２７】[0027]
【発明の効果】以上説明したように、請求項１の発明に
よれば、接続端末数が多い場合に有利なスター接続型の
仮想空間共有装置において、各端末から受信した映像を
他の端末に分配する時に、端末から受信する各利用者の
分身の位置情報から顔映像の分配先利用者と他の利用者
との仮想空間内の距離を計算し、距離が近い利用者の顔
映像から順に、解像度、フレーム数を多く割り当てるよ
うな間引き処理を適用しているので、画一的な劣化を生
じさせることなく自分に近い利用者の顔画像ほど映像品
質の良い顔画像が得られ、経済的に公衆網に適用可能と
なり、ＬＡＮ等における網輻輳を回避することができ
る。As described above, according to the first aspect of the invention, in the star-connection type virtual space sharing apparatus which is advantageous when the number of connected terminals is large, the image received from each terminal is transmitted to other terminals. At the time of distribution, the distance in the virtual space between the user to whom the face image is distributed and other users is calculated from the position information of each user's alter ego received from the terminal, and the face images of the users with the shortest distance are sequentially calculated. Since a thinning process that allocates a large number of frames, resolution, and number of frames is applied, a face image of a user closer to himself can be obtained without generating uniform deterioration, and a face image with better image quality can be obtained, which is economical. In addition, it can be applied to a public network, and network congestion in a LAN or the like can be avoided.
【００２８】また、請求項２の発明によれば、接続端末
数が多い場合に有利なスター接続型の仮想空間共有装置
において、各端末から受信した映像を他の端末に分配す
る時に、端末から受信する各利用者の分身の位置情報か
ら顔映像の分配先利用者と他の利用者との視線の一致度
を計算し、視線の一致度の大きい利用者の顔映像から順
に、解像度、フレーム数を多く割り当てるような間引き
処理を適用しているので、画一的な劣化を生じさせるこ
となく自分の視線方向に近い利用者の顔画像ほど映像品
質の良い顔画像が得られ、経済的に公衆網に適用可能と
なり、ＬＡＮ等における網輻輳を回避することができ
る。Further, according to the invention of claim 2, in the virtual space sharing apparatus of star connection type which is advantageous when the number of connected terminals is large, when the video received from each terminal is distributed to other terminals, From the position information of each user's alter ego received, calculate the degree of line-of-sight match between the user to whom the face image is distributed and other users, and the resolution and frame are calculated in order from the face image of the user with the highest line-of-sight match. Since the thinning process that allocates a large number is applied, a face image of a user closer to his or her line-of-sight direction can be obtained as a face image with better image quality without causing uniform deterioration, which is economically feasible. It can be applied to a public network, and network congestion on a LAN or the like can be avoided.
【００２９】また、請求項３の発明によれば、接続端末
数が多い場合に有利なスター接続型の仮想空間共有装置
において、各端末から受信した映像を他の端末に分配す
る時に、端末から受信する各利用者の分身の位置情報か
ら顔映像の分配先利用者と他の利用者との仮想空間内の
距離と視線の一致度を計算し、距離が近く視線の一致度
の大きい利用者の顔映像から順に、解像度、フレーム数
を多く割り当てるような間引き処理を適用しているの
で、画一的な劣化を生じさせることなく自分に近くかつ
視線方向に近い利用者の顔画像ほど映像品質の良い顔画
像が得られ、経済的に公衆網に適用可能となり、ＬＡＮ
等における網輻輳を回避することができる。Further, according to the invention of claim 3, in a virtual space sharing apparatus of star connection type which is advantageous when the number of connected terminals is large, when a video received from each terminal is distributed to other terminals, A user who calculates the distance in the virtual space and the line of sight between the user to whom the face image is distributed and other users based on the position information of each user's alter ego, and the user who has a close line of sight and a large line of sight Since the thinning process is applied so that the resolution and the number of frames are allocated in order from the face image of, the face image of the user closer to himself and closer to the line-of-sight direction without causing uniform deterioration in image quality. A good face image can be obtained and it can be economically applied to the public network.
It is possible to avoid network congestion in the above.
【００３０】さらに、請求項４の発明によれば、特に、
上記の顔映像の分配先利用者と他の利用者との仮想空間
内の距離と視線の一致度の計算、および、顔画像の画一
的でない分配のためになされる評価であってそれら両方
を合わせた評価が容易になる。Further, according to the invention of claim 4, in particular,
It is an evaluation made for the calculation of the degree of coincidence of the distance and the line of sight in the virtual space between the user to whom the face image is distributed and other users, and the evaluation performed for the non-uniform distribution of the face images, both of which are This makes it easier to evaluate.
【図１】本発明の一実施例における利用者間距離の分割
例を示す図FIG. 1 is a diagram showing an example of division of a distance between users according to an embodiment of the present invention.
【図２】上記実施例における利用者間視線一致度の分割
例を示す図FIG. 2 is a diagram showing an example of division of the line-of-sight coincidence degree between users in the above embodiment.
【図３】上記実施例における視野角度の計測例を示す図FIG. 3 is a diagram showing an example of measurement of a viewing angle in the above embodiment.
【図４】上記実施例の顔画像分配における利用者間優先
度づけの例を示す図FIG. 4 is a diagram showing an example of prioritization among users in face image distribution according to the above embodiment.
【図５】上記実施例における利用者の配置モデルの例を
示す図FIG. 5 is a diagram showing an example of a user placement model in the above embodiment.
【図６】上記実施例の仮想空間共有装置の装置構成例を
示す図FIG. 6 is a diagram showing a device configuration example of a virtual space sharing device of the above embodiment.
【図７】端末の論理的メッシュ接続例を示す図FIG. 7 is a diagram showing an example of a logical mesh connection of terminals.
【図８】端末の論理的スター接続例を示す図FIG. 8 is a diagram showing an example of a logical star connection of terminals.
【図９】端末の物理的メッシュ接続例を示す図FIG. 9 is a diagram showing an example of physical mesh connection of terminals.
【図１０】端末の物理的スター接続例を示す図FIG. 10 is a diagram showing an example of a physical star connection of terminals.
１０…仮想空間共有装置 １１，１２，１３…回線インタフェース部 １４…位置情報分配部 １５…距離計算部 １６…視線一致度計算部 １７…映像間引き率決定部 １８…映像間引き・分配部 １９，２３，２７…映像受信用内部バス ２０，２４，２８…映像送信用内部バス ２１，２５，２９…位置情報受信用内部バス ２２，２６，３０…位置情報送信用内部バス ３１…距離計算結果転送用内部バス ３２…視線一致度計算結果転送用内部バス ３３…映像間引き率通知用内部バス ３４，３５，３６…通信回線 10 ... Virtual space sharing device 11, 12, 13 ... Line interface unit 14 ... Position information distribution unit 15 ... Distance calculation unit 16 ... Line-of-sight coincidence calculation unit 17 ... Video thinning rate determination unit 18 ... Video thinning / distribution unit 19, 23 , 27 ... Video reception internal bus 20, 24, 28 ... Video transmission internal bus 21, 25, 29 ... Position information reception internal bus 22, 26, 30 ... Position information transmission internal bus 31 ... Distance calculation result transfer Internal bus 32 ... Internal bus for transfer of line-of-sight coincidence calculation result 33 ... Internal bus for notifying video thinning rate 34, 35, 36 ... Communication line
───────────────────────────────────────────────────── フロントページの続き (51)Int.Cl.6 識別記号 庁内整理番号 ＦＩ 技術表示箇所 Ｈ０４Ｌ 12/44 ─────────────────────────────────────────────────── ─── Continuation of the front page (51) Int.Cl. 6 Identification code Internal reference number FI technical display location H04L 12/44
Claims (4)
ような３次元仮想空間と当該３次元仮想空間内に他の利
用者の分身とを表現できる端末を複数台、通信網を介し
てスター型に接続し、前記端末から受信した利用者の顔
映像と前記３次元仮想空間内の位置情報とを他の端末に
分配することによって、複数の利用者が同一の３次元仮
想空間を遠隔地で共有できる３次元仮想空間共有装置で
あって、 端末から受信する各利用者の分身の位置情報から顔映像
の分配先利用者と他の利用者との３次元仮想空間内の距
離を計算する手段と、 前記距離が近い利用者の顔映像から順に解像度もしくは
フレーム数またはそれら両方を多く割り当てて前記顔映
像の分配先利用者の端末に送信する手段と、 を有することを特徴とする３次元仮想空間共有装置。1. A plurality of terminals capable of expressing a three-dimensional virtual space in which a user can freely move at will, and the altercations of other users in the three-dimensional virtual space, via a communication network. A plurality of users remotely connect to the same 3D virtual space by connecting them in a star shape and distributing the face image of the user received from the terminal and the position information in the 3D virtual space to other terminals. A 3D virtual space sharing device that can be shared on the ground, and calculates the distance in the 3D virtual space between the user to whom the face image is distributed and other users from the position information of each user's alter ego received from the terminal. And a means for allocating a large number of resolutions or frames or both in order from the face image of the user having the shortest distance and transmitting the resolution to the terminal of the user to whom the face image is distributed. Dimensional virtual space sharing device.
ような３次元仮想空間と当該３次元仮想空間内に他の利
用者の分身とを表現できる端末を複数台、通信網を介し
てスター型に接続し、前記端末から受信した利用者の顔
映像と前記３次元仮想空間内の位置情報とを他の端末に
分配することによって、複数の利用者が同一の３次元仮
想空間を遠隔地で共有できる３次元仮想空間共有装置で
あって、 端末から受信する各利用者の分身の位置情報から顔映像
の分配先利用者と他の利用者との３次元仮想空間内の視
線の一致度を計算する手段と、 前記視線の一致度が大きい利用者の顔映像から順に解像
度もしくはフレーム数またはそれら両方を多く割り当て
て前記顔映像の分配先利用者の端末に送信する手段と、 を有することを特徴とする３次元仮想空間共有装置。2. A plurality of terminals capable of expressing a three-dimensional virtual space in which a user can freely move at will, and the altercations of other users in the three-dimensional virtual space, via a communication network. A plurality of users remotely connect to the same 3D virtual space by connecting them in a star shape and distributing the face image of the user received from the terminal and the position information in the 3D virtual space to other terminals. A three-dimensional virtual space sharing device that can be shared on the ground, and the line-of-sight match in the three-dimensional virtual space between the user to whom the face image is distributed and other users based on the position information of each user's alter ego received from the terminal. A means for calculating the degree, and a means for allocating a large number of resolutions or the number of frames or both in order from the face image of the user having a high degree of coincidence of the line of sight, and transmitting it to the terminal of the user to whom the face image is distributed. 3D characterized by Virtual space sharing device.
ような３次元仮想空間と当該３次元仮想空間内に他の利
用者の分身とを表現できる端末を複数台、通信網を介し
てスター型に接続し、前記端末から受信した利用者の顔
映像と前記３次元仮想空間内の位置情報とを他の端末に
分配することによって、複数の利用者が同一の３次元仮
想空間を遠隔地で共有できる３次元仮想空間共有装置で
あって、 端末から受信する各利用者の分身の位置情報から顔映像
の分配先利用者と他の利用者との３次元仮想空間内の距
離と視線の一致度を計算する手段と、 前記距離と視線の一致度の両方を評価してその評価が高
い利用者の顔映像から順に解像度もしくはフレーム数ま
たはそれら両方を多く割り当てて前記顔映像の分配先利
用者の端末に送信する手段と、 を有することを特徴とする３次元仮想空間共有装置。3. A plurality of terminals capable of expressing a three-dimensional virtual space in which a user can freely move at will, and the altercations of other users in the three-dimensional virtual space, via a communication network. A plurality of users remotely connect to the same 3D virtual space by connecting them in a star shape and distributing the face image of the user received from the terminal and the position information in the 3D virtual space to other terminals. A three-dimensional virtual space sharing device that can be shared on the ground, and the distance and line of sight in the three-dimensional virtual space between the user to whom the face image is distributed and other users based on the position information of each user's alter ego received from the terminal. Means for calculating the degree of coincidence, and the distribution destination of the face image by allocating the resolution or the number of frames or both of them in order from the face image of the user who evaluates both the distance and the line-of-sight coincidence degree and has a high evaluation. Means to send to user's terminal , 3-dimensional virtual space sharing apparatus characterized by having a.
において、送信する手段が、距離の評価値として該距離
に逆比例するような値を与え視線一致度の評価値として
視線の角度に逆比例するような値を与えそれらの評価値
の積が大きい利用者の顔映像から順に解像度もしくはフ
レーム数またはそれら両方を多く割り当てて顔映像の分
配先利用者の端末に送信するものであることを特徴とす
る３次元仮想空間共有装置。4. The three-dimensional virtual space sharing apparatus according to claim 3, wherein the means for transmitting gives a value that is inversely proportional to the distance as an evaluation value of the distance, and an angle of the line of sight as an evaluation value of the degree of line-of-sight matching. A value that is inversely proportional is given, and the resolution and / or the number of frames or both of them are assigned in order from the face image of the user having a large product of the evaluation values and transmitted to the terminal of the user to whom the face image is distributed. A three-dimensional virtual space sharing device characterized by:
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP06079994A JP3122576B2 (en) | 1994-04-19 | 1994-04-19 | 3D virtual space sharing device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP06079994A JP3122576B2 (en) | 1994-04-19 | 1994-04-19 | 3D virtual space sharing device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| JPH07288791A true JPH07288791A (en) | 1995-10-31 |
| JP3122576B2 JP3122576B2 (en) | 2001-01-09 |
Family
ID=13705863
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| JP06079994A Expired - Lifetime JP3122576B2 (en) | 1994-04-19 | 1994-04-19 | 3D virtual space sharing device |
Country Status (1)
| Country | Link |
|---|---|
| JP (1) | JP3122576B2 (en) |
Cited By (28)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6166727A (en) * | 1997-12-15 | 2000-12-26 | Mitsubishi Denki Kabushiki Kaisha | Virtual three dimensional space sharing system for a wide-area network environment |
| US6535232B1 (en) | 1998-03-18 | 2003-03-18 | Matsushita Electric Industrial Co., Ltd. | Device for controlling quality of reproduction of motion picture and method for controlling the same |
| JP2012230525A (en) * | 2011-04-26 | 2012-11-22 | Nippon Hoso Kyokai <Nhk> | Content management device, client terminal, content management program, and content generation program |
| WO2020090786A1 (en) * | 2018-10-31 | 2020-05-07 | 株式会社ドワンゴ | Avatar display system in virtual space, avatar display method in virtual space, and computer program |
| US10952006B1 (en) | 2020-10-20 | 2021-03-16 | Katmai Tech Holdings LLC | Adjusting relative left-right sound to provide sense of an avatar's position in a virtual space, and applications thereof |
| US10979672B1 (en) | 2020-10-20 | 2021-04-13 | Katmai Tech Holdings LLC | Web-based videoconference virtual environment with navigable avatars, and applications thereof |
| US11070768B1 (en) | 2020-10-20 | 2021-07-20 | Katmai Tech Holdings LLC | Volume areas in a three-dimensional virtual conference space, and applications thereof |
| US11076128B1 (en) | 2020-10-20 | 2021-07-27 | Katmai Tech Holdings LLC | Determining video stream quality based on relative position in a virtual space, and applications thereof |
| US11095857B1 (en) | 2020-10-20 | 2021-08-17 | Katmai Tech Holdings LLC | Presenter mode in a three-dimensional virtual conference space, and applications thereof |
| US11184362B1 (en) | 2021-05-06 | 2021-11-23 | Katmai Tech Holdings LLC | Securing private audio in a virtual conference, and applications thereof |
| WO2022153568A1 (en) * | 2021-01-12 | 2022-07-21 | ソニーグループ株式会社 | Server device and method for controlling network |
| US11457178B2 (en) | 2020-10-20 | 2022-09-27 | Katmai Tech Inc. | Three-dimensional modeling inside a virtual video conferencing environment with a navigable avatar, and applications thereof |
| US11562531B1 (en) | 2022-07-28 | 2023-01-24 | Katmai Tech Inc. | Cascading shadow maps in areas of a three-dimensional environment |
| US11593989B1 (en) | 2022-07-28 | 2023-02-28 | Katmai Tech Inc. | Efficient shadows for alpha-mapped models |
| US11651108B1 (en) | 2022-07-20 | 2023-05-16 | Katmai Tech Inc. | Time access control in virtual environment application |
| US11682164B1 (en) | 2022-07-28 | 2023-06-20 | Katmai Tech Inc. | Sampling shadow maps at an offset |
| US11700354B1 (en) | 2022-07-21 | 2023-07-11 | Katmai Tech Inc. | Resituating avatars in a virtual environment |
| US11704864B1 (en) | 2022-07-28 | 2023-07-18 | Katmai Tech Inc. | Static rendering for a combination of background and foreground objects |
| US11711494B1 (en) | 2022-07-28 | 2023-07-25 | Katmai Tech Inc. | Automatic instancing for efficient rendering of three-dimensional virtual environment |
| US11741664B1 (en) | 2022-07-21 | 2023-08-29 | Katmai Tech Inc. | Resituating virtual cameras and avatars in a virtual environment |
| US11743430B2 (en) | 2021-05-06 | 2023-08-29 | Katmai Tech Inc. | Providing awareness of who can hear audio in a virtual conference, and applications thereof |
| US11748939B1 (en) | 2022-09-13 | 2023-09-05 | Katmai Tech Inc. | Selecting a point to navigate video avatars in a three-dimensional environment |
| US11776203B1 (en) | 2022-07-28 | 2023-10-03 | Katmai Tech Inc. | Volumetric scattering effect in a three-dimensional virtual environment with navigable video avatars |
| US11876630B1 (en) | 2022-07-20 | 2024-01-16 | Katmai Tech Inc. | Architecture to control zones |
| US11928774B2 (en) | 2022-07-20 | 2024-03-12 | Katmai Tech Inc. | Multi-screen presentation in a virtual videoconferencing environment |
| US11956571B2 (en) | 2022-07-28 | 2024-04-09 | Katmai Tech Inc. | Scene freezing and unfreezing |
| US12009938B2 (en) | 2022-07-20 | 2024-06-11 | Katmai Tech Inc. | Access control in zones |
| US12022235B2 (en) | 2022-07-20 | 2024-06-25 | Katmai Tech Inc. | Using zones in a three-dimensional virtual environment for limiting audio and video |
-
1994
- 1994-04-19 JP JP06079994A patent/JP3122576B2/en not_active Expired - Lifetime
Cited By (32)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6166727A (en) * | 1997-12-15 | 2000-12-26 | Mitsubishi Denki Kabushiki Kaisha | Virtual three dimensional space sharing system for a wide-area network environment |
| US6535232B1 (en) | 1998-03-18 | 2003-03-18 | Matsushita Electric Industrial Co., Ltd. | Device for controlling quality of reproduction of motion picture and method for controlling the same |
| JP2012230525A (en) * | 2011-04-26 | 2012-11-22 | Nippon Hoso Kyokai <Nhk> | Content management device, client terminal, content management program, and content generation program |
| WO2020090786A1 (en) * | 2018-10-31 | 2020-05-07 | 株式会社ドワンゴ | Avatar display system in virtual space, avatar display method in virtual space, and computer program |
| JP2020091504A (en) * | 2018-10-31 | 2020-06-11 | 株式会社ドワンゴ | Avatar display system in virtual space, avatar display method in virtual space, and computer program |
| CN112424760A (en) * | 2018-10-31 | 2021-02-26 | 多玩国株式会社 | Virtual character display system in virtual space, virtual character display method in virtual space, and computer program |
| US11205293B2 (en) | 2018-10-31 | 2021-12-21 | Dwango Co., Ltd. | Avatar display system in virtual space, avatar display method in virtual space, and computer program |
| US10952006B1 (en) | 2020-10-20 | 2021-03-16 | Katmai Tech Holdings LLC | Adjusting relative left-right sound to provide sense of an avatar's position in a virtual space, and applications thereof |
| US11070768B1 (en) | 2020-10-20 | 2021-07-20 | Katmai Tech Holdings LLC | Volume areas in a three-dimensional virtual conference space, and applications thereof |
| US11076128B1 (en) | 2020-10-20 | 2021-07-27 | Katmai Tech Holdings LLC | Determining video stream quality based on relative position in a virtual space, and applications thereof |
| US11095857B1 (en) | 2020-10-20 | 2021-08-17 | Katmai Tech Holdings LLC | Presenter mode in a three-dimensional virtual conference space, and applications thereof |
| US10979672B1 (en) | 2020-10-20 | 2021-04-13 | Katmai Tech Holdings LLC | Web-based videoconference virtual environment with navigable avatars, and applications thereof |
| US11457178B2 (en) | 2020-10-20 | 2022-09-27 | Katmai Tech Inc. | Three-dimensional modeling inside a virtual video conferencing environment with a navigable avatar, and applications thereof |
| US11290688B1 (en) | 2020-10-20 | 2022-03-29 | Katmai Tech Holdings LLC | Web-based videoconference virtual environment with navigable avatars, and applications thereof |
| WO2022153568A1 (en) * | 2021-01-12 | 2022-07-21 | ソニーグループ株式会社 | Server device and method for controlling network |
| US11743430B2 (en) | 2021-05-06 | 2023-08-29 | Katmai Tech Inc. | Providing awareness of who can hear audio in a virtual conference, and applications thereof |
| US11184362B1 (en) | 2021-05-06 | 2021-11-23 | Katmai Tech Holdings LLC | Securing private audio in a virtual conference, and applications thereof |
| US11928774B2 (en) | 2022-07-20 | 2024-03-12 | Katmai Tech Inc. | Multi-screen presentation in a virtual videoconferencing environment |
| US12022235B2 (en) | 2022-07-20 | 2024-06-25 | Katmai Tech Inc. | Using zones in a three-dimensional virtual environment for limiting audio and video |
| US12009938B2 (en) | 2022-07-20 | 2024-06-11 | Katmai Tech Inc. | Access control in zones |
| US11876630B1 (en) | 2022-07-20 | 2024-01-16 | Katmai Tech Inc. | Architecture to control zones |
| US11651108B1 (en) | 2022-07-20 | 2023-05-16 | Katmai Tech Inc. | Time access control in virtual environment application |
| US11741664B1 (en) | 2022-07-21 | 2023-08-29 | Katmai Tech Inc. | Resituating virtual cameras and avatars in a virtual environment |
| US11700354B1 (en) | 2022-07-21 | 2023-07-11 | Katmai Tech Inc. | Resituating avatars in a virtual environment |
| US11704864B1 (en) | 2022-07-28 | 2023-07-18 | Katmai Tech Inc. | Static rendering for a combination of background and foreground objects |
| US11776203B1 (en) | 2022-07-28 | 2023-10-03 | Katmai Tech Inc. | Volumetric scattering effect in a three-dimensional virtual environment with navigable video avatars |
| US11711494B1 (en) | 2022-07-28 | 2023-07-25 | Katmai Tech Inc. | Automatic instancing for efficient rendering of three-dimensional virtual environment |
| US11562531B1 (en) | 2022-07-28 | 2023-01-24 | Katmai Tech Inc. | Cascading shadow maps in areas of a three-dimensional environment |
| US11956571B2 (en) | 2022-07-28 | 2024-04-09 | Katmai Tech Inc. | Scene freezing and unfreezing |
| US11593989B1 (en) | 2022-07-28 | 2023-02-28 | Katmai Tech Inc. | Efficient shadows for alpha-mapped models |
| US11682164B1 (en) | 2022-07-28 | 2023-06-20 | Katmai Tech Inc. | Sampling shadow maps at an offset |
| US11748939B1 (en) | 2022-09-13 | 2023-09-05 | Katmai Tech Inc. | Selecting a point to navigate video avatars in a three-dimensional environment |
Also Published As
| Publication number | Publication date |
|---|---|
| JP3122576B2 (en) | 2001-01-09 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP3122576B2 (en) | 3D virtual space sharing device | |
| CN106385587B (en) | Share the method, apparatus and system at virtual reality visual angle | |
| JPH11177628A (en) | Three-dimension virtual space common share system for broad area environment | |
| US6330022B1 (en) | Digital processing apparatus and method to support video conferencing in variable contexts | |
| CN109889855A (en) | Intelligent panoramic net cast networked shopping system and method based on mobile APP | |
| JPH10107895A (en) | Multi-media information service access | |
| JPS61117944A (en) | Synchronous method in multi-point communication system | |
| CN106604042A (en) | Panorama webcasting system and panorama webcasting method based on cloud server | |
| CN101953158A (en) | Methods and systems for optimized processing in a telepresence system for 360 degree video conferencing technical field | |
| JP3817020B2 (en) | Image generation method and apparatus in virtual space, and imaging apparatus | |
| JP3488096B2 (en) | Face image control method in three-dimensional shared virtual space communication service, three-dimensional shared virtual space communication device, and program recording medium therefor | |
| JPH0522722A (en) | Input/ouptup equipment for image communication | |
| US6738356B1 (en) | Object oriented video merging system | |
| JP3027793B2 (en) | Virtual space sharing device | |
| JPH1055257A (en) | Three-dimensional virtual space display method | |
| JP3193254B2 (en) | 3D virtual space sharing system | |
| US20050134682A1 (en) | Network based conference system | |
| CN115423916A (en) | XR (X-ray diffraction) technology-based immersive interactive live broadcast construction method, system and medium | |
| CN108200102A (en) | A kind of data safety based on screen character identification obtains system | |
| WO2019152038A1 (en) | Virtual window for teleconferencing | |
| JPH099222A (en) | Virtual space sharing system | |
| JP3257459B2 (en) | Shared virtual space simple two-dimensional interface realizing method, client system having the interface, and storage medium storing the interface program | |
| JP3449520B2 (en) | 3D virtual space display method | |
| TW202129363A (en) | Method and apparatus for realizing 3d display, and 3d display system | |
| JP3184028B2 (en) | People image display system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| FPAY | Renewal fee payment (event date is renewal date of database) |
Free format text: PAYMENT UNTIL: 20071020 Year of fee payment: 7 |
|
| FPAY | Renewal fee payment (event date is renewal date of database) |
Free format text: PAYMENT UNTIL: 20081020 Year of fee payment: 8 |
|
| FPAY | Renewal fee payment (event date is renewal date of database) |
Free format text: PAYMENT UNTIL: 20091020 Year of fee payment: 9 |
|
| FPAY | Renewal fee payment (event date is renewal date of database) |
Free format text: PAYMENT UNTIL: 20101020 Year of fee payment: 10 |
|
| FPAY | Renewal fee payment (event date is renewal date of database) |
Free format text: PAYMENT UNTIL: 20101020 Year of fee payment: 10 |
|
| FPAY | Renewal fee payment (event date is renewal date of database) |
Free format text: PAYMENT UNTIL: 20111020 Year of fee payment: 11 |
|
| FPAY | Renewal fee payment (event date is renewal date of database) |
Free format text: PAYMENT UNTIL: 20111020 Year of fee payment: 11 |
|
| FPAY | Renewal fee payment (event date is renewal date of database) |
Free format text: PAYMENT UNTIL: 20121020 Year of fee payment: 12 |
|
| FPAY | Renewal fee payment (event date is renewal date of database) |
Free format text: PAYMENT UNTIL: 20121020 Year of fee payment: 12 |
|
| FPAY | Renewal fee payment (event date is renewal date of database) |
Free format text: PAYMENT UNTIL: 20131020 Year of fee payment: 13 |
|
| S531 | Written request for registration of change of domicile |
Free format text: JAPANESE INTERMEDIATE CODE: R313531 |
|
| R350 | Written notification of registration of transfer |
Free format text: JAPANESE INTERMEDIATE CODE: R350 |
|
| EXPY | Cancellation because of completion of term |