EP2377314A1 - Method and device for communication by video conference - Google Patents
Method and device for communication by video conferenceInfo
- Publication number
- EP2377314A1 EP2377314A1 EP09803829A EP09803829A EP2377314A1 EP 2377314 A1 EP2377314 A1 EP 2377314A1 EP 09803829 A EP09803829 A EP 09803829A EP 09803829 A EP09803829 A EP 09803829A EP 2377314 A1 EP2377314 A1 EP 2377314A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- image
- user
- local
- local user
- remote
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/15—Conference systems
Definitions
- the present invention relates to videoconferencing communications.
- videoconferencing allows a local user to communicate by voice and view with at least one remote user.
- each user uses at least one screen that restores the image of the other user and a camera to capture his own image to the attention of the other user.
- the present invention provides a solution to this problem.
- It relates to a videoconferencing communication device between a local user and at least one remote user comprising a local screen capable of rendering the local user an image of the remote user and a local image sensor capable of capturing an image. from the local user to the remote user.
- the device furthermore comprises a local delaying device capable of applying to the image of the local user from the local image sensor a chosen delay, the local screen being able to restore the local user the image of the local user thus delayed so that the image of the local user thus delayed is restored locally at the same time as the image of the local user remotely restored.
- the negative impression of desynchronization is eliminated since the local user has locally his own image as it is rendered remotely, which allows it to implement a communication by videoconference of quality.
- the delay is calculated as a function of the technical characteristics of elements belonging to the group formed by the communication network, the coding of the images, the distance and the speed of propagation of the voice and the image, and / or depending on the transmission delay experienced.
- the delay is calculated according to the transmission delay back and forth between the local user and the remote user.
- the delay is calculated in real time, dynamically, continuously or at a given rate.
- the image is restored locally while taking into account the quality of the transmission, which makes it possible to locally dispose of its own image as it is rendered at a distance not only at the same time but also with the same quality which improves all the impression of immersion.
- the device further comprises a superposition member capable of superimposing the image of the local user thus delayed with the image of the local user without delay, which allows the local user to adapt its behavior according to the gap between the images of the local user with and without delay.
- the device further comprises a processor capable of converting into a visual or vibratory representation the sound echo existing in the transmission and / or the transmission delay of the sound between a local user and a remote user. This is an advantage also in audio conferencing.
- the subject of the present invention is also a method of communication by videoconference between a local user and at least one remote user, in which provision is made to equip the local user with a local screen able to restore the local user.
- the method further comprises the step of locally applying a selected delay to the local user image from the local image sensor, and returning the user to the user. local image of the local user thus delayed, so that the image of the local user thus delayed is restored locally at the same time as the image of the local user remotely restored.
- the remote user is provided with another communication device comprising a remote screen capable of rendering the remote user an image of the local user, a remote image sensor capable of capturing an image of the remote user to the attention of the local user and a remote delaying member adapted to apply a selected delay to the image of the remote user from the remote image sensor, and in which is restored to the remote user the image of the remote user thus delayed, so that the image of the remote user thus delayed and restored at the remote user at a given moment corresponds to the image of the remote user restored at the local user level at that instant.
- FIG. 1 shows schematically a video conferencing communication between two users distant from each other by a long distance according to the prior art
- FIG. 2 diagrammatically represents the videoconferencing communication of FIG. 1 in which a delay is applied to the image of the local user in accordance with the invention
- FIG. 3 illustrates in detail an alternative embodiment of the device according to the invention
- FIG. 4 is a flowchart illustrating the process according to the invention.
- FIG. 5 diagrammatically represents the videoconferencing communication of FIG. 2 in which the applied delay corresponds to the round trip delay between the users.
- a video-conference call is established between a local user 1 located on a site 2 and a remote user 3 located on a site 4 very far from the site 2, for example several thousand km.
- the videoconferencing communication is established between the local user 1 and several remote users 3.
- the videoconferencing communication is established using a communication device 5 whose processing means 10 are located here on the site. 2.
- the processing means 10 of the communication device 5 may be located on another site such as the site 4.
- the communication device 5 comprises a screen 7 adapted to restore to the local user 1, an image 13 of the remote user 3 with a delay D.
- the delay D is here a function of the communication network used, the coding of the images, the distance and the speed of propagation of the voice and the image between the two sites 2 and 4.
- the device 5 further comprises a camera 9 which is able to capture the image H of the local user 1 to the remote user 3.
- the screen 7 is also able to restore the image 11 of the local user 1 from the camera 9, at the reference time T.
- a screen 11 makes it possible to restore to the remote user 3 the image 11 of the local user coming from the communication device 5.
- the image 11 is restored with a delay D which is a function of the network of communication used, image coding, distance and speed of voice and image propagation between users.
- the screen 11 also restores the image of the remote user 3 captured by a camera 13 located on the site 4. This image 13 is restored via the device 5 at a time equal to T + D on the screen 7 and a time equal to T + 2D on the screen 11.
- the communication device of the prior art suffers from a relatively important desynchronization problem between the users. Indeed, the image of the local user 11 arrives at the remote user after a delay D which can be relatively long, without the local user being aware of the delay D. This results in a negative impression that the users do not speak in a natural and interactive way, which prevents quality communication between users.
- the device 5 further comprises a local delay member 12 adapted to apply to the image of the local user 11 from the local image sensor 9 a selected delay R.
- the local screen 7 then returns to the local user the image of the local user 11 thus delayed at time equal to T + R while the remote screen 11 restores to the remote user the image of the user local 11 at the time equal to T + R + D, where D is the communication delay between the two sites.
- the delay R is chosen so that the image of the local user 11 thus delayed is restored locally on the screen 7 at the same time as the image of the remote user restored locally.
- the communication device comprises on the site 2 a delaying element 14 able to apply to the image of the user 11 coming from the image sensor 9 a selected delay R1 and to the site 4, connected to the site 2 via a communication network 15, a delay member 16 adapted to apply to the image of the user 13 from the image sensor 13 a delay R2.
- the main steps of the videoconferencing communication method are as follows.
- step S1 the video acquisition is performed using the image sensors 9 and 13.
- step S2 the delay R and / or the delays R1 and R2 are estimated.
- the delay is estimated by measuring the time difference between when an image is sent from the local site to the remote site. For example, this measurement is performed on the Real-time Transport Protocol (RTP) packets and the clocks are synchronized with the Network Time Protocol (NTP) signal.
- RTP Real-time Transport Protocol
- NTP Network Time Protocol
- the delay is estimated by measuring the time difference between the time of sending and arrival of packets of a probe, for example according to the UDP (User Datagram Protocol) or ICMP (Internet Control Message Protocol) protocols.
- UDP User Datagram Protocol
- ICMP Internet Control Message Protocol
- the delay is calculated in real time, dynamically, continuously or at a given rate.
- step S3 the delays thus estimated are applied to the images acquired during step S1.
- the delay is applied by storing in memory the packets destined for the total screen for a duration corresponding to the transmission delay D.
- the delay is applied by modifying the time tags of the packets to be sent to the device decoding the images.
- the image is restored locally taking into account also the quality of the transmission (bit rate, error rate, etc.), which makes it possible to locally dispose of its own image as it is restored to distance not only at the same time but also with the same quality.
- step S4 the image display step is performed on the screens 7 and 11.
- the device further comprises a superposition member capable of superimposing on each screen 7 and 11 the image of the user thus delayed with the image of the user without delay, what allows the user to adapt his behavior according to the difference between the images of the user with and without delay.
- the device further comprises a processor capable of converting into a visual or vibratory representation the sound echo existing in the transmission and / or the transmission delay of the sound between a local user and a remote user.
- the images 11 and 13 restored on the screen 7 are synchronous and displayed at time equal to T + 2D.
- the images 11 and 13 restored on the screen 11 are synchronous and displayed at time equal to T + 2D.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Telephonic Communication Services (AREA)
Abstract
Description
Claims
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
FR0858422A FR2939592B1 (en) | 2008-12-10 | 2008-12-10 | METHOD AND DEVICE FOR VISIOCONFERENCE COMMUNICATION. |
PCT/FR2009/052474 WO2010067026A1 (en) | 2008-12-10 | 2009-12-10 | Method and device for communication by video conference |
Publications (1)
Publication Number | Publication Date |
---|---|
EP2377314A1 true EP2377314A1 (en) | 2011-10-19 |
Family
ID=40467030
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP09803829A Ceased EP2377314A1 (en) | 2008-12-10 | 2009-12-10 | Method and device for communication by video conference |
Country Status (7)
Country | Link |
---|---|
US (1) | US8681201B2 (en) |
EP (1) | EP2377314A1 (en) |
JP (1) | JP5295383B2 (en) |
KR (1) | KR101252399B1 (en) |
CN (1) | CN102246520B (en) |
FR (1) | FR2939592B1 (en) |
WO (1) | WO2010067026A1 (en) |
Families Citing this family (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2012195704A (en) * | 2011-03-15 | 2012-10-11 | Fujitsu Ltd | Synchronization control device, synchronization control method, and synchronization control program |
FR2984060A1 (en) * | 2011-12-12 | 2013-06-14 | France Telecom | Method for local restoration of video during e.g. video communication, between e.g. TV and receiver terminal, involves applying network disturbances to duplicated data stream and displaying video reconstructed from modified data stream |
FR2984058A1 (en) * | 2011-12-12 | 2013-06-14 | France Telecom | METHOD AND DEVICE FOR LOCAL VIDEO RESTITUTION DURING VISIOPHONIC COMMUNICATION |
FR2984059A1 (en) * | 2011-12-12 | 2013-06-14 | France Telecom | Method for local restoration of video locally acquired and transmitted by e.g. Internet Protocol network, during e.g. audio communication, between e.g. personal computer and TV, involves adapting video to be restored and displaying video |
US9100330B1 (en) * | 2012-07-13 | 2015-08-04 | Emc Corporation | Introduction of read delay or write delay in servers of a geographically distributed data processing system so that clients read up-to-date data |
GB2505924B (en) * | 2012-09-14 | 2014-08-13 | Richard George Hoptroff | Simultaneous data presentation mechanism |
US9300713B2 (en) | 2013-08-16 | 2016-03-29 | Qualcomm Incorporated | Clock synchronization for multi-processor/multi-chipset solution |
JP5909475B2 (en) * | 2013-10-09 | 2016-04-26 | 日本電信電話株式会社 | Remote dialogue apparatus and method |
KR20170028088A (en) | 2015-09-03 | 2017-03-13 | 주식회사 케이엠씨로보틱스 | Smart table apparatus for video tele-conference and medel house simulation |
Family Cites Families (14)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4010466A (en) * | 1975-08-04 | 1977-03-01 | Princeton Electronic Products, Inc. | Method and system of electronic image storage and display |
US6215515B1 (en) * | 1992-02-19 | 2001-04-10 | Netergy Networks, Inc. | Videocommunicating device with an on-screen telephone keypad user-interface method and arrangement |
JPH0916798A (en) * | 1995-07-03 | 1997-01-17 | Nippon Telegr & Teleph Corp <Ntt> | Multi-spot cooperative plotting support system |
US5949474A (en) * | 1997-12-31 | 1999-09-07 | At&T Corp | Videophone blocker |
US6292210B1 (en) * | 1997-12-31 | 2001-09-18 | At&T Corp. | Integrated remote control and phone user interface |
US6285405B1 (en) * | 1998-10-14 | 2001-09-04 | Vtel Corporation | System and method for synchronizing data signals |
GB0321083D0 (en) * | 2003-09-09 | 2003-10-08 | British Telecomm | Video communications method and system |
US7453829B2 (en) * | 2003-10-29 | 2008-11-18 | Tut Systems, Inc. | Method for conducting a video conference |
JP2007043227A (en) * | 2005-07-29 | 2007-02-15 | Sharp Corp | Communication apparatus and communication system |
JP4479650B2 (en) * | 2005-11-29 | 2010-06-09 | ソニー株式会社 | Communication system, terminal device and computer program |
JP4268976B2 (en) * | 2006-06-15 | 2009-05-27 | ジーイー・メディカル・システムズ・グローバル・テクノロジー・カンパニー・エルエルシー | Imaging device |
JP2008061060A (en) * | 2006-09-01 | 2008-03-13 | Matsushita Electric Ind Co Ltd | Conference system |
US8237764B1 (en) * | 2007-01-29 | 2012-08-07 | Vsee Lab, Inc. | Local video feedback for videoconferencing |
US8259156B2 (en) * | 2008-12-23 | 2012-09-04 | Sony Corporation | Videoconference arrangement |
-
2008
- 2008-12-10 FR FR0858422A patent/FR2939592B1/en not_active Expired - Fee Related
-
2009
- 2009-12-10 JP JP2011540174A patent/JP5295383B2/en not_active Expired - Fee Related
- 2009-12-10 EP EP09803829A patent/EP2377314A1/en not_active Ceased
- 2009-12-10 WO PCT/FR2009/052474 patent/WO2010067026A1/en active Application Filing
- 2009-12-10 US US13/128,166 patent/US8681201B2/en active Active
- 2009-12-10 CN CN200980149490.9A patent/CN102246520B/en not_active Expired - Fee Related
- 2009-12-10 KR KR1020117013158A patent/KR101252399B1/en not_active IP Right Cessation
Non-Patent Citations (2)
Title |
---|
None * |
See also references of WO2010067026A1 * |
Also Published As
Publication number | Publication date |
---|---|
WO2010067026A1 (en) | 2010-06-17 |
US20120127260A1 (en) | 2012-05-24 |
KR20110093880A (en) | 2011-08-18 |
KR101252399B1 (en) | 2013-04-08 |
CN102246520A (en) | 2011-11-16 |
FR2939592B1 (en) | 2011-04-08 |
FR2939592A1 (en) | 2010-06-11 |
JP5295383B2 (en) | 2013-09-18 |
JP2012511855A (en) | 2012-05-24 |
US8681201B2 (en) | 2014-03-25 |
CN102246520B (en) | 2014-11-05 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP2377314A1 (en) | Method and device for communication by video conference | |
EP3171589B1 (en) | Drone equipped with a video camera sending sequences of images corrected for the wobble effect | |
CN103139446B (en) | The video stabilization received | |
EP0342756B1 (en) | High definition emitting and receiving television system with a reduced data rate | |
EP0143010A1 (en) | Method and device for detecting moving television picture elements for digital data flow compression television systems with conditional replenishment | |
FR2946820A1 (en) | DATA TRANSMISSION METHOD AND ASSOCIATED DEVICE. | |
FR2852473A1 (en) | Remote video processing network control process for use in videophonic telecommunication, involves execution of modification command on video flow by video processing network before transmitting it to terminal e.g. server | |
EP2559218B1 (en) | Reception of a digital content in trick mode | |
FR3012279A1 (en) | MULTIPOINT DIFFUSION METHOD | |
FR2987213A1 (en) | VIDEO SYSTEM FOR REPRESENTING IMAGE DATA AND ITS APPLICATION METHOD | |
FR2638310A1 (en) | METHOD AND DEVICE FOR CONVERTING THE TEMPORAL RHYTHM OF HIGH-DEFINITION TELEVISION IMAGES, AND TELEVISION IMAGE DECODER COMPRISING SUCH A DEVICE | |
FR2978639A1 (en) | METHODS OF COMPRESSING AND DECOMPRESSING IMAGES | |
EP0690623A1 (en) | Method of and device for inserting asynchronous data into a digital signal | |
EP3721248A1 (en) | Processing of data of a video sequence in order to zoom on a speaker detected in the sequence | |
EP3350931B1 (en) | Optimised transmission of video data over a wireless network | |
EP0092276A1 (en) | Display system with interlaced television raster scanning, and digital oscilloscope comprising such a system | |
FR2806574A1 (en) | DEVICE FOR SYNCHRONIZING INTERACTIVE APPLICATIONS IN A TELEVISION RECEIVER | |
FR2805700A1 (en) | Video conference TV signal receiver having TV/camera/microphone inputs and telephone communications interface with internal mechanisms allowing TV camera and microphone signals to be viewed. | |
FR3075543A1 (en) | METHOD FOR DOWNLOADING A CHAIN FOR ZAPPING A DIGITAL CHAIN BASED ON USER BEHAVIOR | |
FR2848767A1 (en) | Video broadcasting signal time marking method for synchronizing video program with enriching function, involves generating marking signal when graphical unit in video sequence is detected, and associating signal with part of sequence | |
FR2945395A1 (en) | Data e.g. video data, transmitting method for allowing interaction between persons in building site and office, involves transmitting frame including header with information comprising specific bits indicating data types of respective bytes | |
EP0936801A1 (en) | Facsimile apparatus for retransmitting video images | |
EP0427576A1 (en) | Interpolator for a sub-sampling transmission system | |
FR2983996A1 (en) | Method for displaying portion of image on screen of display device in cell phone, involves displaying extracted image on screen of display device, and determining crop window based on position of observer relative to screen | |
FR2750279A1 (en) | METHOD AND DEVICE FOR MODIFYING THE FREQUENCY-FRAME OF A TELEVISION SIGNAL |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
17P | Request for examination filed |
Effective date: 20110711 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO SE SI SK SM TR |
|
DAX | Request for extension of the european patent (deleted) | ||
17Q | First examination report despatched |
Effective date: 20121128 |
|
111Z | Information provided on other rights and legal means of execution |
Free format text: AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO SE SI SK SM TR Effective date: 20130410 |
|
RAP1 | Party data changed (applicant data changed or rights of an application transferred) |
Owner name: ALCATEL LUCENT |
|
D11X | Information provided on other rights and legal means of execution (deleted) | ||
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R003 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE APPLICATION HAS BEEN REFUSED |
|
18R | Application refused |
Effective date: 20170930 |