WO2008043182A1 - Système de support pour un travail en collaboration - Google Patents

Système de support pour un travail en collaboration Download PDF

Info

Publication number
WO2008043182A1
WO2008043182A1 PCT/CA2007/001826 CA2007001826W WO2008043182A1 WO 2008043182 A1 WO2008043182 A1 WO 2008043182A1 CA 2007001826 W CA2007001826 W CA 2007001826W WO 2008043182 A1 WO2008043182 A1 WO 2008043182A1
Authority
WO
WIPO (PCT)
Prior art keywords
collaborative work
application
supporting
collaborative
collaboration
Prior art date
Application number
PCT/CA2007/001826
Other languages
English (en)
Other versions
WO2008043182A8 (fr
Inventor
Mohamed Cheriet
Pierre Dumas
Maarouf Saad
Louis Villardier
Saliah-Hassane Hamadou
Gilles Saint-Amant
Samir Hadjout
Original Assignee
Ets (Ecole De Technologie Superieure)
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from CA002563866A external-priority patent/CA2563866A1/fr
Application filed by Ets (Ecole De Technologie Superieure) filed Critical Ets (Ecole De Technologie Superieure)
Priority to CA2702509A priority Critical patent/CA2702509A1/fr
Publication of WO2008043182A1 publication Critical patent/WO2008043182A1/fr
Publication of WO2008043182A8 publication Critical patent/WO2008043182A8/fr

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00Data switching networks
    • H04L12/02Details
    • H04L12/16Arrangements for providing special services to substations
    • H04L12/18Arrangements for providing special services to substations for broadcast or conference, e.g. multicast
    • H04L12/1813Arrangements for providing special services to substations for broadcast or conference, e.g. multicast for computer conferences, e.g. chat rooms
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00Administration; Management
    • G06Q10/10Office automation; Time management
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/40Support for services or applications
    • H04L65/401Support for services or applications wherein the services involve a main real-time session and one or more additional parallel real-time or time sensitive sessions, e.g. white board sharing or spawning of a subconference
    • H04L65/4015Support for services or applications wherein the services involve a main real-time session and one or more additional parallel real-time or time sensitive sessions, e.g. white board sharing or spawning of a subconference where at least one of the additional parallel sessions is real time or time sensitive, e.g. white board sharing, collaboration or spawning of a subconference
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/14Systems for two-way working
    • H04N7/15Conference systems
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/40Support for services or applications
    • H04L65/403Arrangements for multi-party communication, e.g. for conferences
    • H04L65/4053Arrangements for multi-party communication, e.g. for conferences without floor control
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network
    • H04L67/104Peer-to-peer [P2P] networks
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/14Systems for two-way working
    • H04N7/15Conference systems
    • H04N7/157Conference systems defining a virtual conference space and using avatars or agents

Definitions

  • the present invention generally relates to a system for supporting collaborative work. More specifically, but not exclusively, the present invention is concerned with a multimodal/multi-sensorial integrated system that supports collaborative work using common tools and applications, whereby geographically-disseminated participants thereof can interact in real-time with each other.
  • a purpose of collaborative work and collaborative research is to support cost-effective creative solutions to complex collaborative problems that reduce risk, time and space constraints by means of intensive use of information and communication technologies.
  • Several client/server based products were developed for the collaboration work and are offered on the market.
  • there is a need for an improved system For example, there is a need for robustness and reliability of the system, a need for higher performance for real-time collaborative applications and for sharing expensive or non-accessible equipments, a need for higher quality of multimedia, a need for integration of different applications together, a need for adaptability of the system to changes, a need for more visibility of all the participants along with the services and objects to be shared.
  • the client/server based systems for collaborative work have a central failure point in the server.
  • P2P Peer-to-Peer
  • an object of the present invention is to provide a system for supporting collaborative work that is designed and structured and comprises features adapted in view of overcoming the above discussed drawbacks of the current systems.
  • the system for supporting collaborative work presented in the present invention allows for disseminated participants at remote sites to interact in real-time with each other through a fault tolerant network in a peer-to-peer configuration.
  • the system comprises: (i) a plurality of collaboration platforms having a layered architecture to support collaborative application such as conferencing, instant messaging, audio/video, shared whiteboards, shared data and files, collaborative browsing, application sharing, virtual laboratory application, slide show and audio/video stream sharing with annotation feature; and (ii) plurality of hardware platform and equipments consisting of: a workstation, a multimedia room equipped with a white board, cameras and videoconferencing devices, a projection screen with an associated video projector and a smartboard, a laboratory room and an adapted operating room comprising haptic device and remote machine such as a robot.
  • a system for supporting collaborative work for allowing disseminated participants to interact in real-time with each other through a network comprising: a plurality of collaboration platforms having a layered architecture to support at least one collaborative application and accessible by the disseminated participants at remote sites;
  • the layered architecture includes at least one layer for interconnecting the plurality of collaboration platforms through the network in a peer-to-peer configuration and wherein the plurality of collaboration platforms are so configured so that when a new collaboration platform interconnects with the plurality of collaboration platforms the new collaboration platform inherits the at least one collaborative application.
  • the system for supporting collaborative includes an annotation feature allowing the disseminated participants to annotate the at least one of the collaborative applications.
  • Figures 1a and 1b are block diagrams schematically illustrating a system for supporting collaborative work, in accordance with an illustrative embodiment of the present invention
  • Figure 2 is a schematic diagram illustrating a collaboration platform architecture of the system for supporting collaborative work of Figures 1a and 1 b;
  • Figure 3 is a block diagram schematically illustrating a deployment example of the infrastructure of the system for supporting collaborative work of Figures 1a and 1 b;
  • Figure 4 is a schematic diagram illustrating a plurality of devices found in a multimedia room of the system for supporting collaborative work of Figures 1a and 1 b;
  • Figure 5 is a block diagram schematically illustrating a system for supporting collaborative work comprising a laboratory room, in accordance with another illustrative embodiment of the present invention.
  • Figure 6 is a flow chart illustrating a method used for integrating dynamically new objects or applications in the system for supporting collaborative work of Figure 5;
  • Figure 7 is a block diagram schematically illustrating an application of the system for supporting collaborative work of Figures 1a and 1 b for real-time telesurgery and telementoring;
  • Figure 8 is an image of a graphical participant interface of the system for supporting collaborative work of Figures 1a and 1 b;
  • Figure 9 is a block diagram schematically illustrating an implementation of the annotation feature, which enriches the system for supporting collaborative work of Figures 1a and 1b.
  • the present invention is generally concerned with a system for supporting collaborative work.
  • the system has an architecture that encompasses a plurality of layers, the integration of which results in a multimodal environment having the ability of gathering and integrating multi- sensorial information from a plurality of remote sites, this being described as "telepresence".
  • the system can comprise several collaborative tools and applications, such as conferencing, instant messaging, chatting, audio/video, shared whiteboards, shared data and files, collaborative browsing, slide show, audio/video stream sharing, application sharing, eDrive, a multimedia, virtual laboratory and a virtual operating room.
  • the system for supporting collaborative work also comprises a broadband fault tolerant network that can connect together several multimedia rooms, intended for sending to other remote sites, receiving from other remote sites and processing multi-sensorial information.
  • the system can have recourse to various video, audio and/or haptic human- machine interfaces; it can make use of various media, such as text, voice, sound, touch feeling, graphics, gesture and motion, handwriting and shared applications.
  • the system for supporting collaborative work encompasses several collaborative tools and applications, all of which being integrated in the same work space. Moreover, its distributed architecture makes it possible to integrate new tools or applications thereinto.
  • the system is synchronous, which means that the course of the pertaining events is governed by a common phenomenon, such as a clock.
  • This synchronicity property allows the participants of a collaborative work session to simultaneously interact with each other; a collaborative work session is characterized by a group of participants using a set of collaborative tools and/or applications during a fixed time frame to manipulate or produce artifacts, i.e. databases, documents, files, etc.
  • the system for supporting collaborative work offers a multimedia support to receive or deliver information under various forms, particularly but not exclusively under visual, video, audio and haptic forms.
  • Participants can connect to the system either via the Internet, or by any other network, including an intranet or a local network.
  • the system for supporting collaborative work may comprise one or a plurality of multimedia rooms, a multimedia room being (i) defined as a physical site from where one or many participants can access the system, and (ii) potentially equipped with a plurality of interfaces, i.e. video interface, audio interface, haptic interface, etc.
  • the system for supporting collaborative work might also comprise a remote facility, the functions of which can be remotely controlled by the participants.
  • this remote facility can be a laboratory, or a medical or a surgical room.
  • the system for supporting collaborative work might include a specially dedicated multimedia room from where participants can enter the collaborative work session for learning purposes, this being described as "telementoring".
  • the system for supporting collaborative work makes intensive use of, for example, the multimodal perceptual processes, the transmission of information via broadband networks, the integration of multi-sensor interfaces to a multiple interaction network for receiving and transmitting both data and control signals, for which the applications are suitable to enhance collaborative work, for example collaborative research.
  • the collaborative environment 10 Rather than using a conventional Client/Server architecture, the collaborative environment 10, as illustrated in Figures 1a and 1 b, has an open overlay self-scaling network architecture based on the distributed Peer-to-Peer (P2P) computing paradigm, which integrates various perceptual modes of information. It enables remote access, as well as the direct sharing of resources, responsibilities and services in synchronous/asynchronous manner among geographically disseminated participants such as 22 ( Figure 1 b).
  • P2P Peer-to-Peer
  • the system for supporting collaborative work 10 may be used in various contexts that need to support synchronous collaborative work, such as eLearning, eCommerce, eHealth (eDiagnostics, Teleoperation and telementoring), eDesign, eGoverance, eBusiness, eBanking, eProcurement, eNegotiation, etc.
  • Figure 1a is an illustration of a system for supporting collaborative work 10 that comprises six geographically separate sites, numbered site 1 to site 6, linked together by a network 12.
  • a participant 22 (as shown in Figure 1 b) can join a collaborative work session either from a multimedia room 14a-14c or from a work station 16a-16b.
  • the system for supporting collaborative work 10 also comprises a laboratory room 18, the equipments of which can be remotely controlled by any participant 22 at sites 1-4 or 6.
  • the network 12 is any network that links together the six sites and may comprise, for instance, Internet links, intranet links, local networks, private networks, etc.
  • Figure 1 b is a more detailed view of a system for supporting collaborative work 10 comprising sites 1-5, wherein each site 1 to 3 comprises a collaboration platform 20. Participants 22 interact with the system for supporting collaborative work 10 either through a multimedia room 14, as in sites 1 and 2, or through a workstation 16 as in site 3.
  • site 3 is linked to the network 12 through the Internet.
  • the system for supporting collaborative work 10 includes a laboratory room 18 at site 4, which comprises laboratory servers (not shown), and a multicast video bridge 24 for managing all the cameras (not shown) that may be disseminated at the various sites 1-4.
  • the collaboration platform 20 comprises a multi-layer architecture, comprising the following layers:
  • the participant interface layer 26 represents various participant interfaces; it is the collections of graphical objects, i.e. menus, commands, controls, etc., that enable participants 22 to interact with the collaboration platform 20 and to use the various provided collaborative tools.
  • the participant interface 102 as illustrated in Figure 8, may use a relaxed WYSIWIS (What You See Is What I See) interface metaphor and is characterized by optimal management of the displaying space, flexibility in the presentation and ease of access to collaborative services and functionalities.
  • the application layer 28 constitutes the bulk of the collaboration platform 20 and includes the collection of applicative logics. It uses the services of the middleware layer 30 to build collaborative tools, toolkits and applications, in order to satisfy the needs of the participants 22 in terms of communications, data sharing and collaboration. It may comprise the following key components:
  • a whiteboard tool which is a collaborative drawing tool using a vector- based representation for offering a drawing space of several pages and a graphic toolbox; • an eDrive tool or virtual drive enabling data, file and audio/video stream sharing and exchanging (downloading);
  • an audio/video stream sharing tool with an annotation feature (pointing and highlighting a specific region of the running video) and enabling collaborative control (moving, zooming, etc) of a remote camera.
  • the middleware layer 30 provides the required implementations to develop a distributed system that ensures communication between the participating processes through a duplicated object system (DoS) architecture.
  • DoS duplicated object system
  • a duplicated object is a type of decentralized, distributed object supporting the above enumerated collaborative tools, toolkits and applications, in order to satisfy the needs of the participants 22 in terms of communications, data sharing and collaboration. These objects contain datasets describing all the network-relevant information about a tool, toolkit or application.
  • a duplicated object can be either a duplication master, which is the controlling instance of the object, or a duplica, which is a complete copy of the master object.
  • the middleware layer 30 also provides a set of services such as coherence, session, collection of specialized network services, all of which allow to facilitate the development and implementation of collaborative functionalities of the application layer 28. Finally, the middleware layer 30 provides a distributed clock that ensures temporal order of information during communication processes.
  • the network layer 32 takes in charge all functions related to communication networks, including communication and routing protocols, bandwidth management, and quality of service.
  • This layer 32 is characterized by the following key elements: an automatic message routing mechanism which can allow a peer to join another peer via a third peer, a configurable transport protocol, a hierarchical and cascading message passing model based on multicast groups, and message bundling techniques.
  • the application layer 28 allows control sharing
  • the annotation feature which enriches collaborative tools such as the visioning tool, application sharing tool and an audio/video stream sharing tool by allowing pointing, highlighting and drawing over a presentation or a running video, may be implemented according to the schematic diagram of Figure 9.
  • a transparent GUI control 132 is superposed over the application automation GUI control 136.
  • the graphical annotations i.e. pointers, highlights, drawings, etc.
  • the graphical annotations are translated to duplicated objects 134 at the application layer 28 and published over session in a separate channel, i.e. published over Net-Z.
  • a synchronization is performed between the duplicated objects 134 and the automation objects (data and user commands) 138.
  • the shared content for example a presentation
  • Net- Z refers to the Net-Z middleware of Quazal inc., which was originally dedicated to the development of multi-participant games.
  • the collaboration platform 20 may use, for example, the Net-Z middleware from Quazal inc. for duplicating objects and ensuring that all participants 22 of a collaborative work session have, on their respective work station, a copy of all objects that are in use. Every copy of a duplicated object is made from the same master copy so as to (i) ensure coherence, (ii) maintain the pertaining functionalities and (iii) control the object's instances.
  • the collaboration platform 20 is decentralized and symmetric, since it is based on a peer-to-peer (P2P) distributed architecture, and comprises a broadband network 12 that can connect a plurality of laboratory rooms 18 or multimedia rooms 14 together.
  • P2P peer-to-peer
  • the collaboration platform 20 aggregates various aspects of multimodal perceptual information in order to support collaborative work in different fields of activity.
  • This P2P distributed architecture means that the collaboration platform 20 does not depend on a central server; rather, the application components and the responsibilities of maintaining network services are distributed across multiple work stations. This renders the collaboration platform 20 more robust and tolerant to failure or disconnection of any work station within the collaborative work session. In the occurrence of a failure or disconnection, the duplication master objects will migrate to another station and let the collaborative work session to seamlessly carry on.
  • FIG 3 An example of deployment of the infrastructure of the collaboration platform 20 is illustrated. Each site 1-5 is connected to the network 12 with GigaEthernet links 40 and via a switch 42. Of course, other types of connections can be used and would be obvious to a person of ordinary skill in the art. For example, site 4 is connected to the switch 42 via an optical carrier 44. Also, a testbed network 46 can be present and connected to the network 12 for monitoring and performance analysis purposes.
  • one of the sites 1-5 will include a multicast video bridge (not shown) for managing all the cameras.
  • the multimedia room 14 can comprise and integrate into the collaborative environment 10 a plurality of features, the information of all of which can be accessed by the participants 22.
  • the features can comprise, amongst others, whiteboards 50, smart boards (handwritten recognition acquisition and understanding) 52, screens 54, cameras 56, haptic devices 58, databases and applications, etc. Those features are schematically illustrated in Figure 4.
  • the multimedia room 14 can also be equipped with high- quality accessories and devices enabling intensive computing, high-definition (HD) visualization, 2D and 3D image processing (recognition), group communication, and videoconference services for multiple participants 22. Thanks to the high degree of integration of such intelligent interactive devices, such multimedia rooms 14 are innovative in the field of collaborative work. For instance, during teleconferencing, intelligent cameras 56 are autonomously guided to track the person 60 who is currently speaking by putting him continuously on its vision field. The speaker 60 may create his drawing directly on a shared whiteboard 50 by using the smart board 52 which provides handwriting recognition acquisition and understanding.
  • HD high-definition
  • 2D and 3D image processing recognition
  • group communication group communication
  • videoconference services for multiple participants 22. Thanks to the high degree of integration of such intelligent interactive devices, such multimedia rooms 14 are innovative in the field of collaborative work. For instance, during teleconferencing, intelligent cameras 56 are autonomously guided to track the person 60 who is currently speaking by putting him continuously on its vision field. The speaker 60 may create his drawing directly on a shared whiteboard 50
  • a remote machine not shown
  • the graphical participant interface 102 may also be projected to produce a wide main screen 54, having a large high definition (HD) format, by means of a projector assembly 64.
  • a digitization center (not shown in Figure 4) for storing, distributing and sharing digital data.
  • the collaboration platform 20 may comprise one or several haptic devices 58.
  • a haptic device 58 is a technology which interfaces with the participant 22 through the sense of touch. By enabling a force-feedback output, a haptic device 58 makes possible to actuate teleoperators.
  • the haptic devices 58 may be coupled to stereoscopic spectacles in order to perceive depth of field and, in this manner, add an extra information parameter that helps the participant 22 to properly perform a telemanipulation.
  • haptic device 58 Two examples of use of an haptic device 58 are (i) conducting an experiment in a remote laboratory room 18 and (ii) performing a surgery on a remote patient.
  • a haptic device 58 may comprise Phantom DesktopTM used in connection with two pantins and a universal joint wrist, e.g. a Phantom 1.5ATM and a Freedom 6STM.
  • haptic devices 58 allow for controlling remote machines or robots.
  • the haptic devices 58 enable to start experimentations using different robots or to perform simulations of different machines.
  • the haptic devices 58 allow a surgeon to manipulate surgical robots and instruments.
  • the collaboration platform 20 may encompass a laboratory room 18, which comprises a set of collaborative applications for performing experiments on remote equipments that are actuated by teleoperators.
  • the laboratory room 18 allows to remotely perform interactive experiments, possibly by using haptic devices 58.
  • it is also suitable for distant learning, as it enables many geographically disseminated participants 22 to simultaneously conduct an experiment, to get and share the results thereof and, possibly, to visualize in real-time a 3D video of the experiment.
  • the laboratory room 18 also offers the possibility to simulate an experiment from relevant models and databases.
  • the laboratory room 18 can also be equipped with HD visualization and high quality sound systems such as those found in the multimedia rooms 14.
  • FIG. 5 a collaborative environment comprising a laboratory room 18 is shown.
  • a plurality of sites 1-6 each of which comprising a collaboration platform 20 and either a multimedia room 14 or workstation 16, as well as the laboratory room 18 are connected to the network 12.
  • the network 12 can be a private network, shared by a group of universities and linking them together, for example.
  • the laboratory room 18 comprises a virtual laboratory application 70 and a virtual laboratory application using LabVIEWTM 72.
  • the virtual laboratory application 70 is completely integrated to the collaboration platform 20 and includes a machine 76 or a robot, connected to a data acquisition device 78 or card in order to monitor and save the results from experimentations. Those results are accessible at site 6 and can be shared with any participant 22 involved and connected to a collaborative work session.
  • the laboratory room 18 also comprises a virtual laboratory application using LabVIEWTM 72.
  • This virtual laboratory application 72 comprises a LabVIEWTM server 74, linked to a data acquisition device 78 or card, which is connected to a machine 76 to obtain data from that machine 76. Also, a machine 76 can be directly connected to the LabVIEWTM server 74 for data processing.
  • the LabVIEWTM server 74 is linked to the network 12 so that it is accessible to all the participants 22 located at sites 1-6. Therefore, the disseminated participants 22 can perform on-line remote experimentations and share their results.
  • one of the sites 1-3 includes a multicast video bridge (not shown) for managing all the cameras.
  • collaboration platform 20 allows for adding new virtual laboratory applications 70 or 72 during a collaborative work session.
  • FIG. 6 there is shown a flow diagram of an illustrative example of a process 80 executed when adding new virtual laboratory applications 72 during a collaborative work session.
  • the steps of the process 80 are indicated by blocks 82 to 88.
  • the process 80 starts at block 82 where a participant 22 can create a new virtual laboratory duplicated object, which contains description information (name, type, version, etc.) and the address of the laboratory application server 74 (LabVIEWTM server for example). Then, at block 84, the collaboration platform 20 publishes the duplicated object over Net-Z and activates remotely, at block 86, the virtual laboratory application 72 within LabVIEWTM. Following which, at block 88, the new virtual laboratory application 72 is opened within the shared workspace dedicated to the virtual laboratory tool(s).
  • a new virtual laboratory application 72 is developed and deployed within the LabVIEWTM development environment without affecting the collaboration platform 20.
  • the developers can produce new shared remote control applications, which are called virtual laboratory, in accordance to their particular needs and use in a collaborative work session.
  • Telemedicine One embodiment of the present invention is its use for performing telemedicine. More specifically, the present invention can be used for performing real-time medical or surgical interventions at distance, for diagnosis or curative purposes, whether or not in a telementoring context.
  • Figure 7 illustrates a telesurgery environment.
  • a surgeon 90 is located in a medically-adapted multimedia room 14 with a collaboration platform 20 at site 2 while a distant patient 92 is located in a remote, adapted operating room 94, which incorporates the features of a multimedia room 14 and a collaboration platform 20, at site 1.
  • One or several assistants 96 may also be present in the adapted operating room 94 to assist the surgeon 90 in his work.
  • the medically-adapted multimedia room 14 and the adapted operating room 94 are both equipped, particularly but not exclusively, with two- way cameras 56 and haptic devices 58 (see Figure 4).
  • the cameras 56 allow (i) the surgeon 90 and the assistant(s) 96 to see each other and (ii) the surgeon 90 to see the distant patient 92, especially the area on which the surgery is performed.
  • the haptic devices 58 allow the surgeon 90 to receive a touch feeling feedback from the contact of the instruments he manipulates. For example, this feedback to the surgeon 90 can be the pressure exerted by the patient's body on an instrument the surgeon 90 manipulates thereon or therein.
  • the surgeon 90 performs the surgery on the distant patient 92 via a remote robot 98 placed in the adapted operating room 94.
  • the surgeon 90 uses a laboratory room 18 comprising a virtual laboratory application 72 and the server 74 from LabVIEWTM, and the surgeon 90 interacts with the robot manipulator with embedded camera 98 via the haptic devices 58 and a data acquisition device 78 or card, which is connected to the LabVIEWTM server 74.
  • the camera embedded in the robot manipulator 98 captures a detailed video of the operation which is displayed in high resolution in a main projection screen such as the screen 54 in Figure 4.
  • Audio/video tools facilitate the communications between the surgeon 90 and the assistant(s) 96.
  • resident students 100 located at remote site 3 comprising medically-adapted multimedia room 14, a laboratory room 18 and a collaboration platform 20, may participate to the operation session for the purpose of telementoring and learning.
  • several surgeons 90 may collaborate together and teleoperate on the same patient 92.
  • the dedicated broadband network 12 guaranties secure real-time transmission and an acceptable latency for this kind of task. High standards of communication security and fast response which are needed in a telesurgery context are provided.
  • one of the sites 1-3 includes a multicast video bridge (not shown) for managing all the cameras.
  • FIG 8 there is shown the graphical interface 102 of the collaboration platform 20 as seen by a participant 22.
  • a plurality of applications are integrated into one single window or workspace.
  • the space 104 allows for displaying all the connected and disseminated participants 22.
  • the space 106 shows the available sharing documents from different participants 22.
  • the space 108 allows for chatting and instant messaging to all the connected participants 22.
  • the space 110 is a whiteboard for drawing, writing, taking notes, calculating, etc.
  • the space 112 allows participants 22 to browse the web and do searches.
  • the spaces 114 and 116 allow for displaying pictures and videos from different machines in remote virtual loboratory rooms 18. They also allow for displaying the results of experimentations via graphs or tables.
  • the space 118 allows the remote control, sharing and annotation of applications such as, for example, MS-Office or other applications.
  • a participant 22 added annotations 119, which may be viewed by all other participants 22.
  • the space 120 it allows audio/video streaming with an annotation feature (pointing and highlighting a specific region of the running video) and enabling collaborative control (moving, zooming, etc) of a remote camera.
  • a menu bar 122 shows all the different commands available to the participants 22.
  • the collaboration platform 20 features the group awareness functionality.
  • Group awareness is defined as enabling each participant 22 to a collaborative work session to perceive the actions, activities and states of the other participants 22. Awareness is also sometimes referred to as "ubiquity”.
  • Group awareness management is made possible by functionalities through a dedicated space for awareness information comprising parameters such as presence information, identification, localization, availability, activity level and history.
  • Figure 8 which shows a graphical interface 102 to the collaborative work collaboration platform 20
  • the space 104 displays the name of all the currently connected participants 22, along with their respective activities and tools, which are available to be shared.
  • the space 106 allows each participant 22 to know who wants to share what. It is to be understood that an administrator of the collaboration platform 20 may restrict the use and/or control of certain tools to specific participants 22.
  • inheritance allows a late-comer participant 22 to join and inherit all shared objects or collaborative objects that have been created or produced during an on-going collaborative work session. Moreover, the collaborative work session is not affected if its initiator disconnects therefrom.
  • the inheritance property is implemented by using the Net-Z middleware of Quazal inc., which was originally dedicated to the development of multi-participant games.
  • the middleware 30 provides a set of specialized services, such as coherence synchronization, session and implementation, which facilitate the development and implementation of collaborative functionalities for the application layer 28.
  • the middleware layer 30 makes it possible for the collaboration platform 20 to inherit the performance and properties thereof, such as object duplication and migration, duplicated spaces, data extrapolation, remote procedure calls (RPC), etc.
  • middleware layer 30 allows the collaboration platform 20 to inherit the following characteristics: a descriptive approach with a high level of abstraction, fault tolerance, reliability, flexibility (supporting P2P, Client/Server, and Hybrid architectures), interoperability (it can easily interoperate with other middleware or software components or systems), data integrity (via data encryption), use of compression, ability to evolve (1024 available classes and 4 millions instantiations) and ability to perform load balancing.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Business, Economics & Management (AREA)
  • Human Resources & Organizations (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Strategic Management (AREA)
  • Entrepreneurship & Innovation (AREA)
  • Economics (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Marketing (AREA)
  • Operations Research (AREA)
  • Quality & Reliability (AREA)
  • Tourism & Hospitality (AREA)
  • Data Mining & Analysis (AREA)
  • General Business, Economics & Management (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Information Transfer Between Computers (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Computer And Data Communications (AREA)
  • Telephonic Communication Services (AREA)

Abstract

La présente invention concerne un système de support d'un travail collaboratif permettant à des participants dispersés dans des sites distants d'interagir en temps réel les uns avec les autres par un réseau tolérant aux pannes dans une configuration sans serveur. Le système comprend : (i) une pluralité de plates-formes de collaboration ayant une architecture en couches pour prendre en charge l'application collaborative, comme une application de conférence, de messagerie instantanée, de son et de vidéo, de tableau blanc partagé, de fichiers et données partagés, de navigation collaborative, de partage d'applications, de laboratoire virtuel, de diaporama et de partage de flux audio/vidéo avec fonction d'annotation, (ii) une pluralité de plates-formes matérielles et d'équipements composés de : un poste de travail, une salle multimédia équipée d'un tableau blanc, de caméras et d'appareils de vidéoconférence, un écran de projection avec un projecteur vidéo associé et un tableau de commande intelligent, une salle de laboratoire et une salle fonctionnelle adaptée comprenant un dispositif tactile et une machine distante comme un robot.
PCT/CA2007/001826 2006-10-13 2007-10-15 Système de support pour un travail en collaboration WO2008043182A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CA2702509A CA2702509A1 (fr) 2006-10-13 2007-10-15 Systeme de support pour un travail en collaboration

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US85130406P 2006-10-13 2006-10-13
CA002563866A CA2563866A1 (fr) 2006-10-13 2006-10-13 Systeme pour soutenir le travail de collaboration
US60/851,304 2006-10-13
CA2,563,866 2006-10-13

Publications (2)

Publication Number Publication Date
WO2008043182A1 true WO2008043182A1 (fr) 2008-04-17
WO2008043182A8 WO2008043182A8 (fr) 2008-07-03

Family

ID=39282380

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CA2007/001826 WO2008043182A1 (fr) 2006-10-13 2007-10-15 Système de support pour un travail en collaboration

Country Status (2)

Country Link
CA (1) CA2702509A1 (fr)
WO (1) WO2008043182A1 (fr)

Cited By (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102008056917A1 (de) * 2008-11-12 2010-06-02 Universität Konstanz Kooperationsfenster/wand
EP2311255A1 (fr) * 2008-08-14 2011-04-20 Telefonaktiebolaget L M Ericsson (PUBL) Partage de contenu multimédia dans un réseau de communication
WO2012100335A1 (fr) * 2011-01-25 2012-08-02 Aastra Technologies Limited Système et procédé de collaboration
WO2013035308A3 (fr) * 2011-09-05 2013-05-23 Panasonic Corporation Système de communication de télévision, terminal et procédé
FR2986931A1 (fr) * 2012-02-10 2013-08-16 Damien Guerin Procede d'acquisition et de transmission d'un contenu audiovisuel lors d'une operation chirurgicale
US20150261917A1 (en) * 2013-03-15 2015-09-17 Douglas K. Smith Federated Collaborative Medical Records System Utilizing Cloud Computing Network and Methods
EP3021552A1 (fr) * 2014-11-14 2016-05-18 Orange Procédé et dispositif de communication via un espace d'interaction partagé
US9759420B1 (en) 2013-01-25 2017-09-12 Steelcase Inc. Curved display and curved display support
US9804731B1 (en) 2013-01-25 2017-10-31 Steelcase Inc. Emissive surfaces and workspaces method and apparatus
US9984245B2 (en) 2012-07-25 2018-05-29 The University Of North Carolina At Chapel Hill Methods, systems, and computer readable media for providing a secure virtual research space
US10264213B1 (en) 2016-12-15 2019-04-16 Steelcase Inc. Content amplification system and method
WO2021252023A1 (fr) * 2020-06-08 2021-12-16 Dropbox, Inc. Production et gestion intelligentes de sources tierces dans un concentrateur contextuel
US11327626B1 (en) 2013-01-25 2022-05-10 Steelcase Inc. Emissive surfaces and workspaces method and apparatus

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6338086B1 (en) * 1998-06-11 2002-01-08 Placeware, Inc. Collaborative object architecture
US20020129106A1 (en) * 2001-03-12 2002-09-12 Surgency, Inc. User-extensible system for manipulating information in a collaborative environment
US20020183878A1 (en) * 2001-03-23 2002-12-05 Valentin Chartier Collaborative design
US20030018719A1 (en) * 2000-12-27 2003-01-23 Ruths Derek Augustus Samuel Data-centric collaborative computing platform
US6640241B1 (en) * 1999-07-19 2003-10-28 Groove Networks, Inc. Method and apparatus for activity-based collaboration by a computer system equipped with a communications manager
US20030217105A1 (en) * 2002-05-17 2003-11-20 Groove Networks, Inc. Method and apparatus for connecting a secure peer-to-peer collaboration system to an external system
US6741904B1 (en) * 2001-02-16 2004-05-25 Benjamin C. Gage Real time design, development and delivery collaborative apparel solution digital platform
US20040181592A1 (en) * 2001-02-22 2004-09-16 Sony Corporation And Sony Electronics, Inc. Collaborative computer-based production system including annotation, versioning and remote interaction
US20050028006A1 (en) * 2003-06-02 2005-02-03 Liquid Machines, Inc. Computer method and apparatus for managing data objects in a distributed context
US20050193062A1 (en) * 2004-02-27 2005-09-01 International Business Machines Corporation Collaboration server, collaboration system, and method and program for collaboration server and system

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6338086B1 (en) * 1998-06-11 2002-01-08 Placeware, Inc. Collaborative object architecture
US6640241B1 (en) * 1999-07-19 2003-10-28 Groove Networks, Inc. Method and apparatus for activity-based collaboration by a computer system equipped with a communications manager
US20030018719A1 (en) * 2000-12-27 2003-01-23 Ruths Derek Augustus Samuel Data-centric collaborative computing platform
US6741904B1 (en) * 2001-02-16 2004-05-25 Benjamin C. Gage Real time design, development and delivery collaborative apparel solution digital platform
US20040181592A1 (en) * 2001-02-22 2004-09-16 Sony Corporation And Sony Electronics, Inc. Collaborative computer-based production system including annotation, versioning and remote interaction
US20020129106A1 (en) * 2001-03-12 2002-09-12 Surgency, Inc. User-extensible system for manipulating information in a collaborative environment
US20020183878A1 (en) * 2001-03-23 2002-12-05 Valentin Chartier Collaborative design
US20030217105A1 (en) * 2002-05-17 2003-11-20 Groove Networks, Inc. Method and apparatus for connecting a secure peer-to-peer collaboration system to an external system
US20050028006A1 (en) * 2003-06-02 2005-02-03 Liquid Machines, Inc. Computer method and apparatus for managing data objects in a distributed context
US20050193062A1 (en) * 2004-02-27 2005-09-01 International Business Machines Corporation Collaboration server, collaboration system, and method and program for collaboration server and system

Cited By (33)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2311255A1 (fr) * 2008-08-14 2011-04-20 Telefonaktiebolaget L M Ericsson (PUBL) Partage de contenu multimédia dans un réseau de communication
DE102008056917A1 (de) * 2008-11-12 2010-06-02 Universität Konstanz Kooperationsfenster/wand
US9674286B2 (en) 2011-01-25 2017-06-06 Mitel Networks Corporation Collaboration system and method
WO2012100335A1 (fr) * 2011-01-25 2012-08-02 Aastra Technologies Limited Système et procédé de collaboration
WO2013035308A3 (fr) * 2011-09-05 2013-05-23 Panasonic Corporation Système de communication de télévision, terminal et procédé
US9124761B2 (en) 2011-09-05 2015-09-01 Panasonic Intellectual Property Management Co., Ltd. Television communication system, terminal, and method
FR2986931A1 (fr) * 2012-02-10 2013-08-16 Damien Guerin Procede d'acquisition et de transmission d'un contenu audiovisuel lors d'une operation chirurgicale
US9984245B2 (en) 2012-07-25 2018-05-29 The University Of North Carolina At Chapel Hill Methods, systems, and computer readable media for providing a secure virtual research space
US10754491B1 (en) 2013-01-25 2020-08-25 Steelcase Inc. Emissive surfaces and workspaces method and apparatus
US11775127B1 (en) 2013-01-25 2023-10-03 Steelcase Inc. Emissive surfaces and workspaces method and apparatus
US11327626B1 (en) 2013-01-25 2022-05-10 Steelcase Inc. Emissive surfaces and workspaces method and apparatus
US9759420B1 (en) 2013-01-25 2017-09-12 Steelcase Inc. Curved display and curved display support
US9804731B1 (en) 2013-01-25 2017-10-31 Steelcase Inc. Emissive surfaces and workspaces method and apparatus
US11102857B1 (en) 2013-01-25 2021-08-24 Steelcase Inc. Curved display and curved display support
US10154562B1 (en) 2013-01-25 2018-12-11 Steelcase Inc. Curved display and curved display support
US10983659B1 (en) 2013-01-25 2021-04-20 Steelcase Inc. Emissive surfaces and workspaces method and apparatus
US10977588B1 (en) 2013-01-25 2021-04-13 Steelcase Inc. Emissive shapes and control systems
US10652967B1 (en) 2013-01-25 2020-05-12 Steelcase Inc. Curved display and curved display support
US11246193B1 (en) 2013-01-25 2022-02-08 Steelcase Inc. Curved display and curved display support
US11443254B1 (en) 2013-01-25 2022-09-13 Steelcase Inc. Emissive shapes and control systems
US20150261917A1 (en) * 2013-03-15 2015-09-17 Douglas K. Smith Federated Collaborative Medical Records System Utilizing Cloud Computing Network and Methods
US20170140105A1 (en) * 2013-03-15 2017-05-18 Douglas K. Smith Federated Collaborative Medical Records System
EP3021552A1 (fr) * 2014-11-14 2016-05-18 Orange Procédé et dispositif de communication via un espace d'interaction partagé
FR3028700A1 (fr) * 2014-11-14 2016-05-20 Orange Procede et dispositif de communication via un espace d'interaction partage
US10638090B1 (en) 2016-12-15 2020-04-28 Steelcase Inc. Content amplification system and method
US11190731B1 (en) 2016-12-15 2021-11-30 Steelcase Inc. Content amplification system and method
US10897598B1 (en) 2016-12-15 2021-01-19 Steelcase Inc. Content amplification system and method
US11652957B1 (en) 2016-12-15 2023-05-16 Steelcase Inc. Content amplification system and method
US10264213B1 (en) 2016-12-15 2019-04-16 Steelcase Inc. Content amplification system and method
WO2021252023A1 (fr) * 2020-06-08 2021-12-16 Dropbox, Inc. Production et gestion intelligentes de sources tierces dans un concentrateur contextuel
US11461428B2 (en) 2020-06-08 2022-10-04 Dropbox, Inc. Intelligently generating and managing third-party sources within a contextual hub
US11853380B2 (en) 2020-06-08 2023-12-26 Dropbox, Inc. Intelligently generating and managing third-party sources within a contextual hub
US11893075B2 (en) 2020-06-08 2024-02-06 Dropbox, Inc. Intelligently generating and managing third-party sources within a contextual hub

Also Published As

Publication number Publication date
CA2702509A1 (fr) 2008-04-17
WO2008043182A8 (fr) 2008-07-03

Similar Documents

Publication Publication Date Title
WO2008043182A1 (fr) Système de support pour un travail en collaboration
Pang et al. Collaborative 3 D visualization with CSpray
Bouras et al. Educational virtual environments: design rationale and architecture
US20130290421A1 (en) Visualization of complex data sets and simultaneous synchronization of such data sets
CN106295107A (zh) 一种实现医学影像同步会诊的方法及***
US9386271B2 (en) System and method for synthesizing and preserving consistent relative neighborhood position in multi-perspective multi-point tele-immersive environments
US9826196B2 (en) System and method for synthesizing and preserving consistent relative neighborhood position in multi-perspective multi-point tele-immersive environments
Kaeri et al. Agent-based system architecture supporting remote collaboration via an internet of multimedia things approach
Theoktisto et al. Enhancing collaboration in virtual reality applications
Intapong et al. Modular web-based collaboration platform
Buckingham Shum et al. Lyceum: Internet voice groupware for distance learning
Valin et al. Sharing viewpoints in collaborative virtual environments
CA2563866A1 (fr) Systeme pour soutenir le travail de collaboration
Singh et al. Towards environment-to-environment (e2e) multimedia communication systems
Vertegaal et al. Look who's talking: the GAZE groupware system
DeFanti et al. Technologies for virtual reality/tele-immersion applications: issues of research in image display and global networking
Koleva et al. Experiencing a presentation through a mixed reality boundary
Kirk Turn it this way: Remote gesturing in video-mediated communication
Drira et al. A multi-paradigm layered architecture for synchronous distance learning
Guo et al. Tangible video communication over the Internet
ter Haar et al. Remote Expert Assistance System for Mixed-HMD Clients over 5G Infrastructure
Billinghurst et al. Collaboration with wearable computers
Lucca et al. An overview of systems enabling computer supported collaborative learning requiring immersive presence (CSCLIP)
Sun et al. Implementing three-party desktop videoconferencing
Törlind Distributed engineering: tools and methods for collaborative product development

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 07815977

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 07815977

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 2702509

Country of ref document: CA