EP3769196A1 - Method for interaction between at least one user and/or a first electronic device and a second electronic device - Google Patents
Method for interaction between at least one user and/or a first electronic device and a second electronic deviceInfo
- Publication number
- EP3769196A1 EP3769196A1 EP19709983.1A EP19709983A EP3769196A1 EP 3769196 A1 EP3769196 A1 EP 3769196A1 EP 19709983 A EP19709983 A EP 19709983A EP 3769196 A1 EP3769196 A1 EP 3769196A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- electronic device
- user
- data
- gui
- sharing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
- 238000000034 method Methods 0.000 title claims abstract description 61
- 230000003993 interaction Effects 0.000 title claims abstract description 23
- 230000005540 biological transmission Effects 0.000 claims abstract description 12
- 238000012545 processing Methods 0.000 claims abstract description 10
- 230000002452 interceptive effect Effects 0.000 claims description 16
- 238000004590 computer program Methods 0.000 claims description 9
- 230000009471 action Effects 0.000 claims description 7
- 238000006073 displacement reaction Methods 0.000 claims description 7
- 230000001815 facial effect Effects 0.000 claims description 3
- 238000004891 communication Methods 0.000 description 10
- 238000010586 diagram Methods 0.000 description 8
- 230000002093 peripheral effect Effects 0.000 description 7
- 230000033001 locomotion Effects 0.000 description 6
- 230000006870 function Effects 0.000 description 3
- 230000008901 benefit Effects 0.000 description 2
- 238000004364 calculation method Methods 0.000 description 2
- 230000008859 change Effects 0.000 description 2
- 238000009877 rendering Methods 0.000 description 2
- 230000002457 bidirectional effect Effects 0.000 description 1
- 238000012790 confirmation Methods 0.000 description 1
- 230000002354 daily effect Effects 0.000 description 1
- 238000012938 design process Methods 0.000 description 1
- 230000003203 everyday effect Effects 0.000 description 1
- 230000000977 initiatory effect Effects 0.000 description 1
- 238000009434 installation Methods 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 230000008520 organization Effects 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 238000010079 rubber tapping Methods 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06F3/04886—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
- G06F21/30—Authentication, i.e. establishing the identity or authorisation of security principals
- G06F21/31—User authentication
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/1454—Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/54—Interprogram communication
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T1/00—General purpose image data processing
- G06T1/20—Processor architectures; Processor configuration, e.g. pipelining
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2354/00—Aspects of interface with display user
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2370/00—Aspects of data communication
- G09G2370/04—Exchange of auxiliary data, i.e. other than image data, between monitor and graphics controller
- G09G2370/042—Exchange of auxiliary data, i.e. other than image data, between monitor and graphics controller for monitor identification
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2370/00—Aspects of data communication
- G09G2370/06—Consumer Electronics Control, i.e. control of another device by a display or vice versa
Definitions
- the present invention relates to a method of interaction between on the one hand at least one user and / or at least one first electronic device and secondly a second electronic device comprising a touch display screen allowing, easily and intuitively , to enter and / or modify data simultaneously by several people, on the same device and / or on a plurality of peripherals.
- the known sharing systems although offering a number of interesting features, do not allow several objects to be manipulated simultaneously and in real time, and to display them in real time on different remote electronic devices. Indeed, the data sharing systems of the prior art only allow users to act one after the other.
- US 8,965,349 discloses a method of sharing an application interactively comprising a step of initiating, by a first electronic device, communication with a second electronic device; after the start of the communication, transmitting a request from the first electronic device to engage in the sharing of an application with a second electronic device; receiving, at the first electronic device, the sharing confirmation of the second electronic device; displaying, on the first electronic device, the application and the data relating to the communication; generating, at the level of the first electronic device, an instruction to the second electronic device, said instruction being relative to the display of the application on the second electronic device; and transmitting the instruction to the second electronic device.
- Said instruction is a screen image to be displayed on the second electronic device.
- the communication may be a video conference and, in this case, the data associated with the communication are images of the video conference.
- multiple devices can share applications or application data in such a way that the users of the electronic devices can each view the data of the application of another or interact with each other through a shared application.
- the document EP 2 869 188 describes meanwhile an electronic device for sharing an application and a method for controlling said electronic device.
- the server electronic device communicating with a client electronic device comprises a communication unit configured to form a connection with the client electronic device, a controller configured to determine an application to be shared with the client electronic device, to generate shared data for the client electronic device. shared application, and for controlling the communication unit to transmit the shared data to the client electronic device, and a screen configured to display a run screen of the shared application.
- the control method includes a step of establishing a connection with the client electronic device, a step of determining an application to be shared with the client electronic device, a step of generating data of the shared application, said information being intended to be shared, and a step of transmitting the shared data to the client electronic device, said shared data being then displayed on the screen of said client electronic device.
- the document US7,327,376 describes a graphical user interface called multi-user collaborative GUI.
- the multi-user collaborative graphical user interface has a display area with a horizontal orientation, the display surface being positioned between the multiple users.
- the display area also has a centroid and a circumference.
- the display area is partitioned into work areas so that there is a work area for each user of multiple users positioned around a touch table. An element is displayed in a particular work area using a global polar coordinate system centered on said centroid.
- This type of GUI has the disadvantage of limiting the work area of each user, said work area is even smaller than there is a large number of users around the table.
- US2004 / 0066414 discloses a system and method for managing software application windows in a graphical user interface having a desktop and taskbar display area.
- Each instantiated program is represented as one or more graphic windows in the desktop and as a control mosaic in the taskbar.
- Control tiles are grouped into control tile groups that facilitate organization and single access control.
- Project Control tile groups allow the grouping of multiple software applications.
- the layout and state of the minimized control tile group can be preserved and previewed before being restored.
- An indication is obtained for organizing a graphical control relating to a software application and another control relating to another application.
- the graphic controls are grouped on a part of the display.
- the commands are displayed as a group in the part to instantiate an action on the controls by selecting a group consisting of minimized graphics windows.
- This type of GUI is not suitable for interactive sharing of all types of documents, files, objects, applications, software or application data or software with an intuitive and effective interaction for different users in real time around a same touch table or several touch panels connected remotely.
- Document US2010 / 0095233 is also known which describes a method, a device and a system for extracting and displaying technical data for an industrial device monitored by a computer program for control, configuration or condition monitoring in industrial installations or commercial.
- a substantially static and large active display element such as a touch table
- Said touch table has "home areas" displaying programs or applications preselected by the user, said user is identified by an object with an RFID tag.
- a computing device or mobile computing device such as a PDA, can send a link or reference of an application, interface or document to the large active screen so applications can be displayed by the large active screen to facilitate retrieval, manipulation of information as well as access to information.
- This type of device has the disadvantage of having a predetermined and therefore limited number of "home areas" i.e. GUI.
- One of the aims of the invention is thus to overcome these disadvantages by providing a method of interaction with a graphical user interface called GUI and interactive sharing applications and data between touch screen computers and a computer program for implementing said simple and inexpensive design process and allowing interactive sharing of all types of documents, files, objects, applications, software or data application or software with real-time multi-user interaction and real-time display feedback on all desired devices with intuitive and efficient interaction with the GUI.
- a method of interaction between on the one hand at least one user and / or at least one first electronic device comprising at least one processor or microprocessor or one graphics processor called GPU according to the acronym "Graphics Processing Unit”, a memory, an input / output port for transmitting data to and from said electronic device and a display screen, and secondly a second electronic device comprising at least one processor or microprocessor or a graphics processor called GPU according to the acronym "Graphics Processing Unit", a memory, an input / output port for the transmission of data to and from said second electronic device and a touch screen display;
- said method is remarkable in that it comprises at least the following steps of:
- the method according to the invention comprises a step of importing into the main GUI of said user and / or said first electronic device data and / or files and / or applications or software, or application data. and software of each user and / or first electronic device connected to a sharing module, said sharing module consisting of a computer program for interactive sharing of data, files, applications or software, or application and software data on the second electronic device.
- Said sharing module is stored in a server and / or in the memory of the second electronic device and / or in the memory of the first electronic device.
- said method comprises a step of generating at least a second GUI secondary GUI related to the main GUI and in which are displayed at least one command and / or at least one data of at least one application.
- connection step of the user is performed according to at least the following steps:
- Said identification system consists of a QR code and / or a facial recognition system and / or a voice recognition system and / or a biometric recognition system and / or an identifier field and a password field.
- the user's connection step is performed according to at least the following steps:
- connection data consist of at least one identifier and a password.
- the main GUI and / or the secondary GUI (s) have a circular shape.
- the secondary GUI or GUIs are positioned near the main GUI.
- the method according to the invention comprises a step of displaying in the main GUI of the profile picture of the user connected to the second electronic device or, failing that, of an avatar.
- Said profile picture is imported from the sharing session opened by the user and / or the first electronic device in the sharing module.
- the method according to the invention comprises a step of generating at least one alphanumeric keyboard displayed in a window associated with at least a first graphical user interface and / or at least a second graphical user interface and / or at least one window.
- a scan code which is associated with a character and / or an action in the first graphical user interface and / or the second graphical user interface and / or allows to write in the window.
- said method comprises a step of generating at least one command from an interaction between at least one user and the second electronic device, such as a touch table for example.
- Said interaction consists of pressing and / or moving with at least one finger of at least one hand and / or the slice of at least one hand and / or the palm of at least one hand on the screen of the second electronic device that generates a request transmitted to at least one of the electronic devices.
- Another object of the invention relates to a computer program product comprising a sequence of instructions for the implementation of a method according to the invention.
- FIG. 1 is a schematic perspective view of the connection of an electronic device with a touch table
- FIG. 2 is a graphical representation of the user interface according to the invention.
- FIG. 3 is a graphical representation of the preliminary step of connecting the electronic device with a touch table
- FIG. 4 is a graphical representation of the user interface with alphanumeric keyboards according to the invention.
- FIG. 5 is a diagramatic diagram of a touch screen computer according to the invention.
- FIG. 6 is a diagrammatic representation in the form of a diagram of a first application of the method according to the invention allowing at least two users to share data on a single touch screen computer according to the invention
- FIG. 7 is a diagramatic representation of a second application of the method according to the invention enabling at least one user of a first touch-screen computer according to the invention to share data with at least one another user of at least one second touch computer according to the invention,
- FIG. 9 is a schematic flow diagram of the second step of the method according to the invention.
- FIG. 10 is a schematic flow diagram of the third step of the method according to the invention
- FIG. 11 is a schematic flow diagram of the fourth step of the method according to the invention.
- FIG. 12 is a schematic flow diagram of the fifth step of the method according to the invention.
- FIG. 13 is a schematic flow chart of the sixth step of the method according to the invention.
- FIG. 14 is a schematic flow chart of a seventh step of the method according to the invention.
- FIGS. 15 to 25 are schematic representations of metaphors providing commands to the graphical user interface.
- a computer of the tablet or touch-screen table type comprising a user interface according to the invention will be described below; however, it is obvious that the computer may consist of any type of computer with touch screen or not such as a smartphone or PC-type computer without departing from the scope of the invention.
- FIG. 5 is a block diagram of an exemplary electronic device 100 that can be used to interactively share applications and / or data and / or peripherals in accordance with the invention
- said electronic device 100 can be a portable device, such as a smart phone called “smartphone", a table or a touch pad, a laptop, a digital camera, a digital telephone handset or the like
- said electronic device 100 comprises at least a processor 110 said CPU according to the English acronym "Central Processing Unit” which controls the various operations of the electronic device 100 and can interact with the other components of the device.
- Said processor 110 may consist of any processor well known to those skilled in the art such as a Pentium® or Atom® processor marketed by INTEL® or an A4 or A5 processor marketed by Apple® for example.
- the processor may consist of a single-core microprocessor or a multi-core microprocessor.
- a multi-core microprocessor is understood to mean a microprocessor having a plurality of physical cores which work in parallel, each physical core being a set of circuits capable of to run programs autonomously and all the functionalities necessary for the execution of a program being present in these cores: ordinal counter, registers, calculation units, etc.
- the electronic device 100 may include several processors even if only one is shown in Figure 1.
- graphics processor also called GPU according to the acronym "Graphics Processing Unit”
- GPU Graphics Processing Unit
- said graphics processor being well known in itself an integrated circuit generally present on a graphics card, a motherboard or the processor 110 (CPU) and providing the calculation functions of the display.
- the electronic device 100 may be a fixed device, such as a desktop computer said PC, a digital telephone base, a television, a media center or the like without departing from the scope of the invention.
- the lines connecting the different elements of the electronic device represent communication paths between said elements, these communication paths being bidirectional or omnidirectional.
- the electronic device 100 includes a memory 120, or other similar storage device, a user input module 130, an input / output port 140 for enabling data transmission to and from the device 100, a display screen 150 and internal or external peripherals 160.
- Said internal or external peripherals 160 consist, for example, in a camera to enable a user of the electronic device according to the invention to carry out a videoconference with a another person, such as a user of a second electronic device, in a camera, a printer, an infra-red detector or in sensors.
- the user input module 130 generally allows a user to manipulate certain functions of the electronic device 100, including interacting and sharing resident applications on the storage of the apparatus and executed by the processor 110, and may consist of in a device such as a touchpad, a keyboard, a mouse, a stylus or the like, said peripheral device being able to be connected to the electronic device either in a wired manner or by means of a wireless connection (Wi-Fi or bluetooth for example) ), or in a touch screen, said touch screen also forming the display screen 150.
- This touch screen can consist of a capacitive, resistive or interference-based type screen. electromagnetic wavelengths or in any other type of touch screen well known to those skilled in the art.
- the electronic device comprises a so-called sharing module software 170 which makes it possible to control the aspects and interactions related to the interactive sharing of one or more applications and / or data and / or peripherals as it will be detailed below.
- Software is understood to mean a set of machine-interpretable instruction sequences and a set of data necessary for these operations.
- the software includes a computer program that is stored in the memory 120 and executed by the processor 110 whenever the applications are shared or the sharing is initiated.
- the sharing module 170 may consist of a firmware, hardware or software or a combination of these without departing from the scope of the invention. Furthermore, said sharing module 170 may be hosted in whole or part on a server or other remote device and accessible by other electronic devices engaged in sharing applications.
- This sharing module 170 allows the interactive sharing of data, files, applications or software, or application and software data on a single electronic device 100 between several users or between two or more electronic devices, local or remote .
- Said data, files, applications, software, or application and software data can therefore be accessed by multiple users on multiple devices.
- Several users can even be on a single device such as a touch table, or a vertical interactive screen, for example.
- some electronic devices may not have users as servers.
- Each user can then access data, files, applications or software, or application and software data made accessible.
- Each user of each electronic device can display, view, modify and manipulate different files, data, objects, applications or software in real time through a software or a shared application; this alone or several on each electronic device and perform all operations simultaneously with others users.
- the sharing module 170 allows all users to interact at the same time on all devices alone or with several devices on each device simultaneously.
- the sharing will be possible according to the possible rights to be granted to each user to display, view, modify and manipulate the various data, files, objects, applications or software or data of applications or software; or even, depending on the possible rights granted to each data, files, objects, applications or software or application data or software.
- a user can manipulate a plan on a touch interactive table in Paris, said touch interactive table forming a first electronic device according to the invention, while another person takes notes on the corner of the table on the same table , while a third person draws in another corner on another touch table in New York, ie on a second electronic device according to the invention, while a fourth displays in the middle what the camera of his smartphone, ie a third electronic device according to the invention, is filming in Moscow, while others view on an interactive whiteboard in Tokyo and can interact with each element.
- all users can see the different graphic elements and interact with them.
- all the electronic devices are capable of communicating with each other by any means (network, telephone communication or other), all the devices are equipped with electronic components and drivers for the dialogue of the electronic devices with each other or at least with the electronic device designated as a server.
- An electronic device can act as the host of the interactive sharing solution software, the other electronic devices can then only have to transmit their data or the actions of the users via this same sharing application which is also installed on the electronic device.
- the "server” application can then send the display information to the different electronic devices that wish to have the display return.
- the orientation of the different objects displayed can be interpreted by the electronic device on which it is displayed to adapt the orientation to the use.
- the interaction and sharing module 170 also serves as a gateway for managing and organizing the user interface and all the electronic devices and functions of all devices and peripherals of the internal or external devices.
- the mode of interaction of the user with the electronic device depends on each electronic device itself. All user-device interaction modes are possible.
- each electronic device has its own screen with its own graphic widgets that interact together.
- a widget is a software component.
- the rendering quality on the screen is also improved for items that will not be compressed.
- At least two or more users interactively share data, files, applications or software, or application and software data on an electronic device 100 and may interact simultaneously with the different elements.
- This solution allows an active collaboration of each user on the electronic device 100 simultaneously.
- the advantage of this solution is to allow n users to collaborate, interact together in real time simultaneously and share all kinds of data, files, applications or software, or application and software data.
- At least one or more users interactively share data, files, applications, or software, or application and software data on a first electronic device 100 with at least one other user on at least one other electronic device and can simultaneously interact with the different users of different electronic devices.
- This solution allows an active collaboration of each user on the different electronic devices simultaneously with a return of display in near real time on the various devices that allow the display.
- This solution is particularly useful when there are at least two users who want to share, collaborate and interact on at least two remote electronic devices, so that they can collaborate, share interactive data, files, files, applications or software, or application and software data without having to be physically present in the same geographical location.
- the sharing module 170 allows, in a first step (FIG. 8), a connection of a first electronic device 100 to a server 180 via an internet connection, for example, and an identification of the first electronic device 100 by said server 180 as a client.
- the first electronic device 100 then transmits to the server 180 a request to create a sharing session, then the server 180 creates a sharing session and transmits the information relating to this sharing session to said first device 100.
- the first electronic device 100 sends an invitation to connect to the sharing session to other electronic devices 100. This invitation can be done in different ways.
- a user sends an invitation e-mail (e-mail) from the first electronic device 100 to users of other electronic devices.
- an invitation email to connect to the sharing session is generated automatically by the server 180 and sent by said server 180 to users of other electronic devices.
- the invitation to connect to the sharing session can be performed by telephone, by a notification called In-App, etc ... without departing from the scope of the invention.
- each new electronic device that has received the invitation to connect to the sharing session can also send an invitation to connect to said session to other devices, via the email address book, for example.
- the other electronic devices 100 accept the invitation from the server 180 which then tests the bit rate of the connection of each electronic device 100 with the server 180.
- the rate of the connection is tested to choose the mode of transmission of information and the quality of sending information. In this way, one maximizes the chances of having non-jerky and pleasant exchanges.
- the connection speed is tested later at regular intervals to adapt the transmission mode and the quality of sending according to the bandwidth of the connection.
- the said image is transmitted in real time to the other electronic devices 100.
- said image transmitted by the server 180 to the other electronic devices can be compressed as will be detailed later.
- the image is downloaded once by the users, modifying if necessary the size of said image if the connection of the various users is not sufficiently powerful or if the image is too large.
- the image is optionally compressed to minimize the rate used.
- the rendering on the display screens of the electronic devices is the same, without any loss of quality of the image and only the image is transmitted and not the entire screen unlike the methods of the prior art.
- the data relating to the displacement and / or zoom are transmitted to the server 180 which retransmits this data to the other electronic devices 100 so that the displacement and / or the zoom of the image is displayed on the screens of the other electronic devices 100.
- the server 180 which retransmits this data to the other electronic devices 100 so that the displacement and / or the zoom of the image is displayed on the screens of the other electronic devices 100.
- it is not possible to does not re-download the image, only the change of position and the change of zoom factor is transmitted to the server 180 and then to the various electronic devices.
- FIG. 14 when an electronic device 100 adds a note and when another electronic device 100 adds a new image, the data is transmitted respectively to the server 180 which then transmits them in real time to all other electronic devices for said data to be displayed on said electronic devices.
- the method comprises a step of importing into the main GUI of said user and / or said first electronic device data and / or files and / or applications or software, or application and software data of each user and / or each first electronic device connected to a sharing module, said sharing module consisting of a computer program for interactive sharing of data, files, applications or software, or application data and software on the second electronic device.
- said sharing module is indifferently registered in a server and / or in the memory of the second electronic device 1 and / or in the memory of the first electronic device 1.
- the method comprises a step of generating at least a second GUI secondary GUI linked to the main GUI 3 and in which at least one command and / or at least one command is displayed. a given at least one application.
- the main GUI 3 and / or the secondary GUI or 4 have a circular shape and the secondary GUI or GUI are positioned near, such as the periphery of the main GUI.
- the main GUI 3 and / or the secondary GUI 4 may have any form without departing from the scope of the invention.
- the method comprises a step of displaying in the main GUI 3 of the profile picture of the user connected to the second electronic device 1 or, failing that, of an avatar, said profile picture being for example, imported from the sharing session opened by the user and / or the first electronic device 2 in the sharing module.
- the user's connection step is performed according to at least the following steps:
- the identification system consists of an identifier field and a password field; however, it goes without saying that the identification system may consist of any other type of identification system such as a QR code and / or a facial recognition system and / or a voice recognition system and / or a system biometric recognition, etc. without departing from the scope of the invention.
- the user G connection step is performed according to at least the following steps:
- the method comprises a step of generating at least one alphanumeric keyboard 6 displayed in a window associated with at least a first graphical user interface and / or at least a second graphical user interface and / or at least one window 7, the first and / or the second user interface consisting of a main GUI 3 or a secondary GUI 4.
- the term "associated" means that the alphanumeric keyboard 7 interacts with the first graphical user interface and / or the second graphical user interface and / or a window 7.
- the alphanumeric keyboard 7 makes it possible to enter a control request for the first graphical user interface and / or the second graphical user interface and / or allows to write in window 7 in particular.
- pressing a key of said alphanumeric keyboard 7 generates a code, called a scan code, which is associated with a character and / or an action in the first graphical user interface and / or the second graphical user interface and / or allows to write in window 7.
- a scan code which is associated with a character and / or an action in the first graphical user interface and / or the second graphical user interface and / or allows to write in window 7.
- the method also includes generating at least one command from an interaction between at least one user and said electronic device in the form of a metaphor. Said interaction is carried out by a pressure, very short and / or short and / or long, and / or a displacement with at least one finger of at least one hand and / or the slice of at least one hand and / or the palm of at least one hand on the touch screen of the device generates a request transmitted to at least one of the electronic devices.
- a third metaphor consists of a long key with two fingers in a window and a simultaneous rotation of said fingers to provide rotation of the window in the direction of rotation of the fingers.
- a fourth metaphor consists of a long key with three fingers in a window and an upward movement to provide a fold of the window in a taskbar of the user interface.
- a fifth metaphor consists of a long key with three fingers in a window and a downward movement to provide a fold of the window under the main frame 3.
- a sixth metaphor consists of a short key with three fingers in a window displaying an Internet browser and a shift to the right or left to provide scrolling the next or respectively preceding web page.
- a seventh metaphor consists of a short key with the ten fingers of both user's hands and a downward movement to provide a reduction of all open windows in the interface task bar user or under the main frame 3 of the user.
- an eighth metaphor consists of a long key with the palm of the hand and a circular motion to provide erasure (closing) of all open windows.
- a ninth metaphor consists of a long key with the edge of the hand in a window and a rectilinear motion to provide a cut of the contents of the window.
- a tenth metaphor is a quick tapping with several fingers of a hand on the touch screen to provide a new window containing an alphanumeric keyboard, the latter being associated with the active window. for example to allow to write in said particular window.
- all interactions using metaphors can be summarized in the table below.
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Software Systems (AREA)
- Human Computer Interaction (AREA)
- Computer Security & Cryptography (AREA)
- Signal Processing (AREA)
- Computer Networks & Wireless Communication (AREA)
- Computer Hardware Design (AREA)
- User Interface Of Digital Computer (AREA)
- Position Input By Displaying (AREA)
Abstract
Description
Claims
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
FR1852332A FR3079048B1 (en) | 2018-03-19 | 2018-03-19 | INTERACTION PROCESS BETWEEN ON THE ONE HAND AT LEAST ONE USER AND / OR A FIRST ELECTRONIC DEVICE AND ON THE OTHER HAND A SECOND ELECTRONIC DEVICE |
PCT/EP2019/056679 WO2019179927A1 (en) | 2018-03-19 | 2019-03-18 | Method for interaction between at least one user and/or a first electronic device and a second electronic device |
Publications (1)
Publication Number | Publication Date |
---|---|
EP3769196A1 true EP3769196A1 (en) | 2021-01-27 |
Family
ID=62948204
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP19709983.1A Withdrawn EP3769196A1 (en) | 2018-03-19 | 2019-03-18 | Method for interaction between at least one user and/or a first electronic device and a second electronic device |
Country Status (4)
Country | Link |
---|---|
US (1) | US20210026527A1 (en) |
EP (1) | EP3769196A1 (en) |
FR (1) | FR3079048B1 (en) |
WO (1) | WO2019179927A1 (en) |
Families Citing this family (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US10969956B2 (en) * | 2018-03-20 | 2021-04-06 | Cemtrex Inc. | Smart desk with gesture detection and control features |
USD971932S1 (en) * | 2020-08-25 | 2022-12-06 | Hiho, Inc. | Display screen or portion thereof having a graphical user interface |
CN115002937B (en) * | 2022-07-18 | 2022-12-23 | 荣耀终端有限公司 | Multi-device cooperation method, electronic device and related product |
CN116719649A (en) * | 2022-09-01 | 2023-09-08 | 荣耀终端有限公司 | Session notification prompting method, electronic equipment and readable storage medium |
Family Cites Families (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7327376B2 (en) | 2000-08-29 | 2008-02-05 | Mitsubishi Electric Research Laboratories, Inc. | Multi-user collaborative graphical user interfaces |
US7913183B2 (en) | 2002-10-08 | 2011-03-22 | Microsoft Corporation | System and method for managing software applications in a graphical user interface |
EP2074487A1 (en) * | 2006-10-13 | 2009-07-01 | ABB Research Ltd. | A device, system and computer implemented method to display and process technical data for a device in an industrial control system |
US8390577B2 (en) | 2008-07-25 | 2013-03-05 | Intuilab | Continuous recognition of multi-touch gestures |
US9317899B2 (en) * | 2012-01-13 | 2016-04-19 | Sony Corporation | Information processing apparatus and information processing method, and computer program |
US8965349B2 (en) | 2012-01-26 | 2015-02-24 | Apple Inc. | Interactive application sharing |
FR3005518B1 (en) * | 2013-05-07 | 2017-04-07 | Glowbl | COMMUNICATION INTERFACE AND METHOD, COMPUTER PROGRAM, AND CORRESPONDING RECORDING MEDIUM |
KR102107404B1 (en) | 2013-10-30 | 2020-05-07 | 삼성전자주식회사 | Apparatus for sharing application and method for controlling thereof |
FR3039906B1 (en) * | 2015-08-04 | 2018-09-07 | Kineti Technologies | METHOD FOR INTERACTIVE SHARING OF APPLICATIONS AND DATA BETWEEN TOUCH SCREEN COMPUTERS AND COMPUTER PROGRAM FOR IMPLEMENTING SAID METHOD |
-
2018
- 2018-03-19 FR FR1852332A patent/FR3079048B1/en active Active
-
2019
- 2019-03-18 US US16/979,905 patent/US20210026527A1/en not_active Abandoned
- 2019-03-18 EP EP19709983.1A patent/EP3769196A1/en not_active Withdrawn
- 2019-03-18 WO PCT/EP2019/056679 patent/WO2019179927A1/en unknown
Also Published As
Publication number | Publication date |
---|---|
WO2019179927A1 (en) | 2019-09-26 |
FR3079048B1 (en) | 2021-11-19 |
US20210026527A1 (en) | 2021-01-28 |
FR3079048A1 (en) | 2019-09-20 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US11895391B2 (en) | Capturing and displaying images with multiple focal planes | |
EP3769196A1 (en) | Method for interaction between at least one user and/or a first electronic device and a second electronic device | |
US20230252659A1 (en) | Displaying and editing images with depth information | |
US10387025B2 (en) | Multi-mode user interface | |
US20170024226A1 (en) | Information processing method and electronic device | |
US8549418B2 (en) | Projected display to enhance computer device use | |
US20090094561A1 (en) | Displaying Personalized Documents To Users Of A Surface Computer | |
US20130198653A1 (en) | Method of displaying input during a collaboration session and interactive board employing same | |
US9134904B2 (en) | Displaying documents to a plurality of users of a surface computer | |
US20160147400A1 (en) | Tab based browser content sharing | |
WO2015077259A1 (en) | Image sharing for online collaborations | |
CA2961215A1 (en) | Partitioned application presentation across devices | |
US11409410B2 (en) | User input interfaces | |
US20120242589A1 (en) | Computer Interface Method | |
WO2017021460A1 (en) | Method for interactive sharing of applications and data between touch-screen computers and computer program for implementing said method | |
CN112783388B (en) | Display method, display device and electronic equipment | |
EP2590150B1 (en) | Method and device for controlling at least one apparatus with at least one other apparatus, system using such a device | |
FR3026874A1 (en) | DECISION SUPPORT METHOD AND DEVICE | |
US11163883B2 (en) | Enhancing security of a touch screen device | |
US10101831B1 (en) | Techniques for sharing data between devices with varying display characteristics | |
Seifert et al. | From the private into the public: privacy-respecting mobile interaction techniques for sharing data on surfaces | |
US9146633B1 (en) | Touch-based hovering on remote devices | |
CN114090896A (en) | Information display method and device and electronic equipment | |
WO2013121117A1 (en) | Method and device for controlling at least one apparatus by at least one other apparatus, apparatus and system implementing such a device | |
Ballendat | Visualization of and interaction with digital devices around large surfaces as a function of proximity |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: UNKNOWN |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE |
|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE |
|
17P | Request for examination filed |
Effective date: 20200928 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
AX | Request for extension of the european patent |
Extension state: BA ME |
|
DAV | Request for validation of the european patent (deleted) | ||
DAX | Request for extension of the european patent (deleted) | ||
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN |
|
18D | Application deemed to be withdrawn |
Effective date: 20231003 |