EP3108332A1 - Interface utilisateur et procédé de commutation d'un premier mode de commande d'une interface utilisateur en un mode gestuel en 3d - Google Patents
Interface utilisateur et procédé de commutation d'un premier mode de commande d'une interface utilisateur en un mode gestuel en 3dInfo
- Publication number
- EP3108332A1 EP3108332A1 EP15705545.0A EP15705545A EP3108332A1 EP 3108332 A1 EP3108332 A1 EP 3108332A1 EP 15705545 A EP15705545 A EP 15705545A EP 3108332 A1 EP3108332 A1 EP 3108332A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- user interface
- user
- hand
- predefined
- gesture
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
Definitions
- the present invention relates to a user interface as well as a method for changing from a first operating mode of a user interface into an SD gesture mode, by means of which an operation of the user interface can be carried out by a plurality of freely executed in space gestures.
- the present invention relates to avoiding erroneous operations by a comfortable yet secure initialization of a 3D gesture mode.
- the gesture is detected and converted into control commands.
- the start of the 3D gesture operation and the
- DE 10 2012 000 263 A1 discloses a method and a device for operating functions in a vehicle using in three-dimensional space
- Detection device detects a hand or a finger of the user for a first predetermined period of time in a valid detection area, a gesture control is activated.
- a gesture control is activated for the learning process of the user. It is proposed to permit blind operation by the user by visual and / or acoustic feedback during a gesture operation.
- DE 10 2006 037 156 A1 describes an interactive operating device, by means of which the gesture operation of a graphical content displayed on a display device is made possible. Depending on a determined operating intention the on the
- Display device displayed graphical content for activating one with it shown optimized function. For example, when approaching a button, the button will be enlarged.
- DE 10 2009 008 041 A1 discloses a method for operating a motor vehicle with a touchscreen, in which an approach sensor system for detecting a gesture for executing or initializing the execution of a function of the motor vehicle is provided. If a gesture of a hand is performed in the vicinity of the touch screen without touching the touch screen, the function of the motor vehicle is performed.
- Computer program product a signal sequence and a means of transport proposed to solve the problem.
- the method is used to switch from a first operating mode, in which a 3D gesture operation for starting a plurality of functions of the user interface or a communication technology connected to him computer system is not possible, in a 3D gesture mode, by means of which an operation of the user interface can be done by a variety of gestures executed freely in space.
- the first operating mode can be completely based on the operation via hardware-configured buttons, turn-push dials,
- a touch-sensitive surface of a display unit e.g., a touch screen.
- functions associated with graphic contents are not called by 3D gestures.
- a hand of a user is detected in a predefined detection area of a sensor in a first step.
- the sensor can
- a predefined attitude of the user's hand and / or a predefined movement of the user's hand are detected.
- the predefined attitude of the user's hand and / or a predefined movement of the hand can be used.
- the inventive method comprises starting a timer.
- the timer may be started in response to detecting a predefined posture of the user's hand and / or in response to detecting a predefined movement of the user's hand.
- the 3D gesture mode is changed only if the predefined posture and / or movement is not ended before the timer expires.
- the timer expires, it is checked if the predefined posture / movement is still in progress and changed from the first operating mode to the SD-gesture mode only in response to both conditions.
- the predefined posture may include, for example, a palm open in the direction of a sensor used for 3D gesture recognition and / or in the direction of a display unit of the user interface.
- the opened palm is substantially parallel to a surface of the display unit or substantially perpendicular in the direction of the sensor.
- another gesture or other gestures may be predefined to start or end the gesture operation. Further examples of this are a so-called "thumbs up" gesture or a gripping gesture (bale of a fist opened from, for example, in the direction of the sensor used and / or in the direction of a display unit of the user interface
- Hand gesture or merge several or all fingertips Such gestures have been found to be sensibly secure and therefore found to be suitable for starting the SD gesture mode.
- an optical and / or audible indication to the user may be made that the 3D gesture mode is now activated.
- this indication can also be made in response to the change to the SD gesture mode. In this way it is avoided that the user takes the predefined posture unnecessarily long or carries out movement, although the SD gesture operation can already take place. For example, a driver may become one
- a hand symbol in an edge area of a graphic content of a display unit can be displayed, in particular animated.
- a sound signal, a click sound or a voice output can be made as an acoustic indication.
- a user interface comprising a sensor for detection by a user's hand of free gestures executed in space. Furthermore, the user interface has a display unit for displaying a random graphic content.
- the display unit may be configured, for example, as a matrix screen, which is embedded in the dashboard of a means of transportation as an instrument cluster and / or as a central information display.
- an evaluation unit which may comprise a programmable processor, for example, is provided for detecting a plurality of gestures in the signals of the sensor.
- evaluation units are also referred to as “electronic control unit (ECU).”
- ECU electronic control unit
- the evaluation unit is set up to detect a predefined position of the user's hand and / or a predefined movement of the user's hand, for which the evaluation unit can analyze the detected movement patterns and compares with references stored (for example, in a local or wireless database), if the match is successful, in other words, a detected 3D gesture is associated with the start of the 3D gesture mode
- Evaluation unit the user interface of the invention of a first
- the senor may be an optical sensor, which is arranged for example in the headliner of a means of locomotion.
- a sensor operating in the infrared range may also be provided to enable or support gesture recognition.
- an optical and / or acoustic output unit for outputting an indication of the successful start of the 3-D gesture mode can be provided.
- LEDs or matrix displays have prevailed as optical output units
- loudspeakers are preferably used for the output of acoustic information (for example speech output, sound signals, sounds).
- a third aspect of the present invention is a
- a computer program product e.g., a data memory
- instructions are stored containing a programmable processor
- Evaluation unit of a user interface according to the second-mentioned aspect of the present invention enable to perform the steps of a method according to the first-mentioned aspect of the invention.
- the computer program product can be as CD, DVD, Blu-ray Disc, Flash Memory, Hard Disk, RAM / ROM, Cache etc.
- a signal sequence representing instructions which enable a programmable processor of a user interface evaluation unit according to the second-mentioned aspect of the present invention to carry out the steps of a method according to the first-mentioned aspect of the invention is proposed.
- the information technology provision of the instructions is provided for the case under protection, that the storage means required for this purpose are outside the scope of the appended claims.
- a user terminal which may for example be designed as a portable electronic device.
- electronic wireless communication devices such as
- Smartphones tablet PCs or laptops / netbooks, suitable for one
- Portable user terminals often have all the hardware required to support 3D gesture operation. With regard to the user terminal and the associated features and advantages, reference is made to the above statements.
- a means of transportation is proposed, which may be designed, for example, as a car, van, truck, aircraft and / or watercraft.
- a means of transportation is proposed, which may be designed, for example, as a car, van, truck, aircraft and / or watercraft.
- Display unit can be designed as fixed in a dashboard of the means of transport built central screen and / or as an instrument cluster. In this way, the means of locomotion is also set up to solve the problem of the invention or for use in a method according to the invention.
- Figure 1 is a schematic overview of components of an embodiment of a user interface according to the invention in an embodiment of an inventively designed car;
- Figure 2 is a schematic overview of components of an embodiment of a user interface according to the invention in an embodiment of an inventively designed user terminal;
- FIG. 3 shows a diagram for illustrating a first method step of a
- FIG. 4 shows a selection of gestures that can be used according to the invention
- FIG. 5 shows a diagram for illustrating a first method step of a second exemplary embodiment of a method according to the invention
- FIG. 6 shows a flow chart, illustrating steps of an embodiment of a method according to the invention
- Figure 1 shows a car 10 as a means of transport, in which a screen 3 of a user interface according to the invention as a display unit in the dashboard of the car 10 is inserted. Below the screen 3, a sensor 5 is arranged, which spans a detection area 9 in front of the screen 3 in space. A speaker 1 1 is provided for outputting hints of the user interface 1. Finally, there is also a data store s for providing predefined references for the
- the aforementioned components are connected to an evaluation unit in the form of an electronic control unit 7 in terms of information technology.
- the electronic control unit 7 is also set up to display graphic content 2 on the screen 3.
- FIG. 2 shows an overview of components of an embodiment of a user interface according to the invention in an embodiment of a user terminal 20 according to the invention in the form of a smartphone.
- the screen 3 of the smartphone represents the display unit, a microprocessor 7, the evaluation unit, a flash memory 8, the memory means and a speaker 1 1 a signal generator of the user interface 1 according to the invention.
- an infrared LED strip 5 as a sensor with the microprocessor 7 connected in terms of information technology.
- the latter is also coupled to an antenna 17 for wireless communication with a wireless infrastructure or other user terminals.
- a keyboard 6 of the smartphone 20 is partially cut to allow the view of the components behind it.
- FIG. 3 shows an operating step in which a menu 2 for selecting a radio station as graphical content by a user's hand 4 is to be operated on a screen 3 as a display unit.
- the user's hand 4 executes a predefined gesture in the detection area of the user interface. This consists in the example in that the open hand points in the direction of the screen 3 and the five fingers of the hand 4 are held out and held moderately spread.
- the evaluation unit (not shown) is set up, also further gestures of the hand 4 into commands for controlling the menu 2 on the
- FIG. 4 shows possible hand postures and gestures for interaction with a person
- inventive user interface 1 In part a, the open palm of the hand 4 points in the direction of the screen 3. The fingers of the hand 4 are stretched out and (slightly) spread. Partial figure b shows a pointing gesture of the hand 4, in which only the index finger is stretched, the remaining fingers are balled into a fist. In subfigure c, a hint gesture or click gesture is illustrated, in which the
- Forefinger of the hand 4 is initially stretched out and then folded in the direction of the screen 3.
- FIG. 5 shows an operating step which, following successful 3D gesture operation, may follow subsequent to the sign-on process discussed in FIG.
- FIG. 6 shows method steps of an exemplary embodiment of a method according to the invention for changing from a first operating mode of a user interface to a 3D gesture mode.
- a first step 100 graphical content is displayed on a display unit, which is subsequently to be operated via 3D gestures.
- the user guides his hand into a predefined detection area of a sensor of the user interface.
- step 200 the user's hand is detected by the sensor, and in step 300, a predefined posture and / or movement of the user's hand is detected.
- sensory, reliably detectable gestures that are nevertheless easily distinguishable from the usual postures / movements when handling the user are suitable.
- step 400 a timer is started, the sequence of which establishes another condition for starting the 3D gesture mode. Is it going? Timer off after the predefined posture / movement is completed (Y), the system remains in the first operating mode. Accordingly, the process returns to step 100 in this case. If the timer expires before the user's manual pose / movement is terminated, the system will switch from the first mode of operation to the 3D gesture mode in step 500 and will issue a visual and audible indication in step 600 that the 3D gesture mode has been successfully activated.
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
DE102014202833.7A DE102014202833A1 (de) | 2014-02-17 | 2014-02-17 | Anwenderschnittstelle und Verfahren zum Wechseln von einem ersten Bedienmodus einer Anwenderschnittstelle in einen 3D-Gesten-Modus |
PCT/EP2015/052549 WO2015121173A1 (fr) | 2014-02-17 | 2015-02-06 | Interface utilisateur et procédé de commutation d'un premier mode de commande d'une interface utilisateur en un mode gestuel en 3d |
Publications (1)
Publication Number | Publication Date |
---|---|
EP3108332A1 true EP3108332A1 (fr) | 2016-12-28 |
Family
ID=52544458
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP15705545.0A Withdrawn EP3108332A1 (fr) | 2014-02-17 | 2015-02-06 | Interface utilisateur et procédé de commutation d'un premier mode de commande d'une interface utilisateur en un mode gestuel en 3d |
Country Status (4)
Country | Link |
---|---|
EP (1) | EP3108332A1 (fr) |
CN (1) | CN106030462A (fr) |
DE (1) | DE102014202833A1 (fr) |
WO (1) | WO2015121173A1 (fr) |
Families Citing this family (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
DE102016011365A1 (de) * | 2016-09-21 | 2018-03-22 | Daimler Ag | Verfahren zur Steuerung eines Kraftfahrzeugmoduls und Kraftfahrzeugmodul |
DE102017201312A1 (de) | 2017-01-27 | 2018-08-02 | Audi Ag | Verfahren zum Steuern eines Temperierungselements eines Behälterhalters |
Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20110221666A1 (en) * | 2009-11-24 | 2011-09-15 | Not Yet Assigned | Methods and Apparatus For Gesture Recognition Mode Control |
DE202012005255U1 (de) * | 2012-05-29 | 2012-06-26 | Youse Gmbh | Bedienvorrichtung mit einer Gestenüberwachungseinheit |
Family Cites Families (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR100575906B1 (ko) * | 2002-10-25 | 2006-05-02 | 미츠비시 후소 트럭 앤드 버스 코포레이션 | 핸드 패턴 스위치 장치 |
JP3903968B2 (ja) * | 2003-07-30 | 2007-04-11 | 日産自動車株式会社 | 非接触式情報入力装置 |
KR20060070280A (ko) * | 2004-12-20 | 2006-06-23 | 한국전자통신연구원 | 손 제스처 인식을 이용한 사용자 인터페이스 장치 및 그방법 |
US7834847B2 (en) * | 2005-12-01 | 2010-11-16 | Navisense | Method and system for activating a touchless control |
DE102006037156A1 (de) | 2006-03-22 | 2007-09-27 | Volkswagen Ag | Interaktive Bedienvorrichtung und Verfahren zum Betreiben der interaktiven Bedienvorrichtung |
DE102009008041A1 (de) | 2009-02-09 | 2010-08-12 | Volkswagen Ag | Verfahren zum Betrieb eines Kraftfahrzeuges mit einem Touchscreen |
US8619029B2 (en) * | 2009-05-22 | 2013-12-31 | Motorola Mobility Llc | Electronic device with sensing assembly and method for interpreting consecutive gestures |
CN102221891A (zh) * | 2011-07-13 | 2011-10-19 | 广州视源电子科技有限公司 | 实现视像手势识别的方法和*** |
DE102012000263A1 (de) | 2012-01-10 | 2013-07-11 | Daimler Ag | Verfahren und Vorrichtung zum Bedienen von Funktionen in einem Fahrzeug unter Verwendung von im dreidimensionalen Raum ausgeführten Gesten sowie betreffendes Computerprogrammprodukt |
-
2014
- 2014-02-17 DE DE102014202833.7A patent/DE102014202833A1/de not_active Withdrawn
-
2015
- 2015-02-06 CN CN201580009060.2A patent/CN106030462A/zh active Pending
- 2015-02-06 EP EP15705545.0A patent/EP3108332A1/fr not_active Withdrawn
- 2015-02-06 WO PCT/EP2015/052549 patent/WO2015121173A1/fr active Application Filing
Patent Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20110221666A1 (en) * | 2009-11-24 | 2011-09-15 | Not Yet Assigned | Methods and Apparatus For Gesture Recognition Mode Control |
DE202012005255U1 (de) * | 2012-05-29 | 2012-06-26 | Youse Gmbh | Bedienvorrichtung mit einer Gestenüberwachungseinheit |
Non-Patent Citations (1)
Title |
---|
See also references of WO2015121173A1 * |
Also Published As
Publication number | Publication date |
---|---|
DE102014202833A1 (de) | 2015-08-20 |
WO2015121173A1 (fr) | 2015-08-20 |
CN106030462A (zh) | 2016-10-12 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP2200858B1 (fr) | Systeme de vehicule a fonction d'assistance | |
EP3108331B1 (fr) | Interface utilisateur et procédé pour commander sans contact un élément de commande intégré dans un équipement selon un mode gestuel en 3d | |
WO2015010752A1 (fr) | Procédé et dispositif de commande à distance d'une fonction d'un véhicule automobile | |
EP3118048B1 (fr) | Selection de fonction par commande gestuelle comprenant un retour haptique | |
EP3358454B1 (fr) | Interface utilisateur, véhicule et procédé de distinction de l'utilisateur | |
DE102014200993A1 (de) | Anwenderschnittstelle und Verfahren zur Anpassung einer Ansicht auf einer Anzeigeeinheit | |
DE102018100197A1 (de) | Verfahren zum Betreiben einer Mensch-Maschinen-Schnittstelle sowie Mensch-Maschinen-Schnittstelle | |
DE102013020795A1 (de) | Verfahren und Anordnung zum Steuern von Funktionen eines Kraftfahrzeugs | |
DE102014019005A1 (de) | Verfahren zum Betreiben einer Bedienvorrichtung eines Kraftfahrzeugs in unterschiedlichen Bedienmodi sowie Bedienvorrichtung und Kraftfahrzeug | |
EP3108332A1 (fr) | Interface utilisateur et procédé de commutation d'un premier mode de commande d'une interface utilisateur en un mode gestuel en 3d | |
EP2030828B1 (fr) | Système de commande multimodal et procédé de commande de composants et de fonctions dans un véhicule | |
WO2017140569A1 (fr) | Dispositif de commande d'un véhicule automobile et procédé de fonctionnement d'un dispositif de commande pour provoquer un effet de changement entre un plan virtuel de représentation et une main | |
DE102014200609A1 (de) | Berührungssensitive Bedienvorrichtung mit Mulde | |
DE102013019570A1 (de) | Bedieneinrichtung mit berührungsloser Schrifteingabefunktion für ein Kraftfahrzeug, Kraftfahrzeug und Verfahren zum Betreiben einer Bedieneinrichtung | |
EP3108333B1 (fr) | Interface utilisateur et procédé d'assistance d'un utilisateur lors de la commande d'une interface utilisateur | |
DE102010009622A1 (de) | Verfahren zum Betreiben einer Benutzerschnittstelle und Vorrichtung dazu, insbesondere in einem Fahrzeug | |
DE102016003072A1 (de) | Bedienvorrichtung und Verfahren zum Erfassen einer Benutzerauswahl zumindest einer Bedienfuktion der Bedienvorrichtung | |
DE102009033061A1 (de) | Verfahren und Vorrichtung zum Steuern einer Benutzerschnittstelle | |
DE102015222682A1 (de) | Verfahren zum Aktivieren eines Bedienelements eines Kraftfahrzeugs und Bediensystem für ein Kraftfahrzeug | |
DE102013016490B4 (de) | Kraftfahrzeug mit berührungslos aktivierbarem Handschrifterkenner | |
DE102011116312A1 (de) | Verfahren und Eingabevorrichtung zum Steuern eines elektronischen Geräts | |
WO2021028274A1 (fr) | Système utilisateur et procédé pour faire fonctionner un système utilisateur | |
DE102017210958A1 (de) | Verfahren zur taktilen Interaktion eines Benutzers mit einem elektronischen Gerät sowie elektronisches Gerät dazu | |
DE102014111749A1 (de) | Verfahren und Vorrichtung zum Steuern eines technischen Gerätes | |
WO2021004681A1 (fr) | Procédé pour faire fonctionner un système de commande utilisateur et système de commande utilisateur |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
17P | Request for examination filed |
Effective date: 20160919 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
AX | Request for extension of the european patent |
Extension state: BA ME |
|
RIN1 | Information on inventor provided before grant (corrected) |
Inventor name: WILD, HOLGER Inventor name: CZELNIK, MARK PETER |
|
17Q | First examination report despatched |
Effective date: 20181108 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN |
|
18D | Application deemed to be withdrawn |
Effective date: 20200305 |