EP1444566A2 - Input device, webcam and screen having a voice input function - Google Patents
Input device, webcam and screen having a voice input functionInfo
- Publication number
- EP1444566A2 EP1444566A2 EP02787724A EP02787724A EP1444566A2 EP 1444566 A2 EP1444566 A2 EP 1444566A2 EP 02787724 A EP02787724 A EP 02787724A EP 02787724 A EP02787724 A EP 02787724A EP 1444566 A2 EP1444566 A2 EP 1444566A2
- Authority
- EP
- European Patent Office
- Prior art keywords
- input device
- voice control
- manual input
- control signals
- integrated
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
- G06F1/16—Constructional details or arrangements
- G06F1/1601—Constructional details related to the housing of computer displays, e.g. of CRT monitors, of flat displays
- G06F1/1605—Multimedia displays, e.g. with integrated or attached speakers, cameras, microphones
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/02—Input arrangements using manually operated switches, e.g. using keyboards or dials
- G06F3/0202—Constructional details or processes of manufacture of the input device
- G06F3/021—Arrangements integrating additional peripherals in a keyboard, e.g. card or barcode reader, optical scanner
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
- G06F3/0354—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
- G06F3/03543—Mice or pucks
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/16—Sound input; Sound output
Definitions
- Input device webcam and screen with voice input function
- the present invention relates to a manual input device for generating control signals for real and / or virtual objects, a screen and an Internet camera attachment for a computing device.
- keyboards, mice, trackballs and joysticks are widely used today. They are used to control cursors, mouse pointers etc., for example to navigate through a virtual scene or to move virtual objects that are graphically displayed on a screen. While keyboards and mice need a fixed storage space in order to be operated efficiently, using a touch screen or a touch panel is possible directly to point at objects shown on the screen with your finger without the need for additional space-consuming additional devices on the desk.
- US-A-5,757,360 discloses an egg-shaped input device for computers which can be moved freely in space by a user's hand, determines its current positions, directions of movement, speeds and accelerations and transmits this kinematic data wirelessly to a computer.
- An analog movement sequence in the form of a movement pattern is identified, from which movement commands are derived and converted into an animated graphic representation.
- the movement patterns are then automatically recognized with the aid of a pattern recognition algorithm. Control commands are also generated.
- the disadvantage of this method is that it cannot be freely specified, since the user's movement sequences, which are recorded by the input device in an analog manner, correspond to corresponding movement sequences of stored movement sequences of an animated graphic representation and can only be represented as such.
- Input devices which have manually operated force / torque sensors are known, for example, from the patents DE 36 11 336 C2, DE 37 64 287 and EP 0 979 990 A2.
- a conceivable solution would be the input of the numerical data by means of voice control signals (English: “Voice Control”).
- voice Control the user must carry an attachment according to the prior art on his head that carries a microphone.
- This attachment must be worn by the user (English: “headset”).
- This solution also has ergonomic problems, since on the one hand the user now has to handle a total of four input devices, namely the force / moment sensor, the normal computer mouse, the keyboard and the microphone.
- the number of connections for example on the back of the computer to which the four devices mentioned are to be connected, is not sufficient, or there are double assignments if at least two of the devices mentioned have the same connection type (e.g. USB, RS 232 C) are required.
- a manual input device for generating control signals for real and / or virtual objects.
- the manual input device can not only be used to control computers, but also to control robots. tern or other real objects.
- a microphone for recording and converting acoustic voice control signals from a user into electrical signals is integrated in the housing of the manual input device.
- This advantageous embodiment achieves two advantages by means of a single measure: on the one hand, the integration of the microphone into the housing of the manual input device relieves the user of handling an input device.
- the interface of the input device can also be used for the transmission of acoustic voice control signals or their evaluation. This reduces the number of occupied interfaces on the computer. According to the invention, the avoidance of two disadvantages from the prior art is thus achieved by a single simple measure.
- a processing unit e.g. an application-specific integrated semiconductor component (ASIC) can be provided, which subjects the output signals from the microphone to an algorithm for automatic speaker identification, speech recognition, analysis and / or interpretation. If a speech recognition algorithm that is independent of the voice of the respective speaker is implemented, the implementation of the automatic speaker identification can be omitted.
- the manual input device not only transmits acoustically or electrically converted signals to the computing unit, but rather commands which can be processed directly by a computer are conveyed.
- “voice control” also means the input of (for example numerical) values or texts. Voice control is therefore also to be understood in the sense of “voice input” (input of information and control commands).
- the manual input device can be, for example, a conventional computer mouse, a force / moment sensor or a keyboard.
- the voice control function ie the activation of the recording and implementation of acoustic voice control signals by the combination of input device and microphone, can be activated by actuating the manual input device (for example by means of a special key).
- the manual input device can be operated together with driver software that automatically activates the voice control function (recording and converting acoustic voice control signals) as soon as the manual input device is connected to a connection provided on the computing unit. This is a particularly advantageous solution because, when the input device is connected, not only is it possible to enter the usual control commands (cursor or mouse pointer control, etc.) for the computing unit, but the speech recognition function is also provided at the same time.
- the voice control activation function can be integrated directly into the driver software that is used to implement the other control signals (cursor or object control). This has the advantage that the user does not have to install two different software packages for the manual input device and the voice control, but rather the control signal function and the voice control function can be installed simultaneously by installing a single driver software.
- interpreted and processed voice control. signals are transmitted together with the other control commands (for example for cursor control, etc.) to a computing unit via a common wired or wireless interface.
- the other control commands for example for cursor control, etc.
- Such an input device is particularly advantageous in the field of CAD, desktop publishing or the like.
- an Internet camera attachment for a computing device.
- Such camera attachments are often referred to as webcams.
- a microphone is integrated in the housing of the Internet camera attachment.
- a microphone can also be permanently connected to the housing of the webcam or attached to it.
- the invention relates equally to microphones integrated into the display housing for voice input.
- Fig. 1 shows a first embodiment in which a microphone for recording and converting acoustic voice control signals into electrical signals, an ASIC for automatic speaker identification, speech recognition, analysis and interpretation as well as a button for manual activation of the voice control function are integrated in the housing of a computer mouse .
- FIG. 2 shows a second exemplary embodiment, in which a microphone for recording and converting acoustic speech signals into the housing of a computer keyboard.
- Fig. 3 shows a third embodiment in which in the housing of an Internet
- Camera attachment (“webcam”), a microphone for recording and converting acoustic voice control signals into electrical signals, an ASIC for automatic speaker identification, speech recognition, analysis and interpretation and a button for manual activation of the voice control function are integrated, and
- Fig. 4 shows a fourth embodiment in which in the housing of a computer screen, a microphone for recording and converting acoustic voice control signals into electrical signals, an ASIC for automatic Speaker identification, speech recognition, analysis and interpretation and a button for manual activation of the voice control function are integrated.
- FIGS. 1 to 4 The functions of the assemblies contained in four different exemplary embodiments of the present invention, as shown in FIGS. 1 to 4, are described in more detail below. The meaning of the symbols provided with reference symbols in FIGS. 1 to 4 can be found in the attached list of reference symbols.
- a computer 7 with a screen 7a, a mouse or a force / moment sensor 1 and a keyboard 1 'as manual input devices for entering control commands and an Internet camera attachment 1 "(English:" webcam ") mapped.
- This computer 7 represents only one example of an environment in which real and / or virtual objects can be controlled.
- a CAD program can be installed on the computer 7.
- the manual input devices 1, 1 'and / or the webcam 1 "are expanded in such a way that they each have an integrated microphone 3, as shown in FIGS. 1 to 4.
- voice control signals of the user can be recorded , converted into electrical signals and converted into suitable commands for controlling the computer 7 by means of a processing unit 4 (microprocessor), for example an application-specific integrated semiconductor component (ASIC).
- ASIC 4 subjects the output signals of the microphone 3 to an algorithm for automatic speaker identification (if a speech recognition algorithm that is independent of the voice of the respective speaker is implemented), speech recognition and analysis and interprets them as control signals for the connected computer.
- the control signals are preferably such that they are related to the configuration / setting or the operation of the input device or the webcam.
- Settings can be made by language (assignment of the degrees of freedom of the input device, etc.) or functions can be triggered.
- the driver Software (usually on the computer) for the input device or the webcam a function that enables the evaluation of the voice-controlled control signals.
- the processor 4 for the speech signal evaluation is preferably arranged in the housing of the input device or the webcam, usually as a separate component separate from the processors for the image signal evaluation or the evaluation of the signals from the input device.
- the voice signal evaluation can preferably be stored as firmware.
- the implemented and evaluated commands are then transmitted to the computer 7 via the same interface 8, which is also provided for the transmission of the other control commands via the mouse 1 or the keyboard 1 'for controlling the cursor or the mouse pointer.
- the voice control function can be activated on the manual input device 1, 1 'by means of a special key - key 5 in the case of the mouse 1 or key 5' in the case of the keyboard 1 '.
- the driver software for the input device automatically activates the voice control function as soon as the input device 1, 1 'or the webcam 1 "is connected to the corresponding port 6 (for example a USB port 6 or a serial RS 232 port). Interface etc.) of the computer 7.
- the voice control function or the voice Control activation function can be integrated, which reduces the installation effort for the user. With the connection of the manual input device 1, 1 ', the voice control is also available at the same time.
- wired interface 8 which serves for the joint transmission of the recognized, linguistically analyzed and interpreted voice control signals converted into electrical signals, together with the other control commands
- wired interface 8 which serves for the joint transmission of the recognized, linguistically analyzed and interpreted voice control signals converted into electrical signals, together with the other control commands
- An infrared interface or an interface according to the Bluetooth standard is suitable for this wireless interface.
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- Computer Hardware Design (AREA)
- Multimedia (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- General Health & Medical Sciences (AREA)
- User Interface Of Digital Computer (AREA)
- Position Input By Displaying (AREA)
Abstract
Description
Claims
Applications Claiming Priority (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
DE10156457 | 2001-11-16 | ||
DE10156457 | 2001-11-16 | ||
PCT/EP2002/012918 WO2003042802A2 (en) | 2001-11-16 | 2002-11-18 | Input device, webcam and screen having a voice input function |
Publications (1)
Publication Number | Publication Date |
---|---|
EP1444566A2 true EP1444566A2 (en) | 2004-08-11 |
Family
ID=7706059
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP02787724A Withdrawn EP1444566A2 (en) | 2001-11-16 | 2002-11-18 | Input device, webcam and screen having a voice input function |
Country Status (4)
Country | Link |
---|---|
US (1) | US20040080622A1 (en) |
EP (1) | EP1444566A2 (en) |
AU (1) | AU2002352051A1 (en) |
WO (1) | WO2003042802A2 (en) |
Families Citing this family (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20070109410A1 (en) * | 2005-11-15 | 2007-05-17 | Creative Technology Ltd. | Apparatus for audio reproduction and image capturing |
US7949536B2 (en) * | 2006-08-31 | 2011-05-24 | Microsoft Corporation | Intelligent speech recognition of incomplete phrases |
KR101115467B1 (en) * | 2009-09-30 | 2012-02-24 | 주식회사 팬택 | Terminal and method for providing virtual keyboard |
US9557828B2 (en) | 2010-10-15 | 2017-01-31 | Zuken Inc. | Input information processing system, input information processing method, program and computer-readable recording medium |
US10430212B1 (en) * | 2016-07-13 | 2019-10-01 | Screenshare Technology Ltd. | Method for recording, editing and reproduction of computer session |
CN107204188A (en) * | 2017-06-13 | 2017-09-26 | 大连东软信息学院 | Computerized speech assistant devices and its method of work |
CN110308747B (en) * | 2019-06-26 | 2022-05-31 | 西南民族大学 | Electronic type full-automatic computer operating device based on machine vision |
TWI812973B (en) * | 2021-07-02 | 2023-08-21 | 矽統科技股份有限公司 | Touch system and sensing method thereof and active pen |
Family Cites Families (14)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CA2080802A1 (en) * | 1991-10-21 | 1993-04-22 | Anthony Garcia | Computer mouse and microphone combination and method for using the same |
US5339095A (en) * | 1991-12-05 | 1994-08-16 | Tv Interactive Data Corporation | Multi-media pointing device |
US5757360A (en) * | 1995-05-03 | 1998-05-26 | Mitsubishi Electric Information Technology Center America, Inc. | Hand held computer control device |
JPH0965224A (en) * | 1995-08-24 | 1997-03-07 | Hitachi Ltd | Television receiver |
EP0836324B1 (en) * | 1996-10-09 | 2004-12-08 | Polycom, Inc. | Integrated portable videoconferencing |
US6026417A (en) * | 1997-05-02 | 2000-02-15 | Microsoft Corporation | Desktop publishing software for automatically changing the layout of content-filled documents |
US6489947B2 (en) * | 1997-08-15 | 2002-12-03 | Ergodevices Corp. | Ergonomic dual-section computer-pointing device |
DE19835809A1 (en) * | 1998-08-07 | 2000-02-10 | Thomas Teufel | Combo mouse |
FR2783625B1 (en) * | 1998-09-21 | 2000-10-13 | Thomson Multimedia Sa | SYSTEM INCLUDING A REMOTE CONTROL DEVICE AND A VOICE REMOTE CONTROL DEVICE OF THE DEVICE |
US6348912B1 (en) * | 1999-05-25 | 2002-02-19 | Micron Technology, Inc. | Family mouse |
WO2001040893A2 (en) * | 1999-12-03 | 2001-06-07 | Cyberscan Technology, Inc. | Method, system and apparatus for electronic face-to-face business and retail brokerage |
US20010012998A1 (en) * | 1999-12-17 | 2001-08-09 | Pierrick Jouet | Voice recognition process and device, associated remote control device |
US6611725B1 (en) * | 2000-02-03 | 2003-08-26 | Solidworks Corporation | Computer drawing system |
US6859358B2 (en) * | 2001-09-14 | 2005-02-22 | International Business Machines Corporation | Sub-notebook portable computer with integrated wireless mobile telephone |
-
2002
- 2002-11-18 US US10/450,088 patent/US20040080622A1/en not_active Abandoned
- 2002-11-18 EP EP02787724A patent/EP1444566A2/en not_active Withdrawn
- 2002-11-18 AU AU2002352051A patent/AU2002352051A1/en not_active Abandoned
- 2002-11-18 WO PCT/EP2002/012918 patent/WO2003042802A2/en not_active Application Discontinuation
Non-Patent Citations (1)
Title |
---|
See references of WO03042802A2 * |
Also Published As
Publication number | Publication date |
---|---|
WO2003042802A2 (en) | 2003-05-22 |
WO2003042802A3 (en) | 2004-04-01 |
US20040080622A1 (en) | 2004-04-29 |
AU2002352051A1 (en) | 2003-05-26 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP1428110B1 (en) | Three-dimensional integrated touch screen input apparatus | |
DE69018708T2 (en) | Three-dimensional mouse with a recess. | |
DE10004372B4 (en) | Design of sensations of strength for computer applications with noises | |
EP2130109B1 (en) | Mobile communication device and input device for the same | |
DE69225550T2 (en) | Method and device for reducing the operating effort for a touch-sensitive screen | |
DE112017004677T5 (en) | Touch-sensitive keyboard | |
DE102011114535A1 (en) | Data glove with tactile feedback information and procedures | |
DE102008061039A1 (en) | Method for optical multitouch control for graphical user interface | |
DE10056291A1 (en) | Visual display of objects in field of view for man-machine communication by acquiring information input by user using signal or pattern recognition | |
EP3040817A1 (en) | Device and method for inputting a text using virtual control elements with haptic feedback for simulating key haptics, especially in a motor vehicle | |
WO2003023592A2 (en) | Desktop manager | |
DE102007018364A1 (en) | Pointing device for three-dimensional space navigation using multiple finger-operated sensors | |
DE102015012720B4 (en) | Interactive operating system and method for performing an operating action in an interactive operating system | |
DE102013216152A1 (en) | Ultrasonic head with control device and method for controlling an ultrasound device | |
EP1573502A2 (en) | Rapid input device | |
DE102016206719A1 (en) | Touch input device and vehicle with a touch input device | |
EP1444566A2 (en) | Input device, webcam and screen having a voice input function | |
EP3093182B1 (en) | Means of locomotion, working machine, user interface and method for displaying the content of a first display device on a second display device | |
DE102015003883B4 (en) | Motor vehicle simulation arrangement for simulating a virtual environment with a virtual motor vehicle and method for simulating a virtual environment | |
DE10155030A1 (en) | desktop Manager | |
DE102013202818B4 (en) | Method for controlling an application and associated system | |
EP0878754A2 (en) | Process for interacting with a computer, display and interface for using this process | |
WO2015176707A1 (en) | Input device, computer or operating system, and vehicle | |
DE102019114752A1 (en) | Method, device and computer program for detecting an input and vehicle with such a device | |
DE202023001912U1 (en) | Input device manipulator |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
17P | Request for examination filed |
Effective date: 20040405 |
|
AK | Designated contracting states |
Kind code of ref document: A2 Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR IE IT LI LU MC NL PT SE SK TR |
|
AX | Request for extension of the european patent |
Extension state: AL LT LV MK RO SI |
|
17Q | First examination report despatched |
Effective date: 20070726 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: 8566 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN |
|
18D | Application deemed to be withdrawn |
Effective date: 20071206 |