EP1803053A1 - A hand-held electronic appliance and method of entering a selection of a menu item - Google Patents
A hand-held electronic appliance and method of entering a selection of a menu itemInfo
- Publication number
- EP1803053A1 EP1803053A1 EP04790324A EP04790324A EP1803053A1 EP 1803053 A1 EP1803053 A1 EP 1803053A1 EP 04790324 A EP04790324 A EP 04790324A EP 04790324 A EP04790324 A EP 04790324A EP 1803053 A1 EP1803053 A1 EP 1803053A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- entry
- pen
- menu
- hand
- electronic appliance
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
- G06F3/046—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by electromagnetic means
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F3/0482—Interaction with lists of selectable items, e.g. menus
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
- G06F2203/048—Indexing scheme relating to G06F3/048
- G06F2203/04807—Pen manipulated menu
Definitions
- the present invention relates to the field of hand-held electronic appliances, such as mobile phones, smart phones, personal digital assistants (PDA), navigation systems, electronic cameras, digital photo viewers and multipurpose hand-held electronic appliances.
- hand-held electronic appliances such as mobile phones, smart phones, personal digital assistants (PDA), navigation systems, electronic cameras, digital photo viewers and multipurpose hand-held electronic appliances.
- PDA personal digital assistants
- US Patent Number 6,667,740B2 shows a hand-held personal digital assistant (PDA) which includes an xy digitising system behind the PDA's liquid crystal display which can sense the xy position of a resonant stylus.
- PDA personal digital assistant
- a mobile telephone is disclosed that has a liquid crystal display, and sensor windings and excitation windings of a digitising system under the display. The digitising system is operable to sense the position of a resonant stylus relative to the display.
- the digitising system of the mobile telephone may be used to allow a user to create short text messages which can then be sent by the mobile telephone to another party. If the mobile telephone includes an organiser, then the digitiser can be used to control the inputting, manipulation and outputting of data from the organiser.
- some hand-held electronic appliances In order to facilitate a user's interaction some hand-held electronic appliances have a graphical user interface for a user's selections of icons of the graphical user interface by means of an entry pen. Such prior art hand-held electronic appliances have resistive interfaces that require that the entry pen is pressed against the surface of the display for a user's interaction. Examples for such prior art hand-held electronic appliances include PDAs that are commercially available from PalmOne (www.palm1.com).
- US Patent Number 6, 664,991 shows a user interface for a pen-based device that allows users to activate the full "card" for an entry using a single tap whilst also giving the user the ability to reach a menu of context dependent commands using a simple gesture.
- the gesture consists of pressing and holding the stylus on a selection for a system-specified length of time. If the user does not move the stylus more than a system-specified distance from the original location for that time, a context menu gesture is recognised and the application displays a context menu.
- pressing and holding an external button on the pen-based device while an entry is highlighted is considered a context menu gesture.
- double tapping the stylus or pressing and holding an external button whilst tapping the stylus are considered context menu gestures.
- a hand-held electronic appliance that has graphical user interface means for displaying at least one context menu.
- the context menu has a number of menu items.
- the hand-held electronic appliance has pen entry means for contactless selection of one of the menu items. Further, the hand-held electronic appliance has means for entering the selection.
- the pen entry means for contactless selection can be implemented using capacitive and / or inductive position sensing technologies.
- Such contactless position sensing technologies are as such known from the prior art (e.g. EP 0259 894 B1 ,EP 0307667 B1 ; US 6,485,306 B1 ; US 5,600,105; US 6,667,740 B2; US 5,488,204; US 5,942,733 and US 6,380,929 ).
- the present invention is particularly advantageous as it facilitates a user's interaction with the hand-held electronic appliance.
- the user can select a menu item of a context menu without contacting the surface of the display which makes the user's interaction much more convenient. For example, the user can move the entry pen over the display while there is a gap between the surface of the display and the entry pen for convenient selection of a menu item within a context menu.
- this entry can be performed by depressing the pen tip of the entry pen onto the surface of the display or by operating a switch of the entry pen. In the latter case both the selection of the menu item and entry of the selection can be performed without contacting the surface of the display with the entry pen.
- At least one of the menu items of the context menu has an assigned context sub-menu.
- the graphical user interface displays the sub-menu in response to a contactless selection of the menu item to which the sub- menu is assigned.
- the graphical user interface comprises an icon that represents the context menu.
- the icon is selected by means of the entry pen, the context menu that is represented by the icon is displayed for the user's selection of the menu item.
- the graphical user interface comprises a number of context menus.
- the context menus provide selectable choices or options to a user in a stack of panes, with one choice being provided per pane. Each pane carries one menu item.
- the context menus are relatively small, with typically only a word or two of text being provided in each pane.
- the context menus are categorised. For example, there is one context menu for entering and / or viewing user settings, a context menu for communication functions, a context menu for organiser functions, a context menu for navigation functions, a context menu for digital camera functions and / or for other functionalities of the hand-held electronic appliance.
- Each of the context menus can have one or more levels of sub ⁇ menus.
- the graphical user interface has a context manual for convenient dialling of telephone numbers.
- Each menu item represents a telephone number that is used relatively frequently by the user.
- a menu item can show a person's or organisation's name and / or the person's or organisation's telephone number.
- For convenient dialing the user selects one of the telephone numbers from the context menu and enters the selection. In response to the entry of the selection the selected number is called.
- email addresses or other communication links can be provided as menu items for convenient user selection.
- the present invention is particularly advantageous for multi-function hand-held electronic appliances such as so-called smart phones that include an electronic organiser and / or other functionalities, such as a digital camera and/or a navigation system.
- the present invention facilitates a user's intuitive and ergonomic interaction with such complex hand ⁇ held electronic appliances.
- Figure 1 Is a schematic top view of an embodiment of a hand-held electronic appliance of the invention
- Figure 2 is a perspective view of a position sensor illustrating electromagnetic coupling between the position sensor and the entry pen
- Figure 3 shows the hand-held electronic appliance of figure 1 after a user's selection of a menu item
- Figure 4 shows a block diagram of a more detailed embodiment of the hand-held electronic appliance
- Figure 5 is a flow diagram showing a preferred mode of operation of the hand-held electronic appliance of figure 4
- Figure 6 is a perspective view showing an embodiment of the configuration of the position-detecting system of the hand-held electronic appliance of figure 4
- Figure 7 is a flow chart illustrating an embodiment of the method of the invention.
- FIG. 1 shows a schematic view of the hand-held smartphone 100.
- the smartphone 100 has about the size of a palm and is battery powered. It has a wireless interface to a digital cellular communication network, such as a GSM, UMTS, CDMA, WLAN or other kind of wireless network. By means of the wireless interface a user can make phone calls, send email and / or connect to the Internet.
- a digital cellular communication network such as a GSM, UMTS, CDMA, WLAN or other kind of wireless network.
- the smartphone 100 has a housing 101 ; the housing 101 has clips 104 for receiving an entry pen 124.
- the entry pen 124 has a pen tip 128 and / or a side switch 126.
- the entry pen 124 has internal circuitry for generating a signal when the pen tip 128 is depressed and / or when the side switch 126 is operated when the entry pen 124 is in the proximity of the display 130 of the smartphone 100.
- the entry pen 124 may or may not have a battery for powering its internal circuitry.
- the entry pen 124 includes internal circuitry for electromagnetic coupling with transmission and sensor coils disposed behind the display 130. Electromagnetic coupling has the advantage that the need for a battery within the entry pen 124 can be avoided as the entry pen is powered by the electromagnetic waves it receives from the transmission coils.
- the entry pen 124 can be designed in accordance with EP0259894B1 or EP0307667B1.
- the housing 101 may have a reception hole for receiving the entry pen 124 with clips disposed inside the reception hole.
- the smartphone 100 has an operating system that provides a graphical user interface such as the Symbian OS, the Palm OS or the Pocket PC Operating System.
- the graphical user interface has an icon 184 for entering and / or viewing of user settings, an icon 186 for selecting communication functionalities, such as making a phone call, sending an email and / or connecting to the Internet, and icon 188 for access to organiser functionalities, such as entering or viewing a task, a calendar entry, and / or an address, and an icon 190 for access to camera functionalities of the built-in digital camera of the smartphone 100.
- the graphical user interface of the smartphone 100 may include additional or other icons for access to other functionalities, such as access to the functionalities of a built-in GPS navigation system, a digital photo viewer or the like.
- the graphical user interface has a cursor 192; the cursor 192 serves as a pointer for a user's graphic selection of one of the icons 184 to 190 or of another graphical element of the graphical user interface displayed on the display 130.
- the cursor 192 can be moved by means of the entry pen 124 without a need to contact the surface of the display 130.
- the user orients the pen tip 128 to a xy position within the display 130 without a requirement to contact the surface of the display 130.
- the orientation of the pen tip 128 is sensed by means of the receiver coils disposed behind the display 130 and the respective position information is entered into the processor of the smartphone 100.
- the cursor 192 is moved to the position to which the pen tip 128 points.
- a user can conveniently move the cursor 192 to any position within display 130 by means of entry pen 124 without a need to touch the surface of the display 130 with the pen tip 128.
- the contactless coupling between the entry pen 124 and the transmission and sensor coils disposed behind the display 130 is schematically illustrated in the perspective view of figure 2.
- a printed circuit board 194 is disposed behind the display 130 (cf figure 1 ) such that it forms an under layer of the display 130.
- the printed circuit board 194 carries a sensor unit which extends in the plane, including a transmission coil unit for transmission of position detecting signals for detecting the position of the entry pen 124 relative to the display 130. Further, the printed circuit board 194 has a sensor coil unit for receiving position indicating signals indicating the position of the entry pen 124.
- the sensor coil unit includes a plurality of sensor coils arranged in the x and y directions.
- the printed circuit board 194 has a connector 196 for coupling the printed circuit board 194 to an integrated circuit that controls operation of the position sensing and signal exchange with the entry pen 124 and delivers position data and other data such as pen tip up / down information or information indicative of the pen side switch position.
- the electromagnetic coupling between the entry pen 124 and the printed circuit board 194 has a certain contactless user range which enables interaction.
- the electromagnetic coupling between the entry pen 124 and the printed circuit board 194 is sufficiently strong to sense the entry pen position, if the gap 198 between the pen tip 128 and the printed circuit board 194 is below 30mm, preferably below 20mm.
- Figure 3 illustrates a user's interaction for selection of a user setting.
- the user For entering the user setting the user moves the cursor 192 onto the icon 184 by means of entry pen 124 without a requirement for contacting the surface of the display 130 with the pen tip 128.
- the context menu 197 that is assigned to the icon 184 is displayed on the display 130.
- the context menu 197 has a number of menu items, e.g.
- 'lock / unlock phone' for locking / unlocking the smartphone 100
- 'ringing type' for selection of the ringing tone type
- 'messages' for reading or deleting a message
- 'auto answer on / off' for setting the automatic answer functionality on or off
- 'clear last call' for setting the last-called numbers to be cleared or retained when the smartphone 100 is switched off
- 'emergency' for setting a key on / off for one-touch dialling of emergency calls
- 'restrictions' for setting call restrictions and / or other menu items for viewing and / or changing user settings.
- the user desires to change the ringing tone type of the smartphone 100.
- the user moves the cursor 192 from the icon 184 over the context menu 197 onto the menu item 'ringing type'.
- the menu item 'ringing type' has an assigned sub-menu.
- the fact that the menu item 'ringing type' has a sub-menu is symbolised by the arrow symbol 199 next to the words 'ringing type' of the respective menu item.
- the menu items 'messages' and 'restrictions' have assigned sub ⁇ menus as symbolised by the respective arrow symbols.
- a selected menu item and/or sub-menu item is highlighted.
- the sub-menu 195 When the cursor 192 is on the menu item 'ringing type' the sub-menu 195 that is assigned to the menu item 'ringing type' is displayed next to the arrow symbol 199.
- the sub-menu 195 has menu items 'tone A', 'tone B', and 'tone C corresponding to respective ringing tone types A, B and C.
- the user wants to select the ringing tone type B, he or she moves the cursor 192 onto the menu item 'tone B' over the sub-menu 195 by means of the entry pen 124 without a need to touch the surface of the display 130.
- the cursor 192 is on the menu item 'tone B' the user can perform a user input action in order to enter his or her selection of the menu item 'tone B' for entering the selection of the desired ringing tone type B.
- This user input action can be performed by depressing the pen tip 128 onto the menu item 'tone B' when the cursor 192 is positioned on the menu item 'tone B'.
- the user can operate the side switch 126 of the entry pen 124 in order to enter the selection of ringing tone type B when the cursor 192 is positioned on the menu item 'tone B'.
- the entry pen 124 generates a signal that is received by the senor coils of the printed circuit board 194 (cf. figure 2). That signal is entered into the microprocessor of the smartphone 100 for entry of the user's selection.
- the user can select or de-select the respective setting by performing the user input action after the cursor 192 has been moved onto the respective menu item. For example, if the user wants to set automatic answer on or off, he or she moves the cursor 192 onto the 'auto answer on / off' menu item and then performs the user entry action, e.g. depressing the pen tip 128 against the surface of the display 130 or operating the side switch 126.
- the other icons 186, 188, and 190 have assigned respective context menus. Access to the context menus, menu items, and sub-menus, if any, works the same way as explained with respect to the icon 184.
- the present invention is particularly advantageous as it makes a user's interaction with the smartphone 100 more convenient by enabling contactless selection of context menus, menu items, sub-menus and sub-menu items.
- the contactless selection of menu items has ergonomic advantages.
- the invention reduces the risk of repetitive strain injury when the smartphone 100 is used frequently.
- FIG 4 shows a block diagram of a more detailed embodiment of a portable hand-held electronic appliance 300.
- the electronic appliance 300 is an implementation of the smartphone 100 (cf. figures 1 , 2 and 3). Elements of the electronic appliance 300 that correspond to elements of the smartphone 100 are designated by like reference numerals.
- the electronic appliance 300 has a position sensor 302 for sensing the position of an entry pen 324.
- the position sensor 302 can be implemented as a printed circuit board (cf. printed circuit board194 shown in figure 2).
- the position sensor 302 is located behind the display 330 for sensing a position of the entry pen 324 relative to the display and for receiving user entry signals from the entry pen 324.
- the entry pen 324 has a side switch 326 that can be operated by a user and a pen tip 328.
- the display 330 can be a liquid crystal display or an organic light emitting diode (OLED) display or another kind of display.
- OLED organic light emitting diode
- the position sensor senses the position of the entry pen 324 relative to the display 330 by electromagnetic coupling.
- the position sensor 302 can receive a user entry signal from the entry pen 324.
- a user entry signal is an electromagnetic signal that is emitted from the entry pen 324 in order to indicate a switch position of the side switch 326 and / or whether the pen tip 328 is depressed or not.
- the electronic appliance 300 has an integrated circuit 306 for controlling operation of the position sensor 302 and for processing position signals received from the position sensor 302.
- the integrated circuit 306 has analogue circuitry 332 that comprises a transmission component 334 and a reception component 336.
- the transmission component 334 and the reception component 336 serve to generate control signals 338 for controlling the transmission of electromagnetic signals from the position sensor 302 to the entry pen 324 and the reception of electromagnetic signals from the entry pen 324 by the position sensor 302.
- the resultant position signal 304 that carries the position information is received by the reception component 336 which provides the sampled position signal 304 to the position signal processing component 310.
- the position signal processing component 310 belongs to logic circuitry 340 of the integrated circuit 306. In the preferred embodiment considered here, the position signal processing component 310 is provided by a set of instructions of the firmware 342 which is executed by logic circuitry 340.
- the firmware 342 has a position sensor control component 344 which is a set of firmware instructions for controlling overall operation of the position sensor 302 and the analogue circuitry 332. Further, the firmware 342 has a generator component 346 which is a set of firmware instructions for generating an identifier for each position dataset that is provided by the position signal processing component 310.
- the interrupt component 348 is a set of firmware instructions for generating an interrupt 320 when a new acquisition scan of the position data is performed.
- the integrated circuit 306 has a memory 314.
- the memory 314 has a predefined memory location 350 for storing the identifier of a position dataset.
- the memory 314 has predefined memory locations 352, 354, 356, 358 and 360. These memory locations 352 to 360 serve for storage of a complete position dataset.
- a complete position data set can consist of a sensed x-position and y-position of the entry pen 324, pressure data indicative of the pressure with which the pen tip 328 of the entry pen 324 is depressed against the display 330, a pen tip up / down bit indicating whether the pen tip 328 is depressed against the display 330 or not, and pen side switch information indicating the position of the side switch 326 of the entry pen 324.
- the memory location 352 is permanently assigned to the x-position
- the memory location 354 is assigned to the y-position
- the memory location 356 is assigned to the pressure data
- the memory location 358 is assigned to the pen tip up / down bit
- the memory location 360 is assigned to the pen side switch information.
- the memory 314 has a memory mapped area where each component of a position data set and the identifier of the position data set is always stored on a pre-defined memory location.
- the integrated circuit 306 is coupled to an integrated circuit 308 of the electronic appliance 300.
- the integrated circuit 306 has a bus interface 362 for sending a position dataset 312 and its identifier to the integrated circuit 308.
- the integrated circuit 308 has a bus interface 364.
- the bus interfaces 362 and 364 connect the integrated circuits 306 and 308 by means of a data bus such as the SPI, HC and / or UART data buses.
- the integrated circuit 308 has logic circuitry 366 for execution of various program components.
- the logic circuitry 366 can serve for execution of a program component 368 for providing a telecommunication functionality such as a mobile telephony, email and / or Internet functionality, a program component 370 for providing an electronic organiser functionality, a program component 372 for providing a navigation system, and a program component 374 for providing a digital camera functionality.
- the logic circuitry 366 serves for execution of a program component 376 that provides an operating system and program component 377 that provides a graphical user interface.
- the program component 377 may or may not be an integral part of the program component 376.
- the integrated circuit 308 has a memory 316 for storing the position dataset 312.
- the portable electronic device 300 has a battery 378 for providing power to the various components of the portable electronic device, including the integrated circuit 308.
- the display 330 is coupled to the integrated circuit 308 for displaying the elements of the graphical user interface provided by the program component 377 and for displaying various information and user data related to one or more of the functionalities provided by the program components 368, 370, 372 and 374.
- the elements of the graphical user interface include icons to which context menus are assigned (cf. icons 184, 186, 188, 190 of figure 1 ).
- each context menu has menu items of the same category.
- the electronic appliance 300 can have an integrated antenna 380 for providing a wireless interface to a digital telecommunication network.
- the antenna 380 can be required for providing a navigation functionality such as for reception of global positioning system (GPS) signals.
- GPS global positioning system
- a user of the electronic appliance 300 can select a menu item by orienting the entry pen 324 towards the menu item. For example, this can be done by moving a cursor provided by the graphical user interface onto the menu item without a need for contacting the surface of the display with the entry pen 324 (cf. figure 3).
- the user can operate the side switch 326 and / or press the pen tip 328 against the surface of the display 330.
- the entry pen 328 sends and electromagnetic signal that is sensed by the sensor coils of the position sensor 302, i.e. pen tip down signal and/or the side switch signal.
- the analogue circuitry 332 is controlled by the position sensor control component 344 to provide control signals 338 to the position sensor 302 for acquisition of a position signal 304.
- the position signal 304 is analogue to digital converted and provided to the position signal processing component 310 in order to extract the position dataset 312 from the digitised position signal 304.
- the generator component 346 provides an identifier for the new position dataset 312.
- the generator component 346 is implemented as a scan counter which counts the data acquisitions of position datasets 312 performed by the position sensor control component 344. With each position data acquisition scan that is performed by the position sensor 302 under the control of the position sensor control component 344 the scan counter is incremented or decremented depending on the implementation.
- the position signal processing component 310 writes the position dataset 312 and the scan number provided by the generator component 346 to the memory mapped area of the memory 314.
- the scan number is written to the memory location 350, the x-position data to the memory location 352, the y-position data to the memory location 354, the pressure information to the memory location 356, the pen tip up / down bit to the memory location 358 and the pen side switch information to the memory location 360.
- the interrupt component 348 is invoked in order to generate and interrupt 320 which is sent from the integrated circuit 308 to the integrated circuit 308.
- the interrupt 320 is received by the integrated circuit 308.
- a read operation of the memory mapped area of the memory 314 is performed by the integrated circuit 308 by means of its bus interface 364.
- the integrated circuit 308 reads the memory mapped area from the memory location 350 to the memory location 360 in sequential order. After these read operations the integrated circuit 308 performs another read operation in order to read the memory location 350 again. If the content of the memory location 350 is the same for both the initial read operation and the read operation after having read the dataset 312, this indicates that the dataset 312 is valid. If the contrary is the case, this indicates that the position signal processing component 310 has performed another write operation of a new position data set while the integrated circuit 308 has attempted to read the previous position dataset 312. In the latter case the integrated circuit 308 re-tries to read the content of the memory mapped area of the memory 314 for reading a consecutive up-to date position dataset 312.
- the position dataset 312 is stored in the memory 316 of the integrated circuit 308 for access by the program components 368, 370, 372 and / or 374.
- Figure 5 shows a corresponding diagram illustrating the operation of the electronic appliance of figure 4. As shown in figure 5 the operation of the position detection circuitry provided by the position sensor 302/integrated circuit 306 and operation of the host processor provided by the integrated circuit 308 can be independent and asynchronous .
- the process 400 performed by the position detection circuitry comprises the following steps:
- step 402 a position scan is performed for acquisition of a position dataset that includes at least x, y position data of the current position of the entry pen with respect to the display in the x, y plane.
- step 404 the scan counter is incremented or decremented.
- the position signal acquired from the position scan performed in step 402 is processed in step 406 which provides the position dataset.
- the position dataset and the scan counter value are stored in a memory mapped storage region (step 408).
- an interrupt is sent to the host processor in step 410 in order to signal the availability of up-to-date position data in the memory mapped storage region. From step 410 the control goes back to step 402 for performance of a consecutive position data acquisition.
- the process 412 performed by the host processor comprises the following steps:
- step 414 the host processor receives an interrupt from the position detection circuitry (cf. step 410). In response the host processor reads the scan counter value from the memory mapped storage region (416). Next, the host processor reads the position dataset from the memory mapped storage region (step 418). In step 420 the host processor re-reads the scan counter value from the memory mapped storage region. If the scan counter values that have been read in the steps 416 and 420 are identical, this implies that the position dataset that has been read in step 418 is valid (step 422) and the position dataset is provided to an application for further processing (step 424). If the contrary is the case, this implies that the position dataset was in the process of being overwritten with a new position dataset during the read operation performed in step 418. As a consequence, the control goes back from step 422 to step 416 in order to perform a new read attempt of valid position data from the memory mapped storage region.
- the position data indicates a current position of the entry pen with respect to the display of the hand-held electronic appliance. If the graphical user interface provides a cursor icon on the display, the desired position of the cursor icon is given by the position data acquired from the position sensor. In other words, the cursor icon follows the entry pen's movement when the entry pen hovers above the surface of the display.
- Figure 6 shows an exemplary configuration of the position detecting circuitry that can be used for acquisition of the position data. Elements in the embodiment of figure 6, that correspond to elements in the embodiments of figure 1 to 4 are designated by like reference numerals.
- the position detecting system includes a position indicator 524 for indicating a position and a position detecting apparatus 502 for detecting the position of the position indicator 524.
- the position indicator 524 includes at least one coil and indicates a position.
- the position indicator 524 includes a coil and a capacitor connected to the coil, in which the capacitor and the coil form a resonant circuit.
- the position indicator 524 includes additional circuitry for generating an electromagnetic signal when the user performs a user input action, such as operating the switch of the position indicator 524.
- the position detecting apparatus 502 includes a control unit 544, a transmission control unit 534 for generating position detecting signals, a transmission circuit 535, a sensor unit 503 serving as a sensor area, a switching unit 507 for selecting / switching sensor coils, a reception circuit 536 and a coordinate detection unit 510.
- the sensor unit 503, which extends in the plane, includes a transmission coil unit 580 for transmitting position detecting signals for detecting the position of the position indicator 524; and a sensor coil unit 582 for receiving position indicating signals indicating the position of the position indicator 524.
- the sensor coil unit 582 includes a plurality of sensor coils arranged in the x-direction (x-direction sensor coils) and a plurality of sensor coils arranged in the y-direction orthogonal to the x-direction (y-direction sensor coils).
- the control unit 544 corresponds to the signal transmitting unit, the receiving unit and the position detecting unit; the transmission control unit 534 and the transmission circuit 535 correspond to the signal transmitting unit; the switching unit 507 and the reception circuit 536 correspond to the receiving unit ; and the coordinator detection unit 510 corresponds to the position detection unit.
- the control unit 544 controls the position detecting apparatus 502 and also controls the transmission control unit 534, the switching unit 507, the reception circuit 536 and the coordinator detection unit 510.
- the transmission control unit 534 generates position detecting signals for detecting a position indicated by the position indicator 524 under the control of the control unit 544.
- the transmission circuit 535 amplifies the position detecting signals from the transmission control unit 534 and supplies the position detecting signals to the transmission coil unit 580, which is provided in the sensor unit 503. Accordingly, the transmission coil unit is driven.
- the sensor coils are scanned using the switching unit 507 and the reception unit 536 for position detection by coordinate detection unit 510.
- the sensor coils can serve for reception of the electromagnetic signal that is emitted by the position indicator 524 when the user performs the user input action, such as operating a switch of the position indicator 524 (cf. side switch 126, 326 or pen tip 128, 328 cf. Fig. 1 , 2, 3, and 4 respectively).
- the respective user entry signal is provided as part of the position dataset to the host processor (cf. pentip up/down bit or pen side switch information within dataset 312).
- the graphical user interface signals entry of the graphically selected menu item which causes a respective entry of a user setting or invokes a certain functionality.
- the various components that are required for controlling a driving operation of the position sensor 502 are provided by a mixed analogue / digital application specific integrated circuit 506 which has a similar design as the integrated circuit 306 of figure 4.
- the components of the integrated circuit 506 related to the storage of position data and interfacing with a host processor are not shown in figure 6 for ease of explanation.
- FIG. 7 illustrates an embodiment of the method of the invention.
- a number of icons are displayed on the display of a hand-held electronic appliance, such as a smartphone, a PDA, a navigation system, an electronic organiser, a digital camera or another multifunctional hand-held electronic appliance.
- a hand-held electronic appliance such as a smartphone, a PDA, a navigation system, an electronic organiser, a digital camera or another multifunctional hand-held electronic appliance.
- each icon has an assigned context menu that comprises a number of menu items of the same category.
- step 702 the user moves an entry pen over one of the icons with or without contacting the display surface.
- the context menu assigned to that selected icon is displayed (step 704).
- close proximity of the entry pen to the xy position of the icon is sufficient to trigger display of the respective context menu.
- One of the menu items of the context menu can be selected by the user by moving the entry pen to the xy position of the desired menu item (step 706). Again, this can be performed with or without contacting the display surface.
- step 708 it is determined whether the selected menu item has an assigned sub-menu. If this is the case the sub-menu is displayed in step 710 and the user can select one of the menu items of the sub-menu by orienting the entry pen towards the x y position of the desired menu item of the sub-menu with or without contacting the display with the entry pen (step 712). From there the control goes back to step 708.
- step 714 the user can enter his or her selection of a menu item by performing a user input action. For example, the user depresses the entry pen against the display surface for entering the selection of the menu item that has not an assigned sub-menu. Alternatively the user operates a switch of the entry pen for entry of the selection.
- a user input action For example, the user depresses the entry pen against the display surface for entering the selection of the menu item that has not an assigned sub-menu.
- the user operates a switch of the entry pen for entry of the selection.
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- General Physics & Mathematics (AREA)
- Electromagnetism (AREA)
- Position Input By Displaying (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The present invention relates to a hand-held electronic appliance comprising: graphical user interface means (130, 330, 377) for displaying at least one context menu (195, 197) the context menu having a number of menu items, pen entry means (124, 194, 302, 306, 324, 502, 524) for contactless selection of one of the menu items, means (126, 128, 326, 328) for entering the selection.
Description
A hand-held electronic appliance and method of entering a selection of a menu item
Description
Field of the invention.
The present invention relates to the field of hand-held electronic appliances, such as mobile phones, smart phones, personal digital assistants (PDA), navigation systems, electronic cameras, digital photo viewers and multipurpose hand-held electronic appliances.
Background and prior art
Various hand-held electronic appliances which include an entry pen for a user's entry of commands or data are known from the prior art. For example, US Patent Number 6,667,740B2 shows a hand-held personal digital assistant (PDA) which includes an xy digitising system behind the PDA's liquid crystal display which can sense the xy position of a resonant stylus. Further, a mobile telephone is disclosed that has a liquid crystal display, and sensor windings and excitation windings of a digitising system under the display. The digitising system is operable to sense the position of a resonant stylus relative to the display. The digitising system of the mobile telephone may be used to allow a user to create short text messages which can then be sent by the mobile
telephone to another party. If the mobile telephone includes an organiser, then the digitiser can be used to control the inputting, manipulation and outputting of data from the organiser.
In order to facilitate a user's interaction some hand-held electronic appliances have a graphical user interface for a user's selections of icons of the graphical user interface by means of an entry pen. Such prior art hand-held electronic appliances have resistive interfaces that require that the entry pen is pressed against the surface of the display for a user's interaction. Examples for such prior art hand-held electronic appliances include PDAs that are commercially available from PalmOne (www.palm1.com).
US Patent Number 6, 664,991 shows a user interface for a pen-based device that allows users to activate the full "card" for an entry using a single tap whilst also giving the user the ability to reach a menu of context dependent commands using a simple gesture. The gesture consists of pressing and holding the stylus on a selection for a system-specified length of time. If the user does not move the stylus more than a system-specified distance from the original location for that time, a context menu gesture is recognised and the application displays a context menu. Alternatively, pressing and holding an external button on the pen-based device while an entry is highlighted is considered a context menu gesture. As a further alternative double tapping the stylus or pressing and holding an external button whilst tapping the stylus are considered context menu gestures.
Summary of the invention
In accordance with the invention there is provided a hand-held electronic appliance that has graphical user interface means for displaying at least one context menu. The context menu has a number of menu items. The hand-held electronic appliance has pen entry means for contactless selection of one of the menu items. Further, the hand-held electronic appliance has means for entering the selection.
The pen entry means for contactless selection can be implemented using capacitive and / or inductive position sensing technologies. Such contactless position sensing technologies are as such known from the prior art (e.g. EP 0259 894 B1 ,EP 0307667 B1 ; US 6,485,306 B1 ; US 5,600,105; US 6,667,740 B2; US 5,488,204; US 5,942,733 and US 6,380,929 ).
The present invention is particularly advantageous as it facilitates a user's interaction with the hand-held electronic appliance. The user can select a menu item of a context menu without contacting the surface of the display which makes the user's interaction much more convenient. For example, the user can move the entry pen over the display while there is a gap between the surface of the display and the entry pen for convenient selection of a menu item within a context menu.
For entry of a menu item selection into the hand-held electronic appliance the user needs to perform an additional user entry action. For example, this entry can be performed by depressing the pen tip of the entry pen onto the surface of the display or by operating a switch of the entry pen. In the latter case both the selection of the menu item and entry of the selection can be performed without contacting the surface of the display with the entry pen.
In accordance with an embodiment of the invention at least one of the menu items of the context menu has an assigned context sub-menu. The graphical user interface displays the sub-menu in response to a contactless selection of the menu item to which the sub- menu is assigned.
In accordance with an embodiment of the invention the graphical user interface comprises an icon that represents the context menu. When the icon is selected by means of the entry pen, the context menu that is represented by the icon is displayed for the user's selection of the menu item.
Preferably, the graphical user interface comprises a number of context menus. The context menus provide selectable choices or options to a user in a stack of panes, with one choice being provided per pane. Each pane carries one menu item. The context menus are relatively small, with typically only a word or two of text being provided in each pane.
Preferably, the context menus are categorised. For example, there is one context menu for entering and / or viewing user settings, a context menu for communication functions, a context menu for organiser functions, a context menu for navigation functions, a context menu for digital camera functions and / or for other functionalities of the hand-held
electronic appliance. Each of the context menus can have one or more levels of sub¬ menus.
For example, the graphical user interface has a context manual for convenient dialling of telephone numbers. Each menu item represents a telephone number that is used relatively frequently by the user. A menu item can show a person's or organisation's name and / or the person's or organisation's telephone number. For convenient dialing the user selects one of the telephone numbers from the context menu and enters the selection. In response to the entry of the selection the selected number is called. Likewise email addresses or other communication links can be provided as menu items for convenient user selection.
The present invention is particularly advantageous for multi-function hand-held electronic appliances such as so-called smart phones that include an electronic organiser and / or other functionalities, such as a digital camera and/or a navigation system. The present invention facilitates a user's intuitive and ergonomic interaction with such complex hand¬ held electronic appliances.
Brief description of the drawings
In the following preferred embodiments of the invention will be described in greater detail, by way of example only, making reference to the drawings in with:
Figure 1 Is a schematic top view of an embodiment of a hand-held electronic appliance of the invention,
Figure 2 is a perspective view of a position sensor illustrating electromagnetic coupling between the position sensor and the entry pen,
Figure 3 shows the hand-held electronic appliance of figure 1 after a user's selection of a menu item,
Figure 4 shows a block diagram of a more detailed embodiment of the hand-held electronic appliance,
Figure 5 is a flow diagram showing a preferred mode of operation of the hand-held electronic appliance of figure 4,
Figure 6 is a perspective view showing an embodiment of the configuration of the position-detecting system of the hand-held electronic appliance of figure 4,
Figure 7 is a flow chart illustrating an embodiment of the method of the invention.
Detailed Description
Figure 1 shows a schematic view of the hand-held smartphone 100. The smartphone 100 has about the size of a palm and is battery powered. It has a wireless interface to a digital cellular communication network, such as a GSM, UMTS, CDMA, WLAN or other kind of wireless network. By means of the wireless interface a user can make phone calls, send email and / or connect to the Internet.
The smartphone 100 has a housing 101 ; the housing 101 has clips 104 for receiving an entry pen 124. The entry pen 124 has a pen tip 128 and / or a side switch 126.
The entry pen 124 has internal circuitry for generating a signal when the pen tip 128 is depressed and / or when the side switch 126 is operated when the entry pen 124 is in the proximity of the display 130 of the smartphone 100. The entry pen 124 may or may not have a battery for powering its internal circuitry.
Preferably the entry pen 124 includes internal circuitry for electromagnetic coupling with transmission and sensor coils disposed behind the display 130. Electromagnetic coupling has the advantage that the need for a battery within the entry pen 124 can be avoided as the entry pen is powered by the electromagnetic waves it receives from the transmission coils. For example, the entry pen 124 can be designed in accordance with EP0259894B1 or EP0307667B1.
It is to be noted that there are various design options to removably attach the entry pen 124 to the housing 101 of the smartphone 100. As an alternative to external attachment of the entry pen 124 by means of the clips 104, the housing 101 may have a reception hole for receiving the entry pen 124 with clips disposed inside the reception hole.
The smartphone 100 has an operating system that provides a graphical user interface such as the Symbian OS, the Palm OS or the Pocket PC Operating System.
The graphical user interface has an icon 184 for entering and / or viewing of user settings, an icon 186 for selecting communication functionalities, such as making a phone call, sending an email and / or connecting to the Internet, and icon 188 for access to organiser functionalities, such as entering or viewing a task, a calendar entry, and / or an address, and an icon 190 for access to camera functionalities of the built-in digital camera of the smartphone 100. The graphical user interface of the smartphone 100 may include additional or other icons for access to other functionalities, such as access to the functionalities of a built-in GPS navigation system, a digital photo viewer or the like.
In the preferred embodiment considered here the graphical user interface has a cursor 192; the cursor 192 serves as a pointer for a user's graphic selection of one of the icons 184 to 190 or of another graphical element of the graphical user interface displayed on the display 130.
The cursor 192 can be moved by means of the entry pen 124 without a need to contact the surface of the display 130. In other words, the user orients the pen tip 128 to a xy position within the display 130 without a requirement to contact the surface of the display 130. The orientation of the pen tip 128 is sensed by means of the receiver coils disposed behind the display 130 and the respective position information is entered into the processor of the smartphone 100. In response, the cursor 192 is moved to the position to which the pen tip 128 points. Hence, a user can conveniently move the cursor 192 to any position within display 130 by means of entry pen 124 without a need to touch the surface of the display 130 with the pen tip 128.
The contactless coupling between the entry pen 124 and the transmission and sensor coils disposed behind the display 130 is schematically illustrated in the perspective view of figure 2.
A printed circuit board 194 is disposed behind the display 130 (cf figure 1 ) such that it forms an under layer of the display 130. The printed circuit board 194 carries a sensor unit which extends in the plane, including a transmission coil unit for transmission of position detecting signals for detecting the position of the entry pen 124 relative to the display 130. Further, the printed circuit board 194 has a sensor coil unit for receiving position indicating signals indicating the position of the entry pen 124. The sensor coil unit includes a plurality of sensor coils arranged in the x and y directions.
The printed circuit board 194 has a connector 196 for coupling the printed circuit board 194 to an integrated circuit that controls operation of the position sensing and signal exchange with the entry pen 124 and delivers position data and other data such as pen tip up / down information or information indicative of the pen side switch position.
The electromagnetic coupling between the entry pen 124 and the printed circuit board 194 has a certain contactless user range which enables interaction. For example, the electromagnetic coupling between the entry pen 124 and the printed circuit board 194 is sufficiently strong to sense the entry pen position, if the gap 198 between the pen tip 128 and the printed circuit board 194 is below 30mm, preferably below 20mm.
Figure 3 illustrates a user's interaction for selection of a user setting. For entering the user setting the user moves the cursor 192 onto the icon 184 by means of entry pen 124 without a requirement for contacting the surface of the display 130 with the pen tip 128. After the cursor 192 has been moved onto the icon 184 the context menu 197 that is assigned to the icon 184 is displayed on the display 130. The context menu 197 has a number of menu items, e.g. 'lock / unlock phone' for locking / unlocking the smartphone 100, 'ringing type' for selection of the ringing tone type, 'messages' for reading or deleting a message, 'auto answer on / off' for setting the automatic answer functionality on or off, 'clear last call' for setting the last-called numbers to be cleared or retained when the smartphone 100 is switched off, 'emergency' for setting a key on / off for one-touch dialling of emergency calls, 'restrictions' for setting call restrictions and / or other menu items for viewing and / or changing user settings.
In the example considered here the user desires to change the ringing tone type of the smartphone 100.
For setting the ringing tone type the user moves the cursor 192 from the icon 184 over the context menu 197 onto the menu item 'ringing type'. The menu item 'ringing type' has an assigned sub-menu. The fact that the menu item 'ringing type' has a sub-menu is symbolised by the arrow symbol 199 next to the words 'ringing type' of the respective menu item. Likewise , the menu items 'messages' and 'restrictions' have assigned sub¬ menus as symbolised by the respective arrow symbols. Preferably a selected menu item and/or sub-menu item is highlighted.
When the cursor 192 is on the menu item 'ringing type' the sub-menu 195 that is assigned to the menu item 'ringing type' is displayed next to the arrow symbol 199. In the example considered here, the sub-menu 195 has menu items 'tone A', 'tone B', and 'tone C corresponding to respective ringing tone types A, B and C.
For example, if the user wants to select the ringing tone type B, he or she moves the cursor 192 onto the menu item 'tone B' over the sub-menu 195 by means of the entry pen 124 without a need to touch the surface of the display 130. When the cursor 192 is on the menu item 'tone B' the user can perform a user input action in order to enter his or her selection of the menu item 'tone B' for entering the selection of the desired ringing tone type B.
This user input action can be performed by depressing the pen tip 128 onto the menu item 'tone B' when the cursor 192 is positioned on the menu item 'tone B'. Alternatively, the user can operate the side switch 126 of the entry pen 124 in order to enter the selection of ringing tone type B when the cursor 192 is positioned on the menu item 'tone B'. In either case the entry pen 124 generates a signal that is received by the senor coils of the printed circuit board 194 (cf. figure 2). That signal is entered into the microprocessor of the smartphone 100 for entry of the user's selection.
If the user selects a menu item within context menu 197 that has no assigned sub-menu the user can select or de-select the respective setting by performing the user input action after the cursor 192 has been moved onto the respective menu item. For example, if the user wants to set automatic answer on or off, he or she moves the cursor 192 onto the 'auto answer on / off' menu item and then performs the user entry action, e.g. depressing the pen tip 128 against the surface of the display 130 or operating the side switch 126.
As icon 184, the other icons 186, 188, and 190 have assigned respective context menus. Access to the context menus, menu items, and sub-menus, if any, works the same way as explained with respect to the icon 184.
The present invention is particularly advantageous as it makes a user's interaction with the smartphone 100 more convenient by enabling contactless selection of context menus, menu items, sub-menus and sub-menu items. In addition to the increased convenience, the contactless selection of menu items has ergonomic advantages. In
particular the invention reduces the risk of repetitive strain injury when the smartphone 100 is used frequently.
Figure 4 shows a block diagram of a more detailed embodiment of a portable hand-held electronic appliance 300. For example, the electronic appliance 300 is an implementation of the smartphone 100 (cf. figures 1 , 2 and 3). Elements of the electronic appliance 300 that correspond to elements of the smartphone 100 are designated by like reference numerals.
The electronic appliance 300 has a position sensor 302 for sensing the position of an entry pen 324. The position sensor 302 can be implemented as a printed circuit board (cf. printed circuit board194 shown in figure 2). The position sensor 302 is located behind the display 330 for sensing a position of the entry pen 324 relative to the display and for receiving user entry signals from the entry pen 324. The entry pen 324 has a side switch 326 that can be operated by a user and a pen tip 328. The display 330 can be a liquid crystal display or an organic light emitting diode (OLED) display or another kind of display.
The position sensor senses the position of the entry pen 324 relative to the display 330 by electromagnetic coupling. In addition to the position detection, the position sensor 302 can receive a user entry signal from the entry pen 324. A user entry signal is an electromagnetic signal that is emitted from the entry pen 324 in order to indicate a switch position of the side switch 326 and / or whether the pen tip 328 is depressed or not.
The electronic appliance 300 has an integrated circuit 306 for controlling operation of the position sensor 302 and for processing position signals received from the position sensor 302. The integrated circuit 306 has analogue circuitry 332 that comprises a transmission component 334 and a reception component 336. The transmission component 334 and the reception component 336 serve to generate control signals 338 for controlling the transmission of electromagnetic signals from the position sensor 302 to the entry pen 324 and the reception of electromagnetic signals from the entry pen 324 by the position sensor 302. The resultant position signal 304 that carries the position information is received by the reception component 336 which provides the sampled position signal 304 to the position signal processing component 310.
The position signal processing component 310 belongs to logic circuitry 340 of the integrated circuit 306. In the preferred embodiment considered here, the position signal processing component 310 is provided by a set of instructions of the firmware 342 which is executed by logic circuitry 340.
In addition, the firmware 342 has a position sensor control component 344 which is a set of firmware instructions for controlling overall operation of the position sensor 302 and the analogue circuitry 332. Further, the firmware 342 has a generator component 346 which is a set of firmware instructions for generating an identifier for each position dataset that is provided by the position signal processing component 310. The interrupt component 348 is a set of firmware instructions for generating an interrupt 320 when a new acquisition scan of the position data is performed.
Further, the integrated circuit 306 has a memory 314. The memory 314 has a predefined memory location 350 for storing the identifier of a position dataset. The memory 314 has predefined memory locations 352, 354, 356, 358 and 360. These memory locations 352 to 360 serve for storage of a complete position dataset.
A complete position data set can consist of a sensed x-position and y-position of the entry pen 324, pressure data indicative of the pressure with which the pen tip 328 of the entry pen 324 is depressed against the display 330, a pen tip up / down bit indicating whether the pen tip 328 is depressed against the display 330 or not, and pen side switch information indicating the position of the side switch 326 of the entry pen 324.
The memory location 352 is permanently assigned to the x-position, the memory location 354 is assigned to the y-position, the memory location 356 is assigned to the pressure data, the memory location 358 is assigned to the pen tip up / down bit and the memory location 360 is assigned to the pen side switch information. In other words, the memory 314 has a memory mapped area where each component of a position data set and the identifier of the position data set is always stored on a pre-defined memory location.
The integrated circuit 306 is coupled to an integrated circuit 308 of the electronic appliance 300. The integrated circuit 306 has a bus interface 362 for sending a position dataset 312 and its identifier to the integrated circuit 308. The integrated circuit 308 has a bus interface 364. For example, the bus interfaces 362 and 364 connect the integrated
circuits 306 and 308 by means of a data bus such as the SPI, HC and / or UART data buses.
The integrated circuit 308 has logic circuitry 366 for execution of various program components. For example, the logic circuitry 366 can serve for execution of a program component 368 for providing a telecommunication functionality such as a mobile telephony, email and / or Internet functionality, a program component 370 for providing an electronic organiser functionality, a program component 372 for providing a navigation system, and a program component 374 for providing a digital camera functionality. Further, the logic circuitry 366 serves for execution of a program component 376 that provides an operating system and program component 377 that provides a graphical user interface. The program component 377 may or may not be an integral part of the program component 376.
The integrated circuit 308 has a memory 316 for storing the position dataset 312.
The portable electronic device 300 has a battery 378 for providing power to the various components of the portable electronic device, including the integrated circuit 308. The display 330 is coupled to the integrated circuit 308 for displaying the elements of the graphical user interface provided by the program component 377 and for displaying various information and user data related to one or more of the functionalities provided by the program components 368, 370, 372 and 374. The elements of the graphical user interface include icons to which context menus are assigned (cf. icons 184, 186, 188, 190 of figure 1 ). Preferably, each context menu has menu items of the same category.
The electronic appliance 300 can have an integrated antenna 380 for providing a wireless interface to a digital telecommunication network. Likewise, the antenna 380 can be required for providing a navigation functionality such as for reception of global positioning system (GPS) signals.
In operation a user of the electronic appliance 300 can select a menu item by orienting the entry pen 324 towards the menu item. For example, this can be done by moving a cursor provided by the graphical user interface onto the menu item without a need for contacting the surface of the display with the entry pen 324 (cf. figure 3). For entering the user's selection of the menu item the user can operate the side switch 326 and / or press the
pen tip 328 against the surface of the display 330. In response, the entry pen 328 sends and electromagnetic signal that is sensed by the sensor coils of the position sensor 302, i.e. pen tip down signal and/or the side switch signal.
The analogue circuitry 332 is controlled by the position sensor control component 344 to provide control signals 338 to the position sensor 302 for acquisition of a position signal 304. The position signal 304 is analogue to digital converted and provided to the position signal processing component 310 in order to extract the position dataset 312 from the digitised position signal 304.
The generator component 346 provides an identifier for the new position dataset 312. In the preferred embodiment considered here, the generator component 346 is implemented as a scan counter which counts the data acquisitions of position datasets 312 performed by the position sensor control component 344. With each position data acquisition scan that is performed by the position sensor 302 under the control of the position sensor control component 344 the scan counter is incremented or decremented depending on the implementation.
The position signal processing component 310 writes the position dataset 312 and the scan number provided by the generator component 346 to the memory mapped area of the memory 314. In other words, the scan number is written to the memory location 350, the x-position data to the memory location 352, the y-position data to the memory location 354, the pressure information to the memory location 356, the pen tip up / down bit to the memory location 358 and the pen side switch information to the memory location 360.
When the scan number and the new position dataset 312 are written to the memory 314 the interrupt component 348 is invoked in order to generate and interrupt 320 which is sent from the integrated circuit 308 to the integrated circuit 308.
The interrupt 320 is received by the integrated circuit 308. In response a read operation of the memory mapped area of the memory 314 is performed by the integrated circuit 308 by means of its bus interface 364. For example, the integrated circuit 308 reads the memory mapped area from the memory location 350 to the memory location 360 in sequential order. After these read operations the integrated circuit 308 performs another read operation in order to read the memory location 350 again. If the content of the
memory location 350 is the same for both the initial read operation and the read operation after having read the dataset 312, this indicates that the dataset 312 is valid. If the contrary is the case, this indicates that the position signal processing component 310 has performed another write operation of a new position data set while the integrated circuit 308 has attempted to read the previous position dataset 312. In the latter case the integrated circuit 308 re-tries to read the content of the memory mapped area of the memory 314 for reading a consecutive up-to date position dataset 312.
The position dataset 312 is stored in the memory 316 of the integrated circuit 308 for access by the program components 368, 370, 372 and / or 374.
Figure 5 shows a corresponding diagram illustrating the operation of the electronic appliance of figure 4. As shown in figure 5 the operation of the position detection circuitry provided by the position sensor 302/integrated circuit 306 and operation of the host processor provided by the integrated circuit 308 can be independent and asynchronous .
The process 400 performed by the position detection circuitry comprises the following steps:
In step 402 a position scan is performed for acquisition of a position dataset that includes at least x, y position data of the current position of the entry pen with respect to the display in the x, y plane. In step 404 the scan counter is incremented or decremented. The position signal acquired from the position scan performed in step 402 is processed in step 406 which provides the position dataset. The position dataset and the scan counter value are stored in a memory mapped storage region (step 408). Further, an interrupt is sent to the host processor in step 410 in order to signal the availability of up-to-date position data in the memory mapped storage region. From step 410 the control goes back to step 402 for performance of a consecutive position data acquisition.
The process 412 performed by the host processor comprises the following steps:
In step 414 the host processor receives an interrupt from the position detection circuitry (cf. step 410). In response the host processor reads the scan counter value from the memory mapped storage region (416). Next, the host processor reads the position dataset from the memory mapped storage region (step 418). In step 420 the host processor re-reads the scan counter value from the memory mapped storage region.
If the scan counter values that have been read in the steps 416 and 420 are identical, this implies that the position dataset that has been read in step 418 is valid (step 422) and the position dataset is provided to an application for further processing (step 424). If the contrary is the case, this implies that the position dataset was in the process of being overwritten with a new position dataset during the read operation performed in step 418. As a consequence, the control goes back from step 422 to step 416 in order to perform a new read attempt of valid position data from the memory mapped storage region.
The position data indicates a current position of the entry pen with respect to the display of the hand-held electronic appliance. If the graphical user interface provides a cursor icon on the display, the desired position of the cursor icon is given by the position data acquired from the position sensor. In other words, the cursor icon follows the entry pen's movement when the entry pen hovers above the surface of the display.
Figure 6 shows an exemplary configuration of the position detecting circuitry that can be used for acquisition of the position data. Elements in the embodiment of figure 6, that correspond to elements in the embodiments of figure 1 to 4 are designated by like reference numerals.
The position detecting system according to the preferred embodiment considered here includes a position indicator 524 for indicating a position and a position detecting apparatus 502 for detecting the position of the position indicator 524.
The position indicator 524 includes at least one coil and indicates a position. For example, the position indicator 524 includes a coil and a capacitor connected to the coil, in which the capacitor and the coil form a resonant circuit. Preferably, the position indicator 524 includes additional circuitry for generating an electromagnetic signal when the user performs a user input action, such as operating the switch of the position indicator 524.
The position detecting apparatus 502 includes a control unit 544, a transmission control unit 534 for generating position detecting signals, a transmission circuit 535, a sensor unit 503 serving as a sensor area, a switching unit 507 for selecting / switching sensor coils, a reception circuit 536 and a coordinate detection unit 510.
The sensor unit 503, which extends in the plane, includes a transmission coil unit 580 for transmitting position detecting signals for detecting the position of the position indicator 524; and a sensor coil unit 582 for receiving position indicating signals indicating the position of the position indicator 524. The sensor coil unit 582 includes a plurality of sensor coils arranged in the x-direction (x-direction sensor coils) and a plurality of sensor coils arranged in the y-direction orthogonal to the x-direction (y-direction sensor coils).
The control unit 544 corresponds to the signal transmitting unit, the receiving unit and the position detecting unit; the transmission control unit 534 and the transmission circuit 535 correspond to the signal transmitting unit; the switching unit 507 and the reception circuit 536 correspond to the receiving unit ; and the coordinator detection unit 510 corresponds to the position detection unit.
The control unit 544 controls the position detecting apparatus 502 and also controls the transmission control unit 534, the switching unit 507, the reception circuit 536 and the coordinator detection unit 510.
The transmission control unit 534 generates position detecting signals for detecting a position indicated by the position indicator 524 under the control of the control unit 544. The transmission circuit 535 amplifies the position detecting signals from the transmission control unit 534 and supplies the position detecting signals to the transmission coil unit 580, which is provided in the sensor unit 503. Accordingly, the transmission coil unit is driven. The sensor coils are scanned using the switching unit 507 and the reception unit 536 for position detection by coordinate detection unit 510.
In addition the sensor coils can serve for reception of the electromagnetic signal that is emitted by the position indicator 524 when the user performs the user input action, such as operating a switch of the position indicator 524 (cf. side switch 126, 326 or pen tip 128, 328 cf. Fig. 1 , 2, 3, and 4 respectively). The respective user entry signal is provided as part of the position dataset to the host processor (cf. pentip up/down bit or pen side switch information within dataset 312). In response, the graphical user interface signals entry of the graphically selected menu item which causes a respective entry of a user setting or invokes a certain functionality.
The various components that are required for controlling a driving operation of the position sensor 502 are provided by a mixed analogue / digital application specific integrated circuit 506 which has a similar design as the integrated circuit 306 of figure 4. The components of the integrated circuit 506 related to the storage of position data and interfacing with a host processor are not shown in figure 6 for ease of explanation.
Figure 7 illustrates an embodiment of the method of the invention. In step 700 a number of icons are displayed on the display of a hand-held electronic appliance, such as a smartphone, a PDA, a navigation system, an electronic organiser, a digital camera or another multifunctional hand-held electronic appliance. Preferably each icon has an assigned context menu that comprises a number of menu items of the same category.
In step 702 the user moves an entry pen over one of the icons with or without contacting the display surface. When the xy position of the entry pen equals the xy position of one of the icons the context menu assigned to that selected icon is displayed (step 704). Depending on the implementation, close proximity of the entry pen to the xy position of the icon is sufficient to trigger display of the respective context menu. One of the menu items of the context menu can be selected by the user by moving the entry pen to the xy position of the desired menu item (step 706). Again, this can be performed with or without contacting the display surface.
In step 708 it is determined whether the selected menu item has an assigned sub-menu. If this is the case the sub-menu is displayed in step 710 and the user can select one of the menu items of the sub-menu by orienting the entry pen towards the x y position of the desired menu item of the sub-menu with or without contacting the display with the entry pen (step 712). From there the control goes back to step 708.
If it is determined in steps 708 that a selected menu item does not have an assigned sub¬ menu the control goes to step 714. In step 714 the user can enter his or her selection of a menu item by performing a user input action. For example, the user depresses the entry pen against the display surface for entering the selection of the menu item that has not an assigned sub-menu. Alternatively the user operates a switch of the entry pen for entry of the selection.
List of Reference Numerals
100 Smartphone
101 Housing
102 Position Sensor
105 Clips
124 Entry Pen
128 Pen Tip
126 Side Switch
130 Display
184 Icon
186 Icon
188 Icon
190 Icon
192 Cursor
194 Printed Circuit E
195 Sub-menu
196 Connector
197 Context Menu
198 Gap
199 Arrow Symbol
300 Electronic Appliance
302 Position Sensor
304 Position Signal
306 Integrated Circuit
308 Integrated Circuit
310 Position Signal Processing Component
312 Position Dataset
314 Memory
316 Memory
320 Interrupt
324 Entry Pen
332 Analogue Circuitry
334 Transmission Component
336 Reception Component
338 Control Signal
340 Logic Circuitry
342 Firmware
344 Position Sensor Control Component
346 Generator Component
348 Interrupt Component
350 Memory Location
352 Memory Location
354 Memory Location
356 Memory Location
358 Memory Location
360 Memory Location
362 Bus Interface
364 Bus Interface
366 Logic Circuitry
368 Program Component
370 Program Component
372 Program Component
374 Program Component
376 Program Component
377 Program Component
378 Battery
380 Antenna
502 Position Detecting Apparatus
503 Sensor Unit
506 Integrated Circuit
507 Switching Unit
510 Coordinate Detection Unit
524 Position Indicator
534 Transmission Control Unit
535 Transmission Circuit
536 Reception Circuit
544 Control Unit
580 Transmission Coil Unit
582 Sensor Coil Unit
Claims
1. A hand-held electronic appliance comprising:
graphical user interface means (130; 330, 377) for displaying at least one context menu (195, 197) the context menu having a number of menu items,
pen entry means (124, 194; 302, 306, 324; 502, 524) for contactless selection of one of the menu items,
means (126, 128; 326, 328) for entering the selection.
2. The hand-held electronic appliance of claim 1 , at least one menu item having an assigned context sub-menu (195), the graphical user interface means being adapted to display the sub-menu in response to the contactless selection of the at least one menu item.
3. The hand-held electronic appliance of claim 1 or 2, the graphical user interface means comprising at least one icon (184, 186, 188, 190) being representative of a respective context menu, the pen entry means being adapted for contactless selection of the at least one icon and the graphical user interface means being adapted to display the context menu in response to the contactless selection of the at least one icon.
4. The hand-held electronic appliance of claim 3, the graphical user interface means comprising a plurality of context menus being represented by respective icons (184, 186, 188, 190), each context menu comprising menu items belonging to a common category.
5. The hand-held electronic appliance of claim 4, one of the icons of the graphical interface means being representative of the category user settings.
6. The hand-held electronic appliance of claim 4 or 5, one icon of the graphical user interface means being representative of the category communication functions.
7. The hand-held electronic appliance of claim 4, 5, or 6, one icon of the graphical user interface means being representative of the category organiser functions.
8. The hand-held electronic appliance of any one of claim 4 to 7, one icon of the graphical user interface means being representative of the category digital camera functions.
9. The hand-held electronic appliance of any one of claim 4 to 8, one icon of the graphical user interface means being representative of navigation functions.
10. The hand-held electronic appliance of any one of the preceding claims, the graphical user interface means being adapted to highlight a selected menu item.
11. The hand-held electronic appliance of any one of the preceding claims, the graphical user interface means comprising a display (130; 330) and the pen entry means comprising a position sensor (302; 502) for sensing the position of an entry pen (124; 324; 524) relative to the display while the entry pen is in proximity to the display.
12. The hand-held electronic appliance of any one of the preceding claims, the pen entry means comprising a capacitive proximity sensor.
13. The hand-held electronic appliance of any one of the preceding claims, the pen entry means being adapted to sense a position of an entry pen by electromagnetic coupling.
14. The hand-held electronic appliance of any one of the preceding claims, the pen entry means having an entry pen, the entry pen comprising a user operable input element (126, 128; 326, 328) for entering the selection.
15. The hand-held electronic appliance of claim 14, the user operable input element being a pen tip (128; 328) of the entry pen, the entry pen being adapted to send a pen tip down signal when the pen tip is depressed against the surface of the display.
16. The hand-held electronic appliance of claim 14 or 15, the user operable input element being a switch (126; 326), the entry pen being adapted to send an entry signal in response to operation of the switch in order to signal entry of the selection.
17. The hand-held electronic appliance of any one of the preceding claims being or comprising a mobile phone, a smartphone, a personal digital assistant, a navigation system, a digital camera, and / or a digital photo viewer.
18. A method of entering a selection of a menu item of a context menu into a hand-held electronic appliance comprising:
displaying the context menu (195, 197), the context menu having a number of menu items,
contactless selection of one of the menu items by means of an entry pen (124; 324; 524),
entering the selection by performing a single user entry action (126, 128; 326, 328).
19. The method of claim 18, the single user entry action consisting of depressing the entry pen against a display of the hand-held electronic appliance.
20. The method of claim 18 or 19, the single user entry action consisting of operating a switch of the entry pen.
21. The method of claim 18, 19 or 20, wherein at least one menu item has an assigned context sub-menu (195), and further comprising displaying the sub¬ menu in response to the contactless selection of the one menu item.
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
PCT/EP2004/011443 WO2006039939A1 (en) | 2004-10-13 | 2004-10-13 | A hand-held electronic appliance and method of entering a selection of a menu item |
Publications (1)
Publication Number | Publication Date |
---|---|
EP1803053A1 true EP1803053A1 (en) | 2007-07-04 |
Family
ID=34959123
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP04790324A Withdrawn EP1803053A1 (en) | 2004-10-13 | 2004-10-13 | A hand-held electronic appliance and method of entering a selection of a menu item |
Country Status (2)
Country | Link |
---|---|
EP (1) | EP1803053A1 (en) |
WO (1) | WO2006039939A1 (en) |
Families Citing this family (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
GB0811946D0 (en) * | 2008-06-30 | 2008-07-30 | Symbian Software Ltd | Computing device |
US8890818B2 (en) | 2010-09-22 | 2014-11-18 | Nokia Corporation | Apparatus and method for proximity based input |
CN105009055A (en) * | 2013-01-31 | 2015-10-28 | 惠普发展公司,有限责任合伙企业 | Defining a design plan |
JP5860838B2 (en) * | 2013-05-30 | 2016-02-16 | 京セラドキュメントソリューションズ株式会社 | Display device, electronic device, and image forming apparatus |
CN113325987A (en) * | 2021-06-15 | 2021-08-31 | 深圳地平线机器人科技有限公司 | Method and device for guiding operation body to perform air-separating operation |
CN113434064B (en) * | 2021-07-01 | 2022-03-29 | 掌阅科技股份有限公司 | Handwriting reader stroke switching method, electronic equipment and storage medium |
Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP0982678A2 (en) * | 1998-08-27 | 2000-03-01 | Wacom Co., Ltd. | Digitizer tablet with active and boundary areas |
US20040008189A1 (en) * | 2002-07-10 | 2004-01-15 | Clapper Edward O. | Multi-mouse actions stylus |
Family Cites Families (13)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPS6370326A (en) | 1986-09-12 | 1988-03-30 | Wacom Co Ltd | Position detector |
DE307667T1 (en) | 1987-08-24 | 1991-09-05 | Wacom Co., Ltd., Saitama | COORDINATE INPUT SYSTEM WITH AN INPUT WRITING PEN. |
DE4121180A1 (en) * | 1991-06-27 | 1993-01-07 | Bosch Gmbh Robert | Finger input type interactive screen display system for road vehicle navigation - has panel screen with matrix of sensing elements that can be of infrared or ultrasonic proximity devices or can be touch foil contacts |
US5942733A (en) | 1992-06-08 | 1999-08-24 | Synaptics, Inc. | Stylus input capacitive touchpad sensor |
US5488204A (en) | 1992-06-08 | 1996-01-30 | Synaptics, Incorporated | Paintbrush stylus for capacitive touch sensor pad |
JPH07200137A (en) | 1993-12-28 | 1995-08-04 | Wacom Co Ltd | Position detection device and its position indicator |
US6380929B1 (en) | 1996-09-20 | 2002-04-30 | Synaptics, Incorporated | Pen drawing computer input device |
US6337698B1 (en) | 1998-11-20 | 2002-01-08 | Microsoft Corporation | Pen-based interface for a notepad computer |
JP2002531902A (en) | 1998-11-27 | 2002-09-24 | シナプティックス (ユーケー)リミテッド | Position sensor |
US6664991B1 (en) | 2000-01-06 | 2003-12-16 | Microsoft Corporation | Method and apparatus for providing context menus on a pen-based device |
US6485306B1 (en) | 2001-07-10 | 2002-11-26 | Aiptek International Inc. | Locus-recordable portable handwriting device |
US20020113784A1 (en) * | 2000-12-29 | 2002-08-22 | Feilmeier Michael Leon | Portable computer aided design apparatus and method |
US20030025676A1 (en) * | 2001-08-02 | 2003-02-06 | Koninklijke Philips Electronics N.V. | Sensor-based menu for a touch screen panel |
-
2004
- 2004-10-13 WO PCT/EP2004/011443 patent/WO2006039939A1/en active Application Filing
- 2004-10-13 EP EP04790324A patent/EP1803053A1/en not_active Withdrawn
Patent Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP0982678A2 (en) * | 1998-08-27 | 2000-03-01 | Wacom Co., Ltd. | Digitizer tablet with active and boundary areas |
US20040008189A1 (en) * | 2002-07-10 | 2004-01-15 | Clapper Edward O. | Multi-mouse actions stylus |
Non-Patent Citations (1)
Title |
---|
See also references of WO2006039939A1 * |
Also Published As
Publication number | Publication date |
---|---|
WO2006039939A1 (en) | 2006-04-20 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US9122396B2 (en) | Application quick launch extension | |
US9128597B2 (en) | Method for switching user interface, electronic device and recording medium using the same | |
EP1466241B1 (en) | Method and apparatus for integrating a wide keyboard in a small device | |
US20060061557A1 (en) | Method for using a pointing device | |
US20070082710A1 (en) | Method and apparatus for batch-processing of commands through pattern recognition of panel input in a mobile communication terminal | |
US20090079699A1 (en) | Method and device for associating objects | |
EP1815313B1 (en) | A hand-held electronic appliance and method of displaying a tool-tip | |
US20100026642A1 (en) | User interface apparatus and method using pattern recognition in handy terminal | |
US20080136784A1 (en) | Method and device for selectively activating a function thereof | |
US20070268259A1 (en) | Handheld wireless communication device | |
JP2009530944A (en) | Improved mobile communication terminal and method therefor | |
WO2010040201A1 (en) | Panning and zooming images on a handheld touch-sensitive display | |
US20070254704A1 (en) | Handheld wireless communication device | |
US20070254700A1 (en) | Handheld wireless communication device | |
JPWO2011055816A1 (en) | Information terminal and input control program | |
EP1229428A1 (en) | A portable touch screen device | |
EP1811365A2 (en) | Input unit, mobile terminal unit, and content data manipulation method in mobile terminal unit | |
EP1408400A2 (en) | Touch-pad for use on a portable electronic device | |
US20070254706A1 (en) | Handheld wireless communication device | |
US20070254721A1 (en) | Handheld wireless communication device | |
CN101308421B (en) | Block-free touch control operation electronic device | |
US7986301B2 (en) | Handheld wireless communication device | |
KR100312232B1 (en) | User data interfacing method of digital portable telephone terminal having touch screen panel | |
US20070254707A1 (en) | Handheld wireless communication device | |
US20070254705A1 (en) | Handheld wireless communication device |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
17P | Request for examination filed |
Effective date: 20070514 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): DE FR GB |
|
DAX | Request for extension of the european patent (deleted) | ||
RBV | Designated contracting states (corrected) |
Designated state(s): DE FR GB |
|
17Q | First examination report despatched |
Effective date: 20080117 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN |
|
18D | Application deemed to be withdrawn |
Effective date: 20130704 |