CA2860915A1 - User interface for a touch screen - Google Patents

Abstract

A non-transitory computer readable medium storing instructions which, when executed by a processor of an electronic device that includes a touch sensitive and pressure sensitive display, cause the processor to enable a user interface of the electronic device, by which a glide gesture along the display and an amount of pressure applied to the display both generate the same user interface command.

Description

USER INTERFACE FOR A TOUCH SCREEN
CROSS REFERENCES TO RELATED APPLICATIONS
[0001] This application claims priority benefit of U.S. Provisional Patent Application Serial No. 61/591,921,entitled USER INTERFACE FOR A
LIGHT-BASED TOUCH SCREEN, filed on January 29, 2012 by inventors Remo Behdasht, Richard Henriksson, Thomas Eriksson, Joseph Shain, Anders Jansson, Niklas Kvist, Robert Petterson, Lars Sparf and John Karlsson, the contents of which are hereby incorporated herein in their entirety.

FIELD OF THE INVENTION
[0002] The field of the present invention is pressure-sensitive touch screens.
BACKGROUND OF THE INVENTION

[0003] Many consumer electronic devices are now being built with touch sensitive screens, for use with finger or stylus touch user inputs. These devices range from small screen devices such as mobile phones and car entertainnnent systems, to mid-size screen devices such as notebook computers, to large screen devices such as check-in stations at airports.
However, touch screens are generally limited to user input in the form of finger or stylus taps, and sweep gestures. Pressure-sensitive displays that enable detecting an amount of pressure applied to the screen afford additional possibilities for user interfaces.

SUMMARY OF THE DESCRIPTION

[0004] Aspects of the present invention relate to user interfaces for touch screens that detect both a touch location and an amount of pressure applied to the screen.

[0005] Further aspects of the present invention relate to touch screens that implement these user interfaces and, in one embodiment, to touch screens that implement both a touch sensor and a pressure sensor using an array of light emitters and light receivers.

[0006] There is thus provided in accordance with an embodiment of the present invention a light-based touch screen that discriminates between hard touches and soft touches. In one embodiment, a rigidly mounted screen is surrounded by emitters and receivers. A hard touch is discriminated from a soft touch by an increase in detected light at a plurality of receivers, the increase resulting from a bending of the rigidly mounted screen caused by the hard touch. In another embodiment, a screen is flexibly mounted in a housing surrounded by rigidly mounted emitters and receivers. The pressure of the touch lowers the screen into the housing, resulting in an increase in detected light at a plurality of the receivers. Different amounts of pressure correspond to differences in the increased amounts of detected light.

[0007] There is additionally provided in accordance with an embodiment of the present invention a touch screen, including a housing, a display mounted in the housing, a touch sensor, mounted in the housing and connected to the display, for identifying an object that is gliding along an upper surface of the display, a pressure sensor, mounted in the housing and connected to the display, for determining that pressure is being applied to the display, and a processor, mounted in the housing and connected to the touch and pressure sensors and to the display, for applying a first scroll command to an image rendered on the display in response to the touch sensor identifying the object gliding along the upper surface of the display, and for applying a second scroll command to the image in response to the pressure sensor determining that pressure is being applied to the display.

[0008] There is further provided in accordance with an embodiment of the present invention a non-transitory computer readable medium storing instructions which, when executed by a processor of an electronic device that includes a touch sensitive and pressure sensitive display, cause the processor to enable a user interface of the electronic device, by which a glide gesture along the display and an amount of pressure applied to the display both generate the same user interface command.

[0009] There is yet further provided in accordance with an embodiment of the present invention a non-transitory computer readable medium storing instructions which, when executed by a processor of an electronic device that includes a touch sensitive and pressure sensitive display, cause the processor to enable a user interface of the device, by which an image rendered on the display is zoomed in response to pressure being applied to the display, whereby the zoom is performed such that the location within the image at which the pressure is first applied is the center of the zoomed image.

BRIEF DESCRIPTION OF THE DRAWINGS

[0010] The present invention will be more fully understood and appreciated from the following detailed description, taken in conjunction with the drawings in which:

[0011] FIG. 1 is a diagram of a touch screen having 16 emitters and 16 receivers, in accordance with an embodiment of the present invention;

[0012] FIG. 2 is a simplified flowchart of a method to activate a zoom function on a pressure-sensitive touch screen, in accordance with an embodiment of the present invention;

[0013] FIG. 3 is a simplified illustration of activation of a zoom function on a pressure-sensitive touch screen, in accordance with an embodiment of the present invention;

[0014] FIG. 4 is simplified flowchart of a method to activate a scroll function on a pressure-sensitive touch screen, in accordance with an embodiment of the present invention;

[0015] FIGS. 5 - 8 are illustrations of a touch screen that detects occurrence of a hard press, in accordance with an embodiment of the present invention;

[0016] FIGS. 9 and 10 are bar charts showing increase in light detected, when pressure is applied to a rigidly mounted 7-inch LCD
screen, in accordance with an embodiment of the present invention;

[0017] In the figures, elements numbered in the 100's generally relate to light beams, elements numbered in the 200's generally relate to light sources, elements numbered in the 300's generally relate to light receivers, elements numbered in the 500's generally relate to light guides, elements numbered in the 700's generally relate to circuit elements, elements numbered in the 800's generally relate to electronic devices, and elements numbered in the 900's generally relate to user interfaces. Elennents numbered in the 1000's are operations of flow charts.

[0018] Similarly numbered elements represent elements of the same type, but they need not be identical elements.

DETAILED DESCRIPTION

[0019] Aspects of the present invention relate to pressure-sensitive touch screens and touch surfaces.

[0020] For clarity of exposition, throughout the present specification the term "touch screen" is used as a generic term to refer to touch sensitive surfaces that may or may not include an electronic display. As such, the term "touch screen" as used herein includes inter alia a mouse touchpad as included in many laptop computers, and the cover of a handheld electronic device. The term "optical touch screen" is used as a generic term to refer to light-based touch screens, including inter alia screens that detect a touch based on the difference between an expected light intensity and a detected light intensity, where the detected light intensity may be greater than or less than the expected light intensity. The term "screen glass" is used as a generic term to refer to a transparent screen surface. The screen may be constructed inter alia from glass, or from a non-glass material including inter alia crystal, acrylic and plastic. In some embodiments of the present invention, the screen allows near-infrared light to pass through, but is otherwise non-transparent.

[0021] For clarity of exposition, throughout the present specification, the term "emitter" is used as a generic term to refer to a light emitting element, including inter alia a light-emitting diode (LED), and the output end of a fiber optic or tubular light guide that outputs light into a lens or reflector that directs the light over a display surface. The term "receiver"
is used as a generic term to refer to a light detecting element, including inter alia a photo diode (PD), and the input end of a fiber optic or tubular light guide that receives light beams that traversed a display surface and directs them to a light detecting element or to an image sensor, the image sensor being inter alia a charge coupled device (CCD) or a complementary metal oxide semiconductor (CMOS) image sensor.

[0022] The present invention has multiple embodiments using various touch screen technologies including inter alia resistive, capacitive, projective capacitive and light-based touch sensors. Similarly, many different pressure sensing technologies are used in different embodiments of the present invention. For purposes of exposition, this specification addresses light-based touch sensors and pressure sensors; however, other types of sensors are included within the scope of the invention.

[0023] According to embodiments of the present invention, a light-based touch screen includes one or more emitters, including inter alia infra-red or near infra-red light-ernitting diodes (LEDs), and a plurality of receivers, including inter alia photo diodes (PDs), arranged along the perimeter surrounding the touch screen or touch surface. The emitters project light substantially parallel to the screen surface, and this light is detected by the receivers. A pointer, such as a finger or a stylus, placed over a portion of the screen blocks some of the light beams, and correspondingly some of the receivers detect less light intensity. The geometry of the locations of the receivers, and the light intensities they detect, suffice to determine screen coordinates of the pointer. The emitters and receivers are controlled for selective activation and de-activation by a controller. Generally, each emitter and receiver has I/O
connectors, and signals are transmitted to specify which emitters and which receivers are activated.

[0024] In an embodiment of the present invention, plural emitters are arranged along two adjacent sides of a rectangular screen, and plural receivers are arranged along the other two adjacent sides. In this regard, reference is now made to FIG. 1, which is a diagram of a touch screen 800 having 16 emitters 200 and 16 receivers 300, in accordance with an embodiment of the present invention. Emitters 200 emit infra-red or near infra-red light beams across the top of the touch screen, which are detected by corresponding receivers 300 that are directly opposite respective emitters 200. When a pointer touches touch screen 800, it blocks light from reaching some of receivers 300. By identifying, from the receiver outputs, which light beams have been blocked by the pointer, the pointer's location can be determined.

[0025] Embodiments of the present invention detect an amount of pressure applied to a touch sensitive surface during a touch operation.
Detecting pressure enables discrimination between a light touch and a hard press, and is useful for user interfaces that associate separate actions to a touch and a press. E.g., a user may select a button or icon by touching it, and activate the function associated with the button or icon by pressing on it. Such a user interface is described in applicants' co-pending U.S. Application No. 1 2/486,03 3, entitled USER INTERFACE
FOR MOBILE COMPUTER UNIT.

[0026] Touch sensor and pressure sensor inputs to a central processing unit enable the processing unit to distinguish between no-pressure touch gestures and touch gestures that apply pressure. This allows the processing unit to provide the standard suite of tap and sweep gestures for non-pressure touches, and an additional suite of user inputs when a degree of downward pressure is applied to a screen surface.

[0027] In some embodiments of the present invention, a pressure gesture is used to activate a zoom command; namely, a user presses on an image displayed on a screen in order to enlarge the image. The zoom command is generally a smooth zoom, which gradually increases the zoom factor over time, while the screen is being pressed. In one embodiment of the present invention, the pressure sensor distinguishes multiple levels of applied pressure, and the rate at which the zoom factor increases corresponds to the amount of detected pressure, whereby greater pressure corresponds to a faster rate of increase.

[0028] Reference is made to FIG. 2, which is a simplified flowchart of a method to activate a zoom function on a pressure-sensitive touch screen, in accordance with an embodiment of the present invention. At operation 1011 a determination is made whether a touch is detected on the touch screen. If not, the method exits. If so, at operation 1012 a further determination is made whether pressure is being applied to the touch screen. If not, the method returns to operation 1011. If so, then the current level of pressure being applied to the screen is detected, and compared with the level of pressure previously applied to the screen. If it is determined at operation 1013 that the current pressure level is greater than the previous pressure level, then at operation 1015 the rate of zoom is increased and the method returns to operation 1012. Otherwise, if it is determined at operation 1014 that the current pressure level is less than the previous pressure level, then at operation 1016 the rate of zoom is decreased and the method returns to operation 1012.
Otherwise, the current pressure and the previous pressure levels are the same, and at operation 1017 the zoom rate is maintained and the method returns to operation 1012.

[0029] Conventional zoom commands, such as commands activated by a pinch or spread gesture, zoom in on the center of a displayed image portion. In order to zoom in on a different portion of the image, a user is required to pan the image so as to bring its center to a desired location, and then perform a zoom command.

[0030] In distinction, with embodiments of the present invention, the center of a zoom is the location touched on the display. Reference is made to FIG. 53, which is a simplified illustration of activation of a zoom function on a pressure-sensitive touch screen, in accordance with an embodiment of the present invention. FIG. 53 shows two images of a pressure-sensitive touch screen 800, before and after a zoom operation is performed. In the upper image, showing touch screen 800 before the zoom operation is performed, touch screen 800 displays an airplane in the upper right corner of the screen. A finger 900 is shown applying downward pressure on touch screen 800, at the location of the airplane, to activate a zoom function. Touch screen 800 detects the location of finger 900, and centers the zoomed image at that location. As such, in the lower image, showing touch screen 800 after the zoom operation is performed, the airplane is at the center of touch screen 800. Finger 900 remains at its original location throughout the zoom.

[0031] In embodiments of the present invention, the pressure sensor controls parameters of a scroll command. When display of a document or other object extends beyond the limits of touch screen 800, a portion of the document or object is displayed, and the users sweeps a finger along the vertical dimension of the screen in order to scroll the document or object up or down. In one embodiment, the scroll continues even when the user's finger has reached the upper or lower edge of the screen, as long as contact with the screen is maintained. In this embodiment, the speed of scrolling is determined based on the amount of pressed applied by the finger to touch screen 800, whereby a greater pressure on the screen corresponds to a faster scroll rate.

[0032] Often it is useful for a user scrolling through a large document or object to change the speed of the scroll dynamically. E.g., a user may wish to scroll quickly in order to move to a desired area within a document, and then continue to scroll slowly within the desired area. In accordance with embodiments of the present invention, the user controls the scrolling speed by adjusting the amount of pressure applied by the finger on touch screen 800. In one embodiment, the user reduces the scrolling speed by applying more pressure on the screen. As such, navigating a document is intuitive; namely, the user begins scrolling by maintaining contact with touch screen 800 after a vertical scroll gesture, and then applies pressure to the screen to reduce scrolling speed. It is often easier for a user to increase pressure than to decrease pressure.

[0033] Reference is made to FIG. 4, which is simplified flowchart of a method to activate a scroll function on a pressure-sensitive touch screen, in accordance with an embodiment of the present invention. At operation 1021 a user scrolls a document or other object by sweeping a finger vertically along the touch screen. At operation 1022 a determination is made whether the finger has reached an edge of the touch screen. If so, then at operation 1023 a further determination is made whether the touch is still maintained. If not, the method exits. Otherwise, the current level of pressure being applied to the screen is detected, and compared with the level of pressure previously applied to the screen. If it is determined at operation 1024 that the current pressure level is greater than the previous pressure level, then at operation 1025 the scrolling speed is decreased and the method returns to operation 1023.
Otherwise, at operation 1025 the scrolling speed is maintained, scrolling continues at the same speed, and the method returns to operation 1023.

[0034] In some embodiments of the present invention, a touch enabled device includes a base plane, such as a PCB, a light guide frame rigidly mounted on the base plane, and a resilient member attached to the base plane to suspend or "float" a non-rigidly mounted touch screen inside the light guide frame. A press on the touch screen deflects the floating touch screen along a z-axis, exposing more of the light guide frame. A light guide frame reflector, which directs light over the screen as described hereinabove, is formed so that the exposure allows more light to traverse the screen. In this way, when a hard press on the screen occurs, many of the receivers detect a sudden increase in detected light. Moreover, detection of a hard press may be conditioned upon a touch being detected at the same time, thus preventing false detection of a hard press due to a sudden increase in ambient light. When the downward pressure is released, the resilient member returns the screen to its original position within the light guide frame.

[0035] Reference is made to FIGS. 5 - 8, which are illustrations of a touch screen 800 that detects occurrence of a hard press, in accordance with an embodiment of the present invention. FIG. 5 shows touch screen 800 in rest position, screen 800 being supported by resilient supporting members 841 and 842 which are mounted on a printed circuit board 700 to create a flex air gap 843. FIG. 5 shows two light guides, 518 and 519, one on either side of screen 800, for directing light 100 from an emitter 200 over screen 800 to a receiver 300. Only a small upper portion of each light guide 518 and 519 extends above screen 800.
Receiver 300 communicates detected light intensities to a calculating unit 770.

[0036] FIG. 6 shows a finger 900 pressing down on the screen, causing members 841 and 842 to compress and to narrow flex air gap 843. As a result, a larger portion of light guides 518 and 519 are exposed above screen 800, thus allowing (a) more light 100 from emitter 200 to traverse screen 800 and be detected by receiver 300, and (b) more ambient light 101 to reach receiver 300. In various embodiments, either or both of these increases in detected light are used to indicate a hard press. In other embodiments, the amount of downward pressure applied is determined based on the amount of additional detected light, thus enabling discrimination between more hard and less hard touches.

[0037] In some embodiments, the light guide frame includes protruding lips 520 and 521, shown in FIG. 7, that extend over the edges of screen 800, to counter balance the upward force of resilient members 841 and 842 when no downward pressure is applied to screen 800. Resilient members 841 and 842 may comprise inter alia a flexible mounting material, a torsion spring, an elastic polymer body, or a hydraulic suspension system. FIG. 8 shows emitters 200, receivers 300 coupled with calculating unit 770, and resilient members 841 and 842 arranged on a single PCB 700.

[0038] In other embodiments, the touch screen is not displaceable relative to the frame. However, the screen flexes or bends somewhat in response to a hard press. The bending of the screen causes a sudden increase in detected light in many of the receivers, indicating a hard press on the screen. As indicated hereinabove, detection of a hard press may be conditioned upon a touch also being detected at the same time, thus preventing false detection of a hard press in response to trauma to the device.

[0039] Reference is made to FIGS. 9 and 10, which are bar charts showing increase in light detected, when pressure is applied to a rigidly mounted 7-inch LCD screen, in accordance with an embodiment of the present invention. The bar charts show the amount of light detected from each emitter along one edge of the screen when a soft touch occurs (FIG.
9), and when a hard touch occurs (FIG. 10). The light emitters and light receivers are shift-aligned, so that light from each emitter is detected by two receivers. As such, two bars are shown for each emitter, indicating the light detected by each of the two receivers. Both bars indicate that a touch is detected at receivers opposite LED 4, where no light is detected.
The bar charts show that more light is detected from neighboring emitters in the case of a hard touch, than in the case of a soft touch.

[0040] The present invention has broad application to electronic devices with touch sensitive screens, including small-size, mid-size and large-size screens. Such devices include inter alia computers, home entertainment systems, car entertainment systems, security systems, PDAs, cell phones, electronic games and toys, digital photo frames, digital musical instruments, e-book readers, TVs and GPS navigators.

[0041] In the foregoing specification, the invention has been described with reference to specific exemplary embodiments thereof. It will, however, be evident that various modifications and changes may be made to the specific exemplary embodiments without departing from the broader spirit and scope of the invention as set forth in the appended claims. Accordingly, the specification and drawings are to be regarded in an illustrative rather than a restrictive sense.

Claims (16)

1. A touch screen, comprising:
a housing;
a display mounted in said housing;
a touch sensor, mounted in said housing and connected to said display, for identifying an object that is gliding along an upper surface of said display;
a pressure sensor, mounted in said housing and connected to said display, for determining that pressure is being applied to said display; and a processor, mounted in said housing and connected to said touch and pressure sensors and to said display, for applying a first scroll command to an image rendered on said display in response to said touch sensor identifying the object gliding along the upper surface of said display, and for applying a second scroll command to the image in response to said pressure sensor determining that pressure is being applied to said display.

2. The touch screen of claim 1 wherein said display is flexibly mounted in said housing, and wherein said pressure sensor comprises:
at least one light receiver rigidly mounted below said display in said housing; and a calculating unit connected to said at least one light receiver and to said processor, for receiving outputs indicating amounts of light received by said at least one light receiver, and for determining that pressure is being applied to said display based on an increase in an output from said at least one light receiver.

3. The touch screen of claim 1 wherein said display comprises a flexible material that bends resiliently in response to applied pressure, and wherein said pressure sensor comprises:
at least one light receiver rigidly mounted below said display in said housing; and a calculating unit connected to said at least one light receiver and to said processor, for receiving output indicating amounts of received light from said at least one light receiver, and for determining that pressure is being applied to said display based on an increase in an output from said at least one light receiver.

4. The touch screen of claim 1 wherein said pressure sensor distinguishes multiple levels of pressure being applied to said display, and wherein said processor zooms or scrolls the image rendered on said display at a speed corresponding to the level of pressure detected by said pressure sensor.

5. The touch screen of claim 1, wherein said processor determines that pressure is being applied to said display only when said touch sensor detects a touch on said display.

6. The touch screen of claim 1 wherein said touch sensor and said pressure sensor comprise:
a shared plurality of light emitters below said display in said housing, for emitting light beams across said display; and a shared plurality of light receivers below said display in said housing, for receiving the emitted light beams; and a shared calculating unit, connected to said light receivers, for determining (i) a location of a touch based on receiving less than an expected amount of light at a first one of said receivers, and (ii) a pressure of the touch based on receiving more than an expected amount of light at a second one of said receivers.

7. The touch screen of claim 1, wherein the second scroll command is applied only when said touch sensor identifies the object at an edge of said display while said pressure sensor determines that pressure is being applied to said display.

8. The touch screen of claim 7, wherein the second scroll command is applied only when it is preceded by the first scroll command.

9. A non-transitory computer readable medium storing instructions which, when executed by a processor of an electronic device that comprises a touch sensitive and pressure sensitive display, cause the processor to enable a user interface of the electronic device, by which a glide gesture along the display and an amount of pressure applied to the display both generate the same user interface command.

10. The non-transitory computer readable medium of claim 9, wherein when the glide gesture reaches an edge of the display, the user interface continues to invoke the user interface command in response to the pressure being applied to the display.

11. The non-transitory computer readable medium of claim 9, wherein a parameter of the user interface command is set in accordance with a speed of the glide gesture and an amount of the pressure applied to the display.

12. The non-transitory computer readable medium of claim 11, wherein the user interface command is a scroll command for scrolling information rendered on the display, and wherein the parameter is the speed of the scrolling.

13. The non-transitory computer readable medium of claim 12, wherein greater amounts of pressure correspond to slower scroll speeds.

14. The non-transitory computer readable medium of claim 11, wherein the user interface command is a zoom command for zooming an image rendered on the display, and wherein the parameter is the speed of the zooming.

15. The non-transitory computer readable medium of claim 14, wherein greater amounts of pressure correspond to slower zoom speeds.

16. A non-transitory computer readable medium storing instructions which, when executed by a processor of an electronic device that comprises a touch sensitive and pressure sensitive display, cause the processor to enable a user interface of the device, by which an image rendered on the display is zoomed in response to pressure being applied to the display, whereby the zoom is performed such that the location within the image at which the pressure is first applied is the center of the zoomed image.