WO2007068791A1 - Method and arrangement to manage graphical user interface and portable device provided with graphical user interface - Google Patents

Method and arrangement to manage graphical user interface and portable device provided with graphical user interface Download PDF

Info

Publication number
WO2007068791A1
WO2007068791A1 PCT/FI2006/000409 FI2006000409W WO2007068791A1 WO 2007068791 A1 WO2007068791 A1 WO 2007068791A1 FI 2006000409 W FI2006000409 W FI 2006000409W WO 2007068791 A1 WO2007068791 A1 WO 2007068791A1
Authority
WO
WIPO (PCT)
Prior art keywords
user interface
portable device
graphical user
control means
pointer
Prior art date
Application number
PCT/FI2006/000409
Other languages
French (fr)
Inventor
Antti Piippo
Original Assignee
Elcoteq Se
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Elcoteq Se filed Critical Elcoteq Se
Publication of WO2007068791A1 publication Critical patent/WO2007068791A1/en

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16—Constructional details or arrangements
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/0304—Detection arrangements using opto-electronic means
    • G06F3/0317—Detection arrangements using opto-electronic means in co-operation with a patterned surface, e.g. absolute position or relative movement detection for an optical mouse or pen positioned with respect to a coded surface
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16—Constructional details or arrangements
    • G06F1/1613—Constructional details or arrangements for portable computers
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16—Constructional details or arrangements
    • G06F1/1613—Constructional details or arrangements for portable computers
    • G06F1/1626—Constructional details or arrangements for portable computers with a single-body enclosure integrating a flat display, e.g. Personal Digital Assistants [PDAs]
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2200/00—Indexing scheme relating to G06F1/04 - G06F1/32
    • G06F2200/16—Indexing scheme relating to G06F1/16 - G06F1/18
    • G06F2200/163—Indexing scheme relating to constructional details of the computer
    • G06F2200/1637—Sensing arrangement for detection of housing movement or orientation, e.g. for controlling scrolling or cursor movement on the display of an handheld computer
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/048—Indexing scheme relating to G06F3/048
    • G06F2203/04804—Transparency, e.g. transparent or translucent windows

Definitions

  • the present invention relates to graphical user interfaces. More particularly, the present invention relates to a method for controlling the graphical user interface of, preferably, a mobile telephone, a Personal Digital Assistant (PDA), an intelligent telephone, a computer or the like, which graphical user interface includes a pointer and background graphics which can be moved with respect to each other, in which method the background graphics visible in the graphical user interface is moved, i.e. scrolled, on a display of a portable device in the background of the pointer continuously fixed on the display of the graphical user interface by means of a control means associated with the graphical user interface when the portable device is moved along a base.
  • PDA Personal Digital Assistant
  • the present invention also relates to an arrangement for controlling a graphical user interface of a mobile telephone, a PDA, an intelligent telephone or a similar portable device, which arrangement includes background graphics and a pointer which can be moved with respect to each other, the pointer being a pointer continuously fixed on a display of the portable device, and in which portable device a manually or automatically activated graphical user interface control means affecting the graphical user interface is integrated as an integral part, and which portable device is intended to be moved along a base in order to move, Le. scroll, the background graphics in the background of the continuously fixed pointer of the graphical user interface.
  • the present invention relates to a portable device equipped with a graphical user interface including a pointer and background graphics which can be moved with respect to each other, preferably a mobile telephone, a PDA, an intelligent telephone or the like, which graphical user interface consists of a pointer fixed with respect to a display and background graphics movable with respect to the pointer, which background graphics can be moved in a desired direction when the portable device is moved along a base, and in which portable device a manually or automatically activated graphical user interface control means affecting the graphical user interface is integrated as an integral part in order to move, i.e. scroll the background graphics in the background of the continuously fixed pointer of the graphical user interface when the portable device moves along a base.
  • the present invention is, however, not dependent on the type of the device or system, as a graphical user interface is today almost without exception the user interface of data processing devices and systems as well as communications devices and systems.
  • the graphical user interface according to prior art has been based on the basic idea that, in order to control the user interface, it must be possible to move a pointer with respect to a graphical base visible on a display. When the area of the graphical base is larger than the area of the display, i.e.
  • the display it is typical of the graphical user interface according to prior art that there are narrow bars at the top and/or bottom of the display, by means of which the graphical base can be scrolled on the display and thereby usually also with respect to the pointer.
  • a function related to the pointer is also known by means of which the graphical base can be locked to be immobile with respect to the pointer and thus the graphical base can be scrolled on the display - in this case the scrolling direction is usually vertical.
  • the pointer in order to control the graphical user interface, the pointer is movable on the display to select a desired position and/or area and thus to activate a desired function.
  • the device or system can be controlled by means of the graphical user interface.
  • a particularly significant problem is related to graphical user interfaces when the display is small in size. In a small display it is difficult to position the pointer and therefore it is difficult to activate the desired function; the selection of a desired position and/or area is not unproblematic in a small display either. Such a problem is significant, for example, when "surfing" on websites as it is difficult to position the pointer on a desired link.
  • This function enables moving a graphical base, e.g. a map base or a website, on the display by tilting the mobile telephone.
  • a desired spot such as a WWW link.
  • this proposal is not unproblematically suitable for other uses except to be used in connection with a viewing state.
  • Another weakness is that, in order to maintain the MIRROR function, the function maintenance button must be continuously held down, which is certainly tiring in long-term use.
  • the terminal device again functions like a conventional terminal device, i.e. the pointer is movable with respect to the background graphics.
  • One object of the present invention is to eliminate or at least substantially remove the drawbacks and weaknesses related to prior art. These objects are achieved by means of the above-mentioned method and arrangement for controlling a graphical user interface and the portable device equipped with a graphical user interface. Their special characteristics are presented in the appended set of claims.
  • the graphical user interface consists of a fixed pointer and background graphics which can be moved with respect to the pointer.
  • the background graphics are moved by means of a control means affecting the graphical user interface.
  • the moving of the background graphics is enabled by a manually or automatically activated graphical user interface control means, which is arranged in the device according to the invention and which may be:
  • an optical means functioning as a reader device or a scanner device, which may be arranged as a functional part of a camera module, or • a mechanical means, which may be a roll means, for example, or
  • a sensor means which may be a position sensor and/or an acceleration sensor and/or a motion sensor and/or a pressure sensor, for example, or
  • a wireless data transmission connection which may be a BluetoothTM connection, an infrared (IR) connection or a radio frequency (RF) connection, for example, or a supporting data transmission protocol or a suitable wired data transmission connection, can be applied to the graphical user interface control means included in the arrangement according to the invention.
  • IR infrared
  • RF radio frequency
  • the present invention can be implemented by software by implementing a program suitable for the arrangement according to the invention for controlling the graphical user interface.
  • the control arrangement according to the invention can be used in mobile stations and other portable devices and computers • instead of a mouse or a corresponding means or the like, which, in known graphical user interface control solutions in computers, for example, is a manually movable wired/wireless mouse means and/or joystick/multidirectional switch and/or a "touchpad” solution, as a control means affecting the graphical user interface, or
  • the arrangement according to the invention provides movement of the background graphics and the pointer of the graphical user interface with respect to each other so that the pointer is a continuously immobile point with respect to the frame of the display in the background of which the background graphics of the control means can be moved by means of the control arrangement.
  • the direction of the movement of the background graphics is opposite to the movement of the control means and the magnitude of the movement of the background graphics substantially corresponds to the magnitude of the movement of the control means.
  • the graphical user interface control arrangement is integrated in the same portable device as the display, which portable device may be a mobile telephone, for example, the device has no moving pointer or means to move it (a joystick/multidirectional switch or the like).
  • the pointer is an immobile point with respect to the display and moving the device moves the background graphics in the background of the pointer, whereby it is easy to position the pointer on the desired spot in the background, which may be a link to a website, for example.
  • Preferred applications for the present invention include, for example, Internet browsing, the browsing and management of Microsoft Office documents, and generally the management of various applications applying a graphical user interface.
  • the method according to the present invention is generally intended to be applied to a device or system equipped with a graphical operating system 10, 11 for controlling a graphical user interface 10, 11.
  • a graphical operating system 10 for controlling a graphical user interface 10, 11.
  • Such devices preferably include mobile telephones 1 (cf. Figure 1), PDAs, intelligent telephones, computers 5 (cf. Figure 2) and data processing systems.
  • a typical graphical operating system includes a pointer 11 and background graphics 10 which can be moved with respect to each other.
  • the invention is characterized in that the background graphics 10 included in the user interface are moved, i.e.
  • a user interface control means 3 which is moved along a base, which may be the surface of a desk or the user's hand/foot.
  • the direction of the movement Al, Bl, Cl of the background graphics is opposite to the direction of the movement A, B, C of the control means.
  • the background graphics it is preferable that the background graphics move substantially in correspondence with the magnitude of the movement of the control means.
  • Figure 1 shows an application applying the invention for controlling a graphical user interface, integrated in a mobile telephone 1
  • Figure 2 shows an application applying the invention for controlling a graphical user interface, arranged in connection with a portable computer.
  • the background graphics 10 are formed by a website which is larger than the size of the display 2 of the mobile telephone 1 or the display 2 of the computer 5. Thereby part of the website remains invisible on the display.
  • the pointer 11 is formed of two lines perpendicular to each other.
  • the graphical user interface thus consists of the pointer 11, which is a continuously immobile point with respect to the display 2 and which has been illustrated in the figures by two lines perpendicular to each other, and the background graphics 10, which can be moved on the display 2 by means of the control means 3 affecting the user interface.
  • the control means 3 affecting the operating system 10, 11, which according to the invention enables moving the background graphics 10, may be a user interface control means activated manually by means of a key in the control means 3 or the device 1, 5, for example, or automatically on the basis of the position/manner of handling/speed of movement of the control means or the like, for example.
  • control means 3 is a control means arranged separately from the device, i.e. the computer 5, which control means is connected to the computer through a wireless/wired connection
  • data transmission connection may be wireless or wired.
  • the wireless data transmission connection may be, for example, a BluetoothTM connection or an infrared (IR) connection or a radio frequency (RF) connection or a similar wireless connection known as such.
  • the data transmission connection may be wireless
  • the mobile telephone 1, for example, which includes a cameral module 3 functioning as a reader device may function as the computer user interface control means.
  • the wired data transmission connection may be any suitable wired connection known as such.
  • the type of connection is not essential with respect to the invention and therefore they are here only mentioned. Another consequence of this large number of options is that the control means 3 may be used according to the invention instead of or as support to both a control means in the device 1 , 5 or the system and a control means associated with the device 1.
  • control means 3 is chosen from a set including
  • an optical reader device such as a scanner device
  • an optical reader device which is arranged as a functional part of a camera module
  • a mechanical means such as a roll means rotated against a base or manually, or
  • a sensor device such as a position sensor and/or an acceleration sensor and/or a motion sensor and/or a pressure sensor
  • the functionality of the arrangement according to the invention may be implemented purely by software so that, in order to control the graphical user interface 10, 11, an application for moving the pointer 11 and the background graphics 10 with respect to each other is implemented in the control application of the arrangement so that the pointer remains continuously immobile on the display 2.
  • the direction of the movement Al, Bl, Cl of the background graphics 10 is opposite to the direction of the movement A, B, C of the control means 3, which substantially facilitates the interpretation of the movement. It is further preferable that the magnitude of the movement Al, Bl, Cl of the background graphics 10 substantially corresponds to the magnitude of the movement A, B, C of the control means, which further facilitates the assessment of the magnitude of the movement by means of which the so far hidden background graphics are displayed on the display 2.
  • Figure 1 shows a preferred embodiment, which shows a mobile telephone 1 equipped with a graphical user interface including a pointer 11 and background graphics 10, which can be moved with respect to each other.
  • the user interface 10, 11 of the mobile telephone according to the invention consists of the pointer which is fixed with respect to a display 2 and the background graphics which can be moved with respect to the pointer, which background graphics are a website in the figure and which can be moved in a desired direction by means of a user interface control means 3 arranged in the mobile telephone.
  • control means 3 which enables the movement of the website 10, is a manually or automatically activated user interface control means, which is arranged as a part of the portable device 1.
  • control means 3 is selected from a set which includes • an optical reader device, such as a scanner device,
  • a mechanical means such as a roll means rotated against a base or manually, or
  • a sensor means such as a position sensor and/or an acceleration sensor and/or a motion sensor and/or a pressure sensor, • or a similar motion recognition means for detecting the movement of the control means and the base with respect to each other.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Hardware Design (AREA)
  • Telephone Function (AREA)
  • Position Input By Displaying (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

A method and an arrangement for controlling a graphical user interface (10, 11) of, preferably, a mobile telephone (1) or a computer (5), which graphical user interface includes a pointer (11) and background graphics (10) which can be moved with respect to each other. The invention is characterized in that the background graphics of the user interface can be moved by means of a user interface control means (3), which is moved along a base. The invention also relates to a mobile telephone or the like equipped with a graphical user interface. According to the invention, the graphical user interface comprises a fixed pointer and background graphics which are movable with respect to the pointer and which can be moved in a desired direction by means of a control means in the mobile telephone, for example a reader device integrated in a camera module.

Description

Method and arrangement to manage graphical user interface and portable device provided with graphical user interface
The present invention relates to graphical user interfaces. More particularly, the present invention relates to a method for controlling the graphical user interface of, preferably, a mobile telephone, a Personal Digital Assistant (PDA), an intelligent telephone, a computer or the like, which graphical user interface includes a pointer and background graphics which can be moved with respect to each other, in which method the background graphics visible in the graphical user interface is moved, i.e. scrolled, on a display of a portable device in the background of the pointer continuously fixed on the display of the graphical user interface by means of a control means associated with the graphical user interface when the portable device is moved along a base. The present invention also relates to an arrangement for controlling a graphical user interface of a mobile telephone, a PDA, an intelligent telephone or a similar portable device, which arrangement includes background graphics and a pointer which can be moved with respect to each other, the pointer being a pointer continuously fixed on a display of the portable device, and in which portable device a manually or automatically activated graphical user interface control means affecting the graphical user interface is integrated as an integral part, and which portable device is intended to be moved along a base in order to move, Le. scroll, the background graphics in the background of the continuously fixed pointer of the graphical user interface. Furthermore, the present invention relates to a portable device equipped with a graphical user interface including a pointer and background graphics which can be moved with respect to each other, preferably a mobile telephone, a PDA, an intelligent telephone or the like, which graphical user interface consists of a pointer fixed with respect to a display and background graphics movable with respect to the pointer, which background graphics can be moved in a desired direction when the portable device is moved along a base, and in which portable device a manually or automatically activated graphical user interface control means affecting the graphical user interface is integrated as an integral part in order to move, i.e. scroll the background graphics in the background of the continuously fixed pointer of the graphical user interface when the portable device moves along a base.
It should be emphasized that the present invention is, however, not dependent on the type of the device or system, as a graphical user interface is today almost without exception the user interface of data processing devices and systems as well as communications devices and systems. As long as it has existed, the graphical user interface according to prior art has been based on the basic idea that, in order to control the user interface, it must be possible to move a pointer with respect to a graphical base visible on a display. When the area of the graphical base is larger than the area of the display, i.e. the display, it is typical of the graphical user interface according to prior art that there are narrow bars at the top and/or bottom of the display, by means of which the graphical base can be scrolled on the display and thereby usually also with respect to the pointer. A function related to the pointer is also known by means of which the graphical base can be locked to be immobile with respect to the pointer and thus the graphical base can be scrolled on the display - in this case the scrolling direction is usually vertical.
Thus it is typical of prior art that, in order to control the graphical user interface, the pointer is movable on the display to select a desired position and/or area and thus to activate a desired function. Thereby the device or system can be controlled by means of the graphical user interface. A particularly significant problem is related to graphical user interfaces when the display is small in size. In a small display it is difficult to position the pointer and therefore it is difficult to activate the desired function; the selection of a desired position and/or area is not unproblematic in a small display either. Such a problem is significant, for example, when "surfing" on websites as it is difficult to position the pointer on a desired link.
The MIRROR function of the MyOrigo™ mobile station is previously known, cf. http://www.mobileburn.com/review.jsp?Id=547. This function enables moving a graphical base, e.g. a map base or a website, on the display by tilting the mobile telephone. However, it has the weakness that it is especially difficult to position a desired spot, such as a WWW link. Thus this proposal is not unproblematically suitable for other uses except to be used in connection with a viewing state. Another weakness is that, in order to maintain the MIRROR function, the function maintenance button must be continuously held down, which is certainly tiring in long-term use. When exiting from this functional state, the terminal device again functions like a conventional terminal device, i.e. the pointer is movable with respect to the background graphics.
One object of the present invention is to eliminate or at least substantially remove the drawbacks and weaknesses related to prior art. These objects are achieved by means of the above-mentioned method and arrangement for controlling a graphical user interface and the portable device equipped with a graphical user interface. Their special characteristics are presented in the appended set of claims.
Thus the basic idea is that the graphical user interface consists of a fixed pointer and background graphics which can be moved with respect to the pointer. According to a preferred embodiment of the invention, the background graphics are moved by means of a control means affecting the graphical user interface.
According to the basic idea of the invention, the moving of the background graphics is enabled by a manually or automatically activated graphical user interface control means, which is arranged in the device according to the invention and which may be:
• an optical means functioning as a reader device or a scanner device, which may be arranged as a functional part of a camera module, or • a mechanical means, which may be a roll means, for example, or
• a sensor means, which may be a position sensor and/or an acceleration sensor and/or a motion sensor and/or a pressure sensor, for example, or
• another similar movement recognition means enabling detection of the movement of the telephone with respect to the base.
A wireless data transmission connection, which may be a Bluetooth™ connection, an infrared (IR) connection or a radio frequency (RF) connection, for example, or a supporting data transmission protocol or a suitable wired data transmission connection, can be applied to the graphical user interface control means included in the arrangement according to the invention.
The present invention can be implemented by software by implementing a program suitable for the arrangement according to the invention for controlling the graphical user interface. Thereby the control arrangement according to the invention can be used in mobile stations and other portable devices and computers • instead of a mouse or a corresponding means or the like, which, in known graphical user interface control solutions in computers, for example, is a manually movable wired/wireless mouse means and/or joystick/multidirectional switch and/or a "touchpad" solution, as a control means affecting the graphical user interface, or
• as support to a mouse or a corresponding means or the like, which, in known graphical user interface control means in computers, for example, is a manually movable wired/wireless mouse means and/or joystick/multidirectional switch and/or a "touchpad" solution, as a control means affecting the pointer.
Thus, the arrangement according to the invention provides movement of the background graphics and the pointer of the graphical user interface with respect to each other so that the pointer is a continuously immobile point with respect to the frame of the display in the background of which the background graphics of the control means can be moved by means of the control arrangement. Preferably, the direction of the movement of the background graphics is opposite to the movement of the control means and the magnitude of the movement of the background graphics substantially corresponds to the magnitude of the movement of the control means.
When the graphical user interface control arrangement is integrated in the same portable device as the display, which portable device may be a mobile telephone, for example, the device has no moving pointer or means to move it (a joystick/multidirectional switch or the like). Thereby the pointer is an immobile point with respect to the display and moving the device moves the background graphics in the background of the pointer, whereby it is easy to position the pointer on the desired spot in the background, which may be a link to a website, for example.
Preferred applications for the present invention include, for example, Internet browsing, the browsing and management of Microsoft Office documents, and generally the management of various applications applying a graphical user interface.
Of the benefits of the invention, it is worth mentioning that • the display graphics are not affected by any restrictions or limits of the display,
• only by moving the graphical user interface control means itself, such as the mobile station itself, or a control means affecting the graphical user interface and connected to the device, such as a computer, by means of a wired/wireless connection, the display graphics in the background of the graphical user interface can be scrolled on the display with respect to the fixed pointer,
• the invention can be implemented by a software solution.
The invention and its other special characteristics will be discussed in the following special part of the specification and the set of claims with reference to the appended drawings, in which Figure 1 shows an example of the invention applied in connection with a mobile telephone, and Figure 2 shows another example of the invention applied in connection with a portable computer.
The method according to the present invention is generally intended to be applied to a device or system equipped with a graphical operating system 10, 11 for controlling a graphical user interface 10, 11. Such devices preferably include mobile telephones 1 (cf. Figure 1), PDAs, intelligent telephones, computers 5 (cf. Figure 2) and data processing systems. A typical graphical operating system includes a pointer 11 and background graphics 10 which can be moved with respect to each other. To implement an enhanced control of the operating system, the invention is characterized in that the background graphics 10 included in the user interface are moved, i.e. scrolled, on a display 2 of the device/system in the background of the continuously immobile pointer included in the graphical user interface by means of a user interface control means 3, which is moved along a base, which may be the surface of a desk or the user's hand/foot.
When the background graphics 10 are moved by means of the control means 3, the direction of the movement Al, Bl, Cl of the background graphics is opposite to the direction of the movement A, B, C of the control means. When the background graphics are moved, it is preferable that the background graphics move substantially in correspondence with the magnitude of the movement of the control means.
Reference is made to Figure 1, which shows an application applying the invention for controlling a graphical user interface, integrated in a mobile telephone 1, and to Figure 2, which shows an application applying the invention for controlling a graphical user interface, arranged in connection with a portable computer. In the figures, the background graphics 10 are formed by a website which is larger than the size of the display 2 of the mobile telephone 1 or the display 2 of the computer 5. Thereby part of the website remains invisible on the display.
Both in the example of Figure 1 and the example of Figure 2, the pointer 11 is formed of two lines perpendicular to each other.
In the examples shown in the figures, the graphical user interface thus consists of the pointer 11, which is a continuously immobile point with respect to the display 2 and which has been illustrated in the figures by two lines perpendicular to each other, and the background graphics 10, which can be moved on the display 2 by means of the control means 3 affecting the user interface.
The control means 3 affecting the operating system 10, 11, which according to the invention enables moving the background graphics 10, may be a user interface control means activated manually by means of a key in the control means 3 or the device 1, 5, for example, or automatically on the basis of the position/manner of handling/speed of movement of the control means or the like, for example.
When the control means 3 is a control means arranged separately from the device, i.e. the computer 5, which control means is connected to the computer through a wireless/wired connection, it is typical of the invention that the data transmission connection may be wireless or wired.
The wireless data transmission connection may be, for example, a Bluetooth™ connection or an infrared (IR) connection or a radio frequency (RF) connection or a similar wireless connection known as such. As the data transmission connection may be wireless, the mobile telephone 1, for example, which includes a cameral module 3 functioning as a reader device, may function as the computer user interface control means. The wired data transmission connection may be any suitable wired connection known as such. However, the type of connection is not essential with respect to the invention and therefore they are here only mentioned. Another consequence of this large number of options is that the control means 3 may be used according to the invention instead of or as support to both a control means in the device 1 , 5 or the system and a control means associated with the device 1.
The functional principle and the different possible data transmission connections enable a fairly free choice of a control means. Preferably, the control means 3 is chosen from a set including
• an optical reader device, such as a scanner device, • an optical reader device which is arranged as a functional part of a camera module,
• a mechanical means, such as a roll means rotated against a base or manually, or
• a sensor device, such as a position sensor and/or an acceleration sensor and/or a motion sensor and/or a pressure sensor,
• or a similar motion recognition means for recognizing the movement of the control means and the base with respect to each other.
The functionality of the arrangement according to the invention may be implemented purely by software so that, in order to control the graphical user interface 10, 11, an application for moving the pointer 11 and the background graphics 10 with respect to each other is implemented in the control application of the arrangement so that the pointer remains continuously immobile on the display 2.
Whether the functionality has been implemented fully or only partly by software, its is preferable according to the invention that the direction of the movement Al, Bl, Cl of the background graphics 10 is opposite to the direction of the movement A, B, C of the control means 3, which substantially facilitates the interpretation of the movement. It is further preferable that the magnitude of the movement Al, Bl, Cl of the background graphics 10 substantially corresponds to the magnitude of the movement A, B, C of the control means, which further facilitates the assessment of the magnitude of the movement by means of which the so far hidden background graphics are displayed on the display 2.
Figure 1 shows a preferred embodiment, which shows a mobile telephone 1 equipped with a graphical user interface including a pointer 11 and background graphics 10, which can be moved with respect to each other. In this embodiment the user interface 10, 11 of the mobile telephone according to the invention consists of the pointer which is fixed with respect to a display 2 and the background graphics which can be moved with respect to the pointer, which background graphics are a website in the figure and which can be moved in a desired direction by means of a user interface control means 3 arranged in the mobile telephone.
Ih the embodiment of Figure 1 the control means 3, which enables the movement of the website 10, is a manually or automatically activated user interface control means, which is arranged as a part of the portable device 1. Preferably, the control means 3 is selected from a set which includes • an optical reader device, such as a scanner device,
• an optical reader device which as been arranged as a functional part of a camera module,
• a mechanical means, such as a roll means rotated against a base or manually, or
• a sensor means, such as a position sensor and/or an acceleration sensor and/or a motion sensor and/or a pressure sensor, • or a similar motion recognition means for detecting the movement of the control means and the base with respect to each other.
The invention has been described above by means of certain preferred examples only. The invention is not limited to these examples, but various alternatives and modifications and functionally equivalent arrangement implementations and partial solutions are possible within the scope defined in the appended set of claims.

Claims

Claims
1. A method for controlling a user interface (10,11) of, preferably, a mobile telephone, a Personal Digital Assistant (PDA), an intelligent telephone, a computer or a similar portable device (1), which graphical user interface includes a pointer (11) and background graphics
(10) which can be moved with respect to each other, in which method the background graphics visible on the user interface are moved, i.e. scrolled, on a display (2) of the portable device in the background of a continuously fixed pointer (11) on the display of the graphical user interface by means of a control means (3) associated with the graphical user interface when the portable device is moved along a base, characterized in that the movement (A, B, C) of the portable device (1) along the base is recognized by the graphical user interface (10,11) control means (3) and that optionally an optical reader device, such as a scanner device, or another optical reader device functionally arranged to be associated with a camera means of the portable device, for example, is used as the control means.
2. A method as claimed in claim 1, characterized in that the background graphics (10) are moved by means of the control means (3) in the direction of the movement (Al, Bl, Cl) opposite to the movement (A, B, C) of the control means, preferably in correspondence with the magnitude of the movement of the control means (A, B, C).
3. A arrangement for controlling a graphical user interface (10, 11) of a mobile telephone, a Personal Digital Assistant (PDA), an intelligent telephone or a similar portable device (1), which arrangement includes background graphics (10) and a pointer (11) which can be moved with respect to each other, which pointer is a pointer continuously fixed on a display (2) of the portable device, and in which portable device a graphical user interface control means (3) activated manually or automatically and affecting the graphical user interface is integrated as an integral part, and which portable device is intended to be moved along a base for moving, i.e. scrolling, the background graphics of the graphical user interface in the background of the continuously fixed pointer of the graphical user interface, characterized in that, in order to recognize the movement of the portable device
(1) and the base with respect to each other when the portable device is moved along the base, the control means (3) of the graphical user interface (10, 11) arranged in the portable device is optionally an optical reader device, such as a scanner device, or another optical reader device arranged to be functionally associated with a camera means of the portable device, for example.
4. A arrangement as claimed in claim 3, characterized in that the functionality of the control means (3) in the portable device (1) is implemented by software so that, in order to control the graphical user interface (10, 11), an application for moving the pointer (11) and the background graphics (10) with respect to each other so that the pointer stays continuously immobile on the display (2) is implemented in the control application of the portable device.
5. An arrangement as claimed in claim 3 and/or 4, characterized in that the control means (3) arranged in the portable device (1) is aiτanged to be used instead of or as support to another control means associated with the portable device, such as a mouse and/or a joystick/multidirectional switch and/or a "touchpad" means solution or the like.
6. An arrangement as claimed in claim 5, characterized in that a data transmission connection between the other control means and the portable device (1) is a suitable wireless connection, preferably a Bluetooth™ connection or an infrared (IR) connection or a radio frequency (RF) connection, or a suitable wired data transmission connection.
7. An arrangement as claimed in any one of the preceding claims, characterized in that the direction of the movement (Al, Bl, Cl) of the background graphics (10) is opposite to the direction of the movement (A, B, C) of the control means (3) in the portable device (1), preferably so that the magnitude of the movement (Al, Bl, Cl) of the background graphics (10) substantially corresponds to the magnitude of the movement (A, B, C) of the control means (3) arranged in the portable device.
8. A portable device, preferably a mobile telephone, a Personal Digital Assistant (PDA), an intelligent telephone or the like, equipped with a graphical user interface including a pointer (11) and background graphics (10) which can be moved with respect to each other, which graphical user interface (10, 11) consists of the pointer (11) fixed with respect to a display (2) and the background graphics (10) which are movable with respect to the pointer and can be moved in a desired direction by moving the portable device along a base, and in which portable device a graphical user interface control means (3) affecting the graphical user interface and activated manually or automatically is integrated as an integral part for moving, i.e. scrolling, the background graphics in the background of the continuously fixed pointer of the graphical user interface when the portable device moves along the base, characterized in that, in order to recognize the movement of the portable device (1) on the base and their movement with respect to each other, the control means (3) of the graphical user interface (10, 11) arranged in the portable device is optionally an optical reader device, such as a scanner device, or another optical reader device arranged to be functionally associated with a camera means of the portable device, for example.
PCT/FI2006/000409 2005-12-13 2006-12-13 Method and arrangement to manage graphical user interface and portable device provided with graphical user interface WO2007068791A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
FI20051283A FI20051283A (en) 2005-12-13 2005-12-13 Method and Arrangement for Managing a Graphical User Interface and a Portable Device with a Graphical User Interface
FI20051283 2005-12-13

Publications (1)

Publication Number Publication Date
WO2007068791A1 true WO2007068791A1 (en) 2007-06-21

Family

ID=35510648

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/FI2006/000409 WO2007068791A1 (en) 2005-12-13 2006-12-13 Method and arrangement to manage graphical user interface and portable device provided with graphical user interface

Country Status (2)

Country Link
FI (1) FI20051283A (en)
WO (1) WO2007068791A1 (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2009150522A1 (en) * 2008-06-11 2009-12-17 Nokia Corporation Camera gestures for user interface control
US8785709B2 (en) 2011-03-30 2014-07-22 University Of Louisville Research Foundation, Inc. Catalytic isomerisation of linear olefinic hydrocarbons
WO2018130909A3 (en) * 2017-01-11 2018-09-27 Intelligent Inventions Limited Images with virtual reality backgrounds

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020057256A1 (en) * 2000-11-14 2002-05-16 Flack James F. Fixed cursor
WO2002097597A1 (en) * 2001-05-30 2002-12-05 Palm, Inc. Portable electronic device
GB2387755A (en) * 2002-03-28 2003-10-22 Nec Corp Portable apparatus including improved pointing device using image shift
WO2006036069A1 (en) * 2004-09-27 2006-04-06 Hans Gude Gudensen Information processing system and method

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020057256A1 (en) * 2000-11-14 2002-05-16 Flack James F. Fixed cursor
WO2002097597A1 (en) * 2001-05-30 2002-12-05 Palm, Inc. Portable electronic device
GB2387755A (en) * 2002-03-28 2003-10-22 Nec Corp Portable apparatus including improved pointing device using image shift
WO2006036069A1 (en) * 2004-09-27 2006-04-06 Hans Gude Gudensen Information processing system and method

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2009150522A1 (en) * 2008-06-11 2009-12-17 Nokia Corporation Camera gestures for user interface control
CN102089738A (en) * 2008-06-11 2011-06-08 诺基亚公司 Camera gestures for user interface control
US8269842B2 (en) 2008-06-11 2012-09-18 Nokia Corporation Camera gestures for user interface control
US8785709B2 (en) 2011-03-30 2014-07-22 University Of Louisville Research Foundation, Inc. Catalytic isomerisation of linear olefinic hydrocarbons
WO2018130909A3 (en) * 2017-01-11 2018-09-27 Intelligent Inventions Limited Images with virtual reality backgrounds

Also Published As

Publication number Publication date
FI20051283A0 (en) 2005-12-13
FI20051283A (en) 2007-06-14

Similar Documents

Publication Publication Date Title
US8542186B2 (en) Mobile device with user interaction capability and method of operating same
CN109814972B (en) Interface display method and terminal
US20220197458A1 (en) Portable terminal device
US8786562B2 (en) Mobile electronic device, control method, and storage medium storing control program
EP2613234A1 (en) User interface, device and method for a physically flexible device
US8952904B2 (en) Electronic device, screen control method, and storage medium storing screen control program
US20070192730A1 (en) Electronic device, computer program product and method of managing application windows
EP2068235A2 (en) Input device, display device, input method, display method, and program
US20100088628A1 (en) Live preview of open windows
WO2020134744A1 (en) Icon moving method and mobile terminal
US20090153466A1 (en) Method and System for Optimizing Scrolling and Selection Activity
CN109800045B (en) Display method and terminal
US20060061557A1 (en) Method for using a pointing device
US9298364B2 (en) Mobile electronic device, screen control method, and storage medium strong screen control program
CN108491148B (en) Application sharing method and terminal
JP2012141976A (en) Apparatus and method for controlling a screen display in portable terminal
CN110795189A (en) Application starting method and electronic equipment
CN110941469B (en) Application splitting creation method and terminal equipment thereof
US11354031B2 (en) Electronic apparatus, computer-readable non-transitory recording medium, and display control method for controlling a scroll speed of a display screen
CN109885242B (en) Method for executing operation and electronic equipment
US20080012822A1 (en) Motion Browser
JP2017204024A (en) Mobile terminal device
WO2007068791A1 (en) Method and arrangement to manage graphical user interface and portable device provided with graphical user interface
KR20090126686A (en) Method of zooming in/out of video processing apparatus with touch input device and video processing apparatus performing the same
US8384692B2 (en) Menu selection method and apparatus using pointing device

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application
NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 06830918

Country of ref document: EP

Kind code of ref document: A1