WO2007068791A1 - Method and arrangement to manage graphical user interface and portable device provided with graphical user interface - Google Patents
Method and arrangement to manage graphical user interface and portable device provided with graphical user interface Download PDFInfo
- Publication number
- WO2007068791A1 WO2007068791A1 PCT/FI2006/000409 FI2006000409W WO2007068791A1 WO 2007068791 A1 WO2007068791 A1 WO 2007068791A1 FI 2006000409 W FI2006000409 W FI 2006000409W WO 2007068791 A1 WO2007068791 A1 WO 2007068791A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- user interface
- portable device
- graphical user
- control means
- pointer
- Prior art date
Links
- 238000000034 method Methods 0.000 title claims abstract description 10
- 230000033001 locomotion Effects 0.000 claims description 36
- 230000003287 optical effect Effects 0.000 claims description 11
- 230000005540 biological transmission Effects 0.000 claims description 10
- 230000001133 acceleration Effects 0.000 description 3
- 238000012545 processing Methods 0.000 description 2
- 230000001419 dependent effect Effects 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 230000007774 longterm Effects 0.000 description 1
- 238000012423 maintenance Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 229920001690 polydopamine Polymers 0.000 description 1
- 238000012552 review Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
- G06F1/16—Constructional details or arrangements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/0304—Detection arrangements using opto-electronic means
- G06F3/0317—Detection arrangements using opto-electronic means in co-operation with a patterned surface, e.g. absolute position or relative movement detection for an optical mouse or pen positioned with respect to a coded surface
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
- G06F1/16—Constructional details or arrangements
- G06F1/1613—Constructional details or arrangements for portable computers
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
- G06F1/16—Constructional details or arrangements
- G06F1/1613—Constructional details or arrangements for portable computers
- G06F1/1626—Constructional details or arrangements for portable computers with a single-body enclosure integrating a flat display, e.g. Personal Digital Assistants [PDAs]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2200/00—Indexing scheme relating to G06F1/04 - G06F1/32
- G06F2200/16—Indexing scheme relating to G06F1/16 - G06F1/18
- G06F2200/163—Indexing scheme relating to constructional details of the computer
- G06F2200/1637—Sensing arrangement for detection of housing movement or orientation, e.g. for controlling scrolling or cursor movement on the display of an handheld computer
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
- G06F2203/048—Indexing scheme relating to G06F3/048
- G06F2203/04804—Transparency, e.g. transparent or translucent windows
Definitions
- the present invention relates to graphical user interfaces. More particularly, the present invention relates to a method for controlling the graphical user interface of, preferably, a mobile telephone, a Personal Digital Assistant (PDA), an intelligent telephone, a computer or the like, which graphical user interface includes a pointer and background graphics which can be moved with respect to each other, in which method the background graphics visible in the graphical user interface is moved, i.e. scrolled, on a display of a portable device in the background of the pointer continuously fixed on the display of the graphical user interface by means of a control means associated with the graphical user interface when the portable device is moved along a base.
- PDA Personal Digital Assistant
- the present invention also relates to an arrangement for controlling a graphical user interface of a mobile telephone, a PDA, an intelligent telephone or a similar portable device, which arrangement includes background graphics and a pointer which can be moved with respect to each other, the pointer being a pointer continuously fixed on a display of the portable device, and in which portable device a manually or automatically activated graphical user interface control means affecting the graphical user interface is integrated as an integral part, and which portable device is intended to be moved along a base in order to move, Le. scroll, the background graphics in the background of the continuously fixed pointer of the graphical user interface.
- the present invention relates to a portable device equipped with a graphical user interface including a pointer and background graphics which can be moved with respect to each other, preferably a mobile telephone, a PDA, an intelligent telephone or the like, which graphical user interface consists of a pointer fixed with respect to a display and background graphics movable with respect to the pointer, which background graphics can be moved in a desired direction when the portable device is moved along a base, and in which portable device a manually or automatically activated graphical user interface control means affecting the graphical user interface is integrated as an integral part in order to move, i.e. scroll the background graphics in the background of the continuously fixed pointer of the graphical user interface when the portable device moves along a base.
- the present invention is, however, not dependent on the type of the device or system, as a graphical user interface is today almost without exception the user interface of data processing devices and systems as well as communications devices and systems.
- the graphical user interface according to prior art has been based on the basic idea that, in order to control the user interface, it must be possible to move a pointer with respect to a graphical base visible on a display. When the area of the graphical base is larger than the area of the display, i.e.
- the display it is typical of the graphical user interface according to prior art that there are narrow bars at the top and/or bottom of the display, by means of which the graphical base can be scrolled on the display and thereby usually also with respect to the pointer.
- a function related to the pointer is also known by means of which the graphical base can be locked to be immobile with respect to the pointer and thus the graphical base can be scrolled on the display - in this case the scrolling direction is usually vertical.
- the pointer in order to control the graphical user interface, the pointer is movable on the display to select a desired position and/or area and thus to activate a desired function.
- the device or system can be controlled by means of the graphical user interface.
- a particularly significant problem is related to graphical user interfaces when the display is small in size. In a small display it is difficult to position the pointer and therefore it is difficult to activate the desired function; the selection of a desired position and/or area is not unproblematic in a small display either. Such a problem is significant, for example, when "surfing" on websites as it is difficult to position the pointer on a desired link.
- This function enables moving a graphical base, e.g. a map base or a website, on the display by tilting the mobile telephone.
- a desired spot such as a WWW link.
- this proposal is not unproblematically suitable for other uses except to be used in connection with a viewing state.
- Another weakness is that, in order to maintain the MIRROR function, the function maintenance button must be continuously held down, which is certainly tiring in long-term use.
- the terminal device again functions like a conventional terminal device, i.e. the pointer is movable with respect to the background graphics.
- One object of the present invention is to eliminate or at least substantially remove the drawbacks and weaknesses related to prior art. These objects are achieved by means of the above-mentioned method and arrangement for controlling a graphical user interface and the portable device equipped with a graphical user interface. Their special characteristics are presented in the appended set of claims.
- the graphical user interface consists of a fixed pointer and background graphics which can be moved with respect to the pointer.
- the background graphics are moved by means of a control means affecting the graphical user interface.
- the moving of the background graphics is enabled by a manually or automatically activated graphical user interface control means, which is arranged in the device according to the invention and which may be:
- an optical means functioning as a reader device or a scanner device, which may be arranged as a functional part of a camera module, or • a mechanical means, which may be a roll means, for example, or
- a sensor means which may be a position sensor and/or an acceleration sensor and/or a motion sensor and/or a pressure sensor, for example, or
- a wireless data transmission connection which may be a BluetoothTM connection, an infrared (IR) connection or a radio frequency (RF) connection, for example, or a supporting data transmission protocol or a suitable wired data transmission connection, can be applied to the graphical user interface control means included in the arrangement according to the invention.
- IR infrared
- RF radio frequency
- the present invention can be implemented by software by implementing a program suitable for the arrangement according to the invention for controlling the graphical user interface.
- the control arrangement according to the invention can be used in mobile stations and other portable devices and computers • instead of a mouse or a corresponding means or the like, which, in known graphical user interface control solutions in computers, for example, is a manually movable wired/wireless mouse means and/or joystick/multidirectional switch and/or a "touchpad” solution, as a control means affecting the graphical user interface, or
- the arrangement according to the invention provides movement of the background graphics and the pointer of the graphical user interface with respect to each other so that the pointer is a continuously immobile point with respect to the frame of the display in the background of which the background graphics of the control means can be moved by means of the control arrangement.
- the direction of the movement of the background graphics is opposite to the movement of the control means and the magnitude of the movement of the background graphics substantially corresponds to the magnitude of the movement of the control means.
- the graphical user interface control arrangement is integrated in the same portable device as the display, which portable device may be a mobile telephone, for example, the device has no moving pointer or means to move it (a joystick/multidirectional switch or the like).
- the pointer is an immobile point with respect to the display and moving the device moves the background graphics in the background of the pointer, whereby it is easy to position the pointer on the desired spot in the background, which may be a link to a website, for example.
- Preferred applications for the present invention include, for example, Internet browsing, the browsing and management of Microsoft Office documents, and generally the management of various applications applying a graphical user interface.
- the method according to the present invention is generally intended to be applied to a device or system equipped with a graphical operating system 10, 11 for controlling a graphical user interface 10, 11.
- a graphical operating system 10 for controlling a graphical user interface 10, 11.
- Such devices preferably include mobile telephones 1 (cf. Figure 1), PDAs, intelligent telephones, computers 5 (cf. Figure 2) and data processing systems.
- a typical graphical operating system includes a pointer 11 and background graphics 10 which can be moved with respect to each other.
- the invention is characterized in that the background graphics 10 included in the user interface are moved, i.e.
- a user interface control means 3 which is moved along a base, which may be the surface of a desk or the user's hand/foot.
- the direction of the movement Al, Bl, Cl of the background graphics is opposite to the direction of the movement A, B, C of the control means.
- the background graphics it is preferable that the background graphics move substantially in correspondence with the magnitude of the movement of the control means.
- Figure 1 shows an application applying the invention for controlling a graphical user interface, integrated in a mobile telephone 1
- Figure 2 shows an application applying the invention for controlling a graphical user interface, arranged in connection with a portable computer.
- the background graphics 10 are formed by a website which is larger than the size of the display 2 of the mobile telephone 1 or the display 2 of the computer 5. Thereby part of the website remains invisible on the display.
- the pointer 11 is formed of two lines perpendicular to each other.
- the graphical user interface thus consists of the pointer 11, which is a continuously immobile point with respect to the display 2 and which has been illustrated in the figures by two lines perpendicular to each other, and the background graphics 10, which can be moved on the display 2 by means of the control means 3 affecting the user interface.
- the control means 3 affecting the operating system 10, 11, which according to the invention enables moving the background graphics 10, may be a user interface control means activated manually by means of a key in the control means 3 or the device 1, 5, for example, or automatically on the basis of the position/manner of handling/speed of movement of the control means or the like, for example.
- control means 3 is a control means arranged separately from the device, i.e. the computer 5, which control means is connected to the computer through a wireless/wired connection
- data transmission connection may be wireless or wired.
- the wireless data transmission connection may be, for example, a BluetoothTM connection or an infrared (IR) connection or a radio frequency (RF) connection or a similar wireless connection known as such.
- the data transmission connection may be wireless
- the mobile telephone 1, for example, which includes a cameral module 3 functioning as a reader device may function as the computer user interface control means.
- the wired data transmission connection may be any suitable wired connection known as such.
- the type of connection is not essential with respect to the invention and therefore they are here only mentioned. Another consequence of this large number of options is that the control means 3 may be used according to the invention instead of or as support to both a control means in the device 1 , 5 or the system and a control means associated with the device 1.
- control means 3 is chosen from a set including
- an optical reader device such as a scanner device
- an optical reader device which is arranged as a functional part of a camera module
- a mechanical means such as a roll means rotated against a base or manually, or
- a sensor device such as a position sensor and/or an acceleration sensor and/or a motion sensor and/or a pressure sensor
- the functionality of the arrangement according to the invention may be implemented purely by software so that, in order to control the graphical user interface 10, 11, an application for moving the pointer 11 and the background graphics 10 with respect to each other is implemented in the control application of the arrangement so that the pointer remains continuously immobile on the display 2.
- the direction of the movement Al, Bl, Cl of the background graphics 10 is opposite to the direction of the movement A, B, C of the control means 3, which substantially facilitates the interpretation of the movement. It is further preferable that the magnitude of the movement Al, Bl, Cl of the background graphics 10 substantially corresponds to the magnitude of the movement A, B, C of the control means, which further facilitates the assessment of the magnitude of the movement by means of which the so far hidden background graphics are displayed on the display 2.
- Figure 1 shows a preferred embodiment, which shows a mobile telephone 1 equipped with a graphical user interface including a pointer 11 and background graphics 10, which can be moved with respect to each other.
- the user interface 10, 11 of the mobile telephone according to the invention consists of the pointer which is fixed with respect to a display 2 and the background graphics which can be moved with respect to the pointer, which background graphics are a website in the figure and which can be moved in a desired direction by means of a user interface control means 3 arranged in the mobile telephone.
- control means 3 which enables the movement of the website 10, is a manually or automatically activated user interface control means, which is arranged as a part of the portable device 1.
- control means 3 is selected from a set which includes • an optical reader device, such as a scanner device,
- a mechanical means such as a roll means rotated against a base or manually, or
- a sensor means such as a position sensor and/or an acceleration sensor and/or a motion sensor and/or a pressure sensor, • or a similar motion recognition means for detecting the movement of the control means and the base with respect to each other.
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Computer Hardware Design (AREA)
- Telephone Function (AREA)
- Position Input By Displaying (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
A method and an arrangement for controlling a graphical user interface (10, 11) of, preferably, a mobile telephone (1) or a computer (5), which graphical user interface includes a pointer (11) and background graphics (10) which can be moved with respect to each other. The invention is characterized in that the background graphics of the user interface can be moved by means of a user interface control means (3), which is moved along a base. The invention also relates to a mobile telephone or the like equipped with a graphical user interface. According to the invention, the graphical user interface comprises a fixed pointer and background graphics which are movable with respect to the pointer and which can be moved in a desired direction by means of a control means in the mobile telephone, for example a reader device integrated in a camera module.
Description
Method and arrangement to manage graphical user interface and portable device provided with graphical user interface
The present invention relates to graphical user interfaces. More particularly, the present invention relates to a method for controlling the graphical user interface of, preferably, a mobile telephone, a Personal Digital Assistant (PDA), an intelligent telephone, a computer or the like, which graphical user interface includes a pointer and background graphics which can be moved with respect to each other, in which method the background graphics visible in the graphical user interface is moved, i.e. scrolled, on a display of a portable device in the background of the pointer continuously fixed on the display of the graphical user interface by means of a control means associated with the graphical user interface when the portable device is moved along a base. The present invention also relates to an arrangement for controlling a graphical user interface of a mobile telephone, a PDA, an intelligent telephone or a similar portable device, which arrangement includes background graphics and a pointer which can be moved with respect to each other, the pointer being a pointer continuously fixed on a display of the portable device, and in which portable device a manually or automatically activated graphical user interface control means affecting the graphical user interface is integrated as an integral part, and which portable device is intended to be moved along a base in order to move, Le. scroll, the background graphics in the background of the continuously fixed pointer of the graphical user interface. Furthermore, the present invention relates to a portable device equipped with a graphical user interface including a pointer and background graphics which can be moved with respect to each other, preferably a mobile telephone, a PDA, an intelligent telephone or the like, which graphical user interface consists of a pointer fixed with respect to a display and background graphics movable with respect to the pointer, which background graphics can be moved in a desired direction when the portable device is moved along a base, and in which portable device a manually or automatically activated graphical user interface control means affecting the graphical user interface is integrated as an integral part in order to move, i.e. scroll the background graphics in the background of the continuously fixed pointer of the graphical user interface when the portable device moves along a base.
It should be emphasized that the present invention is, however, not dependent on the type of the device or system, as a graphical user interface is today almost without exception the user interface of data processing devices and systems as well as communications devices and systems.
As long as it has existed, the graphical user interface according to prior art has been based on the basic idea that, in order to control the user interface, it must be possible to move a pointer with respect to a graphical base visible on a display. When the area of the graphical base is larger than the area of the display, i.e. the display, it is typical of the graphical user interface according to prior art that there are narrow bars at the top and/or bottom of the display, by means of which the graphical base can be scrolled on the display and thereby usually also with respect to the pointer. A function related to the pointer is also known by means of which the graphical base can be locked to be immobile with respect to the pointer and thus the graphical base can be scrolled on the display - in this case the scrolling direction is usually vertical.
Thus it is typical of prior art that, in order to control the graphical user interface, the pointer is movable on the display to select a desired position and/or area and thus to activate a desired function. Thereby the device or system can be controlled by means of the graphical user interface. A particularly significant problem is related to graphical user interfaces when the display is small in size. In a small display it is difficult to position the pointer and therefore it is difficult to activate the desired function; the selection of a desired position and/or area is not unproblematic in a small display either. Such a problem is significant, for example, when "surfing" on websites as it is difficult to position the pointer on a desired link.
The MIRROR function of the MyOrigo™ mobile station is previously known, cf. http://www.mobileburn.com/review.jsp?Id=547. This function enables moving a graphical base, e.g. a map base or a website, on the display by tilting the mobile telephone. However, it has the weakness that it is especially difficult to position a desired spot, such as a WWW link. Thus this proposal is not unproblematically suitable for other uses except to be used in connection with a viewing state. Another weakness is that, in order to maintain the MIRROR function, the function maintenance button must be continuously held down, which is certainly tiring in long-term use. When exiting from this functional state, the terminal device again functions like a conventional terminal device, i.e. the pointer is movable with respect to the background graphics.
One object of the present invention is to eliminate or at least substantially remove the drawbacks and weaknesses related to prior art.
These objects are achieved by means of the above-mentioned method and arrangement for controlling a graphical user interface and the portable device equipped with a graphical user interface. Their special characteristics are presented in the appended set of claims.
Thus the basic idea is that the graphical user interface consists of a fixed pointer and background graphics which can be moved with respect to the pointer. According to a preferred embodiment of the invention, the background graphics are moved by means of a control means affecting the graphical user interface.
According to the basic idea of the invention, the moving of the background graphics is enabled by a manually or automatically activated graphical user interface control means, which is arranged in the device according to the invention and which may be:
• an optical means functioning as a reader device or a scanner device, which may be arranged as a functional part of a camera module, or • a mechanical means, which may be a roll means, for example, or
• a sensor means, which may be a position sensor and/or an acceleration sensor and/or a motion sensor and/or a pressure sensor, for example, or
• another similar movement recognition means enabling detection of the movement of the telephone with respect to the base.
A wireless data transmission connection, which may be a Bluetooth™ connection, an infrared (IR) connection or a radio frequency (RF) connection, for example, or a supporting data transmission protocol or a suitable wired data transmission connection, can be applied to the graphical user interface control means included in the arrangement according to the invention.
The present invention can be implemented by software by implementing a program suitable for the arrangement according to the invention for controlling the graphical user interface. Thereby the control arrangement according to the invention can be used in mobile stations and other portable devices and computers • instead of a mouse or a corresponding means or the like, which, in known graphical user interface control solutions in computers, for example, is a manually movable wired/wireless mouse means and/or joystick/multidirectional switch and/or a "touchpad" solution, as a control means affecting the graphical user interface, or
• as support to a mouse or a corresponding means or the like, which, in known graphical user
interface control means in computers, for example, is a manually movable wired/wireless mouse means and/or joystick/multidirectional switch and/or a "touchpad" solution, as a control means affecting the pointer.
Thus, the arrangement according to the invention provides movement of the background graphics and the pointer of the graphical user interface with respect to each other so that the pointer is a continuously immobile point with respect to the frame of the display in the background of which the background graphics of the control means can be moved by means of the control arrangement. Preferably, the direction of the movement of the background graphics is opposite to the movement of the control means and the magnitude of the movement of the background graphics substantially corresponds to the magnitude of the movement of the control means.
When the graphical user interface control arrangement is integrated in the same portable device as the display, which portable device may be a mobile telephone, for example, the device has no moving pointer or means to move it (a joystick/multidirectional switch or the like). Thereby the pointer is an immobile point with respect to the display and moving the device moves the background graphics in the background of the pointer, whereby it is easy to position the pointer on the desired spot in the background, which may be a link to a website, for example.
Preferred applications for the present invention include, for example, Internet browsing, the browsing and management of Microsoft Office documents, and generally the management of various applications applying a graphical user interface.
Of the benefits of the invention, it is worth mentioning that • the display graphics are not affected by any restrictions or limits of the display,
• only by moving the graphical user interface control means itself, such as the mobile station itself, or a control means affecting the graphical user interface and connected to the device, such as a computer, by means of a wired/wireless connection, the display graphics in the background of the graphical user interface can be scrolled on the display with respect to the fixed pointer,
• the invention can be implemented by a software solution.
The invention and its other special characteristics will be discussed in the following special part of the specification and the set of claims with reference to the appended drawings, in which
Figure 1 shows an example of the invention applied in connection with a mobile telephone, and Figure 2 shows another example of the invention applied in connection with a portable computer.
The method according to the present invention is generally intended to be applied to a device or system equipped with a graphical operating system 10, 11 for controlling a graphical user interface 10, 11. Such devices preferably include mobile telephones 1 (cf. Figure 1), PDAs, intelligent telephones, computers 5 (cf. Figure 2) and data processing systems. A typical graphical operating system includes a pointer 11 and background graphics 10 which can be moved with respect to each other. To implement an enhanced control of the operating system, the invention is characterized in that the background graphics 10 included in the user interface are moved, i.e. scrolled, on a display 2 of the device/system in the background of the continuously immobile pointer included in the graphical user interface by means of a user interface control means 3, which is moved along a base, which may be the surface of a desk or the user's hand/foot.
When the background graphics 10 are moved by means of the control means 3, the direction of the movement Al, Bl, Cl of the background graphics is opposite to the direction of the movement A, B, C of the control means. When the background graphics are moved, it is preferable that the background graphics move substantially in correspondence with the magnitude of the movement of the control means.
Reference is made to Figure 1, which shows an application applying the invention for controlling a graphical user interface, integrated in a mobile telephone 1, and to Figure 2, which shows an application applying the invention for controlling a graphical user interface, arranged in connection with a portable computer. In the figures, the background graphics 10 are formed by a website which is larger than the size of the display 2 of the mobile telephone 1 or the display 2 of the computer 5. Thereby part of the website remains invisible on the display.
Both in the example of Figure 1 and the example of Figure 2, the pointer 11 is formed of two lines perpendicular to each other.
In the examples shown in the figures, the graphical user interface thus consists of the pointer 11, which is a continuously immobile point with respect to the display 2 and which has been
illustrated in the figures by two lines perpendicular to each other, and the background graphics 10, which can be moved on the display 2 by means of the control means 3 affecting the user interface.
The control means 3 affecting the operating system 10, 11, which according to the invention enables moving the background graphics 10, may be a user interface control means activated manually by means of a key in the control means 3 or the device 1, 5, for example, or automatically on the basis of the position/manner of handling/speed of movement of the control means or the like, for example.
When the control means 3 is a control means arranged separately from the device, i.e. the computer 5, which control means is connected to the computer through a wireless/wired connection, it is typical of the invention that the data transmission connection may be wireless or wired.
The wireless data transmission connection may be, for example, a Bluetooth™ connection or an infrared (IR) connection or a radio frequency (RF) connection or a similar wireless connection known as such. As the data transmission connection may be wireless, the mobile telephone 1, for example, which includes a cameral module 3 functioning as a reader device, may function as the computer user interface control means. The wired data transmission connection may be any suitable wired connection known as such. However, the type of connection is not essential with respect to the invention and therefore they are here only mentioned. Another consequence of this large number of options is that the control means 3 may be used according to the invention instead of or as support to both a control means in the device 1 , 5 or the system and a control means associated with the device 1.
The functional principle and the different possible data transmission connections enable a fairly free choice of a control means. Preferably, the control means 3 is chosen from a set including
• an optical reader device, such as a scanner device, • an optical reader device which is arranged as a functional part of a camera module,
• a mechanical means, such as a roll means rotated against a base or manually, or
• a sensor device, such as a position sensor and/or an acceleration sensor and/or a motion sensor and/or a pressure sensor,
• or a similar motion recognition means
for recognizing the movement of the control means and the base with respect to each other.
The functionality of the arrangement according to the invention may be implemented purely by software so that, in order to control the graphical user interface 10, 11, an application for moving the pointer 11 and the background graphics 10 with respect to each other is implemented in the control application of the arrangement so that the pointer remains continuously immobile on the display 2.
Whether the functionality has been implemented fully or only partly by software, its is preferable according to the invention that the direction of the movement Al, Bl, Cl of the background graphics 10 is opposite to the direction of the movement A, B, C of the control means 3, which substantially facilitates the interpretation of the movement. It is further preferable that the magnitude of the movement Al, Bl, Cl of the background graphics 10 substantially corresponds to the magnitude of the movement A, B, C of the control means, which further facilitates the assessment of the magnitude of the movement by means of which the so far hidden background graphics are displayed on the display 2.
Figure 1 shows a preferred embodiment, which shows a mobile telephone 1 equipped with a graphical user interface including a pointer 11 and background graphics 10, which can be moved with respect to each other. In this embodiment the user interface 10, 11 of the mobile telephone according to the invention consists of the pointer which is fixed with respect to a display 2 and the background graphics which can be moved with respect to the pointer, which background graphics are a website in the figure and which can be moved in a desired direction by means of a user interface control means 3 arranged in the mobile telephone.
Ih the embodiment of Figure 1 the control means 3, which enables the movement of the website 10, is a manually or automatically activated user interface control means, which is arranged as a part of the portable device 1. Preferably, the control means 3 is selected from a set which includes • an optical reader device, such as a scanner device,
• an optical reader device which as been arranged as a functional part of a camera module,
• a mechanical means, such as a roll means rotated against a base or manually, or
• a sensor means, such as a position sensor and/or an acceleration sensor and/or a motion sensor and/or a pressure sensor,
• or a similar motion recognition means for detecting the movement of the control means and the base with respect to each other.
The invention has been described above by means of certain preferred examples only. The invention is not limited to these examples, but various alternatives and modifications and functionally equivalent arrangement implementations and partial solutions are possible within the scope defined in the appended set of claims.
Claims
Claims
1. A method for controlling a user interface (10,11) of, preferably, a mobile telephone, a Personal Digital Assistant (PDA), an intelligent telephone, a computer or a similar portable device (1), which graphical user interface includes a pointer (11) and background graphics
(10) which can be moved with respect to each other, in which method the background graphics visible on the user interface are moved, i.e. scrolled, on a display (2) of the portable device in the background of a continuously fixed pointer (11) on the display of the graphical user interface by means of a control means (3) associated with the graphical user interface when the portable device is moved along a base, characterized in that the movement (A, B, C) of the portable device (1) along the base is recognized by the graphical user interface (10,11) control means (3) and that optionally an optical reader device, such as a scanner device, or another optical reader device functionally arranged to be associated with a camera means of the portable device, for example, is used as the control means.
2. A method as claimed in claim 1, characterized in that the background graphics (10) are moved by means of the control means (3) in the direction of the movement (Al, Bl, Cl) opposite to the movement (A, B, C) of the control means, preferably in correspondence with the magnitude of the movement of the control means (A, B, C).
3. A arrangement for controlling a graphical user interface (10, 11) of a mobile telephone, a Personal Digital Assistant (PDA), an intelligent telephone or a similar portable device (1), which arrangement includes background graphics (10) and a pointer (11) which can be moved with respect to each other, which pointer is a pointer continuously fixed on a display (2) of the portable device, and in which portable device a graphical user interface control means (3) activated manually or automatically and affecting the graphical user interface is integrated as an integral part, and which portable device is intended to be moved along a base for moving, i.e. scrolling, the background graphics of the graphical user interface in the background of the continuously fixed pointer of the graphical user interface, characterized in that, in order to recognize the movement of the portable device
(1) and the base with respect to each other when the portable device is moved along the base, the control means (3) of the graphical user interface (10, 11) arranged in the portable device is optionally an optical reader device, such as a scanner device, or another optical reader device arranged to be functionally associated with a camera means of the portable
device, for example.
4. A arrangement as claimed in claim 3, characterized in that the functionality of the control means (3) in the portable device (1) is implemented by software so that, in order to control the graphical user interface (10, 11), an application for moving the pointer (11) and the background graphics (10) with respect to each other so that the pointer stays continuously immobile on the display (2) is implemented in the control application of the portable device.
5. An arrangement as claimed in claim 3 and/or 4, characterized in that the control means (3) arranged in the portable device (1) is aiτanged to be used instead of or as support to another control means associated with the portable device, such as a mouse and/or a joystick/multidirectional switch and/or a "touchpad" means solution or the like.
6. An arrangement as claimed in claim 5, characterized in that a data transmission connection between the other control means and the portable device (1) is a suitable wireless connection, preferably a Bluetooth™ connection or an infrared (IR) connection or a radio frequency (RF) connection, or a suitable wired data transmission connection.
7. An arrangement as claimed in any one of the preceding claims, characterized in that the direction of the movement (Al, Bl, Cl) of the background graphics (10) is opposite to the direction of the movement (A, B, C) of the control means (3) in the portable device (1), preferably so that the magnitude of the movement (Al, Bl, Cl) of the background graphics (10) substantially corresponds to the magnitude of the movement (A, B, C) of the control means (3) arranged in the portable device.
8. A portable device, preferably a mobile telephone, a Personal Digital Assistant (PDA), an intelligent telephone or the like, equipped with a graphical user interface including a pointer (11) and background graphics (10) which can be moved with respect to each other, which graphical user interface (10, 11) consists of the pointer (11) fixed with respect to a display (2) and the background graphics (10) which are movable with respect to the pointer and can be moved in a desired direction by moving the portable device along a base, and in which portable device a graphical user interface control means (3) affecting the graphical user interface and activated manually or automatically is integrated as an integral part for
moving, i.e. scrolling, the background graphics in the background of the continuously fixed pointer of the graphical user interface when the portable device moves along the base, characterized in that, in order to recognize the movement of the portable device (1) on the base and their movement with respect to each other, the control means (3) of the graphical user interface (10, 11) arranged in the portable device is optionally an optical reader device, such as a scanner device, or another optical reader device arranged to be functionally associated with a camera means of the portable device, for example.
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
FI20051283A FI20051283A (en) | 2005-12-13 | 2005-12-13 | Method and Arrangement for Managing a Graphical User Interface and a Portable Device with a Graphical User Interface |
FI20051283 | 2005-12-13 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2007068791A1 true WO2007068791A1 (en) | 2007-06-21 |
Family
ID=35510648
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/FI2006/000409 WO2007068791A1 (en) | 2005-12-13 | 2006-12-13 | Method and arrangement to manage graphical user interface and portable device provided with graphical user interface |
Country Status (2)
Country | Link |
---|---|
FI (1) | FI20051283A (en) |
WO (1) | WO2007068791A1 (en) |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2009150522A1 (en) * | 2008-06-11 | 2009-12-17 | Nokia Corporation | Camera gestures for user interface control |
US8785709B2 (en) | 2011-03-30 | 2014-07-22 | University Of Louisville Research Foundation, Inc. | Catalytic isomerisation of linear olefinic hydrocarbons |
WO2018130909A3 (en) * | 2017-01-11 | 2018-09-27 | Intelligent Inventions Limited | Images with virtual reality backgrounds |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20020057256A1 (en) * | 2000-11-14 | 2002-05-16 | Flack James F. | Fixed cursor |
WO2002097597A1 (en) * | 2001-05-30 | 2002-12-05 | Palm, Inc. | Portable electronic device |
GB2387755A (en) * | 2002-03-28 | 2003-10-22 | Nec Corp | Portable apparatus including improved pointing device using image shift |
WO2006036069A1 (en) * | 2004-09-27 | 2006-04-06 | Hans Gude Gudensen | Information processing system and method |
-
2005
- 2005-12-13 FI FI20051283A patent/FI20051283A/en not_active Application Discontinuation
-
2006
- 2006-12-13 WO PCT/FI2006/000409 patent/WO2007068791A1/en active Application Filing
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20020057256A1 (en) * | 2000-11-14 | 2002-05-16 | Flack James F. | Fixed cursor |
WO2002097597A1 (en) * | 2001-05-30 | 2002-12-05 | Palm, Inc. | Portable electronic device |
GB2387755A (en) * | 2002-03-28 | 2003-10-22 | Nec Corp | Portable apparatus including improved pointing device using image shift |
WO2006036069A1 (en) * | 2004-09-27 | 2006-04-06 | Hans Gude Gudensen | Information processing system and method |
Cited By (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2009150522A1 (en) * | 2008-06-11 | 2009-12-17 | Nokia Corporation | Camera gestures for user interface control |
CN102089738A (en) * | 2008-06-11 | 2011-06-08 | 诺基亚公司 | Camera gestures for user interface control |
US8269842B2 (en) | 2008-06-11 | 2012-09-18 | Nokia Corporation | Camera gestures for user interface control |
US8785709B2 (en) | 2011-03-30 | 2014-07-22 | University Of Louisville Research Foundation, Inc. | Catalytic isomerisation of linear olefinic hydrocarbons |
WO2018130909A3 (en) * | 2017-01-11 | 2018-09-27 | Intelligent Inventions Limited | Images with virtual reality backgrounds |
Also Published As
Publication number | Publication date |
---|---|
FI20051283A0 (en) | 2005-12-13 |
FI20051283A (en) | 2007-06-14 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US8542186B2 (en) | Mobile device with user interaction capability and method of operating same | |
CN109814972B (en) | Interface display method and terminal | |
US20220197458A1 (en) | Portable terminal device | |
US8786562B2 (en) | Mobile electronic device, control method, and storage medium storing control program | |
EP2613234A1 (en) | User interface, device and method for a physically flexible device | |
US8952904B2 (en) | Electronic device, screen control method, and storage medium storing screen control program | |
US20070192730A1 (en) | Electronic device, computer program product and method of managing application windows | |
EP2068235A2 (en) | Input device, display device, input method, display method, and program | |
US20100088628A1 (en) | Live preview of open windows | |
WO2020134744A1 (en) | Icon moving method and mobile terminal | |
US20090153466A1 (en) | Method and System for Optimizing Scrolling and Selection Activity | |
CN109800045B (en) | Display method and terminal | |
US20060061557A1 (en) | Method for using a pointing device | |
US9298364B2 (en) | Mobile electronic device, screen control method, and storage medium strong screen control program | |
CN108491148B (en) | Application sharing method and terminal | |
JP2012141976A (en) | Apparatus and method for controlling a screen display in portable terminal | |
CN110795189A (en) | Application starting method and electronic equipment | |
CN110941469B (en) | Application splitting creation method and terminal equipment thereof | |
US11354031B2 (en) | Electronic apparatus, computer-readable non-transitory recording medium, and display control method for controlling a scroll speed of a display screen | |
CN109885242B (en) | Method for executing operation and electronic equipment | |
US20080012822A1 (en) | Motion Browser | |
JP2017204024A (en) | Mobile terminal device | |
WO2007068791A1 (en) | Method and arrangement to manage graphical user interface and portable device provided with graphical user interface | |
KR20090126686A (en) | Method of zooming in/out of video processing apparatus with touch input device and video processing apparatus performing the same | |
US8384692B2 (en) | Menu selection method and apparatus using pointing device |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application | ||
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 06830918 Country of ref document: EP Kind code of ref document: A1 |