WO2017032193A1 - 用户界面布局的调整方法及装置 - Google Patents

用户界面布局的调整方法及装置 Download PDF

Info

Publication number
WO2017032193A1
WO2017032193A1 PCT/CN2016/090717 CN2016090717W WO2017032193A1 WO 2017032193 A1 WO2017032193 A1 WO 2017032193A1 CN 2016090717 W CN2016090717 W CN 2016090717W WO 2017032193 A1 WO2017032193 A1 WO 2017032193A1
Authority
WO
WIPO (PCT)
Prior art keywords
points
user interface
gravity
desired operation
center
Prior art date
Application number
PCT/CN2016/090717
Other languages
English (en)
French (fr)
Inventor
吕毅
Original Assignee
广州视睿电子科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 广州视睿电子科技有限公司 filed Critical 广州视睿电子科技有限公司
Publication of WO2017032193A1 publication Critical patent/WO2017032193A1/zh

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/0485—Scrolling or panning

Definitions

  • the present invention relates to the field of touch device technologies, and in particular, to a method for adjusting a user interface layout and a device for adjusting a user interface layout.
  • the touch screen also called “touch screen” and “touch panel” is an inductive liquid crystal display device that can receive input signals such as contacts.
  • the touch screen has given multimedia a new look. It is an attractive new multimedia interactive device widely used in public information inquiry, leading office, industrial control and other fields.
  • the size of the touch screen is getting larger and larger.
  • the touch screen size is large, for example, when the touch screen size is larger than 42 inches, when the user performs a touch or stylus operation on the screen, the user can no longer browse the entire screen with the naked eye.
  • the screen size is larger, for example, when the touch screen size is larger than 55 inches, the user needs to move his or her position back and forth to achieve full-screen touch and browsing operations. Therefore, the existing large-screen touch screen has defects such as inconvenient use and low use efficiency.
  • a method for adjusting a user interface layout includes the steps of:
  • touch operation information on the current user interface where the touch operation information includes points involved in the operation, position coordinates of the points, and interface elements of the operation, wherein the points are arranged in the order of operation;
  • the desired operational center of gravity is taken as the starting coordinate of the user interface to be moved, and the user interface to be moved is moved to a position having the largest overlapping area with the desired operating interval.
  • the adjustment method of the user interface layout of the present invention determines a desired operation interval and a desired operation center of gravity according to the current touch operation information of the user and the interface element of the operation, thereby moving the other user interface to a suitable user operation according to the desired operation interval and the desired operation center of gravity. position.
  • the invention automatically adjusts the layout of the user interface according to the current touch operation information of the user, so that the user can realize the rapid operation of the user interface without any movement of the user regardless of the position of the large screen, and the use convenience and the use efficiency of the large-screen touch screen are improved.
  • the step of determining the desired operation interval according to the position coordinates of the points includes: determining a minimum rectangle including the points according to the position coordinates of the points. The minimum rectangle of each point is taken as a desired operation section.
  • the step of determining a desired operation interval according to the position coordinates of the points includes: determining a minimum rectangle including the points according to position coordinates of the points; determining, according to an interface element of the operation, a minimum rectangle of interface elements; combining the smallest rectangle of the points and the smallest rectangle of the interface elements, and combining the merged regions as a desired operation interval.
  • the distance between the to-be-moved user interface and the desired operation interval is greater than a preset threshold, and the to-be-moved user interface is related to the current user interface.
  • a device for adjusting a user interface layout comprising:
  • the touch operation information acquiring module is configured to acquire touch operation information on the current user interface, where the touch operation information includes points involved in the operation, position coordinates of the points, and interface elements of the operation, wherein the points are operated according to the operation. Arranged in order;
  • Determining an operation interval determining module configured to determine a desired operation interval according to position coordinates of the points
  • a weight determining module configured to determine a minimum weight and a maximum weight according to an interface element of the operation
  • the operation center of gravity determining module is configured to determine a center of gravity of the desired operation according to the position coordinates of the points, the order of the points, the total number of the points, the minimum weight, and the maximum weight;
  • a user interface movement module configured to use the desired operation center of gravity as a starting coordinate of the user interface to be moved, and move the to-be-moved user interface to a position having a maximum overlapping area with the desired operation interval.
  • the adjusting device of the user interface layout of the present invention determines a desired operating interval and a desired operating center of gravity according to the current touch operation information of the user and the interface element of the operation, thereby moving the other user interface to a suitable user operation according to the desired operating interval and the desired operational center of gravity. position.
  • the invention automatically adjusts the layout of the user interface according to the current touch operation information of the user, so that the user can realize the rapid operation of the user interface without any movement of the user regardless of the position of the large screen, and the use convenience and the use efficiency of the large-screen touch screen are improved.
  • the desired operation interval determination module includes a first operation interval determination unit, and the first operation interval determination unit is configured to determine, according to the position coordinates of the points A minimum rectangle including the points is used, and the smallest rectangle of each point is taken as a desired operation section.
  • the desired operation interval determining module further includes: a first minimum rectangle determining unit, configured to determine a minimum rectangle including the points according to position coordinates of the points; and a second minimum rectangle determining unit And determining, by the interface element of the operation, a minimum rectangle including the interface element; and a second operation interval determining unit, configured to merge the minimum rectangle of the points and the minimum rectangle of the interface element, and merge the The area is the desired operating range.
  • the distance between the to-be-moved user interface and the desired operation interval is greater than a preset threshold, and the to-be-moved user interface is related to the current user interface.
  • FIG. 1 is a schematic flow chart of an embodiment of a method according to the present invention.
  • FIG. 2 is a schematic view of a specific embodiment of an operation type of the present invention.
  • FIG. 3 is a schematic diagram of a specific embodiment of a desired operational interval and a desired operational center of gravity determined by the present invention
  • FIG. 4 is a schematic diagram of user interface adjustment according to the desired operation interval and the desired operational center of gravity of FIG. 3 according to the present invention
  • Figure 5 is a schematic structural view of an embodiment of the device of the present invention.
  • Embodiment 1 of a desired operation interval determining module according to the present invention
  • FIG. 7 is a schematic structural diagram of Embodiment 2 of a desired operation interval determining module according to the present invention.
  • a method for adjusting a user interface layout includes the following steps:
  • the desired operation center of gravity is used as a starting coordinate of the user interface to be moved, and the user interface to be moved is moved to a position having a maximum overlapping area with the desired operation interval.
  • the present invention is directed to an application interface on a large screen touch screen. After the software is turned on, the user operates on the user interface, including mouse and keyboard operations, touch operations, and stylus operations.
  • the software collects touch operation information, where the touch operation information includes points involved in the operation, position coordinates of each point, and interface elements of the operation.
  • the points involved in the operation are determined according to the type of user operation. For example, as shown in FIG. 2, from left to right are: click (or tap), double click (or multi-click), single-finger swipe, multi-finger swipe.
  • click or tap
  • double click or multi-click
  • single-finger swipe multi-finger swipe
  • multi-finger swipe the point involved in the operation is the point clicked
  • the point involved in the operation is the point (including the tolerance) of each click in the multiple clicks
  • the point involved in the operation is all points in the sliding path.
  • the points involved in the operation are arranged in the order of operation so that the desired operational center of gravity is subsequently determined by the weight.
  • the interface elements of the operation are the objects that are operated on the screen for this time, such as clicked buttons, swiped lists, double-clicked icons, and the like.
  • the interface element information of the collection operation is for the calculation of the subsequent desired operation center of gravity and the determination of the desired operation interval.
  • the step of determining a desired operation interval according to position coordinates of the points may include: determining, according to position coordinates of the points A minimum rectangle including the points is used, and the smallest rectangle of each point is taken as a desired operation section.
  • the calculation method for the smallest rectangle is:
  • equations (1) and (2) define the coordinates of one of the smallest rectangles in the X and Y directions
  • equations (3) and (4) calculate the width and height of the smallest rectangle.
  • Point indicates the point involved in the operation
  • point.X min indicates the minimum value of the point involved in the operation in the X coordinate direction
  • point.Y min indicates the minimum value of the point involved in the operation in the Y coordinate direction
  • point.X max indicates the point involved in the operation. In the maximum value of the X coordinate direction, point.Y max represents the maximum value of the point involved in the operation in the Y coordinate direction.
  • the desired operation interval is not limited to the minimum rectangle, and the minimum rectangle may be reduced inward or enlarged to a certain extent, and the reduced or enlarged minimum rectangle is taken as the desired operation interval.
  • the step of determining a desired operating interval based on the position coordinates of the points includes:
  • the smallest rectangle of each point and the smallest rectangle of the interface element are combined into a region, and the merged region is taken as a desired operation interval.
  • the minimum rectangle of the interface element and the minimum rectangular positional relationship of the point involved in the operation generally include the following cases: partial overlap; one of the smallest rectangles is in the area of the other smallest rectangle Inside; the two completely overlap.
  • the determined desired operating interval is the area where the two smallest rectangles are not overlapped plus the overlapping area.
  • the smallest rectangle having a larger area is taken as the desired operation section.
  • any one of the smallest rectangles is taken as the desired operation interval.
  • the present invention also needs to determine the desired operational center of gravity. First need to determine a minimum weight value ⁇ min (0 ⁇ min ⁇ 0.5) and a maximum weight value ⁇ max (0.5 ⁇ max ⁇ 1) .
  • the user can determine the specific ⁇ min and ⁇ max values according to the interface elements of the operation, which is not limited by the present invention. Then, the relationship between the values of ⁇ min and ⁇ max and the interface elements can be set, and the operating system obtains the corresponding values of ⁇ min and ⁇ max according to the interface elements of the current operation.
  • the formula for calculating the desired operation center is:
  • center.X represents the X coordinate of the desired operation center
  • center.Y represents the Y coordinate of the desired operation center.
  • the user interface layout can be adjusted, that is, the user interface to be moved is moved to a position convenient for the user to operate.
  • the user interface to be moved herein refers to a user interface whose distance from the desired operation interval is greater than a preset threshold and related to the current user interface, where The user interface related to the user interface refers to the user interface that may be involved in subsequent steps of the current user interface.
  • the determined desired operation interval and the desired operation center of gravity are at the far right of the screen, indicating that the user is at the rightmost position of the screen, and only the distance from the desired operation interval exceeds a preset threshold, such as the leftmost user interface of the screen, and The user interface associated with the current user interface moves to the right of the screen. If the distance between the user interface related to the current user interface and the desired operation interval is less than a preset threshold, the user interface does not need to be moved, but for the aesthetic appearance of the interface, the related user interfaces that do not need to be moved may be placed on average. Other situations are not mentioned here.
  • the desired operation center of gravity is taken as the starting coordinate of the user interface to be moved.
  • the user interface to be moved may be located at the left side, the right side, the lower side, the upper side or the middle of the starting coordinate, etc.
  • the operation interval has the largest area overlap, where the maximum area coincides, that is, the user interface to be moved is moved to the position of the starting coordinates.
  • the user interface may be moved only according to the desired operation center of gravity or the desired operation interval, but only a single factor for interface adjustment is not suitable in many cases, for example, the user is the most from the screen. The right side of the screen is drawn to the far left of the screen. At this time, the range of the desired operation interval determined is too large, and the user interface that moves only according to the desired operation interval does not achieve the desired effect. So one It is generally necessary to take into account both the desired operating range and the desired operating center of gravity to achieve better user interface adjustment.
  • the trajectory of the finger touch is as shown by the black curve, and the desired operation interval determined according to the trajectory of the finger touch is a rectangle including the touch trajectory, and the desired operation center of gravity determined according to the trajectory of the finger touch is a hollow “ ⁇ ”. number.
  • the operation area of the user's operation covers the rectangular portion, indicating that the user is at a position that is very far to the right of the screen at this time, and the position of the pop-up frame on the left side of the screen needs to be adjusted to facilitate the user's operation.
  • the desired operation center of gravity is the starting coordinate of the popup interface
  • the popup interface may be located at the left, right, bottom, or middle of the starting coordinate.
  • the pop-up interface is adjusted to the left of the starting coordinate, it can overlap with the largest area of the desired operating interval. Therefore, the pop-up interface is adjusted to the left of the desired operating center of gravity, and the final layout of the pop-up interface is adjusted. 4 is shown.
  • the user only needs to operate the pop-up interface in the original position, and does not need to move to the left side of the screen, which improves the convenience and efficiency of the touch screen, and improves the user's operating experience.
  • the user uses the whiteboard software for presentations in a meeting or classroom environment, where the presentation is primarily written and marked on the screen.
  • the whiteboard software includes an operator interface that is located at the far right of the screen.
  • the prior art solution when the user writes on the left side of the screen, once the operation interface needs to be operated, it is necessary to go to the far right of the screen to perform the operation.
  • the technical solution of the present invention when the user writes on the left side of the screen, the determined desired operation interval and the desired operation center of gravity are on the left side of the screen, and the operation interface is automatically moved to the left side of the screen.
  • the operation interface can be operated without moving, which improves the efficiency of the device.
  • the present invention further provides an apparatus for adjusting a layout of a user interface, and a specific implementation manner of the apparatus of the present invention will be described in detail below with reference to the accompanying drawings.
  • an apparatus for adjusting a user interface layout includes:
  • the touch operation information obtaining module 510 is configured to acquire touch operation information on the current user interface, where the touch operation information includes points involved in the operation, position coordinates of the points, and interface elements of the operation, where the points are in accordance with The order of operations;
  • the operation interval determining module 520 is configured to determine a desired operation interval according to the position coordinates of the points;
  • the weight determining module 530 is configured to determine a minimum weight and a maximum weight according to the interface element of the operation;
  • the operation center of gravity determining module 540 is configured to determine a center of gravity of the desired operation according to the position coordinates of the points, the order of the points, the total number of the points, the minimum weight, and the maximum weight;
  • the user interface movement module 550 is configured to use the desired operation center of gravity as a starting coordinate of the user interface to be moved, and move the to-be-moved user interface to a position having a maximum overlapping area with the desired operation interval.
  • the desired operation interval determination module 520 determines a desired operation interval according to the position coordinates of each point.
  • the desired operation interval determining module 520 may include a first operation interval determining unit 5201, and the first operation interval determining unit 5201 is configured to determine a minimum rectangle including the points according to the position coordinates of the points, and the respective The smallest rectangle of points is used as the desired operation interval.
  • the desired operation interval is not limited to the minimum rectangle, and the minimum rectangle may be reduced inward or enlarged to a certain extent, and the reduced or enlarged minimum rectangle is taken as the desired operation interval.
  • the desired operation interval determining module 520 may further include:
  • a first minimum rectangle determining unit 5202 configured to determine a minimum rectangle including the points according to position coordinates of the points
  • a second minimum rectangle determining unit 5203 configured to determine a minimum rectangle including the interface element according to an interface element of the operation
  • the second operation interval determining unit 5204 is configured to combine the smallest rectangle of the respective points and the minimum rectangle of the interface element, and use the merged region as a desired operation interval.
  • the present invention also needs to determine the desired operational center of gravity.
  • It is desirable to operate the center of gravity determination module 540 according to It is desirable to operate the Y coordinate of the center of gravity; where gravity.Y represents the Y coordinate of the center of gravity of the desired operation, Points[n].Y represents the ordinate of the n+1th point, n 0, 1, 2...length-1.
  • the desired operation interval determination module 520 obtains the desired operation interval
  • the desired operation center of gravity determination module 540 obtains the desired operation center of gravity
  • the user interface movement module 550 can perform adjustment of the user interface layout.
  • the user interface to be moved herein refers to a user interface related to the desired operation interval, which is greater than a preset threshold, and related to the current user interface
  • current The user interface related to the user interface refers to the user interface that may be involved in subsequent steps of the current user interface.
  • the desired operation center of gravity is taken as the starting coordinate of the user interface to be moved.
  • the mobile user interface is adjusted to the starting coordinates, there is a maximum area coincidence with the desired operating interval, where there is a maximum area coincidence, ie, the user interface to be moved is moved to the position of the starting coordinates.
  • the texture or graphic of the user interface can be adjusted according to the position to be visually integrated with other elements.
  • the method and device for adjusting the layout of the user interface of the present invention automatically adjust the layout of the user interface according to the current touch operation information of the user, so that the user does not need to move by itself regardless of the position of the large screen. That is, the rapid operation of the user interface can be realized, and the use convenience and the use efficiency of the large-screen touch screen are improved.

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)
  • Position Input By Displaying (AREA)
  • Other Investigation Or Analysis Of Materials By Electrical Means (AREA)

Abstract

一种用户界面布局的调整方法及装置，所述方法包括步骤：获取当前用户界面上的触摸操作信息（S110）；根据所述各点的位置坐标确定期望操作区间（S120）；根据操作的界面元素确定最小权值和最大权值（S130）；根据所述各点的位置坐标、所述各点的顺序、所述各点的总个数、所述最小权值和最大权值，确定期望操作重心（S140）；将所述期望操作重心作为待移动用户界面的起始坐标，并将所述待移动用户界面移至与所述期望操作区间有最大重合面积的位置（S150）。根据用户当前触摸操作信息自动调整用户界面布局，使得用户无论处于大屏幕的哪个位置，无需自身移动即可以实现对用户界面的迅速操作，提高了大屏幕触摸屏的使用便捷性以及使用效率。

Description

用户界面布局的调整方法及装置 技术领域
本发明涉及触摸设备技术领域，特别是涉及一种用户界面布局的调整方法、用户界面布局的调整装置。
背景技术
触摸屏又称为“触控屏”、“触控面板”，是一种可接收触头等输入讯号的感应式液晶显示装置。触摸屏赋予了多媒体以崭新的面貌，是极富吸引力的全新多媒体交互设备，广泛应用于公共信息的查询、领导办公、工业控制等领域。
随着科技的发展，触摸屏的尺寸越来越大。当触摸屏尺寸较大时，例如当触摸屏尺寸大于42英寸时，用户在屏幕上进行触摸或触笔操作时，不再能用肉眼浏览到整个屏幕的画面。当屏幕尺寸更大时，例如当触摸屏尺寸大于55英寸时，用户如要实现全屏幕的触摸和浏览操作，需要来回移动自己的位置。所以现有的大屏幕触摸屏存在使用不方便、使用效率低等缺陷。
发明内容
基于此，有必要针对上述问题，提供一种使用方便、使用效率高的用户界面布局的调整方法及装置。
一种用户界面布局的调整方法，包括步骤：
获取当前用户界面上的触摸操作信息，所述触摸操作信息包括操作涉及的各点、所述各点的位置坐标以及操作的界面元素，其中所述各点按照操作的顺序排列；
根据所述各点的位置坐标确定期望操作区间；
根据操作的界面元素确定最小权值和最大权值；
根据所述各点的位置坐标、所述各点的顺序、所述各点的总个数、所述最小权值和最大权值，确定期望操作重心；
将所述期望操作重心作为待移动用户界面的起始坐标，并将所述待移动用户界面移至与所述期望操作区间有最大重合面积的位置。
本发明用户界面布局的调整方法，根据用户当前的触摸操作信息以及操作的界面元素，确定期望操作区间以及期望操作重心，从而根据期望操作区间和期望操作重心将其它用户界面移动至适宜用户操作的位置。本发明根据用户当前触摸操作信息自动调整用户界面布局，使得用户无论处于大屏幕的哪个位置，无需自身移动即可以实现对用户界面的迅速操作，提高了大屏幕触摸屏的使用便捷性以及使用效率。
期望操作区间确定的方式有多种，在一个实施例中，根据所述各点的位置坐标确定期望操作区间的步骤包括：根据所述各点的位置坐标确定包含所述各点的最小矩形，将所述各点的最小矩形作为期望操作区间。在另一个实施例中，根据所述各点的位置坐标确定期望操作区间的步骤包括：根据所述各点的位置坐标确定包含所述各点的最小矩形；根据操作的界面元素确定包含所述界面元素的最小矩形；将所述各点的最小矩形和所述界面元素的最小矩形进行区域合并，将合并后的区域作为期望操作区间。
在一个实施例中，根据
Figure PCTCN2016090717-appb-000001
确定期望操作重心的X坐标；其中gravity.X表示期望操作重心的X坐标，θmax表示最大权值，θmin表示最小权值，length表示各点的总个数，
Figure PCTCN2016090717-appb-000002
Figure PCTCN2016090717-appb-000003
points[n].X表示第n+1个点的横坐标，n＝0，1，2…length-1。根据
Figure PCTCN2016090717-appb-000004
期望操作重心的Y坐标；其中gravity.Y表示期望操作重心的Y坐标，
Figure PCTCN2016090717-appb-000005
Figure PCTCN2016090717-appb-000006
Figure PCTCN2016090717-appb-000007
points[n].Y表示第n+1个点的纵坐标，n＝0，1，2…length-1。
为了避免内存消耗，所述待移动用户界面与所述期望操作区间的距离大于预设阈值，且所述待移动用户界面与所述当前用户界面相关。
一种用户界面布局的调整装置，包括：
触摸操作信息获取模块，用于获取当前用户界面上的触摸操作信息，所述触摸操作信息包括操作涉及的各点、所述各点的位置坐标以及操作的界面元素，其中所述各点按照操作的顺序排列；
期望操作区间确定模块，用于根据所述各点的位置坐标确定期望操作区间；
权值确定模块，用于根据操作的界面元素确定最小权值和最大权值；
期望操作重心确定模块，用于根据所述各点的位置坐标、所述各点的顺序、所述各点的总个数、所述最小权值和最大权值，确定期望操作重心；
用户界面移动模块，用于将所述期望操作重心作为待移动用户界面的起始坐标，并将所述待移动用户界面移至与所述期望操作区间有最大重合面积的位置。
本发明用户界面布局的调整装置，根据用户当前的触摸操作信息以及操作的界面元素，确定期望操作区间以及期望操作重心，从而根据期望操作区间和期望操作重心将其它用户界面移动至适宜用户操作的位置。本发明根据用户当前触摸操作信息自动调整用户界面布局，使得用户无论处于大屏幕的哪个位置，无需自身移动即可以实现对用户界面的迅速操作，提高了大屏幕触摸屏的使用便捷性以及使用效率。
期望操作区间确定的方式有多种，在一个实施例中，所述期望操作区间确定模块包括第一操作区间确定单元，所述第一操作区间确定单元用于根据所述各点的位置坐标确定包含所述各点的最小矩形，将所述各点的最小矩形作为期望操作区间。在另一实施例中，所述期望操作区间确定模块还包括：第一最小矩形确定单元，用于根据所述各点的位置坐标确定包含所述各点的最小矩形；第二最小矩形确定单元，用于根据操作的界面元素确定包含所述界面元素的最小矩形；第二操作区间确定单元，用于将所述各点的最小矩形和所述界面元素的最小矩形进行区域合并，将合并后的区域作为期望操作区间。
在一个实施例中，所述期望操作重心确定模块根据
Figure PCTCN2016090717-appb-000008
Figure PCTCN2016090717-appb-000009
确定期望操作重心的X坐标；其中gravity.X表示期望操作重心的X坐标，θmax表示最大权值，θmin表示最小权值，length表示各点的总个数，
Figure PCTCN2016090717-appb-000010
Figure PCTCN2016090717-appb-000011
Figure PCTCN2016090717-appb-000012
points[n].X表示第n+1个点的横坐标，n＝0，1，2…length-1。所述期望操作重心确定模块根据
Figure PCTCN2016090717-appb-000013
Figure PCTCN2016090717-appb-000014
期望操作重心的Y坐标；其中gravity.Y表示期望操作重心的Y坐标，
Figure PCTCN2016090717-appb-000015
Figure PCTCN2016090717-appb-000016
Figure PCTCN2016090717-appb-000017
points[n].Y表示第n+1个点的纵坐标，n＝0，1，2…length-1。
为了避免内存消耗，所述待移动用户界面与所述期望操作区间的距离大于预设阈值，且所述待移动用户界面与所述当前用户界面相关。
附图说明
图1为本发明方法实施例的流程示意图；
图2为本发明操作类型具体实施例的示意图；
图3为本发明确定的期望操作区间和期望操作重心具体实施例的示意图；
图4为本发明根据图3的期望操作区间和期望操作重心进行用户界面调整的示意图；
图5为本发明装置实施例的结构示意图；
图6为本发明期望操作区间确定模块实施例一的结构示意图；
图7为本发明期望操作区间确定模块实施例二的结构示意图。
具体实施方式
为了更好的理解本发明要解决的技术问题、采取的技术方案以及达到的技术效果，下面结合附图对本发明用户界面布局的调整方法及装置的具体实 施方式做详细描述。
如图1所示，一种用户界面布局的调整方法，包括步骤：
S110、获取当前用户界面上的触摸操作信息，所述触摸操作信息包括操作涉及的各点、所述各点的位置坐标以及操作的界面元素，其中所述各点按照操作的顺序排列；
S120、根据所述各点的位置坐标确定期望操作区间；
S130、根据操作的界面元素确定最小权值和最大权值；
S140、根据所述各点的位置坐标、所述各点的顺序、所述各点的总个数、所述最小权值和最大权值，确定期望操作重心；
S150、将所述期望操作重心作为待移动用户界面的起始坐标，并将所述待移动用户界面移至与所述期望操作区间有最大重合面积的位置。
考虑到实际使用场景中的体验，本发明针对的是大屏幕触摸屏上的应用界面。软件开启后，用户在用户界面上进行操作，这些操作包括键鼠操作、触摸操作和触笔操作等。
在用户操作过程中，软件会收集触摸操作信息，其中触摸操作信息包括操作涉及的各点、各点的位置坐标以及操作的界面元素等。操作涉及的各点根据用户操作类型确定。例如，如图2所示，从左到右依次是：点击(或轻触)、双击(或多击)、单指滑动、多指滑动。在“点击”操作中，操作涉及到的点即所点击的点；在双击(或多击)操作中，操作涉及到的点即多次点击中每一次点击到的点(包括容差)；在单指或多指滑动操作中，操作涉及到的点即滑动路径中所有的点。操作涉及的各点需按照操作的顺序进行排列，以便后续按权值确定期望操作重心。操作的界面元素即为本次操作在屏幕上的对象，例如点击的按钮、滑动的列表、双击的图标等。收集操作的界面元素信息是为了后续的期望操作重心的计算以及期望操作区间的确定。
根据各点的位置坐标确定期望操作区间的方法有很多种，例如，在一个实施例中，根据所述各点的位置坐标确定期望操作区间的步骤可以包括：根据所述各点的位置坐标确定包含所述各点的最小矩形，将所述各点的最小矩形作为期望操作区间。最小矩形的计算方法为：
rect.X＝point.Xmin(1)
rect.Y＝point.Ymin(2)
rect.Width＝point.Xmax-point.Xmin(3)
rect.Height＝point.Ymax-point.Ymin(4)
其中rect表示矩阵函数，公式(1)和公式(2)定义了最小矩形其中一个顶点X方向和Y方向的坐标，公式(3)和公式(4)计算了最小矩形的宽和高。point表示操作涉及的点，point.Xmin表示操作涉及的点在X坐标方向的最小值，point.Ymin表示操作涉及的点在Y坐标方向的最小值，point.Xmax表示操作涉及的点在X坐标方向的最大值，point.Ymax表示操作涉及的点在Y坐标方向的最大值。
在涉及较为特殊的用户操作时，期望操作区间不限制于为最小矩形，还可以将该最小矩形向内缩小或向外放大一定程度，将缩小或放大后的最小矩形作为期望操作区间。
在某些情况下，期望操作区间可能还需要将所操作的界面元素的位置和大小考虑在内。所以在另一个实施例中，根据所述各点的位置坐标确定期望操作区间的步骤包括：
根据所述各点的位置坐标确定包含所述各点的最小矩形；
根据操作的界面元素确定包含所述界面元素的最小矩形；
将所述各点的最小矩形和所述界面元素的最小矩形进行区域合并，将合并后的区域作为期望操作区间。
由于操作的界面元素为本次操作在屏幕上的对象，所以界面元素的最小矩形和操作涉及的点的最小矩形位置关系一般包含以下情形：部分重叠；其中一个最小矩形在另一个最小矩形的区域内；两者完全重叠。当两个最小矩形有部分重叠时，确定的期望操作区间为两个最小矩形未重叠的区域加上该重叠区域。当其中一个最小矩形在另一个最小矩形的区域内时，将区域较大的最小矩形作为期望操作区间。当两者完全重叠时，将任意一个最小矩形作为期望操作区间。
为了更好的调整用户界面，本发明还需要确定期望操作重心。首先需要确定一个最小权值θmin(0≤θmin≤0.5)和一个最大权值θmax(0.5≤θmax≤ 1)。对于不同的界面元素，θmin和θmax值可能不同。例如，对于点击一个可以弹出列表的按钮，可取θmin＝0，θmax＝1.0；对于一个正在缩放中的图片需要弹出图片操作菜单，可取θmin＝0.5，θmax＝1.0；对于用户从左到右的划线操作，可取θmin＝0.5，θmax＝1.0。用户可以根据操作的界面元素确定具体的θmin和θmax值，本发明并不对此做出限定。然后即可以设置θmin、θmax值和各界面元素的对应关系，操作***根据当前操作的界面元素获取相应的θmin和θmax值。
在确定好θmin和θmax值后：
根据
Figure PCTCN2016090717-appb-000018
确定期望操作重心的X坐标；其中gravity.X表示期望操作重心的X坐标，θmax表示最大权值，θmin表示最小权值，length表示各点的总个数，
Figure PCTCN2016090717-appb-000019
Figure PCTCN2016090717-appb-000020
Figure PCTCN2016090717-appb-000021
points[n].X表示第n+1个点的横坐标，n＝0，1，2…length-1；
根据
Figure PCTCN2016090717-appb-000022
期望操作重心的Y坐标；其中gravity.Y表示期望操作重心的Y坐标，
Figure PCTCN2016090717-appb-000023
Figure PCTCN2016090717-appb-000024
Figure PCTCN2016090717-appb-000025
points[n].Y表示第n+1个点的纵坐标，n＝0，1，2…length-1。
对于没有特殊要求的界面元素，通常可取值θmin＝0.5，θmax＝1.0。那么：
Figure PCTCN2016090717-appb-000026
Figure PCTCN2016090717-appb-000027
在有极端性能要求或者界面元素的变化对用户体验影响非常小时，期望操作重心的计算也可简化为期望操作中心的计算。计算期望操作中心的公式为：
Figure PCTCN2016090717-appb-000028
Figure PCTCN2016090717-appb-000029
其中，center.X表示期望操作中心的X坐标，center.Y表示期望操作中心的Y坐标。
得到期望操作区间和期望操作重心后，即可以进行用户界面布局的调整，也即是将待移动用户界面移动到用户方便操作的位置。为了防止移动所有用户界面消耗过多的内存等，这里的待移动用户界面指的是与所述期望操作区间的距离大于预设阈值，且与所述当前用户界面相关的用户界面，其中与当前用户界面相关的用户界面指的是当前用户界面后续步骤可能会涉及到的用户界面。例如确定的期望操作区间和期望操作重心在屏幕的最右边，说明用户处在屏幕最右边的位置，此时仅需将与期望操作区间距离超过预设阈值，例如屏幕最左边的用户界面，且与当前用户界面相关的用户界面移动到屏幕的右边。若与当前用户界面相关的用户界面与期望操作区间距离小于预设阈值，则不需要对用户界面进行移动，但是为了界面的美观，可以将这些相关的不需要移动的用户界面平均放置。其它情况类此，在此不予赘述。
根据期望操作区间和期望操作重心具体调整用户界面布局时，将期望操作重心作为待移动用户界面的起始坐标。此时待移动用户界面可以位于所述起始坐标的左边、右边、下边、上边或中间等，为了更好的调整界面布局，考虑待移动用户界面调整到该起始坐标的何处时与期望操作区间有最大面积重合，在何处有最大面积重合，即将该待移动用户界面移动到起始坐标的该处位置。用户界面布局完成后，为了用户界面更加美观，还可以根据位置的不同调整用户界面的贴图或图形，以便在视觉上与其它元素融合。需要说明的是，在某些特殊情况下也可以仅根据期望操作重心或期望操作区间进行用户界面的移动，但是仅考虑单个因素进行界面调整在很多情况下并不适合，例如用户从屏幕的最右边划线至屏幕的最左边，此时确定的期望操作区间范围太大，仅根据期望操作区间移动的用户界面并不能达到预期效果。所以一 般需要同时兼顾期望操作区间和期望操作重心，以达到较好的用户界面调整效果。
为了更好的理解本发明根据期望操作区间和期望操作重心进行用户界面调整的过程，下面结合一个具体实施例进行详细说明。
如图3所示，手指触摸的轨迹如黑色曲线所示，根据手指触摸的轨迹确定的期望操作区间为包含所述触摸轨迹的矩形，根据手指触摸的轨迹确定的期望操作重心为空心“×”号。通过图3可以看出，用户此次操作的操作区域覆盖了矩形部分，说明用户此时处在屏幕非常偏右的位置，需要将屏幕左边的弹出框界面进行位置调整，以方便用户的操作。
如图4所示，以期望操作重心为弹出框界面的起始坐标，弹出框界面可位于此起始坐标的左边、右边、下边或中间等。但考虑到弹出框界面调整到起始坐标的左边时可以与期望操作区间有最大面积的重合，故此时将弹出框界面调整到期望操作重心的左边显示，弹出框界面调整后的最终布局如图4所示。此时用户只需要在原来的位置即可以对弹出框界面进行操作，不需要移动至屏幕的左边，提高了触摸屏的便捷性和使用效率，并提高了用户的操作体验。
为了更好的理解本发明达到的技术效果，下面结合一个应用实例进行说明。
用户在会议或者课堂教学环境中使用白板软件进行演示，演示中主要在屏幕上书写和标记。白板软件包含一个操作界面，该操作界面位于屏幕的最右侧。当采用现有技术方案时，当用户在屏幕的左侧进行书写时，一旦需要操作该操作界面，均需要走到屏幕的最右侧进行操作。而采用本发明技术方案，当用户在屏幕的左侧进行书写时，确定的期望操作区间和期望操作重心在屏幕的左侧，此时便会自动将该操作界面移动至屏幕的左侧，用户无需移动即可以对该操作界面进行操作，提高了设备的使用效率。
基于同一发明构思，本发明还提供一种用户界面布局的调整装置，下面结合附图对本发明装置的具体实施方式做详细描述。
如图5所示，一种用户界面布局的调整装置，包括：
触摸操作信息获取模块510，用于获取当前用户界面上的触摸操作信息，所述触摸操作信息包括操作涉及的各点、所述各点的位置坐标以及操作的界面元素，其中所述各点按照操作的顺序排列；
期望操作区间确定模块520，用于根据所述各点的位置坐标确定期望操作区间；
权值确定模块530，用于根据操作的界面元素确定最小权值和最大权值；
期望操作重心确定模块540，用于根据所述各点的位置坐标、所述各点的顺序、所述各点的总个数、所述最小权值和最大权值，确定期望操作重心；
用户界面移动模块550，用于将所述期望操作重心作为待移动用户界面的起始坐标，并将所述待移动用户界面移至与所述期望操作区间有最大重合面积的位置。
触摸操作信息获取模块510获取到触摸操作信息后，期望操作区间确定模块520根据各点的位置坐标确定期望操作区间的方法有很多种，例如，在一个实施例中，如图6所示，所述期望操作区间确定模块520可以包括第一操作区间确定单元5201，所述第一操作区间确定单元5201用于根据所述各点的位置坐标确定包含所述各点的最小矩形，将所述各点的最小矩形作为期望操作区间。在涉及较为特殊的用户操作时，期望操作区间不限制于为最小矩形，还可以将该最小矩形向内缩小或向外放大一定程度，将缩小或放大后的最小矩形作为期望操作区间。
在另一个实施例中，如图7所示，所述期望操作区间确定模块520还可以包括：
第一最小矩形确定单元5202，用于根据所述各点的位置坐标确定包含所述各点的最小矩形；
第二最小矩形确定单元5203，用于根据操作的界面元素确定包含所述界面元素的最小矩形；
第二操作区间确定单元5204，用于将所述各点的最小矩形和所述界面元素的最小矩形进行区域合并，将合并后的区域作为期望操作区间。
为了更好的调整用户界面，本发明还需要确定期望操作重心。首先权值确定模块530根据操作的界面元素确定最小权值和最大权值，然后期望操作重心确定模块540根据
Figure PCTCN2016090717-appb-000030
确定期望操作重心的X坐标；其中gravity.X表示期望操作重心的X坐标，θmax表示最大权值，θmin表示最小权值，length表示各点的总个数，
Figure PCTCN2016090717-appb-000031
Figure PCTCN2016090717-appb-000032
points[n].X表示第n+1个点的横坐标，n＝0，1，2…length-1。期望操作重心确定模块540根据
Figure PCTCN2016090717-appb-000033
期望操作重心的Y坐标；其中gravity.Y表示期望操作重心的Y坐标，
Figure PCTCN2016090717-appb-000034
Figure PCTCN2016090717-appb-000035
Figure PCTCN2016090717-appb-000036
points[n].Y表示第n+1个点的纵坐标，n＝0，1，2…length-1。
期望操作区间确定模块520得到期望操作区间，和期望操作重心确定模块540得到期望操作重心后，用户界面移动模块550即可以进行用户界面布局的调整。为了防止移动所有用户界面时消耗过多的内存等，这里的待移动用户界面指的是与所述期望操作区间的距离大于预设阈值，且与所述当前用户界面相关的用户界面，与当前用户界面相关的用户界面指的是当前用户界面后续步骤可能会涉及到的用户界面。用户界面移动模块550根据期望操作区间和期望操作重心具体调整用户界面布局时，将期望操作重心作为待移动用户界面的起始坐标。考虑待移动用户界面调整到该起始坐标的何处时与期望操作区间有最大面积重合，在何处有最大面积重合，即将该待移动用户界面移动到起始坐标的该处位置。用户界面布局完成后，为了用户界面更加美观，还可以根据位置的不同调整用户界面的贴图或图形，以便在视觉上与其它元素融合。
本发明装置其它技术特征与本发明方法相同，在此不予赘述。
本发明用户界面布局的调整方法及装置，根据用户当前触摸操作信息自动调整用户界面布局，使得用户无论处于大屏幕的哪个位置，无需自身移动 即可以实现对用户界面的迅速操作，提高了大屏幕触摸屏的使用便捷性以及使用效率。
以上所述实施例的各技术特征可以进行任意的组合，为使描述简洁，未对上述实施例中的各个技术特征所有可能的组合都进行描述，然而，只要这些技术特征的组合不存在矛盾，都应当认为是本说明书记载的范围。
以上所述实施例仅表达了本发明的几种实施方式，其描述较为具体和详细，但并不能因此而理解为对发明专利范围的限制。应当指出的是，对于本领域的普通技术人员来说，在不脱离本发明构思的前提下，还可以做出若干变形和改进，这些都属于本发明的保护范围。因此，本发明专利的保护范围应以所附权利要求为准。

Claims (10)

  1. 一种用户界面布局的调整方法，其特征在于，包括步骤：
    获取当前用户界面上的触摸操作信息，所述触摸操作信息包括操作涉及的各点、所述各点的位置坐标以及操作的界面元素，其中所述各点按照操作的顺序排列；
    根据所述各点的位置坐标确定期望操作区间；
    根据操作的界面元素确定最小权值和最大权值；
    根据所述各点的位置坐标、所述各点的顺序、所述各点的总个数、所述最小权值和最大权值，确定期望操作重心；
    将所述期望操作重心作为待移动用户界面的起始坐标，并将所述待移动用户界面移至与所述期望操作区间有最大重合面积的位置。
  2. 根据权利要求1所述的用户界面布局的调整方法，其特征在于，根据所述各点的位置坐标确定期望操作区间的步骤包括：
    根据所述各点的位置坐标确定包含所述各点的最小矩形，将所述各点的最小矩形作为期望操作区间。
  3. 根据权利要求1所述的用户界面布局的调整方法，其特征在于，根据所述各点的位置坐标确定期望操作区间的步骤包括：
    根据所述各点的位置坐标确定包含所述各点的最小矩形；
    根据操作的界面元素确定包含所述界面元素的最小矩形；
    将所述各点的最小矩形和所述界面元素的最小矩形进行区域合并，将合并后的区域作为期望操作区间。
  4. 根据权利要求1所述的用户界面布局的调整方法，其特征在于，根据
    Figure PCTCN2016090717-appb-100001
    确定期望操作重心的X坐标；其中gravity.X表示期望操作重心的X坐标，θmax表示最大权值，θmin表示最小权值，length表示各点的总个数，
    Figure PCTCN2016090717-appb-100002
    Figure PCTCN2016090717-appb-100003
    Figure PCTCN2016090717-appb-100004
    points[n].X表示第n+1个点的横坐标，n＝0，1，2…length-1；
    根据
    Figure PCTCN2016090717-appb-100005
    期望操作重心的Y坐标；其中gravity.Y表示期望操作重心的Y坐标，
    Figure PCTCN2016090717-appb-100006
    Figure PCTCN2016090717-appb-100007
    Figure PCTCN2016090717-appb-100008
    points[n].Y表示第n+1个点的纵坐标，n＝0，1，2…length-1。
  5. 根据权利要求1至4任意一项所述的用户界面布局的调整方法，其特征在于，所述待移动用户界面与所述期望操作区间的距离大于预设阈值，且所述待移动用户界面与所述当前用户界面相关。
  6. 一种用户界面布局的调整装置，其特征在于，包括：
    触摸操作信息获取模块，用于获取当前用户界面上的触摸操作信息，所述触摸操作信息包括操作涉及的各点、所述各点的位置坐标以及操作的界面元素，其中所述各点按照操作的顺序排列；
    期望操作区间确定模块，用于根据所述各点的位置坐标确定期望操作区间；
    权值确定模块，用于根据操作的界面元素确定最小权值和最大权值；
    期望操作重心确定模块，用于根据所述各点的位置坐标、所述各点的顺序、所述各点的总个数、所述最小权值和最大权值，确定期望操作重心；
    用户界面移动模块，用于将所述期望操作重心作为待移动用户界面的起始坐标，并将所述待移动用户界面移至与所述期望操作区间有最大重合面积的位置。
  7. 根据权利要求6所述的用户界面布局的调整装置，其特征在于，所述期望操作区间确定模块包括第一操作区间确定单元，所述第一操作区间确定单元用于根据所述各点的位置坐标确定包含所述各点的最小矩形，将所述各点的最小矩形作为期望操作区间。
  8. 根据权利要求6所述的用户界面布局的调整装置，其特征在于，所述期望操作区间确定模块还包括：
    第一最小矩形确定单元，用于根据所述各点的位置坐标确定包含所述各点的最小矩形；
    第二最小矩形确定单元，用于根据操作的界面元素确定包含所述界面元素的最小矩形；
    第二操作区间确定单元，用于将所述各点的最小矩形和所述界面元素的最小矩形进行区域合并，将合并后的区域作为期望操作区间。
  9. 根据权利要求6所述的用户界面布局的调整装置，其特征在于，所述期望操作重心确定模块根据
    Figure PCTCN2016090717-appb-100009
    确定期望操作重心的X坐标；其中gravity.X表示期望操作重心的X坐标，θmax表示最大权值，θmin表示最小权值，length表示各点的总个数，
    Figure PCTCN2016090717-appb-100010
    Figure PCTCN2016090717-appb-100011
    Figure PCTCN2016090717-appb-100012
    points[n].X表示第n+1个点的横坐标，n＝0，1，2…length-1；
    所述期望操作重心确定模块根据
    Figure PCTCN2016090717-appb-100013
    期望操作重心的Y坐标；其中gravity.Y表示期望操作重心的Y坐标，
    Figure PCTCN2016090717-appb-100014
    Figure PCTCN2016090717-appb-100015
    Figure PCTCN2016090717-appb-100016
    points[n].Y表示第n+1个点的纵坐标，n＝0，1，2…length-1。
  10. 根据权利要求6至9任意一项所述的用户界面布局的调整装置，其特征在于，所述待移动用户界面与所述期望操作区间的距离大于预设阈值，且所述待移动用户界面与所述当前用户界面相关。
PCT/CN2016/090717 2015-08-21 2016-07-20 用户界面布局的调整方法及装置 WO2017032193A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201510519820.6 2015-08-21
CN201510519820.6A CN105068735B (zh) 2015-08-21 2015-08-21 用户界面布局的调整方法及装置

Publications (1)

Publication Number Publication Date
WO2017032193A1 true WO2017032193A1 (zh) 2017-03-02

Family

ID=54498118

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2016/090717 WO2017032193A1 (zh) 2015-08-21 2016-07-20 用户界面布局的调整方法及装置

Country Status (2)

Country Link
CN (1) CN105068735B (zh)
WO (1) WO2017032193A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114675920A (zh) * 2022-03-25 2022-06-28 北京字跳网络技术有限公司 布局对象的操控方法、装置、电子设备以及存储介质

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105068735B (zh) * 2015-08-21 2018-04-20 广州视睿电子科技有限公司 用户界面布局的调整方法及装置
CN106201172B (zh) * 2016-06-24 2020-09-01 广州视睿电子科技有限公司 一种触屏终端的画布显示方法及装置
CN106445386B (zh) * 2016-09-28 2019-10-25 广州视睿电子科技有限公司 一种笔迹显示方法及装置
CN109753256A (zh) * 2018-03-29 2019-05-14 北京字节跳动网络技术有限公司 一种窗口控制栏的布局方法、装置及设备
CN108762628B (zh) * 2018-04-23 2020-10-02 广州视源电子科技股份有限公司 页面元素移动显示方法、装置、终端设备及存储介质

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103440089A (zh) * 2013-06-25 2013-12-11 百度在线网络技术（北京）有限公司 一种用户设备的界面调整方法及用户设备
US20140040826A1 (en) * 2012-08-01 2014-02-06 Samsung Electronics Co., Ltd. Method for operating screen and electronic device thereof
CN104750400A (zh) * 2013-12-27 2015-07-01 华为技术有限公司 终端界面的优化操作方法和装置
CN105068735A (zh) * 2015-08-21 2015-11-18 广州视睿电子科技有限公司 用户界面布局的调整方法及装置

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9851883B2 (en) * 2014-02-17 2017-12-26 Xerox Corporation Method and apparatus for adjusting and moving a user interface for single handed use on an endpoint device

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140040826A1 (en) * 2012-08-01 2014-02-06 Samsung Electronics Co., Ltd. Method for operating screen and electronic device thereof
CN103440089A (zh) * 2013-06-25 2013-12-11 百度在线网络技术（北京）有限公司 一种用户设备的界面调整方法及用户设备
CN104750400A (zh) * 2013-12-27 2015-07-01 华为技术有限公司 终端界面的优化操作方法和装置
CN105068735A (zh) * 2015-08-21 2015-11-18 广州视睿电子科技有限公司 用户界面布局的调整方法及装置

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114675920A (zh) * 2022-03-25 2022-06-28 北京字跳网络技术有限公司 布局对象的操控方法、装置、电子设备以及存储介质
CN114675920B (zh) * 2022-03-25 2024-02-02 北京字跳网络技术有限公司 布局对象的操控方法、装置、电子设备以及存储介质

Also Published As

Publication number Publication date
CN105068735B (zh) 2018-04-20
CN105068735A (zh) 2015-11-18

Similar Documents

Publication Publication Date Title
US11709560B2 (en) Device, method, and graphical user interface for navigating through a user interface using a dynamic object selection indicator
WO2017032193A1 (zh) 用户界面布局的调整方法及装置
US20210019028A1 (en) Method, device, and graphical user interface for tabbed and private browsing
WO2016041425A1 (zh) 输入法虚拟键盘的调整方法和输入法装置
US9395917B2 (en) Electronic display with a virtual bezel
US8860675B2 (en) Drawing aid system for multi-touch devices
US20130219343A1 (en) Thumbnail-image selection of applications
US20140139430A1 (en) Virtual touch method
TW201617837A (zh) 一種螢幕顯示視窗的處理方法以及移動終端
CN104238949A (zh) 一种分屏显示方法和装置
US9747010B2 (en) Electronic content visual comparison apparatus and method
WO2013139089A1 (zh) 屏幕内容放大显示方法及终端
TWI510083B (zh) 電子設備及其圖片縮放方法
US20200097164A1 (en) Linking Multiple Windows in a User Interface Display
CN110928614B (zh) 界面显示方法、装置、设备及存储介质
US11740754B2 (en) Method for interface operation and terminal, storage medium thereof
EP2613247A2 (en) Method and apparatus for displaying keypad in terminal having touch screen
US20230325062A1 (en) Method for adjusting interface display state, and electronic device
CN106716493A (zh) 对内容样式化的方法和对内容样式化的触摸屏设备
CN103809852A (zh) 在同一屏幕上同时显示多个应用程序的方法及装置
US20240004532A1 (en) Interactions between an input device and an electronic device
TWI493390B (zh) 觸控游標的顯示方法
KR20100042833A (ko) 측면 터치 스크린을 갖는 휴대 단말기
WO2020143387A1 (zh) 表格处理方法、装置、***、存储介质及交互智能平板
WO2015078127A1 (zh) 一种文档呈现方法及用户终端

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16838453

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 16838453

Country of ref document: EP

Kind code of ref document: A1