CN110297574B - User interface operation method and device - Google Patents

User interface operation method and device Download PDF

Info

Publication number
CN110297574B
CN110297574B CN201810246978.4A CN201810246978A CN110297574B CN 110297574 B CN110297574 B CN 110297574B CN 201810246978 A CN201810246978 A CN 201810246978A CN 110297574 B CN110297574 B CN 110297574B
Authority
CN
China
Prior art keywords
control group
operation control
boundary line
sub
area
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201810246978.4A
Other languages
Chinese (zh)
Other versions
CN110297574A (en
Inventor
姚维
周思浩
卞文瀚
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Banma Zhixing Network Hongkong Co Ltd
Original Assignee
Banma Zhixing Network Hongkong Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Banma Zhixing Network Hongkong Co Ltd filed Critical Banma Zhixing Network Hongkong Co Ltd
Priority to CN201810246978.4A priority Critical patent/CN110297574B/en
Publication of CN110297574A publication Critical patent/CN110297574A/en
Application granted granted Critical
Publication of CN110297574B publication Critical patent/CN110297574B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The embodiment of the invention provides a user interface operation method and device, wherein the method comprises the following steps: in response to a position switching operation triggered on a user interface on which at least one operation control group is displayed, determining a target operation control group to be moved from the at least one operation control group according to distances between the at least one operation control group and trigger positions of the position switching operation, respectively; and moving the target operation control group to the triggering position, so that the operation control groups on the user interface are all positioned at the position convenient for the user to operate, and the user can operate conveniently.

Description

User interface operation method and device
Technical Field
The invention relates to the technical field of internet, in particular to a user interface operation method and device.
Background
A video conference system, also called a video conference system, refers to a system device for transmitting audio, video and file data to each other through a transmission line and multimedia devices for two or more individuals or groups at different places to achieve real-time and interactive communication and achieve the purpose of conference.
In order to facilitate users to use various functions provided by the video conference system, one or more operation control groups are generally displayed on some user interfaces of some application of the video conference system, and one operation control group can be regarded as an operation navigation bar which contains a plurality of operation controls, so that the users can use corresponding functions, such as functions of an electronic whiteboard, a video call and the like, by triggering one of the operation controls.
Generally, in an enterprise conference scenario, display screens corresponding to a video conference system are large in size, for example, over 55 inches, so that when a user needs to click an operation control on a certain user interface to enable a certain function, the operation control is far away from the user, and the user may need to move to a proper position to touch the operation control, thereby causing inconvenience in operation of the user.
Disclosure of Invention
In view of this, embodiments of the present invention provide a method and an apparatus for operating a user interface, so as to improve convenience of user operation.
In a first aspect, an embodiment of the present invention provides a user interface operation method, including:
in response to a position switching operation triggered on a user interface on which at least one operation control group is displayed, determining a target operation control group to be moved from the at least one operation control group according to distances between the at least one operation control group and triggering positions of the position switching operation, respectively;
and moving the target operation control group to the triggering position.
In a second aspect, an embodiment of the present invention provides a user interface operating apparatus, including:
the operation detection module is used for detecting position switching operation triggered on a user interface on which at least one operation control group is displayed;
A control selection module, configured to determine a target operation control group to be moved from the at least one operation control group according to distances between the at least one operation control group and the trigger position of the position switching operation, respectively;
and the control display module is used for moving the target operation control group to the trigger position.
In a third aspect, an embodiment of the present invention provides an electronic device, including a processor and a memory, where the memory is used to store one or more computer instructions, and when executed by the processor, the one or more computer instructions implement the user interface operation method in the first aspect. The electronic device may also include a communication interface for communicating with other devices or a communication network.
An embodiment of the present invention provides a computer storage medium, configured to store a computer program, where the computer program enables a computer to implement the user interface operation method in the first aspect when executed.
The user interface operation method provided in the embodiment of the present invention assumes that a user interface is displayed on a display screen with a larger size, where the user interface includes at least one operation control group, and when a user wants to operate an operation control in the operation control group but the current position of the user is inconvenient to operate the operation control, for example, the user cannot touch the operation control, the user may trigger a position switching operation at a position of the user interface where the user is convenient to operate, so that, based on distances between the trigger position of the position switching operation and the at least one operation control group, a target operation control group to be moved, that is, an operation control group farther from the trigger position, is determined from the at least one operation control group, so as to move and display the determined target operation control group to a trigger position corresponding to the position switching operation, therefore, the operation control groups on the user interface are all positioned at the positions convenient for the user to operate, and the user can operate conveniently.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and those skilled in the art can also obtain other drawings according to the drawings without creative efforts.
Fig. 1 is a flowchart of a first embodiment of a user interface operation method according to the present invention;
FIG. 2 is a schematic diagram of a variation process of the user interface corresponding to the embodiment shown in FIG. 1;
FIG. 3 is a flowchart of a second embodiment of a method for operating a user interface according to the present invention;
FIG. 4 is a schematic diagram of a variation process of the user interface corresponding to the embodiment shown in FIG. 3;
FIG. 5 is a schematic diagram of another variation process of the user interface corresponding to the embodiment shown in FIG. 3;
fig. 6 is a flowchart of a third embodiment of a user interface operation method according to the present invention;
FIG. 7 is a schematic diagram of a variation process of the user interface corresponding to the embodiment shown in FIG. 6;
FIG. 8 is a schematic diagram of another variation process of the user interface corresponding to the embodiment shown in FIG. 6;
FIG. 9 is a schematic structural diagram of a user interface operating device according to an embodiment of the present invention;
fig. 10 is a schematic structural diagram of an electronic device corresponding to the user interface operation device provided in the embodiment shown in fig. 9.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The terminology used in the embodiments of the invention is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. As used in the examples of the present invention and the appended claims, the singular forms "a", "an", and "the" are intended to include the plural forms as well, and "a" and "an" generally include at least two, but do not exclude at least one, unless the context clearly dictates otherwise.
It should be understood that the term "and/or" as used herein is merely one type of association that describes an associated object, meaning that three relationships may exist, e.g., a and/or B may mean: a exists alone, A and B exist simultaneously, and B exists alone. In addition, the character "/" herein generally indicates that the former and latter related objects are in an "or" relationship.
The words "if", as used herein, may be interpreted as "at … …" or "at … …" or "in response to a determination" or "in response to a detection", depending on the context. Similarly, the phrases "if determined" or "if detected (a stated condition or event)" may be interpreted as "when determined" or "in response to a determination" or "when detected (a stated condition or event)" or "in response to a detection (a stated condition or event)", depending on the context.
It is also noted that the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a good or system that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such good or system. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a commodity or system that includes the element.
In addition, the sequence of steps in each method embodiment described below is only an example and is not strictly limited.
Fig. 1 is a flowchart of a first embodiment of a user interface operation method provided in an embodiment of the present invention, where the user interface operation method provided in an embodiment of the present invention may be executed by an Application (APP) corresponding to the user interface. As shown in fig. 1, the method comprises the steps of:
101. and in response to the position switching operation triggered on the user interface on which the at least one operation control group is displayed, determining a target operation control group to be moved from the at least one operation control group according to the distances between the at least one operation control group and the triggering positions of the position switching operation, respectively.
102. And moving the target operation control group to the triggering position.
The user interface operation method provided by the embodiment of the invention can be suitable for any Application (APP) installed in terminal equipment with a larger screen size, and as long as a certain user interface of the application comprises at least one operation control group, the user interface operation method provided by the embodiment of the invention can realize the movement of the display position of the at least one operation control group in the user interface, so that a user can conveniently operate the operation control. In practical applications, the terminal device may be a large-sized television terminal used in a video conference scenario, for example.
As shown in the first diagram in fig. 2, it is assumed that a certain user interface of a certain application has a first operation control group (including operation control 1, operation control 2, and operation control 3) located on the lower boundary line side of the user interface and a second operation control group (including operation control 4, operation control 5, operation control 6, and operation control 7) located on the right boundary line side of the user interface, and the user is assumed to stand on the left side of the screen at this time. At this time, if the user needs to click a certain operation control in the second operation control group, the user may not touch the operation control due to the large screen size, so that at this time, the user may perform the position switching operation at a position on the user interface where the user is convenient to operate, for example, continuously click for multiple times near the certain position as illustrated in the first diagram in fig. 2, so that the second operation control group in the user interface moves to the trigger position corresponding to the position switching operation, that is, the second operation control group moves to the trigger position for displaying, as illustrated in the second diagram in fig. 2.
It is understood that fig. 2 illustrates that the second operation control group moves to the trigger position of the position switching operation, and the first operation control group does not move to the trigger position because the distance between the first operation control group and the trigger position does not satisfy the preset requirement, and the distance between the second operation control group and the trigger position satisfies the preset requirement.
In practical applications, in order to support a user to trigger the position switching operation to move the display position of the operation control group on the user interface to a position where the user can conveniently operate when the user needs the position switching operation, the user needs to be enabled to register the position switching operation with the application. Based on this, when a user needs to trigger a position switching operation on a certain user interface of the application, one of the position switching operations registered at a position of the user interface where the user interface is convenient to operate on the operation control group may be made, so that if the application detects that the operation made by the user is one of the at least one registered position switching operation, the operation is considered as a position switching operation.
Optionally, the at least one registered location switching operation may be, for example: double-clicking the screen several times, e.g. twice, three times, four times, may for example again be: multiple fingers, such as two fingers, three fingers, four fingers, slide in one direction at the same time, and so on.
When the position switching operation of a user on a certain user interface is detected, a target operation control group to be moved is determined according to the distance between each operation control group contained in the user interface and the triggering position of the position switching operation, namely, the operation control group far away from the triggering position is determined, so that the target operation control group is moved to the triggering position, and therefore the user can conveniently operate any operation control in the operation control group which cannot be touched originally.
For any operation control group, the distance between the operation control group and the trigger position of the position switching operation may be a straight-line distance between the trigger position and a central point of the area occupied by the operation control group, but may also be embodied as measuring the distance in an indirect manner, which will be described in detail in the following embodiments.
In this embodiment, when a user wants to operate a certain operation control in a certain operation control group in a user interface but the current position of the user is inconvenient to operate the operation control, for example, the user cannot touch the operation control, the user may trigger a position switching operation at a position of the user interface where the user is convenient to operate, and thus, a target operation control group farther from the trigger position is determined based on the distance between the trigger position of the position switching operation and each operation control group, so as to move and display the determined target operation control group to the trigger position corresponding to the position switching operation, so that the operation control groups on the user interface are all located at the position where the user is convenient to operate, and the user operation is convenient.
Fig. 3 is a flowchart of a second embodiment of a user interface operation method provided in the embodiment of the present invention, and as shown in fig. 3, the method may include the following steps:
301. and in response to position switching operation triggered on the user interface on which the at least one operation control group is displayed, determining the operation control group with the distance greater than a preset threshold value from the at least one operation control group as a target operation control group according to the distance between the at least one operation control group and the triggering position.
In this embodiment, for any operation control group, the distance between the operation control group and the trigger position of the position switching operation may be directly embodied as: the linear distance between the triggering position and the central point of the area occupied by the operation control group. And if the linear distance is greater than the preset threshold value, the operation control group is a target operation control group and needs to move to the triggering position of the position switching operation.
The preset threshold value can be set by combining the screen size and the farthest distance which can be conveniently touched by a user, namely, the farthest distance which can be conveniently touched by the user stretching out of the arm at a certain position.
For example, fig. 4 and 5 illustrate user interfaces displayed on a screen when a user starts an electronic whiteboard application in a video conferencing system scenario. In fig. 4, it is assumed that the user interface includes only one operation control group located on the right boundary line side of the user interface, and for convenience of description, the operation control group is referred to as operation control group a, which includes four operation controls a1, a2, a3, and a 4. In fig. 5, it is assumed that the user interface includes two operation control groups, namely, an operation control group a located on the right boundary side of the user interface and an operation control group B located on the lower boundary side of the user interface, where the three operation controls B1, B2, and B3 are included.
Assuming that in fig. 4, the distance between the operation control group a and the trigger position of the position switching operation is greater than the preset threshold, it is determined that the operation control group a is the target operation control group. Assuming that in fig. 5, the distance between the operation control group a and the trigger position of the position switching operation is greater than the preset threshold, and the distance between the operation control group B and the trigger position of the position switching operation is also greater than the preset threshold, it is determined that both the operation control group a and the operation control group B are the target operation control group.
302. And determining a first boundary line corresponding to the shortest distance in the display boundary lines according to the distances from the trigger position to the display boundary lines of the user interface.
303. And determining a sub-area for accommodating the target operation control group in the control display area on the first boundary line side.
304. And moving the target operation control group to the sub-area for display.
It is understood that the user interface may include, in addition to the operation control group, a data area, which may display data content for the user to view or may be a blank area for the user to input data content. The middle larger area in the user interface of the electronic whiteboard application as shown in fig. 4 and 5 is a data area for the user to write the explanation content and the like in the area. In addition, in order to facilitate the user to perform operations such as data content viewing and inputting in the data area, the operation control group is generally located in the peripheral area of the user interface, and the central larger area is used as the data area.
Therefore, the user interface may be divided into two types of regions, one type is a data region, and the other type is a control display region, where generally, the control display region surrounds the data region, so that control display regions respectively corresponding to four boundary lines of the user interface, such as the four control display regions illustrated in fig. 4, may be predefined. Accordingly, the movement of the target operation control group is to move to the control display region on the boundary line side corresponding to the trigger position of the position switching operation.
Based on this, in this embodiment, the moving the target operation control group to the trigger position of the position switching operation may be implemented as:
determining a first boundary line corresponding to the shortest distance in all the display boundary lines according to the distances from the trigger position of the position switching operation to all the display boundary lines of the user interface;
and moving the target operation control group to the control display area on the first boundary line side for display.
In practical applications, the determination of the trigger position of the position switching operation may be different due to different specific implementation forms of the position switching operation. For example, when the position switching operation is implemented by continuously clicking the screen for multiple times, the positions clicked by the user for multiple times may have slight differences, and at this time, the position corresponding to any one of the continuous multiple-click operations may be used as the trigger position of the position switching operation. For another example, when the position switching operation is implemented by sliding the multi-finger in a certain direction, the position where the multi-finger just touches the screen may be used as the trigger position of the position switching operation.
The distance from the trigger position of the position switching operation to each display boundary line of the user interface is a vertical distance from the trigger position to each display boundary line.
As shown in fig. 4 and 5, the trigger position of the position switching operation by the user is closest to the left boundary line, and therefore, the left boundary line is determined to be the first boundary line.
In practical application, the control display area on the first boundary line side may or may not have an operation control group; the size of the control display area on the first boundary line side may be greater than or equal to the size of the area currently occupied by the target operation control group, or may be smaller than the size of the area currently occupied by the target operation control group. Therefore, when the target operation control group is moved to the control display area on the first boundary line side for display, it is necessary to determine a sub-area accommodating the target operation control group in the control display area on the first boundary line side, and then move the target operation control group to the sub-area for display.
With reference to fig. 4 and 5, in fig. 4, the target operation control group is only the operation control group a on the right boundary line side, and it is assumed that the trigger position of the position switching operation of the user is closest to the left boundary line, and it is assumed that the height of the control display area on the left boundary line side is greater than the height of the operation control group a and the width is greater than the width of the operation control group a, and no other operation control group is displayed in the control display area, at this time, the control display area may be considered as a sub-area accommodating the operation control group a, and the operation control group a may be directly moved to the control display area without changing the display style of the operation control group a.
In fig. 5, the target operation control group includes an operation control group a on the right boundary line side and an operation control group B on the lower boundary line side, and it is assumed that the trigger position of the position switching operation of the user is closest to the left boundary line, and the control display area on the left boundary line side is insufficient to accommodate the operation control group a and the operation control group B according to the original display style of the operation control group a and the operation control group B, and at this time, when the operation control group a and the operation control group B are moved and displayed into the control display area, the display style may be adaptively changed. Since the control display area corresponds to the left boundary line, generally, the controls in the control display area should be displayed in a longitudinal arrangement, so when determining the sub-area accommodating the target operation control group in the control area, the control display area may be divided into two rows, one row for accommodating the operation control group a and one row for accommodating the operation control group B, according to the number of the target operation control groups, namely, the operation control group a and the operation control group B. Then, the operation control group a is moved to the sub-area corresponding to one column for display, and the operation control group B is rotated to be arranged longitudinally and then moved to the sub-area corresponding to the other column for display, as shown in fig. 5.
It should be noted that, for example, when the operation control group a is displayed in a sub-region, if the size, i.e., the height and the width, of the sub-region is larger than the height and the width of the operation control group a, the display style of the operation control group a is not changed, but if the size of the sub-region is smaller than the size of the operation control group a, the display style of the operation control group a is changed, which may be represented by a reduction in each operation control icon in the operation control group a or a reduction in the number of operation controls that can be simultaneously displayed in the operation control group a (the operation control group a is changed to a style in which all the operation controls are displayed by a sliding operation), and so on. For example, if the height of the sub-region is smaller than the height of the operation control group a, the operation control icons in the operation control group a are reduced so that the sub-region can accommodate the operation controls.
In summary, in the process of determining a sub-region for accommodating the target operation control group in the control display region on the first boundary line side, and moving the target operation control group to the sub-region for display, the sub-region of the control display region may be divided according to the number of the target operation control groups and the default control arrangement direction of the control display region, and then the display style of each target operation control group is determined according to the size relationship between each target operation control group and the corresponding sub-region, so that each target operation control group is moved to the corresponding sub-region for display according to the determined display style.
Through the embodiment, the operation control group far away from the user on the user interface can be moved to the position close to the user, namely, the position convenient for the user to operate, so that the operation of the user is facilitated.
Fig. 6 is a flowchart of a third embodiment of a user interface operation method provided in the embodiment of the present invention, and as shown in fig. 6, the method may include the following steps:
601. in response to a position switching operation triggered on a user interface on which at least one operation control group is displayed, determining a first boundary line corresponding to the shortest distance among display boundary lines according to distances from a trigger position to the display boundary lines of the user interface, respectively.
602. And if the side of the second boundary line opposite to the first boundary line is provided with the first operation control group, determining that the target operation control group comprises the first operation control group.
603. And if the third boundary line side adjacent to the first boundary line is provided with a second operation control group and the distance between the second operation control group and the trigger position is greater than a preset threshold value, determining that the target operation control group comprises the second operation control group.
604. The first operation control group is moved to the first boundary line side.
605. The second operation control group is moved to the first boundary line side.
In this embodiment, for any operation control group, the distance between the operation control group and the trigger position of the position switching operation may be measured in an indirect manner as follows: and a positional relationship between a display boundary line closest to a trigger position of the position switching operation and a display boundary line corresponding to each operation control group.
Specifically, first, a display boundary line, to which a trigger position of a position switching operation is closest, is determined, and referred to as a first boundary line, and then, it is determined whether or not an operation control group exists on a second boundary line side opposite to the first boundary line, that is, opposite to the first boundary line, and if so, it is determined that the first operation control group needs to be moved as a target operation control group. And then, traversing another two boundary lines adjacent to the first boundary line to be called a third boundary line, and judging whether an operation control group is arranged on the side of the third boundary line to be called a second operation control group, if so, further determining whether the second operation control group is moved as a target operation control group according to the distance between the trigger position of the position switching operation and the second operation control group. Specifically, if the linear distance from the trigger position to the central point of the area occupied by the second operation control group is greater than a preset threshold, the second operation control group is a target operation control group.
Taking fig. 7 and 8 as an example, assuming that the user interface includes two operation control sets, namely, an operation control set a located on the right boundary line side of the user interface and an operation control set B located on the lower boundary line side of the user interface, and assuming that the trigger position of the position switching operation of the user is closest to the left boundary line, it may be directly determined that the operation control set a on the right boundary line side is the target operation control set that needs to be moved.
Then, as shown in fig. 7, if it is assumed that the distance between the trigger position and the operation control group B is smaller than the preset threshold, the operation control group B is not the target operation control group that needs to be moved, and at this time, the operation control group a only needs to be moved to the left boundary line side.
In the case shown in fig. 7, moving the first operation control group to the left boundary line side may be implemented as:
a first sub-area accommodating the operation control group a is determined in the control display area on the left boundary side, and the arrangement direction of the controls corresponding to the first sub-area is consistent with the current arrangement direction of the controls of the operation control group a, such as the longitudinal arrangement illustrated in fig. 7. And then, moving the operation control group A to the first sub-area according to the control arrangement direction for display. The first sub-area illustrated in fig. 7 is a control display area on the left boundary line side.
And in the process of moving the operation control group A into the first sub-region according to the control arrangement direction for display, if the size of the first sub-region is smaller than the size of the current display region of the operation control group A, compressing the operation control group A according to the size of the first sub-region, and then moving the compressed operation control group A into the first sub-region according to the control arrangement direction for display. For example, the compression process is to perform a reduction process on each operation control icon in the operation control group a, or perform a reduction process on the number of operation controls that can be simultaneously displayed in the operation control group a, such as the change process of the sliding display style mentioned in the foregoing embodiment.
As shown in fig. 8, if it is assumed that the distance between the trigger position and the operation control group B is greater than the preset threshold, the operation control group B is also a target operation control group that needs to be moved, and at this time, the operation control group a and the operation control group B need to be moved to the left boundary line side.
At this time, the specific implementation of moving the operation control group a and the operation control group B to the left boundary line side may be implemented with reference to fig. 5, that is, a first sub-region accommodating the operation control group a and a second sub-region accommodating the operation control group B are determined in the control display region on the left boundary line side, and it can be understood by referring to fig. 5 that the arrangement direction of the controls corresponding to the first sub-region is longitudinally arranged in accordance with the current arrangement direction of the controls of the operation control group a, and the arrangement direction of the controls corresponding to the second sub-region is opposite to the current arrangement direction of the controls of the operation control group B, that is, the arrangement direction of the controls in the operation control group B is changed from horizontal to longitudinal arrangement. The first sub-area and the second sub-area can be obtained by uniformly dividing the control display area into a left half and a right half. Thus, the operation control group a is displayed by being moved into the first sub-area, and the operation control group B is displayed by being moved into the second sub-area. In this process of moving to the display of the respectively corresponding sub-regions, the change of the display style of the operation control group mentioned in the foregoing embodiment may be involved.
Alternatively, the movement of the operation control group a and the operation control group B to the left boundary line side may also be implemented as:
and determining a first sub-area for accommodating the operation control group A in the control display area on the left boundary side, and moving the operation control group A into the first sub-area according to the control arrangement direction for display. And for the operation control group B, the operation control group B may be shifted to the left boundary line side along its corresponding lower boundary line, as shown in fig. 8. The distance that the operation control group B translates along the corresponding lower boundary line to the left boundary line side may be moved until the trigger position of the distance position switching operation reaches the preset threshold value, or may be moved to the left top of the control display area where the left top of the operation control group B reaches the lower boundary line.
Through the embodiment, the operation control group far away from the user on the user interface can be moved to the position close to the user, namely, the position convenient for the user to operate, so that the operation of the user is facilitated.
The user interface operation device of one or more embodiments of the present invention will be described in detail below. Those skilled in the art will appreciate that the user interface operating means may be constructed using commercially available hardware components configured by the steps taught in the present scheme.
Fig. 9 is a schematic structural diagram of a user interface operating device according to an embodiment of the present invention, and as shown in fig. 9, the device includes: the system comprises an operation detection module 11, a control selection module 12 and a control display module 13.
And the operation detection module 11 is used for detecting the position switching operation triggered on the user interface on which at least one operation control group is displayed.
And a control selecting module 12, configured to determine, according to distances between the at least one operation control group and the trigger positions of the position switching operation, a target operation control group to be moved from the at least one operation control group.
And a control display module 13, configured to move the target operation control group to the trigger position.
Optionally, the apparatus further comprises: a receiving module 14 and a storage module 15.
The receiving module 14 is configured to receive a location switching operation registration instruction, where the location switching operation registration instruction includes at least one location switching operation.
A saving module 15, configured to save the at least one location switching operation.
Thus, the operation detection module 11 is specifically configured to: it is detected whether a position switching operation triggered on a user interface on which at least one operation control group is displayed is one of the at least one position switching operation.
Optionally, the control selection module 12 may be configured to: and determining the operation control group with the distance larger than a preset threshold value from the at least one operation control group as the target operation control group according to the distance between the at least one operation control group and the triggering position.
Thus, optionally, the control display module 13 may be configured to: determining a first boundary line corresponding to the shortest distance in all the display boundary lines according to the distances from the trigger positions to all the display boundary lines of the user interface; determining a sub-area accommodating the target operation control group in a control display area on the first boundary line side; and moving the target operation control group to the sub-area for display.
Optionally, the control selection module 12 may be further configured to: determining a first boundary line corresponding to the shortest distance in all the display boundary lines according to the distances from the trigger positions to all the display boundary lines of the user interface; and if a first operation control group is arranged on a second boundary line side opposite to the first boundary line, determining that the target operation control group comprises the first operation control group.
Accordingly, the control display module 13 may be configured to: and moving the first operation control group to the first boundary line side.
Specifically, the control display module 13 is configured to: determining a first sub-region accommodating the first operation control group in a control display region on the side of the first boundary line, wherein the control arrangement direction corresponding to the first sub-region is consistent with the current control arrangement direction of the first operation control group; and moving the first operation control group to the first sub-area according to the control arrangement direction for display.
The control display module 13 is specifically configured to, during the process of moving the first operation control group to the first sub-region for display according to the control arrangement direction: if the size of the first sub-area is smaller than the size of the current display area of the first operation control group, compressing the first operation control group according to the size of the first sub-area; and moving the compressed first operation control group to the first sub-area according to the control arrangement direction for display.
Optionally, the control selection module 12 may be further configured to: if a second operation control group is arranged on a third boundary line side adjacent to the first boundary line, and the distance between the second operation control group and the trigger position is greater than a preset threshold value, determining that the target operation control group comprises the second operation control group;
Accordingly, the control display module 13 is configured to: and moving the second operation control group to the first boundary line side.
Wherein, in the process of moving the second operation control group to the first boundary line side, the control display module 13 may be configured to: translating the second operation control group to the first boundary line side along the third boundary line; or determining a second sub-area accommodating the second operation control group in the control display area on the first boundary line side, and moving the second operation control group into the second sub-area according to the control arrangement direction corresponding to the second sub-area for display, wherein the control arrangement direction corresponding to the second sub-area is opposite to the current control arrangement direction of the second operation control group.
The apparatus shown in fig. 9 can perform the method of the embodiment shown in fig. 1 to 6, and reference may be made to the related description of the embodiment shown in fig. 1 to 6 for a part not described in detail in this embodiment. The implementation process and technical effect of the technical solution refer to the descriptions in the embodiments shown in fig. 1 to fig. 6, and are not described herein again.
While the internal functions and structures of the ui operating device are described above, in one possible design, the structure of the ui operating device may be implemented as an electronic device, which may include: a processor 21 and a memory 22. Wherein the memory 22 is used for storing programs for supporting the user interface operation device to execute the user interface operation method provided in the embodiment shown in fig. 1 to 6, and the processor 21 is configured to execute the programs stored in the memory 22.
The program comprises one or more computer instructions which, when executed by the processor 21, are capable of performing the steps of:
in response to a position switching operation triggered on a user interface on which at least one operation control group is displayed, determining a target operation control group to be moved from the at least one operation control group according to distances between the at least one operation control group and triggering positions of the position switching operation, respectively;
and moving the target operation control group to the triggering position.
Optionally, the processor 21 is further configured to perform all or part of the steps in the embodiments shown in fig. 1 to 6.
The structure of the user interface operation device may further include a communication interface 23, which is used for the user interface operation device to communicate with other devices or a communication network.
In addition, an embodiment of the present invention provides a computer storage medium for storing computer software instructions for a user interface operating device, which includes a program for executing the user interface operating method in the method embodiments shown in fig. 1 to 6.
The above-described embodiments of the apparatus are merely illustrative, and the units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the present embodiment. One of ordinary skill in the art can understand and implement it without inventive effort.
Through the above description of the embodiments, those skilled in the art will clearly understand that each embodiment can be implemented by adding a necessary general hardware platform, and of course, can also be implemented by a combination of hardware and software. With this understanding in mind, the above-described aspects and portions of the present technology which contribute substantially or in part to the prior art may be embodied in the form of a computer program product, which may be embodied on one or more computer-usable storage media having computer-usable program code embodied therein, including without limitation disk storage, CD-ROM, optical storage, and the like.
The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
In a typical configuration, a computing device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory.
The memory may include forms of volatile memory in a computer readable medium, Random Access Memory (RAM) and/or non-volatile memory, such as Read Only Memory (ROM) or flash memory (flash RAM). Memory is an example of a computer-readable medium.
Computer-readable media, including both non-transitory and non-transitory, removable and non-removable media, may implement information storage by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), Static Random Access Memory (SRAM), Dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), Read Only Memory (ROM), Electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), Digital Versatile Discs (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices, or any other non-transmission medium that can be used to store information that can be accessed by a computing device. As defined herein, a computer readable medium does not include a transitory computer readable medium such as a modulated data signal and a carrier wave.
Finally, it should be noted that: the above examples are only intended to illustrate the technical solution of the present invention, but not to limit it; although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and such modifications or substitutions do not depart from the spirit and scope of the corresponding technical solutions of the embodiments of the present invention.

Claims (10)

1. A method of user interface operation, comprising:
in response to a position switching operation triggered on a user interface on which at least one operation control group is displayed, determining a target operation control group to be moved from the at least one operation control group according to distances between the at least one operation control group and triggering positions of the position switching operation, respectively;
and moving the target operation control group to the trigger position so as to enable the target operation control group to be moved to the trigger position for displaying.
2. The method according to claim 1, wherein the determining a target operation control group to be moved from the at least one operation control group according to the distances between the at least one operation control group and the triggering positions of the position switching operation, respectively, comprises:
and determining the operation control group with the distance larger than a preset threshold value from the at least one operation control group as the target operation control group according to the distance between the at least one operation control group and the triggering position.
3. The method of claim 2, wherein moving the target set of operating controls to the triggered position comprises:
Determining a first boundary line corresponding to the shortest distance in all the display boundary lines according to the distances from the trigger positions to all the display boundary lines of the user interface respectively;
determining a sub-area accommodating the target operation control group in a control display area on the first boundary line side;
and moving the target operation control group to the sub-area for display.
4. The method according to claim 1, wherein the determining a target operation control group to be moved from the at least one operation control group according to the distances between the at least one operation control group and the triggering positions of the position switching operation, respectively, comprises:
determining a first boundary line corresponding to the shortest distance in all the display boundary lines according to the distances from the trigger positions to all the display boundary lines of the user interface respectively;
if a first operation control group is arranged on a second boundary line side opposite to the first boundary line, determining that the target operation control group comprises the first operation control group;
moving the target set of operational controls to the trigger position, including:
and moving the first operation control group to the first boundary line side.
5. The method of claim 4, wherein said moving said first set of operational controls to said first boundary line side comprises:
determining a first sub-area for accommodating the first operation control group in a control display area on the side of the first boundary line, wherein the control arrangement direction corresponding to the first sub-area is consistent with the current control arrangement direction of the first operation control group;
and moving the first operation control group to the first sub-area according to the control arrangement direction for display.
6. The method of claim 5, wherein moving the first set of operational controls to be displayed in the first sub-region in the control arrangement direction comprises:
if the size of the first sub-area is smaller than the size of the current display area of the first operation control group, compressing the first operation control group according to the size of the first sub-area;
and moving the compressed first operation control group to the first sub-area according to the control arrangement direction for display.
7. The method of claim 4, further comprising:
If a second operation control group is arranged on a third boundary line side adjacent to the first boundary line, and the distance between the second operation control group and the trigger position is greater than a preset threshold value, determining that the target operation control group comprises the second operation control group;
the moving the target operation control group to the triggering position comprises:
and moving the second operation control group to the first boundary line side.
8. The method of claim 7, wherein said moving said second set of operational controls to said first boundary line side comprises:
translating the second operation control group to the first boundary line side along the third boundary line;
alternatively, the first and second electrodes may be,
determining a second sub-area for accommodating the second operation control group in a control display area on the side of the first boundary line, wherein the control arrangement direction corresponding to the second sub-area is opposite to the current control arrangement direction of the second operation control group;
and moving the second operation control group to the second sub-area according to the control arrangement direction corresponding to the second sub-area for display.
9. The method according to any one of claims 1 to 8, further comprising:
Receiving a position switching operation registration instruction, wherein the position switching operation registration instruction comprises at least one position switching operation;
saving the at least one position switching operation;
wherein the position switching operation is one of the at least one position switching operation.
10. An electronic device, comprising: a memory, a processor; wherein, the first and the second end of the pipe are connected with each other,
the memory is for storing one or more computer instructions, wherein the one or more computer instructions, when executed by the processor, implement a method of user interface operation as recited in any of claims 1-9.
CN201810246978.4A 2018-03-23 2018-03-23 User interface operation method and device Active CN110297574B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810246978.4A CN110297574B (en) 2018-03-23 2018-03-23 User interface operation method and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810246978.4A CN110297574B (en) 2018-03-23 2018-03-23 User interface operation method and device

Publications (2)

Publication Number Publication Date
CN110297574A CN110297574A (en) 2019-10-01
CN110297574B true CN110297574B (en) 2022-06-14

Family

ID=68026183

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810246978.4A Active CN110297574B (en) 2018-03-23 2018-03-23 User interface operation method and device

Country Status (1)

Country Link
CN (1) CN110297574B (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112312058B (en) * 2020-03-22 2023-06-27 北京字节跳动网络技术有限公司 Interaction method and device and electronic equipment
CN112363666A (en) * 2020-11-05 2021-02-12 厦门厦华科技有限公司 Window adjusting method and device for electronic whiteboard

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106126055A (en) * 2016-06-12 2016-11-16 乐视控股(北京)有限公司 operation interface display control method and device
CN106383642A (en) * 2016-09-09 2017-02-08 北京金山安全软件有限公司 Display method and related device for control of media playing interface
CN107621914A (en) * 2017-08-02 2018-01-23 努比亚技术有限公司 Display methods, terminal and the computer-readable recording medium of termination function control key

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3035184B1 (en) * 2014-12-15 2021-10-20 Canon Kabushiki Kaisha User interface apparatus, method for controlling a user interface, and computer-readable storage medium for controlling a user interface

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106126055A (en) * 2016-06-12 2016-11-16 乐视控股(北京)有限公司 operation interface display control method and device
CN106383642A (en) * 2016-09-09 2017-02-08 北京金山安全软件有限公司 Display method and related device for control of media playing interface
CN107621914A (en) * 2017-08-02 2018-01-23 努比亚技术有限公司 Display methods, terminal and the computer-readable recording medium of termination function control key

Also Published As

Publication number Publication date
CN110297574A (en) 2019-10-01

Similar Documents

Publication Publication Date Title
US8751955B2 (en) Scrollbar user interface for multitouch devices
US10095389B2 (en) Gesture-based on-chart data filtering
US10331311B2 (en) Information management with non-hierarchical views
US9542070B2 (en) Method and apparatus for providing an interactive user interface
JP5911599B2 (en) Method and portable device for switching classified web pages
CN110244949B (en) Page information display method and device
AU2014308633B2 (en) Swipe toolbar to switch tabs
US10275132B2 (en) Display apparatus, method of controlling display apparatus, and recordable medium storing program for performing method of controlling display apparatus
US11693544B2 (en) Mobile terminal display picture control method, apparatus, and device and storage medium
US20150286356A1 (en) Method, apparatus, and terminal device for controlling display of application interface
CN107704157B (en) Multi-screen interface operation method and device and storage medium
WO2021098832A1 (en) Element control method, device, apparatus, and storage medium
US20220019346A1 (en) Table processing method, device, interactive white board and storage medium
CN106445972B (en) Page display method and device
US20100241958A1 (en) Method and system to manage and prioritize windows based on touch strip inputs
US20150309690A1 (en) Method and system for searching information records
WO2016188229A1 (en) Terminal device and method for dynamically adjusting control position
CN107153546B (en) Video playing method and mobile device
CN110286977B (en) Display method and related product
CN110297574B (en) User interface operation method and device
WO2017088228A1 (en) Picture zooming method and apparatus
CN112099706A (en) Page display method and device, electronic equipment and computer readable storage medium
US20130311934A1 (en) Method for displaying multi menu pages in one window of multi-touch-sensitive display unit of computing device and computing device applying the method
CN106249879A (en) The display packing of a kind of virtual reality image and terminal
US20150253944A1 (en) Method and apparatus for data processing

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
TA01 Transfer of patent application right

Effective date of registration: 20201218

Address after: Room 603, 6 / F, Roche Plaza, 788 Cheung Sha Wan Road, Kowloon, China

Applicant after: Zebra smart travel network (Hong Kong) Limited

Address before: A four-storey 847 mailbox in Grand Cayman Capital Building, British Cayman Islands

Applicant before: Alibaba Group Holding Ltd.

TA01 Transfer of patent application right
GR01 Patent grant
GR01 Patent grant