CN106325656B

CN106325656B - Applied to the 3D user interface interaction method for touching terminal and touch terminal

Info

Publication number: CN106325656B
Application number: CN201510345351.0A
Authority: CN
Inventors: 陈亮; 庄泳
Original assignee: Shenzhen Super Multi-Dimensional Technology Co Ltd
Current assignee: SuperD Co Ltd
Priority date: 2015-06-19
Filing date: 2015-06-19
Publication date: 2019-10-25
Anticipated expiration: 2035-06-19
Also published as: CN106325656A

Abstract

The invention discloses a kind of applied to the 3D user interface interaction method for touching terminal, comprising: detects whether that there are operating bodies；If testing result be it is yes, according to the operating body and it is described touch terminal the distance between display screen, adjust it is described manipulation icon protrude from it is described display screen distance or the multiple desktop icons protrude from it is described display screen distance；The manipulation icon is any one in multiple desktop icons that the 3D user interface is shown.The interaction for touching 3D user interface under terminal use pattern is realized by the method for the invention, is improved user and is manipulated experience, greatly enhances ease for use, flexibility and the enjoyment of user interface.

Description

3D user interface interaction method applied to touch terminal and touch terminal

Technical Field

The invention relates to the technical field of 3D processing, in particular to a 3D user interface interaction method applied to a touch terminal and the touch terminal.

Background

The touch terminals such as mobile phones and tablet computers are greatly convenient for interaction between people and terminal equipment due to the adoption of touch operation, and the touch terminals such as the mobile phones and the tablet computers become common equipment for daily office work and entertainment of people.

However, in the prior art, the interaction of the user interface is relatively single in function except the interaction satisfying the basic operation function, and particularly, the icons on the user interface are not changed at all, and certain relation is lacked among the icons, so that the user feels stiff, and flexibility and fun are lacked.

Disclosure of Invention

The invention provides a 3D user interface interaction method applied to a touch terminal and the touch terminal.

In order to solve the technical problems, the invention adopts a technical scheme that:

A3D user interface interaction method applied to a touch terminal, wherein the touch terminal comprises a use mode; in a use mode, a backboard and a plurality of desktop icons suspended on the backboard are displayed on the 3D user interface, and when a touch operation of an operating body touching the display screen of the touch terminal is not received, the desktop icons protrude out of the display screen of the touch terminal for display; the method comprises the following steps:

detecting whether an operation body exists or not;

if the detection result is yes, adjusting the distance of the control icon protruding out of the display screen or the distance of the desktop icons protruding out of the display screen according to the distance between the operation body and the display screen of the touch terminal;

the control icon is any one of a plurality of desktop icons displayed by the 3D user interface.

Optionally, the adjusting, according to a distance between the operation body and a display screen of the touch terminal, a distance that the control icon protrudes from the display screen or a distance that the desktop icons protrude from the display screen includes:

when the distance between the operation body and a display screen of the touch terminal is reduced or increased, increasing the distance of the control icon protruding out of the display screen or increasing the distance of the desktop icons protruding out of the display screen; or,

when the distance between the operation body and the display screen of the touch terminal is reduced or increased, the distance of the control icon protruding out of the display screen is reduced or the distance of the desktop icons protruding out of the display screen is reduced.

Optionally, when the distance between the operation body and the display screen of the touch terminal decreases or increases, decreasing the distance that the manipulation icon protrudes from the display screen or decreasing the distance that the desktop icons protrude from the display screen specifically includes:

judging whether the distance between the operation body and the display screen is smaller than the maximum distance of the control icon protruding out of the display screen;

if the judgment result is yes, adjusting the distance that the control icon protrudes out of the display screen or the distance that the plurality of desktop icons protrude out of the display screen, so that the control icon or the plurality of desktop icons sink towards the backboard.

Optionally, the adjusting the distance that the control icon protrudes from the display screen or the distance that the desktop icons protrude from the display screen specifically includes:

adjusting the distance of the control icon protruding out of the display screen to be the distance between the operation body and the display screen; or,

and adjusting the distance of the plurality of desktop icons protruding out of the display screen to be the distance between the operation body and the display screen.

Optionally, the method further comprises:

when receiving a touch operation of the operation body touching the display screen of the touch terminal, analyzing operation information contained in the touch operation, determining the current operation type of the operation body according to the analyzed operation information, and executing the operation corresponding to the determined operation type.

Optionally, the operation information includes:

the time information of the operation body contacting the display screen and/or the motion trail information of the operation body on the display screen.

Optionally, the operation types include:

one or more of click operation, up-down sliding operation, left-right sliding operation, or long-press operation.

Optionally, the determining the current operation type of the operation body according to the analyzed operation information specifically includes:

when the time for the operating body to contact the display screen is less than a preset first time threshold, further judging the motion track of the operating body on the display screen; if no motion track exists, determining that the current operation type of the operation body is clicking operation, if the motion track exists and the operation is rapid up-down displacement operation, determining that the current operation type of the operation body is up-down sliding operation, and if the motion track exists and the operation is rapid left-right displacement operation, determining that the current operation type of the operation body is left-right sliding operation;

or when the time that the operation body contacts the display screen is greater than or equal to a preset first time threshold, determining that the current operation type of the operation body is long-press operation.

Optionally, before the executing the operation corresponding to the determined operation type, the method further includes:

and judging whether a control icon exists in a region controlled by the operation body, wherein the control icon is any one of the plurality of desktop icons.

Optionally, when there is a control icon in the region controlled by the operation body, the executing the operation corresponding to the determined operation type includes:

when the determined operation type is the clicking operation, judging the icon type of the control icon; if the icon is the application icon or the micro-control icon, executing the operation of starting the application corresponding to the icon, and if the icon is the folder icon, executing the operation of opening the folder; or,

when the determined operation type is the up-down sliding operation, judging the icon type of the control icon; if the icon is the application icon or the micro-control element icon, executing the operation of starting the sub-level function corresponding to the application icon or the micro-control element icon; if the icon is the folder icon, no response is made; or,

when the determined operation type is a left-right sliding operation, executing an operation of starting a switching screen; or,

the touch terminal further comprises an icon editing mode, and when the determined operation type is long-press operation, the operation of switching the touch terminal from the use mode to the icon editing mode is executed.

Optionally, when there is no control icon in the region controlled by the operation body, the executing the operation corresponding to the determined operation type includes:

when the determined operation type is single click operation or up-down sliding operation, no response is made; or,

when the determined operation type is a left-right sliding operation, executing screen switching operation; or,

Optionally, the touch terminal further comprises an icon editing mode; in an icon editing mode, the backplane is split into a plurality of polyhedrons with spacing features therebetween; the desktop icons respectively correspond to one of the polyhedrons, and each desktop icon is located between the display screen and the polyhedron corresponding to the desktop icon.

Optionally, the plurality of polyhedrons are tetrahedrons or hexahedrons.

Optionally, in the icon editing mode, the interval feature between the plurality of polyhedrons is characterized by a split identifier which is a split line with depth information.

Optionally, in an icon editing mode, the backplane is split into a plurality of polyhedrons with spacing features therebetween; the desktop icons respectively correspond to one of the polyhedrons, and each desktop icon is located between the display screen and the polyhedron corresponding to the desktop icon.

Optionally, the method further comprises:

in a use mode, the projection of the plurality of desktop icons on the 3D user interface is changed according to the change of time.

Correspondingly, in order to solve the technical problem, an embodiment of the present invention further provides a touch terminal, where the touch terminal includes a use mode; in a use mode, a backboard and a plurality of desktop icons suspended on the backboard are displayed on a 3D user interface of the touch terminal; when the touch operation of the operation body is not received, the desktop icon protrudes out of the display screen for displaying; the touch terminal includes:

the first detection module is used for detecting whether an operation body exists or not;

the processing module is used for adjusting the distance of the control icon protruding out of the display screen or the distance of the desktop icons protruding out of the display screen according to the distance between the operation body and the display screen of the touch terminal when the detection result of the detection module is yes;

Optionally, the processing module is specifically configured to:

Optionally, the processing module includes: a judging unit and a processing unit;

the judging unit is used for judging whether the distance between the operation body and the display screen is smaller than the maximum distance of the control icon protruding out of the display screen;

Optionally, the detection module is further configured to detect whether a touch operation of the operation body touching the display screen of the touch terminal is received;

the processing module is further configured to: when the detection module receives the touch operation of the operation body touching the display screen of the touch terminal, the operation information contained in the touch operation received by the detection module is analyzed, the current operation type of the operation body is determined according to the analyzed operation information, and the operation corresponding to the determined operation type is executed.

Optionally, the operation information includes:

Optionally, the operation types include:

Optionally, the processing module is specifically configured to:

Optionally, the touch terminal further includes a determining module, configured to determine whether a control icon exists in a region controlled by an operating body when the detecting module receives a touch operation of the operating body touching the display screen of the touch terminal, where the control icon is any one of the desktop icons;

the processing module is specifically configured to execute an operation corresponding to the determined operation type when the judging module judges that the control icon exists in the region controlled by the operation body.

Finally, an embodiment of the present invention further provides a touch terminal, including: a display screen and a central processing unit,

the display screen is used for displaying a 3D user interface and receiving touch operation of an operation body on the display screen of the touch terminal; the touch terminal comprises a use mode; in a use mode, a backboard and a plurality of desktop icons suspended on the backboard are displayed on the 3D user interface, and when the display screen does not receive touch operation of the operating body touching the display screen, the desktop icons protrude out of the display screen for display;

the central processing unit is used for detecting whether an operation body exists or not when the display screen does not receive the touch operation of the operation body for touching the display screen; if the detection result is yes, adjusting the distance of the control icon protruding out of the display screen or the distance of the desktop icons protruding out of the display screen according to the distance between the operation body and the display screen of the touch terminal;

the control icon is any one of a plurality of desktop icons displayed on the 3D user interface.

According to the embodiment of the invention, when the touch operation of the operation body for touching the display screen is not received, whether the operation body exists is detected, and when the operation body is detected, the distance of the control icon or the desktop icon protruding out of the display screen is adjusted according to the distance between the operation body and the display screen of the touch terminal, so that the interaction of the 3D user interface in the use mode of the touch terminal is realized, the interaction mode of the user interface is enriched, the user control experience is improved, and the usability, flexibility and fun of the user interface are greatly enhanced.

Drawings

FIG. 1 is a schematic diagram of a 3D user interface of an embodiment of the invention;

FIG. 2 is a schematic diagram of an application icon floating on a backplane in a 3D user interface according to an embodiment of the present invention;

FIG. 3 is a flow chart of a 3D user interface interaction method according to an embodiment of the present invention;

FIG. 4 is a schematic diagram of a 3D user interface operation desktop icon according to an embodiment of the present invention;

fig. 5 and 6 are schematic diagrams illustrating display of desktop icons on a 3D user interface when the display mode is switched to the icon editing mode according to the embodiment of the present invention;

FIGS. 7 and 8 are schematic diagrams illustrating the display effect of the operation application icon according to the embodiment of the present invention;

9A, 9B, and 9C are schematic projection diagrams of desktop icons on a user interface at different time points according to an embodiment of the present invention;

FIG. 10 is a flow chart of a method of user interface interaction in a use mode of an embodiment of the present invention;

FIG. 11 is a schematic view of an embodiment of the present invention in which the entire screen is flipped and cut;

FIG. 12 is a schematic view of a polyhedral flipping cut screen according to an embodiment of the invention;

FIG. 13 is a schematic diagram of a desktop icon fly-in screen cut according to an embodiment of the present invention;

FIG. 14 is a schematic diagram of a 3D UI interaction device according to an embodiment of the invention;

fig. 15 is a schematic diagram of a touch terminal according to an embodiment of the present invention.

Detailed Description

The present invention will be described in detail below with reference to the accompanying drawings and embodiments.

It should be noted that, if not conflicting, the embodiments of the present invention and the features of the embodiments may be combined with each other within the scope of protection of the present invention. Additionally, while functional block divisions are performed in apparatus schematics, with logical sequences shown in flowcharts, in some cases, steps shown or described may be performed in sequences other than block divisions in apparatus or flowcharts.

To facilitate the reader's understanding of the embodiments of the invention, some terms referred to in all embodiments of the invention are explained below before beginning the description of the various embodiments of the invention.

Displayed on the display screen of the touch terminal is a 3D interface, and the 3D interface refers to an interface having a 3D display effect. The display modes of the touch terminal include an icon editing mode and a use mode. A mode in which the touch terminal normally displays a UI (user interface) is referred to as a use mode, and a mode in which an icon on the 3D interface is edited is referred to as an icon editing mode. When the touch terminal is in a use mode, a backboard and a plurality of desktop icons suspended on the backboard are displayed on a user interface of the touch terminal, and the backboard is formed by seamlessly splicing a plurality of polyhedrons. When the touch terminal is in the icon editing mode, the backplane is split into a plurality of hashed polyhedrons.

In all embodiments of the present invention, the main body of the 3D user interface interaction method is a touch terminal, which refers to a terminal device with a touch function, and may include terminal devices such as a computer, a PDA, a tablet computer, an MP4, a smart phone, an electronic book, a game console, and the like. When interaction is carried out, the interaction operation between the touch terminal and the touch terminal can be realized through the operation body. The operation body can be a touch carrier such as a touch pen, a touch glove, a finger of a user and the like.

In all embodiments of the present invention, a desktop icon refers to an icon displayed on a 3D user interface, and includes an application icon, a widget icon (hereinafter, widget icon), or a folder icon. Since a plurality of desktop icons are displayed on the 3D user interface, for convenience of the following description, in all embodiments of the present invention, the desktop icon manipulated by the operation body is defined as a manipulation icon. It will be appreciated that the handle icon may be any one of a plurality of desktop icons.

Next, a use mode and an icon editing mode of the touch terminal will be described through fig. 1 and 2.

As shown in fig. 1 and 2, in the use mode, a backboard 11 and a desktop icon 12 suspended on the backboard 11 are displayed on the 3D user interface displayed by the touch terminal. The back plate 11 is formed by seamlessly splicing a plurality of polyhedrons. At this time, if the touch terminal does not receive the touch operation of the operation body touching the display screen of the touch terminal, or the distance between the operation body and the display screen is greater than 0, the desktop icon 12 protrudes from the display screen for display, so as to form the user interface with the 3D effect. The display protruding from the touch terminal screen in the embodiment of the invention refers to the display effect of the protruding screen formed after the parallax image is incident on human eyes, and the display effect is the subjective visual effect of a user.

In the icon editing mode, the back panel 11 is split into hashed polyhedrons 111 having spacing features between them, which may be, for example, tetrahedrons or hexahedrons. The spacing characteristics between the polyhedrons are characterized by a split identifier, which may be, for example, a split line with depth information, to clearly distinguish the use mode from the icon edit mode in display effect. In the icon editing mode, a plurality of desktop icons on the 3D user interface are recessed into the screen display. Each desktop icon in the plurality of desktop icons contracts and sinks to the polyhedron corresponding to the desktop icon, or the plurality of desktop icons respectively correspond to one polyhedron in the plurality of polyhedrons. Here, the desktop icon shrinks and sinks to the polyhedron corresponding to the desktop icon, which includes two cases: in one case, the desktop icon sinks towards the backboard and suspends in the polyhedron corresponding to the desktop icon; in another case, the desktop icon sinks towards the backboard and sinks to the polyhedron corresponding to the desktop icon.

In the embodiment of the present invention, the area controlled by the operation body includes two situations: when the distance between the operation body and the display screen is larger than 0, or the touch terminal does not receive the touch operation of the operation body touching the display screen of the touch terminal, wherein the area controlled by the operation body refers to the screen area of the operation body vertically corresponding to the screen; when the distance between the operation body and the display screen is equal to 0, or the touch terminal receives a touch operation of the operation body touching the display screen of the touch terminal, the area controlled by the operation body refers to a screen area of the operation body touching the display screen.

According to the 3D user interface interaction method provided by the embodiment of the invention, when the touch operation of the operation body touching the display screen of the touch terminal is not received, because the plurality of desktop icons protrude out of the display screen of the touch terminal for display, the interaction method can adjust the distance of the desktop icons protruding out of the display screen of the touch terminal in the following way, and the specific idea is as follows:

firstly, detecting whether an operation body exists or not; when the operating body is too far away from the touch terminal, the touch terminal cannot sense the presence of the operating body. When the operating body enters a sensing range of the touch terminal, the touch terminal can sense the existence of the operating body.

Secondly, when the touch terminal detects the existence of the operation body, the distance that the control icon protrudes out of the display screen or the distance that the desktop icons protrude out of the display screen can be adjusted according to the distance between the operation body and the display screen of the touch terminal. When the distance that the icons protrude out of the display screen or the distance that the desktop icons protrude out of the display screen is adjusted, the following adjustment modes can be adopted:

when the distance between the operation body and the display screen of the touch terminal is reduced, increasing the distance of the control icon protruding out of the display screen or increasing the distance of the desktop icons protruding out of the display screen;

when the distance between the operation body and the display screen of the touch terminal is increased, increasing the distance of the control icon protruding out of the display screen or increasing the distance of the desktop icons protruding out of the display screen;

when the distance between the operation body and the display screen of the touch terminal is reduced, reducing the distance of the control icon protruding out of the display screen or reducing the distance of the plurality of desktop icons protruding out of the display screen;

when the distance between the operation body and the display screen of the touch terminal is increased, the distance of the control icon protruding out of the display screen is reduced or the distance of the plurality of desktop icons protruding out of the display screen is reduced.

The interaction method according to the embodiment of the present invention will be described below by taking as an example a case where, when the distance between the operation body and the display screen of the touch terminal is decreased or increased, the distance that the manipulation icon protrudes from the display screen is decreased or the distances that the plurality of desktop icons protrude from the display screen are decreased. Other ways of adjusting the distance that the desktop image protrudes from the display screen are similar and will not be described in detail herein.

When the distance between the operation body and the display screen of the touch terminal is reduced or increased, the distance that the control icon protrudes out of the display screen is reduced or the distance that the desktop icons protrude out of the display screen is reduced, which specifically includes: judging whether the distance between the operation body and the display screen is smaller than the maximum distance of the control icon protruding out of the display screen; if the judgment result is yes, the distance that the control icon protrudes out of the display screen or the distance that the desktop icons protrude out of the display screen is adjusted, and the control icon or the desktop icons sink towards the backboard. The following describes embodiments of the present invention in detail by way of specific examples.

Referring to fig. 3, in the 3D user interface interaction method applied to the touch terminal according to the embodiment of the present invention, when the touch operation of the operating body touching the display screen of the touch terminal is not received, since the 3D user interface is protruded from the screen for displaying, the interaction method may include:

step S301, detecting the distance between an operation body and a display screen of the touch terminal;

in the use mode, the 3D user interface is displayed with a backboard on which desktop icons are suspended. And when the touch operation of the operation body touch display screen is not received, the desktop icon protrudes out of the display screen of the touch terminal for display. The operation body may be a touch carrier such as a touch pen, a touch glove, or a hand of a user.

In the embodiment of the invention, the distance between the operating body and the display screen can be detected by touching the floating touch sensor on the terminal. It can be understood that the floating touch sensor has a maximum sensing distance, and when the distance between the operating body and the display screen is greater than the maximum sensing distance of the floating touch sensor, the floating touch sensor cannot sense the distance between the operating body and the display screen. Preferably, the maximum sensing distance of the floating touch sensor is greater than the maximum protruding distance of the desktop icon. The maximum protrusion distance of the desktop icon in the embodiment of the invention refers to the maximum distance of the desktop icon protruding out of the display screen. And in a default state, the desktop icon on the 3D user interface is displayed by default at the maximum projection distance.

Step S303, if the distance between the operation body and the display screen is less than the maximum distance of the control icon protruding out of the display screen, the distance of the control icon protruding out of the display screen or the distance of the plurality of desktop icons protruding out of the display screen is adjusted, so that the control icon or the plurality of desktop icons sink towards the direction of the back plate.

In the embodiment of the present invention, when the distance between the operation body and the display screen detected in step S301 is smaller than the maximum distance at which the manipulation icon protrudes from the display screen, the distance at which the manipulation icon protrudes from the display screen is adjusted, or the distance at which the desktop icons protrude from the display screen is adjusted, and the manipulation icon or the desktop icon sinks toward the back panel, so that the manipulation icon or the desktop icon is pressed by the operation body.

Since it has been described in the foregoing, the desktop icon can be protruded from the screen display of the touch terminal. Therefore, when the desktop icon sink processing operation is performed according to the distance between the operation body and the touch terminal screen, that is, when the distance that the manipulation icon or the desktop icon protrudes from the display screen is adjusted, the manipulation icon or the desktop icon protrudes from the display screen by a distance equal to the distance between the operation body and the display screen, so that the feeling that the manipulation icon or the desktop icon is pressed by the operation body is presented. In general, when the protrusion distance of the control icon or the desktop icon is adjusted, the adjustment can be performed by adjusting the parallax size and the displacement of the control icon or the desktop icon. Specifically, the parallax size and displacement of the control icon or the desktop icon can be adjusted according to the distance between the operation body and the display screen and the position information from the viewer to the display screen. In the process of adjusting the protrusion distance of the control icon or the protrusion distance of the desktop icon, the protrusion distances of all desktop icons displayed on the 3D user interface can be adjusted first, and then the protrusion distances of the control icons controlled by the operation body can be adjusted independently. It can be understood that, in the process of adjusting the protrusion distance of all desktop icons, the sizes of all desktop icons in the X-Y directions can also be adjusted simultaneously. In addition, in the sinking process of the control icon, the operation body touches different positions of the same control icon, and the control icon can shake to different degrees. In addition, in the process of controlling the control icon by touch, there may be a linkage change process between the control icon and the peripheral desktop icons that are not controlled by the operation body, for example, after the control body clicks the control icon, the desktop icons around the control icon may also change, just like ripples caused by water drops. For example, the operation body touches the control icon and in the process of shaking, the peripheral desktop icons are also driven to shake.

According to the embodiment of the invention, the distance between the operation body and the display screen of the touch terminal is detected, and the distance between the operation body and the display screen is smaller than the maximum distance of the control icon protruding out of the display screen, so that the distance of the control icon or the desktop icon protruding out of the display screen is adjusted, and the control icon or the desktop icon sinks towards the direction of the back plate, and the interaction under the use mode of the 3D user interface of the touch terminal is realized.

In the embodiment of the present invention, if the operating body touches the display screen, or the touch terminal receives a touch operation of the operating body touching the display screen of the touch terminal, the operation information included in the touch operation may be further analyzed, the current operation type of the operating body may be determined according to the operation information obtained through the analysis, and an operation corresponding to the determined operation type may be executed.

The operation information obtained according to the received touch analysis may include: and the time information of the contact of the operating body with the display screen and/or the motion trail information of the operating body on the display screen. The operation type of the touch terminal in the use mode may include: one or more of click operation, up-down sliding operation, left-right sliding operation, or long-press operation.

Based on this, when determining the current operation type of the operation body according to the analyzed operation information, the following specific steps may be performed:

when the time that the operation body contacts the display screen is less than a preset first time threshold, further judging the motion track of the operation body on the display screen, if no motion track exists, determining that the current operation type of the operation body is clicking operation, if the motion track exists and the operation is rapid up-down displacement operation, determining that the current operation type of the operation body is up-down sliding operation, and if the motion track exists and the operation is rapid left-right displacement operation, determining that the current operation type of the operation body is left-right sliding operation; or when the time that the operation body contacts the display screen is greater than or equal to a preset first time threshold, determining that the current operation type of the operation body is long-press operation.

After the current operation type of the operation body is determined according to the method, the operation corresponding to the determined operation type can be executed. Even if the same operation type, for example, a click operation, is used, if the manipulation positions of the click operation on the 3D user interface are different, the flow in response to the operation is different. Therefore, before the operation corresponding to the determined operation type is specifically executed, it is necessary to distinguish whether a control icon exists in the controlled area when the operation body touches the display screen, that is, it is necessary to determine whether the control icon exists in the controlled area of the operation body, where the control icon is any one of the plurality of desktop icons.

On one hand, when the operation icon exists in the region operated by the operation body, the executing operation corresponding to the operation type may specifically include:

when the operation type is single click operation, judging the icon type of the operation body control area, if the operation type is an application icon or a micro-control icon, executing to start an application corresponding to the icon, and if the operation type is a folder icon, executing to open a folder; or,

when the operation type is the up-down sliding operation, judging the icon type of the operation area; if the icon is an application icon or a micro-control element icon, executing a corresponding sub-level function of the application icon or the micro-control element icon; if the icon is not the application icon or the micro-control element icon, no response is made; or,

when the operation type is a left-right sliding operation, executing an operation of starting a switching screen; or,

when the operation type is long-press operation, the operation of switching the touch terminal to the icon editing mode is executed

On the other hand, when the region controlled by the operation body does not have the control icon, the operation corresponding to the operation type is executed, which may specifically include:

when the operation type is single click operation, no response is made; or,

when the operation type is the up-down sliding operation, no response is made; or,

when the operation type is a left-right sliding operation, executing screen switching operation; or,

and when the operation type is long press operation, executing the operation of switching the touch terminal to the icon editing mode.

In the embodiment of the present invention, as shown in fig. 4, when the operating body touches the display screen, the distance that the plurality of desktop icons or the control icons protrudes from the display screen is zero. If the control icon targeted by the clicking operation of the operation body is an application icon or a widget icon, after the operation body is loosened, the system highlights the application icon or the widget icon and opens the corresponding application program. At this time, the touch terminal can also enable the application icon or the widget icon to automatically float upwards in the background, so that the distance of the application icon or the widget icon protruding out of the display screen is restored to the initial state, and therefore when a user exits from the application program corresponding to the application icon or the widget icon, the application icon or the widget icon displayed on the 3D user interface protrudes out of the display screen for a certain distance. If the manipulation icon targeted by the clicking operation of the operation body is a folder icon, the system highlights the folder icon and opens the folder after the operation body is released.

Since the folder includes a plurality of application icons, each application icon in the folder is suspended on each polygon in the folder. When the folder icon is clicked, the area where the folder icon is located is enlarged, all polyhedrons and the application icons fly out in sequence, all the polyhedrons are seamlessly spliced together to form a large folder backboard, and all the application icons are suspended on the large folder backboard in sequence. At this time, the area on the screen other than the folder is darkened, and the application icon of the darkened area is in an inoperable state at this time. After the folder icon is opened, when a user clicks a return key, a home key or a darkened non-folder area of the touch terminal, the folder icon is reduced, the expanded application icon is collected, and the system returns to the 3D user interface.

In the embodiment of the present invention, in the case that it is difficult to switch the touch terminal from the use mode to the icon editing mode, the backplane is divided into a plurality of polyhedrons, and each desktop icon is respectively shrunk and sunk in the space between the display screen and the polyhedron corresponding to the desktop icon, that is, each desktop icon corresponds to one of the polyhedrons. The back plate is separated by a certain size, a certain spacing distance is kept between the split polyhedrons, namely, spacing features are arranged among the polyhedrons, so that a vertically and horizontally staggered polyhedral region is formed, the polyhedrons can be tetrahedrons or hexahedrons, the spacing features among the polyhedrons can be characterized by the aid of the splitting identifiers, and the splitting identifiers can be splitting lines with depth information.

It can be understood that, when the back panel is split into a plurality of polyhedrons and the polyhedrons are seamlessly spliced, the following method can be specifically adopted:

the back plate is formed by splicing a plurality of polyhedrons with a three-dimensional spatial position relationship, specifically, a three-dimensional coordinate is established by taking a certain position (for example, the upper left corner) of a screen as an origin of a coordinate system, each polyhedron is respectively provided with a fixed point (for example, a central point) with a fixed position in the three-dimensional coordinate, and when a terminal receives a trigger signal for triggering the contraction or amplification of each polyhedron, each polyhedron contracts to a preset size around the respective fixed point within a preset time, so that cracks with depth information appear between the polyhedrons, further, interval features exist between the polyhedrons, or each polyhedron expands to a preset size around the respective fixed point within the preset time, so that the polyhedrons return to an initial seamless splicing state. For example: during splitting, each polyhedron contracts inwards along a certain position (such as a central position) of the polyhedron, and the contraction with a preset amplitude is completed within a preset time, such as within 0.2 second, and the contraction amplitude reaches 2% of the size of the original polyhedron when the contraction is completed; and when the polyhedron is contracted, the edge of the surface of each polyhedron automatically forms a round chamfer, and the radius of the chamfer is equal to the contraction amplitude at the moment, so that cracks are generated among the polyhedrons. In addition, the contraction process can simulate some physical effects, such as acceleration and deceleration effects, vibration effects, changes of colors and relative positions and the like, so that the effects of increasing fun and feeling are achieved. The contraction time, the contraction amplitude, the chamfer radius, the contraction effect and the like can be set in a user-defined mode in the touch terminal. Obviously, when there are cracks having depth information between the polyhedrons, it is also possible to provide other spacers having different shapes from the polyhedrons in the cracks, thereby playing the same role as a cue for switching between the use mode and the icon editing mode.

As shown in fig. 5 and 6, the polyhedrons are separated from each other by lines having depth information. As can be seen at 303 in fig. 6, the desktop icon may be located between the display screen and the polyhedron corresponding to the desktop icon, the polyhedron is used to carry the desktop icon, the desktop icon and the desktop icon text may be placed in the middle of the polyhedron and aligned in the middle, and the size of the desktop icon is generally smaller than that of the polyhedron. As shown at 302 in fig. 6, when the region where the current polygon is located has no desktop icons, the polygon appears to have bare polygon surfaces.

The following describes a process of changing the position of an application icon when the desktop icon is the application icon when the icon enters the icon editing mode from the use mode, with reference to fig. 7 and 8.

The process of entering the icon editing mode is: in the use mode, after long-time pressing of any position area on the 3D user interface for several seconds, all desktop icons on the 3D user interface sink down to the lower side of the display screen.

It should be noted here that the way in which the application icon sinks may be different depending on the position on the long-press 3D user interface. For example, when the long press is a blank area on the 3D user interface, and the long press is determined to exceed a certain time, the application icons on the 3D user interface together sink below the display screen, and the sinking application icons respectively float on the polyhedrons along with the separation of the back panel into the polyhedrons. When a certain application icon on the 3D user interface is pressed for a long time, the operated application icon begins to sink, when the fact that the long time is pressed for a long time is judged, the rest application icons on the 3D user interface sink to the lower side of the display screen together, meanwhile, the rest application icons are separated into a plurality of polyhedrons along with the back plate, and the sunk application icons are respectively suspended on the polyhedrons. After all application icons are sunk below the display screen, the user can perform an editing operation on any application icon in the icon editing mode at this time. If an application icon is selected by the operation body, the application icon and the corresponding polyhedron float upwards to be close to the back plate, the positions of the other application icons which are not selected by the operation body and the corresponding polyhedrons are kept unchanged, the selected application icon presents a feeling of being sucked by the operation body, but the application icon does not protrude out of the display screen. After the application icon is sucked up by the operation body, the operation body can slide on the display screen at will. When the operation body selects a certain position to release and release the application icon, the application icon sinks to restore to the initial state when the icon editing mode is entered.

In the embodiment of the invention, a user can exit the icon editing mode and return to the use mode by clicking the HOME key on the touch terminal, for example, the terminal.

In the embodiment of the present invention, in the use mode, in order to make the 3D effect better, a projection of the desktop icon 12 is further displayed on the 3D user interface, and the size or shape of the projection is changed according to time and/or date and by combining with a preset change model.

In generating the projection, it is equivalent to placing a set of parallel or point light sources at the current time to illuminate the user interface of the touch terminal, so as to generate a projection corresponding to the current time, and the user can determine the current time accordingly, as shown in fig. 9A, 9B, and 9C, which illustrate the variation of the projection of several times, wherein fig. 9A is 12 am, fig. 9B is 13 pm and fig. 9C is 3 pm. The time may be a time displayed on the touch terminal or a network time. The desktop icons on the user interface have different projection changes along with the change of time, so that the expression forms of the desktop icons are rich and diversified, and the interestingness of the 3D user interface in the process of displaying the desktop icons is improved.

According to the embodiment of the invention, the distance between the operation body and the display screen of the touch terminal is detected, and when the distance between the operation body and the display screen is smaller than the maximum distance of the control icon protruding out of the display screen, the distance of the control icon protruding out of the display screen or the distance of the plurality of desktop icons protruding out of the display screen is adjusted, and the control icon or the plurality of desktop icons sink towards the direction of the back plate, so that the interaction of the 3D user interface in the use mode of the touch terminal is realized, meanwhile, the operation type of the operation body is determined by detecting the operation action of the operation body in the use mode, and the operation corresponding to the operation type is executed, so that the interaction mode of the user interface is enriched, the user control experience is improved, and the usability, the flexibility and the enjoyment of the user interface are greatly enhanced.

The following further describes a flow of a user interface interaction method of the touch terminal in the use mode with reference to fig. 10, as shown in fig. 10, including the following steps:

step S10, judging whether a touch operation of the operation body touch control touch terminal display screen is received;

when the touch operation of the operating body touching the display screen of the terminal is not received and the distance between the operating body and the display screen is not 0, the process proceeds to step S11, and when the touch operation of the operating body touching the display screen of the terminal is received, that is, when the distance between the operating body and the display screen is determined to be 0, the process proceeds to step S14.

Step S11, detecting the distance between the operation body and the display screen;

in the step, the distance between the operation body and the display screen can be detected through a floating touch sensor on the touch terminal; it can be understood that the floating touch sensor has a maximum sensing distance, and when the distance between the operating body and the display screen is greater than the maximum sensing distance of the floating touch sensor, the floating touch sensor cannot sense the distance between the operating body and the display screen. Preferably, the maximum sensing distance of the floating touch sensor is greater than the maximum protruding distance of the icon.

Step S12, determining whether the distance detected in step S11 is less than the maximum distance of the manipulation icon protruding from the display screen;

and in the default state, the control icon is displayed in a default mode with the maximum protruding distance. And when the distance between the operation body and the display screen is greater than the maximum distance of the control icon protruding out of the display screen, no response is given, and the process is exited.

Step S13, when the distance between the operation body and the display screen is determined to be less than the maximum distance that the manipulation icon protrudes from the display screen, the distance that the manipulation icon protrudes from the display screen is adjusted to make the manipulation icon sink to present the feeling that the manipulation icon is pressed by the operation body.

In this step, when the protruding distance of the control icon is adjusted, the control icon is usually protruded to the display screen by a distance equal to the distance between the operation body and the display screen, so as to present the feeling that the control icon is pressed down by the operation body. In general, the protrusion distance of the control icon is adjusted by adjusting the parallax size and the displacement of the control icon. Specifically, the parallax size and the displacement of the manipulation icon can be adjusted according to the distance between the operation body and the display screen and the position information from the viewer to the display screen. After step S13 is performed, the process returns to step S10.

Step S14, analyzing the operation information contained in the touch operation, and determining the current operation type of the operation body according to the analyzed operation information;

in executing step S14, the following cases are specifically classified:

when the time for the operating body to contact the display screen is less than a preset first time threshold T1, judging the motion track of the operating body on the display screen, and if no motion track exists, judging that the operation is a single-click operation; if the operation is rapid up-down displacement operation, the operation is judged to be up-down sliding operation; if the operation is rapid left-right displacement operation, the operation is judged to be left-right sliding operation;

and when the time for which the operating body contacts the display screen is greater than a preset first time threshold T1, judging that the operation is the long-press operation.

Step S15, judging whether a control icon exists in the control area of the operation body;

in this step, if there is a handle icon, the process proceeds to step S16, and if there is no handle icon, the process proceeds to step S17.

And step S16, executing corresponding operation according to the judgment results of the step S14 and the step S15.

Specifically, if the operation type of the operation body is determined to be a single-click operation, then corresponding operations are executed according to the type of the control icon, for example, if the operation type is an APP icon or a widget icon, the application corresponding to the icon is started, and if the operation type is a folder icon, a folder is opened.

Specifically, when the operation type of the operation body is judged to be the up-down sliding operation, corresponding operation is executed according to the type of the control icon, for example, if the operation type is the APP icon or the widget icon, a secondary application behavior of starting the other side of the current icon is executed, and if the operation type is the folder icon, no response is given; and executing the operation corresponding to the determined operation type.

Specifically, when the operation type of the operation body is judged to be the left-right sliding operation, the screen switching operation is started at the moment.

Specifically, when the determined operation type is a long press operation, the operation of switching the touch terminal from the use mode to the icon editing mode is executed.

Step S17, executing the operation corresponding to the determined operation type;

in executing step S17, the following cases are specifically classified:

when the time for the operating body to contact the display screen is less than a preset first time threshold T1, judging the motion track of the operating body on the display screen, if no motion track exists, judging that the operation is a click behavior, and not making any response; if the operation is rapid up-down displacement operation, the operation is judged to be up-down sliding operation, and no response is made at the moment; if the operation is rapid left-right displacement operation, judging that the operation is left-right sliding operation, and starting screen switching operation behavior; and when the time for the operator to contact the display screen is greater than a preset first time threshold T1, judging that the icon is long-time pressing operation and entering an icon editing mode.

In the embodiment of the present invention, when the touch terminal performs the screen switching operation, there may be three ways, which will be described below:

the first mode is as follows:

as shown in fig. 11, when the operation body is operated close to the desktop icon, the desktop icon starts to sink as the operation body gradually approaches the screen, just like being pressed; after the desktop icons sink to the back plate, the operation body presses the screen at the moment, and in the preset time, the operation body slides left and right after pressing the screen, the system judges that the operation type of the current operation body is screen cutting operation, at the moment, all desktop icons of the whole screen sink, all polyhedrons shrink and split, wherein the splitting among the polyhedrons is represented by a splitting line with depth, when the operation body leaves the screen, the whole operation is judged to be finished, all polyhedrons are spliced seamlessly, and the desktop icons float and protrude out of the screen.

Wherein, whether the operation body carries out the in-process that slides from side to side, whether carry out the action of cutting the screen, there are three kinds of schemes to judge. One is by judging the acceleration of the operation body, the other is by judging the speed of the operation body, and the other is by judging the extent of the left-right sliding of the operation body.

In the first scheme, an acceleration sensor can sense the sliding acceleration of an operating body, when the acceleration reaches a preset threshold value a, because the acceleration is high, the whole multi-body surface (all split multi-body surfaces can form a large multi-body surface) can rotate for a certain angle and then bounce back, and in the bouncing back process, all the multi-body surfaces are seamlessly spliced, and desktop icons float upwards to protrude out of a screen; when the acceleration reaches a preset threshold value b, switching the whole screen, seamlessly splicing all polyhedrons, and floating and protruding the desktop icons out of the screen; when the acceleration is smaller than b, the whole screen is bounced back after rotating a certain angle, but the screen cutting operation is not realized. Where 0< b < a.

The second scheme, which determines whether to switch by judging the speed of the operating body, is: when the speed reaches a preset speed V1, the whole polyhedron (all split polyhedrons can form a large polyhedron) can rotate for a certain angle and then bounce back due to the fact that the speed is high, in the bouncing back process, all polyhedrons are spliced seamlessly, and desktop icons float upwards to protrude out of a screen; when the speed reaches a preset speed V2, switching the whole screen, seamlessly splicing all polyhedrons, and floating and protruding the desktop icons out of the screen; when the speed is lower than V2, the whole screen is bounced back after rotating a certain angle, but the screen cutting operation is not realized. Wherein 0< V2< V1.

In the third scheme, the scheme for determining whether to switch by judging the left-right sliding amplitude of the operating body is as follows: when the sliding amplitude of the operation body reaches a preset amplitude S1, the whole polyhedron (all split polyhedron blocks form a large polyhedron) can rotate for a certain angle and then bounce back due to the large amplitude, and in the bouncing back process, all the polyhedrons are seamlessly spliced, and the desktop icons float upwards to protrude out of the screen; when the amplitude reaches the preset S2, switching the whole screen, seamlessly splicing all polyhedrons, and floating and protruding the desktop icons out of the screen; when the amplitude is smaller than S2, the whole screen is bounced back after rotating a certain angle, but the screen cutting operation is not realized. Wherein 0< S2< S1.

The three determination modes can be only one or two or three selected to determine whether to trigger the screen switching operation.

The second way is:

as shown in fig. 12, the difference from the first method is that: in the screen cutting process, each polyhedron rotates respectively, when the screen cutting is successful, each polyhedron rotates to a preset surface, the screen cutting operation is completed, and when the screen cutting is unsuccessful, each desktop icon can rebound to the initial surface. Wherein whether each polygon rotates by one face or two or three faces indicates switching to the next screen, and the speed of rotation can be implemented by system settings.

The third mode is that:

as shown in fig. 13, the third mode differs from the first mode in that: when the screen cutting operation is successful, the desktop icons rotate from the side or fly in without rotating, previous desktop icons at corresponding positions are replaced step by step, and when the operation body leaves the screen, the whole screen of desktop icons floats upwards, the polyhedron expands, and the desktop icons are spliced together seamlessly and gradually return to the default non-operation state; and when the screen switching operation is unsuccessful, the flying-in desktop icon flies out again, and the previous desktop icon returns to the previous position again.

When the screen is successfully cut, the previous desktop icons gradually fade back and disappear, and the flying desktop icons correspondingly enter the corresponding polyhedrons; and when the desktop icons are unsuccessful, the flying desktop icons are withdrawn, the previous desktop icons gradually appear on the corresponding polyhedrons, the polyhedrons are spliced seamlessly, and the desktop icons float upwards.

According to the embodiment of the invention, the distance between the operation body and the display screen of the touch terminal is detected, and when the distance between the operation body and the display screen is smaller than the maximum distance of the control icon protruding out of the display screen, the distance of the control icon or the desktop icon protruding out of the display screen is adjusted, and the control icon or the desktop icon sinks towards the direction of the back plate, so that the interaction of a 3D user interface in a use mode of the touch terminal is realized, meanwhile, the operation type of the operation body is determined by detecting the operation action of the operation body in the use mode, and the operation corresponding to the operation type is executed, so that the interaction mode of the user interface is enriched, the user control experience is improved, and the usability, the flexibility and the enjoyment of the user interface are greatly enhanced.

The 3D interface interaction method applied to the touch terminal is described in detail with reference to fig. 1 to 13, and an interaction process of the touch terminal using the interaction method will be described with reference to fig. 14 to 15. It is understood that, in the following description, when describing the structural composition and the working principle of the touch terminal, the related operation manner similar to the interaction method will not be described in detail.

FIG. 14 is a touch terminal including a usage mode according to an embodiment of the present invention; in a use mode, a backboard and a plurality of desktop icons suspended on the backboard are displayed on a 3D user interface of the touch terminal, and when the touch operation of the operation body is not received, the desktop icons protrude out of a display screen of the touch terminal;

the touch terminal includes: a detection module 140 and a processing module 141.

A detection module 140, configured to detect whether an operation body exists;

and the processing module 141 is configured to adjust a distance that the control icon protrudes out of the display screen or a distance that the desktop icons protrude out of the display screen according to a distance between the operation body and the display screen of the touch terminal when the detection result of the detection module 140 is yes.

According to the touch terminal provided by the embodiment of the invention, when the touch operation of the operation body touching the display screen of the touch terminal is not received, because the plurality of desktop icons protrude out of the display screen of the touch terminal for display, the touch terminal needs to judge whether the operation body exists in the sensing area, and when the operation body is sensed, the distance of the desktop icons protruding out of the display screen of the touch terminal is adjusted according to the distance between the operation body and the display screen. The specific idea is as follows:

firstly, the detection module 140 detects whether an operation body exists; when the operating body is too far away from the touch terminal, the detection module 140 cannot sense the presence of the operating body. When the operating body enters a sensing range of the touch terminal, the detection module 140 can sense the presence of the operating body.

Next, when the detecting module 140 detects the existence of the operation body, the processing module 141 may adjust a distance that the manipulation icon protrudes from the display screen or a distance that the desktop icons protrude from the display screen according to a distance between the operation body and the display screen of the touch terminal. When adjusting the distance that the icon protrudes from the display screen or the distance that the desktop icons protrude from the display screen, the processing module 141 may adopt the following adjustment modes:

The touch terminal according to the embodiment of the present invention will be described below by taking as an example that the processing module 141 reduces the distance that the manipulation icon protrudes from the display screen or reduces the distance that the plurality of desktop icons protrude from the display screen when the distance between the operation body and the display screen of the touch terminal is reduced or increased. Other ways of adjusting the distance that the desktop image protrudes from the display screen are similar and will not be described in detail herein.

The processing module 141 includes: a judging unit and a processing unit;

if the judgment result is yes, namely whether the distance between the operation body and the display screen is smaller than the maximum distance of the control icon protruding out of the display screen or not, the distance of the control icon protruding out of the display screen or the distance of the plurality of desktop icons protruding out of the display screen is adjusted, and the control icon or the plurality of desktop icons sink towards the direction of the back plate.

In the embodiment of the present invention, further, the detecting module 140 is further configured to detect whether a touch operation of the operating body touching the display screen of the touch terminal is received;

the processing module 141 is further configured to: when the detection module 140 receives a touch operation of an operator touching the display screen of the touch terminal, the detection module 140 analyzes operation information included in the touch operation received by the detection module 140, determines a current operation type of the operator according to the analyzed operation information, and executes an operation corresponding to the determined operation type.

In an embodiment of the present invention, the operation acts include: and the time information of the contact of the operating body with the display screen and/or the motion trail information of the operating body on the display screen. The operation types include: one or more of click operation, up-down sliding operation, left-right sliding operation, or long-press operation.

Further, when determining the operation type according to the analyzed operation information, the processing module 141 specifically determines as follows:

when the time that the operation body contacts the display screen is smaller than a preset first time threshold, further judging the motion track of the operation body on the display screen, and if no motion track exists, determining the current operation type clicking operation of the operation body; if the motion track exists and the operation is rapid vertical displacement operation, determining the current operation type of the operation body to be vertical sliding operation, and if the motion track exists and the operation is rapid horizontal displacement operation, determining the current operation type of the operation body to be horizontal sliding operation; or when the time that the operation body contacts the display screen is greater than or equal to a preset first time threshold, determining that the current operation type of the operation body is long-press operation.

Further, the touch terminal further includes: the determining module 142 is further configured to determine whether a control icon exists in a region controlled by the operation body when the detecting module 140 receives a touch operation performed by the operation body to touch the display screen of the touch terminal, where the control icon is any one of a plurality of desktop icons displayed on the 3D user interface.

The processing module 142 may specifically execute an operation corresponding to the corresponding operation type according to the determination result of the determining module 142, and specifically includes two cases:

in the first case: when the determining module 142 determines that the control icon exists in the region controlled by the operation body, the processing module 141 executes an operation corresponding to the operation type, including:

specifically, if the operation type of the operation body is a single-click operation, then corresponding operations are executed according to the type of the control icon, for example, if the operation type is an APP icon or a widget icon, the application corresponding to the icon is started, and if the operation type is a folder icon, the folder is opened.

Specifically, when the operation type of the operation body is a vertical sliding operation, corresponding operations are executed according to the type of the control icon, for example, if the operation type is an APP icon or a widget icon, a secondary application behavior of starting the other side of the current icon is executed, and if the operation type is a folder icon, no response is given; and executing the operation corresponding to the determined operation type.

Specifically, when the operation type of the operation body is a left-right sliding operation, the screen switching operation is started at this time.

In the second case: when the manipulation icon does not exist in the region manipulated by the manipulation object, the processing module 141 executes an operation corresponding to the manipulation type, which may include:

when the operation type is single click operation, no response is made; or,

and when the operation type is long-press operation, executing the operation of switching the touch terminal to the icon editing mode.

Optionally, the touch terminal of the embodiment of the present invention further includes:

and a projection module (not shown in the figure) for changing the projection of the desktop icon on the 3D user interface according to the change of time in the use mode. When the touch terminal is in a use mode, the projection of the desktop icon on the 3D user interface changes according to the change of time, namely, a group of parallel or point light sources are placed at the position of the current time to irradiate the user interface of the touch terminal, so that the projection corresponding to the current time is generated, a user can judge the current time according to the projection, and the application icon on the user interface has different projection changes along with the change of the time, so that the expression form of the application icon is rich and diversified, and the interest of the user interface in displaying the application icon is improved.

It should be noted that, because the contents of information interaction, execution process, and the like between the modules of the touch terminal in the embodiment of the present invention are based on the same concept as the method embodiment of the present invention, the specific contents in the method embodiment are also applicable. The respective modules in the embodiments of the present invention can be implemented as separate hardware or software, and the combination of the functions of the respective units can be implemented using separate hardware or software as necessary.

According to the touch terminal, the distance of the control icon protruding out of the display screen or the distance of the desktop icons protruding out of the display screen is adjusted according to the distance between the detection operation body and the display screen of the touch terminal, and interaction of a 3D user interface in a use mode of the touch terminal is achieved. Meanwhile, the operation type of the operation body is determined by detecting the operation action of the operation body in the use mode, and the operation corresponding to the operation type is executed, so that the interaction mode of the user interface is enriched, the user control experience is promoted, and the usability, flexibility and fun of the user interface are greatly enhanced.

Fig. 15 is a schematic diagram of a touch terminal according to an embodiment of the present invention, including: display screen 151, central processing unit 152, wherein:

a display screen 151 for displaying a 3D user interface and for receiving a touch operation of an operator on the touch terminal; the touch terminal comprises a use mode; in the use mode, a backboard and a plurality of desktop icons suspended on the backboard are displayed on the 3D user interface, and when the display 51 screen does not receive touch operation of the operation body touch display screen, the desktop icons protrude out of the display screen 151 for display;

a central processing unit 152, configured to detect whether an operating body exists when the display screen does not receive a touch operation of the operating body on the display screen 151; if the detection result is yes, adjusting the distance of the control icon protruding out of the display screen or the distance of the desktop icons protruding out of the display screen according to the distance between the operation body and the display screen of the touch terminal;

the control icon is any one of desktop icons on a backboard displayed on the 3D user interface.

first, the cpu 152 detects whether an operator exists; when the operating body is too far from the touch terminal, the presence of the operating body cannot be sensed. When the operating body enters a sensing range of the touch terminal, the presence of the operating body can be sensed.

Secondly, when the existence of the operation body is detected, the central processing unit 152 may adjust the distance that the manipulation icon protrudes from the display screen or the distance that the desktop icons protrude from the display screen according to the distance between the operation body and the display screen of the touch terminal. When the central processing unit 152 adjusts the distance that the icons protrude from the display screen or the distance that the desktop icons protrude from the display screen, the following adjustment methods may be adopted:

when the distance between the operation body and the display screen of the touch terminal is reduced, increasing the distance of the control icon protruding out of the display screen or increasing the distance of the desktop icons protruding out of the display screen; when the distance between the operation body and the display screen of the touch terminal is increased, increasing the distance of the control icon protruding out of the display screen or increasing the distance of the desktop icons protruding out of the display screen; when the distance between the operation body and the display screen of the touch terminal is reduced, reducing the distance of the control icon protruding out of the display screen or reducing the distance of the plurality of desktop icons protruding out of the display screen; when the distance between the operation body and the display screen of the touch terminal is increased, the distance of the control icon protruding out of the display screen is reduced or the distance of the plurality of desktop icons protruding out of the display screen is reduced.

In the embodiment of the present invention, the operation executed by the processor may be implemented as a program or code, and when the operation needs to be executed, the program or code is called into the processor to execute processing.

According to the invention, when the touch terminal detects the existence of the operation body, the distance that the operation icon protrudes out of the display screen or the distance that the plurality of desktop icons protrude out of the display screen is adjusted according to the distance between the detection operation body and the display screen of the touch terminal, so that the interaction of the 3D user interface in the use mode of the touch terminal is realized, meanwhile, the operation type of the operation body is determined by detecting the operation action of the operation body in the use mode, and the operation corresponding to the operation type is executed, so that the interaction mode of the user interface is enriched, the user operation experience is promoted, and the usability, flexibility and fun of the user interface are greatly enhanced.

The above description is only an embodiment of the present invention, and not intended to limit the scope of the present invention, and all modifications of equivalent structures and equivalent processes performed by the present specification and drawings, or directly or indirectly applied to other related technical fields, are included in the scope of the present invention.

Claims

1. A3D user interface interaction method applied to a touch terminal is characterized in that the touch terminal comprises a use mode; in a use mode, a backboard and a plurality of desktop icons suspended on the backboard are displayed on the 3D user interface, when a touch operation of an operating body touching the display screen of the touch terminal is not received, the desktop icons protrude out of the display screen of the touch terminal for display by a maximum protruding distance, and the maximum protruding distance is the maximum distance of the desktop icons protruding out of the display screen; the method comprises the following steps:

detecting whether an operation body exists or not;

if the detection result is yes, adjusting the distance of the control icon protruding out of the display screen or the distance of the plurality of desktop icons protruding out of the display screen according to the distance between the operation body and the display screen of the touch terminal;

the control icon is any one of a plurality of desktop icons displayed by the 3D user interface;

wherein, the adjusting the distance that the control icon protrudes from the display screen or the distance that the desktop icons protrude from the display screen according to the distance between the operation body and the display screen of the touch terminal includes:

when the distance between the operation body and a display screen of the touch terminal is reduced, reducing the distance of the control icon protruding out of the display screen or reducing the distance of the plurality of desktop icons protruding out of the display screen;

wherein, when the distance between the operation body and the display screen of the touch terminal is reduced, reducing the distance that the control icon protrudes from the display screen or reducing the distance that the desktop icons protrude from the display screen includes:

if the judgment result is yes, adjusting the distance that the control icon protrudes out of the display screen or the distance that the plurality of desktop icons protrude out of the display screen, enabling the distance that the control icon or the desktop icon protrudes out of the display screen to be equal to the distance between the operation body and the display screen, and enabling the control icon or the plurality of desktop icons to sink towards the backboard.

2. The method of claim 1, further comprising:

3. The method of claim 2, wherein the operational information comprises:

4. The method of claim 3, wherein the operation types comprise:

5. The method according to claim 4, wherein the determining a current operation type of the operation body according to the analyzed operation information specifically includes:

and when the time that the operating body contacts the display screen is greater than or equal to a preset first time threshold, determining that the current operation type of the operating body is long-press operation.

6. The method according to claim 5, wherein before the executing the operation corresponding to the determined operation type, the method further comprises:

7. The method according to claim 6, wherein when the operation icon exists in the region operated by the operation body, the executing of the operation corresponding to the determined operation type includes:

when the determined operation type is the clicking operation, judging the icon type of the control icon; if the icon is the application icon or the micro-control icon, executing the operation of starting the application corresponding to the icon, and if the icon is the folder icon, executing the operation of opening the folder;

when the determined operation type is the up-down sliding operation, judging the icon type of the control icon; if the icon is the application icon or the micro-control element icon, executing the operation of starting the sub-level function corresponding to the application icon or the micro-control element icon; if the icon is the folder icon, no response is made;

when the determined operation type is a left-right sliding operation, executing an operation of starting a switching screen;

8. The method according to claim 7, wherein when no manipulation icon exists in the region manipulated by the manipulation object, the performing operation corresponding to the determined operation type includes:

when the determined operation type is single click operation or up-down sliding operation, no response is made;

and when the determined operation type is the left-right sliding operation, executing the operation of switching the screen.

9. The method according to claim 1, wherein the touch terminal further comprises an icon editing mode; in an icon editing mode, the backboard is split into a plurality of polyhedrons, the polyhedrons have a spacing feature therebetween, and the spacing feature is a spacing distance; the desktop icons respectively correspond to one of the polyhedrons, and each desktop icon is located between the display screen and the polyhedron corresponding to the desktop icon.

10. The method according to claim 9, wherein the polyhedron is a tetrahedron or hexahedron.

11. The method of claim 9, wherein in an icon editing mode, the spacing between the plurality of polyhedrons is characterized by a split line with depth information.

12. The method according to claim 7 or 8, wherein in the icon editing mode, the backboard is split into a plurality of polyhedrons with a spacing feature therebetween, wherein the spacing feature is a spacing distance; the desktop icons respectively correspond to one of the polyhedrons, and each desktop icon is located between the display screen and the polyhedron corresponding to the desktop icon.

13. The method of any one of claims 1 to 8, further comprising:

14. A touch terminal, characterized in that the touch terminal comprises a usage mode; in a use mode, a backboard and a plurality of desktop icons suspended on the backboard are displayed on a 3D user interface of the touch terminal; when the touch operation of an operation body is not received, the desktop icon protrudes out of the display screen for display by a maximum protruding distance, and the maximum protruding distance is the maximum distance of the desktop icon protruding out of the display screen; the touch terminal includes:

the processing module is used for adjusting the distance of the control icon protruding out of the display screen or the distance of the plurality of desktop icons protruding out of the display screen according to the distance between the operation body and the display screen of the touch terminal when the detection result of the detection module is positive;

the processing module is specifically configured to: when the distance between the operation body and a display screen of the touch terminal is reduced, reducing the distance of the control icon protruding out of the display screen or reducing the distance of the plurality of desktop icons protruding out of the display screen;

the processing module comprises: a judging unit and a processing unit;

and the processing unit is used for adjusting the distance that the control icon protrudes out of the display screen or the distance that the plurality of desktop icons protrude out of the display screen if the judgment result is yes, so that the distance that the control icon or the desktop icon protrudes out of the display screen is equal to the distance between the operation body and the display screen, and the control icon or the plurality of desktop icons sink towards the direction of the backboard.

15. The touch terminal according to claim 14, wherein the detecting module is further configured to detect whether a touch operation of the operating body touching the display screen of the touch terminal is received;

16. The touch terminal of claim 15, wherein the operation information comprises:

17. The touch terminal of claim 16, wherein the operation types include:

18. The touch terminal of claim 17, wherein the processing module is specifically configured to:

19. The touch terminal according to claim 15, further comprising a determining module, configured to determine whether a manipulation icon exists in a region manipulated by an operation body when the detecting module receives a touch operation of the operation body touching a display screen of the touch terminal, where the manipulation icon is any one of the desktop icons;

the processing module is further configured to execute an operation corresponding to the determined operation type when the judging module judges that the control icon exists in the region controlled by the operation body.

20. A touch terminal, comprising: a display screen and a central processing unit,

the display screen is used for displaying a 3D user interface and receiving touch operation of an operation body on the display screen of the touch terminal; the touch terminal comprises a use mode; in a use mode, a backboard and a plurality of desktop icons suspended on the backboard are displayed on the 3D user interface, when the display screen does not receive touch operation of the operating body for touching the display screen, the desktop icons protrude out of the display screen for display by a maximum protruding distance, and the maximum protruding distance is the maximum distance of the desktop icons protruding out of the display screen;

the central processing unit is used for detecting whether an operation body exists or not when the display screen does not receive the touch operation of the operation body for touching the display screen; if the detection result is yes, adjusting the distance of the control icon protruding out of the display screen or the distance of the plurality of desktop icons protruding out of the display screen according to the distance between the operation body and the display screen of the touch terminal;