WO2023221517A1

WO2023221517A1 - Navigation control method and apparatus, terminal device, and storage medium

Info

Publication number: WO2023221517A1
Application number: PCT/CN2022/142413
Authority: WO
Inventors: 张荣晓; 殷开荣; 关伟豪; 孙飘宇
Original assignee: Oppo广东移动通信有限公司
Priority date: 2022-05-20
Filing date: 2022-12-27
Publication date: 2023-11-23
Also published as: CN114860143A

Abstract

A navigation control method and apparatus, a terminal device, and a storage medium. A first terminal device may have a communication connection with a second terminal device, the first terminal device being provided with a projection window, and the projection window being configured to display a projected interface corresponding to a screen interface of the second terminal device. The navigation control method applied to a first terminal device may comprise: in response to a gesture control operation on a projected interface, sending gesture navigation information corresponding to the gesture control operation to a second terminal device, so that the second terminal device, according to the gesture navigation information, executes an interface navigation operation corresponding to the gesture navigation information on a screen interface.

Description

导航控制方法及装置、终端设备、存储介质Navigation control method and device, terminal equipment, storage medium

本申请要求于2022年5月20日提交、申请号为202210558434.8、发明名称为“导航控制方法及装置、终端设备、存储介质”的中国专利申请的优先权，其全部内容通过引用结合在本申请中。This application claims priority to the Chinese patent application submitted on May 20, 2022, with the application number 202210558434.8 and the invention title "Navigation control method and device, terminal equipment, storage medium", the entire content of which is incorporated into this application by reference. middle.

技术领域Technical field

本申请涉及多设备协同技术领域，尤其涉及一种导航控制方法及装置、终端设备、存储介质。The present application relates to the field of multi-device collaboration technology, and in particular, to a navigation control method and device, terminal equipment, and storage media.

背景技术Background technique

当前，随着人均设备数量的逐渐增多，用户使用多个终端设备(例如电脑、平板电脑、智能可穿戴设备、智能手机等)进行协同工作的需求也大大增加。然而，在实践中发现，多设备之间的协同工作往往存在操作困难，效率低下的问题。Currently, as the number of devices per capita gradually increases, the need for users to use multiple terminal devices (such as computers, tablets, smart wearable devices, smartphones, etc.) for collaborative work has also greatly increased. However, in practice, it is found that collaborative work between multiple devices often suffers from operational difficulties and low efficiency.

发明内容Contents of the invention

本申请实施例公开了一种导航控制方法及装置、终端设备、存储介质。The embodiments of the present application disclose a navigation control method and device, terminal equipment, and storage medium.

本申请实施例第一方面公开一种导航控制方法，应用于第一终端设备，所述第一终端设备与第二终端设备通信连接，且所述第一终端设备设有投影窗口，所述投影窗口用于显示与所述第二终端设备的屏幕界面对应的投影界面，所述方法包括：The first aspect of the embodiment of the present application discloses a navigation control method, which is applied to a first terminal device, the first terminal device is communicatively connected to a second terminal device, and the first terminal device is provided with a projection window, and the projection window The window is used to display a projection interface corresponding to the screen interface of the second terminal device, and the method includes:

响应于针对所述投影界面的手势控制操作，向所述第二终端设备发送与所述手势控制操作对应的手势导航信息，以使所述第二终端设备根据所述手势导航信息，对所述屏幕界面执行与所述手势导航信息对应的界面导航操作。In response to a gesture control operation on the projection interface, gesture navigation information corresponding to the gesture control operation is sent to the second terminal device, so that the second terminal device performs the navigation on the projection interface according to the gesture navigation information. The screen interface performs interface navigation operations corresponding to the gesture navigation information.

本申请实施例第二方面公开另一种导航控制方法，应用于第二终端设备，所述第二终端设备与第一终端设备通信连接，且所述第一终端设备设有投影窗口，所述第二终端设备的屏幕界面投影于所述投影窗口，得到所述投影窗口上对应显示的投影界面，所述方法包括：The second aspect of the embodiment of the present application discloses another navigation control method, which is applied to a second terminal device. The second terminal device is communicatively connected to the first terminal device, and the first terminal device is provided with a projection window. The screen interface of the second terminal device is projected on the projection window to obtain a corresponding projection interface displayed on the projection window. The method includes:

接收所述第一终端设备发送的手势导航信息，其中，所述手势导航信息是由所述第一终端设备响应于针对所述投影界面的手势控制操作，向所述第二终端设备发送的与所述手势控制操作对应的手势导航信息；Receive gesture navigation information sent by the first terminal device, wherein the gesture navigation information is sent by the first terminal device to the second terminal device in response to a gesture control operation for the projection interface. Gesture navigation information corresponding to the gesture control operation;

根据所述手势导航信息，对所述屏幕界面执行与所述手势导航信息对应的界面导航操作。According to the gesture navigation information, an interface navigation operation corresponding to the gesture navigation information is performed on the screen interface.

本申请实施例第三方面公开一种导航控制装置，应用于第一终端设备，所述第一终端设备与第二终端设备通信连接，且所述第一终端设备设有投影窗口，所述投影窗口用于显示与所述第二终端设备的屏幕界面对应的投影界面，所述导航控制装置包括：The third aspect of the embodiment of the present application discloses a navigation control device, which is applied to a first terminal device, the first terminal device is communicatively connected to a second terminal device, and the first terminal device is provided with a projection window, and the projection window The window is used to display a projection interface corresponding to the screen interface of the second terminal device, and the navigation control device includes:

发送单元，用于响应于针对所述投影界面的手势控制操作，向所述第二终端设备发送与所述手势控制操作对应的手势导航信息，以使所述第二终端设备根据所述手势导航信息，对所述屏幕界面执行与所述手势导航信息对应的界面导航操作。A sending unit configured to, in response to a gesture control operation on the projection interface, send gesture navigation information corresponding to the gesture control operation to the second terminal device, so that the second terminal device navigates according to the gesture information, and perform an interface navigation operation corresponding to the gesture navigation information on the screen interface.

本申请实施例第四方面公开另一种导航控制装置，应用于第二终端设备，所述第二终端设备与第一终端设备通信连接，且所述第一终端设备设有投影窗口，所述第二终端设备的屏幕界面投影于所述投影窗口，得到所述投影窗口上对应显示的投影界面，所述导航控制装置包括：The fourth aspect of the embodiment of the present application discloses another navigation control device, which is applied to a second terminal device. The second terminal device is communicatively connected to the first terminal device, and the first terminal device is provided with a projection window. The screen interface of the second terminal device is projected on the projection window to obtain the corresponding projection interface displayed on the projection window. The navigation control device includes:

接收单元，用于接收所述第一终端设备发送的手势导航信息，其中，所述手势导航信息是由所述第一终端设备响应于针对所述投影界面的手势控制操作，向所述第二终端设备发送的与所述手势控制操作对应的手势导航信息；A receiving unit configured to receive gesture navigation information sent by the first terminal device, wherein the gesture navigation information is sent by the first terminal device to the second terminal device in response to a gesture control operation on the projection interface. Gesture navigation information corresponding to the gesture control operation sent by the terminal device;

导航执行单元，用于根据所述手势导航信息，对所述屏幕界面执行与所述手势导航信息对应的界面导航操作。A navigation execution unit, configured to execute an interface navigation operation corresponding to the gesture navigation information on the screen interface according to the gesture navigation information.

本申请实施例第五方面公开了一种终端设备，包括存储器及处理器，所述存储器中存储有计算机程序，所述计算机程序被所述处理器执行时，使得所述处理器实现如本申请实施例第一方面或第二方面公开的任意一种导航控制方法中的全部或部分步骤。The fifth aspect of the embodiment of the present application discloses a terminal device, which includes a memory and a processor. A computer program is stored in the memory. When the computer program is executed by the processor, the processor implements the application as described in the present application. All or part of the steps in any navigation control method disclosed in the first or second aspect of the embodiment.

本申请实施例第六方面公开了一种计算机可读存储介质，其存储计算机程序，其中，所述计算机程序被处理器执行时实现如本申请实施例第一方面或第二方面公开的任意一种导航控制方法中的全部或部分步骤。The sixth aspect of the embodiment of the present application discloses a computer-readable storage medium that stores a computer program, wherein when the computer program is executed by a processor, any one of the methods disclosed in the first aspect or the second aspect of the embodiment of the present application is implemented. All or part of the steps in a navigation control method.

本申请的一个或多个实施例的细节在下面的附图和描述中提出。本申请的其它特征和有益效果将从说明书、附图以及权利要求书中体现。The details of one or more embodiments of the application are set forth in the accompanying drawings and the description below. Other features and beneficial effects of the application will be apparent from the description, drawings and claims.

附图说明Description of the drawings

为了更清楚地说明本申请实施例中的技术方案，下面将对实施例中所需要使用的附图进行简单的介绍，显而易见地，下面描述中的附图仅仅是本申请的一些实施例，对于本领域普通技术人员来讲，在不付出创造性劳动的前提下，还可以根据这些附图获得其它的附图。In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required to be used in the embodiments will be briefly introduced below. Obviously, the drawings in the following description are only some embodiments of the present application. Those of ordinary skill in the art can also obtain other drawings based on these drawings without exerting creative efforts.

图1是本申请实施例公开的一种导航控制方法的应用场景示意图；Figure 1 is a schematic diagram of an application scenario of a navigation control method disclosed in an embodiment of the present application;

图2是本申请实施例公开的一种导航控制方法的流程示意图；Figure 2 is a schematic flowchart of a navigation control method disclosed in an embodiment of the present application;

图3A是本申请实施例公开的一种手势控制操作与界面导航操作的对应关系示意图；Figure 3A is a schematic diagram of the correspondence between a gesture control operation and an interface navigation operation disclosed in an embodiment of the present application;

图3B是本申请实施例公开的另一种手势控制操作与界面导航操作的对应关系示意图；Figure 3B is a schematic diagram of the correspondence between another gesture control operation and interface navigation operation disclosed in the embodiment of the present application;

图4是本申请实施例公开的另一种导航控制方法的流程示意图；Figure 4 is a schematic flowchart of another navigation control method disclosed in the embodiment of the present application;

图5是图4所示的导航控制方法对应的数据流向示意图；Figure 5 is a schematic diagram of the data flow corresponding to the navigation control method shown in Figure 4;

图6是本申请实施例公开的又一种导航控制方法的流程示意图；Figure 6 is a schematic flowchart of yet another navigation control method disclosed in an embodiment of the present application;

图7是图6所示的导航控制方法对应的数据流向示意图；Figure 7 is a schematic diagram of the data flow corresponding to the navigation control method shown in Figure 6;

图8是本申请实施例公开的第四种导航控制方法的流程示意图；Figure 8 is a schematic flowchart of the fourth navigation control method disclosed in the embodiment of the present application;

图9是本申请实施例公开的一种导航控制方法的时序图；Figure 9 is a sequence diagram of a navigation control method disclosed in the embodiment of the present application;

图10是本申请实施例公开的另一种导航控制方法的时序图；Figure 10 is a sequence diagram of another navigation control method disclosed in the embodiment of the present application;

图11是本申请实施例公开的一种导航控制装置的模块化示意图；Figure 11 is a modular schematic diagram of a navigation control device disclosed in an embodiment of the present application;

图12是本申请实施例公开的另一种导航控制装置的模块化示意图；Figure 12 is a modular schematic diagram of another navigation control device disclosed in the embodiment of the present application;

图13是本申请实施例公开的一种终端设备的模块化示意图。Figure 13 is a modular schematic diagram of a terminal device disclosed in the embodiment of the present application.

具体实施方式Detailed ways

下面将结合本申请实施例中的附图，对本申请实施例中的技术方案进行清楚、完整的描述，显然，所描述的实施例仅是本申请一部分实施例，而不是全部的实施例。基于本申请中的实施例，本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其它实施例，都属于本申请保护的范围。The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are only some of the embodiments of the present application, rather than all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by those of ordinary skill in the art without creative efforts fall within the scope of protection of this application.

需要说明的是，本申请实施例的术语“包括”和“具有”及他们的任何变形，意图在于覆盖不排他的包含，例如，包含了一系列步骤或单元的过程、方法、***、产品或设备不必限于清楚列出的那些步骤或单元，而是可包括没有清楚地列出的或对于这些过程、方法、产品或设备固有的其它步骤或单元。It should be noted that the terms "including" and "having" and any variations thereof in the embodiments of this application are intended to cover non-exclusive inclusions, for example, processes, methods, systems, products or products that include a series of steps or units. Apparatus are not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such processes, methods, products or devices.

本申请实施例公开了一种导航控制方法及装置、终端设备、存储介质，能够降低终端设备之间进行导航控制的难度，从而有利于提升多设备协同工作的效率以及灵活性。Embodiments of the present application disclose a navigation control method and device, terminal equipment, and storage media, which can reduce the difficulty of navigation control between terminal equipment, thereby helping to improve the efficiency and flexibility of multi-device collaborative work.

以下将结合附图进行详细描述。A detailed description will be given below with reference to the accompanying drawings.

请参阅图1，图1是本申请实施例公开的一种导航控制方法的应用场景示意图，可以包括第一终端设备10以及第二终端设备20，其中，该第一终端设备10可以与第二终端设备20通信连接，且第一终端设备10可以设有投影窗口11，该投影窗口11可用于显示与第二终端设备20的屏幕界面对应的投影界面。可以理解，基于第一终端设备10与第二终端设备20之间所建立的通信连接，第二终端设备20在其屏幕界面中所显示的图像内容，可以同步显示于第一终端设备10的投影界面中(可能存在延迟)。进一步地，通过对第一终端设备10或第二终端设备20执行指定的控制操作，可以相应改变第二终端设备20的屏幕界面中所显示的图像内容，从而也能够同步改变第一终端设备10的投影界面中所显示的图像内容。Please refer to Figure 1. Figure 1 is a schematic diagram of an application scenario of a navigation control method disclosed in an embodiment of the present application, which may include a first terminal device 10 and a second terminal device 20, wherein the first terminal device 10 may be connected to the second terminal device 20. The terminal device 20 is communicatively connected, and the first terminal device 10 may be provided with a projection window 11 , and the projection window 11 may be used to display a projection interface corresponding to the screen interface of the second terminal device 20 . It can be understood that based on the communication connection established between the first terminal device 10 and the second terminal device 20, the image content displayed by the second terminal device 20 in its screen interface can be synchronously displayed on the projection of the first terminal device 10. interface (there may be delays). Further, by performing specified control operations on the first terminal device 10 or the second terminal device 20, the image content displayed in the screen interface of the second terminal device 20 can be changed accordingly, so that the first terminal device 10 can also be synchronously changed. The image content displayed in the projection interface.

示例性地，上述第一终端设备10及第二终端设备20，均可包括具备通信连接功能，或者进一步的多屏协同功能的各类设备或***，如电脑、平板电脑、智能手机、智能手表、智能手环等，本申请实施例中不作具体限定。进一步地，第一终端设备10可以搭载有操作***，如Windows操作***、Linux操作***等，以用于安装可将第二终端设备20的屏幕界面投影至该第一终端设备10的投影窗口11，从而显示与该屏幕界面对应的投影界面的应用程序，或者实现相应的***功能。第二终端设备20也可以搭载有操作***，如Windows Phone操作***、安卓(Android)操作***、iOS操作***、塞班(Symbian)操作***等，以用于配合实现上述投影功能。可以理解，图1所示的第一终端设备10为电脑，第二终端设备20为智能手机，这仅仅是一种示例，不应被视为对本申请实施例中第一终端设备10及第二终端设备20的设备类型的限制。Illustratively, the above-mentioned first terminal device 10 and second terminal device 20 may include various types of devices or systems with communication connection functions or further multi-screen collaboration functions, such as computers, tablets, smart phones, and smart watches. , smart bracelets, etc., are not specifically limited in the embodiments of this application. Further, the first terminal device 10 can be equipped with an operating system, such as a Windows operating system, a Linux operating system, etc., for installing a screen interface that can project the screen interface of the second terminal device 20 to the projection window 11 of the first terminal device 10 , thereby displaying the application program of the projection interface corresponding to the screen interface, or realizing the corresponding system function. The second terminal device 20 may also be equipped with an operating system, such as Windows Phone operating system, Android operating system, iOS operating system, Symbian operating system, etc., to cooperate with the implementation of the above projection function. It can be understood that the first terminal device 10 shown in FIG. 1 is a computer and the second terminal device 20 is a smartphone. This is only an example and should not be regarded as a limitation on the first terminal device 10 and the second terminal device 10 in the embodiment of the present application. Restrictions on the device type of the terminal device 20.

在本申请实施例中，为了方便地对第二终端设备20进行导航控制(例如实现界面后退、返回主页、打开或关闭任务栏、打开或关闭菜单栏等)，第一终端设备10可以响应于针对其投影界面的手势控制操作，向第二终端设备20发送与该手势控制操作对应的手势导航信息，以使第二终端设备20可以根据该手势导航信息，对其屏幕界面执行与该手势导航信息对应的界面导航操作。其中，上述手势控制操作可以包括用户针对第一终端设备10的屏幕所进行的触控操作(例如手写触控、触控笔触控等)，也可以包括通过其他硬件设备所采集到的手势操作(例如鼠标手势、通过隔空识别设备获取的凌空手势等)，本申请实施例中不作具体限定。In the embodiment of the present application, in order to conveniently perform navigation control on the second terminal device 20 (for example, to implement interface backing, return to the homepage, open or close the taskbar, open or close the menu bar, etc.), the first terminal device 10 can respond to For the gesture control operation of its projection interface, send the gesture navigation information corresponding to the gesture control operation to the second terminal device 20, so that the second terminal device 20 can perform the gesture navigation on its screen interface according to the gesture navigation information. Interface navigation operations corresponding to the information. The above-mentioned gesture control operations may include touch operations performed by the user on the screen of the first terminal device 10 (such as handwriting touch, stylus touch, etc.), or may include gesture operations collected through other hardware devices ( For example, mouse gestures, volley gestures obtained through air recognition equipment, etc.), which are not specifically limited in the embodiments of this application.

通过实施上述导航控制方法，能够基于用户针对第一终端设备10的投影界面所进行的手势控制操作，在第二终端设备20的屏幕界面上实现相应的导航控制，从而能够方便地实现多设备协同效果。这样的导航控制方法，可以避免通过点击等较为繁琐的操作来进行跨设备的导航控制，有利于降低终端设备之间进行导航控制的难度，从而能够有效提升多设备协同工作的效率以及灵活性。By implementing the above navigation control method, corresponding navigation control can be implemented on the screen interface of the second terminal device 20 based on the gesture control operation performed by the user on the projection interface of the first terminal device 10 , thereby conveniently realizing multi-device collaboration. Effect. Such a navigation control method can avoid cross-device navigation control through cumbersome operations such as clicking, and is helpful in reducing the difficulty of navigation control between terminal devices, thereby effectively improving the efficiency and flexibility of multi-device collaborative work.

请参阅图2，图2是本申请实施例公开的一种导航控制方法的流程示意图，该导航控制方法可以应用于上述的第一终端设备，该第一终端设备可以与第二终端设备通信连接，且第一终端设备设有投影窗口，该投影窗口用于显示与第二终端设备的屏幕界面对应的投影界面。如图2所示，该导航控制方法可以包括以下步骤：Please refer to Figure 2. Figure 2 is a schematic flowchart of a navigation control method disclosed in an embodiment of the present application. The navigation control method can be applied to the above-mentioned first terminal device. The first terminal device can be communicated and connected with the second terminal device. , and the first terminal device is provided with a projection window, which is used to display a projection interface corresponding to the screen interface of the second terminal device. As shown in Figure 2, the navigation control method may include the following steps:

202、响应于针对投影界面的手势控制操作，向第二终端设备发送与该手势控制操作对应的手势导航信息，以使第二终端设备根据上述手势导航信息，对屏幕界面执行与该手势导航信息对应的界面导航操作。202. In response to the gesture control operation on the projection interface, send gesture navigation information corresponding to the gesture control operation to the second terminal device, so that the second terminal device performs the gesture navigation information on the screen interface according to the above gesture navigation information. Corresponding interface navigation operations.

在本申请实施例中，第一终端设备在与第二终端设备建立通信连接之后，第二终端设备可以将其屏幕界面中所显示的图像内容同步(即投影)至第一终端设备屏幕中的投影窗口，从而该投影窗口可以显示与上述屏幕界面对应的投影界面。在此基础上，通过检测针对该投影界面的手势控制操作，第一终端设备可以获取相应的手势导航信息，并将该手势导航信息发送至第二终端设备，以使第二终端设备可以根据该手势导航信息，对其屏幕界面实现相应的界面导航操作，从而可以方便地实现多设备协同效果。In this embodiment of the present application, after the first terminal device establishes a communication connection with the second terminal device, the second terminal device can synchronize (ie, project) the image content displayed in its screen interface to the image content displayed on the screen of the first terminal device. A projection window, so that the projection window can display a projection interface corresponding to the above-mentioned screen interface. On this basis, by detecting the gesture control operation for the projection interface, the first terminal device can obtain the corresponding gesture navigation information and send the gesture navigation information to the second terminal device, so that the second terminal device can according to the gesture navigation information. Gesture navigation information can implement corresponding interface navigation operations on its screen interface, so that multi-device collaboration effects can be easily achieved.

其中，上述手势控制操作，可以包括类似于用户肢体手势，或者与用户肢体手势相关的控制操作，尤其可以包括通过移动作为终端设备(例如上述的第一终端设备)外设的鼠标而实现的鼠标手势。相较于相关技术中常用来实现多设备协同控制的点击操作(例如通过对第一终端设备的鼠标进行点击等操作，实现对第二终端设备的控制)，以鼠标点击为例，无论是单击还是双击，均需要先将鼠标移动至特定位置，再对鼠标左键或右键进行单次或多次点击；而对于手势控制操作而言，以鼠标手势为例，通常可以在任意位置直接按住鼠标左键或右键，并拖拽鼠标进行移动来“画”出所需的手势。在此基础上，用户在第一终端设备上针对其投影界面所进行的手势控制操作，既可以利用较大的屏幕范围，具有更高的自由度，又能够避免如点击操作必须针对该投影界面中预设的具***置进行所带来的局限性，从而有利于提升对第二终端设备进行导航控制的灵活性。The above-mentioned gesture control operations may include control operations similar to or related to the user's body gestures. In particular, they may include control operations implemented by moving a mouse that is a peripheral device of a terminal device (such as the above-mentioned first terminal device). gesture. Compared with the click operation commonly used in related technologies to achieve collaborative control of multiple devices (for example, by clicking the mouse of the first terminal device to control the second terminal device), taking mouse clicks as an example, whether it is a single Either click or double-click, you need to move the mouse to a specific position first, and then click the left or right mouse button single or multiple times; for gesture control operations, taking mouse gestures as an example, you can usually press directly at any position Hold down the left or right mouse button and drag the mouse to move to "draw" the desired gesture. On this basis, the gesture control operation performed by the user on the first terminal device for its projection interface can not only utilize a larger screen range and have a higher degree of freedom, but also avoid the need to target the projection interface for click operations. This will help improve the flexibility of navigation control of the second terminal device.

其中，上述界面导航操作，指的是根据界面浏览需要，在对终端设备所显示的界面进行替换、调整等各种变化时相应执行的操作。示例性地，界面导航操作至少可以包括界面后退操作、返回主页操作、任务栏操作(例如打开或关闭任务栏)以及菜单栏(例如打开或关闭菜单栏)操作等。在一些实施例中，第二终端设备可以在其屏幕界面显示与各个界面导航操作对应的导航控制按钮。可选地，在通过上述手势控制操作实现对第二终端设备的导航控制时，第一终端设备的投影界面上可以隐藏与第二终端设备的屏幕界面对应的导航控制按钮，从而有利于进一步扩大投影视野，提升用户进行导航控制的使用体验。Among them, the above-mentioned interface navigation operations refer to operations performed when various changes such as replacing and adjusting the interface displayed by the terminal device are performed according to the needs of interface browsing. For example, the interface navigation operation may at least include an interface back operation, a return homepage operation, a taskbar operation (such as opening or closing the taskbar), and a menu bar (such as opening or closing the menu bar) operation. In some embodiments, the second terminal device may display navigation control buttons corresponding to each interface navigation operation on its screen interface. Optionally, when the navigation control of the second terminal device is implemented through the above gesture control operation, the navigation control button corresponding to the screen interface of the second terminal device can be hidden on the projection interface of the first terminal device, thereby facilitating further expansion. Projects the field of view to improve the user's navigation control experience.

在一些实施例中，上述手势控制操作可以包括用户针对第一终端设备的屏幕所进行的触控操作(例如手写触控、触控笔触控等)。第一终端设备通过检测针对其投影界面的触控轨迹，可以获取相应的界面操作信息，并据此向第二终端设备发送与上述手势控制操作对应的手势导航信息。In some embodiments, the above gesture control operation may include a touch operation performed by the user on the screen of the first terminal device (such as handwriting touch, stylus touch, etc.). The first terminal device can obtain the corresponding interface operation information by detecting the touch trajectory on its projection interface, and accordingly sends the gesture navigation information corresponding to the above-mentioned gesture control operation to the second terminal device.

在另一些实施例中，上述手势控制操作也可以包括用户通过其他硬件设备辅助完成或呈现的手势操作(例如鼠标手势、凌空手势等)。示例性地，以第一终端设备包括电脑，上述手势控制操作包括鼠标手势为例，第一终端设备可以获取用户通过操作鼠标在该第一终端设备的屏幕上所产生的移动轨迹(例如按定鼠标左键或右键后进行移动所产生的移动轨迹等)，并将其作为针对投影界面的手势控制操作，进一步确定出相应的界面操作信息，进而第一终端设备可以据此向第二终端设备发送与上述手势控制操作对应的手势导航信息。In other embodiments, the above-mentioned gesture control operations may also include gesture operations (such as mouse gestures, volley gestures, etc.) performed or presented by the user through other hardware devices. For example, assuming that the first terminal device includes a computer and the above gesture control operation includes a mouse gesture, the first terminal device can obtain the movement trajectory (for example, pressing a certain key) generated by the user on the screen of the first terminal device by operating the mouse. The movement trajectory generated by moving the left or right mouse button, etc.), and use it as a gesture control operation for the projection interface to further determine the corresponding interface operation information, and then the first terminal device can send a message to the second terminal device accordingly. Send gesture navigation information corresponding to the above gesture control operation.

示例性地，请一并参阅图3A及图3B，其中图3A是本申请实施例公开的一种手势控制操作与界面导航操作的对应关系示意图，图3B则是本申请实施例公开的另一种手势控制操作与界面导航操作的对应关系示意图。如图3A所示，第一终端设备10可以检测针对其投影界面11的手势控制操作，若该手势控制操作具体表现为从左向右的触控操作或手势操作(带箭头的虚线表示操作方向)，则可以对应于第二终端设备20的屏幕界面中的界面后退按钮21a，从而第二终端设备20可以根据第一终端设备10所发送的与该手势控制操作对应的手势导航信息，对屏幕界面执行相应的界面后退操作。又如图3B所示，若该手势控制操作具体表现为从下向上的触控操作或手势操作，则可以对应于第二终端设备20的屏幕界面中的返回主页按钮21b，从而第二终端设备20可以根据第一终端设备10所发送的与该手势控制操作对应的手势导航信息，对屏幕界面执行相应的返回主页操作。需要说明的是，上述手势控制操作与第二终端设备所具体执行的导航控制操作之间的对应关系仅是一种示例，在一些实施例中，也可以存在其他不同的对应关系，本申请实施例中不作具体限定。For example, please refer to FIG. 3A and FIG. 3B together. FIG. 3A is a schematic diagram of the corresponding relationship between a gesture control operation and an interface navigation operation disclosed in an embodiment of the present application. FIG. 3B is another schematic diagram of a gesture control operation disclosed in an embodiment of the present application. A schematic diagram of the corresponding relationship between gesture control operations and interface navigation operations. As shown in FIG. 3A , the first terminal device 10 can detect a gesture control operation for its projection interface 11 , if the gesture control operation is specifically a touch operation or gesture operation from left to right (the dotted line with an arrow indicates the direction of the operation) ), it may correspond to the interface back button 21a in the screen interface of the second terminal device 20, so that the second terminal device 20 can control the screen according to the gesture navigation information corresponding to the gesture control operation sent by the first terminal device 10. The interface performs the corresponding interface back operation. As shown in FIG. 3B , if the gesture control operation is embodied as a bottom-up touch operation or gesture operation, it may correspond to the return home button 21b in the screen interface of the second terminal device 20, so that the second terminal device 20 can perform a corresponding return homepage operation on the screen interface according to the gesture navigation information corresponding to the gesture control operation sent by the first terminal device 10 . It should be noted that the corresponding relationship between the above gesture control operation and the navigation control operation specifically performed by the second terminal device is only an example. In some embodiments, other different corresponding relationships may also exist. This application implements There are no specific limitations in the example.

可选地，上述针对第一终端设备的投影界面所进行的手势控制操作，既可以在该第一终端设备的投影窗口内进行，也可以在该投影窗口的范围之外进行，不影响第一终端设备对该手势控制操作实现检测等必要过程。Optionally, the above gesture control operation performed on the projection interface of the first terminal device can be performed within the projection window of the first terminal device or outside the range of the projection window, without affecting the first terminal device. The terminal device implements necessary processes such as detection of the gesture control operation.

作为一种可选的实施方式，第一终端设备在对针对其投影界面所进行的手势控制操作进行检测之前，还可以先检测其投影界面与第二终端设备的屏幕界面之间的同步状态，并在该同步状态表示上述投影界面与屏幕界面保持同步的情况下，才启动检测针对该投影界面的手势控制操作。通过实施上述方法，能够避免在第一终端设备的投影界面未与第二终端设备的屏幕界面实现同步的情况下，误导用户对第二终端设备进行错误的导航控制，从而有利于确保对第二终端设备进行导航控制的可靠性。As an optional implementation manner, before the first terminal device detects the gesture control operation performed on its projection interface, it can also first detect the synchronization state between its projection interface and the screen interface of the second terminal device, And when the synchronization state indicates that the above-mentioned projection interface and the screen interface are synchronized, the detection of the gesture control operation for the projection interface is started. By implementing the above method, it is possible to avoid misleading the user to perform erroneous navigation control on the second terminal device when the projection interface of the first terminal device is not synchronized with the screen interface of the second terminal device, thereby helping to ensure that the second terminal device The reliability of navigation control by terminal equipment.

可见，实施上述实施例所描述的导航控制方法，能够基于用户针对第一终端设备的投影界面所进行的手势控制操作，在第二终端设备的屏幕界面上实现相应的导航控制，从而能够方便地实现多设备协同效果。这样的导航控制方法，可以避免通过点击等较为繁琐的操作来进行跨设备的导航控制，有利于降低终端设备之间进行导航控制的难度，从而能够有效提升多设备协同工作的效率以及灵活性。It can be seen that implementing the navigation control method described in the above embodiment can implement corresponding navigation control on the screen interface of the second terminal device based on the gesture control operation performed by the user on the projection interface of the first terminal device, thereby conveniently Achieve multi-device synergy effects. Such a navigation control method can avoid cross-device navigation control through cumbersome operations such as clicking, and is helpful in reducing the difficulty of navigation control between terminal devices, thereby effectively improving the efficiency and flexibility of multi-device collaborative work.

请参阅图4，图4是本申请实施例公开的另一种导航控制方法的流程示意图，该导航控制方法可以应用于上述的第一终端设备，该第一终端设备可以与第二终端设备通信连接，且第一终端设备设有投影窗口，该投影窗口用于显示与第二终端设备的屏幕界面对应的投影界面。如图4所示，该导航控制方法可以包括以下步骤：Please refer to Figure 4. Figure 4 is a schematic flow chart of another navigation control method disclosed in an embodiment of the present application. This navigation control method can be applied to the above-mentioned first terminal device, and the first terminal device can communicate with the second terminal device. The first terminal device is connected, and the first terminal device is provided with a projection window, and the projection window is used to display a projection interface corresponding to the screen interface of the second terminal device. As shown in Figure 4, the navigation control method may include the following steps:

402、响应于针对投影界面的手势控制操作，获取与该手势控制操作对应的界面操作信息。402. In response to the gesture control operation on the projection interface, obtain the interface operation information corresponding to the gesture control operation.

在本申请实施例中，第一终端设备在检测到针对其投影界面的手势控制操作之后，可以响应于该手势控制操作，进一步获取与该手势控制操作对应的界面操作信息。示例性地，上述手势控制操作对应的界面操作信息，可以包括相应的触控操作或手势操作所对应的轨迹特征，例如轨迹形状、轨迹方向等。在后续步骤中，可以通过第一终端设备或者第二终端设备对该界面操作信息进行识别，以判断上述手势控制操作是否有效(例如是否为用户误触，是否存在对应的导航控制操作等)，并在确认该手势控制操作有效的情况下，匹配与之对应的导航信号，以供第二终端设备针对其屏幕界面执行相应的界面导航操作。In this embodiment of the present application, after detecting a gesture control operation for its projection interface, the first terminal device may respond to the gesture control operation and further obtain interface operation information corresponding to the gesture control operation. For example, the interface operation information corresponding to the above-mentioned gesture control operation may include the trajectory characteristics corresponding to the corresponding touch operation or gesture operation, such as trajectory shape, trajectory direction, etc. In subsequent steps, the interface operation information can be identified through the first terminal device or the second terminal device to determine whether the above gesture control operation is valid (for example, whether it is an accidental touch by the user, whether there is a corresponding navigation control operation, etc.), And when it is confirmed that the gesture control operation is valid, the corresponding navigation signal is matched so that the second terminal device can perform a corresponding interface navigation operation on its screen interface.

404、基于第二终端设备对应的目标导航模式，对该界面操作信息进行识别，得到上述手势控制操作对应的导航信号。404. Based on the target navigation mode corresponding to the second terminal device, identify the interface operation information and obtain the navigation signal corresponding to the above gesture control operation.

在本申请实施例中，对上述界面操作信息的识别及匹配可以在第一终端设备上进行，即针对上述手势控制操作的具体识别过程可以由第一终端设备完成，再由该第一终端设备将其所识别得到的导航信号发送至第二终端设备，以供第二终端设备执行相应的界面导航操作。其中，上述识别过程可以基于预设的数据库实现，例如第二终端设备对应的目标导航模式，该目标导航模式可以包括界面操作信息与第二终端设备可响应的导航信号之间的对应关系。基于上述目标导航模式，第一终端设备可以对界面操作信息进行准确的判断，以获取与上述手势控制操作对应，且在第二终端设备可被有效执行的导航信号。In this embodiment of the present application, the recognition and matching of the above-mentioned interface operation information can be performed on the first terminal device, that is, the specific recognition process for the above-mentioned gesture control operation can be completed by the first terminal device, and then the first terminal device The recognized navigation signal is sent to the second terminal device, so that the second terminal device can perform a corresponding interface navigation operation. The above identification process may be implemented based on a preset database, such as a target navigation mode corresponding to the second terminal device. The target navigation mode may include a correspondence between interface operation information and navigation signals that the second terminal device can respond to. Based on the above target navigation mode, the first terminal device can accurately judge the interface operation information to obtain a navigation signal that corresponds to the above gesture control operation and can be effectively executed on the second terminal device.

406、将导航信号发送至第二终端设备，以使第二终端设备根据该导航信号，对屏幕界面执行与该导航信号对应的界面导航操作。406. Send the navigation signal to the second terminal device, so that the second terminal device performs an interface navigation operation corresponding to the navigation signal on the screen interface according to the navigation signal.

在本申请实施例中，第一终端设备在识别得到与上述手势控制操作对应的导航信号之后，可以将该导航信号发送至第二终端设备。示例性地，请参阅图5，图5是上述导航控制方法对应的数据流向示意图。如图5所示，第一终端设备可以用于对其检测到的手势控制操作所对应的界面操作信息进行识别，并将识别所得到的导航信号发送至第二终端设备，以供第二终端设备执行相应的界面导航操作，从而可以对该第二终端设备的屏幕界面进行导航控制，实现多设备协同效果。In this embodiment of the present application, after the first terminal device recognizes the navigation signal corresponding to the above-mentioned gesture control operation, the first terminal device may send the navigation signal to the second terminal device. For example, please refer to Figure 5, which is a schematic diagram of the data flow corresponding to the above navigation control method. As shown in Figure 5, the first terminal device can be used to identify the interface operation information corresponding to the gesture control operation detected by it, and send the navigation signal obtained by the identification to the second terminal device for use by the second terminal. The device performs corresponding interface navigation operations, so that the screen interface of the second terminal device can be navigated and controlled to achieve a multi-device synergy effect.

可见，实施上述实施例所描述的导航控制方法，能够基于在第一终端设备所进行的手势控制操作来实现对第二终端设备屏幕界面的导航控制，从而能够方便地对第二终端设备进行精确控制，实现多设备协同效果。这样的导航控制方法，可以避免通过点击等较为繁琐的操作来进行跨设备的导航控制，有利于降低终端设备之间进行导航控制的难度，从而能够有效提升多设备协同工作的效率以及灵活性。此外，通过在第一终端设备识别具体的手势控制操作，可以由该第一终端设备完成匹配实际导航操作的过程，从而能够有效利用第一终端设备的算力，进一步提升对第二终端设备进行导航控制的效率。It can be seen that by implementing the navigation control method described in the above embodiment, the navigation control of the screen interface of the second terminal device can be realized based on the gesture control operation performed on the first terminal device, so that the second terminal device can be accurately controlled conveniently. Control to achieve multi-device synergy effects. Such a navigation control method can avoid cross-device navigation control through cumbersome operations such as clicking, and is helpful in reducing the difficulty of navigation control between terminal devices, thereby effectively improving the efficiency and flexibility of multi-device collaborative work. In addition, by recognizing the specific gesture control operation on the first terminal device, the first terminal device can complete the process of matching the actual navigation operation, thereby effectively utilizing the computing power of the first terminal device and further improving the performance of the second terminal device. Navigation control efficiency.

请参阅图6，图6是本申请实施例公开的又一种导航控制方法的流程示意图，该导航控制方法可以应用于上述的第一终端设备，该第一终端设备可以与第二终端设备通信连接，且第一终端设备设有投影窗口，该投影窗口用于显示与第二终端设备的屏幕界面对应的投影界面。如图6所示，该导航控制方法可以包括以下步骤：Please refer to Figure 6. Figure 6 is a schematic flow chart of yet another navigation control method disclosed in an embodiment of the present application. The navigation control method can be applied to the above-mentioned first terminal device, and the first terminal device can communicate with the second terminal device. The first terminal device is connected, and the first terminal device is provided with a projection window, and the projection window is used to display a projection interface corresponding to the screen interface of the second terminal device. As shown in Figure 6, the navigation control method may include the following steps:

602、响应于针对投影界面的手势控制操作，获取该手势控制操作对应的界面操作信息。602. In response to the gesture control operation on the projection interface, obtain the interface operation information corresponding to the gesture control operation.

其中，步骤602与上述步骤402类似，此处不再赘述。Among them, step 602 is similar to the above-mentioned step 402, and will not be described again here.

604、将界面操作信息发送至第二终端设备，以使第二终端设备基于该第二终端设备对应的目标导航模式，对该界面操作信息进行识别，得到上述手势控制操作对应的导航信号，以及根据该导航信号，对屏幕界面执行与该导航信号对应的界面导航操作。604. Send the interface operation information to the second terminal device, so that the second terminal device recognizes the interface operation information based on the target navigation mode corresponding to the second terminal device, and obtains the navigation signal corresponding to the gesture control operation, and According to the navigation signal, an interface navigation operation corresponding to the navigation signal is performed on the screen interface.

在本申请实施例中，对界面操作信息的识别及匹配可以在第二终端设备上进行，即针对上述手势控制操作的具体识别过程可以交由第二终端设备实现，再由该第二终端设备根据其所识别得到的导航信号执行相应的界面导航操作。其中，上述识别过程也可以基于第二终端设备对应的目标导航模式实现，该目标导航模式可以包括界面操作信息与第二终端设备可响应的导航信号之间的对应关系。基于该目标导航模式，第二终端设备可以对界面操作信息进行准确的判断，以获取与上述手势控制操作对应，且在该第二终端设备可被有效执行的导航信号。In this embodiment of the present application, the recognition and matching of interface operation information can be performed on the second terminal device, that is, the specific recognition process for the above gesture control operation can be implemented by the second terminal device, and then the second terminal device Execute corresponding interface navigation operations according to the navigation signals recognized by it. The above identification process may also be implemented based on a target navigation mode corresponding to the second terminal device. The target navigation mode may include a correspondence between interface operation information and navigation signals to which the second terminal device can respond. Based on the target navigation mode, the second terminal device can accurately judge the interface operation information to obtain a navigation signal that corresponds to the above gesture control operation and can be effectively executed on the second terminal device.

示例性地，请参阅图7，图7是上述导航控制方法对应的数据流向示意图。如图7所示，第一终端设备可以用于获取与其检测到的手势控制操作所对应的界面操作信息，并将该界面操作信息发送至第二终端设备，以供第二终端设备对该界面操作信息进行识别，并根据识别所得到的导航信号执行相应的界面导航操作，从而可以对该第二终端设备的屏幕界面进行导航控制，实现多设备协同效果。For example, please refer to Figure 7, which is a schematic diagram of the data flow corresponding to the above navigation control method. As shown in Figure 7, the first terminal device can be used to obtain the interface operation information corresponding to the gesture control operation detected by it, and send the interface operation information to the second terminal device for the second terminal device to modify the interface. The operation information is identified, and the corresponding interface navigation operation is performed according to the navigation signal obtained by the identification, so that the screen interface of the second terminal device can be navigated and controlled to achieve a multi-device synergy effect.

可见，实施上述实施例所描述的导航控制方法，能够基于在第一终端设备所进行的手势控制操作来实现对第二终端设备屏幕界面的导航控制，从而能够方便地对第二终端设备进行精确控制，实现多设备协同效果。这样的导航控制方法，可以避免通过点击等较为繁琐的操作来进行跨设备的导航控制，有利于降低终端设备之间进行导航控制的难度，从而能够有效提升多设备协同工作的效率以及灵活性。此外，通过在第二终端设备识别具体的手势控制操作，可以由该第二终端设备完成匹配实际导航操作的过程，从而能够确保准确依据第二终端设备对应的目标导航模式，进一步提升对第二终端设备进行导航控制的准确性及可靠性。It can be seen that by implementing the navigation control method described in the above embodiment, the navigation control of the screen interface of the second terminal device can be realized based on the gesture control operation performed on the first terminal device, so that the second terminal device can be accurately controlled conveniently. Control to achieve multi-device synergy effects. Such a navigation control method can avoid cross-device navigation control through cumbersome operations such as clicking, and is helpful in reducing the difficulty of navigation control between terminal devices, thereby effectively improving the efficiency and flexibility of multi-device collaborative work. In addition, by recognizing the specific gesture control operation on the second terminal device, the second terminal device can complete the process of matching the actual navigation operation, thereby ensuring that the target navigation mode corresponding to the second terminal device is accurately followed, and further improving the accuracy of the second terminal device. The accuracy and reliability of navigation control by terminal equipment.

请参阅图8，图8是本申请实施例公开的第四种导航控制方法的流程示意图，该导航控制方法可以应用于上述的第二终端设备，该第二终端设备可以与第一终端设备通信连接，且第一终端设备设有投影窗口，第二终端设备的屏幕界面投影于该投影窗口，可以得到该投影窗口上对应显示的投影界面。如图8所示，该导航控制方法可以包括以下步骤：Please refer to Figure 8. Figure 8 is a schematic flow chart of the fourth navigation control method disclosed in the embodiment of the present application. This navigation control method can be applied to the above-mentioned second terminal device, and the second terminal device can communicate with the first terminal device. The first terminal device is connected, and the first terminal device is provided with a projection window, and the screen interface of the second terminal device is projected on the projection window, and the corresponding projection interface displayed on the projection window can be obtained. As shown in Figure 8, the navigation control method may include the following steps:

802、接收第一终端设备发送的手势导航信息，其中，该手势导航信息是由第一终端设备响应于针对投影界面的手势控制操作，向第二终端设备发送的与该手势控制操作对应的手势导航信息。802. Receive gesture navigation information sent by the first terminal device, wherein the gesture navigation information is a gesture corresponding to the gesture control operation sent by the first terminal device to the second terminal device in response to the gesture control operation on the projection interface. Navigation information.

在本申请实施例中，第一终端设备在检测到针对其投影界面的手势控制操作之后，可以将其所获取的与该手势控制操作对应的手势导航信息发送至第二终端设备，从而第二终端设备可以在后续步骤中，根据其所接收到的手势导航信息，对该第二终端设备的屏幕界面执行相应的界面导航操作。In this embodiment of the present application, after detecting a gesture control operation on its projection interface, the first terminal device may send the acquired gesture navigation information corresponding to the gesture control operation to the second terminal device, so that the second terminal device In subsequent steps, the terminal device can perform corresponding interface navigation operations on the screen interface of the second terminal device according to the gesture navigation information it receives.

804、根据上述手势导航信息，对屏幕界面执行与该手势导航信息对应的界面导航操作。804. According to the above gesture navigation information, perform an interface navigation operation corresponding to the gesture navigation information on the screen interface.

在一些实施例中，手势导航信息可以包括上述手势控制操作对应的导航信号，即第一终端设备可以在其本地对其检测所得到的手势控制操作对应的界面操作信息进行识别，并将识别所得到的导航信号发送至第二终端设备。在此基础上，第二终端设备可以直接根据其所接收到的导航信号，对其屏幕界面执行与该导航信号对应的界面导航操作。In some embodiments, the gesture navigation information may include the navigation signal corresponding to the above-mentioned gesture control operation, that is, the first terminal device can locally identify the interface operation information corresponding to the gesture control operation detected by it, and will identify the detected operation information. The obtained navigation signal is sent to the second terminal device. On this basis, the second terminal device can directly perform the interface navigation operation corresponding to the navigation signal on its screen interface according to the navigation signal it receives.

在另一些实施例中，手势导航信息也可以包括上述手势控制操作对应的界面操作信息，从而第二终端设备在接收到该界面操作信息之后，可以基于该第二终端设备对应的目标导航模式，对该界面操作信息进行识别，得到上述手势控制操作对应的导航信号，进而可以根据该导航信号，对其屏幕界面执行与该导航信号对应的界面导航操作。In other embodiments, the gesture navigation information may also include the interface operation information corresponding to the above-mentioned gesture control operation, so that after receiving the interface operation information, the second terminal device can, based on the target navigation mode corresponding to the second terminal device, The interface operation information is identified to obtain the navigation signal corresponding to the above gesture control operation, and then the interface navigation operation corresponding to the navigation signal can be performed on the screen interface according to the navigation signal.

可见，实施上述实施例所描述的导航控制方法，第二终端设备能够基于用户针对第一终端设备的投影界面所进行的手势控制操作，在接收到相应的手势导航信息后，在其屏幕界面上实现相应的导航控制，从而能够方便地实现多设备协同效果。这样的导航控制方法，可以避免通过点击等较为繁琐的操作来进行跨设备的导航控制，有利于降低终端设备之间进行导航控制的难度，从而能够有效提升多设备协同工作的效率以及灵活性。其中，对于手势控制操作的具体识别过程既可以在第一终端设备上进行，也可以在第二终端设备上进行，有利于提升实现针对第二终端设备的导航控制的灵活性，从而能够在避免相关技术中需要通过点击等较为繁琐的操作才能进行跨设备导航控制的前提下，降低终端设备之间进行导航控制的难度，有利于提升多设备协同工作的效率以及灵活性。It can be seen that by implementing the navigation control method described in the above embodiment, the second terminal device can perform a gesture control operation on the projection interface of the first terminal device based on the user, and after receiving the corresponding gesture navigation information, on its screen interface Implement corresponding navigation control so that multi-device synergy can be easily achieved. Such a navigation control method can avoid cross-device navigation control through cumbersome operations such as clicking, and is helpful in reducing the difficulty of navigation control between terminal devices, thereby effectively improving the efficiency and flexibility of multi-device collaborative work. Among them, the specific recognition process of the gesture control operation can be performed on either the first terminal device or the second terminal device, which is conducive to improving the flexibility of realizing navigation control for the second terminal device, thereby being able to avoid In related technologies, on the premise that cross-device navigation control requires tedious operations such as clicking, reducing the difficulty of navigation control between terminal devices will help improve the efficiency and flexibility of multi-device collaborative work.

请参阅图9，图9是本申请实施例公开的一种导航控制方法的时序图，该导航控制方法可以应用于上述的第一终端设备与第二终端设备，该第一终端设备可以与第二终端设备通信连接，且第一终端设备设有投影窗口，该投影窗口用于显示与第二终端设备的屏幕界面对应的投影界面。如图9所示，该导航控制方法可以包括以下步骤：Please refer to Figure 9. Figure 9 is a sequence diagram of a navigation control method disclosed in an embodiment of the present application. The navigation control method can be applied to the above-mentioned first terminal device and the second terminal device. The first terminal device can be connected to the third terminal device. Two terminal devices are connected through communication, and the first terminal device is provided with a projection window, and the projection window is used to display a projection interface corresponding to the screen interface of the second terminal device. As shown in Figure 9, the navigation control method may include the following steps:

902、第一终端设备响应于针对投影界面的手势控制操作，获取与该手势控制操作对应的界面操作信息。902. In response to a gesture control operation on the projection interface, the first terminal device obtains interface operation information corresponding to the gesture control operation.

904、第一终端设备基于第二终端设备对应的目标导航模式，对该界面操作信息进行识别，得到上述手势控制操作对应的导航信号。904. The first terminal device recognizes the interface operation information based on the target navigation mode corresponding to the second terminal device, and obtains the navigation signal corresponding to the above gesture control operation.

906、第一终端设备将导航信号发送至第二终端设备。906. The first terminal device sends the navigation signal to the second terminal device.

908、第二终端设备根据导航信号，对屏幕界面执行与该导航信号对应的界面导航操作。908. The second terminal device performs an interface navigation operation corresponding to the navigation signal on the screen interface according to the navigation signal.

请一并参阅图10，图10是本申请实施例公开的另一种导航控制方法的时序图，该导航控制方法可以应用于如图9所示的第一终端设备及第二终端设备。如图10所示，该导航控制方法可以包括以下步骤：Please also refer to FIG. 10 , which is a sequence diagram of another navigation control method disclosed in an embodiment of the present application. The navigation control method can be applied to the first terminal device and the second terminal device shown in FIG. 9 . As shown in Figure 10, the navigation control method may include the following steps:

1002、第一终端设备响应于针对投影界面的手势控制操作，获取与该手势控制操作对应的界面操作信息。1002. In response to a gesture control operation on the projection interface, the first terminal device obtains interface operation information corresponding to the gesture control operation.

1004、第一终端设备将界面操作信息发送至第二终端设备。1004. The first terminal device sends the interface operation information to the second terminal device.

1006、第二终端设备基于该第二终端设备对应的目标导航模式，对界面操作信息进行识别，得到上述手势控制操作对应的导航信号。1006. The second terminal device recognizes the interface operation information based on the target navigation mode corresponding to the second terminal device, and obtains the navigation signal corresponding to the above gesture control operation.

1008、第二终端设备根据导航信号，对屏幕界面执行与该导航信号对应的界面导航操作。1008. The second terminal device performs an interface navigation operation corresponding to the navigation signal on the screen interface according to the navigation signal.

可见，实施上述时序图所描述的导航控制方法，能够基于用户针对第一终端设备的投影界面所进行的手势控制操作，在第二终端设备的屏幕界面上实现相应的导航控制，从而能够方便地实现多设备协同效果。其中，对于手势控制操作的具体识别过程既可以在第一终端设备上进行，也可以在第二终端设备上进行，有利于提升实现针对第二终端设备的导航控制的灵活性，从而能够在避免相关技术中需要通过点击等较为繁琐的操作才能进行跨设备导航控制的前提下，降低终端设备之间进行导航控制的难度，有利于提升多设备协同工作的效率以及灵活性。It can be seen that implementing the navigation control method described in the above sequence diagram can realize corresponding navigation control on the screen interface of the second terminal device based on the gesture control operation performed by the user on the projection interface of the first terminal device, thereby conveniently Achieve multi-device synergy effects. Among them, the specific recognition process of the gesture control operation can be performed on either the first terminal device or the second terminal device, which is conducive to improving the flexibility of realizing navigation control for the second terminal device, thereby being able to avoid In related technologies, on the premise that cross-device navigation control requires tedious operations such as clicking, reducing the difficulty of navigation control between terminal devices will help improve the efficiency and flexibility of multi-device collaborative work.

请参阅图11，图11是本申请实施例公开的一种导航控制装置的模块化示意图，该导航控制装置可以应用于上述的第一终端设备，该第一终端设备可以与第二终端设备通信连接，且第一终端设备设有投影窗口，该投影窗口用于显示与第二终端设备的屏幕界面对应的投影界面。如图11所示，该导航控制装置可以包括发送单元1101，其中：Please refer to Figure 11. Figure 11 is a modular schematic diagram of a navigation control device disclosed in an embodiment of the present application. The navigation control device can be applied to the above-mentioned first terminal device, and the first terminal device can communicate with the second terminal device. The first terminal device is connected, and the first terminal device is provided with a projection window, and the projection window is used to display a projection interface corresponding to the screen interface of the second terminal device. As shown in Figure 11, the navigation control device may include a sending unit 1101, wherein:

发送单元1101，用于响应于针对投影界面的手势控制操作，向第二终端设备发送与该手势控制操作对应的手势导航信息，以使第二终端设备根据上述手势导航信息，对屏幕界面执行与该手势导航信息对应的界面导航操作。The sending unit 1101 is configured to send gesture navigation information corresponding to the gesture control operation to the second terminal device in response to the gesture control operation on the projection interface, so that the second terminal device performs the operation on the screen interface according to the above gesture navigation information. The interface navigation operation corresponding to the gesture navigation information.

可见，采用上述实施例所描述的导航控制装置，能够基于用户针对第一终端设备的投影界面所进行的手势控制操作，在第二终端设备的屏幕界面上实现相应的导航控制，从而能够方便地实现多设备协同效果。这样的导航控制方法，可以避免通过点击等较为繁琐的操作来进行跨设备的导航控制，有利于降低终端设备之间进行导航控制的难度，从而能够有效提升多设备协同工作的效率以及灵活性。It can be seen that the navigation control device described in the above embodiment can implement corresponding navigation control on the screen interface of the second terminal device based on the gesture control operation performed by the user on the projection interface of the first terminal device, thereby conveniently Achieve multi-device synergy effects. Such a navigation control method can avoid cross-device navigation control through cumbersome operations such as clicking, and is helpful in reducing the difficulty of navigation control between terminal devices, thereby effectively improving the efficiency and flexibility of multi-device collaborative work.

在一种实施例中，上述手势导航信息可以包括手势控制操作对应的导航信号，则上述发送单元1101可以包括未图示的信息获取子单元、第一识别子单元以及信号发送子单元，其中：In one embodiment, the above-mentioned gesture navigation information may include navigation signals corresponding to gesture control operations, and the above-mentioned sending unit 1101 may include an information acquisition sub-unit, a first identification sub-unit and a signal sending sub-unit (not shown), wherein:

信息获取子单元，用于响应于针对投影界面的手势控制操作，获取与该手势控制操作对应的界面操作信息；An information acquisition subunit, configured to respond to a gesture control operation on the projection interface and obtain interface operation information corresponding to the gesture control operation;

第一识别子单元，用于基于第二终端设备对应的目标导航模式，对该界面操作信息进行识别，得到上述手势控制操作对应的导航信号；The first identification subunit is used to identify the interface operation information based on the target navigation mode corresponding to the second terminal device, and obtain the navigation signal corresponding to the above-mentioned gesture control operation;

信号发送子单元，用于将导航信号发送至第二终端设备，以使第二终端设备根据该导航信号，对屏幕界面执行与该导航信号对应的界面导航操作。The signal sending subunit is used to send the navigation signal to the second terminal device, so that the second terminal device performs an interface navigation operation corresponding to the navigation signal on the screen interface according to the navigation signal.

在一种实施例中，上述手势导航信息也可以包括手势控制操作对应的界面操作信息，则上述发送单元1101可以仅包括未图示的信息获取子单元以及信号发送子单元，其中：In one embodiment, the above-mentioned gesture navigation information may also include interface operation information corresponding to the gesture control operation, and the above-mentioned sending unit 1101 may only include an information acquisition sub-unit and a signal sending sub-unit (not shown), wherein:

信息获取子单元，用于响应于针对投影界面的手势控制操作，获取该手势控制操作对应的界面操作信息；An information acquisition subunit, configured to respond to a gesture control operation on the projection interface and obtain interface operation information corresponding to the gesture control operation;

信号发送子单元，用于将界面操作信息发送至第二终端设备，以使第二终端设备基于该第二终端设备对应的目标导航模式，对该界面操作信息进行识别，得到上述手势控制操作对应的导航信号，以及根据该导航信号，对屏幕界面执行与该导航信号对应的界面导航操作。The signal sending subunit is used to send the interface operation information to the second terminal device, so that the second terminal device recognizes the interface operation information based on the target navigation mode corresponding to the second terminal device, and obtains the above-mentioned gesture control operation correspondence. a navigation signal, and according to the navigation signal, perform an interface navigation operation corresponding to the navigation signal on the screen interface.

在一种实施例中，该导航控制装置还可以包括未图示的第一检测单元以及第二检测单元，其中：In one embodiment, the navigation control device may further include a first detection unit and a second detection unit (not shown), wherein:

第一检测单元，用于在上述发送单元1101响应于针对投影界面的手势控制操作，向第二终端设备发送与该手势控制操作对应的手势导航信息之前，检测投影界面与屏幕界面之间的同步状态；A first detection unit configured to detect synchronization between the projection interface and the screen interface before the sending unit 1101 responds to a gesture control operation on the projection interface and sends gesture navigation information corresponding to the gesture control operation to the second terminal device. state;

第二检测单元，用于在上述同步状态表示投影界面与屏幕界面保持同步的情况下，检测针对投影界面的手势控制操作。The second detection unit is used to detect the gesture control operation for the projection interface when the synchronization state indicates that the projection interface and the screen interface are synchronized.

其中，上述界面导航操作，至少可以包括界面后退操作、返回主页操作、任务栏操作以及菜单栏操作。Among them, the above-mentioned interface navigation operation may at least include an interface back operation, a return homepage operation, a taskbar operation, and a menu bar operation.

可见，采用上述实施例所描述的导航控制装置，能够基于在第一终端设备所进行的手势控制操作来实现对第二终端设备屏幕界面的导航控制，从而能够方便地对第二终端设备进行精确控制，实现多设备协同效果。这样的导航控制方法，可以避免通过点击等较为繁琐的操作来进行跨设备的导航控制，有利于降低终端设备之间进行导航控制的难度，从而能够有效提升多设备协同工作的效率以及灵活性。此外，对于手势控制操作的具体识别过程既可以在第一终端设备上进行，也可以在第二终端设备上进行，有利于进一步提升实现针对第二终端设备的导航控制的灵活性。It can be seen that by using the navigation control device described in the above embodiment, the navigation control of the screen interface of the second terminal device can be realized based on the gesture control operation performed on the first terminal device, so that the second terminal device can be accurately controlled conveniently. Control to achieve multi-device synergy effects. Such a navigation control method can avoid cross-device navigation control through cumbersome operations such as clicking, and is helpful in reducing the difficulty of navigation control between terminal devices, thereby effectively improving the efficiency and flexibility of multi-device collaborative work. In addition, the specific recognition process of the gesture control operation can be performed on either the first terminal device or the second terminal device, which is beneficial to further improving the flexibility of navigation control for the second terminal device.

请参阅图12，图12是本申请实施例公开的一种导航控制装置的模块化示意图，该导航控制装置可以应用于上述的第二终端设备，该第二终端设备可以与第一终端设备通信连接，且第一终端设备设有投影窗口，第二终端设备的屏幕界面投影于该投影窗口，可以得到该投影窗口上对应显示的投影界面。如图12所示，该导航控制装置可以包括接收单元1201以及导航执行单元1202，其中：Please refer to Figure 12. Figure 12 is a modular schematic diagram of a navigation control device disclosed in an embodiment of the present application. The navigation control device can be applied to the above-mentioned second terminal device. The second terminal device can communicate with the first terminal device. The first terminal device is connected, and the first terminal device is provided with a projection window, and the screen interface of the second terminal device is projected on the projection window, and the corresponding projection interface displayed on the projection window can be obtained. As shown in Figure 12, the navigation control device may include a receiving unit 1201 and a navigation execution unit 1202, where:

接收单元1201，用于接收第一终端设备发送的手势导航信息，其中，该手势导航信息是由第一终端设备响应于针对投影界面的手势控制操作，向第二终端设备发送的与该手势控制操作对应的手势导航信息；The receiving unit 1201 is configured to receive gesture navigation information sent by the first terminal device, wherein the gesture navigation information is sent by the first terminal device to the second terminal device in response to the gesture control operation for the projection interface and is related to the gesture control operation. Gesture navigation information corresponding to the operation;

导航执行单元1202，用于根据手势导航信息，对屏幕界面执行与该手势导航信息对应的界面导航操作。The navigation execution unit 1202 is configured to execute an interface navigation operation corresponding to the gesture navigation information on the screen interface according to the gesture navigation information.

在一种实施例中，上述手势导航信息可以包括手势控制操作对应的导航信号，该导航信号可以是由第一终端设备响应于针对投影界面的手势控制操作，基于第二终端设备对应的目标导航模式，对与该手势控制操作对应的界面操作信息进行识别所得到的。在此基础上，上述导航执行单元1202，具体可以用于：In one embodiment, the above gesture navigation information may include a navigation signal corresponding to the gesture control operation. The navigation signal may be generated by the first terminal device in response to the gesture control operation for the projection interface, based on the target navigation corresponding to the second terminal device. Mode, obtained by identifying the interface operation information corresponding to the gesture control operation. On this basis, the above-mentioned navigation execution unit 1202 can be specifically used to:

根据上述导航信号，对屏幕界面执行与该导航信号对应的界面导航操作。According to the above navigation signal, an interface navigation operation corresponding to the navigation signal is performed on the screen interface.

在一种实施例中，上述手势导航信息也可以包括手势控制操作对应的界面操作信息，则上述导航执行单元1202可以包括未图示的第二识别子单元以及导航执行子单元，其中：In one embodiment, the above-mentioned gesture navigation information may also include interface operation information corresponding to the gesture control operation, and the above-mentioned navigation execution unit 1202 may include a second recognition sub-unit and a navigation execution sub-unit (not shown), wherein:

第二识别子单元，用于基于第二终端设备对应的目标导航模式，对上述界面操作信息进行识别，得到上述手势控制操作对应的导航信号；The second identification subunit is used to identify the above-mentioned interface operation information based on the target navigation mode corresponding to the second terminal device, and obtain the navigation signal corresponding to the above-mentioned gesture control operation;

导航执行子单元，用于根据该导航信号，对屏幕界面执行与该导航信号对应的界面导航操作。The navigation execution subunit is used to execute an interface navigation operation corresponding to the navigation signal on the screen interface according to the navigation signal.

可见，采用上述实施例所描述的导航控制装置，能够基于在第一终端设备所进行的手势控制操作来实现对第二终端设备屏幕界面的导航控制，从而能够方便地对第二终端设备进行精确控制，实现多设备协同效果。这样的导航控制方法，可以避免通过点击等较为繁琐的操作来进行跨设备的导航控制，有利于降低终端设备之间进行导航控制的难度，从而能够有效提升多设备协同工作的效率以及灵活性。此外，对于手势控制操作的具体识别过程既可以在第一终端设备上进行，也可以在第二终端设备上进行，有利于提升实现针对第二终端设备的导航控制的灵活性。It can be seen that by using the navigation control device described in the above embodiment, the navigation control of the screen interface of the second terminal device can be realized based on the gesture control operation performed on the first terminal device, so that the second terminal device can be accurately controlled conveniently. Control to achieve multi-device synergy effects. Such a navigation control method can avoid cross-device navigation control through cumbersome operations such as clicking, and is helpful in reducing the difficulty of navigation control between terminal devices, thereby effectively improving the efficiency and flexibility of multi-device collaborative work. In addition, the specific recognition process of the gesture control operation can be performed on either the first terminal device or the second terminal device, which is beneficial to improving the flexibility of navigation control for the second terminal device.

请参阅图13，图13是本申请实施例公开的一种终端设备的模块化示意图。如图13所示，该终端设备可以包括：Please refer to Figure 13, which is a modular schematic diagram of a terminal device disclosed in an embodiment of the present application. As shown in Figure 13, the terminal device may include:

存储有可执行程序代码的存储器1301； Memory 1301 storing executable program code;

与存储器1301耦合的处理器1302； processor 1302 coupled to memory 1301;

其中，处理器1302调用存储器1301中存储的可执行程序代码，可以执行上述实施例所描述的任意一种应用于第一终端设备或第二终端设备的导航控制方法中的全部或部分步骤。The processor 1302 calls the executable program code stored in the memory 1301 to execute all or part of the steps in any navigation control method applied to the first terminal device or the second terminal device described in the above embodiments.

此外，本申请实施例进一步公开了一种计算机可读存储介质，其存储用于电子数据交换的计算机程序，其中，该计算机程序使得计算机可以执行上述实施例所描述的任意一种应用于第一终端设备或第二终端设备的导航控制方法中的全部或部分步骤。In addition, embodiments of the present application further disclose a computer-readable storage medium that stores a computer program for electronic data exchange, wherein the computer program enables the computer to execute any of the methods described in the above embodiments for the first application. All or part of the steps in the navigation control method of the terminal device or the second terminal device.

此外，本申请实施例进一步公开一种计算机程序产品，当该计算机程序产品在计算机上运行时，使得计算机可以执行上述实施例所描述的任意一种应用于第一终端设备或第二终端设备的导航控制方法中的全部或部分步骤。In addition, embodiments of the present application further disclose a computer program product. When the computer program product is run on a computer, the computer can execute any of the methods described in the above embodiments and applied to the first terminal device or the second terminal device. Navigation controls all or some of the steps in a method.

本领域普通技术人员可以理解上述实施例的各种方法中的全部或部分步骤是可以通过程序来指令相关的硬件来完成，该程序可以存储于一计算机可读存储介质中，存储介质包括只读存储器(Read-Only Memory，ROM)、随机存储器(Random Access Memory，RAM)、可编程只读存储器(Programmable Read-only Memory，PROM)、可擦除可编程只读存储器(Erasable Programmable Read Only Memory，EPROM)、一次可编程只读存储器(One-time Programmable Read-Only Memory，OTPROM)、电子抹除式可复写只读存储器(Electrically-Erasable Programmable Read-Only Memory，EEPROM)、只读光盘(Compact Disc Read-Only Memory，CD-ROM)或其它光盘存储器、磁盘存储器、磁带存储器、或者能够用于携带或存储数据的计算机可读的任何其它介质。Those of ordinary skill in the art can understand that all or part of the steps in the various methods of the above embodiments can be completed by instructing relevant hardware through a program. The program can be stored in a computer-readable storage medium, and the storage medium includes a read-only storage medium. Memory (Read-Only Memory, ROM), random access memory (Random Access Memory, RAM), programmable read-only memory (Programmable Read-only Memory, PROM), erasable programmable read-only memory (Erasable Programmable Read Only Memory, EPROM), One-time Programmable Read-Only Memory (OTPROM), Electronically Erasable Programmable Read-Only Memory (EEPROM), Compact Disc Read-Only Memory (CD-ROM) or other optical disk storage, magnetic disk storage, magnetic tape storage, or any other computer-readable medium that can be used to carry or store data.

以上对本申请实施例公开的一种导航控制方法及装置、终端设备、存储介质进行了详细介绍，本文中应用了具体个例对本申请的原理及实施方式进行了阐述，以上实施例的说明只是用于帮助理解本申请的方法及其核心思想；同时，对于本领域的一般技术人员，依据本申请的思想，在具体实施方式及应用范围上均会有改变之处，综上所述，本说明书内容不应理解为对本申请的限制。The navigation control method and device, terminal equipment, and storage medium disclosed in the embodiments of the present application have been introduced in detail above. Specific examples are used in this article to illustrate the principles and implementation methods of the present application. The description of the above embodiments is only for To help understand the methods and core ideas of this application; at the same time, for those of ordinary skill in the field, there will be changes in the specific implementation methods and application scope based on the ideas of this application. In summary, this specification The contents should not be construed as limitations on this application.

Claims

一种导航控制方法，其特征在于，应用于第一终端设备，所述第一终端设备与第二终端设备通信连接，且所述第一终端设备设有投影窗口，所述投影窗口用于显示与所述第二终端设备的屏幕界面对应的投影界面，所述方法包括：A navigation control method, characterized in that it is applied to a first terminal device, the first terminal device is communicatively connected to a second terminal device, and the first terminal device is provided with a projection window, and the projection window is used to display The projection interface corresponding to the screen interface of the second terminal device, the method includes:

响应于针对所述投影界面的手势控制操作，向所述第二终端设备发送与所述手势控制操作对应的手势导航信息，以使所述第二终端设备根据所述手势导航信息，对所述屏幕界面执行与所述手势导航信息对应的界面导航操作。In response to the gesture control operation on the projection interface, sending gesture navigation information corresponding to the gesture control operation to the second terminal device, so that the second terminal device performs the navigation on the projection interface according to the gesture navigation information. The screen interface performs interface navigation operations corresponding to the gesture navigation information.
根据权利要求1所述的方法，其特征在于，所述手势导航信息包括所述手势控制操作对应的导航信号，所述响应于针对所述投影界面的手势控制操作，向所述第二终端设备发送与所述手势控制操作对应的手势导航信息，包括：The method of claim 1, wherein the gesture navigation information includes a navigation signal corresponding to the gesture control operation, and in response to the gesture control operation for the projection interface, the second terminal device Send gesture navigation information corresponding to the gesture control operation, including:

响应于针对所述投影界面的手势控制操作，获取与所述手势控制操作对应的界面操作信息；In response to a gesture control operation on the projection interface, obtain interface operation information corresponding to the gesture control operation;

基于所述第二终端设备对应的目标导航模式，对所述界面操作信息进行识别，得到所述手势控制操作对应的所述导航信号；Based on the target navigation mode corresponding to the second terminal device, identify the interface operation information to obtain the navigation signal corresponding to the gesture control operation;

将所述导航信号发送至所述第二终端设备，以使所述第二终端设备根据所述导航信号，对所述屏幕界面执行与所述导航信号对应的界面导航操作。The navigation signal is sent to the second terminal device, so that the second terminal device performs an interface navigation operation corresponding to the navigation signal on the screen interface according to the navigation signal.
根据权利要求1所述的方法，其特征在于，所述手势导航信息包括所述手势控制操作对应的界面操作信息，所述响应于针对所述投影界面的手势控制操作，向所述第二终端设备发送与所述手势控制操作对应的手势导航信息，包括：The method of claim 1, wherein the gesture navigation information includes interface operation information corresponding to the gesture control operation, and in response to the gesture control operation for the projection interface, the second terminal The device sends gesture navigation information corresponding to the gesture control operation, including:

响应于针对所述投影界面的手势控制操作，获取所述手势控制操作对应的所述界面操作信息；In response to a gesture control operation on the projection interface, obtain the interface operation information corresponding to the gesture control operation;

将所述界面操作信息发送至所述第二终端设备，以使所述第二终端设备基于所述第二终端设备对应的目标导航模式，对所述界面操作信息进行识别，得到所述手势控制操作对应的导航信号，以及根据所述导航信号，对所述屏幕界面执行与所述导航信号对应的界面导航操作。Send the interface operation information to the second terminal device, so that the second terminal device recognizes the interface operation information based on the target navigation mode corresponding to the second terminal device to obtain the gesture control operate a corresponding navigation signal, and perform an interface navigation operation corresponding to the navigation signal on the screen interface according to the navigation signal.
根据权利要求1至3任一项所述的方法，其特征在于，在所述响应于针对所述投影界面的手势控制操作，向所述第二终端设备发送与所述手势控制操作对应的手势导航信息之前，所述方法还包括：The method according to any one of claims 1 to 3, characterized in that, in response to the gesture control operation for the projection interface, sending a gesture corresponding to the gesture control operation to the second terminal device Before navigating information, the method further includes:

检测所述投影界面与所述屏幕界面之间的同步状态；Detect the synchronization status between the projection interface and the screen interface;

在所述同步状态表示所述投影界面与所述屏幕界面保持同步的情况下，检测针对所述投影界面的手势控制操作。When the synchronization state indicates that the projection interface is synchronized with the screen interface, a gesture control operation for the projection interface is detected.
根据权利要求1至3任一项所述的方法，其特征在于，所述界面导航操作，至少包括界面后退操作、返回主页操作、任务栏操作以及菜单栏操作。The method according to any one of claims 1 to 3, characterized in that the interface navigation operation includes at least an interface back operation, a return home page operation, a task bar operation and a menu bar operation.
根据权利要求1至3任一项所述的方法，其特征在于，所述手势控制操作至少包括鼠标手势，所述鼠标手势为通过移动鼠标实现的手势操作，所述鼠标为所述第一终端设备的外接设备。The method according to any one of claims 1 to 3, characterized in that the gesture control operation at least includes a mouse gesture, the mouse gesture is a gesture operation implemented by moving a mouse, and the mouse is the first terminal The device's external devices.
一种导航控制方法，其特征在于，应用于第二终端设备，所述第二终端设备与第一终端设备通信连接，且所述第一终端设备设有投影窗口，所述第二终端设备的屏幕界面投影于所述投影窗口，得到所述投影窗口上对应显示的投影界面，所述方法包括：A navigation control method, characterized in that it is applied to a second terminal device, the second terminal device is communicatively connected to a first terminal device, and the first terminal device is provided with a projection window, and the second terminal device is The screen interface is projected on the projection window to obtain the corresponding projection interface displayed on the projection window. The method includes:

接收所述第一终端设备发送的手势导航信息，其中，所述手势导航信息是由所述第一终端设备响应于针对所述投影界面的手势控制操作，向所述第二终端设备发送的与所述手势控制操作对应的手势导航信息；Receive gesture navigation information sent by the first terminal device, wherein the gesture navigation information is sent by the first terminal device to the second terminal device in response to a gesture control operation for the projection interface. Gesture navigation information corresponding to the gesture control operation;

根据所述手势导航信息，对所述屏幕界面执行与所述手势导航信息对应的界面导航操作。According to the gesture navigation information, an interface navigation operation corresponding to the gesture navigation information is performed on the screen interface.
根据权利要求7所述的方法，其特征在于，所述手势导航信息包括所述手势控制操作对应的导航信号，所述导航信号是由所述第一终端设备响应于针对所述投影界面的手势控制操作，基于所述第二终端设备对应的目标导航模式，对与所述手势控制操作对应的界面操作信息进行识别所得到的，所述根据所述手势导航信息，对所述屏幕界面执行与所述手势导航信息对应的界面导航操作，包括：The method of claim 7, wherein the gesture navigation information includes a navigation signal corresponding to the gesture control operation, and the navigation signal is generated by the first terminal device in response to a gesture directed to the projection interface. The control operation is obtained by identifying the interface operation information corresponding to the gesture control operation based on the target navigation mode corresponding to the second terminal device. According to the gesture navigation information, the screen interface is executed with The interface navigation operations corresponding to the gesture navigation information include:

根据所述导航信号，对所述屏幕界面执行与所述导航信号对应的界面导航操作。According to the navigation signal, an interface navigation operation corresponding to the navigation signal is performed on the screen interface.
根据权利要求7所述的方法，其特征在于，所述手势导航信息包括所述手势控制操作对应的界面操作信息，所述根据所述手势导航信息，对所述屏幕界面执行与所述手势导航信息对应的界面导航操作，包括：The method of claim 7, wherein the gesture navigation information includes interface operation information corresponding to the gesture control operation, and the gesture navigation is performed on the screen interface according to the gesture navigation information. Interface navigation operations corresponding to the information include:

基于所述第二终端设备对应的目标导航模式，对所述界面操作信息进行识别，得到所述手势控制操作对应的导航信号；Based on the target navigation mode corresponding to the second terminal device, identify the interface operation information to obtain a navigation signal corresponding to the gesture control operation;

根据所述导航信号，对所述屏幕界面执行与所述导航信号对应的界面导航操作。According to the navigation signal, an interface navigation operation corresponding to the navigation signal is performed on the screen interface.
一种导航控制装置，其特征在于，应用于第一终端设备，所述第一终端设备与第二终端设备通信连接，且所述第一终端设备设有投影窗口，所述投影窗口用于显示与所述第二终端设备的屏幕界面对应的投影界面，所述导航控制装置包括：A navigation control device, characterized in that it is applied to a first terminal device, the first terminal device is communicatively connected to a second terminal device, and the first terminal device is provided with a projection window, and the projection window is used to display A projection interface corresponding to the screen interface of the second terminal device, the navigation control device includes:

发送单元，用于响应于针对所述投影界面的手势控制操作，向所述第二终端设备发送与所述手势控制操作对应的手势导航信息，以使所述第二终端设备根据所述手势导航信息，对所述屏幕界面执行与所述手势导航信息对应的界面导航操作。A sending unit configured to, in response to a gesture control operation on the projection interface, send gesture navigation information corresponding to the gesture control operation to the second terminal device, so that the second terminal device navigates according to the gesture information, and perform an interface navigation operation corresponding to the gesture navigation information on the screen interface.
根据权利要求10所述的导航控制装置，其特征在于，所述手势导航信息包括所述手势控制操作对应的导航信号，所述发送单元包括信息获取子单元、第一识别子单元以及信号发送子单元，其中：The navigation control device according to claim 10, wherein the gesture navigation information includes a navigation signal corresponding to the gesture control operation, and the sending unit includes an information acquisition subunit, a first identification subunit and a signal sending subunit. unit, where:

所述信息获取子单元，用于响应于针对所述投影界面的手势控制操作，获取与所述手势控制操作对应的界面操作信息；The information acquisition subunit is configured to obtain interface operation information corresponding to the gesture control operation in response to a gesture control operation on the projection interface;

所述第一识别子单元，用于基于所述第二终端设备对应的目标导航模式，对所述界面操作信息进行识别，得到所述手势控制操作对应的所述导航信号；The first identification subunit is used to identify the interface operation information based on the target navigation mode corresponding to the second terminal device, and obtain the navigation signal corresponding to the gesture control operation;

所述信号发送子单元，用于将所述导航信号发送至所述第二终端设备，以使所述第二终端设备根据所述导航信号，对所述屏幕界面执行与所述导航信号对应的界面导航操作。The signal sending subunit is used to send the navigation signal to the second terminal device, so that the second terminal device performs operations corresponding to the navigation signal on the screen interface according to the navigation signal. Interface navigation operations.
根据权利要求10所述的导航控制装置，其特征在于，所述手势导航信息包括所述手势控制操作对应的界面操作信息，所述发送单元包括信息获取子单元以及信号发送子单元，其中：The navigation control device according to claim 10, wherein the gesture navigation information includes interface operation information corresponding to the gesture control operation, and the sending unit includes an information acquisition subunit and a signal sending subunit, wherein:

所述信息获取子单元，用于响应于针对所述投影界面的手势控制操作，获取所述手势控制操作对应的界面操作信息；The information acquisition subunit is configured to acquire interface operation information corresponding to the gesture control operation in response to a gesture control operation on the projection interface;

所述信号发送子单元，用于将所述界面操作信息发送至所述第二终端设备，以使所述第二终端设备基于所述第二终端设备对应的目标导航模式，对所述界面操作信息进行识别，得到所述手势控制操作对应的导航信号，以及根据所述导航信号，对所述屏幕界面执行与所述导航信号对应的界面导航操作。The signal sending subunit is used to send the interface operation information to the second terminal device, so that the second terminal device operates the interface based on the target navigation mode corresponding to the second terminal device. The information is identified to obtain the navigation signal corresponding to the gesture control operation, and based on the navigation signal, the interface navigation operation corresponding to the navigation signal is performed on the screen interface.
根据权利要求10至12任一项所述的导航控制装置，其特征在于，所述导航控制装置还包括第一检测单元以及第二检测单元，其中：The navigation control device according to any one of claims 10 to 12, characterized in that the navigation control device further includes a first detection unit and a second detection unit, wherein:

所述第一检测单元，用于在所述发送单元响应于针对所述投影界面的手势控制操作，向所述第二终端设备发送与所述手势控制操作对应的手势导航信息之前，检测所述投影界面与屏幕界面之间的同步状态；The first detection unit is configured to detect the gesture navigation information corresponding to the gesture control operation before the sending unit responds to the gesture control operation for the projection interface and sends the gesture navigation information corresponding to the gesture control operation to the second terminal device. The synchronization status between the projection interface and the screen interface;

所述第二检测单元，用于在所述同步状态表示所述投影界面与所述屏幕界面保持同步的情况下，检测针对所述投影界面的手势控制操作。The second detection unit is configured to detect a gesture control operation for the projection interface when the synchronization state indicates that the projection interface is synchronized with the screen interface.
根据权利要求10至12任一项所述的导航控制装置，其特征在于，所述界面导航操作，至少包括界面后退操作、返回主页操作、任务栏操作以及菜单栏操作。The navigation control device according to any one of claims 10 to 12, characterized in that the interface navigation operation includes at least an interface back operation, a return home page operation, a task bar operation and a menu bar operation.
根据权利要求10至12任一项所述的导航控制装置，其特征在于，所述手势控制操作至少包括鼠标手势，所述鼠标手势为通过移动鼠标实现的手势操作，所述鼠标为所述第一终端设备的外接设备。The navigation control device according to any one of claims 10 to 12, wherein the gesture control operation at least includes a mouse gesture, the mouse gesture is a gesture operation implemented by moving a mouse, and the mouse is the first An external device for a terminal device.
一种导航控制装置，其特征在于，应用于第二终端设备，所述第二终端设备与第一终端设备通信连接，且所述第一终端设备设有投影窗口，所述第二终端设备的屏幕界面投影于所述投影窗口，得到所述投影窗口上对应显示的投影界面，所述导航控制装置包括：A navigation control device, characterized in that it is applied to a second terminal device, the second terminal device is communicatively connected to a first terminal device, and the first terminal device is provided with a projection window, and the second terminal device is The screen interface is projected on the projection window to obtain the corresponding projection interface displayed on the projection window. The navigation control device includes:

接收单元，用于接收所述第一终端设备发送的手势导航信息，其中，所述手势导航信息是由所述第一终端设备响应于针对所述投影界面的手势控制操作，向所述第二终端设备发送的与所述手势控制操作对应的手势导航信息；A receiving unit configured to receive gesture navigation information sent by the first terminal device, wherein the gesture navigation information is sent by the first terminal device to the second terminal device in response to a gesture control operation on the projection interface. Gesture navigation information corresponding to the gesture control operation sent by the terminal device;

导航执行单元，用于根据所述手势导航信息，对所述屏幕界面执行与所述手势导航信息对应的界面导航操作。A navigation execution unit, configured to execute an interface navigation operation corresponding to the gesture navigation information on the screen interface according to the gesture navigation information.
根据权利要求16所述的导航控制装置，其特征在于，所述手势导航信息包括所述手势控制操作对应的导航信号，所述导航信号是由所述第一终端设备响应于针对所述投影界面的手势控制操作，基于所述第二终端设备对应的目标导航模式，对与所述手势控制操作对应的界面操作信息进行识别所得到的；The navigation control device according to claim 16, wherein the gesture navigation information includes a navigation signal corresponding to the gesture control operation, and the navigation signal is generated by the first terminal device in response to the projection interface. The gesture control operation is obtained by identifying the interface operation information corresponding to the gesture control operation based on the target navigation mode corresponding to the second terminal device;

所述导航执行单元，用于：The navigation execution unit is used for:

根据所述导航信号，对所述屏幕界面执行与所述导航信号对应的界面导航操作。According to the navigation signal, an interface navigation operation corresponding to the navigation signal is performed on the screen interface.
根据权利要求16所述的导航控制装置，其特征在于，所述手势导航信息包括所述手势控制操作对应的界面操作信息，所述导航执行单元包括第二识别子单元以及导航执行子单元，其中：The navigation control device according to claim 16, wherein the gesture navigation information includes interface operation information corresponding to the gesture control operation, and the navigation execution unit includes a second identification subunit and a navigation execution subunit, wherein :

所述第二识别子单元，用于基于所述第二终端设备对应的目标导航模式，对所述界面操作信息进行识别，得到所述手势控制操作对应的导航信号；The second identification subunit is used to identify the interface operation information based on the target navigation mode corresponding to the second terminal device, and obtain the navigation signal corresponding to the gesture control operation;

所述导航执行子单元，用于根据所述导航信号，对所述屏幕界面执行与所述导航信号对应的界面导航操作。The navigation execution subunit is configured to execute an interface navigation operation corresponding to the navigation signal on the screen interface according to the navigation signal.
一种终端设备，其特征在于，所述终端设备包括存储器及处理器，所述存储器中存储有计算机程序，所述计算机程序被所述处理器执行时，使得所述处理器实现如权利要求1至6任一项所述的方法，或者如权利要求7至9任一项所述的方法。A terminal device, characterized in that the terminal device includes a memory and a processor, a computer program is stored in the memory, and when the computer program is executed by the processor, the processor implements the method of claim 1 The method according to any one of claims 7 to 9, or the method according to any one of claims 7 to 9.
一种计算机可读存储介质，其上存储有计算机程序，其特征在于，所述计算机程序被处理器执行时实现如权利要求1至6任一项所述的方法，或者如权利要求7至9任一项所述的方法。A computer-readable storage medium with a computer program stored thereon, characterized in that when the computer program is executed by a processor, the method as claimed in any one of claims 1 to 6 is implemented, or as claimed in claims 7 to 9 any of the methods described.