WO2019001060A1

WO2019001060A1 - Application display method and device, three-dimensional space display interface operation method and device, display method and device, application content display method and device, and terminal device

Info

Publication number: WO2019001060A1
Application number: PCT/CN2018/081355
Authority: WO
Inventors: 曾良军
Original assignee: 曾良军
Priority date: 2017-06-26
Filing date: 2018-03-30
Publication date: 2019-01-03

Abstract

The present invention provides an application display method and device, the method comprising: receiving a three-dimensional picture display instruction, the three-dimensional picture including M display panels and a control panel; selecting, according to the number of display panels included in the three-dimensional picture, M applications from applications running in the background, and determining a display panel corresponding to each application; Displaying, in the control panel, the application information about a plurality of applications installed in a system, and displaying, in a corresponding display panel, the determined application interface information about each application respectively. Further disclosed is a corresponding application display device.

Description

应用显示方法和装置、三维空间显示界面的操作方法和装置、显示方法和装置、应用内容的展示方法和装置，及终端设备Display method and device, operation method and device of three-dimensional space display interface, display method and device, display method and device for application content, and terminal device

本申请要求于2017年06月26日提交中国专利局的申请号为CN201710494686.8名称为“一种应用显示方法和装置”及2017年11月24日提交中国专利局的申请号为CN201711200382.2名称为“三维空间显示界面的操作方法、装置和终端设备”、申请号为CN201711200385.6名称为“显示方法、装置和终端设备”和申请号为CN201711201082.6名称为“应用内容的展示方法、装置和终端设备”的中国专利申请的优先权，其全部内容通过引用结合在本申请中。This application claims that the application number of CN201710494686.8 submitted to the China Patent Office on June 26, 2017 is “an application display method and device” and the application number submitted to the China Patent Office on November 24, 2017 is CN201711200382.2. The name is "Operation method, device and terminal device of the three-dimensional space display interface", the application number is CN201711200385.6, the name is "display method, device and terminal device" and the application number is CN201711201082.6, the name is "display method of application content, The priority of the Chinese patent application of the device and the terminal device is hereby incorporated by reference in its entirety.

技术领域Technical field

本发明涉及软件应用技术领域，具体而言，涉及一种应用显示方法和装置、三维空间显示界面的操作方法和装置、显示方法和装置、应用内容的展示方法和装置，及终端设备。The present invention relates to the field of software application technologies, and in particular, to an application display method and apparatus, an operation method and apparatus for a three-dimensional space display interface, a display method and apparatus, a display method and apparatus for application content, and a terminal device.

背景技术Background technique

目前，终端设备中驻留有多种应用，每个应用通过显示屏进行平面显示，当用户希望同时使用不同的应用时，仅能退出当前的应用，打开另外需求的应用，不能通过显示屏同时显示多个应用，使得切换比较繁琐，客户体验比较差。At present, there are multiple applications in the terminal device, and each application performs flat display through the display screen. When the user wants to use different applications at the same time, only the current application can be exited, and another application that needs is opened, and the display cannot be simultaneously Displaying multiple applications makes switching difficult and the customer experience is poor.

发明内容Summary of the invention

有鉴于此，本发明的目的在于提供一种应用显示方法和装置，用于解决现有技术中在无法在三维画面同时显示多个应用的问题。In view of this, an object of the present invention is to provide an application display method and apparatus for solving the problem in the prior art that multiple applications cannot be simultaneously displayed on a three-dimensional screen.

第一方面，本发明的实施例提供一种应用显示方法，应用于终端设备，所述方法包括：In a first aspect, an embodiment of the present invention provides an application display method, which is applied to a terminal device, where the method includes:

接收三维画面显示指令，所述三维画面中包含M个显示面板和控制面板；Receiving a three-dimensional picture display instruction, where the three-dimensional picture includes M display panels and a control panel;

根据所述三维画面中包含的显示面板数量，在后台运行的应用中选择M个应用，并确定与每个应用对应的显示面板；Selecting M applications in an application running in the background according to the number of display panels included in the three-dimensional screen, and determining a display panel corresponding to each application;

将确定的每个应用的应用界面信息分别显示在对应的显示面板中，将***安装的应用的应用信息均显示在控制面板中。The determined application interface information of each application is respectively displayed in the corresponding display panel, and the application information of the installed application of the system is displayed in the control panel.

可选地，应用窗口包括显示面板和控制面板，所述方法还包括：Optionally, the application window includes a display panel and a control panel, and the method further includes:

通过所述应用窗口接收用户的操作指令；Receiving an operation instruction of the user through the application window;

当接收到所述操作指令时，按照所述操作指令在所述三维画面中展示应用内容。When the operation instruction is received, the application content is displayed in the three-dimensional screen according to the operation instruction.

可选地，当所述操作指令包括三维画面修改指令时，所述按照所述操作指令在所述三维画面中展示应用内容的步骤，包括：Optionally, when the operation instruction includes a three-dimensional picture modification instruction, the step of displaying the application content in the three-dimensional picture according to the operation instruction includes:

将所述三维画面修改指令中的修改内容，添加至所述三维画面中，根据所述三维画面修改指令中的坐标，调整所述修改内容在所述三维画面中的位置，显示当前三维画面。Adding the modified content in the three-dimensional picture modification instruction to the three-dimensional picture, and adjusting the position of the modified content in the three-dimensional picture according to the coordinates in the three-dimensional picture modification instruction, and displaying the current three-dimensional picture.

可选地，所述方法还包括：当接收到所述操作指令时，按照所述操作指令显示所述三维画面和/或所述应用窗口；Optionally, the method further includes: displaying the three-dimensional picture and/or the application window according to the operation instruction when receiving the operation instruction;

当所述操作指令包括三维画面显示指令时，所述按照所述操作指令显示所述三维画面的步骤，包括：When the operation instruction includes a three-dimensional screen display instruction, the step of displaying the three-dimensional image according to the operation instruction includes:

按照所述三维画面显示指令，显示所述三维画面；其中，所述三维画面显示指令包括显示视角或显示模式；所述显示视角至少包括平行视角或望远镜视角；所述显示模式至少包括平面模式、球面模式、曲面模式或异形模式；Displaying the three-dimensional picture according to the three-dimensional picture display instruction; wherein the three-dimensional picture display instruction includes a display angle of view or a display mode; the display angle of view includes at least a parallel angle of view or a telescope angle; the display mode includes at least a plane mode, Spherical mode, surface mode or profiled mode;

当所述操作指令包括应用窗口显示指令时，所述按照所述操作指令显示所述应用窗口的步骤，包括：When the operation instruction includes an application window display instruction, the step of displaying the application window according to the operation instruction includes:

当所述应用窗口显示指令为隐藏应用窗口时，隐藏所述应用窗口，将所述三维画面进行全屏显示；当所述应用窗口显示指令为显示应用窗口时，显示所述应用窗口，将所述三维画面进行半屏显示；或者，所述应用窗口以透明或半透明的形式覆盖于所述三维画面上。When the application window display instruction is a hidden application window, the application window is hidden, and the three-dimensional image is displayed in full screen; when the application window display instruction is to display an application window, the application window is displayed, and the application window is The three-dimensional picture is displayed in half screen; or the application window is overlaid on the three-dimensional picture in a transparent or translucent form.

可选地，所述应用窗口内设置有多个操作单元；Optionally, a plurality of operation units are disposed in the application window;

每个所述操作单元通过接收触屏信号获取设定类型的操作指令；Each of the operation units acquires a set type of operation instruction by receiving a touch screen signal;

或者，所述显示界面上还显示有操作盘和瞄点；通过所述操作盘和所述瞄点，每个所述操作单元获取设定类型的操作指令。Alternatively, the display interface further displays an operation panel and an aiming point; each of the operation units acquires a set type of operation instruction by the operation panel and the aiming point.

可选地，所述方法还包括：Optionally, the method further includes:

接收用户发出的对象操作指令；其中，所述对象操作指令包括语音指令、手势指令或操作指令；Receiving an object operation instruction issued by a user; wherein the object operation instruction includes a voice instruction, a gesture instruction, or an operation instruction;

从当前的三维画面中，确定接收到所述对象操作指令时，瞄点瞄准的对象；Determining, from the current three-dimensional picture, an object targeted by the aiming point when receiving the object operation instruction;

选中所述对象，对所述对象进行控制操作。The object is selected to perform control operations on the object.

可选地，当所述对象操作指令包括语音指令时，所述接收用户发出的对象操作指令的步骤，包括：Optionally, when the object operation instruction includes a voice instruction, the step of receiving an object operation instruction issued by a user includes:

通过麦克风接收用户发出的语音信号，判断所述语音信号中是否包含预设的关键字，如果是，将所述语音信号中包含的所述关键字确定为所述对象操作指令；或Receiving, by the microphone, a voice signal sent by the user, determining whether the voice signal includes a preset keyword, and if yes, determining the keyword included in the voice signal as the object operation instruction; or

通过摄像装置接收用户发出的手势视频信号，判断所述手势视频信号中是否包含预设的手势特征，如果是，将所述手势视频信号中包含的所述手势特征确定为所述对象操作指令。Receiving, by the camera device, the gesture video signal sent by the user, determining whether the gesture video signal includes a preset gesture feature, and if yes, determining the gesture feature included in the gesture video signal as the object operation instruction.

可选地，所述方法还包括：通过传感器装置检测所述用户头部的运动状态；根据所述运动状态，控制所述瞄点在三维画面中移动。Optionally, the method further includes: detecting, by the sensor device, a motion state of the user's head; and controlling, according to the motion state, the target point to move in a three-dimensional picture.

可选地，所述终端设备的显示界面用于显示三维画面，所述三维画面内包括3D元素和应用窗口，所述方法包括：Optionally, the display interface of the terminal device is configured to display a three-dimensional image, where the three-dimensional image includes a 3D element and an application window, and the method includes:

根据接收到的传感信号，将所述三维画面的对应部分显示在所述显示界面中；所述传感信号包括所述终端的运动状态，或者，用户触发的触屏信号；所述运动状态包括所述终端的位置和角度；Displaying, according to the received sensing signal, a corresponding portion of the three-dimensional picture in the display interface; the sensing signal includes a motion state of the terminal, or a touch screen signal triggered by a user; the motion state Including the position and angle of the terminal;

当接收到用户操作指令时，按照所述操作指令在三维画面中显示所述3D元素和/或所述应用窗口。When the user operation instruction is received, the 3D element and/or the application window are displayed in a three-dimensional screen according to the operation instruction.

可选地，当所述三维画面内包括多个应用窗口时，至少一个所述应用窗口用于接收用户触发的三维画面设置指令；Optionally, when the three-dimensional picture includes multiple application windows, at least one of the application windows is configured to receive a user-triggered three-dimensional picture setting instruction;

所述按照所述操作指令在三维画面中显示所述应用窗口的步骤，包括：The step of displaying the application window in a three-dimensional screen according to the operation instruction includes:

当所述三维画面设置指令中包括窗口设置指令时，按照所述窗口设置指令在所述三维画面中显示所述应用窗口；其中，所述窗口设置指令至少包括窗口添加指令、窗口位置指令、窗口视角指令、窗口显示设置指令、窗口大小调整指令、窗口旋转方式指令、窗口排列指令和窗口显示形状设置指令中的多种；所述窗口显示形状设置指令至少包括平面模式、球面模式、曲面模式或异形模式。When the window setting instruction includes a window setting instruction, displaying the application window in the three-dimensional screen according to the window setting instruction; wherein the window setting instruction includes at least a window adding instruction, a window position instruction, and a window a plurality of angle view instructions, a window display setting instruction, a window size adjustment instruction, a window rotation mode instruction, a window arrangement instruction, and a window display shape setting instruction; the window display shape setting instruction includes at least a plane mode, a spherical mode, a surface mode, or Alien mode.

第二方面，本发明实施例提供一种应用显示装置，应用于终端设备，所述装置包括：In a second aspect, an embodiment of the present invention provides an application display device, which is applied to a terminal device, where the device includes:

接收单元，用于接收三维画面显示指令，所述三维画面中包含M个显示面板；a receiving unit, configured to receive a three-dimensional screen display instruction, where the three-dimensional screen includes M display panels;

第一处理单元，用于根据所述三维画面中包含的显示面板数量，在后台运行的应用中选择M个应用，并确定与每个应用对应的显示面板；a first processing unit, configured to select M applications in an application running in the background according to the number of display panels included in the three-dimensional screen, and determine a display panel corresponding to each application;

第二处理单元，用于将确定的每个应用的应用界面信息分别显示在对应的显示面板中，将***安装的应用的应用信息均显示在控制面板中。The second processing unit is configured to display the determined application interface information of each application in the corresponding display panel, and display the application information of the installed application of the system in the control panel.

可选地，所述第一处理单元具体用于：Optionally, the first processing unit is specifically configured to:

根据应用进入后台的时间信息，或应用的属性信息，确定各个应用的优先级，从高优先级到低优先级在所述应用中选择M个应用；Determining the priority of each application according to the time information of the application entering the background, or the attribute information of the application, and selecting M applications from the high priority to the low priority;

根据各个应用的优先级，以及预设的显示面板的标识，针对M个应用中的每个应用，确定与该应用对应的显示面板。A display panel corresponding to the application is determined for each of the M applications according to the priority of each application and the identifier of the preset display panel.

可选地，所述第二处理单元还用于：Optionally, the second processing unit is further configured to:

检测各个应用的状态；Detect the status of each application;

在检测到至少一个应用的状态为使用状态后，基于各个应用的优先级，在检测到的至少一个应用中，确定目标应用；After detecting that the state of the at least one application is the usage state, determining, according to the priority of each application, the target application in the detected at least one application;

获取该目标应用的应用界面信息中的背景信息；Obtaining background information in the application interface information of the target application;

将所述背景信息转换为三维背景信息；Converting the background information into three-dimensional background information;

基于所述三维背景信息，以及预设的图片元素，确定三维画面的显示背景。Determining a display background of the three-dimensional picture based on the three-dimensional background information and the preset picture element.

在所述至少一个应用中，确定是否存在外部设备的输入请求命令，在确定存在外部设备的输入请求命令后，获取所述输入请求命令，所述输入请求命令中携带有请求信息；In the at least one application, determining whether there is an input request command of the external device, and after determining that the input request command of the external device exists, acquiring the input request command, where the input request command carries the request information;

在所述请求信息中确定至少一个关键词，针对各个关键词，基于预设的关键词与三维模型的映射关系，在三维画面的预设范围中显示与该关键词对应的三维模型。At least one keyword is determined in the request information, and for each keyword, a three-dimensional model corresponding to the keyword is displayed in a preset range of the three-dimensional image based on a mapping relationship between the preset keyword and the three-dimensional model.

第三方面，本发明实施例还提供一种终端设备，所述终端设备包括处理器及存储有若干计算机指令的非易失性存储器，所述计算机指令被所述处理器执行时，所述终端设备执行第一方面的应用显示方法。In a third aspect, an embodiment of the present invention further provides a terminal device, where the terminal device includes a processor and a non-volatile memory storing a plurality of computer instructions, when the computer instruction is executed by the processor, the terminal The device performs the application display method of the first aspect.

第四方面，本发明实施例还提供一种可读存储介质，所述可读存储介质包括计算机程序，所述计算机程序运行时控制所述可读存储介质所在终端设备执行第一方面的应用显示方法。In a fourth aspect, the embodiment of the present invention further provides a readable storage medium, where the readable storage medium includes a computer program, and the computer program controls the terminal device where the readable storage medium is located to perform an application display of the first aspect method.

根据本发明的技术方案，接收三维画面显示指令，所述三维画面中包含M个显示面板；根据所述三维画面中包含的显示面板数量，在后台运行的应用中选择M个应用，并确定与每个应用对应的显示面板；将***安装的多个应用的应用信息显示在控制面板中，将确定的每个应用的应用界面信息分别显示在对应的显示面板中，实现在终端设备中同时显示多个应用，提高用户体验。According to the technical solution of the present invention, a three-dimensional picture display instruction is received, where the three-dimensional picture includes M display panels; according to the number of display panels included in the three-dimensional picture, M applications are selected in an application running in the background, and Display panel corresponding to each application; display application information of multiple applications installed in the system in the control panel, and display the determined application interface information of each application in the corresponding display panel, so as to simultaneously display in the terminal device Multiple applications to enhance the user experience.

为使本发明的上述目的、特征和优点能更明显易懂，下文特举较佳实施例，并配合所附附图，作详细说明如下。The above described objects, features, and advantages of the invention will be apparent from the description and appended claims appended claims

附图说明DRAWINGS

为了更清楚地说明本发明实施例的技术方案，下面将对实施例中所需要使用的附图作简单地介绍，应当理解，以下附图仅示出了本发明的某些实施例，因此不应被看作是对范围的限定，对于本领域普通技术人员来讲，在不付出创造性劳动的前提下，还可以根据这些附图获得其他相关的附图。In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings used in the embodiments will be briefly described below. It should be understood that the following drawings show only certain embodiments of the present invention, and therefore It should be seen as a limitation on the scope, and those skilled in the art can obtain other related drawings according to these drawings without any creative work.

图1为本发明实施例提供的终端设备的方框示意图；FIG. 1 is a schematic block diagram of a terminal device according to an embodiment of the present disclosure;

图2为本发明实施例提供的一种应用显示方法的流程图；2 is a flowchart of an application display method according to an embodiment of the present invention;

图3为本发明实施例提供的一种普通显示画面的示意图；FIG. 3 is a schematic diagram of a general display screen according to an embodiment of the present disclosure;

图4为本发明实施例提供的一种三维画面的示意图；4 is a schematic diagram of a three-dimensional picture according to an embodiment of the present invention;

图5及图8-13为本发明实施例提供的应用显示方法的所包括的其他步骤的流程图；FIG. 5 and FIG. 8-13 are flowcharts showing other steps included in the application display method according to an embodiment of the present disclosure;

图6为本发明实施例提供的一种应用窗口和三维画面的位置关系示意图；FIG. 6 is a schematic diagram of a positional relationship between an application window and a three-dimensional screen according to an embodiment of the present invention;

图7为本发明实施例提供的另一种应用窗口和三维画面的位置关系示意图；FIG. 7 is a schematic diagram of a positional relationship between another application window and a three-dimensional screen according to an embodiment of the present invention;

图14-18为本发明实施例提供的应用显示装置的部分功能模块示意图。14-18 are schematic diagrams of some functional modules of an application display device according to an embodiment of the present invention.

具体实施方式Detailed ways

为使本发明实施例的目的、技术方案和优点更加清楚，下面将结合本发明实施例中附图，对本发明实施例中的技术方案进行清楚、完整地描述，显然，所描述的实施例仅仅是本发明一部分实施例，而不是全部的实施例。通常在此处附图中描述和示出的本发明实施例的组件可以以各种不同的配置来布置和设计。因此，以下对在附图中提供的本发明的实施例的详细描述并非旨在限制要求保护的本发明的范围，而是仅仅表示本发明的选定实施例。基于本发明的实施例，本领域技术人员在没有做出创造性劳动的前提下所获得的所有其他实施例，都属于本发明保护的范围。The technical solutions in the embodiments of the present invention are clearly and completely described in the following with reference to the accompanying drawings in the embodiments of the present invention. It is a partial embodiment of the invention, and not all of the embodiments. The components of the embodiments of the invention, which are generally described and illustrated in the figures herein, may be arranged and designed in various different configurations. Therefore, the following detailed description of the embodiments of the invention in the claims All other embodiments obtained by those skilled in the art based on the embodiments of the present invention without creative efforts are within the scope of the present invention.

请参照图1，是本发明较佳实施例提供的终端设备100的方框示意图。所述终端设备100可以是，但不限于，智能手机、个人电脑(personal computer，PC)、平板电脑、个人数字助理(personal digital assistant，PDA)、移动上网设备(mobile Internet device，MID)等。所述终端设备100可以包括应用显示装置110、存储器111、存储控制器112以及处理器113。Please refer to FIG. 1 , which is a block diagram of a terminal device 100 according to a preferred embodiment of the present invention. The terminal device 100 may be, but not limited to, a smart phone, a personal computer (PC), a tablet computer, a personal digital assistant (PDA), a mobile internet device (MID), and the like. The terminal device 100 may include an application display device 110, a memory 111, a storage controller 112, and a processor 113.

所述存储器111、存储控制器112及处理器113各元件相互之间直接或间接地电性连接，以实现数据的传输或交互。例如，这些元件相互之间可通过一条或多条通讯总线或信号线实现电性连接。应用显示装置110可以包括至少一个可以软件或固件(firmware)的形式存储于所述存储器111中或固化在所述终端设备100的操作***(operating system，OS)中的软件功能模块。所述处理器113用于执行所述存储器111中存储的可执行模块，例如应用显示装置110所包括的软件功能模块及计算机程序等。The components of the memory 111, the memory controller 112, and the processor 113 are electrically connected directly or indirectly to each other to implement data transmission or interaction. For example, the components can be electrically connected to one another via one or more communication buses or signal lines. The application display device 110 may include at least one software function module that may be stored in the memory 111 or in an operating system (OS) of the terminal device 100 in the form of software or firmware. The processor 113 is configured to execute an executable module stored in the memory 111, such as a software function module, a computer program, and the like included in the application display device 110.

其中，所述存储器111可以是，但不限于，随机存取存储器(Random Access Memory，RAM)，只读存储器(Read Only Memory，ROM)，可编程只读存储器(Programmable Read-Only Memory，PROM)，可擦除只读存储器(Erasable Programmable Read-Only Memory，EPROM)，电可擦除只读存储器(Electric Erasable Programmable Read-Only Memory，EEPROM)等。其中，存储器111用于存储程序，所述处理器113在接收到执行指令后，执行所述程序。所述处理器113以及其他可能的组件对存储器111的访问可在所述存储控制器112的控制下进行。The memory 111 can be, but not limited to, a random access memory (RAM), a read only memory (ROM), and a programmable read-only memory (PROM). Erasable Programmable Read-Only Memory (EPROM), Electric Erasable Programmable Read-Only Memory (EEPROM), and the like. The memory 111 is used to store a program, and the processor 113 executes the program after receiving an execution instruction. Access to the memory 111 by the processor 113 and other possible components can be performed under the control of the memory controller 112.

所述处理器113可能是一种集成电路芯片，具有信号的处理能力。上述的处理器113可以是通用处理器，包括中央处理器(Central Processing Unit，CPU)、网络处理器(Network Processor，NP)等；还可以是数字信号处理器(DSP)、专用集成电路(ASIC)、现成可编程门阵列(FPGA)或者其他可编程逻辑器件、分立门或者晶体管逻辑器件、分立硬件组件。可以实现或者执行本发明实施例中公开的各方法、步骤及逻辑框图。通用处理器可以是微处理器或者该处理器也可以是任何常规的处理器等。The processor 113 may be an integrated circuit chip with signal processing capabilities. The processor 113 may be a general-purpose processor, including a central processing unit (CPU), a network processor (NP), etc.; or may be a digital signal processor (DSP) or an application specific integrated circuit (ASIC). ), off-the-shelf programmable gate arrays (FPGAs) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components. The methods, steps, and logic blocks disclosed in the embodiments of the present invention may be implemented or executed. The general purpose processor may be a microprocessor or the processor or any conventional processor or the like.

应当理解的是，图1所示的结构仅为终端设备100的结构示意图，所述终端设备100还可包括比图1中所示更多或者更少的组件，或者具有与图1所示不同的配置。图1中所示的各组件可以采用硬件、软件或其组合实现。It should be understood that the structure shown in FIG. 1 is only a schematic structural diagram of the terminal device 100, and the terminal device 100 may further include more or less components than those shown in FIG. 1, or have different from that shown in FIG. Configuration. The components shown in Figure 1 can be implemented in hardware, software, or a combination thereof.

图2为根据本发明实施例提供的一种应用显示方法的流程图。如图2所示，该方法始于步骤S110。FIG. 2 is a flowchart of an application display method according to an embodiment of the present invention. As shown in FIG. 2, the method begins in step S110.

在步骤S110中，接收三维画面显示指令，所述三维画面中包含M个显示面板和控制面板。其中，M为正整数。In step S110, a three-dimensional screen display instruction is received, and the three-dimensional screen includes M display panels and a control panel. Where M is a positive integer.

在步骤S120中，根据所述三维画面中包含的显示面板数量，在后台运行的应用中选择M个应用，并确定与每个应用对应的显示面板。In step S120, based on the number of display panels included in the three-dimensional screen, M applications are selected among applications running in the background, and a display panel corresponding to each application is determined.

在本实施例中，所述应用可以具有多个功能，每一功能可以通过显示屏进行显示，在本实施例的一种实施方式中，同一应用不同功能对应的显示画面可在显示屏上同时显示。In this embodiment, the application may have multiple functions, and each function may be displayed through a display screen. In an embodiment of the embodiment, the display screen corresponding to different functions of the same application may be simultaneously displayed on the display screen. display.

在步骤S130中，将确定的每个应用的应用界面信息分别显示在对应的显示面板中，将***安装的应用的应用信息均显示在控制面板中。In step S130, the determined application interface information of each application is respectively displayed in the corresponding display panel, and the application information of the application installed by the system is displayed in the control panel.

在本实施例中，在进入三维画面之前，终端设备100默认为普通显示画面如桌面(参考图3)，可通过在桌面上的快捷栏设置三维画面入口，如，虚拟按钮，在用户点击该虚拟按钮后，进入对应的三维画面(虚拟场景)。或者通过对终端设备100中的应用进行操作实现三维画面的切换，如在应用中设置有三维画面入口按钮，点击该按钮进入三维画面，另外，可以通过根据实际情况对三维画面的显示方式及信息进行设置。其中，三维画面也指显示在显示屏中的3D空间。In this embodiment, before entering the three-dimensional screen, the terminal device 100 defaults to a normal display screen such as a desktop (refer to FIG. 3), and can set a three-dimensional screen entry by using a shortcut bar on the desktop, such as a virtual button, when the user clicks on the After the virtual button, enter the corresponding 3D picture (virtual scene). Or switching the three-dimensional screen by operating the application in the terminal device 100, such as setting a three-dimensional screen entry button in the application, clicking the button to enter the three-dimensional screen, and displaying the manner and information of the three-dimensional image according to the actual situation. Make settings. Among them, the three-dimensional picture also refers to the 3D space displayed in the display screen.

在进入三维画面后，可以在控制面板中，显示***安装的应用的应用信息(比如，图标)，在控制面板显示图标时，可以按照进入三维画面之前应用的位置依次进行显示，也可以在***安装的应用中选择使用频率高于预设的阈值的应用进行显示，控制面板在三维画面中的位置可以是自左往右进行显示，也可以在任意位置进行显示，控制面板的数量及显示位置根据实际情况确定，本发明对此不予限制。After entering the 3D screen, the application information (for example, an icon) of the application installed in the system may be displayed in the control panel. When the icon is displayed on the control panel, the display may be sequentially performed according to the position before the 3D screen is applied, or may be displayed in the system. The installed application selects an application that uses a frequency higher than a preset threshold for display. The position of the control panel in the three-dimensional screen may be displayed from left to right, or may be displayed at any position, the number of control panels and the display position. According to the actual situation, the present invention does not limit this.

可选地，所述在后台运行的应用中选择M个应用，并确定与每个应用对应的显示面板，包括：Optionally, selecting the M applications in the background running application, and determining a display panel corresponding to each application, includes:

根据应用进入后台的时间信息，或应用的属性信息，确定各个应用的优先级，从高优先级到低优先级在所述应用中选择M个应用。The priority of each application is determined according to the time information of the application entering the background, or the attribute information of the application, and the M applications are selected from the high priority to the low priority.

请参考图4，在本实施例的一种实施方式中，在接收到三维画面显示指令后，自动检测应用进入后台的时间，将应用进入后台的时间与当前时间的差值确定为时间间隔，按照时间间隔由短到长的顺序排序，将时间间隔最短的应用的优先级确定为高优先级，以此类推。以优先级从高到低的方式从进入后台的应用中选择M个应用。在本实施例的另一种实施方式中，在确定应用的优先级时，还可以根据应用的属性信息，确定该应用的关键信息，以及预设的关键信息与优先级的映射关系，针对检测到的每个应用，确定该应用的优先级。比如，在检测到的应用为淘宝、爱奇艺、微信、支付宝等应用时，可以将各个应用的关键信息依次确定为购物、视频、社交、交易等，每个关键信息对应有优先级。本发明对此不予限制。Referring to FIG. 4, in an embodiment of the present embodiment, after receiving the three-dimensional screen display instruction, the time for the application to enter the background is automatically detected, and the difference between the time when the application enters the background and the current time is determined as the time interval. The time intervals are sorted from short to long, the priority of the application with the shortest interval is determined as high priority, and so on. Select M applications from the applications entering the background in a high-to-low priority manner. In another implementation manner of the embodiment, when determining the priority of the application, the key information of the application and the mapping relationship between the preset key information and the priority may be determined according to the attribute information of the application, and the detection is performed for the detection. For each application, determine the priority of the application. For example, when the detected applications are applications such as Taobao, iQiyi, WeChat, Alipay, etc., the key information of each application may be sequentially determined as shopping, video, social, transaction, etc., and each key information has a priority. The invention is not limited thereto.

根据确定的M个应用的优先级，以及预设显示面板的标识信息(如编码)，针对每个应用，确定与该应用对应的显示面板。如，确定了3个优先级不同的应用，3个应用的优先级分别为高、中、低，显示面板的编码可以为1、2、3，在编码为1的显示面板显示高优先级的应用，编码为2的显示面板显示中优先级的应用，编码为3的显示面板显示低优先级的应用。The display panel corresponding to the application is determined for each application according to the determined priority of the M applications and the identification information (such as encoding) of the preset display panel. For example, three applications with different priorities are determined. The priority of the three applications is high, medium, and low. The encoding of the display panel can be 1, 2, and 3, and the display panel with the encoding of 1 displays the high priority. The application, the display panel coded 2 displays the medium priority application, and the code 3 display panel displays the low priority application.

可选地，在所述将确定的每个应用的应用界面信息分别显示在对应的显示面板中后，所述方法还包括：Optionally, after the application interface information of each application to be determined is displayed in the corresponding display panel, the method further includes:

检测各个应用的状态；Detect the status of each application;

在检测到至少一个应用的状态为使用状态时，基于各个应用的优先级，在检测到的至少一个应用中，确定目标应用；When detecting that the state of the at least one application is the usage state, determining, according to the priority of each application, the target application in the detected at least one application;

获取该目标应用的应用界面信息中的背景信息；将所述背景信息转换为三维背景信息；Obtaining background information in the application interface information of the target application; converting the background information into three-dimensional background information;

可选地，三维画面中的显示面板显示应用时，针对每个显示面板，可以根据该显示面板中应用的应用界面信息，确定该显示面板中应用的状态，如，应用界面信息中存在视频播放信息时，确定该显示面板中的应用的状态为使用状态。也可检测该显示面板中的应用是否接收到如外部设备的输入请求，在确定该显示面板中的应用接收到输入请求时，确定该显示面板为使用状态，对如何确定应用的使用状态本发明不予限制。Optionally, when the display panel in the three-dimensional screen displays the application, for each display panel, the state of the application in the display panel may be determined according to the application interface information applied in the display panel, for example, the video playback exists in the application interface information. When the information is determined, it is determined that the state of the application in the display panel is the usage state. It is also possible to detect whether an application in the display panel receives an input request, such as an external device, and when determining that the application in the display panel receives an input request, determining that the display panel is in a use state, and how to determine an application state of the application. No restrictions.

在检测到至少一个应用的状态为使用状态时，将优先级最高的应用的确定为目标应用，获取该目标应用的背景信息，该目标应用的背景信息一般为二维图片、三维图片、动画等。根据预设的坐标转换算法如顶点划分映射算法等，将所述背景信息转换为三维背景信息。根据三维背景信息，以及预设的图片元素如房屋模型、动画、视频等，确定三维画面的显示背景。其中，坐标转换算法(如顶点划分映射算法)在现有技术中已有详细的介绍，此处不再进行过多说明。When it is detected that the state of the at least one application is the usage state, the determination of the application with the highest priority is the target application, and the background information of the target application is obtained, and the background information of the target application is generally a two-dimensional image, a three-dimensional image, an animation, and the like. . The background information is converted into three-dimensional background information according to a preset coordinate conversion algorithm such as a vertex partition map algorithm or the like. The display background of the three-dimensional picture is determined according to the three-dimensional background information and preset picture elements such as house models, animations, videos, and the like. Among them, the coordinate conversion algorithm (such as the vertex partitioning mapping algorithm) has been described in detail in the prior art, and will not be described too much here.

可选地，在检测到至少一个应用的状态为使用状态后，还包括：Optionally, after detecting that the state of the at least one application is the usage state, the method further includes:

在所述至少一个应用中，确定是否存在外部设备的输入请求命令，在确定存在外部设备的输入请求命令后，获取所述输入请求命令中携带有请求信息；In the at least one application, determining whether there is an input request command of the external device, and after determining that the input request command of the external device exists, acquiring the input request command carries the request information;

从所述请求信息中确定至少一个关键词，针对各个关键词，基于预设的关键词与三维模型的映射关系，在三维画面的预设范围中显示与该关键词对应的三维模型。Determining at least one keyword from the request information, and for each keyword, displaying a three-dimensional model corresponding to the keyword in a preset range of the three-dimensional image based on a mapping relationship between the preset keyword and the three-dimensional model.

可选地，在确定的使用状态的应用中，检测该应用是否接收到外部设备的输入请求命令，该输入请求命令可以为HTTP命令，例如，用于在浏览网页时点击的网址信息。本发明对接收的输入请求命令的具体形式不予限制。Optionally, in the determined usage status application, detecting whether the application receives an input request command of the external device, the input request command may be an HTTP command, for example, the web address information used when browsing the webpage. The present invention does not limit the specific form of the received input request command.

下面以例子，说明如何根据输入请求命令显示对应的三维模型。例如，确定第二个显示面板中的应用的状态为使用状态，该显示面板中的应用为浏览器(比如，IE浏览器、UC浏览器等)，用户使用浏览器浏览旅游网页，当用户在搜索对话框中输入“成都7日游”后，确定关键词为“成都”等，在预设的关键词与三维模型的映射关系中，确定与成都对应的三维模型，如，三维宣传片视频等。在三维画面中的预设范围显示对应的三维宣传片视频，例如，在三维画面的正中央进行显示。在播放过程中可以通过三维宣传片视频右上角设置的退出按钮退出视频播放。The following example shows how to display the corresponding 3D model according to the input request command. For example, determining that the state of the application in the second display panel is a usage state, the application in the display panel is a browser (eg, an IE browser, a UC browser, etc.), and the user browses the travel webpage by using a browser, when the user is After entering "Chengdu 7-Day Tour" in the search dialog box, determine the keyword as "Chengdu", etc., and determine the three-dimensional model corresponding to Chengdu in the mapping relationship between the preset keyword and the three-dimensional model, for example, a three-dimensional video Wait. The corresponding three-dimensional video is displayed in a preset range in the three-dimensional picture, for example, in the center of the three-dimensional picture. During playback, you can exit the video playback through the exit button set in the upper right corner of the 3D video.

可选地，该方法还包括：Optionally, the method further includes:

检测终端设备100的旋转角度；Detecting a rotation angle of the terminal device 100;

根据检测到的所述旋转角度，调整各个显示面板在三维画面中的显示位置。The display position of each display panel in the three-dimensional screen is adjusted according to the detected rotation angle.

例如，用户横屏使用终端设备100时，检测到终端设备100逆时针旋转了90度。此时，将三维画面中的各个显示面板对应旋转90度，以方便用户使用。For example, when the user uses the terminal device 100 in landscape mode, it is detected that the terminal device 100 is rotated 90 degrees counterclockwise. At this time, each display panel in the three-dimensional screen is rotated by 90 degrees correspondingly for the convenience of the user.

可选地，该方法还包括：Optionally, the method further includes:

在检测到三维画面的预设区域接收到三维画面退出指令后，退出所述三维画面。After receiving the three-dimensional screen exit instruction in the preset area where the three-dimensional picture is detected, the three-dimensional picture is exited.

具体地，预设区域可以为三维画面右上角的30*60像素的范围。在进入三维画面后，三维画面的右上角显示退出虚拟按钮，在该预设区域接收到用户的如点击操作后，退出三维画面。Specifically, the preset area may be a range of 30*60 pixels in the upper right corner of the three-dimensional picture. After entering the three-dimensional picture, the virtual button is displayed in the upper right corner of the three-dimensional picture, and the three-dimensional picture is exited after receiving the user's click operation in the preset area.

另外，在显示三维画面时，在检测第一个显示面板中的应用接收到启动命令后，在三维画面中增加一个显示面板，显示启动的该应用的应用界面信息。或者，将优先级最低的应用退出，在显示优先级最低的应用的显示面板中显示该应用的应用界面信息。In addition, when the three-dimensional screen is displayed, after detecting that the application in the first display panel receives the start command, a display panel is added to the three-dimensional screen to display the launched application interface information of the application. Alternatively, the application with the lowest priority is exited, and the application interface information of the application is displayed in the display panel of the application with the lowest priority.

在本实施例中，应用窗口包括显示面板和控制面板，请参照图5，所述方法还可以包括步骤S140及步骤S150。In this embodiment, the application window includes a display panel and a control panel. Referring to FIG. 5, the method may further include step S140 and step S150.

步骤S140，通过应用窗口接收用户触发的操作指令；Step S140, receiving an operation instruction triggered by a user through an application window;

步骤S150，当接收到操作指令时，按照操作指令在三维画面中展示应用内容。Step S150, when receiving the operation instruction, displaying the application content in the three-dimensional screen according to the operation instruction.

该应用窗口内显示有应用页面，该应用页面可以为终端设备100中安装的应用程序APP的页面，也可以为终端设备100的主页面等可以被用户操作的页面；该应用窗口内还可以设置有与三维画面进行交互的接口，例如，操作单元；当应用页面中某一对象需要在三维画面中展示时，用户可以通过该操作单元，将该对象传递至三维画面中进行3D展示；用户还可以通过该操作单元对展示在三维画面中的对象进行操作，例如，旋转对象、变换展示视角、使对象发生形变等，以获得该对象更多的相关信息。An application page is displayed in the application window, and the application page may be a page of the application APP installed in the terminal device 100, or may be a page that can be operated by the user, such as a main page of the terminal device 100; the application window may also be set. There is an interface for interacting with the three-dimensional picture, for example, an operation unit; when an object in the application page needs to be displayed in the three-dimensional picture, the user can pass the object to the three-dimensional picture for 3D display through the operation unit; The object displayed in the three-dimensional picture can be operated by the operation unit, for example, rotating the object, transforming the display angle of view, deforming the object, and the like to obtain more related information of the object.

上述操作单元可以接收设定类型的操作指令；例如，操作单元内设置有操作条，用于调整三维画面、或三维画面中对象的亮度、颜色、显示角度等可以渐进变化的参数；操作单元内还可以设置有操作按钮，用于修改三维画面的背景、或者调整三维画面的显示模式、视角等。The operation unit may receive an operation instruction of a set type; for example, an operation bar is disposed in the operation unit for adjusting a three-dimensional picture, or a parameter that can gradually change in brightness, color, display angle, and the like of the object in the three-dimensional picture; It is also possible to provide an operation button for modifying the background of the three-dimensional picture, or adjusting the display mode, the angle of view, and the like of the three-dimensional picture.

每个操作单元内部还可以嵌套多个子单元，用于更加细化地调整三维画面；例如，当对三维画面添加文字时，用户可以通过操作单元编辑待添加的文字，并通过多个子单元中的操作条、操作按钮等对该文字进行位置调整、字体、颜色、姿势调整等。A plurality of sub-units can also be nested inside each operation unit for more detailed adjustment of the three-dimensional picture; for example, when adding text to the three-dimensional picture, the user can edit the text to be added through the operation unit and pass through multiple sub-units. The operation bar, the operation button, and the like perform position adjustment, font, color, posture adjustment, and the like.

上述应用窗口和三维画面的位置关系可以有多种形式。参见图6，第一种应用窗口和三维画面的位置关系示意图。该应用窗口和三维画面相互分离，分别位于显示界面的指定区域；如图6中，该应用窗口分布在显示界面的左侧，三维画面分布在显示界面的右侧；该应用窗口内设置有多个操作单元；每个操作单元通过接收触屏信号获取设定类型的操作指令；具体地，用户可以通过手指发送触屏信号，直接控制应用窗口内的操作条或操作按钮。The positional relationship between the above application window and the three-dimensional picture can take many forms. Referring to FIG. 6, a schematic diagram of the positional relationship between the first application window and the three-dimensional image. The application window and the three-dimensional image are separated from each other and are respectively located in a designated area of the display interface; as shown in FIG. 6, the application window is distributed on the left side of the display interface, and the three-dimensional picture is distributed on the right side of the display interface; Each operation unit acquires a set type of operation instruction by receiving a touch screen signal; specifically, the user can directly control the operation bar or the operation button in the application window by sending a touch screen signal through the finger.

请参照图7，图7为本实施例提供的另一种应用窗口和三维画面的位置关系示意图。Please refer to FIG. 7. FIG. 7 is a schematic diagram showing the positional relationship between another application window and a three-dimensional image according to the embodiment.

应用窗口位于三维画面中的指定区域；应用窗口内设置有多个操作单元；显示界面上还显示有操作盘和瞄点；通过操作盘和瞄点，每个操作单元获取设定类型的操作指令；另外，应用窗口还可以以透明或半透明的形式覆盖于所述三维画面上。The application window is located in a specified area in the three-dimensional screen; the operation window is provided with a plurality of operation units; the operation interface and the aiming point are also displayed on the display interface; and each operation unit acquires the operation command of the set type through the operation panel and the aiming point In addition, the application window may also be overlaid on the three-dimensional picture in a transparent or translucent form.

具体地，如图7中，应用窗口设置在三维画面的中部位置，当然，该应用窗口还可以设置在三维画面的其他位置，该应用窗口的形式可以为平面形式，也可以随着三维画面本身的透视角度变化成凸状或凹状等曲面形式，即应用窗口融合于三维画面中。当应用窗口位于三维画面中时，用户可以通过摆动手机控制瞄点在三维画面或应用窗口内的位置，通过点触操作盘选中瞄点所在位置的操作单元，进而发送操作指令。Specifically, as shown in FIG. 7, the application window is disposed at a middle position of the three-dimensional screen. Of course, the application window may also be disposed at other positions of the three-dimensional image, and the application window may be in the form of a plane or may follow the three-dimensional image itself. The perspective angle of the perspective changes into a convex or concave curved surface, that is, the application window is fused in the three-dimensional image. When the application window is located in the three-dimensional picture, the user can control the position of the aiming point in the three-dimensional picture or the application window by swinging the mobile phone, and select the operation unit at the position where the aiming point is located by touching the operation panel, and then send an operation instruction.

如图7所示，上述操作盘周围还可以设置多个控制点，当瞄点瞄准控制点时，可以执行相关的操作指令，例如，三维画面的单屏显示、双屏显示、切换应用窗口内显示的操作单元等。As shown in FIG. 7 , a plurality of control points may be disposed around the operation panel, and when the aiming point is aimed at the control point, related operation instructions may be executed, for example, single-screen display of a three-dimensional screen, dual-screen display, and switching within an application window. The operating unit displayed, etc.

当接收到上述操作指令时，按照操作指令显示三维画面和/或所述应用窗口；可选地，上述通过应用窗口接收的操作指令，既可以改变三维画面的显示方式，也可以改变应用窗口的显示方式，当然，也可以同时改变三维画面和应用窗口的显示方式。该三维画面的背景可以为静态的图像，也可以为游戏、视频，及VR画面等。When the operation instruction is received, the three-dimensional picture and/or the application window are displayed according to the operation instruction; optionally, the operation instruction received through the application window may change the display manner of the three-dimensional picture or change the application window. The display mode, of course, can also change the display mode of the 3D picture and the application window at the same time. The background of the three-dimensional picture may be a static image, or may be a game, a video, a VR picture, or the like.

用户可以通过上述应用窗口调用终端设备100内的应用，通过应用窗口操作该应用，实现应用与三维画面之间的交互；例如，通过应用窗口调用即时通讯软件，从该软件中获取联系人发送的文字或图片，进而将该文字或图片添加至三维画面中。The user can invoke the application in the terminal device 100 through the application window, and operate the application through the application window to implement interaction between the application and the three-dimensional image; for example, calling the instant messaging software through the application window, and acquiring the contact sent by the software from the software. Text or image to add the text or image to the 3D image.

上述方式，将应用内容的展示扩展至三维画面，实现了应用和三维画面的即时交互，增加了应用展示三维画面和形式的丰富性，提高了应用的用户体验度。In the above manner, the display of the application content is extended to the three-dimensional image, realizing the instant interaction between the application and the three-dimensional image, increasing the richness of the application to display the three-dimensional picture and form, and improving the user experience of the application.

请参见图8，在本实施例中，终端设备100的显示界面上显示有应用窗口和三维画面，该方法包括如下步骤：Referring to FIG. 8, in the embodiment, an application window and a three-dimensional screen are displayed on the display interface of the terminal device 100, and the method includes the following steps:

步骤S402，通过应用窗口接收用户触发的操作指令；Step S402, receiving an operation instruction triggered by a user through an application window;

步骤S404，判断该操作指令的类型；如果该操作指令包括三维画面修改指令，执行步骤S406；如果该操作指令包括三维画面显示指令，执行步骤S410；如果该操作指令包括应用窗口显示指令，执行步骤S412。Step S404, determining the type of the operation instruction; if the operation instruction includes a three-dimensional picture modification instruction, executing step S406; if the operation instruction includes a three-dimensional picture display instruction, executing step S410; if the operation instruction includes an application window display instruction, performing step S412.

步骤S406，将三维画面修改指令中的修改内容，添加至三维画面中。Step S406, adding the modified content in the three-dimensional picture modification instruction to the three-dimensional picture.

步骤S408，根据三维画面修改指令中的坐标，调整修改内容在三维画面中的位置，显示当前三维画面。Step S408, according to the coordinates in the three-dimensional picture modification instruction, adjust the position of the modified content in the three-dimensional picture, and display the current three-dimensional picture.

例如，用户可以从应用窗口中显示的应用中调取一个可以进行三维展示的图像，添加至三维画面中；该应用窗口中还设置有调整该图像位置的操作条或按钮，用于改变图像在三维画面中的坐标。For example, the user may retrieve an image that can be displayed in three dimensions from the application displayed in the application window and add it to the three-dimensional image; the application window is further provided with an operation bar or a button for adjusting the position of the image, for changing the image. The coordinates in the 3D picture.

步骤S410，按照三维画面显示指令，显示三维画面。In step S410, a three-dimensional screen is displayed according to the three-dimensional screen display instruction.

其中，该三维画面显示指令包括显示视角或显示模式；该显示视角至少包括平行视角或望远镜视角，当然还可以包括其他的视角类型；在每个视角类型中，用户还可以通过应用窗口对该视角类型的角度等参数进行微调；上述显示模式至少包括平面模式、球面模式、曲面模式或异形模式；当然，在每个显示模式中，用户可以通过操作窗口对该显示模式的具体参数进行微调，例如，球面模式中，球体的半径；曲面模式中，曲面的曲率等。The three-dimensional picture display instruction includes a display angle of view or a display mode; the display angle of view includes at least a parallel view or a telescope view, and may of course include other types of views; in each view type, the user may also view the view through the application window. The parameters such as the angle of the type are fine-tuned; the above display mode includes at least a plane mode, a spherical mode, a surface mode, or an alien mode; of course, in each display mode, the user can fine-tune the specific parameters of the display mode through the operation window, for example, for example, , the radius of the sphere in the spherical mode; the curvature of the surface in the surface mode, and so on.

步骤S412，当应用窗口显示指令为隐藏应用窗口时，隐藏应用窗口，将三维画面进行全屏显示；当应用窗口显示指令为显示应用窗口时，显示应用窗口，将三维画面进行半屏显示；或者，应用窗口以透明或半透明的形式覆盖于三维画面上。Step S412, when the application window display instruction is a hidden application window, the application window is hidden, and the three-dimensional image is displayed in full screen; when the application window display instruction is to display the application window, the application window is displayed, and the three-dimensional image is displayed in half screen; or The application window is overlaid on the 3D image in a transparent or translucent form.

通常，当用户需要对三维画面进行较多或较复杂的操作时，需要将三维画面进行半屏显示，屏幕剩余部分显示应用窗口，便于操作；当用户操作完毕，需要长时间观看三维画面时，需要将三维画面进行全屏显示，便于观看；当然，三维画面在进行全屏显示过程中，显示界面中仍然可以设置对应的按钮，当用户点击该按钮时，应用窗口出现。Generally, when a user needs to perform more or more complicated operations on a three-dimensional picture, the three-dimensional picture needs to be displayed in half screen, and the remaining part of the screen displays an application window, which is convenient for operation; when the user completes the operation and needs to watch the three-dimensional picture for a long time, The three-dimensional screen needs to be displayed in full screen for easy viewing; of course, in the process of full-screen display of the three-dimensional screen, the corresponding button can still be set in the display interface, and when the user clicks the button, the application window appears.

上述方式中，将应用内容的展示扩展至三维画面，实现了应用和三维画面的即时交互，增加了应用三维画面,展示形式的丰富性，提高了应用的用户体验度。In the above manner, the display of the application content is extended to the three-dimensional image, realizing the instant interaction between the application and the three-dimensional image, increasing the application of the three-dimensional image, the richness of the display form, and improving the user experience of the application.

当上述三维画面为VR画面时，上述应用窗口可以融合于VR画面中，用户在观看VR画面时，可以通过瞄点对VR画面中的对象和应用窗口进行上述操作，该方式突破了用户操作应用和操作VR画面时需要切换显示界面的交互障碍，实现了应用与VR画面的深度交互，提升了用户的VR体验。When the three-dimensional picture is a VR picture, the application window may be integrated into the VR picture. When viewing the VR picture, the user may perform the above operation on the object and the application window in the VR picture by aiming at the point, which breaks the user operation application. When the VR screen is operated, the interaction barrier of the display interface needs to be switched, and the deep interaction between the application and the VR screen is realized, thereby improving the VR experience of the user.

在本实施例中，所述方法还可以包括对三维画面进行操作的步骤，请参照图9，在该步骤可以包括步骤S161、步骤162及步骤S163。In this embodiment, the method may further include the step of operating on the three-dimensional screen. Referring to FIG. 9, the step may include step S161, step 162, and step S163.

步骤S161，接收用户发出的对象操作指令；其中，该对象操作指令包括语音指令、手势指令或操作指令。Step S161, receiving an object operation instruction issued by a user; wherein the object operation instruction comprises a voice instruction, a gesture instruction or an operation instruction.

步骤S162，从当前的三维画面中，确定接收到对象操作指令时，瞄点瞄准的对象。In step S162, from the current three-dimensional screen, it is determined that the object targeted by the aiming point is received when the object operation instruction is received.

步骤S163，选中该对象，对该对象进行控制操作。In step S163, the object is selected, and the object is controlled.

例如，用户在配戴VR眼镜、手机等终端设备后，终端设备100内播放的VR虚拟场景会随着用户头部的平移、旋转等运动而发生变化，VR界面内瞄点瞄准的对象，也会随之变化。当用户想要对VR场景中的对象A进行操作时，首选需要控制头部运动，使瞄点停留在对象A的位置上，再发出对象操作指令；终端设备100接收到该对象操作指令后，即选中该对象A，进而对该对象A执行后续的控制操作，例如，当对象A是一个物品时，可以对该物品进行移动、开启等操作。For example, after the user wears a terminal device such as a VR glasses or a mobile phone, the VR virtual scene played in the terminal device 100 changes with the movement of the user's head, such as translation, rotation, and the like, and the object targeted by the aiming point in the VR interface is also Will change accordingly. When the user wants to operate the object A in the VR scene, it is preferred to control the head motion so that the aiming point stays at the position of the object A, and then the object operation instruction is issued; after the terminal device 100 receives the object operation instruction, That is, the object A is selected, and then the subsequent control operation is performed on the object A. For example, when the object A is an item, the item can be moved, opened, and the like.

站在终端设备100的角度，用户将瞄点停留在对象A位置上时，终端设备100并不知晓该用户是想要选中对象A，还是仅仅停止头部运动；当接收到用户发出的对象操作指令时，终端设备100再将当前瞄点停留的对象选中，进而对该对象A执行后续的控制操作。Standing at the perspective of the terminal device 100, when the user stops the target point at the object A position, the terminal device 100 does not know whether the user wants to select the object A or only stops the head movement; when receiving the object operation issued by the user When instructing, the terminal device 100 selects the object that the current aiming point stays, and then performs subsequent control operations on the object A.

当接收到用户发出的语音指令、手势指令或操作指令等对象操作指令时，从当前的三维画面中确定瞄点瞄准的对象；再选中该对象，并对该对象进行控制操作；该方式中，用户可以通过瞄点和发出对象操作指令相互配合的方式选中对象，操作方式快速、准确，与用户的意图契合度较高，可以提高三维画面操作的用户体验度。When an object operation instruction such as a voice instruction, a gesture instruction, or an operation instruction issued by the user is received, an object targeted by the aiming point is determined from the current three-dimensional image; the object is selected, and the object is controlled; in this manner, The user can select the object by means of the aiming point and the object operation instruction, and the operation mode is fast and accurate, and the degree of cooperation with the user is high, which can improve the user experience of the three-dimensional picture operation.

请参照图10，在本实施例中，以对象操作指令包括语音指令为例进行说明，所述对三维画面进行操作的步骤还可以通过以下步骤实现：Referring to FIG. 10, in the embodiment, the object operation instruction includes a voice instruction as an example. The step of operating the three-dimensional screen may also be implemented by the following steps:

步骤S202，通过传感器装置检测用户头部的运动状态；Step S202, detecting, by the sensor device, a motion state of the user's head;

步骤S204，根据该运动状态，控制瞄点在三维画面中移动；Step S204, according to the motion state, controlling the aiming point to move in the three-dimensional picture;

上述传感器装置可以为九轴传感器，通过九轴传感器检测用户头部的运动状态，例如，平行移动、水平转头、上下移动等；三维画面中的瞄点可以固定在界面的设定位置，例如，三维画面的中心；在用户看来，用户头部移动时，三维画面播放的虚拟图像随之变化，而瞄点位置不变；因而，虚拟图像与瞄点发生相对移动，虚拟图像中与瞄点重合的对象对发生变化。The sensor device may be a nine-axis sensor, and the movement state of the user's head is detected by a nine-axis sensor, for example, parallel movement, horizontal rotation, up and down movement, etc.; the aiming point in the three-dimensional picture may be fixed at the set position of the interface, for example The center of the three-dimensional picture; in the user's view, when the user's head moves, the virtual image played by the three-dimensional picture changes, and the position of the aiming point does not change; thus, the virtual image moves relative to the aiming point, and the virtual image is in the same direction. Point pairs of objects change.

步骤S206，通过麦克风接收用户发出的语音信号；Step S206, receiving a voice signal sent by a user through a microphone;

步骤S208，判断该语音信号中是否包含预设的关键字；如果是，执行步骤S210；如果否，结束；Step S208, determining whether the voice signal includes a preset keyword; if yes, executing step S210; if not, ending;

通常，上述步骤S208在实际实现时，终端设备100首先需要对接收到的语音信号进行滤波降噪，对降噪后的语音信号提取特征数据，再将该特征数据与关键字库进行匹配，将匹配成功的特征数据对应的关键字作为该语音信号对应的关键字。Generally, when the foregoing step S208 is actually implemented, the terminal device 100 first needs to perform filtering and noise reduction on the received voice signal, extract feature data from the noise-reduced voice signal, and then match the feature data with the keyword database, and The keyword corresponding to the successfully matched feature data is used as the keyword corresponding to the voice signal.

通常，为了提高语音识别的准确性，其关键字可以较为简短、种类也较少，例如，“选中”、“确定”等关键字；不仅可以保证语音识别的准确性，还可以提高语音识别的效率，快速响应用户的指令。Generally, in order to improve the accuracy of speech recognition, the keywords can be shorter and less variety, for example, "select", "determine" and other keywords; not only can ensure the accuracy of speech recognition, but also improve speech recognition. Efficiency, fast response to user instructions.

步骤S210，将语音信号中包含的关键字确定为对象操作指令；Step S210, determining a keyword included in the voice signal as an object operation instruction;

步骤S212，从当前的三维画面中，确定接收到该对象操作指令时，瞄点瞄准的对象；Step S212, determining, from the current three-dimensional image, an object targeted by the aiming point when receiving the object operation instruction;

步骤S214，选中该对象，对该对象进行控制操作。In step S214, the object is selected, and the object is controlled.

上述方式中，用户可以通过瞄点和发出语音信号相互配合的方式选中对象，操作方式快速、准确，与用户的意图契合度较高，提高了三维画面操作的用户体验度。In the above manner, the user can select the object by means of the aiming point and the voice signal, and the operation mode is fast and accurate, and the degree of cooperation with the user is high, which improves the user experience of the three-dimensional picture operation.

请参照图11，在本实施例中，以对象操作指令包括手势指令为例进行说明，所述对三维画面进行操作的步骤还可以通过以下步骤实现：Referring to FIG. 11 , in the embodiment, the object operation instruction includes a gesture instruction as an example. The step of operating the three-dimensional screen may also be implemented by the following steps:

步骤S302，通过传感器装置检测用户头部的运动状态；Step S302, detecting, by the sensor device, a motion state of the user's head;

步骤S304，根据该运动状态，控制瞄点在三维画面中移动；Step S304, according to the motion state, controlling the aiming point to move in the three-dimensional picture;

步骤S306，通过摄像装置接收用户发出的手势视频信号；Step S306, receiving, by the camera device, a gesture video signal sent by the user;

步骤S308，判断手势视频信号中是否包含预设的手势特征；如果是，执行步骤S310；如果否，结束；Step S308, determining whether the gesture video signal includes a preset gesture feature; if yes, executing step S310; if not, ending;

通常，上述步骤S308在实际实现时，终端设备100首先需要对接收到的手势视频信号进行滤波降噪，对降噪后的手势视频信号进行边缘检测等处理后，提取特征数据，再将该特征数据与手势特征库进行匹配，将匹配成功的特征数据对应的手势特征作为该手势视频信号对应的手势特征。Generally, when the foregoing step S308 is actually implemented, the terminal device 100 first needs to perform filtering and noise reduction on the received gesture video signal, and performs edge detection and the like on the noise-reduced gesture video signal, and then extracts feature data, and then the feature is extracted. The data is matched with the gesture feature database, and the gesture feature corresponding to the successfully matched feature data is used as the gesture feature corresponding to the gesture video signal.

通常，为了提高手势识别的准确性，其手势特征可以较为简单、识别度高、种类也较少，例如，“√”手势、点击手势等动态手势，还可以为静态的手部姿势，例如，伸出特定手指的姿势；简单的手势特征不仅可以保证手势识别的准确性，还可以提高手势识别的效率，快速响应用户的指令。Generally, in order to improve the accuracy of gesture recognition, the gesture features can be relatively simple, high in recognition, and less in variety. For example, dynamic gestures such as "√" gestures and click gestures can also be static hand gestures, for example, Stretching a specific finger posture; simple gesture features not only ensure the accuracy of gesture recognition, but also improve the efficiency of gesture recognition and quickly respond to user commands.

步骤S310，将手势视频信号中包含的手势特征确定为对象操作指令；Step S310, determining a gesture feature included in the gesture video signal as an object operation instruction;

步骤S312，从当前的三维画面中，确定接收到该对象操作指令时，瞄点瞄准的对象；Step S312, determining, from the current three-dimensional picture, an object targeted by the aiming point when receiving the object operation instruction;

步骤S314，选中该对象，对该对象进行控制操作。In step S314, the object is selected, and the object is controlled.

该方式中，用户可以通过瞄点和发出手势视频信号相互配合的方式选中对象，操作方式快速、准确，与用户的意图契合度较高，提高了三维画面操作的用户体验度。In this mode, the user can select the object by means of the aiming point and the gesture video signal, and the operation mode is fast and accurate, and the degree of cooperation with the user is high, which improves the user experience of the three-dimensional picture operation.

在本实施例中，以对象操作指令包括操作指令为例进行说明；上述接收用户发出的对象操作指令的步骤，具体包括：通过手柄接收用户发出的操作指令，将操作指令确定为对象操作指令。In the embodiment, the object operation instruction includes an operation instruction as an example. The step of receiving the object operation instruction issued by the user specifically includes: receiving an operation instruction issued by the user through the handle, and determining the operation instruction as the object operation instruction.

可选地，该手柄上设置有可以发出“确定”或“选中”指令的按键，当用户按动该按键时，即代表发出操作指令，进而选中当面瞄点瞄准的对象。该手柄可以为VR手柄，也可以为AR的操作手柄。Optionally, the handle is provided with a button that can issue a “OK” or “Select” command, and when the user presses the button, the operation command is issued, and then the object targeted by the face is selected. The handle can be a VR handle or an operating handle of the AR.

该方式中，用户可以通过瞄点和发出操作指令相互配合的方式选中对象，操作方式快速、准确，与用户的意图契合度较高，提高了三维画面操作的用户体验度。In this mode, the user can select the object by means of the aiming point and issuing the operation instruction, and the operation mode is fast and accurate, and the degree of cooperation with the user is high, which improves the user experience of the three-dimensional picture operation.

在本实施例中，请参照图12，所述三维画面内包括3D元素和应用窗口，所述方法还包括：In this embodiment, referring to FIG. 12, the 3D picture includes a 3D element and an application window, and the method further includes:

步骤S171，根据接收到的传感信号，将三维画面的对应部分显示在显示界面中；该传感信号包括终端的运动状态，或者，用户触发的触屏信号；该运动状态包括移动终端的位置和角度；Step S171, displaying a corresponding portion of the three-dimensional picture in the display interface according to the received sensing signal; the sensing signal includes a motion state of the terminal, or a touch screen signal triggered by the user; the motion state includes a location of the mobile terminal And angle;

例如，如果三维画面大于移动终端的显示界面，那么当前的显示界面上仅显示三维画面内的一部分画面；用户可以通过旋转手机角度，移动手机的位置等方式使显示界面显示其他部分的画面；还可以通过滑动触摸屏的方式显示该显示界面其他部分的画面。当上述移动终端为VR眼镜时，用户可以通过调整头部的姿势，显示显示界面其他部分的画面。For example, if the three-dimensional picture is larger than the display interface of the mobile terminal, only a part of the picture in the three-dimensional picture is displayed on the current display interface; the user can display the other part of the picture by rotating the angle of the mobile phone, moving the position of the mobile phone, etc.; The screen of other parts of the display interface can be displayed by sliding the touch screen. When the mobile terminal is a VR glasses, the user can display the screen of other parts of the display interface by adjusting the posture of the head.

步骤S172，当接收到用户操作指令时，按照操作指令在三维画面中显示3D元素和/或应用窗口。具体地，该3D元素包括显示背景、以及设置于该显示背景或应用窗口上的装饰物、图片、动图等。Step S172, when receiving the user operation instruction, displaying the 3D element and/or the application window in the three-dimensional screen according to the operation instruction. Specifically, the 3D element includes a display background, and a decoration, a picture, a moving picture, and the like disposed on the display background or the application window.

用户可以对三维画面的显示方式进行变换，例如，设置特定的3D元素，调节3D元素的亮度、角度、位置、模式等，还可以对应用窗口的数量、大小、排列方式、边框形式等参数进行设定。The user can change the display mode of the three-dimensional picture, for example, setting a specific 3D element, adjusting the brightness, angle, position, mode, etc. of the 3D element, and also performing parameters such as the number, size, arrangement, and frame form of the application window. set up.

上述应用窗口可以显示不同应用，例如，当三维画面内包括多个应用窗口时，第一窗口可以显示手机的桌面，第二窗口可以显示通信应用软件的内容，第三窗口可以播放视频，第四窗口可以显示购物网站等等；当然，不同的窗口也可以显示同一应用。The application window may display different applications. For example, when a plurality of application windows are included in the three-dimensional screen, the first window may display the desktop of the mobile phone, the second window may display the content of the communication application software, and the third window may play the video, and the fourth The window can display the shopping site and so on; of course, different windows can also display the same application.

上述各个应用窗口之间可以相互独立，也可以存在控制关系；例如，其中一个应用窗口为设置操作窗口，用户通过该窗口，可以设置其他窗口的显示内容和方式等；再如，其中一个窗口为手机桌面，用户通过该窗口触发桌面上的某一应用，显示三维画面内则自动生成一个窗口，专用于显示触发的应用的内容。Each of the application windows may be independent of each other, or may have a control relationship; for example, one of the application windows is a setting operation window, and the user can set the display content and manner of other windows through the window; for example, one of the windows is The mobile phone desktop, through which the user triggers an application on the desktop, and automatically displays a window within the displayed three-dimensional image, which is dedicated to displaying the content of the triggered application.

可以理解，上述用户触发的操作指令，既可以控制显示三维画面中的3D元素的显示方式，也可以应用窗口的显示方式，还可以同时控制3D元素和应用窗口的显示方式。当然，上述操作指令还可以控制窗口内部的显示内容，例如，页面滑动，视频的播放或暂停等。It can be understood that the operation instruction triggered by the above user can control the display mode of the 3D element in the display three-dimensional picture, the display mode of the window, and the display mode of the 3D element and the application window at the same time. Of course, the above operation instructions can also control the display content inside the window, for example, page sliding, video playback or pause, and the like.

当上述终端设备为手机或平板电脑时，用户可以不戴VR头盔或眼镜，直接通过显示屏查看并操作显示三维画面；在操作过程中，用户可以根据需要进行全屏或分屏查看，可以通过操作指令切换全屏模式和分屏模式。When the terminal device is a mobile phone or a tablet computer, the user can view and operate the three-dimensional display directly through the display without wearing a VR helmet or glasses; during the operation, the user can perform full-screen or split-screen viewing according to the needs, and can operate through The command switches between full screen mode and split screen mode.

请参照图13，本实施例还提供另一种实施方式来进行三维画面显示，三维画面显示包括以下步骤。Referring to FIG. 13, the embodiment further provides another embodiment for performing three-dimensional screen display, and the three-dimensional screen display includes the following steps.

步骤S174，通过传感装置获取终端设备100的运动状态；该运动状态包括终端设备100的位置和角度；Step S174: Acquire a motion state of the terminal device 100 by using a sensing device; the motion state includes a position and an angle of the terminal device 100;

可以通过终端设备100中的陀螺仪、三轴传感器、九轴传感器等传感装置采集终端的运动状态；上述终端设备100的位置数据可以为终端设备100发生的位移，移动后的位置等；上述终端设备的角度数据可以为旋转角度、倾斜角度等。The motion state of the terminal may be collected by a sensing device such as a gyroscope, a three-axis sensor, or a nine-axis sensor in the terminal device 100; the location data of the terminal device 100 may be a displacement generated by the terminal device 100, a position after the movement, etc.; The angle data of the terminal device may be a rotation angle, an inclination angle, or the like.

步骤S175，查找预先设置的运动状态与显示区域坐标的对应关系，获取运动状态对应的显示区域坐标；Step S175, searching for a correspondence between the preset motion state and the display region coordinate, and acquiring the display region coordinate corresponding to the motion state;

步骤S176，将三维画面中，显示区域坐标对应的显示区域显示在显示界面上。In step S176, the display area corresponding to the display area coordinates in the three-dimensional screen is displayed on the display interface.

可以根据当前三维画面的尺寸，将终端设备100的运动状态与该三维画面各个区域的坐标建立对应关系；例如，当终端设备100平移第一设定距离时，显示界面相对三维画面平移第二设定距离；当终端设备100旋转第一设定角度时，显示界面相对三维画面可以平移第三设定距离，或者相对三维画面旋转第二设定角度。当然，还可以根据终端设备100的运行状态调整三维画面的显示视角。The motion state of the terminal device 100 and the coordinates of each region of the three-dimensional image may be associated with each other according to the size of the current three-dimensional image; for example, when the terminal device 100 translates the first set distance, the display interface is moved relative to the three-dimensional frame. a fixed distance; when the terminal device 100 rotates the first set angle, the display interface may translate the third set distance relative to the three-dimensional picture, or rotate the second set angle relative to the three-dimensional picture. Of course, it is also possible to adjust the display viewing angle of the three-dimensional screen according to the operating state of the terminal device 100.

上述三维画面内包括多个应用窗口；多个应用窗口按照设定的排列方式分布在三维画面中。参见图14所示的一种三维画面的示意图；图14中以三维画面中设置有八个应用窗口为例进行说明，这个八个应用窗口以两行四列的形式排列；当然，也可以以一行、一列或其他形式排列；图14中的各个窗口的排列方式向彼此之间不重叠，还可以以重叠的方式排列，仅显示各个窗口的标签。The above three-dimensional picture includes a plurality of application windows; the plurality of application windows are distributed in the three-dimensional picture according to the set arrangement. Referring to FIG. 14 is a schematic diagram of a three-dimensional picture; FIG. 14 is an example in which eight application windows are arranged in a three-dimensional picture, and the eight application windows are arranged in two rows and four columns; of course, One row, one column or other forms are arranged; the arrangement of the windows in FIG. 14 does not overlap each other, and may also be arranged in an overlapping manner, and only the labels of the respective windows are displayed.

上述三维画面为虚拟三维画面；该显示三维画面的尺寸大于终端设备100显示界面的尺寸；用户移动或旋转终端设备100时，显示界面相对显示三维画面变化；图13中，显示界面显示的是显示三维画面中第二行第二个窗口；此时，如果用户向右侧平移终端设备100或向右旋转，该显示界面可以显示显示三维画面中第二行第三个窗口；如果用户向上平移终端设备100或向上旋转，该显示界面可以显示显示三维画面中第一行第二个窗口。The three-dimensional picture is a virtual three-dimensional picture; the size of the display three-dimensional picture is larger than the size of the display interface of the terminal device 100; when the user moves or rotates the terminal device 100, the display interface changes relative to the display three-dimensional picture; in FIG. 13, the display interface displays the display. The second row of the second window in the three-dimensional picture; at this time, if the user pans the terminal device 100 to the right or rotates to the right, the display interface can display the second window of the second line in the three-dimensional picture; The device 100 is rotated upwards, and the display interface can display and display the second window in the first row of the three-dimensional picture.

当三维画面内包括多个应用窗口时，可以采用多种形式接收用户触发的设置指令；例如，至少一个应用窗口用于接收用户触发的三维画面设置指令；再如，三维画面内还包括设置按钮，该设置按钮用于接收用户触发的三维画面设置指令；该三维画面设置指令可以包括窗口设置指令和3D元素设置指令；该设置按钮还可以对三维画面内的各个窗口进行隐藏、窗口内容透明化(仅显示窗口边框)等处理。When a plurality of application windows are included in the three-dimensional screen, the user-triggered setting instructions may be received in various forms; for example, at least one application window is used to receive a user-triggered three-dimensional screen setting instruction; for example, the three-dimensional screen further includes a setting button. The setting button is configured to receive a user-triggered three-dimensional picture setting instruction; the three-dimensional picture setting instruction may include a window setting instruction and a 3D element setting instruction; the setting button may also hide each window in the three-dimensional picture, and the window content is transparent. (Only display window borders) and other processing.

步骤S177，接收用户触发的三维画面设置指令，判断该三维画面设置指令的类型；如果该三维画面设置指令包括窗口设置指令，执行步骤S178，如果该三维画面设置指令包括3D元素设置指令，执行步骤S179；Step S177, receiving a user-triggered three-dimensional picture setting instruction, determining the type of the three-dimensional picture setting instruction; if the three-dimensional picture setting instruction includes a window setting instruction, executing step S178, if the three-dimensional picture setting instruction includes a 3D element setting instruction, performing steps S179;

步骤S178，按照窗口设置指令在三维画面中显示应用窗口；其中，该窗口设置指令至少包括窗口添加指令、窗口位置指令、窗口视角指令、窗口显示设置指令、窗口大小调整指令、窗口旋转方式指令、窗口排列指令和窗口显示形状设置指令中的多种；该窗口显示形状设置指令至少包括平面模式、球面模式、曲面模式或异形模式。Step S178, displaying an application window in the three-dimensional screen according to the window setting instruction; wherein the window setting instruction includes at least a window adding instruction, a window position instruction, a window angle instruction, a window display setting instruction, a window size adjustment instruction, a window rotation mode instruction, The window arrangement instruction and the window display a plurality of shape setting instructions; the window display shape setting instruction includes at least a plane mode, a spherical mode, a surface mode, or an alien mode.

具体地，上述窗口显示设置指令可以设置三维画面内仅显示单独一个窗口，也可以设置多个窗口显示同一应用，也可以设置多个窗口显示不同应用；上述窗口旋转方式指令可以设置窗口不旋转，或者围绕预设的X轴、Y轴或Z轴旋转。Specifically, the window display setting instruction may set only one single window to be displayed in the three-dimensional screen, or may set multiple windows to display the same application, or set multiple windows to display different applications; the window rotation mode instruction may set the window not to rotate. Or rotate around the preset X, Y or Z axis.

例如，通过窗口边框设置指令，可以设置窗口边框为无边框或透明边框；通过窗口视角指令，可以调整窗口内应用显示的视角。For example, through the window border setting instruction, the window border can be set to be no border or transparent border; through the window perspective command, the viewing angle of the application display in the window can be adjusted.

步骤S179，按照3D元素设置指令在三维画面中显示3D元素；其中，该3D元素设置指令至少包括变化效果、显示内容、显示尺寸和显示视角中的一种或多种；显示视角至少包括平行视角或望远镜视角。Step S179, displaying a 3D element in the three-dimensional picture according to the 3D element setting instruction; wherein the 3D element setting instruction includes at least one of a change effect, a display content, a display size, and a display angle; the display angle of view includes at least a parallel view angle Or telescope perspective.

例如，通过显示尺寸，可以对3D元素进行伸缩变化，以调整3D元素的尺寸、形状等；通过显示内容，可以设置3D元素的图像，该图像可以为静态图像、动态图像等。For example, by displaying the size, the 3D element can be flexibly changed to adjust the size, shape, and the like of the 3D element; by displaying the content, an image of the 3D element can be set, and the image can be a still image, a moving image, or the like.

该方式中，三维画面内的各个窗口可以同时显示多个应用程序，用户通过简单的动作即可查看各个应用窗口的内容，突破了应用界面受显示屏物理尺寸、特性限制的局限性；用户还可以通过窗口、设置按钮等对三维画面的显示方式进行多角度的设置，扩展、丰富了终端应用显示范围和显示方式，提升了用户体验度。In this mode, each window in the three-dimensional picture can display multiple applications at the same time, and the user can view the contents of each application window through a simple action, which breaks the limitation that the application interface is limited by the physical size and characteristics of the display screen; The display mode of the three-dimensional screen can be set at multiple angles through windows, setting buttons, etc., which expands and enriches the display range and display mode of the terminal application, thereby improving the user experience.

图15为本发明实施例提供的一种应用显示装置的结构示意图。如图15所示，该装置包括：接收单元601、第一处理单元602、第二处理单元603、检测单元604和调整单元605。FIG. 15 is a schematic structural diagram of an application display device according to an embodiment of the present invention. As shown in FIG. 15, the apparatus includes a receiving unit 601, a first processing unit 602, a second processing unit 603, a detecting unit 604, and an adjusting unit 605.

接收单元601，用于接收三维画面显示指令，所述三维画面中包含M个显示面板和控制面板；The receiving unit 601 is configured to receive a three-dimensional screen display instruction, where the three-dimensional screen includes M display panels and a control panel;

第一处理单元602，用于根据所述三维画面中包含的显示面板数量，在后台运行的应用中选择M个应用，并确定与每个应用对应的显示面板；The first processing unit 602 is configured to select M applications in an application running in the background according to the number of display panels included in the three-dimensional screen, and determine a display panel corresponding to each application;

第二处理单元603，用于将确定的每个应用的应用界面信息分别显示在对应的显示面板中，将***安装的应用的应用信息均显示在控制面板中。The second processing unit 603 is configured to display the determined application interface information of each application in a corresponding display panel, and display application information of the installed application of the system in the control panel.

可选地，所述第一处理单元603具体用于：Optionally, the first processing unit 603 is specifically configured to:

可选地，所述第二处理单元603还用于：Optionally, the second processing unit 603 is further configured to:

检测各个应用的状态；Detect the status of each application;

可选地，该装置还包括：检测单元604和调整单元605，所述检测单元，用于检测终端设备100的旋转角度；Optionally, the device further includes: a detecting unit 604 and an adjusting unit 605, configured to detect a rotation angle of the terminal device 100;

所述调整单元，用于根据检测到的所述旋转角度，调整各个显示面板在三维画面中的显示位置。The adjusting unit is configured to adjust a display position of each display panel in the three-dimensional screen according to the detected rotation angle.

可选地，该装置中的第二处理单元603还用于：Optionally, the second processing unit 603 in the device is further configured to:

请参照图16，在本实施例中，所述应用显示装置还包括指令模块单元606及显示单元607。Referring to FIG. 16, in the embodiment, the application display device further includes an instruction module unit 606 and a display unit 607.

第一指令接收单元606，用于通过应用窗口接收用户的操作指令；The first instruction receiving unit 606 is configured to receive an operation instruction of the user through the application window;

第一显示单元607，用于当接收到操作指令时，按照操作指令在三维画面中展示应用内容。The first display unit 607 is configured to display the application content in the three-dimensional screen according to the operation instruction when receiving the operation instruction.

可选地，第一显示单元607，用于当接收到操作指令时，按照操作指令显示三维画面和/或应用窗口。Optionally, the first display unit 607 is configured to display a three-dimensional picture and/or an application window according to the operation instruction when receiving the operation instruction.

请参照图17，在本实施例中，所述应用显示装置还包括第二指令接收单元608、对象确定单元609及对象选中单元610。Referring to FIG. 17, in the embodiment, the application display device further includes a second instruction receiving unit 608, an object determining unit 609, and an object selecting unit 610.

第二指令接收单元608，用于接收用户发出的对象操作指令；其中，对象操作指令包括语音指令、手势指令或操作指令；对象确定单元609，用于从当前的三维画面中，确定接收到对象操作指令时，瞄点瞄准的对象；对象选中单元610，用于选中对象，对对象进行控制操作。The second instruction receiving unit 608 is configured to receive an object operation instruction issued by the user, where the object operation instruction includes a voice instruction, a gesture instruction, or an operation instruction, and the object determining unit 609 is configured to determine, according to the current three-dimensional image, the received object. When the operation instruction is executed, the object targeted by the aiming point; the object selection unit 610 is used to select the object and perform control operations on the object.

可选地，上述第二指令接收单元608还用于：通过麦克风接收用户发出的语音信号；判断语音信号中是否包含预设的关键字；如果是，将语音信号中包含的关键字确定为对象操作指令。Optionally, the second instruction receiving unit 608 is further configured to: receive, by using a microphone, a voice signal sent by a user; determine whether the voice signal includes a preset keyword; if yes, determine a keyword included in the voice signal as an object. Operation instructions.

可选地，上述第二指令接收单元608还用于：通过摄像装置接收用户发出的手势视频信号；判断手势视频信号中是否包含预设的手势特征；如果是，将手势视频信号中包含的手势特征确定为对象操作指令。Optionally, the second instruction receiving unit 608 is further configured to: receive, by the camera device, a gesture video signal sent by the user; determine whether the gesture video signal includes a preset gesture feature; if yes, the gesture included in the gesture video signal The feature is determined as an object operation instruction.

可选地，上述第二指令接收单元608还用于：通过手柄接收用户发出的操作指令，将操作指令确定为对象操作指令。Optionally, the second instruction receiving unit 608 is further configured to: receive an operation instruction issued by the user through the handle, and determine the operation instruction as the object operation instruction.

请参照图18，在本实施例中，所述应用显示装置还包括第二显示单元611及第三显示单元612。Referring to FIG. 18, in the embodiment, the application display device further includes a second display unit 611 and a third display unit 612.

第二显示单元611，用于根据接收到的传感信号，将三维画面的对应部分显示在显示界面中；传感信号包括终端设备 100的运动状态，或者，用户触发的触屏信号；运动状态包括终端设备100的位置和角度；The second display unit 611 is configured to display a corresponding portion of the three-dimensional picture in the display interface according to the received sensing signal; the sensing signal includes a motion state of the terminal device 100, or a touch screen signal triggered by the user; Including the position and angle of the terminal device 100;

第三显示单元612，用于当接收到用户触发的操作指令时，按照操作指令在三维画面中显示3D元素和/或应用窗口。The third display unit 612 is configured to display the 3D element and/or the application window in the three-dimensional screen according to the operation instruction when receiving the operation instruction triggered by the user.

可选地，上述第二显示单元611，还用于：通过传感装置获取终端设备100的运动状态；查找预先设置的运动状态与显示区域坐标的对应关系，获取运动状态对应的显示区域坐标；将三维画面中，显示区域坐标对应的显示区域显示在显示界面上。Optionally, the second display unit 611 is further configured to: acquire a motion state of the terminal device 100 by using the sensing device; and search for a corresponding relationship between the preset motion state and the display region coordinate, and acquire the display region coordinate corresponding to the motion state; In the three-dimensional screen, the display area corresponding to the display area coordinates is displayed on the display interface.

可选地，当三维画面内包括多个应用窗口时，至少一个应用窗口用于接收用户触发的三维画面设置指令；第三显示单元612，还用于当三维画面设置指令中包括窗口设置指令时，按照窗口设置指令在三维画面中显示应用窗口；其中，窗口设置指令至少包括窗口添加指令、窗口位置指令、窗口视角指令、窗口显示设置指令、窗口大小调整指令、窗口旋转方式指令、窗口排列指令和窗口显示形状设置指令中的其中之一或多种指令的组合；该窗口显示形状设置指令至少包括平面模式、球面模式、曲面模式或异形模式。Optionally, when the three-dimensional picture includes multiple application windows, the at least one application window is configured to receive a user-triggered three-dimensional picture setting instruction, and the third display unit 612 is further configured to: when the three-dimensional picture setting instruction includes the window setting instruction Displaying an application window in a three-dimensional screen according to a window setting instruction; wherein the window setting instruction includes at least a window adding instruction, a window position instruction, a window angle instruction, a window display setting instruction, a window size adjustment instruction, a window rotation mode instruction, and a window arrangement instruction. And the window displays a combination of one or more of the shape setting instructions; the window display shape setting instruction includes at least a planar mode, a spherical mode, a surface mode, or an alien mode.

本发明实施例所提供的一种应用显示装置可以为设备上的特定硬件或者安装于设备上的软件或固件等。本发明实施例所提供的装置，其实现原理及产生的技术效果和前述方法实施例相同，为简要描述，装置实施例部分未提及之处，可参考前述方法实施例中相应内容。所属领域的技术人员可以清楚地了解到，为描述的方便和简洁，前述描述的***、装置和单元的具体工作过程，均可以参考上述方法实施例中的对应过程，在此不再赘述。An application display device provided by an embodiment of the present invention may be specific hardware on a device or software or firmware installed on the device. The implementation principle and the technical effects of the device provided by the embodiments of the present invention are the same as those of the foregoing method embodiments. For a brief description, where the device embodiment is not mentioned, reference may be made to the corresponding content in the foregoing method embodiments. A person skilled in the art can clearly understand that for the convenience and brevity of the description, the specific working processes of the foregoing system, the device and the unit can refer to the corresponding processes in the foregoing method embodiments, and details are not described herein again.

所述功能如果以软件功能单元的形式实现并作为独立的产品销售或使用时，可以存储在一个计算机可读取存储介质中。基于这样的理解，本发明的技术方案本质上或者说对现有技术做出贡献的部分或者该技术方案的部分可以以软件产品的形式体现出来，该计算机软件产品存储在一个存储介质中，包括若干指令用以使得一台计算机设备(可以是个人计算机，服务器，或者网络设备等)执行本发明各个实施例所述方法的全部或部分步骤。而前述的存储介质包括：U盘、移动硬盘、只读存储器(ROM，Read-Only Memory)、随机存取存储器(RAM，Random Access Memory)、磁碟或者光盘等各种可以存储程序代码的介质。The functions may be stored in a computer readable storage medium if implemented in the form of a software functional unit and sold or used as a standalone product. Based on such understanding, the technical solution of the present invention, which is essential or contributes to the prior art, or a part of the technical solution, may be embodied in the form of a software product, which is stored in a storage medium, including The instructions are used to cause a computer device (which may be a personal computer, server, or network device, etc.) to perform all or part of the steps of the methods described in various embodiments of the present invention. The foregoing storage medium includes: a U disk, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk, and the like. .

应注意到：相似的标号和字母在下面的附图中表示类似项，因此，一旦某一项在一个附图中被定义，则在随后的附图中不需要对其进行进一步定义和解释，此外，术语“第一”、“第二”、“第三”等仅用于区分描述，而不能理解为指示或暗示相对重要性。It should be noted that similar reference numerals and letters indicate similar items in the following figures. Therefore, once an item is defined in a drawing, it is not necessary to further define and explain it in the subsequent drawings. Moreover, the terms "first", "second", "third", and the like are used merely to distinguish a description, and are not to be construed as indicating or implying a relative importance.

最后应说明的是：以上所述实施例，仅为本发明的具体实施方式，用以说明本发明的技术方案，而非对其限制，本发明的保护范围并不局限于此，尽管参照前述实施例对本发明进行了详细的说明，本领域的普通技术人员应当理解：任何熟悉本技术领域的技术人员在本发明揭露的技术范围内，其依然可以对前述实施例所记载的技术方案进行修改或可轻易想到变化，或者对其中部分技术特征进行等同替换；而这些修改、变化或者替换，并不使相应技术方案的本质脱离本发明实施例技术方案的精神和范围。都应涵盖在本发明的保护范围之内。因此，本发明的保护范围应所述以权利要求的保护范围为准。Finally, it should be noted that the above-mentioned embodiments are merely specific embodiments of the present invention, and are used to explain the technical solutions of the present invention, and are not limited thereto, and the scope of protection of the present invention is not limited thereto, although reference is made to the foregoing. The present invention has been described in detail, and those skilled in the art should understand that any one skilled in the art can still modify the technical solutions described in the foregoing embodiments within the technical scope disclosed by the present invention. The changes may be easily conceived, or equivalents may be substituted for some of the technical features. The modifications, variations, and substitutions of the present invention do not depart from the spirit and scope of the technical solutions of the embodiments of the present invention. All should be covered by the scope of the present invention. Therefore, the scope of the invention should be determined by the scope of the claims.

工业实用性Industrial applicability

本申请实施例的上述设计能够将***安装的多个应用的应用信息显示在控制面板中，将确定的每个应用的应用界面信息分别显示在对应的显示面板中，实现在终端设备中同时显示多个应用，提高用户体验。The above-mentioned design of the embodiment of the present application can display the application information of the multiple applications installed in the system in the control panel, and display the determined application interface information of each application in the corresponding display panel, so as to simultaneously display in the terminal device. Multiple applications to enhance the user experience.

Claims

一种应用显示方法，应用于终端设备，其特征在于，所述方法包括：An application display method is applied to a terminal device, where the method includes:

接收三维画面显示指令，所述三维画面中包含M个显示面板和控制面板；Receiving a three-dimensional picture display instruction, where the three-dimensional picture includes M display panels and a control panel;

根据所述三维画面中包含的显示面板数量，在后台运行的应用中选择M个应用，并确定与每个应用对应的显示面板；Selecting M applications in an application running in the background according to the number of display panels included in the three-dimensional screen, and determining a display panel corresponding to each application;

将确定的每个应用的应用界面信息分别显示在对应的显示面板中，将***安装的应用的应用信息均显示在控制面板中。The determined application interface information of each application is respectively displayed in the corresponding display panel, and the application information of the installed application of the system is displayed in the control panel.
如权利要求1所述的方法，其特征在于，所述在后台运行的应用中选择M个应用，并确定与每个应用对应的显示面板，包括：The method of claim 1, wherein the selecting the M applications in the background running application and determining the display panel corresponding to each application comprises:

根据应用进入后台的时间信息，或应用的属性信息，确定各个应用的优先级，从高优先级到低优先级在所述应用中选择M个应用；Determining the priority of each application according to the time information of the application entering the background, or the attribute information of the application, and selecting M applications from the high priority to the low priority;

根据各个应用的优先级，以及预设的显示面板的标识，针对M个应用中的每个应用，确定与该应用对应的显示面板。A display panel corresponding to the application is determined for each of the M applications according to the priority of each application and the identifier of the preset display panel.
如权利要求1所述的方法，其特征在于，在所述将确定的每个应用的应用界面信息分别显示在对应的显示面板中后，所述方法还包括：The method of claim 1, wherein after the application interface information of each application to be determined is displayed in a corresponding display panel, the method further comprises:

检测各个应用的状态；Detect the status of each application;

在检测到至少一个应用的状态为使用状态后，基于各个应用的优先级，在检测到的至少一个应用中，确定目标应用；After detecting that the state of the at least one application is the usage state, determining, according to the priority of each application, the target application in the detected at least one application;

获取该目标应用的应用界面信息中的背景信息；Obtaining background information in the application interface information of the target application;

将所述背景信息转换为三维背景信息；Converting the background information into three-dimensional background information;

基于所述三维背景信息，以及预设的图片元素，确定三维画面的显示背景。Determining a display background of the three-dimensional picture based on the three-dimensional background information and the preset picture element.
如权利要求3所述的方法，其特征在于，在检测到至少一个应用的状态为使用状态后，所述方法还包括：The method of claim 3, wherein after detecting that the state of the at least one application is a usage state, the method further comprises:

在所述至少一个应用中，确定是否存在外部设备的输入请求命令，在确定存在外部设备的输入请求命令后，获取所述输入请求命令，所述输入请求命令中携带有请求信息；In the at least one application, determining whether there is an input request command of the external device, and after determining that the input request command of the external device exists, acquiring the input request command, where the input request command carries the request information;

在所述请求信息中确定至少一个关键词，针对各个关键词，基于预设的关键词与三维模型的映射关系，在三维画面的预设范围中显示与该关键词对应的三维模型。At least one keyword is determined in the request information, and for each keyword, a three-dimensional model corresponding to the keyword is displayed in a preset range of the three-dimensional image based on a mapping relationship between the preset keyword and the three-dimensional model.
如权利要求1所述的方法，其特征在于，所述方法还包括：The method of claim 1 wherein the method further comprises:

检测终端设备的旋转角度；根据检测到的所述旋转角度，调整各个显示面板在三维画面中的显示位置。Detecting a rotation angle of the terminal device; adjusting a display position of each display panel in the three-dimensional screen according to the detected rotation angle.
如权利要求1-5中任意一项所述的方法，其特征在于，应用窗口包括显示面板和控制面板，所述方法还包括：The method of any of claims 1-5, wherein the application window comprises a display panel and a control panel, the method further comprising:

通过所述应用窗口接收用户的操作指令；当接收到所述操作指令时，按照所述操作指令在所述三维画面中展示应用内容。Receiving, by the application window, an operation instruction of the user; when receiving the operation instruction, displaying the application content in the three-dimensional screen according to the operation instruction.
如权利要求6所述的方法，其特征在于，所述应用窗口和所述三维画面的位置关系至少包括以下之一：The method of claim 6, wherein the positional relationship between the application window and the three-dimensional picture comprises at least one of the following:

所述应用窗口和所述三维画面相互分离，分别位于所述终端设备的显示界面的指定区域；所述应用窗口位于所述三维画面中的指定区域；或所述应用窗口以透明或半透明的形式覆盖于所述三维画面上。The application window and the three-dimensional picture are separated from each other, respectively located in a designated area of the display interface of the terminal device; the application window is located in a designated area in the three-dimensional picture; or the application window is transparent or translucent The form is overlaid on the three-dimensional picture.
如权利要求6所述的方法，其特征在于，当所述操作指令包括三维画面修改指令时，所述按照所述操作指令在所述三维画面中展示应用内容的步骤，包括：The method according to claim 6, wherein when the operation instruction comprises a three-dimensional picture modification instruction, the step of displaying the application content in the three-dimensional picture according to the operation instruction comprises:

将所述三维画面修改指令中的修改内容，添加至所述三维画面中，根据所述三维画面修改指令中的坐标，调整所述修改内容在所述三维画面中的位置，显示当前三维画面。Adding the modified content in the three-dimensional picture modification instruction to the three-dimensional picture, and adjusting the position of the modified content in the three-dimensional picture according to the coordinates in the three-dimensional picture modification instruction, and displaying the current three-dimensional picture.
如权利要求6所述的方法，其特征在于，所述方法还包括：当接收到所述操作指令时，按照所述操作指令显示所述三维画面和/或所述应用窗口；The method according to claim 6, wherein the method further comprises: displaying the three-dimensional picture and/or the application window according to the operation instruction when the operation instruction is received;

当所述操作指令包括三维画面显示指令时，所述按照所述操作指令显示所述三维画面的步骤，包括：When the operation instruction includes a three-dimensional screen display instruction, the step of displaying the three-dimensional image according to the operation instruction includes:

按照所述三维画面显示指令，显示所述三维画面；其中，所述三维画面显示指令包括显示视角或显示模式；所述显示视角至少包括平行视角或望远镜视角；所述显示模式至少包括平面模式、球面模式、曲面模式或异形模式；Displaying the three-dimensional picture according to the three-dimensional picture display instruction; wherein the three-dimensional picture display instruction includes a display angle of view or a display mode; the display angle of view includes at least a parallel angle of view or a telescope angle; the display mode includes at least a plane mode, Spherical mode, surface mode or profiled mode;

当所述操作指令包括应用窗口显示指令时，所述按照所述操作指令显示所述应用窗口的步骤，包括：When the operation instruction includes an application window display instruction, the step of displaying the application window according to the operation instruction includes:

当所述应用窗口显示指令为隐藏应用窗口时，隐藏所述应用窗口，将所述三维画面进行全屏显示；当所述应用窗口显示指令为显示应用窗口时，显示所述应用窗口，将所述三维画面进行半屏显示；或者，所述应用窗口以透明或半透明的形式覆盖于所述三维画面上。When the application window display instruction is a hidden application window, the application window is hidden, and the three-dimensional image is displayed in full screen; when the application window display instruction is to display an application window, the application window is displayed, and the application window is The three-dimensional picture is displayed in half screen; or the application window is overlaid on the three-dimensional picture in a transparent or translucent form.
如权利要求6所述的方法，其特征在于，所述应用窗口内设置有多个操作单元；The method according to claim 6, wherein a plurality of operation units are disposed in the application window;

每个所述操作单元通过接收触屏信号获取设定类型的操作指令；或者，所述显示界面上还显示有操作盘和瞄点；通过所述操作盘和所述瞄点，每个所述操作单元获取设定类型的操作指令。Each of the operation units acquires a set type of operation instruction by receiving a touch screen signal; or, the display interface further displays an operation panel and an aiming point; through the operation panel and the aiming point, each of the The operation unit acquires an operation instruction of a set type.
如权利要求10所述的方法，其特征在于，所述方法还包括：The method of claim 10, wherein the method further comprises:

接收用户发出的对象操作指令；其中，所述对象操作指令包括语音指令、手势指令或操作指令；从当前的三维画面中，确定接收到所述对象操作指令时，瞄点瞄准的对象；选中所述对象，对所述对象进行控制操作。Receiving an object operation instruction issued by the user; wherein the object operation instruction includes a voice instruction, a gesture instruction, or an operation instruction; and determining, from the current three-dimensional picture, an object that the aiming point is aimed at when the object operation instruction is received; The object is controlled by the object.
如权利要求11所述的方法，其特征在于，当所述对象操作指令包括语音指令时，所述接收用户发出的对象操作指令的步骤，包括：The method of claim 11, wherein when the object operation instruction comprises a voice instruction, the step of receiving an object operation instruction issued by the user comprises:

通过麦克风接收用户发出的语音信号，判断所述语音信号中是否包含预设的关键字，如果是，将所述语音信号中包含的所述关键字确定为所述对象操作指令；或Receiving, by the microphone, a voice signal sent by the user, determining whether the voice signal includes a preset keyword, and if yes, determining the keyword included in the voice signal as the object operation instruction; or

通过摄像装置接收用户发出的手势视频信号，判断所述手势视频信号中是否包含预设的手势特征，如果是，将所述手势视频信号中包含的所述手势特征确定为所述对象操作指令。Receiving, by the camera device, the gesture video signal sent by the user, determining whether the gesture video signal includes a preset gesture feature, and if yes, determining the gesture feature included in the gesture video signal as the object operation instruction.
如权利要求11所述的方法，其特征在于，所述方法还包括：The method of claim 11 wherein the method further comprises:

通过传感器装置检测所述用户头部的运动状态；根据所述运动状态，控制所述瞄点在三维画面中移动。The motion state of the user's head is detected by a sensor device; according to the motion state, the aiming point is controlled to move in a three-dimensional picture.
如权利要求11-13中任意一项所述的方法，所述终端设备的显示界面用于显示三维画面，所述三维画面内包括3D元素和应用窗口，其特征在于，所述方法包括：The method of any one of the preceding claims, wherein the display interface of the terminal device is configured to display a three-dimensional image, and the three-dimensional image includes a 3D element and an application window, wherein the method comprises:

根据接收到的传感信号，将所述三维画面的对应部分显示在所述显示界面中；所述传感信号包括所述终端的运动状态，或者，用户触发的触屏信号；所述运动状态包括所述终端的位置和角度；Displaying, according to the received sensing signal, a corresponding portion of the three-dimensional picture in the display interface; the sensing signal includes a motion state of the terminal, or a touch screen signal triggered by a user; the motion state Including the position and angle of the terminal;

当接收到用户操作指令时，按照所述操作指令在三维画面中显示所述3D元素和/或所述应用窗口。When the user operation instruction is received, the 3D element and/or the application window are displayed in a three-dimensional screen according to the operation instruction.
如权利要求14所述的方法，其特征在于，当所述三维画面内包括多个应用窗口时，至少一个所述应用窗口用于接收用户触发的三维画面设置指令；The method according to claim 14, wherein when the plurality of application windows are included in the three-dimensional screen, at least one of the application windows is configured to receive a user-triggered three-dimensional picture setting instruction;

所述按照所述操作指令在三维画面中显示所述应用窗口的步骤，包括：The step of displaying the application window in a three-dimensional screen according to the operation instruction includes:

当所述三维画面设置指令中包括窗口设置指令时，按照所述窗口设置指令在所述三维画面中显示所述应用窗口；其中，所述窗口设置指令至少包括窗口添加指令、窗口位置指令、窗口视角指令、窗口显示设置指令、窗口大小调整指令、窗口旋转方式指令、窗口排列指令和窗口显示形状设置指令中的多种；所述窗口显示形状设置指令至少包括平面模式、球面模式、曲面模式或异形模式。When the window setting instruction includes a window setting instruction, displaying the application window in the three-dimensional screen according to the window setting instruction; wherein the window setting instruction includes at least a window adding instruction, a window position instruction, and a window a plurality of angle view instructions, a window display setting instruction, a window size adjustment instruction, a window rotation mode instruction, a window arrangement instruction, and a window display shape setting instruction; the window display shape setting instruction includes at least a plane mode, a spherical mode, a surface mode, or Alien mode.
如权利要求15所述的方法，其特征在于，所述按照所述操作指令在三维画面中显示所述3D元素的步骤，包括：The method according to claim 15, wherein the step of displaying the 3D element in a three-dimensional picture according to the operation instruction comprises:

当所述三维画面设置指令中包括3D元素设置指令时，按照所述3D元素设置指令在三维画面中显示所述3D元素；其中，所述3D元素设置指令至少包括变化效果、显示内容、显示尺寸和显示视角中的一种或多种；所述显示视角至少包括平行视角或望远镜视角。When the 3D element setting instruction includes a 3D element setting instruction, the 3D element is displayed in a 3D picture according to the 3D element setting instruction; wherein the 3D element setting instruction includes at least a change effect, a display content, and a display size. And displaying one or more of the viewing angles; the display viewing angle includes at least a parallel viewing angle or a telescope viewing angle.
一种应用显示装置，应用于终端设备，其特征在于，所述装置包括：An application display device is applied to a terminal device, wherein the device comprises:

接收单元，配置成接收三维画面显示指令，所述三维画面中包含M个显示面板和控制面板；a receiving unit configured to receive a three-dimensional screen display instruction, where the three-dimensional screen includes M display panels and a control panel;

第一处理单元，配置成根据所述三维画面中包含的显示面板数量，在后台运行的应用中选择M个应用，并确定与每个应用对应的显示面板；a first processing unit, configured to select M applications in an application running in the background according to the number of display panels included in the three-dimensional screen, and determine a display panel corresponding to each application;

第二处理单元，配置成将确定的每个应用的应用界面信息分别显示在对应的显示面板中，将***安装的应用的应用信息均显示在控制面板中。The second processing unit is configured to display the determined application interface information of each application in the corresponding display panel, and display the application information of the installed application of the system in the control panel.
如权利要求17所述的装置，其特征在于，所述第一处理单元进一步配置成：The apparatus of claim 17, wherein the first processing unit is further configured to:

根据应用进入后台的时间信息，或应用的属性信息，确定各个应用的优先级，从高优先级到低优先级在所述应用中选择M个应用；Determining the priority of each application according to the time information of the application entering the background, or the attribute information of the application, and selecting M applications from the high priority to the low priority;

根据各个应用的优先级，以及预设的显示面板的标识，针对M个应用中的每个应用，确定与该应用对应的显示面板。A display panel corresponding to the application is determined for each of the M applications according to the priority of each application and the identifier of the preset display panel.
一种终端设备，所述终端设备包括处理器及存储有若干计算机指令的非易失性存储器，其特征在于，所述计算机指令被所述处理器执行时，所述终端设备执行权利要求1-16中任意一项所述的应用显示方法。A terminal device comprising a processor and a non-volatile memory storing a plurality of computer instructions, wherein when the computer instruction is executed by the processor, the terminal device executes claim 1- The application display method according to any one of 16.
一种可读存储介质，所述可读存储介质包括计算机程序，其特征在于：A readable storage medium, the readable storage medium comprising a computer program, characterized by:

所述计算机程序运行时控制所述可读存储介质所在终端设备执行权利要求1-16中任意一项所述的应用显示方法。The terminal device that controls the readable storage medium is configured to execute the application display method according to any one of claims 1 to 16.
一种应用内容的展示方法，其特征在于，所述方法应用于终端设备；所述终端设备的显示界面上显示有应用窗口和3D空间；所述方法包括：A method for displaying application content, wherein the method is applied to a terminal device; an application window and a 3D space are displayed on a display interface of the terminal device; and the method includes:

通过所述应用窗口接收用户的操作指令；当接收到所述操作指令时，按照所述操作指令在所述3D空间中展示应用内容。Receiving, by the application window, an operation instruction of the user; when receiving the operation instruction, displaying the application content in the 3D space according to the operation instruction.
一种应用内容的展示装置，其特征在于，所述装置设置于终端设备；所述终端设备的显示界面上显示有应用窗口和3D空间；所述装置包括：An application device for displaying content, wherein the device is disposed on a terminal device; an application window and a 3D space are displayed on a display interface of the terminal device; and the device includes:

指令接收模块，用于通过所述应用窗口接收用户的操作指令；An instruction receiving module, configured to receive an operation instruction of the user through the application window;

内容展示模块，用于当接收到所述操作指令时，按照所述操作指令在所述3D空间中展示应用内容。The content presentation module is configured to display the application content in the 3D space according to the operation instruction when the operation instruction is received.
一种终端设备，其特征在于，包括处理器和机器可读存储介质，所述机器可读存储介质存储有能够被所述处理器执行的机器可执行指令，所述处理器执行所述机器可执行指令以实现权利要求21所述的方法。A terminal device, comprising a processor and a machine readable storage medium, the machine readable storage medium storing machine executable instructions executable by the processor, the processor executing the machine The instructions are executed to implement the method of claim 21.
一种三维空间显示界面的操作方法，其特征在于，所述方法应用于终端设备；所述方法包括：A method for operating a three-dimensional space display interface, wherein the method is applied to a terminal device; the method includes:

接收用户发出的对象操作指令；其中，所述对象操作指令包括语音指令、手势指令或操作指令；Receiving an object operation instruction issued by a user; wherein the object operation instruction includes a voice instruction, a gesture instruction, or an operation instruction;

从当前的三维空间显示界面中，确定接收到所述对象操作指令时，瞄点瞄准的对象；Determining, from the current three-dimensional space display interface, an object targeted by the aiming point when receiving the object operation instruction;

选中所述对象，对所述对象进行控制操作。The object is selected to perform control operations on the object.
一种三维空间显示界面的操作装置，其特征在于，所述装置设置于终端设备；所述装置包括：An operation device for a three-dimensional space display interface, wherein the device is disposed in a terminal device; the device includes:

指令接收模块，用于接收用户发出的对象操作指令；其中，所述对象操作指令包括语音指令、手势指令或操作指令；对象确定模块，用于从当前的三维空间显示界面中，确定接收到所述对象操作指令时，瞄点瞄准的对象；对象选中模块，用于选中所述对象，对所述对象进行控制操作。The instruction receiving module is configured to receive an object operation instruction issued by the user, where the object operation instruction includes a voice instruction, a gesture instruction or an operation instruction, and an object determination module is configured to determine, according to the current three-dimensional space display interface, the received instruction When the object operation instruction is described, the object targeted by the aiming point; the object selection module is used to select the object, and perform control operations on the object.
一种终端设备，其特征在于，包括处理器和机器可读存储介质，所述机器可读存储介质存储有能够被所述处理器执行的机器可执行指令，所述处理器执行所述机器可执行指令以实现权利要求1所述的方法。A terminal device, comprising a processor and a machine readable storage medium, the machine readable storage medium storing machine executable instructions executable by the processor, the processor executing the machine The instructions are executed to implement the method of claim 1.
一种显示方法，其特征在于，所述方法应用于终端，所述终端的显示界面用于显示空间；所述空间内包括3D元素和应用窗口，所述方法包括：根据接收到的传感信号，将所述空间的对应部分显示在所述显示界面中；所述传感信号包括所述终端的运动状态，或者，用户触发的触屏信号；所述运动状态包括所述终端的位置和角度；当接收到用户操作指令时，按照所述操作指令在空间中显示所述3D元素和/或所述应用窗口。A display method is applied to a terminal, wherein a display interface of the terminal is used for displaying a space; the space includes a 3D element and an application window, and the method includes: receiving, according to the received sensing signal Displaying a corresponding portion of the space in the display interface; the sensing signal includes a motion state of the terminal, or a touch screen signal triggered by a user; the motion state includes a position and an angle of the terminal When the user operation instruction is received, the 3D element and/or the application window are displayed in space according to the operation instruction.
一种显示装置，其特征在于，所述装置设置于终端，所述终端的显示界面用于显示空间；所述空间内包括显示3D元素和应用窗口，所述装置包括：A display device, wherein the device is disposed at a terminal, and the display interface of the terminal is used for displaying a space; the space includes displaying a 3D element and an application window, and the device includes:

第一显示模块，用于根据接收到的传感信号，将所述空间的对应部分显示在所述显示界面中；所述传感信号包括所述终端的运动状态，或者，用户触发的触屏信号；所述运动状态包括所述终端的位置和角度；a first display module, configured to display, according to the received sensing signal, a corresponding portion of the space in the display interface; the sensing signal includes a motion state of the terminal, or a touch screen triggered by a user a signal; the motion state including a position and an angle of the terminal;

第二显示模块，用于当接收到用户触发的操作指令时，按照所述操作指令在空间中显示所述3D元素和/或所述应用窗口。And a second display module, configured to display the 3D element and/or the application window in space according to the operation instruction when receiving a user-triggered operation instruction.
一种终端设备，其特征在于，包括处理器和机器可读存储介质，所述机器可读存储介质存储有能够被所述处理器执行的机器可执行指令，所述处理器执行所述机器可执行指令以实现权利要求1至6任一项所述的方法。A terminal device, comprising a processor and a machine readable storage medium, the machine readable storage medium storing machine executable instructions executable by the processor, the processor executing the machine The instructions are executed to implement the method of any one of claims 1 to 6.