WO2016180166A1 - Method of displaying application data, application controller, device and system - Google Patents

Method of displaying application data, application controller, device and system Download PDF

Info

Publication number
WO2016180166A1
WO2016180166A1 PCT/CN2016/079550 CN2016079550W WO2016180166A1 WO 2016180166 A1 WO2016180166 A1 WO 2016180166A1 CN 2016079550 W CN2016079550 W CN 2016079550W WO 2016180166 A1 WO2016180166 A1 WO 2016180166A1
Authority
WO
WIPO (PCT)
Prior art keywords
application
application data
data
control instruction
controller
Prior art date
Application number
PCT/CN2016/079550
Other languages
French (fr)
Chinese (zh)
Inventor
杜武平
姚迪狄
黄丛宇
Original Assignee
阿里巴巴集团控股有限公司
杜武平
姚迪狄
黄丛宇
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 阿里巴巴集团控股有限公司, 杜武平, 姚迪狄, 黄丛宇 filed Critical 阿里巴巴集团控股有限公司
Publication of WO2016180166A1 publication Critical patent/WO2016180166A1/en

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units

Definitions

  • the present application relates to the field of information transmission technologies, and in particular, to a method, an application controller, a device, and a system for displaying application data.
  • a conventional method of displaying application data on a computer on a display screen such as a television is usually a projection method.
  • the projection method generally includes: projecting the application data displayed on the computer screen directly to the display screen through a port connection, for example, using a projector to project or the like.
  • the inventors have found that at least the following problems exist in the prior art: when displaying computer application data by using an existing projection method, the display effect obtained is directly projecting the entire display screen of the computer to a large screen display such as a television. On the device, in order to display the data required by the user on the display screen, the same data must also be displayed on the computer screen of the computer. Therefore, the existing projection method display method has a poor user experience.
  • An object of an embodiment of the present application is to provide a method, an application controller, a device, and a system for displaying application data to improve user experience.
  • the embodiment of the present application provides a method, an application controller, a device, and a system for displaying application data, which are implemented as follows:
  • a method for displaying application data comprising: a first application controller receiving a control instruction for operating a first application; and a first application controller acquiring application data of the first application in response to the control instruction The first application controller returns the application data to the second device.
  • the method before the returning the application data to the second device, the method further includes: performing first processing on the application data; and correspondingly, returning, to the second device, application data that has undergone the first processing.
  • a method for displaying application data comprising: running a first application in a current first device; receiving a control instruction transmitted by the second device for operating the first application; acquiring the application in response to The application data of the control instruction; returning the application data to the second device.
  • a system for displaying application data comprising: a first device and a second device, wherein the first device establishes a communication connection with the first device;
  • the second device receives the input of the user, generates a control instruction for operating the application, and sends the control instruction to the first device;
  • the first device receives a control instruction for operating the application transmitted by the second device, acquires application data of the application in response to the control instruction, and returns the application data to the second device.
  • a device for displaying application data the device being loaded with a computer controller, an application, and an application controller corresponding to the application;
  • the computer controller starts the application or sends the control instruction to the application controller according to the control instruction
  • the application controller receives a control instruction sent by the computer controller, sends the control instruction to the application, acquires application data of the application in response to the control message, and sends the application data to The second device.
  • An application controller for displaying application data includes: a control instruction receiving module, an application data acquiring module, and an application data returning module;
  • the control instruction receiving module receives a control instruction for operating an application
  • the application data obtaining module acquires application data of the application program in response to the control instruction
  • the application data return module returns the application data to the second device.
  • the application controller further includes a first processing module, where the first processing module performs a first process on the application data acquired by the application data acquiring module; correspondingly, the application data returning module returns the first The first processed application data in the processing module is sent to the second device.
  • the application controller on the first device can directly obtain the location by using the dynamic link library according to the received control instruction for operating the application.
  • the application sends the acquired application data to the second device in response to the application data of the control instruction, and the second device may display the application data on the display screen.
  • the application controller on the first device can obtain the application data in the background of the computer. Therefore, the application data that needs to be displayed on the second device can be directly obtained without displaying on the first device, thereby improving the user experience. Further, the user can directly interact with the first device to improve the user experience.
  • 1 is a flow chart of one embodiment of a method for displaying application data of the present application
  • FIG. 2 is a flow chart of an embodiment of a method for displaying application data, which is mainly composed of a first device
  • FIG. 3 is a flow chart of an embodiment of a method for displaying application data, which is mainly applied by an application controller of a first device;
  • FIG. 4 is a structural diagram of a system for displaying application data of the present application.
  • FIG. 5 is a structural diagram of a first device of the present application for displaying application data
  • FIG. 6 is a block diagram of an application controller for displaying application data in the present application.
  • Embodiments of the present application provide a method, an application controller, a device, and a system for displaying application data.
  • the method for displaying application data may include:
  • the second device receives a selection message of the selection application input by the user, and sends the selection message to the first device associated with the second device.
  • the first device may be loaded with an application, a computer controller, and an application controller. Only one application can be loaded on the second device.
  • the application controller and the application may have a one-to-one correspondence.
  • the selection message may include an application identification of the selected application.
  • the application identification can be used to uniquely identify the application.
  • the first device establishes a communication connection with the second device, and in particular, the second device can establish a communication connection with a computer controller on the first device.
  • the connection between the second device and the computer controller on the first device may be established through any means such as wifi, Bluetooth, or TCP connection, which is not limited in this application.
  • the second device can transmit the selection message to a computer controller on the first device.
  • the computer controller on the first device receives the selection message sent by the second device, starts an application corresponding to the selection message, and the computer controller establishes a connection with the application controller of the application.
  • the computer controller may receive a selection message sent by the client, initiate and select the The application corresponding to the message.
  • the application corresponding to the selection message includes: an application corresponding to the application identifier in the selection message.
  • the initiating the application corresponding to the selection message may include: determining a selected application according to the selection message, starting the selected application, and establishing a dynamic link library for the launched application.
  • the dynamic link library can be used to provide application data for the application.
  • the computer controller can establish a communication connection with the application controller.
  • the second device receives the input of the user, generates a control instruction for controlling the application, and sends the control instruction to the first device.
  • the second device can receive input from the user, and based on the user's input, can generate a control command for controlling the application.
  • the second device can transmit the control command to the first device.
  • S104 The computer controller on the first device receives a control instruction sent by the second device, and the computer controller starts the application or sends the control command to the application controller according to the control instruction.
  • the computer controller on the first device can receive a control command from the first device.
  • the computer controller starts the application or sends the control instruction to the application controller according to the control instruction
  • control command is a launch application
  • the computer controller can launch the application, otherwise the computer controller can send the control command to the application controller.
  • the application controller on the first device receives a control command sent by the computer controller, sends the control command to the application, and acquires application data of the application program in response to the control instruction.
  • the application controller may receive a control command sent by the computer controller and may send the control command to the application.
  • the application data may be generated in response to the control instruction.
  • the application data may include: window data and/or audio data of the application.
  • the window data of the application may correspond to the display content of the application on the display screen.
  • the application controlled by the control instruction is a video application
  • the application data in response to the control instruction may display data and sound data for a window of the current video.
  • the control command is video fast forward
  • the application data responsive to the control command may display data and sound data for the window of the fast forward video.
  • the application controller may acquire application data of the application in response to the control instruction.
  • the application data of the application in response to the control instruction may be obtained by using the dynamic link library.
  • the method may include: acquiring window display data and/or audio data in the dynamic link library by intercepting a system call, and using the acquired window display data and/or audio data as application data.
  • the determining that the application data in response to the control instruction may be implemented in the background of the computer, ie may not be displayed on the display of the first device.
  • S106 The first device returns the application data to the second device.
  • the application controller of the first device may send the application data to the client.
  • the application controller may send the application data to the second device by using an RTP/RTCP protocol (Real-Time Transport Protocol/RTP Control Protocol) connection mode or a UDP (User Datagram Protocol) connection mode.
  • RTP/RTCP protocol Real-Time Transport Protocol/RTP Control Protocol
  • UDP User Datagram Protocol
  • the second device receives and displays the application data sent by the first device.
  • the second device may receive application data sent by the application controller of the first device.
  • the first device can display the application data on a display screen.
  • the application data is window display data and sound data of the fast forward video, and the first device can display the fast forward video content on the display screen.
  • the first device may further perform the first processing on the application data before sending the application data to the second device, and accordingly, the first device may send the path to the second device.
  • the first processed application data may include encoding compression of the application data.
  • the second device receives the first processed application data sent by the first device, and performs the first inverse processing on the received application data and displays the data.
  • the first processing is to perform coding compression on the application data
  • the first inverse processing may be to solve the received application data. Compression operation.
  • FIG. 2 is a flow chart of an embodiment of a method for displaying application data, which is mainly composed of a first device. As shown, the method can include:
  • the first device may be loaded with a first application, a computer controller, and a first application controller corresponding to the first application.
  • the first application can be run on the current first device.
  • a dynamic link library can be set for the first application.
  • the dynamic link library may provide application data of the first application.
  • S202 Receive a control instruction for operating the first application that is transmitted by the second device.
  • the first device and the second device can establish a communication connection.
  • the first device may receive a control instruction transmitted by the second device for controlling the first application.
  • S203 Acquire application data of the application in response to the control instruction.
  • the first device may acquire application data of the application in response to the control instruction.
  • the application data may include: window data and/or audio data of the application.
  • the window data of the application may correspond to the display content of the application on the display screen.
  • the application data responsive to the control instruction may be obtained by using the dynamic link library.
  • the method may include: acquiring window display data and/or audio data in the first application dynamic link library by intercepting a system call, and using the acquired window display data and/or audio data as Control application data for instructions.
  • the first device may return the application data to the second device.
  • the first process before the returning the application data to the second device, the first process may be performed on the acquired application data, and correspondingly, the first device may be sent to the second device.
  • the first process may include encoding compression of the application data.
  • FIG. 3 is a flow chart of an embodiment of a method for displaying application data based on an application controller of a first device. As shown, the method can include:
  • the first application controller receives a control instruction for operating the first application.
  • the first application controller and the first application can be loaded with the first device.
  • a computer controller can also be loaded on the first device.
  • the first application controller of the first device can receive a control instruction for operating the first application.
  • the control command may be sent by a computer controller of the first device.
  • a communication connection may be provided between the first application controller of the first device and the computer controller of the first device.
  • the first application controller acquires application data of the first application in response to the control instruction.
  • S303 The first application controller returns the application data to the second device.
  • the first application controller may further perform first processing on the application data before sending the application data to the second device, and correspondingly, the first application controller returns to the The first processed application data is described to the second device.
  • the application controller on the first device can directly use the dynamic link library according to the received control instruction for operating the application Acquiring the application data in response to the control instruction by the application, and sending the acquired application data to the second device, where the second device may display the application data on the display screen.
  • the application controller on the first device can obtain the application data in the background of the computer. Therefore, the application data that needs to be displayed on the second device can be directly obtained without displaying on the first device, thereby improving the user experience. Further, the user can directly interact with the first device to improve the user experience.
  • FIG. 4 is a structural diagram of a system for displaying application data of the present application. As shown, the system The first device 100 and the second device 200 may be included. The first device 100 and the first device 200 can establish a communication connection. among them,
  • the first device 100 may be loaded with a computer controller, an application, and an application controller corresponding to the application.
  • the second device 200 can receive the user's input, generate a control instruction for operating the application, and send the control command to the first device 100;
  • the first device 100 may receive a control instruction for operating the application transmitted by the second device, acquire application data of the application in response to the control instruction, and return the application to the second device 200. data.
  • FIG. 5 is a structural diagram of a first device of the present application for displaying application data.
  • the first device 100 can be loaded with a computer controller 110, an application 120, and an application controller 130 corresponding to the application. among them,
  • the computer controller 110 starts the application 120 or sends the control instruction to the application controller 130 according to the control instruction;
  • the application controller 130 receives the control command sent by the computer controller 110, sends the control command to the application 120, acquires application data of the application 120 in response to the control message, and sends the Applying application data to the second device.
  • the application controller may include a control instruction receiving module 131, an application data obtaining module 132, and an application data returning module 133. among them,
  • the control instruction receiving module 131 can receive a control instruction for operating an application.
  • the application data obtaining module 132 may acquire application data of the application in response to the control instruction.
  • the application data returning module 133 may return the application data to the second device.
  • the application controller further includes a first processing module, and the first processing module performs a first process on the application data acquired in the application data acquiring module.
  • the application data returning module returns the first processed application data in the first processing module to the second device.
  • the transmission device, the application controller, and the system for displaying the application data disclosed in the foregoing embodiments are related to the method embodiments of the present application, and the method embodiments of the present application can be implemented to achieve the technical effects of the method embodiments.
  • PLD Programmable Logic Device
  • FPGA Field Programmable Gate Array
  • HDL Hardware Description Language
  • the controller can be implemented in any suitable manner, for example, the controller can take the form of, for example, a microprocessor or processor and a computer readable medium storing computer readable program code (eg, software or firmware) executable by the (micro)processor.
  • computer readable program code eg, software or firmware
  • examples of controllers include, but are not limited to, the following microcontrollers: ARC 625D, Atmel AT91SAM, The Microchip PIC18F26K20 and the Silicone Labs C8051F320, the memory controller can also be implemented as part of the memory's control logic.
  • the controller can be logically programmed by means of logic gates, switches, ASICs, programmable logic controllers, and embedding.
  • Such a controller can therefore be considered a hardware component, and the means for implementing various functions included therein can also be considered as a structure within the hardware component.
  • a device for implementing various functions can be considered as a software module that can be both a method of implementation and a structure within a hardware component.
  • the system, device, module or unit illustrated in the above embodiments may be implemented by a computer chip or an entity, or by a product having a certain function.
  • the present application can be implemented by means of software plus a necessary general hardware platform. Based on such understanding, portions of the technical solution of the present application that contribute substantially or to the prior art may be embodied in the form of a software product.
  • the computing device includes one or more processors (CPU ), input / output interface, network interface and memory.
  • the computer software product can include instructions for causing a computer device (which can be a personal computer, server, or network device, etc.) to perform the present application. The method described in some embodiments or parts of the embodiments.
  • the computer software product can be stored in a memory, which may include non-persistent memory, random access memory (RAM), and/or nonvolatile memory in a computer readable medium, such as read only memory (ROM) or Flash memory.
  • RAM random access memory
  • ROM read only memory
  • Memory is an example of a computer readable medium.
  • Computer readable media includes both permanent and non-persistent, removable and non-removable media.
  • Information storage can be implemented by any method or technology.
  • the information can be computer readable instructions, data structures, modules of programs, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read only memory.
  • PRAM phase change memory
  • SRAM static random access memory
  • DRAM dynamic random access memory
  • RAM random access memory
  • ROM read only memory
  • EEPROM electrically erasable programmable read only memory
  • flash memory or other memory technology
  • compact disk read only memory CD-ROM
  • DVD digital versatile disk
  • Magnetic tape cartridges magnetic tape storage or other magnetic storage devices or any other non-transportable media can be used to store information that can be accessed by a computing device.
  • computer readable media does not include transitory computer readable media, such as modulated data signals and carrier waves.
  • This application can be used in a variety of general purpose or special purpose computer system environments or configurations.
  • the application can be described in the general context of computer-executable instructions executed by a computer, such as a program module.
  • program modules include routines, programs, objects, components, data structures, and the like that perform particular tasks or implement particular abstract data types.
  • the present application can also be practiced in distributed computing environments where tasks are performed by remote processing devices that are connected through a communication network.
  • program modules can be located locally, including storage devices. And remote computer storage media.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Stored Programmes (AREA)

Abstract

A method of displaying application data, and an application controller, device and system. The method comprises: receiving, by a first application controller, a control instruction used to operate a first application program (S301); acquiring, by the first application controller, application data of the first application program in response to the control instruction (S302); returning, by the first application controller, the application data to a second device (S303). The method for displaying application data, application controller, device and system can improve user experience.

Description

用于显示应用数据的方法、应用控制器、设备及***Method, application controller, device and system for displaying application data 技术领域Technical field
本申请涉及信息传输技术领域，特别涉及一种用于显示应用数据的方法、应用控制器、设备及***。The present application relates to the field of information transmission technologies, and in particular, to a method, an application controller, a device, and a system for displaying application data.
背景技术Background technique
随着计算机和宽带的普及，很多家庭都装了宽带买了计算机，可以通过计算机看视频、玩游戏，但是由于计算机屏幕尺寸较小，为了提高用户的视觉体验效果，需要将计算机上显示的应用数据投影到电视或者更大的屏幕进行显示。With the popularity of computers and broadband, many families have installed broadband to buy computers, can watch videos and play games through computers, but because of the small size of computer screens, in order to improve the user's visual experience, the applications displayed on the computer need to be displayed. The data is projected onto a TV or a larger screen for display.
现有的在电视等显示屏幕上显示计算机上应用数据的方法通常为投影法。所述投影法通常具体包括：通过端口连接，将计算机屏幕上所显示的应用数据直接投射至显示屏幕，例如利用投影仪投影等。A conventional method of displaying application data on a computer on a display screen such as a television is usually a projection method. The projection method generally includes: projecting the application data displayed on the computer screen directly to the display screen through a port connection, for example, using a projector to project or the like.
在实现本申请过程中，发明人发现现有技术中至少存在如下问题：利用现有的投影法显示计算机应用数据时，得到的显示效果是直接将计算机的整个显示屏幕投射到电视等大屏幕显示设备上，为了使所述显示屏幕上显示用户需要的数据，所述计算机的电脑屏幕上也必须显示相同的数据。因此，现有的投影法显示方法用户体验较差。In the process of implementing the present application, the inventors have found that at least the following problems exist in the prior art: when displaying computer application data by using an existing projection method, the display effect obtained is directly projecting the entire display screen of the computer to a large screen display such as a television. On the device, in order to display the data required by the user on the display screen, the same data must also be displayed on the computer screen of the computer. Therefore, the existing projection method display method has a poor user experience.
发明内容Summary of the invention
本申请实施例的目的是提供一种用于显示应用数据的方法、应用控制器、设备及***，以提高用户体验。An object of an embodiment of the present application is to provide a method, an application controller, a device, and a system for displaying application data to improve user experience.
为解决上述技术问题，本申请实施例提供一种用于显示应用数据的方法、应用控制器、设备及***是这样实现的：To solve the above technical problem, the embodiment of the present application provides a method, an application controller, a device, and a system for displaying application data, which are implemented as follows:
一种用于显示应用数据的方法，包括：第一应用控制器接收用于操作第一应用程序的控制指令；第一应用控制器获取所述第一应用程序响应于所述控制指令的应用数据；第一应用控制器返回所述应用数据至第二设备。 A method for displaying application data, comprising: a first application controller receiving a control instruction for operating a first application; and a first application controller acquiring application data of the first application in response to the control instruction The first application controller returns the application data to the second device.
优选方案中，所述向所述第二设备返回所述应用数据之前，还包括：对所述应用数据进行第一处理；相应地，向所述第二设备返回经过第一处理的应用数据。In a preferred solution, before the returning the application data to the second device, the method further includes: performing first processing on the application data; and correspondingly, returning, to the second device, application data that has undergone the first processing.
一种用于显示应用数据的方法，包括：在当前第一设备中运行第一应用程序；接收第二设备传输的用于操作所述第一应用程序的控制指令；获取所述应用程序响应于所述控制指令的应用数据；向所述第二设备返回所述应用数据。A method for displaying application data, comprising: running a first application in a current first device; receiving a control instruction transmitted by the second device for operating the first application; acquiring the application in response to The application data of the control instruction; returning the application data to the second device.
一种用于显示应用数据的***，包括：第一设备和第二设备，所述第一设备与所述第一设备建立通讯连接；其中，A system for displaying application data, comprising: a first device and a second device, wherein the first device establishes a communication connection with the first device;
第二设备接收用户的输入，生成用于操作所述应用程序的控制指令，并将所述控制指令发送至第一设备；The second device receives the input of the user, generates a control instruction for operating the application, and sends the control instruction to the first device;
所述第一设备接收第二设备传输的用于操作所述应用程序的控制指令，获取所述应用程序响应于所述控制指令的应用数据；向所述第二设备返回所述应用数据。The first device receives a control instruction for operating the application transmitted by the second device, acquires application data of the application in response to the control instruction, and returns the application data to the second device.
一种用于显示应用数据的设备，所述设备装载有计算机控制器、应用程序，以及与所述应用程序对应的应用控制器；其中，A device for displaying application data, the device being loaded with a computer controller, an application, and an application controller corresponding to the application; wherein
所述计算机控制器根据所述控制指令启动所述应用程序或发送所述控制指令至所述应用控制器；The computer controller starts the application or sends the control instruction to the application controller according to the control instruction;
所述应用控制器接收所述计算机控制器发来的控制指令，发送所述控制指令至所述应用程序，获取所述应用程序响应于所述控制消息的应用数据，并发送所述应用数据至所述第二设备。The application controller receives a control instruction sent by the computer controller, sends the control instruction to the application, acquires application data of the application in response to the control message, and sends the application data to The second device.
一种用于显示应用数据的应用控制器，所述应用控制器包括：控制指令接收模块、应用数据获取模块和应用数据返回模块；其中，An application controller for displaying application data, the application controller includes: a control instruction receiving module, an application data acquiring module, and an application data returning module; wherein
所述控制指令接收模块接收用于操作应用程序的控制指令；The control instruction receiving module receives a control instruction for operating an application;
所述应用数据获取模块获取所述应用程序响应于所述控制指令的应用数据；The application data obtaining module acquires application data of the application program in response to the control instruction;
所述应用数据返回模块返回所述应用数据至第二设备。 The application data return module returns the application data to the second device.
优选方案中，所述应用控制器还包括第一处理模块，第一处理模块对所述应用数据获取模块中获取的应用数据进行第一处理；相应地，所述应用数据返回模块返回所述第一处理模块中经过第一处理的应用数据至第二设备。In a preferred solution, the application controller further includes a first processing module, where the first processing module performs a first process on the application data acquired by the application data acquiring module; correspondingly, the application data returning module returns the first The first processed application data in the processing module is sent to the second device.
由以上本申请实施例提供的技术方案可见在第一设备上运行应用程序后，第一设备上的应用控制器可以根据接收到的用于操作应用程序的控制指令，利用动态链接库直接获取所述应用程序响应于所述控制指令的应用数据，将获取的应用数据发送给第二设备，第二设备可以将所述应用数据显示显示屏幕上。所述第一设备上的应用控制器获取应用数据可以在计算机后台实现，因此需要在第二设备上显示的应用数据可以直接获取而不需要在第一设备上进行显示，提高了用户体验。进一步地，用户可以直接与第一设备进行人机交互，提高了用户体验。The technical solution provided by the embodiment of the present application can be seen that after the application is run on the first device, the application controller on the first device can directly obtain the location by using the dynamic link library according to the received control instruction for operating the application. The application sends the acquired application data to the second device in response to the application data of the control instruction, and the second device may display the application data on the display screen. The application controller on the first device can obtain the application data in the background of the computer. Therefore, the application data that needs to be displayed on the second device can be directly obtained without displaying on the first device, thereby improving the user experience. Further, the user can directly interact with the first device to improve the user experience.
附图说明DRAWINGS
为了更清楚地说明本申请实施例或现有技术中的技术方案，下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍，显而易见地，下面描述中的附图仅仅是本申请中记载的一些实施例，对于本领域普通技术人员来讲，在不付出创造性劳动性的前提下，还可以根据这些附图获得其他的附图。In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings to be used in the embodiments or the prior art description will be briefly described below. Obviously, the drawings in the following description are only It is a few embodiments described in the present application, and other drawings can be obtained from those skilled in the art without any inventive labor.
图1是本申请用于显示应用数据的方法一个实施例的流程图；1 is a flow chart of one embodiment of a method for displaying application data of the present application;
图2是本申请以第一设备为主体的用于显示应用数据的方法一个实施例的流程图；2 is a flow chart of an embodiment of a method for displaying application data, which is mainly composed of a first device;
图3是本申请以第一设备的应用控制器为主体的用于显示应用数据的方法一个实施例的流程图；3 is a flow chart of an embodiment of a method for displaying application data, which is mainly applied by an application controller of a first device;
图4是本申请用于显示应用数据的***的组成结构图；4 is a structural diagram of a system for displaying application data of the present application;
图5是本申请用于显示应用数据的第一设备的组成结构图；5 is a structural diagram of a first device of the present application for displaying application data;
图6是本申请用于显示应用数据的应用控制器的模块图。 6 is a block diagram of an application controller for displaying application data in the present application.
具体实施方式detailed description
本申请实施例提供一种用于显示应用数据的方法、应用控制器、设备及***。Embodiments of the present application provide a method, an application controller, a device, and a system for displaying application data.
为了使本技术领域的人员更好地理解本申请中的技术方案，下面将结合本申请实施例中的附图，对本申请实施例中的技术方案进行清楚、完整地描述，显然，所描述的实施例仅仅是本申请一部分实施例，而不是全部的实施例。基于本申请中的实施例，本领域普通技术人员在没有作出创造性劳动前提下所获得的所有其他实施例，都应当属于本申请保护的范围。The technical solutions in the embodiments of the present application are clearly and completely described in the following, in which the technical solutions in the embodiments of the present application are clearly and completely described. The embodiments are only a part of the embodiments of the present application, and not all of them. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments of the present application without departing from the inventive scope shall fall within the scope of the application.
图1是本申请用于显示应用数据的方法一个实施例的流程图。如图1所示，所述用于显示应用数据的方法可以包括：1 is a flow diagram of one embodiment of a method for displaying application data in the present application. As shown in FIG. 1, the method for displaying application data may include:
S101：第二设备接收用户输入的选择应用程序的选择消息，发送所述选择消息至与第二设备相关联的第一设备。S101: The second device receives a selection message of the selection application input by the user, and sends the selection message to the first device associated with the second device.
所述第一设备上可以装载有应用程序、计算机控制器和应用控制器。所述第二设备上可以装载有只是一个应用程序。所述应用控制器与所述应用程序可以一一对应。The first device may be loaded with an application, a computer controller, and an application controller. Only one application can be loaded on the second device. The application controller and the application may have a one-to-one correspondence.
所述选择消息可以包括选择的应用程序的应用标识。所述应用程序标识可以用于唯一标识所述应用程序。The selection message may include an application identification of the selected application. The application identification can be used to uniquely identify the application.
所述第一设备与第二设备建立通信连接，具体地所述第二设备可以与第一设备上的计算机控制器建立通信连接。所述第二设备与第一设备上的计算机控制器之间可以通过wifi、蓝牙或TCP连接等任意方式建立连接，本申请对此并不作出限定。The first device establishes a communication connection with the second device, and in particular, the second device can establish a communication connection with a computer controller on the first device. The connection between the second device and the computer controller on the first device may be established through any means such as wifi, Bluetooth, or TCP connection, which is not limited in this application.
所述第二设备可以发送所述选择消息至所述第一设备上的计算机控制器。The second device can transmit the selection message to a computer controller on the first device.
S102：第一设备上的计算机控制器接收第二设备发来的选择消息，启动与所述选择消息对应的应用程序，所述计算机控制器与所述应用程序的应用控制器建立连接。S102: The computer controller on the first device receives the selection message sent by the second device, starts an application corresponding to the selection message, and the computer controller establishes a connection with the application controller of the application.
所述计算机控制器可以接收所述客户端发来的选择消息，启动与所述选择 消息对应的应用程序。所述与选择消息对应的应用程序包括：与所述选择消息中的应用标识对应的应用程序。The computer controller may receive a selection message sent by the client, initiate and select the The application corresponding to the message. The application corresponding to the selection message includes: an application corresponding to the application identifier in the selection message.
所述启动与所述选择消息对应的应用，具体可以包括：根据所述选择消息确定选择的应用程序，启动所述选择的应用程序，为所述启动的应用程序建立动态链接库。所述动态链接库可以用于提供所述应用程序的应用数据。The initiating the application corresponding to the selection message may include: determining a selected application according to the selection message, starting the selected application, and establishing a dynamic link library for the launched application. The dynamic link library can be used to provide application data for the application.
所述计算机控制器可以与所述应用控制器之间建立通信连接。The computer controller can establish a communication connection with the application controller.
S103：第二设备接收用户的输入，生成用于控制所述应用程序的控制指令，并将所述控制指令发送至第一设备。S103: The second device receives the input of the user, generates a control instruction for controlling the application, and sends the control instruction to the first device.
第二设备可以接收用户的输入，根据用户的输入，可以生成用于控制所述应用程序的控制指令。第二设备可以将所述控制指令发送至第一设备。The second device can receive input from the user, and based on the user's input, can generate a control command for controlling the application. The second device can transmit the control command to the first device.
S104：第一设备上的计算机控制器接收第二设备发来的控制指令，所述计算机控制器根据所述控制指令启动所述应用程序或发送所述控制指令至所述应用控制器。S104: The computer controller on the first device receives a control instruction sent by the second device, and the computer controller starts the application or sends the control command to the application controller according to the control instruction.
第一设备上的计算机控制器可以接收第一设备发来的控制指令。所述计算机控制器根据所述控制指令启动所述应用程序或发送所述控制指令至所述应用控制器The computer controller on the first device can receive a control command from the first device. The computer controller starts the application or sends the control instruction to the application controller according to the control instruction
若所述控制指令为启动应用程序，则所述计算机控制器可以启动所述应用程序，否则，所述计算机控制器可以将所述控制指令发送至所述应用控制器。If the control command is a launch application, the computer controller can launch the application, otherwise the computer controller can send the control command to the application controller.
S105：所述第一设备上的应用控制器接收计算机控制器发来的控制指令，发送所述控制指令至所述应用程序，获取所述应用程序响应于所述控制指令的应用数据。S105: The application controller on the first device receives a control command sent by the computer controller, sends the control command to the application, and acquires application data of the application program in response to the control instruction.
所述应用控制器可以接收所述计算机控制器发来的控制指令，并可以发送所述控制指令至所述应用程序。The application controller may receive a control command sent by the computer controller and may send the control command to the application.
所述应用程序接收到控制指令后，可以响应于所述控制指令产生应用数据。After the application receives the control instruction, the application data may be generated in response to the control instruction.
所述应用数据可以包括：应用程序的窗口数据和/或音频数据。所述应用程序的窗口数据可以对应所述应用程序在显示屏幕上的显示内容。 The application data may include: window data and/or audio data of the application. The window data of the application may correspond to the display content of the application on the display screen.
例如，控制指令控制的应用程序为视频类应用程序，所述控制指令为播放视频时，所述响应于控制指令的应用数据可以为当前视频的窗口显示数据和声音数据。若所述控制指令为视频快进，所述响应于控制指令的应用数据可以为快进后视频的窗口显示数据和声音数据。For example, the application controlled by the control instruction is a video application, and when the control instruction is playing a video, the application data in response to the control instruction may display data and sound data for a window of the current video. If the control command is video fast forward, the application data responsive to the control command may display data and sound data for the window of the fast forward video.
所述应用控制器可以获取所述应用程序响应于所述控制指令的应用数据。The application controller may acquire application data of the application in response to the control instruction.
所述应用程序响应于所述控制指令的应用数据可以利用所述动态链接库获取得到。具体可以包括：通过截获***调用的方式获取所述动态链接库中的窗口显示数据和/或音频数据，将所述获取到的窗口显示数据和/或音频数据作为应用数据。The application data of the application in response to the control instruction may be obtained by using the dynamic link library. Specifically, the method may include: acquiring window display data and/or audio data in the dynamic link library by intercepting a system call, and using the acquired window display data and/or audio data as application data.
所述确定响应于所述控制指令的应用数据可以在计算机后台实现，即可以不显示在第一设备的显示器上。The determining that the application data in response to the control instruction may be implemented in the background of the computer, ie may not be displayed on the display of the first device.
S106：第一设备向所述第二设备返回所述应用数据。S106: The first device returns the application data to the second device.
第一设备的应用控制器可以向所述客户端发送所述应用数据。所述应用控制器可以通过RTP/RTCP协议(实时传输协议/RTP控制协议)连接方式或者UDP(User Datagram Protocol，用户数据报协议)连接方式向第二设备发送应用数据。The application controller of the first device may send the application data to the client. The application controller may send the application data to the second device by using an RTP/RTCP protocol (Real-Time Transport Protocol/RTP Control Protocol) connection mode or a UDP (User Datagram Protocol) connection mode.
S107：第二设备接收并显示第一设备发来的应用数据。S107: The second device receives and displays the application data sent by the first device.
第二设备可以接收第一设备的应用控制器发来的应用数据。第一设备可以将所述应用数据显示在显示屏幕上。例如，所述应用数据为快进后视频的窗口显示数据和声音数据，第一设备可以在显示屏幕上显示快进后的视频内容。The second device may receive application data sent by the application controller of the first device. The first device can display the application data on a display screen. For example, the application data is window display data and sound data of the fast forward video, and the first device can display the fast forward video content on the display screen.
在另一个实施例中，所述第一设备在发送所述应用数据至第二设备之前，还可以对所述应用数据进行第一处理，相应地第一设备可以向所述第二设备发送经过第一处理的应用数据。所述第一处理可以包括对所述应用数据进行编码压缩。In another embodiment, the first device may further perform the first processing on the application data before sending the application data to the second device, and accordingly, the first device may send the path to the second device. The first processed application data. The first processing may include encoding compression of the application data.
相应地，所述第二设备接收到第一设备发来的经过第一处理的应用数据可以对所述接收到的应用数据进行第一逆处理并显示。当所述第一处理为对所述应用数据进行编码压缩时，所述第一逆处理可以为对接收到的应用数据进行解 压缩操作。Correspondingly, the second device receives the first processed application data sent by the first device, and performs the first inverse processing on the received application data and displays the data. When the first processing is to perform coding compression on the application data, the first inverse processing may be to solve the received application data. Compression operation.
图2是本申请以第一设备为主体的用于显示应用数据的方法一个实施例的流程图。如图所示，所述方法可以包括：2 is a flow chart of an embodiment of a method for displaying application data, which is mainly composed of a first device. As shown, the method can include:
S201：在第一设备上运行第一应用程序。S201: Run the first application on the first device.
所述第一设备上可以装载有第一应用程序、计算机控制器，以及与第一应用程序对应的第一应用控制器。在当前第一设备上可以运行第一应用程序。运行所述第一应用程序时，可以为所述第一应用程序设置动态链接库。所述动态链接库可以提供所述第一应用程序的应用数据。The first device may be loaded with a first application, a computer controller, and a first application controller corresponding to the first application. The first application can be run on the current first device. When the first application is run, a dynamic link library can be set for the first application. The dynamic link library may provide application data of the first application.
S202：接收第二设备传输的用于操作所述第一应用程序的控制指令。S202: Receive a control instruction for operating the first application that is transmitted by the second device.
第一设备与第二设备可以建立通信连接。第一设备可以接收第二设备传输的用于控制所述第一应用程序的控制指令。The first device and the second device can establish a communication connection. The first device may receive a control instruction transmitted by the second device for controlling the first application.
S203：获取所述应用程序响应于所述控制指令的应用数据。S203: Acquire application data of the application in response to the control instruction.
第一设备可以获取所述应用程序响应于所述控制指令的应用数据。所述应用数据可以包括：应用程序的窗口数据和/或音频数据。所述应用程序的窗口数据可以对应所述应用程序在显示屏幕上的显示内容。The first device may acquire application data of the application in response to the control instruction. The application data may include: window data and/or audio data of the application. The window data of the application may correspond to the display content of the application on the display screen.
所述响应于所述控制指令的应用数据可以利用所述动态链接库获取得到。具体可以包括：通过截获***调用的方式获取所述第一应用程序动态链接库中的窗口显示数据和/或音频数据，将所述获取到的窗口显示数据和/或音频数据作为响应于所述控制指令的应用数据。The application data responsive to the control instruction may be obtained by using the dynamic link library. Specifically, the method may include: acquiring window display data and/or audio data in the first application dynamic link library by intercepting a system call, and using the acquired window display data and/or audio data as Control application data for instructions.
S204：向所述第二设备返回所述应用数据。S204: Return the application data to the second device.
第一设备可以向所述第二设备返回所述应用数据。The first device may return the application data to the second device.
在另一个实施例中，在向所述第二设备返回所述应用数据之前，还可以对上述获取的应用数据进行第一处理，相应地，可以向所述第二设备发送经过第一处理的应用数据。所述第一处理可以包括：对所述应用数据进行编码压缩。 In another embodiment, before the returning the application data to the second device, the first process may be performed on the acquired application data, and correspondingly, the first device may be sent to the second device. Application data. The first process may include encoding compression of the application data.
图3是本申请以第一设备的应用控制器为主体的用于显示应用数据的方法一个实施例的流程图。如图所示，所述方法可以包括：FIG. 3 is a flow chart of an embodiment of a method for displaying application data based on an application controller of a first device. As shown, the method can include:
S301：第一应用控制器接收用于操作第一应用程序的控制指令。S301: The first application controller receives a control instruction for operating the first application.
第一应用控制器与第一应用程序可以装载与第一设备。所述第一设备上还可以装载有计算机控制器。The first application controller and the first application can be loaded with the first device. A computer controller can also be loaded on the first device.
第一设备的第一应用控制器可以接收用于操作第一应用程序的控制指令。所述控制指令可以是第一设备的计算机控制器发来的。所述第一设备的第一应用控制器与第一设备的计算机控制器之间可以设置有通信连接。The first application controller of the first device can receive a control instruction for operating the first application. The control command may be sent by a computer controller of the first device. A communication connection may be provided between the first application controller of the first device and the computer controller of the first device.
S302：第一应用控制器获取所述第一应用程序响应于所述控制指令的应用数据。S302: The first application controller acquires application data of the first application in response to the control instruction.
S303：第一应用控制器返回所述应用数据至第二设备。S303: The first application controller returns the application data to the second device.
在另一个实施例中，所述第一应用控制器在发送所述应用数据至第二设备之前，还可以对所述应用数据进行第一处理，相应地，所述第一应用控制器返回所述经过第一处理的应用数据至第二设备。In another embodiment, the first application controller may further perform first processing on the application data before sending the application data to the second device, and correspondingly, the first application controller returns to the The first processed application data is described to the second device.
上述各个实施例之间相同相似的部分互相参见即可。The same similar parts between the above various embodiments can be referred to each other.
上述实施例公开的用于显示应用数据的方法，在第一设备上运行应用程序后，第一设备上的应用控制器可以根据接收到的用于操作应用程序的控制指令，利用动态链接库直接获取所述应用程序响应于所述控制指令的应用数据，将获取的应用数据发送给第二设备，第二设备可以将所述应用数据显示显示屏幕上。所述第一设备上的应用控制器获取应用数据可以在计算机后台实现，因此需要在第二设备上显示的应用数据可以直接获取而不需要在第一设备上进行显示，提高了用户体验。进一步地，用户可以直接与第一设备进行人机交互，提高了用户体验。The method for displaying application data disclosed in the foregoing embodiment, after running the application on the first device, the application controller on the first device can directly use the dynamic link library according to the received control instruction for operating the application Acquiring the application data in response to the control instruction by the application, and sending the acquired application data to the second device, where the second device may display the application data on the display screen. The application controller on the first device can obtain the application data in the background of the computer. Therefore, the application data that needs to be displayed on the second device can be directly obtained without displaying on the first device, thereby improving the user experience. Further, the user can directly interact with the first device to improve the user experience.
图4是本申请用于显示应用数据的***的组成结构图。如图所示，所述*** 可以包括：第一设备100和第二设备200。所述第一设备100与所述第一设备200可以建立通讯连接。其中，4 is a structural diagram of a system for displaying application data of the present application. As shown, the system The first device 100 and the second device 200 may be included. The first device 100 and the first device 200 can establish a communication connection. among them,
第一设备100上可以装载有计算机控制器、应用程序，以及与所述应用程序对应的应用控制器。The first device 100 may be loaded with a computer controller, an application, and an application controller corresponding to the application.
第二设备200可以接收用户的输入，生成用于操作所述应用程序的控制指令，并将所述控制指令发送至第一设备100；The second device 200 can receive the user's input, generate a control instruction for operating the application, and send the control command to the first device 100;
所述第一设备100可以接收第二设备传输的用于操作所述应用程序的控制指令，获取所述应用程序响应于所述控制指令的应用数据；向所述第二设备200返回所述应用数据。The first device 100 may receive a control instruction for operating the application transmitted by the second device, acquire application data of the application in response to the control instruction, and return the application to the second device 200. data.
图5是本申请用于显示应用数据的第一设备的组成结构图。如图所示，所述第一设备100可以装载有计算机控制器110、应用程序120，以及与所述应用程序对应的应用控制器130。其中，FIG. 5 is a structural diagram of a first device of the present application for displaying application data. As shown, the first device 100 can be loaded with a computer controller 110, an application 120, and an application controller 130 corresponding to the application. among them,
所述计算机控制器110根据所述控制指令启动所述应用程序120或发送所述控制指令至所述应用控制器130；The computer controller 110 starts the application 120 or sends the control instruction to the application controller 130 according to the control instruction;
所述应用控制器130接收所述计算机控制器110发来的控制指令，发送所述控制指令至所述应用程序120，获取所述应用程序120响应于所述控制消息的应用数据，并发送所述应用数据至所述第二设备。The application controller 130 receives the control command sent by the computer controller 110, sends the control command to the application 120, acquires application data of the application 120 in response to the control message, and sends the Applying application data to the second device.
图6是本申请用于显示应用数据的应用控制器的模块图。如图所示，所述应用控制器可以包括：控制指令接收模块131、应用数据获取模块132和应用数据返回模块133。其中，6 is a block diagram of an application controller for displaying application data in the present application. As shown, the application controller may include a control instruction receiving module 131, an application data obtaining module 132, and an application data returning module 133. among them,
所述控制指令接收模块131可以接收用于操作应用程序的控制指令。The control instruction receiving module 131 can receive a control instruction for operating an application.
所述应用数据获取模块132可以获取所述应用程序响应于所述控制指令的应用数据。The application data obtaining module 132 may acquire application data of the application in response to the control instruction.
所述应用数据返回模块133可以返回所述应用数据至第二设备。 The application data returning module 133 may return the application data to the second device.
在另一个实施例中，所述应用控制器还包括第一处理模块，第一处理模块对所述应用数据获取模块中获取的应用数据进行第一处理。相应地，所述应用数据返回模块返回所述第一处理模块中经过第一处理的应用数据至第二设备。In another embodiment, the application controller further includes a first processing module, and the first processing module performs a first process on the application data acquired in the application data acquiring module. Correspondingly, the application data returning module returns the first processed application data in the first processing module to the second device.
上述实施例公开的用于显示应用数据的传输装置、应用控制器和***与本申请的方法实施例相对应，可以实现本申请方法实施例，达到方法实施例的技术效果。The transmission device, the application controller, and the system for displaying the application data disclosed in the foregoing embodiments are related to the method embodiments of the present application, and the method embodiments of the present application can be implemented to achieve the technical effects of the method embodiments.
在20世纪90年代，对于一个技术的改进可以很明显地区分是硬件上的改进(例如，对二极管、晶体管、开关等电路结构的改进)还是软件上的改进(对于方法流程的改进)。然而，随着技术的发展，当今的很多方法流程的改进已经可以视为硬件电路结构的直接改进。设计人员几乎都通过将改进的方法流程编程到硬件电路中来得到相应的硬件电路结构。因此，不能说一个方法流程的改进就不能用硬件实体模块来实现。例如，可编程逻辑器件(Programmable Logic Device,PLD)(例如现场可编程门阵列(Field Programmable Gate Array，FPGA))就是这样一种集成电路，其逻辑功能由用户对器件编程来确定。由设计人员自行编程来把一个数字***“集成”在一片PLD上，而不需要请芯片制造厂商来设计和制作专用的集成电路芯片2。而且，如今，取代手工地制作集成电路芯片，这种编程也多半改用“逻辑编译器(logic compiler)”软件来实现，它与程序开发撰写时所用的软件编译器相类似，而要编译之前的原始代码也得用特定的编程语言来撰写，此称之为硬件描述语言(Hardware Description Language，HDL)，而HDL也并非仅有一种，而是有许多种，如ABEL(Advanced Boolean Expression Language)、AHDL(Altera Hardware Description Language)、Confluence、CUPL(Cornell University Programming Language)、HDCal、JHDL(Java Hardware Description Language)、Lava、Lola、MyHDL、PALASM、RHDL(Ruby Hardware Description Language)等，目前最普遍使用的是VHDL(Very-High-Speed  Integrated Circuit Hardware Description Language)与Verilog2。本领域技术人员也应该清楚，只需要将方法流程用上述几种硬件描述语言稍作逻辑编程并编程到集成电路中，就可以很容易得到实现该逻辑方法流程的硬件电路。In the 1990s, improvements to a technology could clearly distinguish between hardware improvements (eg, improvements to circuit structures such as diodes, transistors, switches, etc.) or software improvements (for process flow improvements). However, as technology advances, many of today's method flow improvements can be seen as direct improvements in hardware circuit architecture. Designers almost always get the corresponding hardware circuit structure by programming the improved method flow into the hardware circuit. Therefore, it cannot be said that the improvement of a method flow cannot be implemented by hardware entity modules. For example, a Programmable Logic Device (PLD) (such as a Field Programmable Gate Array (FPGA)) is an integrated circuit whose logic function is determined by the user programming the device. The designer is self-programming to "integrate" a digital system onto a single PLD without requiring the chip manufacturer to design and fabricate a dedicated integrated circuit chip 2 . Moreover, today, instead of manually making integrated circuit chips, this programming is mostly implemented using "logic compiler" software, which is similar to the software compiler used in programming development, but before compiling The original code has to be written in a specific programming language. This is called the Hardware Description Language (HDL). HDL is not the only one, but there are many kinds, such as ABEL (Advanced Boolean Expression Language). AHDL (Altera Hardware Description Language), Confluence, CUPL (Cornell University Programming Language), HDCal, JHDL (Java Hardware Description Language), Lava, Lola, MyHDL, PALASM, RHDL (Ruby Hardware Description Language), etc., are currently the most commonly used Is VHDL (Very-High-Speed Integrated Circuit Hardware Description Language) and Verilog2. It should also be apparent to those skilled in the art that the hardware flow for implementing the logic method flow can be easily obtained by simply programming the method flow into the integrated circuit with a few hardware description languages.
控制器可以按任何适当的方式实现，例如，控制器可以采取例如微处理器或处理器以及存储可由该(微)处理器执行的计算机可读程序代码(例如软件或固件)的计算机可读介质、逻辑门、开关、专用集成电路(Application Specific Integrated Circuit，ASIC)、可编程逻辑控制器和嵌入微控制器的形式，控制器的例子包括但不限于以下微控制器：ARC 625D、Atmel AT91SAM、Microchip PIC18F26K20 以及Silicone Labs C8051F320，存储器控制器还可以被实现为存储器的控制逻辑的一部分。The controller can be implemented in any suitable manner, for example, the controller can take the form of, for example, a microprocessor or processor and a computer readable medium storing computer readable program code (eg, software or firmware) executable by the (micro)processor. In the form of logic gates, switches, application specific integrated circuits (ASICs), programmable logic controllers, and embedded microcontrollers, examples of controllers include, but are not limited to, the following microcontrollers: ARC 625D, Atmel AT91SAM, The Microchip PIC18F26K20 and the Silicone Labs C8051F320, the memory controller can also be implemented as part of the memory's control logic.
本领域技术人员也知道，除了以纯计算机可读程序代码方式实现控制器以外，完全可以通过将方法步骤进行逻辑编程来使得控制器以逻辑门、开关、专用集成电路、可编程逻辑控制器和嵌入微控制器等的形式来实现相同功能。因此这种控制器可以被认为是一种硬件部件，而对其内包括的用于实现各种功能的装置也可以视为硬件部件内的结构。或者甚至，可以将用于实现各种功能的装置视为既可以是实现方法的软件模块又可以是硬件部件内的结构。Those skilled in the art will also appreciate that in addition to implementing the controller in purely computer readable program code, the controller can be logically programmed by means of logic gates, switches, ASICs, programmable logic controllers, and embedding. The form of a microcontroller or the like to achieve the same function. Such a controller can therefore be considered a hardware component, and the means for implementing various functions included therein can also be considered as a structure within the hardware component. Or even a device for implementing various functions can be considered as a software module that can be both a method of implementation and a structure within a hardware component.
上述实施例阐明的***、装置、模块或单元，具体可以由计算机芯片或实体实现，或者由具有某种功能的产品来实现。The system, device, module or unit illustrated in the above embodiments may be implemented by a computer chip or an entity, or by a product having a certain function.
为了描述的方便，描述以上装置时以功能分为各种单元分别描述。当然，在实施本申请时可以把各单元的功能在同一个或多个软件和/或硬件中实现。For the convenience of description, the above devices are described separately by function into various units. Of course, the functions of each unit may be implemented in the same software or software and/or hardware when implementing the present application.
通过以上的实施方式的描述可知，本领域的技术人员可以清楚地了解到本申请可借助软件加必需的通用硬件平台的方式来实现。基于这样的理解，本申请的技术方案本质上或者说对现有技术做出贡献的部分可以以软件产品的形式体现出来，在一个典型的配置中，计算设备包括一个或多个处理器(CPU)、输入/输出接口、网络接口和内存。该计算机软件产品可以包括若干指令用以使得一台计算机设备(可以是个人计算机，服务器，或者网络设备等)执行本申请各 个实施例或者实施例的某些部分所述的方法。该计算机软件产品可以存储在内存中，内存可能包括计算机可读介质中的非永久性存储器，随机存取存储器(RAM)和/或非易失性内存等形式，如只读存储器(ROM)或闪存(flash RAM)。内存是计算机可读介质的示例。计算机可读介质包括永久性和非永久性、可移动和非可移动媒体可以由任何方法或技术来实现信息存储。信息可以是计算机可读指令、数据结构、程序的模块或其他数据。计算机的存储介质的例子包括，但不限于相变内存(PRAM)、静态随机存取存储器(SRAM)、动态随机存取存储器(DRAM)、其他类型的随机存取存储器(RAM)、只读存储器(ROM)、电可擦除可编程只读存储器(EEPROM)、快闪记忆体或其他内存技术、只读光盘只读存储器(CD-ROM)、数字多功能光盘(DVD)或其他光学存储、磁盒式磁带，磁带磁磁盘存储或其他磁性存储设备或任何其他非传输介质，可用于存储可以被计算设备访问的信息。按照本文中的界定，计算机可读介质不包括短暂电脑可读媒体(transitory media)，如调制的数据信号和载波。It will be apparent to those skilled in the art from the above description of the embodiments that the present application can be implemented by means of software plus a necessary general hardware platform. Based on such understanding, portions of the technical solution of the present application that contribute substantially or to the prior art may be embodied in the form of a software product. In a typical configuration, the computing device includes one or more processors (CPU ), input / output interface, network interface and memory. The computer software product can include instructions for causing a computer device (which can be a personal computer, server, or network device, etc.) to perform the present application. The method described in some embodiments or parts of the embodiments. The computer software product can be stored in a memory, which may include non-persistent memory, random access memory (RAM), and/or nonvolatile memory in a computer readable medium, such as read only memory (ROM) or Flash memory. Memory is an example of a computer readable medium. Computer readable media includes both permanent and non-persistent, removable and non-removable media. Information storage can be implemented by any method or technology. The information can be computer readable instructions, data structures, modules of programs, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read only memory. (ROM), electrically erasable programmable read only memory (EEPROM), flash memory or other memory technology, compact disk read only memory (CD-ROM), digital versatile disk (DVD) or other optical storage, Magnetic tape cartridges, magnetic tape storage or other magnetic storage devices or any other non-transportable media can be used to store information that can be accessed by a computing device. As defined herein, computer readable media does not include transitory computer readable media, such as modulated data signals and carrier waves.
本说明书中的各个实施例均采用递进的方式描述，各个实施例之间相同相似的部分互相参见即可，每个实施例重点说明的都是与其他实施例的不同之处。尤其，对于***实施例而言，由于其基本相似于方法实施例，所以描述的比较简单，相关之处参见方法实施例的部分说明即可。The various embodiments in the specification are described in a progressive manner, and the same or similar parts between the various embodiments may be referred to each other, and each embodiment focuses on the differences from the other embodiments. In particular, for the system embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the description of the method embodiment.
本申请可用于众多通用或专用的计算机***环境或配置中。例如：个人计算机、服务器计算机、手持设备或便携式设备、平板型设备、多处理器***、基于微处理器的***、置顶盒、可编程的消费电子设备、网络PC、小型计算机、大型计算机、包括以上任何***或设备的分布式计算环境等等。This application can be used in a variety of general purpose or special purpose computer system environments or configurations. For example: personal computers, server computers, handheld or portable devices, tablet devices, multiprocessor systems, microprocessor based systems, set-top boxes, programmable consumer electronics devices, network PCs, small computers, mainframe computers, including A distributed computing environment of any of the above systems or devices, and the like.
本申请可以在由计算机执行的计算机可执行指令的一般上下文中描述，例如程序模块。一般地，程序模块包括执行特定任务或实现特定抽象数据类型的例程、程序、对象、组件、数据结构等等。也可以在分布式计算环境中实践本申请，在这些分布式计算环境中，由通过通信网络而被连接的远程处理设备来执行任务。在分布式计算环境中，程序模块可以位于包括存储设备在内的本地 和远程计算机存储介质中。The application can be described in the general context of computer-executable instructions executed by a computer, such as a program module. Generally, program modules include routines, programs, objects, components, data structures, and the like that perform particular tasks or implement particular abstract data types. The present application can also be practiced in distributed computing environments where tasks are performed by remote processing devices that are connected through a communication network. In a distributed computing environment, program modules can be located locally, including storage devices. And remote computer storage media.
虽然通过实施例描绘了本申请，本领域普通技术人员知道，本申请有许多变形和变化而不脱离本申请的精神，希望所附的权利要求包括这些变形和变化而不脱离本申请的精神。 While the present invention has been described by the embodiments of the present invention, it will be understood by those skilled in the art

Claims (15)

  1. 一种用于显示应用数据的方法，其特征在于，包括：A method for displaying application data, comprising:
    第一应用控制器接收用于操作第一应用程序的控制指令；The first application controller receives a control instruction for operating the first application;
    第一应用控制器获取所述第一应用程序响应于所述控制指令的应用数据；The first application controller acquires application data of the first application in response to the control instruction;
    第一应用控制器返回所述应用数据至第二设备。The first application controller returns the application data to the second device.
  2. 如权利要求1所述的一种用于显示应用数据的方法，其特征在于，所述第一应用程序与第一应用控制器一一对应。The method for displaying application data according to claim 1, wherein the first application is in one-to-one correspondence with the first application controller.
  3. 如权利要求1所述的一种用于显示应用数据的方法，其特征在于，所述应用数据包括：应用程序的窗口数据和/或音频数据。A method for displaying application data according to claim 1, wherein said application data comprises: window data and/or audio data of an application.
  4. 如权利要求3所述的一种用于显示应用数据的方法，其特征在于，所述第一应用控制器获取所述第一应用程序响应于所述控制指令的应用数据，包括：通过截获***调用的方式获取所述第一应用程序动态链接库中响应于所述控制指令的窗口显示数据和/或音频数据，将所述获取到的窗口显示数据和/或音频数据作为应用数据；所述动态链接库用于提供所述第一应用程序的应用数据。The method for displaying application data according to claim 3, wherein the first application controller acquires application data of the first application in response to the control instruction, including: intercepting a system Obtaining, in a manner of calling, window display data and/or audio data in response to the control instruction in the first application dynamic link library, using the acquired window display data and/or audio data as application data; The dynamic link library is used to provide application data of the first application.
  5. 如权利要求1所述的一种用于显示应用数据的方法，其特征在于，所述第一应用控制器通过实时传输协议/RTP控制协议连接方式或者用户数据报协议连接的方式向所述第二设备返回所述应用数据。The method for displaying application data according to claim 1, wherein the first application controller communicates to the first application by means of a real-time transport protocol/RTP control protocol connection method or a user datagram protocol connection The second device returns the application data.
  6. 如权利要求1所述的一种用于显示应用数据的方法，其特征在于，所述向所述第二设备返回所述应用数据之前，还包括：对所述应用数据进行第一处理；相应地，向所述第二设备返回经过第一处理的应用数据。 The method for displaying application data according to claim 1, wherein before the returning the application data to the second device, the method further comprises: performing first processing on the application data; And returning the first processed application data to the second device.
  7. 如权利要求6所述的一种用于显示应用数据的方法，其特征在于，所述第一处理包括对所述应用数据进行编码压缩。A method for displaying application data according to claim 6, wherein said first processing comprises encoding compression of said application data.
  8. 一种用于显示应用数据的方法，其特征在于，包括：A method for displaying application data, comprising:
    在当前第一设备中运行第一应用程序；Running the first application in the current first device;
    接收第二设备传输的用于操作所述第一应用程序的控制指令；Receiving, by the second device, a control instruction for operating the first application;
    获取所述应用程序响应于所述控制指令的应用数据；Obtaining application data of the application in response to the control instruction;
    向所述第二设备返回所述应用数据。Returning the application data to the second device.
  9. 如权利要求8所述的一种用于显示应用数据的方法，其特征在于，所述获取所述应用程序响应于所述控制指令的应用数据，包括：通过截获***调用的方式获取所述应用程序的动态链接库中响应于所述控制指令的窗口显示数据和/或音频数据，将所述获取到的窗口显示数据和/或音频数据作为应用数据；所述动态链接库用于提供所述应用程序的应用数据。The method for displaying application data according to claim 8, wherein the obtaining the application data in response to the control instruction by the application comprises: acquiring the application by intercepting a system call And displaying the acquired window display data and/or audio data as application data in a dynamic link library of the program in response to the window display data and/or audio data of the control instruction; the dynamic link library is configured to provide the Application data for the application.
  10. 如权利要求8所述的一种用于显示应用数据的方法，其特征在于，包括：所述第一设备通过实时传输协议/RTP控制协议连接方式或者用户数据报协议连接的方式向所述第二设备返回所述应用数据。A method for displaying application data according to claim 8, comprising: said first device transmitting to said first mode by means of a real-time transport protocol/RTP control protocol connection method or a user datagram protocol connection The second device returns the application data.
  11. 如权利要求8所述的一种用于显示应用数据的方法，其特征在于，所述第一设备装载有第一应用程序、计算机控制器，以及第一应用控制器。A method for displaying application data according to claim 8, wherein said first device is loaded with a first application, a computer controller, and a first application controller.
  12. 一种用于显示应用数据的***，其特征在于，包括：第一设备和第二设备，所述第一设备与所述第一设备建立通讯连接；其中，A system for displaying application data, comprising: a first device and a second device, wherein the first device establishes a communication connection with the first device;
    第二设备接收用户的输入，生成用于操作所述应用程序的控制指令，并将所述控制指令发送至第一设备；The second device receives the input of the user, generates a control instruction for operating the application, and sends the control instruction to the first device;
    所述第一设备接收第二设备传输的用于操作所述应用程序的控制指令，获 取所述应用程序响应于所述控制指令的应用数据；向所述第二设备返回所述应用数据。Receiving, by the first device, a control instruction for operating the application that is transmitted by the second device, And taking the application data in response to the control instruction; returning the application data to the second device.
  13. 一种用于显示应用数据的设备，其特征在于，所述设备装载有计算机控制器、应用程序，以及与所述应用程序对应的应用控制器；其中，An apparatus for displaying application data, wherein the device is loaded with a computer controller, an application, and an application controller corresponding to the application; wherein
    所述计算机控制器根据所述控制指令启动所述应用程序或发送所述控制指令至所述应用控制器；The computer controller starts the application or sends the control instruction to the application controller according to the control instruction;
    所述应用控制器接收所述计算机控制器发来的控制指令，发送所述控制指令至所述应用程序，获取所述应用程序响应于所述控制消息的应用数据，并发送所述应用数据至所述第二设备。The application controller receives a control instruction sent by the computer controller, sends the control instruction to the application, acquires application data of the application in response to the control message, and sends the application data to The second device.
  14. 一种用于显示应用数据的应用控制器，其特征在于，所述应用控制器包括：控制指令接收模块、应用数据获取模块和应用数据返回模块；其中，An application controller for displaying application data, wherein the application controller includes: a control instruction receiving module, an application data acquiring module, and an application data returning module; wherein
    所述控制指令接收模块接收用于操作应用程序的控制指令；The control instruction receiving module receives a control instruction for operating an application;
    所述应用数据获取模块获取所述应用程序响应于所述控制指令的应用数据；The application data obtaining module acquires application data of the application program in response to the control instruction;
    所述应用数据返回模块返回所述应用数据至第二设备。The application data return module returns the application data to the second device.
  15. 如权利要求14所述的一种用于显示应用数据的应用控制器，其特征在于，还包括第一处理模块，第一处理模块对所述应用数据获取模块中获取的应用数据进行第一处理；相应地，所述应用数据返回模块返回所述第一处理模块中经过第一处理的应用数据至第二设备。 The application controller for displaying application data according to claim 14, further comprising a first processing module, wherein the first processing module performs the first processing on the application data acquired in the application data acquiring module Correspondingly, the application data returning module returns the first processed application data in the first processing module to the second device.
PCT/CN2016/079550 2015-05-08 2016-04-18 Method of displaying application data, application controller, device and system WO2016180166A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201510232456.5A CN106201387B (en) 2015-05-08 2015-05-08 Method, application controller, device and system for displaying application data
CN201510232456.5 2015-05-08

Publications (1)

Publication Number Publication Date
WO2016180166A1 true WO2016180166A1 (en) 2016-11-17

Family

ID=57247742

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2016/079550 WO2016180166A1 (en) 2015-05-08 2016-04-18 Method of displaying application data, application controller, device and system

Country Status (2)

Country Link
CN (1) CN106201387B (en)
WO (1) WO2016180166A1 (en)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110254824A1 (en) * 2010-04-16 2011-10-20 Hon Hai Precision Industry Co., Ltd. Electronic device with dual display screens
CN102662999A (en) * 2012-03-15 2012-09-12 北京视博云科技有限公司 Method, device and system for providing multimedia application data
CN103491122A (en) * 2012-06-13 2014-01-01 腾讯科技（深圳）有限公司 Multiple screen display interactive system and airsharing method

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110254824A1 (en) * 2010-04-16 2011-10-20 Hon Hai Precision Industry Co., Ltd. Electronic device with dual display screens
CN102662999A (en) * 2012-03-15 2012-09-12 北京视博云科技有限公司 Method, device and system for providing multimedia application data
CN103491122A (en) * 2012-06-13 2014-01-01 腾讯科技（深圳）有限公司 Multiple screen display interactive system and airsharing method

Also Published As

Publication number Publication date
CN106201387B (en) 2021-11-05
CN106201387A (en) 2016-12-07

Similar Documents

Publication Publication Date Title
US10135898B2 (en) Method, terminal, and system for reproducing content
WO2021135160A1 (en) Gaming live stream control method and device, computer storage medium, and electronic apparatus
US20210235153A1 (en) Video processing method, electronic device, and computer-readable medium
TWI502977B (en) Audio/video playing device, audio/video processing device, systems, and method thereof
US10606367B2 (en) Command relay device, system and method for providing remote assistance/remote control
CN108337560B (en) Media playback device and media serving device for playing media on a web browser
US10306179B2 (en) Image providing apparatus, control method thereof, and image providing system
US10805570B2 (en) System and method for streaming multimedia data
CN109218839B (en) Video playing method and device
US10388326B1 (en) Computing system with external speaker detection feature
US8826344B1 (en) Predictive positioning
US9564108B2 (en) Video frame processing on a mobile operating system
WO2017113708A1 (en) Video playback method and device
KR101931514B1 (en) Apparatus and method for simultaneous playback and backup of media in a web browser
WO2022142568A1 (en) Method and device for content displaying
US11936928B2 (en) Method, system and device for sharing contents
US20150194087A1 (en) Display device and method for controlling the same
WO2021120124A1 (en) Method and apparatus for video display, and computer storage medium
WO2016180166A1 (en) Method of displaying application data, application controller, device and system
CN109547830B (en) Method and device for synchronous playing of multiple virtual reality devices
WO2016061890A1 (en) Resource sharing method, terminal, system and computer storage medium
US11302282B2 (en) Display apparatus and the control method thereof
WO2021217467A1 (en) Method and apparatus for testing intelligent camera
KR102547320B1 (en) Electronic device and method for control thereof
WO2022012959A1 (en) Allocating control of a lighting device in an entertainment mode

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16792016

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 16792016

Country of ref document: EP

Kind code of ref document: A1