TW201812567A - Display data control method, device, and system - Google Patents

Abstract

Disclosed in the present invention are a display data control method, device, and system. The method comprises: a control apparatus acquiring, from a server, display configuration information of a display apparatus, wherein the display configuration information comprises desktop information of the display apparatus and object information of display objects displayed on all display screens included in the display apparatus; the control apparatus drawing, according to the display configuration information, a corresponding operation interface, wherein the operation interface comprises a simulation desktop corresponding to the desktop information and simulation objects corresponding to the display objects; the operation interface of the control apparatus detecting an operating action, and generating a corresponding operation event, wherein the operation event is used to control an operation the same as the operating action to be executed on the display apparatus. The present invention solves the technical problem of the prior art in which flexibility of an interactive process with display information is poor when data content is displayed on a large display screen.

Description

顯示資料的控制方法、裝置和系統    Control method, device and system for displaying data   

本發明係有關一種資料處理領域，尤其是一種顯示資料的控制方法、裝置和系統。 The invention relates to a field of data processing, in particular to a method, device and system for controlling display of data.

現有技術提供了一種由多塊小顯示屏拼接而得到的大顯示屏，這種大顯示屏作為一種顯示設備，所包括的每塊小顯示屏都需要與一台電腦PC相連，進而展示每台電腦PC的桌面內容。 The prior art provides a large display screen obtained by splicing multiple small display screens. As a display device, each large display screen needs to be connected to a computer PC to display each Computer PC desktop content.

基於如圖1所示的大屏顯示設備，傳統的大屏展示項目是基於如圖2所示的架構實現，如圖2所示，每個電腦PC的控制信號來拼接組裝得到整個大顯示屏的最終顯示內容，例如，採用18台PC電腦，總共輸出18路信號，每個PC運行一個H5頁面，投射到一個大屏顯示器上對應的一個小顯示螢幕中。 Based on the large-screen display device shown in Figure 1, the traditional large-screen display project is implemented based on the architecture shown in Figure 2. As shown in Figure 2, the control signals of each computer PC are stitched together to obtain the entire large display. The final display content is, for example, using 18 PC computers, outputting a total of 18 signals, each PC runs an H5 page, and is projected onto a corresponding small display screen on a large screen display.

而對每塊小顯示屏接收到的控制信號的佈局則是通過大屏廠商提供的控制軟體來實現，控制軟體需要交給專業的IT人員來處理，具體的，研發人員通過影片控制器來執行信號控制和佈局，即工作人員可以通過控制設備控制影片控制器來遠程控制信號的切換和佈局，其中，In介面表 示影片控制器的多路HD信號，Out介面表示影片控制器的多路信號輸出。 The layout of the control signals received by each small display screen is achieved through the control software provided by the large screen manufacturer. The control software needs to be handled by professional IT personnel. Specifically, the R & D personnel execute the video controller Signal control and layout, that is, workers can control the switching and layout of signals remotely through the control device to control the film controller. Among them, the In interface represents the multiple HD signals of the film controller, and the Out interface represents the multiple signal outputs of the film controller. .

控制的業務流程如下：首先，UED交互h5頁面給業務方，業務方部署到各自的伺服器，然後，每個PC瀏覽器訪問業務方的伺服器，將桌面通過影片控制器投射到螢幕組，同時，有專門的工作人員通過控制設備來控制信號的切換和佈局。 The controlled business process is as follows: First, the UED interacts with the h5 page to the business party, and the business party deploys to their respective servers. Then, each PC browser accesses the business party's server and projects the desktop to the screen group through the video controller. At the same time, there are specialized staff to control the switching and layout of the signals through the control equipment.

分析可知，上述現有技術提供的的方案主要包括如下兩個缺點：每次要修改大顯示屏上的信號內容時，需要遠程登錄到播放該信號的電腦PC，修改chrome瀏覽器訪問的內容；而如果修改大顯示屏的信號佈局，比如修改信號的位置，縮放信號的大小等，都需要專業IT人員來操控廠商的控制軟體，不是很靈活。 Analysis shows that the solutions provided by the prior art mentioned above mainly include the following two disadvantages: each time you want to modify the signal content on the large display screen, you need to log in remotely to the computer PC playing the signal and modify the content accessed by the chrome browser; and If you modify the signal layout of the large display, such as modifying the position of the signal, scaling the size of the signal, etc., you need professional IT personnel to control the manufacturer's control software, which is not very flexible.

由此在一種採用大顯示屏來展示業務內容的場景下，如果演講人員基於展示的業務內容進行演講時，每次對外講解業務內容的時候，除了主講人外，都需要一個額外的IT人員配合切換信號，降低了整個講解體驗。並且該控制軟體沒有公共標準，每個廠商都有自己的實現，不通用不開源，給維護帶來一定麻煩。 Therefore, in a scenario where a large display screen is used to display business content, if the lecturer gives a presentation based on the displayed business content, each time the business content is explained externally, in addition to the speaker, an additional IT staff is required to cooperate Switching the signals reduces the overall explanation experience. And there is no public standard for the control software. Each manufacturer has its own implementation, which is not universal and not open source, which brings some trouble to maintenance.

針對上述的問題，目前尚未提出有效的解決方案。 In view of the above problems, no effective solution has been proposed.

本發明實施例提供了一種顯示資料的控制方法、裝置和系統，以至少解決現有技術中採用大顯示屏展示資料內 容時，展示資訊的交互過程不靈活的技術問題。 Embodiments of the present invention provide a method, a device, and a system for controlling display data, so as to at least solve the technical problem that the interactive process of display information is not flexible when a large display screen is used to display the data content in the prior art.

根據本發明實施例的一個方面，提供了一種顯示資料的控制系統，該系統包括：顯示設備，包括多個顯示螢幕，每個顯示螢幕用於顯示頁面內容；伺服器，與顯示設備連接，用於保存與頁面內容關聯的顯示配置資訊，其中，顯示配置資訊包括：顯示設備的桌面資訊以及顯示設備所包括的每個顯示螢幕展示的顯示對象的對象資訊；控制設備，與伺服器連接，用於根據獲取到的顯示配置資訊繪製對應的操作介面，並在檢測到操作行為，產生對應的操作事件，其中，操作介面包括：與桌面資訊對應的模擬桌面和與顯示對象對應的模擬對象；其中，伺服器還用於接收操作事件，並根據操作事件控制在顯示設備上執行與操作行為相同的操作。 According to an aspect of an embodiment of the present invention, a control system for displaying data is provided. The system includes: a display device, including a plurality of display screens, each display screen is used to display page content; a server, connected to the display device, and The display configuration information associated with the content of the page is stored, wherein the display configuration information includes: desktop information of the display device and object information of a display object displayed on each display screen included in the display device; a control device, which is connected to a server, and uses The corresponding operation interface is drawn according to the obtained display configuration information, and the corresponding operation event is generated upon detecting the operation behavior. The operation interface includes: a simulated desktop corresponding to the desktop information and a simulated object corresponding to the display object; The server is also used to receive operation events and control the display device to perform the same operation as the operation behavior according to the operation events.

根據本發明實施例的一個方面，提供了一種顯示資料的控制方法，該方法包括：控制設備從伺服器獲取顯示設備的顯示配置資訊，其中，顯示配置資訊包括：顯示設備的桌面資訊以及顯示設備所包括的每個顯示螢幕展示的顯示對象的對象資訊；控制設備根據顯示配置資訊繪製對應的操作介面，其中，操作介面包括：與桌面資訊對應的模擬桌面和與顯示對象對應的模擬對象；控制設備的操作介面檢測到操作行為，產生對應的操作事件，其中，操作事件用於控制在顯示設備上執行與操作行為相同的操作。 According to an aspect of an embodiment of the present invention, a method for controlling display data is provided. The method includes: a control device obtaining display configuration information of a display device from a server, wherein the display configuration information includes: desktop information of the display device and display device. Each display screen includes object information of a display object; the control device draws a corresponding operation interface according to the display configuration information, wherein the operation interface includes: a simulated desktop corresponding to the desktop information and a simulated object corresponding to the display object; control The operation interface of the device detects an operation behavior and generates a corresponding operation event, where the operation event is used to control a display device to perform the same operation as the operation behavior.

根據本發明實施例的一個方面，提供了一種顯示資料的控制方法，該方法包括：伺服器獲取顯示設備的顯示配 置資訊，其中，顯示配置資訊包括：顯示設備的桌面資訊以及顯示設備所包括的每個顯示螢幕展示的顯示對象的對象資訊；伺服器根據控制設備在操作介面上檢測到的操作行為產生對應的操作事件，其中，操作介面為控制設備根據顯示配置資訊繪製，操作介面包括：與桌面資訊對應的模擬桌面和與顯示對象對應的模擬對象；伺服器根據操作事件控制在顯示設備上執行與操作行為相同的操作。 According to an aspect of an embodiment of the present invention, a method for controlling display data is provided. The method includes: a server obtaining display configuration information of a display device, wherein the display configuration information includes: desktop information of the display device and information included in the display device. Object information of the display object displayed on each display screen; the server generates corresponding operation events according to the operation behavior detected by the control device on the operation interface, wherein the operation interface is drawn by the control device according to the display configuration information, and the operation interface includes: and The simulated desktop corresponding to the desktop information and the simulated object corresponding to the display object; the server controls the display device to perform the same operation as the operation behavior according to the operation event.

根據本發明實施例的另一方面，還提供了一種顯示資料的控制裝置，該裝置包括：獲取模組，用於從伺服器獲取顯示設備的顯示配置資訊，其中，顯示配置資訊包括：顯示設備的桌面資訊以及顯示設備所包括的每個顯示螢幕展示的顯示對象的對象資訊；繪製模組，用於根據顯示配置資訊繪製對應的操作介面，其中，操作介面包括：與桌面資訊對應的模擬桌面和與顯示對象對應的模擬對象；產生模組，用於如果操作介面檢測到操作行為，產生對應的操作事件，其中，操作事件用於控制在顯示設備上執行與操作行為相同的操作。 According to another aspect of the embodiments of the present invention, a control device for displaying data is also provided. The device includes: an acquisition module for acquiring display configuration information of a display device from a server, wherein the display configuration information includes: a display device Desktop information and object information of display objects displayed on each display screen included in the display device; a drawing module for drawing a corresponding operation interface according to the display configuration information, wherein the operation interface includes: a simulated desktop corresponding to the desktop information And a simulation object corresponding to the display object; a generating module is configured to generate a corresponding operation event if the operation interface detects an operation behavior, wherein the operation event is used to control a display device to perform the same operation as the operation behavior.

在本發明實施例中，採用控制設備從伺服器獲取顯示設備的顯示配置資訊，其中，顯示配置資訊包括：顯示設備的桌面資訊以及顯示設備所包括的每個顯示螢幕展示的顯示對象的對象資訊；控制設備根據顯示配置資訊繪製對應的操作介面，其中，操作介面包括：與桌面資訊對應的模擬桌面和與顯示對象對應的模擬對象；控制設備的操作介面檢測到操作行為，產生對應的操作事件，其中，操作 事件用於控制在顯示設備上執行與操作行為相同的操作的方式，通過控制設備從伺服器獲取顯示設備的顯示配置資訊，並根據顯示配置資訊繪製對應的操作介面，在用戶使用該操作介面進行相應的操作時，控制設備可以檢測到上述操作行為，從而產生對應的操作事件，此時伺服器會響應該操作事件，並基於操作事件控制在顯示設備上執行與操作行為相同的操作，由於上述控制設備可以通過伺服器來實現，將控制設備本地的操作事件同步至對應的顯示設備上，實現了用戶可以通過控制設備靈活的對大螢幕的顯示設備的操作過程，降低了大螢幕顯示設備的展示資訊的交互靈活性，進而解決了現有技術中採用大顯示屏展示資料內容時，展示資訊的交互過程不靈活的技術問題。 In the embodiment of the present invention, the control device is used to obtain the display configuration information of the display device from the server, wherein the display configuration information includes: desktop information of the display device and object information of a display object displayed on each display screen included in the display device. ; The control device draws a corresponding operation interface according to the display configuration information, wherein the operation interface includes: a simulated desktop corresponding to the desktop information and a simulated object corresponding to the display object; the operation interface of the control device detects an operation behavior and generates a corresponding operation event Among them, the operation event is used to control the way of performing the same operation on the display device as the operation behavior. The control device obtains the display configuration information of the display device from the server, and draws the corresponding operation interface according to the display configuration information. When the operation interface performs corresponding operations, the control device can detect the above operation behaviors, thereby generating corresponding operation events. At this time, the server will respond to the operation events, and based on the operation events, control the execution of the same operation behavior on the display device. operating, Since the above control device can be realized by a server, the local operation events of the control device are synchronized to the corresponding display device, which realizes that the user can flexibly operate the large screen display device through the control device, reducing the large screen display. The interactive flexibility of the display information of the device further solves the technical problem that the interactive process of the display information is not flexible when the large display screen is used to display the data content in the prior art.

10‧‧‧顯示設備 10‧‧‧Display Equipment

30‧‧‧伺服器 30‧‧‧Server

50‧‧‧控制設備 50‧‧‧Control equipment

10‧‧‧電腦終端 10‧‧‧Computer Terminal

102a‧‧‧處理器 102a‧‧‧Processor

102b‧‧‧處理器 102b‧‧‧Processor

102n‧‧‧處理器 102n‧‧‧Processor

104‧‧‧儲存器 104‧‧‧Memory

S20‧‧‧步驟 S20‧‧‧step

S22‧‧‧步驟 S22‧‧‧step

S24‧‧‧步驟 S24‧‧‧step

S90‧‧‧步驟 S90‧‧‧step

S92‧‧‧步驟 S92‧‧‧step

S94‧‧‧步驟 S94‧‧‧step

S96‧‧‧步驟 S96‧‧‧step

S141‧‧‧步驟 S141‧‧‧step

S143‧‧‧步驟 S143‧‧‧step

S145‧‧‧步驟 S145‧‧‧step

S101‧‧‧步驟 S101‧‧‧step

S103‧‧‧步驟 S103‧‧‧step

S105‧‧‧步驟 S105‧‧‧step

S107‧‧‧步驟 S107‧‧‧step

S109‧‧‧步驟 S109‧‧‧step

S111‧‧‧步驟 S111‧‧‧step

S121‧‧‧步驟 S121‧‧‧step

S123‧‧‧步驟 S123‧‧‧step

S125‧‧‧步驟 S125‧‧‧step

130‧‧‧獲取模組 130‧‧‧Get Module

133‧‧‧繪製模組 133‧‧‧Drawing Module

135‧‧‧產生模組 135‧‧‧ Generate Module

14‧‧‧控制設備 14‧‧‧Control Equipment

142‧‧‧處理器 142‧‧‧Processor

144‧‧‧儲存器 144‧‧‧Storage

此處所說明的圖式用來提供對本發明的進一步理解，構成本申請的一部分，本發明的示意性實施例及其說明用於解釋本發明，並不構成對本發明的不當限定。在圖式中：圖1是根據現有技術的大顯示屏端的顯示示意圖；圖2是根據現有技術的大顯示屏的系統控制結構示意圖；圖3是本發明實施例提供的一種影片資料的控制系統的結構示意圖；圖4根據本發明實施例的控制顯示設備中windows桌面 的事件分發的顯示示意圖；圖5示出了一種用於實現顯示資料的控制方法的電腦終端的硬體結構方塊圖；圖6是根據本發明實施例一的顯示資料的控制方法的流程圖；圖7是根據本發明實施例的在控制設備中顯示各個顯示對象的對象資訊的示意圖；圖8是根據本發明實施例的控制設備中抽象的顯示對象的控件的示意圖；圖9a-圖9d是根據本發明實施例的操作事件的業務流程圖；圖10是根據本發明實施例的控制設備的業務交互圖；圖11是根據本發明的實施例的控制設備與伺服器交互的流程示意圖；圖12是根據本發明實施例一的顯示資料的控制方法的流程圖；圖13是根據本發明實施例的顯示資料的控制裝置的示意圖；以及圖14是根據本發明實施例的一種控制設備的結構方塊圖。 The drawings described herein are used to provide a further understanding of the present invention and constitute a part of the present application. The schematic embodiments of the present invention and the descriptions thereof are used to explain the present invention, and do not constitute an improper limitation on the present invention. In the drawings: FIG. 1 is a display diagram of a large display screen terminal according to the prior art; FIG. 2 is a schematic diagram of a system control structure of a large display screen according to the prior art; and FIG. 3 is a control system for a movie material provided by an embodiment of the present invention Fig. 4 is a schematic diagram showing the event distribution of a windows desktop in a display device according to an embodiment of the present invention; Fig. 5 is a block diagram showing the hardware structure of a computer terminal for implementing a method for controlling display data; 6 is a flowchart of a method for controlling display data according to the first embodiment of the present invention; FIG. 7 is a schematic diagram of displaying object information of each display object in a control device according to an embodiment of the present invention; Schematic diagram of abstract display object controls in the control device; Figures 9a-9d are business flow diagrams of operation events according to an embodiment of the present invention; Figure 10 is a business interaction diagram of a control device according to an embodiment of the present invention; and Figure 11 is A schematic flowchart of interaction between a control device and a server according to an embodiment of the present invention; FIG. 12 is a diagram showing display information according to the first embodiment of the present invention A flowchart of a control method; FIG. 13 is a schematic diagram of the control means displays information in accordance with an embodiment of the present invention; and FIG. 14 is a configuration block diagram of a control apparatus according to an embodiment of the present invention.

為了使本技術領域的人員更好地理解本發明方案，下面將結合本發明實施例中的圖式，對本發明實施例中的技 術方案進行清楚、完整地描述，顯然，所描述的實施例僅僅是本發明一部分的實施例，而不是全部的實施例。基於本發明中的實施例，本領域普通技術人員在沒有做出創造性勞動前提下所獲得的所有其他實施例，都應當屬於本發明保護的範圍。 In order to enable those skilled in the art to better understand the solutions of the present invention, the technical solutions in the embodiments of the present invention will be described clearly and completely in combination with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only The embodiments are part of the present invention, but not all the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by a person of ordinary skill in the art without creative efforts should fall within the protection scope of the present invention.

需要說明的是，本發明的說明書和申請專利範圍及上述圖式中的術語“第一”、“第二”等是用於區別類似的對象，而不必用於描述特定的順序或先後次序。應該理解這樣使用的資料在適當情況下可以互換，以便這裡描述的本發明的實施例能夠以除了在這裡圖示或描述的那些以外的順序實施。此外，術語“包括”和“具有”以及他們的任何變形，意圖在於覆蓋不排他的包含，例如，包含了一系列步驟或單元的過程、方法、系統、產品或設備不必限於清楚地列出的那些步驟或單元，而是可包括沒有清楚地列出的或對於這些過程、方法、產品或設備固有的其它步驟或單元。 It should be noted that the terms “first” and “second” in the scope of the description and patent application of the present invention and the above drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the materials used as such are interchangeable under appropriate circumstances so that the embodiments of the invention described herein can be implemented in an order other than those illustrated or described herein. Furthermore, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions, for example, a process, method, system, product, or device that includes a series of steps or units need not be limited to those explicitly listed Those steps or units may instead include other steps or units not explicitly listed or inherent to these processes, methods, products or equipment.

首先，在對本申請實施例進行描述的過程中出現的部分名詞或術語適用於如下解釋： First, some terms or terms appearing during the description of the embodiments of the present application are applicable to the following explanations:

信號源：指影片信號源，比如顯卡的一路DVI信號輸出，PC桌面信號等。 Signal source: refers to the video signal source, such as a DVI signal output from a graphics card, PC desktop signal, etc.

資訊片app：軟體層面抽象的一個對象，邏輯上用於表示塊資料資訊，例如一個網頁，實現上表示一個iframe，是這個技術方案中的一個基本概念。 Information piece app: An object that is abstracted at the software level and is used logically to represent block data information. For example, a web page, representing an iframe in implementation, is a basic concept in this technical solution.

實施例1 Example 1

圖3是本發明實施例提供的一種影片資料的控制系統的結構示意圖，如圖3所示，該控制系統可以包括：顯示設備10、伺服器30和控制設備50。 FIG. 3 is a schematic structural diagram of a control system for film materials according to an embodiment of the present invention. As shown in FIG. 3, the control system may include a display device 10, a server 30, and a control device 50.

其中，顯示設備10，包括多個顯示螢幕0、1、......、n，每個顯示螢幕用於顯示頁面內容；伺服器30，與顯示設備10連接，用於保存與頁面內容關聯的顯示配置資訊，其中，顯示配置資訊包括：顯示設備的桌面資訊以及顯示設備所包括的每個顯示螢幕展示的顯示對象的對象資訊；控制設備50，與伺服器30連接，用於根據獲取到的顯示配置資訊繪製對應的操作介面，並在檢測到操作行為，產生對應的操作事件，其中，操作介面包括：與桌面資訊對應的模擬桌面和與顯示對象對應的模擬對象；其中，伺服器還用於接收操作事件，並根據操作事件控制在顯示設備上執行與操作行為相同的操作。 Among them, the display device 10 includes a plurality of display screens 0, 1, ..., n, each of which is used to display page content; the server 30 is connected to the display device 10 and is used to save and page content Associated display configuration information, where the display configuration information includes: desktop information of the display device and object information of a display object displayed by each display screen included in the display device; a control device 50 connected to the server 30 and configured to obtain The corresponding display configuration information is drawn to the corresponding operation interface, and the operation behavior is detected to generate the corresponding operation event. The operation interface includes: a simulated desktop corresponding to the desktop information and a simulated object corresponding to the display object; wherein, the server It is also used to receive an operation event and control the display device to perform the same operation as the operation behavior according to the operation event.

本申請提供的上述實施例中，控制設備從伺服器獲取顯示設備的顯示配置資訊，並根據顯示配置資訊繪製對應的操作介面，在用戶使用該操作介面進行相應的操作時，控制設備可以檢測到上述操作行為，從而產生對應的操作事件，此時伺服器會響應該操作事件，並基於操作事件控制在顯示設備上執行與操作行為相同的操作。由此可知，控制設備一端可以抽象展示大屏的顯示設備中對應的顯示對象app的資訊展示給用戶，並接收用戶輸入的交互指令和控制指令，並轉化為伺服器系統可識別的操作事件的指 令發送給伺服器server，進而伺服器server可以根據不同指令做相應邏輯處理，由於上述控制設備可以通過伺服器來實現，將控制設備本地的操作事件同步至對應的顯示設備上，實現了用戶可以通過控制設備靈活的對大螢幕的顯示設備的操作過程，降低了大螢幕顯示設備的展示資訊的交互靈活性。 In the above-mentioned embodiment provided by the present application, the control device obtains the display configuration information of the display device from the server, and draws a corresponding operation interface according to the display configuration information. When the user uses the operation interface to perform corresponding operations, the control device can detect The above operation behavior generates a corresponding operation event. At this time, the server will respond to the operation event and control the display device to perform the same operation as the operation behavior based on the operation event. It can be known that the control device end can abstractly display the information of the corresponding display object app in the large-screen display device to the user, and receive the interactive instruction and control instruction input by the user, and convert it into an operation event that can be recognized by the server system. The instructions are sent to the server server, and the server server can then perform corresponding logic processing according to different instructions. Since the above control equipment can be implemented by the server, the local operation events of the control equipment are synchronized to the corresponding display equipment, which realizes that the user can By controlling the flexible operation of the display device of the large-screen display device, the interactive flexibility of the display information of the large-screen display device is reduced.

上述解決方案還進一步定義了一套操作事件的分發機制，使得各種控制設備都能接入顯示設備的系統，完成對展現內容的靈活控制。 The above solution further defines a set of operation event distribution mechanisms, so that various control devices can access the system of the display device, and complete flexible control of the displayed content.

此處需要說明的是上述桌面資訊至少可以包括：顯示設備的桌面尺寸；顯示對象的對象資訊至少包括：顯示對象的尺寸、位於顯示設備中的位置資訊、顯示內容和顯示深度。上述操作事件可以包括如下至少之一：點擊事件、縮放事件、移動事件和滾動事件。 What needs to be explained here is that the above-mentioned desktop information may include at least: the desktop size of the display device; the object information of the display object includes at least: the size of the display object, the position information in the display device, the display content, and the display depth. The above operation event may include at least one of the following: a click event, a zoom event, a movement event, and a scroll event.

具體的，如圖3所示，上述顯示設備10是完整的大屏顯示設備，例如可以是超大的長方形桌面，在這個長方形桌面上放了多個顯示內容不同的對象資訊(即可以是資訊片app1、app2、app3和app4)，上述每個App可以放置在大桌面上的任意位置，app的尺寸也可以在桌面允許的範圍內擴展。 Specifically, as shown in FIG. 3, the above display device 10 is a complete large-screen display device, for example, it may be a super-large rectangular desktop, and a plurality of object information (i.e., information films) may be displayed on the rectangular desktop with different display contents. app1, app2, app3, and app4), each of the above apps can be placed anywhere on the large desktop, and the size of the app can also be expanded within the range allowed by the desktop.

例如，以獲取顯示對象位於顯示設備中的位置資訊為例，需要先獲知每個顯示螢幕在顯示設備中的位置，首先可以將大屏抽象為[M x N]的小屏矩陣拼接成的桌面系統，矩陣中的每個點代表一塊物理顯示螢幕screen，所有 的screen分辨率都相同，比如都為1400 x 1050。每個screen特有的屬性是其在矩陣中的位置(x,y)，例如如圖3所示的顯示設備中，display0這塊顯示螢幕screen的位置是(0,0)，而display6這塊screen的位置是(1,2)。每個顯示螢幕screen裡運行的是一個全屏的chrome瀏覽器，訪問的地址是server提供的display.html？id=(x,y)。通過id參數可以告知server自己代表哪一塊screen。 For example, to obtain the location information of the display object in the display device as an example, you need to know the position of each display screen in the display device first. First, you can abstract the large screen into a desktop composed of a small screen matrix of [M x N]. In the system, each point in the matrix represents a physical display screen screen, and all screen resolutions are the same, such as 1400 x 1050. The unique attribute of each screen is its position (x, y) in the matrix. For example, in the display device shown in FIG. 3, the position of the display screen screen of display0 is (0,0), and the screen of display6 is The position is (1,2). Each display screen is running a full-screen chrome browser, and the address accessed is display.html provided by the server? id = (x, y). The id parameter can tell the server which screen it represents.

上述伺服器30可以實現管理顯示對象的資源文件，並作為網路伺服器webserver對外部設備提供資源服務，同時可以對每個對象資訊創建和刪除對應的app instance，以及所有app在抽象桌面中的位置資訊，並保存有所有大顯示屏中每個display顯示螢幕的連接情況，並可以將關鍵資訊(比如app和screen)的資料實時廣播給對應的控制設備。 The above server 30 can implement the management of resource files of display objects, and serve as a web server webserver to provide resource services to external devices. At the same time, it can create and delete corresponding app instances for each object information, and all apps in the abstract desktop. Location information, and save the connection of each display in all large display screens, and can broadcast key information (such as app and screen) to the corresponding control device in real time.

上述控制設備50抽象展示大屏的顯示設備10和伺服器中app的資訊展示給用戶，接受用戶的交互和控制指令，並轉化為系統可識別的指令發送給伺服器server，伺服器server根據不同指令做相應邏輯處理。 The above-mentioned control device 50 abstractly displays the information of the large-screen display device 10 and the app in the server to the user, accepts the user's interaction and control instructions, and converts them into system-recognizable instructions and sends them to the server server. The instructions do the corresponding logic processing.

一種可選實施例中，控制設備可以向伺服器發送器請求資訊，用於獲取顯示設備的顯示系統桌面的顯示配置資訊，顯示配置資訊可以包括桌面配置的桌面資訊(例如顯示設備的總長寬)，以及拼接該顯示設備的每個顯示螢幕的顯示對象的對象資訊。 In an optional embodiment, the control device may request information from the server transmitter for obtaining display configuration information of the display system desktop of the display device, and the display configuration information may include desktop information of the desktop configuration (such as the total length and width of the display device) , And object information that stitches the display objects of each display screen of the display device.

由上可知，本發明實現了一種如圖4所示的示例，控 制設備設計了一套合理的事件分發系統，例如模擬圖4中windows桌面的事件分發機制，該操作事件的分發系統通過伺服器對顯示螢幕上的顯示對象進行同步控制。從而實現了靈活的交互控制。 As can be seen from the above, the present invention implements an example as shown in FIG. 4. The control device is designed with a reasonable event distribution system, such as an event distribution mechanism that simulates the windows desktop in FIG. 4. The operation event distribution system passes through a server. Synchronize the display objects on the display screen. Thus, flexible interactive control is achieved.

由此可知，通過本發明提供的設計方案，至少可以解決傳統方案中遇到至少如下兩個問題： It can be seen that at least the following two problems encountered in the traditional solution can be solved through the design solution provided by the present invention:

不用遠程登錄信號PC，直接在控制端打開希望呈現的web page。 Instead of remotely signing in to the PC, open the desired web page directly on the console.

不需要專業IT的介入，脫離大屏硬體廠商的限制，直接在iPad上方便的擺放web page在大屏上的位置和尺寸。 There is no need for professional IT to get involved, and it is easy to place the position and size of the web page on the big screen directly on the iPad without the restrictions of the big screen hardware manufacturers.

實施例2 Example 2

根據本發明實施例，還提供了一種顯示資料的控制的方法實施例，需要說明的是，在圖式的流程圖示出的步驟可以在諸如一組電腦可執行指令的電腦系統中執行，並且，雖然在流程圖中示出了邏輯順序，但是在某些情況下，可以以不同於此處的順序執行所示出或描述的步驟。 According to the embodiment of the present invention, an embodiment of a method for controlling display data is also provided. It should be noted that the steps shown in the flowchart of the figure can be executed in a computer system such as a set of computer executable instructions, and Although the logical order is shown in the flowchart, in some cases the steps shown or described may be performed in a different order than here.

本申請實施例一所提供的方法實施例可以在行動終端、電腦終端或者類似的運算裝置中執行。圖5示出了一種用於實現顯示資料的控制方法的電腦終端(或行動設備)的硬體結構方塊圖。如圖5所示，電腦終端10(或行動設備10)可以包括一個或多個(圖中採用102a、102b，......，102n來示出)處理器102(處理器102可以包括但不限於微處理器MCU或可程式化邏輯器件FPGA等的 處理裝置)、用於儲存資料的儲存器104、以及用於通信功能的傳輸模組106。除此以外，還可以包括：顯示器、輸入/輸出介面(I/O介面)、通用串列匯流排(USB)端口(可以作為I/O介面的端口中的一個端口被包括)、網路介面、電源及/或相機。本領域普通技術人員可以理解，圖1所示的結構僅為示意，其並不對上述電子裝置的結構造成限定。例如，電腦終端10還可包括比圖5中所示更多或者更少的組件，或者具有與圖5所示不同的配置。 The method embodiments provided in the first embodiment of the present application may be executed in a mobile terminal, a computer terminal, or a similar computing device. FIG. 5 shows a block diagram of a hardware structure of a computer terminal (or mobile device) for implementing a method for controlling display data. As shown in FIG. 5, the computer terminal 10 (or mobile device 10) may include one or more (shown with 102a, 102b, ..., 102n in the figure) a processor 102 (the processor 102 may include (But not limited to a processing device such as a microprocessor MCU or a programmable logic device FPGA), a memory 104 for storing data, and a transmission module 106 for communication functions. In addition, it can also include: display, input / output interface (I / O interface), universal serial bus (USB) port (can be included as one of the ports of I / O interface), network interface , Power, and / or camera. Persons of ordinary skill in the art can understand that the structure shown in FIG. 1 is only schematic, and it does not limit the structure of the electronic device. For example, the computer terminal 10 may further include more or fewer components than those shown in FIG. 5, or have a configuration different from that shown in FIG. 5.

應當注意到的是上述一個或多個處理器102及/或其他資料處理電路在本文中通常可以被稱為“資料處理電路”。該資料處理電路可以全部或部分的體現為軟體、硬體、固件或其他任意組合。此外，資料處理電路可為單個獨立的處理模組，或全部或部分的結合到電腦終端10(或行動設備)中的其他元件中的任意一個內。如本申請實施例中所涉及到的，該資料處理電路作為一種處理器控制(例如與介面連接的可變電阻終端路徑的選擇)。 It should be noted that the aforementioned one or more processors 102 and / or other data processing circuits may be generally referred to herein as "data processing circuits". The data processing circuit may be fully or partially embodied as software, hardware, firmware, or any other combination. In addition, the data processing circuit may be a single independent processing module, or may be wholly or partially incorporated into any one of other components in the computer terminal 10 (or mobile device). As mentioned in the embodiment of the present application, the data processing circuit is controlled as a processor (for example, selection of a variable resistance terminal path connected to an interface).

儲存器104可用于儲存應用軟體的軟體程式以及模組，如本發明實施例中的顯示資料的控制方法對應的程式指令/資料儲存裝置，處理器102通過運行儲存在儲存器104內的軟體程式以及模組，從而執行各種功能應用以及資料處理，即實現上述的應用程式的漏洞檢測方法。儲存器104可包括高速隨機儲存器，還可包括非易失性儲存器，如一個或者多個磁性儲存裝置、閃存、或者其他非易失性固態儲存器。在一些實例中，儲存器104可進一步包 括相對於處理器102遠程設置的儲存器，這些遠程儲存器可以通過網路連接至電腦終端10。上述網路的實例包括但不限於網際網路、企業內部網、區域網路、行動通信網及其組合。 The storage 104 may be used to store software programs and modules of application software, such as a program instruction / data storage device corresponding to the display data control method in the embodiment of the present invention. The processor 102 runs the software program stored in the storage 104 And modules to execute various functional applications and data processing, that is, to implement the vulnerability detection method of the above application program. The storage 104 may include a high-speed random storage, and may also include a non-volatile storage, such as one or more magnetic storage devices, a flash memory, or other non-volatile solid-state storage. In some examples, the memory 104 may further include a memory remotely disposed with respect to the processor 102, and these remote memories may be connected to the computer terminal 10 through a network. Examples of the above network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

傳輸裝置106用於經由一個網路接收或者發送資料。上述的網路具體實例可包括電腦終端10的通信供應商提供的無線網路。在一個實例中，傳輸裝置106包括一個網路適配器(Network Interface Controller，NIC)，其可通過基站與其他網路設備相連從而可與網際網路進行通訊。在一個實例中，傳輸裝置106可以為射頻(Radio Frequency，RF)模組，其用於通過無線方式與網際網路進行通訊。 The transmission device 106 is used for receiving or transmitting data via a network. Specific examples of the above-mentioned network may include a wireless network provided by a communication provider of the computer terminal 10. In one example, the transmission device 106 includes a network adapter (Network Interface Controller, NIC), which can be connected to other network devices through a base station so as to communicate with the Internet. In one example, the transmission device 106 may be a radio frequency (RF) module, which is used to communicate with the Internet wirelessly.

此處需要說明的是，在一些實施例中，上述圖5所示的電腦設備(或行動設備)具有觸摸顯示器(也被稱為“觸摸屏”或“觸摸顯示屏”)，該觸摸顯示器可使得用戶能夠與電腦終端10(或行動設備)的用戶介面進行交互。在一些實施例中，上述圖1所示的電腦設備(或行動設備)具有圖像用戶介面(GUI)，用戶可以通過觸摸觸敏表面上的手指接觸及/或手勢來與GUI進行人機交互，此處的人機交互功能可選的包括如下交互：創建網頁、繪圖、文字處理、製作電子文檔、遊戲、影片會議、即時通信、收發電子郵件、通話介面、播放數位影片、播放數位音樂及/或網路瀏覽等、用於執行上述人機交互功能的可執行指令被配置/儲存在一個或多個處理器可執行的電腦 程式產品或可讀儲存媒介中。 It should be noted here that, in some embodiments, the computer device (or mobile device) shown in FIG. 5 described above has a touch display (also referred to as a “touch screen” or a “touch display”). The touch display can make The user can interact with the user interface of the computer terminal 10 (or mobile device). In some embodiments, the computer device (or mobile device) shown in FIG. 1 described above has an image user interface (GUI), and the user can perform human-computer interaction with the GUI by touching finger contacts and / or gestures on the touch-sensitive surface. The optional human-computer interaction functions here include the following interactions: creating web pages, drawing, word processing, making electronic documents, games, video conferences, instant messaging, sending and receiving emails, calling interfaces, playing digital videos, playing digital music, and Executable instructions for performing the human-computer interaction functions, such as Internet browsing, are configured / stored in a computer program product or a readable storage medium executable by one or more processors.

在上述運行環境下，本申請提供了如圖6所示的顯示資料的控制方法。圖6是根據本發明實施例一的顯示資料的控制方法的流程圖。 Under the above-mentioned operating environment, the present application provides a method for controlling display data as shown in FIG. 6. 6 is a flowchart of a method for controlling display data according to the first embodiment of the present invention.

如圖6所示，該顯示資料的控制方法可以包括如下實施步驟： As shown in FIG. 6, the method for controlling display data may include the following implementation steps:

步驟S20，控制設備從伺服器獲取顯示設備的顯示配置資訊，其中，顯示配置資訊包括：顯示設備的桌面資訊以及顯示設備所包括的每個顯示螢幕展示的顯示對象的對象資訊。 Step S20: The control device obtains display configuration information of the display device from the server, where the display configuration information includes: desktop information of the display device and object information of a display object displayed on each display screen included in the display device.

一種可選實施例中，控制設備可以向伺服器發送器請求資訊，用於獲取顯示設備的顯示系統桌面的顯示配置資訊，顯示配置資訊可以包括桌面配置的桌面資訊(例如顯示設備的總長寬)，以及拼接該顯示設備的每個顯示螢幕的顯示對象的對象資訊(例如如圖6中的app資訊)。 In an optional embodiment, the control device may request information from the server transmitter for obtaining display configuration information of the display system desktop of the display device, and the display configuration information may include desktop information of the desktop configuration (such as the total length and width of the display device) , And object information (for example, app information as shown in FIG. 6) of each display screen on which the display device is spliced.

由此可知，伺服器可以實現管理顯示對象的資源文件，並作為網路伺服器webserver對外部設備提供資源服務，同時可以對每個對象資訊創建和刪除對應的app instance，以及所有app在抽象桌面中的位置資訊，並保存有所有大顯示屏中每個display顯示螢幕的連接情況，並可以將關鍵資訊(比如app和screen)的資料實時廣播給對應的控制設備。 It can be known that the server can manage the resource files of the display objects and serve as a web server webserver to provide resource services to external devices. At the same time, it can create and delete corresponding app instances for each object information, and all apps on the abstract desktop. Location information in the media, and saves the connection of each display screen in all large display screens, and can broadcast key information (such as app and screen) to the corresponding control device in real time.

較佳地，上述桌面資訊至少包括：顯示設備的桌面尺寸；顯示對象的對象資訊至少包括：顯示對象的尺寸、位 於顯示設備中的位置資訊、顯示內容和顯示深度z-index，顯示深度z-index用於表示當多個顯示對象app在同一個位置有重疊的時候，每個顯示對象處於圖層中的位置，例如可以區別開哪一個顯示對象處於其他顯示對象的上層。 Preferably, the above-mentioned desktop information includes at least: the desktop size of the display device; the object information of the display object includes at least: the size of the display object, the position information in the display device, the display content and the display depth z-index, and the display depth z- The index is used to indicate that when multiple display object apps overlap at the same position, each display object is in a layer position, for example, it can distinguish which display object is on the upper layer of other display objects.

例如，以獲取顯示對象位於顯示設備中的位置資訊為例，需要先獲知每個顯示螢幕在顯示設備中的位置，首先可以將大屏抽象為[M x N]的小屏矩陣拼接成的桌面系統，矩陣中的每個點代表一塊物理顯示螢幕screen，所有的screen分辨率都相同，比如都為1400 x 1050。每個screen特有的屬性是其在矩陣中的位置(x,y)，例如如圖3所示的顯示設備中，display0這塊顯示螢幕screen的位置是(0,0)，而display6這塊screen的位置是(1,2)。每個screen裡運行的是一個全屏的chrome瀏覽器，訪問的地址是server提供的display.html？id=(x,y)。通過id參數可以告知server自己代表哪一塊screen For example, to obtain the location information of the display object in the display device as an example, you need to know the position of each display screen in the display device first. First, you can abstract the large screen into a desktop composed of a small screen matrix of [M x N]. In the system, each point in the matrix represents a physical display screen screen, and all screen resolutions are the same, such as 1400 x 1050. The unique attribute of each screen is its position (x, y) in the matrix. For example, in the display device shown in FIG. 3, the position of the display screen screen of display0 is (0,0), and the screen of display6 is The position is (1,2). Each screen is running a full-screen chrome browser, and the address accessed is display.html provided by the server? id = (x, y). The id parameter can tell the server which screen it represents.

一種可選實施例中，以圖7所示的在控制設備中顯示各個顯示對象的對象資訊為例中，在顯示設備的桌面可以為如圖7所示的長方形桌面，在這個長方形桌面上放了多個顯示內容不同的對象資訊(即可以是資訊片app1、app2、app3和app4)，上述每個App可以放置在大桌面上的任意位置，app的尺寸也可以在桌面允許的範圍內擴展。 In an optional embodiment, taking the object information of each display object displayed in the control device as shown in FIG. 7 as an example, the desktop of the display device may be a rectangular desktop as shown in FIG. Multiple pieces of object information with different display contents (that is, information films app1, app2, app3, and app4), each of the above apps can be placed anywhere on the large desktop, and the size of the app can also be expanded within the range allowed by the desktop .

步驟S22，控制設備根據顯示配置資訊繪製對應的操作介面，其中，操作介面包括：與桌面資訊對應的模擬桌 面和與顯示對象對應的模擬對象。 Step S22: The control device draws a corresponding operation interface according to the display configuration information. The operation interface includes: a simulation desktop corresponding to the desktop information and a simulation object corresponding to the display object.

具體的，在控制設備可以根據顯示配置資訊繪製一個模擬的桌面和模擬對象app的顯示圖，用戶可以根據控制設備中當前顯示的圖像來獲取當前大顯示屏設備中各個顯示螢幕的內容的佈局情況。 Specifically, the control device can draw a display diagram of a simulated desktop and a simulated object app according to the display configuration information. The user can obtain the layout of the contents of each display screen in the current large display device according to the image currently displayed in the control device. Happening.

步驟S24，控制設備的操作介面檢測到操作行為，產生對應的操作事件，其中，操作事件用於控制在顯示設備上執行與操作行為相同的操作。 In step S24, the operation interface of the control device detects an operation behavior and generates a corresponding operation event, where the operation event is used to control a display device to perform the same operation as the operation behavior.

進而可以收集用戶的交互事件，例如在控制設備為行動端的情況下，可以採用hammer.js庫收集用戶手勢操作，較佳地，上述操作事件包括如下至少之一：點擊事件、縮放事件、移動事件和滾動事件。 Furthermore, user interaction events can be collected. For example, when the control device is a mobile terminal, the user can use the hammer.js library to collect user gesture operations. Preferably, the above operation events include at least one of the following: a click event, a zoom event, and a movement event. And scroll events.

以操作事件為縮放事件和移動事件為例，用戶可以通過在控制設備上移動和縮放app來控制顯示設備上對應的顯示螢幕中的顯示對象執行移動和縮放。上述顯示設備作為一種大屏的顯示螢幕，顯示設備的桌面可以抽象為桌面容器，顯示設備顯示的對象資訊可以抽象為容器內的資訊片app，由此，大屏的顯示設備展現的結果可以抽象為多個顯示對象app的組合。 Taking the operation event as the zoom event and the movement event as an example, the user can control the display object in the corresponding display screen on the display device to perform the movement and zoom by moving and zooming the app on the control device. The above display device is a large-screen display screen. The desktop of the display device can be abstracted as a desktop container, and the object information displayed by the display device can be abstracted as an information film app in the container. Therefore, the results displayed by the large-screen display device can be abstracted. A combination of multiple display object apps.

由上可知，本申請提供的上述實施例中，控制設備從伺服器獲取顯示設備的顯示配置資訊，並根據顯示配置資訊繪製對應的操作介面，在用戶使用該操作介面進行相應的操作時，控制設備可以檢測到上述操作行為，從而產生對應的操作事件，此時伺服器會響應該操作事件，並基於 操作事件控制在顯示設備上執行與操作行為相同的操作。由此可知，控制設備一端可以抽象展示大屏的顯示設備中對應的顯示對象app的資訊展示給用戶，並接收用戶輸入的交互指令和控制指令，並轉化為伺服器系統可識別的操作事件的指令發送給伺服器server，進而伺服器server可以根據不同指令做相應邏輯處理，由於上述控制設備可以通過伺服器來實現，將控制設備本地的操作事件同步至對應的顯示設備上，實現了用戶可以通過控制設備靈活的對大螢幕的顯示設備的操作過程，降低了大螢幕顯示設備的展示資訊的交互靈活性。 It can be known from the above that in the above-mentioned embodiment provided by the present application, the control device obtains the display configuration information of the display device from the server, and draws a corresponding operation interface according to the display configuration information. The device can detect the above-mentioned operation behavior, thereby generating a corresponding operation event. At this time, the server will respond to the operation event, and control the display device to perform the same operation as the operation behavior based on the operation event. It can be known that the control device end can abstractly display the information of the corresponding display object app in the large-screen display device to the user, and receive the interactive instruction and control instruction input by the user, and convert it into an operation event that can be recognized by the server system. The instructions are sent to the server server, and the server server can then perform corresponding logic processing according to different instructions. Since the above control equipment can be implemented by the server, the local operation events of the control equipment are synchronized to the corresponding display equipment, which realizes that the user can By controlling the flexible operation of the display device of the large-screen display device, the interactive flexibility of the display information of the large-screen display device is reduced.

上述解決方案還進一步定義了一套操作事件的分發機制，使得各種控制設備都能接入顯示設備的系統，完成對展現內容的靈活控制。 The above solution further defines a set of operation event distribution mechanisms, so that various control devices can access the system of the display device, and complete flexible control of the displayed content.

一種可選實施例中，在步驟S24執行控制設備的操作介面檢測到操作行為，產生對應的操作事件之後，還可以執行如下實施步驟： In an optional embodiment, after the operation interface of the control device in step S24 detects an operation behavior and generates a corresponding operation event, the following implementation steps may be performed:

步驟S241，將操作事件發送給伺服器。 Step S241: Send the operation event to the server.

步驟S243，伺服器控制顯示設備上展示的顯示對象執行操作事件所對應的應用邏輯。 Step S243: The server controls the display logic displayed on the display device to execute application logic corresponding to the operation event.

由此可知，上述步驟S241和步驟S243所實現方案中，控制設備端可以將用戶的交互行為轉化為伺服器server端可識別的操作pointer事件發送給伺服器server，伺服器server運行對應的應用邏輯後，還可以更新app資訊，並廣播給控制設備，使得控制設備一端可以更新模擬的操作介 面中的控件(mock UI)。以上應用邏輯的判斷可以運行在伺服器server端，而操作事件(例如鼠標似乎)的觸發則由控制設備一端來實現，控制設備模擬得到的UI如圖8所示。 It can be known from the above that in the solutions implemented in steps S241 and S243, the control device can convert the user's interactive behavior into a recognizable operation pointer event on the server and send it to the server, and the server runs the corresponding application logic. Later, the app information can also be updated and broadcast to the control device, so that the control device can update the controls (mock UI) in the simulated operation interface. The judgment of the above application logic can be run on the server server side, and the triggering of operation events (such as the mouse seems) is realized by the control device side. The UI simulated by the control device is shown in FIG. 8.

較佳地，為了在控制設備一端實現靈活的交互控制，需要設計一套合理的事件分發系統。例如以顯示設備的操作系統為windows的情況下，控制設備可以實現模擬windows桌面的事件分發機制，定義的事件分發系統描述如下：將每個顯示對象app的類對應為windows系統的一個應用窗口，將伺服器server的類對應為windows系統，將來自控制設備一端的操作事件的控制命令的類對應為鼠標操作。 Preferably, in order to achieve flexible interactive control at the control device end, a reasonable event distribution system needs to be designed. For example, when the operating system of the display device is Windows, the control device can implement an event distribution mechanism that simulates the desktop of the Windows. The defined event distribution system is described as follows: the class of each display object app corresponds to an application window of the Windows system The class of the server server corresponds to the windows system, and the class of the control command from the operation event on the control device side corresponds to the mouse operation.

基於以上設計，抽象出以下事件消息： Based on the above design, the following event messages are abstracted:

pointerPress(point,button)模擬鼠標點下(button區分左右鍵) pointerPress (point, button) simulates a mouse click (button distinguishes left and right keys)

pointerRelease(point,button)模擬鼠標放開(button區分左右鍵) pointerRelease (point, button) simulates mouse release (button distinguishes left and right keys)

pointerMove(point)模擬鼠標移動 pointerMove (point) simulates mouse movement

pointerScroll(point,wheelDelta)模擬鼠標中鍵滾動，用於放大或縮小app。 pointerScroll (point, wheelDelta) simulates the middle mouse button scrolling and is used to zoom in or out of the app.

由此可知，上述執行操作事件所對應的應用邏輯至少可以包括如下幾種應用方式： It can be known that the application logic corresponding to the execution operation event can include at least the following application modes:

方式一：在操作事件為點擊事件的情況下，伺服器選擇顯示深度最高的顯示對象執行點擊事件。 Method 1: When the operation event is a click event, the server selects the display object with the highest display depth to perform the click event.

具體的，如圖9a所示，在檢測到點擊事件之後，從所有顯示對象中查找到被選中的且顯示深度最高的顯示對象，並對該對象執行點擊操作，從而實現從控制設備的顯示屏中選中要操作的對象，並將該對象的點擊指令進行保存或緩存selectdApp.prevPt=pointer。 Specifically, as shown in FIG. 9a, after a click event is detected, a selected display object with the highest display depth is found from all display objects, and a click operation is performed on the object to implement display from the control device. Select the object to be operated in the screen, and save or cache the click instruction of the object selectedApp.prevPt = pointer.

方式二：在操作事件為移動事件的情況下，伺服器對選中的顯示對象執行移動事件。 Method 2: When the operation event is a movement event, the server performs a movement event on the selected display object.

具體的，如圖9b所示，在檢測到移動事件之後，查找是否存在被選中的顯示對象，如果有，則將選中的顯示對象移動至目標位置，並保存該對象的移動指令，即對選中的需要執行移動的顯示對象的指針進行保存selectdApp.prevPt=pointer。 Specifically, as shown in FIG. 9b, after a movement event is detected, whether a selected display object exists is found, and if so, the selected display object is moved to a target position, and a movement instruction of the object is saved, that is, Save the selected pointer of the display object to be moved. SelectedApp.prevPt = pointer.

方式三：在操作事件為鼠標抬起事件、縮放事件或瀏覽事件的情況下，伺服器對選中的顯示對象執行縮放事件。 Method 3: When the operation event is a mouse-up event, a zoom event, or a browse event, the server performs a zoom event on the selected display object.

具體的，如圖9c所示，如果檢測到鼠標抬起事件，則放棄選中的顯示對象。另外，在檢測到縮放事件或瀏覽事件之後，查找是否存在被選中的顯示對象，如果有，則將選中的顯示對象進行縮放或瀏覽目標區域內的顯示對象，並保存該對象的指令。 Specifically, as shown in FIG. 9c, if a mouse up event is detected, the selected display object is discarded. In addition, after a zoom event or a browse event is detected, whether a selected display object exists is found, and if so, the selected display object is zoomed or browsed for a display object in a target area, and an instruction for the object is saved.

方式四：在操作事件為滾動事件的情況下，伺服器對瀏覽到的顯示對象執行滾動事件。 Method 4: When the operation event is a scroll event, the server performs a scroll event on the browsed display object.

具體的，如圖9d所示，在檢測到滾動之後，查找是否存在被選中的顯示對象，如果有，則將選中的顯示對象進 行滾動式的瀏覽，並保存該對象的滾動指令。 Specifically, as shown in FIG. 9d, after scrolling is detected, it is found whether there is a selected display object, and if there is, the selected display object is scroll-viewed, and a scroll instruction of the object is saved.

一種可選實施例中，在執行步驟S243伺服器控制顯示設備上展示的顯示對象執行操作事件所對應的應用邏輯之後，還可以實施如下步驟： In an optional embodiment, after executing step S243, the server controls the display logic displayed on the display device to execute the application logic corresponding to the operation event, and may further implement the following steps:

步驟S245，伺服器根據操作事件的執行結果更新對應的顯示對象的對象資訊，得到新的顯示配置資訊。 In step S245, the server updates the object information of the corresponding display object according to the execution result of the operation event to obtain new display configuration information.

步驟S246，伺服器將新的顯示配置資訊返回給控制設備，使得控制設備顯示新的操作介面。 In step S246, the server returns the new display configuration information to the control device, so that the control device displays a new operation interface.

一種可選實施例中，在步驟S20執行控制設備從伺服器獲取顯示設備的顯示配置資訊之前，還可以實施如下步驟：步驟S10，伺服器接收到控制設備發送的對象打開指令，其中，對象打開指令至少包括：待顯示對象的訪問地址；步驟S12，伺服器根據對象打開指令創建待顯示對象的對象資訊，其中，待顯示對象的對象資訊至少包括：待顯示對象的尺長、顯示深度和位置資訊；步驟S14，伺服器控制顯示設備顯示待顯示對象。 In an optional embodiment, before executing the control device to obtain the display configuration information of the display device from the server in step S20, the following steps may also be implemented: step S10, the server receives an object opening instruction sent by the control device, wherein the object is opened The instruction includes at least: the access address of the object to be displayed; step S12, the server creates the object information of the object to be displayed according to the object opening instruction, wherein the object information of the object to be displayed includes at least: the length, the display depth and the position of the object to be displayed Information; step S14, the server controls the display device to display the object to be displayed.

圖10是根據本發明實施例的控制設備的業務交互圖。結合圖10所示的實施例，對於如何打開一個新的資訊片app，處理流程如下： FIG. 10 is a service interaction diagram of a control device according to an embodiment of the present invention. With reference to the embodiment shown in FIG. 10, for how to open a new information piece app, the processing flow is as follows:

步驟90，控制設備一端接收到用戶輸入的待顯示對象的訪問地址，此處的訪問地址可以是網頁地址(webpage url)； 步驟92，控制設備發送對象打開指令給伺服器，進而打開顯示設備上的APP該指令攜帶了待顯示對象的訪問地址這個參數； 步驟94，伺服器根據該指令創建新的對象資訊，包括對象資訊所對應的顯示螢幕在大螢幕顯示設備上的位置和尺寸。 In step 90, the control device receives the access address of the object to be displayed input by the user. The access address here may be a webpage url. In step 92, the control device sends an object opening instruction to the server, and then opens the display device. The instruction of the APP carries the parameter of the access address of the object to be displayed. In step 94, the server creates new object information according to the instruction, including the position and size of the display screen corresponding to the object information on the large-screen display device.

步驟S96，伺服器發送上述創建的新的對象資訊至顯示設備，使得顯示設備獲取該對象資訊APP對應的DOM，從而在顯示設備的對應位置顯示該對象。 In step S96, the server sends the new object information created above to the display device, so that the display device obtains the DOM corresponding to the object information APP, thereby displaying the object at the corresponding position of the display device.

較佳地，上述步驟S14伺服器控制顯示設備顯示待顯示對象可以包括如下可選的實施方案： Preferably, in step S14, the server controlling the display device to display the object to be displayed may include the following optional implementations:

步驟S141，顯示設備從伺服器下載與待顯示對象相關的對象資訊. Step S141, the display device downloads object information related to the object to be displayed from the server.

步驟S143，顯示設備產生與待顯示對象對應的DOM資料。 In step S143, the display device generates DOM data corresponding to the object to be displayed.

步驟S145，顯示設備按照任意一個或多個顯示螢幕的螢幕資訊加載並顯示DOM資料。 In step S145, the display device loads and displays the DOM data according to the screen information of any one or more display screens.

由上分析可知，上述步驟S141至步驟S145所提供的實施方案中，在大螢幕的顯示設備中實現顯示螢幕中的螢幕資訊需要包括如下幾個關鍵點：首先，每個顯示螢幕screen都會將所有運行的app相關的class定義文件(js文件)下載下來，並在當前運行環境產生app instance；每個app instance實際對應的是一個dom節點，所以app instance產生之後實際上掛在到相應的dom上，以此實現最終的視覺 呈現。app的定義文件本質上是一個reactjs組件的定義，而reactjs組件可以很方便的mount到一個dom上每個screen都有其標識，比如標示id為(i,j)的screen，會將容器內的所有app都做一定偏移，實現手段是對app的容器dom進行translate(offsetX,offsetY)，其中offsetX=(1400 * i+app.x),offsetY=(1050 * j+app.y)。 From the above analysis, it can be known that in the implementation provided by the above steps S141 to S145, the realization of the screen information in the display screen in the display device of the large screen needs to include the following key points: First, each display screen The class definition file (js file) related to the running app is downloaded and an app instance is generated in the current running environment; each app instance actually corresponds to a dom node, so the app instance is actually hung on the corresponding dom after it is generated To achieve the final visual presentation. The definition file of the app is essentially a definition of a reactjs component, and the reactjs component can be easily mounted on a dom. Each screen has its own identifier. For example, the screen with the id (i, j) will mark the contents of the container. All apps have a certain offset. The implementation method is to translate (offsetX, offsetY) the app's container dom, where offsetX = (1400 * i + app.x), offsetY = (1050 * j + app.y).

圖11是根據本發明的實施例的控制設備與伺服器交互的流程示意圖。下面基於圖11所示的實施例對本發明的控制設備一端與伺服器server的資料流程的核心方案進行詳細描述如下： FIG. 11 is a schematic flowchart of interaction between a control device and a server according to an embodiment of the present invention. Based on the embodiment shown in FIG. 11, the core solution of the data flow of the control device and the server of the present invention is described in detail as follows:

步驟S101，控制設備向伺服器server請求獲知系統的桌面配置(大屏的總長寬)，以及所有app的資訊，包括app的位置，長寬，以及z-index，當app位置有重疊的時候表徵誰在更上層。 Step S101: The control device requests the server server for the desktop configuration of the system (the total length and width of the large screen) and information of all apps, including the position, length, width, and z-index of the app. Who is higher.

步驟S103，根據以上資訊繪製一個mock的桌面和app圖，提示用戶當前的佈局情況，以及收集用戶的交互事件，行動端用hammer.js庫收集用戶手勢操作。 Step S103, draw a mock desktop and app map according to the above information, prompt the user's current layout situation, and collect user interaction events. The mobile terminal uses the hammer.js library to collect user gesture operations.

步驟S105，用戶通過移動和縮放app來控制系統。 In step S105, the user controls the system by moving and zooming the app.

步驟S107，控制端將用戶的交互行為轉化為server端可識別的pointer事件發送給server。 Step S107: The control end converts the user's interactive behavior into a pointer event that can be recognized by the server and sends it to the server.

步驟S109，伺服器server運行對應邏輯後，更新對象app資訊，並廣播給控制設備一端。 Step S109: After the server runs the corresponding logic, it updates the target app information and broadcasts it to the control device.

步驟S111，控制設備一端更新虛擬的控件對象mock UI。 Step S111: The control device updates the virtual control object mock UI at one end.

由此可知，通過本發明提供的設計方案，至少可以解決傳統方案中遇到至少如下兩個問題： It can be seen that at least the following two problems encountered in the traditional solution can be solved through the design solution provided by the present invention:

不用遠程登錄信號PC，直接在控制端打開希望呈現的web page。 Instead of remotely signing in to the PC, open the desired web page directly on the console.

不需要專業IT的介入，脫離大屏硬體廠商的限制，直接在iPad上方便的擺放web page在大屏上的位置和尺寸。 There is no need for professional IT to get involved, and it is easy to place the position and size of the web page on the big screen directly on the iPad without the restrictions of the big screen hardware manufacturers.

同時，不僅僅上述的兩種控制問題得以解決，我們通過寫簡單的腳本，還能獲得很多傳統方案無法實現的功能，比如控制app從大屏右側滑入，左側劃出，以及滑入滑出的時間和變化的快慢都可以精確控制。這些都在情報三期項目中得到較好的應用。 At the same time, not only the above two control problems are solved, we can obtain many functions that cannot be achieved by traditional solutions by writing simple scripts, such as controlling the app to slide in from the right side of the big screen, draw out on the left, and slide in and out The time and speed of change can be precisely controlled. These have been better applied in the third phase of the intelligence project.

需要說明的是，對於前述的各方法實施例，為了簡單描述，故將其都表述為一系列的動作組合，但是本領域技術人員應該知悉，本發明並不受所描述的動作順序的限制，因為依據本發明，某些步驟可以採用其他順序或者同時進行。其次，本領域技術人員也應該知悉，說明書中所描述的實施例均屬於較佳實施例，所涉及的動作和模組並不一定是本發明所必須的。 It should be noted that, for the foregoing method embodiments, for simplicity of description, they are all described as a series of action combinations, but those skilled in the art should know that the present invention is not limited by the described action order. Because according to the present invention, certain steps may be performed in another order or simultaneously. Secondly, those skilled in the art should also know that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily required by the present invention.

通過以上的實施方式的描述，本領域的技術人員可以清楚地瞭解到根據上述實施例的方法可藉助軟體加必需的通用硬體平臺的方式來實現，當然也可以通過硬體，但很多情況下前者是更佳的實施方式。基於這樣的理解，本發明的技術方案本質上或者說對現有技術做出貢獻的部分可以以軟體產品的形式體現出來，該電腦軟體產品儲存在一 個儲存媒介(如ROM/RAM、磁碟、光碟)中，包括若干指令用以使得一台終端設備(可以是手機，電腦，伺服器，或者網路設備等)執行本發明各個實施例所述的方法。 Through the description of the above embodiments, those skilled in the art can clearly understand that the method according to the above embodiments can be implemented by means of software plus a necessary universal hardware platform. Of course, it can also be implemented by hardware, but in many cases The former is a better implementation. Based on such an understanding, the technical solution of the present invention, in essence, or a part that contributes to the existing technology, can be embodied in the form of a software product. The computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk). ) Includes several instructions for causing a terminal device (which may be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods described in the embodiments of the present invention.

實施例3 Example 3

同樣基於圖4所示的運行環境下，本申請提供了如圖12所示的顯示資料的控制方法。圖12是根據本發明實施例一的顯示資料的控制方法的流程圖。 Also based on the operating environment shown in FIG. 4, the present application provides a method for controlling display data as shown in FIG. 12. FIG. 12 is a flowchart of a method for controlling display data according to the first embodiment of the present invention.

如圖12所示，該顯示資料的控制方法可以包括如下實施步驟：步驟S121，伺服器獲取顯示設備的顯示配置資訊，其中，顯示配置資訊包括：顯示設備的桌面資訊以及顯示設備所包括的每個顯示螢幕展示的顯示對象的對象資訊；步驟123，伺服器根據控制設備在操作介面上檢測到的操作行為產生對應的操作事件，其中，操作介面為控制設備根據顯示配置資訊繪製，操作介面包括：與桌面資訊對應的模擬桌面和與顯示對象對應的模擬對象；步驟125，伺服器根據操作事件控制在顯示設備上執行與操作行為相同的操作。 As shown in FIG. 12, the method for controlling display data may include the following implementation steps: Step S121: The server obtains display configuration information of the display device, where the display configuration information includes: desktop information of the display device and each of the information included in the display device. Object information of the display object displayed on each display screen; step 123, the server generates a corresponding operation event according to the operation behavior detected by the control device on the operation interface, wherein the operation interface is drawn by the control device according to the display configuration information, and the operation interface includes : A simulated desktop corresponding to the desktop information and a simulated object corresponding to the display object; step 125, the server controls the display device to perform the same operation as the operation behavior according to the operation event.

由上可知，本申請提供的上述實施例中，控制設備從伺服器獲取顯示設備的顯示配置資訊，並根據顯示配置資訊繪製對應的操作介面，在用戶使用該操作介面進行相應的操作時，控制設備可以檢測到上述操作行為，從而產生 對應的操作事件，此時伺服器會響應該操作事件，並基於操作事件控制在顯示設備上執行與操作行為相同的操作。由此可知，控制設備一端可以抽象展示大屏的顯示設備中對應的顯示對象app的資訊展示給用戶，並接收用戶輸入的交互指令和控制指令，並轉化為伺服器系統可識別的操作事件的指令發送給伺服器server，進而伺服器server可以根據不同指令做相應邏輯處理，由於上述控制設備可以通過伺服器來實現，將控制設備本地的操作事件同步至對應的顯示設備上，實現了用戶可以通過控制設備靈活的對大螢幕的顯示設備的操作過程，降低了大螢幕顯示設備的展示資訊的交互靈活性。 As can be seen from the above, in the above-mentioned embodiment provided by the present application, the control device obtains the display configuration information of the display device from the server, and draws a corresponding operation interface according to the display configuration information. When the user uses the operation interface to perform corresponding operations, the control The device can detect the above-mentioned operation behavior, thereby generating a corresponding operation event. At this time, the server will respond to the operation event, and control the display device to perform the same operation as the operation behavior based on the operation event. It can be known that the control device end can abstractly display the information of the corresponding display object app in the large-screen display device to the user, and receive the interactive instruction and control instruction input by the user, and convert it into an operation event that can be recognized by the server system. The instructions are sent to the server server, and the server server can then perform corresponding logic processing according to different instructions. Since the above control equipment can be implemented by the server, the local operation events of the control equipment are synchronized to the corresponding display equipment, which realizes that the user can By controlling the flexible operation of the display device of the large-screen display device, the interactive flexibility of the display information of the large-screen display device is reduced.

上述解決方案還進一步定義了一套操作事件的分發機制，使得各種控制設備都能接入顯示設備的系統，完成對展現內容的靈活控制。 The above solution further defines a set of operation event distribution mechanisms, so that various control devices can access the system of the display device, and complete flexible control of the displayed content.

本申請實施例3從伺服器一側來保護本發明的核心，該實施例還可以提供與上述實施例2提供的具有相同或相應的可選或較佳的實施例，所實現的實例和應用場景相同，但不限於上述實施例二所揭露的內容。 Embodiment 3 of the present application protects the core of the present invention from the server side. This embodiment can also provide the same or corresponding optional or preferred embodiments, implemented examples, and applications as those provided in the above Embodiment 2. The scenarios are the same, but are not limited to the content disclosed in the second embodiment.

實施例4 Example 4

根據本發明實施例，還提供了一種用於實施上述顯示資料的控制方法的顯示資料的控制裝置，圖13是根據本發明實施例的顯示資料的控制裝置的示意圖。如圖13所示，該裝置可以包括：獲取模組130、繪製模組133和產生模組 135。 According to an embodiment of the present invention, there is also provided a display data control device for implementing the above-mentioned control method of display data. FIG. 13 is a schematic diagram of a display data control device according to an embodiment of the present invention. As shown in FIG. 13, the device may include an obtaining module 130, a drawing module 133, and a generating module 135.

其中，獲取模組130，用於從伺服器獲取顯示設備的顯示配置資訊，其中，顯示配置資訊包括：顯示設備的桌面資訊以及顯示設備所包括的每個顯示螢幕展示的顯示對象的對象資訊；繪製模組133，用於根據顯示配置資訊繪製對應的操作介面，其中，操作介面包括：與桌面資訊對應的模擬桌面和與顯示對象對應的模擬對象；產生模組135，用於如果操作介面檢測到操作行為，產生對應的操作事件，其中，操作事件用於控制在顯示設備上執行與操作行為相同的操作。 The obtaining module 130 is configured to obtain display configuration information of a display device from a server, where the display configuration information includes: desktop information of the display device and object information of a display object displayed on each display screen included in the display device; The drawing module 133 is used to draw a corresponding operation interface according to the display configuration information. The operation interface includes: a simulated desktop corresponding to the desktop information and a simulated object corresponding to the display object; and a generating module 135 is used to detect if the operation interface To the operation behavior, a corresponding operation event is generated, where the operation event is used to control a display device to perform the same operation as the operation behavior.

此處需要說明的是，上述獲取模組130、繪製模組133和產生模組135對應於實施例2中的步驟S20至步驟S24，三個模組與對應的步驟所實現的實例和應用場景相同，但不限於上述實施例一所揭露的內容。需要說明的是，上述模組作為裝置的一部分可以運行在實施例二提供的電腦終端10中。 What needs to be explained here is that the above-mentioned acquisition module 130, drawing module 133, and generation module 135 correspond to steps S20 to S24 in Embodiment 2. Examples and application scenarios implemented by the three modules and corresponding steps The same, but not limited to the content disclosed in the first embodiment. It should be noted that, as a part of the device, the above module can be run in the computer terminal 10 provided in the second embodiment.

本發明實施例4還可以提供對應於上述實施例1提供的可選或較佳實施例，所實現的實例和應用場景相同，但不限於上述實施例一所揭露的內容。 Embodiment 4 of the present invention may also provide an optional or preferred embodiment corresponding to the foregoing Embodiment 1, and the implemented examples and application scenarios are the same, but are not limited to the content disclosed in the foregoing Embodiment 1.

實施例5 Example 5

本發明的實施例可以提供一種控制設備，該控制設備可以是電腦終端群中的任意一個控制設備。可選地，在本 實施例中，上述控制設備也可以替換為行動終端等終端設備。 An embodiment of the present invention may provide a control device, and the control device may be any control device in a computer terminal group. Optionally, in this embodiment, the foregoing control device may also be replaced with a terminal device such as a mobile terminal.

可選地，在本實施例中，上述控制設備可以位於電腦網路的多個網路設備中的至少一個網路設備。 Optionally, in this embodiment, the control device may be located in at least one network device among a plurality of network devices in a computer network.

在本實施例中，上述電腦終端可以執行應用程式的漏洞檢測方法中以下步驟的程式代碼：控制設備從伺服器獲取顯示設備的顯示配置資訊，其中，顯示配置資訊包括：顯示設備的桌面資訊以及顯示設備所包括的每個顯示螢幕展示的顯示對象的對象資訊；控制設備根據顯示配置資訊繪製對應的操作介面，其中，操作介面包括：與桌面資訊對應的模擬桌面和與顯示對象對應的模擬對象；控制設備的操作介面檢測到操作行為，產生對應的操作事件，其中，操作事件用於控制在顯示設備上執行與操作行為相同的操作。 In this embodiment, the computer terminal may execute the program code of the following steps in the vulnerability detection method of the application program: the control device obtains display configuration information of the display device from the server, wherein the display configuration information includes: desktop information of the display device and The display device displays object information of each display screen included in the display device. The control device draws a corresponding operation interface according to the display configuration information. The operation interface includes: a simulated desktop corresponding to the desktop information and a simulated object corresponding to the display object. ; The operation interface of the control device detects an operation behavior and generates a corresponding operation event, wherein the operation event is used to control the display device to perform the same operation as the operation behavior.

可選地，圖14是根據本發明實施例的一種控制設備的結構方塊圖。如圖14所示，該控制設備14可以包括：一個或多個(圖中僅示出一個)處理器、儲存器、以及其他必要裝置。 Optionally, FIG. 14 is a structural block diagram of a control device according to an embodiment of the present invention. As shown in FIG. 14, the control device 14 may include one or more processors (only one is shown in the figure), a memory, and other necessary devices.

其中，儲存器可用於儲存軟體程式以及模組，如本發明實施例中的安全漏洞檢測方法和裝置對應的程式指令/模組，處理器通過運行儲存在儲存器內的軟體程式以及模組，從而執行各種功能應用以及資料處理，即實現上述的系統漏洞攻擊的檢測方法。儲存器可包括高速隨機儲存器，還可以包括非易失性儲存器，如一個或者多個磁性儲 存裝置、閃存、或者其他非易失性固態儲存器。在一些實例中，儲存器可進一步包括相對于處理器遠程設置的儲存器，這些遠程儲存器可以通過網路連接至終端14。上述網路的實例包括但不限於網際網路、企業內部網、區域網路、行動通信網及其組合。 The memory can be used to store software programs and modules, such as the program instructions / modules corresponding to the security vulnerability detection method and device in the embodiments of the present invention. The processor runs the software programs and modules stored in the memory. Therefore, various functional applications and data processing are performed, that is, the above-mentioned detection method of system vulnerability attacks is implemented. The storage may include high-speed random storage, and may also include non-volatile storage, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state storage. In some examples, the memory may further include a memory remotely disposed with respect to the processor, and these remote memories may be connected to the terminal 14 through a network. Examples of the above network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

處理器可以通過傳輸裝置調用儲存器儲存的資訊及應用程式，以執行下述步驟：控制設備從伺服器獲取顯示設備的顯示配置資訊，其中，顯示配置資訊包括：顯示設備的桌面資訊以及顯示設備所包括的每個顯示螢幕展示的顯示對象的對象資訊；控制設備根據顯示配置資訊繪製對應的操作介面，其中，操作介面包括：與桌面資訊對應的模擬桌面和與顯示對象對應的模擬對象；控制設備的操作介面檢測到操作行為，產生對應的操作事件，其中，操作事件用於控制在顯示設備上執行與操作行為相同的操作。 The processor can call the information and application stored in the storage through the transmission device to perform the following steps: the control device obtains the display configuration information of the display device from the server, wherein the display configuration information includes: desktop information of the display device and the display device Each display screen includes object information of a display object; the control device draws a corresponding operation interface according to the display configuration information, wherein the operation interface includes: a simulated desktop corresponding to the desktop information and a simulated object corresponding to the display object; control The operation interface of the device detects an operation behavior and generates a corresponding operation event, where the operation event is used to control a display device to perform the same operation as the operation behavior.

可選的，上述處理器還可以執行如下步驟的程式代碼：將操作事件發送給伺服器；伺服器控制顯示設備上展示的顯示對象執行操作事件所對應的應用邏輯，其中，在操作事件為點擊事件的情況下，伺服器選擇顯示深度最高的顯示對象執行點擊事件；在操作事件為移動事件的情況下，伺服器對選中的顯示對象執行移動事件；在操作事件為縮放事件的情況下，伺服器對選中的顯示對象執行縮放事件；在操作事件為滾動事件的情況下，伺服器對瀏覽到的顯示對象執行滾動事件。 Optionally, the processor may further execute the program code of the following steps: sending an operation event to the server; the server controlling the display logic displayed on the display device to execute the application logic corresponding to the operation event, where the operation event is a click In the event of an event, the server selects the display object with the highest display depth to perform the click event. When the operation event is a movement event, the server performs a movement event on the selected display object. In the case of the operation event being a zoom event, The server performs a zoom event on the selected display object; when the operation event is a scroll event, the server performs a scroll event on the browsed display object.

可選的，上述處理器還可以執行如下步驟的程式代 碼：伺服器根據操作事件的執行結果更新對應的顯示對象的對象資訊，得到新的顯示配置資訊；伺服器將新的顯示配置資訊返回給控制設備，使得控制設備顯示新的操作介面。 Optionally, the processor may further execute the program code of the following steps: the server updates the object information of the corresponding display object according to the execution result of the operation event to obtain new display configuration information; the server returns the new display configuration information to Control the device so that the control device displays a new operating interface.

可選的，上述處理器還可以執行如下步驟的程式代碼：伺服器接收到控制設備發送的對象打開指令，其中，對象打開指令至少包括：待顯示對象的訪問地址；伺服器根據對象打開指令創建待顯示對象的對象資訊，其中，待顯示對象的對象資訊至少包括：待顯示對象的尺長、顯示深度和位置資訊；伺服器控制顯示設備顯示待顯示對象。 Optionally, the processor may further execute the program code of the following steps: the server receives the object opening instruction sent by the control device, wherein the object opening instruction includes at least: the access address of the object to be displayed; the server creates the object according to the object opening instruction The object information of the object to be displayed, wherein the object information of the object to be displayed includes at least: the length, the display depth, and the position information of the object to be displayed; the server controls the display device to display the object to be displayed.

可選的，上述處理器還可以執行如下步驟的程式代碼：顯示設備從伺服器下載與待顯示對象相關的對象資訊；顯示設備產生與待顯示對象對應的DOM資料；顯示設備按照任意一個或多個顯示螢幕的螢幕資訊加載並顯示DOM資料。 Optionally, the processor may further execute the program code of the following steps: the display device downloads object information related to the object to be displayed from the server; the display device generates DOM data corresponding to the object to be displayed; the display device is based on any one or more The screen information of each display screen loads and displays DOM data.

採用本發明實施例，提供了一種顯示資料的控制方案。通過控制設備從伺服器獲取顯示設備的顯示配置資訊，並根據顯示配置資訊繪製對應的操作介面，在用戶使用該操作介面進行相應的操作時，控制設備可以檢測到上述操作行為，從而產生對應的操作事件，此時伺服器會響應該操作事件，並基於操作事件控制在顯示設備上執行與操作行為相同的操作，從而達到了用戶可以通過控制設備靈活的對大螢幕的顯示設備的操作過程，達到了降低大螢幕顯示設備的展示資訊的交互靈活性的目的，進而解決了 現有技術中採用大顯示屏展示資料內容時，展示資訊的交互過程不靈活的技術問題。 Using the embodiment of the present invention, a control scheme for displaying data is provided. The control device obtains the display configuration information of the display device from the server, and draws the corresponding operation interface according to the display configuration information. When the user uses the operation interface to perform the corresponding operation, the control device can detect the above operation behavior, thereby generating a corresponding Operation event. At this time, the server will respond to the operation event and control the display device to perform the same operation as the operation behavior based on the operation event, so that the user can flexibly operate the large-screen display device through the control device. The purpose of reducing the interactive flexibility of the display information of the large-screen display device is achieved, and the technical problem of the inflexible interactive process of the display information when the large-screen display information is used in the prior art is solved.

本領域普通技術人員可以理解，圖14所示的結構僅為示意，電腦終端也可以是智能手機(如Android手機、iOS手機等)、平板電腦、掌聲電腦以及行動網際網路設備(Mobile Internet Devices，MID)、PAD等終端設備。圖10其並不對上述電子裝置的結構造成限定。例如，電腦終端10還可包括比圖10中所示更多或者更少的組件(如網路介面、顯示裝置等)，或者具有與圖10所示不同的配置。 Those of ordinary skill in the art can understand that the structure shown in FIG. 14 is only a schematic, and the computer terminal may also be a smart phone (such as an Android phone, an iOS phone, etc.), a tablet computer, an applause computer, and a mobile Internet device (Mobile Internet Devices). , MID), PAD and other terminal equipment. FIG. 10 does not limit the structure of the electronic device. For example, the computer terminal 10 may further include more or less components (such as a network interface, a display device, etc.) than those shown in FIG. 10, or have a different configuration from that shown in FIG. 10.

本領域普通技術人員可以理解上述實施例的各種方法中的全部或部分步驟是可以通過程式來指令終端設備相關的硬體來完成，該程式可以儲存於一電腦可讀儲存媒介中，儲存媒介可以包括：閃存盤、只讀儲存器(Read-Only Memory，ROM)、隨機存取器(Random Access Memory，RAM)、磁盤或光碟等。 Those of ordinary skill in the art can understand that all or part of the steps in the various methods of the above embodiments can be completed by a program instructing the hardware related to the terminal device. The program can be stored in a computer-readable storage medium, and the storage medium can Including: flash disk, read-only memory (ROM), random access memory (RAM), magnetic disk or optical disk, etc.

實施例5 Example 5

本發明的實施例還提供了一種儲存媒介。可選地，在本實施例中，上述儲存媒介可以用於保存上述實施例一所提供的顯示資料的控制方法所執行的程式代碼。 An embodiment of the present invention also provides a storage medium. Optionally, in this embodiment, the storage medium may be used to store program code executed by the control method of display data provided in the first embodiment.

可選地，在本實施例中，上述儲存媒介可以位於電腦網路中電腦終端群中的任意一個電腦終端中，或者位於行動終端群中的任意一個行動終端中。 Optionally, in this embodiment, the storage medium may be located in any computer terminal in a computer terminal group in a computer network, or in any mobile terminal in a mobile terminal group.

可選地，在本實施例中，儲存媒介被設置為儲存用於 執行以下步驟的程式代碼：控制設備從伺服器獲取顯示設備的顯示配置資訊，其中，顯示配置資訊包括：顯示設備的桌面資訊以及顯示設備所包括的每個顯示螢幕展示的顯示對象的對象資訊；控制設備根據顯示配置資訊繪製對應的操作介面，其中，操作介面包括：與桌面資訊對應的模擬桌面和與顯示對象對應的模擬對象；控制設備的操作介面檢測到操作行為，產生對應的操作事件，其中，操作事件用於控制在顯示設備上執行與操作行為相同的操作。 Optionally, in this embodiment, the storage medium is configured to store program code for performing the following steps: the control device obtains the display configuration information of the display device from the server, wherein the display configuration information includes: desktop information of the display device And the object information of the display object displayed on each display screen included in the display device; the control device draws a corresponding operation interface according to the display configuration information, wherein the operation interface includes: a simulation desktop corresponding to the desktop information and a simulation corresponding to the display object Object; the operation interface of the control device detects an operation behavior and generates a corresponding operation event, where the operation event is used to control the display device to perform the same operation as the operation behavior.

可選地，在本實施例中，儲存媒介被設置為儲存用於執行以下步驟的程式代碼： Optionally, in this embodiment, the storage medium is configured to store program code for performing the following steps:

可選地，在本實施例中，儲存媒介被設置為儲存用於執行以下步驟的程式代碼：伺服器根據操作事件的執行結果更新對應的顯示對象的對象資訊，得到新的顯示配置資訊；伺服器將新的顯示配置資訊返回給控制設備，使得控制設備顯示新的操作介面。 Optionally, in this embodiment, the storage medium is configured to store program code for performing the following steps: the server updates the object information of the corresponding display object according to the execution result of the operation event to obtain new display configuration information; the server The controller returns the new display configuration information to the control device, so that the control device displays a new operation interface.

可選地，在本實施例中，儲存媒介被設置為儲存用於執行以下步驟的程式代碼：伺服器接收到控制設備發送的對象打開指令，其中，對象打開指令至少包括：待顯示對象的訪問地址；伺服器根據對象打開指令創建待顯示對象的對象資訊，其中，待顯示對象的對象資訊至少包括：待顯示對象的尺長、顯示深度和位置資訊；伺服器控制顯示設備顯示待顯示對象。 Optionally, in this embodiment, the storage medium is configured to store program code for performing the following steps: the server receives an object opening instruction sent by the control device, wherein the object opening instruction includes at least: access to the object to be displayed Address; the server creates object information of the object to be displayed according to the object opening instruction, wherein the object information of the object to be displayed at least includes: the length, depth, and position information of the object to be displayed; the server controls the display device to display the object to be displayed.

可選地，在本實施例中，儲存媒介被設置為儲存用於執行以下步驟的程式代碼：顯示設備從伺服器下載與待顯 示對象相關的對象資訊；顯示設備產生與待顯示對象對應的DOM資料；顯示設備按照任意一個或多個顯示螢幕的螢幕資訊加載並顯示DOM資料。 Optionally, in this embodiment, the storage medium is configured to store program code for performing the following steps: the display device downloads object information related to the object to be displayed from the server; the display device generates a DOM corresponding to the object to be displayed Data; the display device loads and displays DOM data according to the screen information of any one or more display screens.

上述本發明實施例序號僅僅為了描述，不代表實施例的優劣。 The sequence numbers of the foregoing embodiments of the present invention are only for description, and do not represent the superiority or inferiority of the embodiments.

在本發明的上述實施例中，對各個實施例的描述都各有側重，某個實施例中沒有詳述的部分，可以參見其他實施例的相關描述。 In the above embodiments of the present invention, the description of each embodiment has its own emphasis. For a part that is not described in detail in an embodiment, reference may be made to the description of other embodiments.

在本申請所提供的幾個實施例中，應該理解到，所揭露的技術內容，可通過其它的方式實現。其中，以上所描述的裝置實施例僅僅是示意性的，例如所述單元的劃分，僅僅為一種邏輯功能劃分，實際實現時可以有另外的劃分方式，例如多個單元或組件可以結合或者可以整合到另一個系統，或一些特徵可以忽略，或不執行。另一點，所顯示或討論的相互之間的耦合或直接耦合或通信連接可以是通過一些介面，單元或模組的間接耦合或通信連接，可以是電性或其它的形式。 In the several embodiments provided in this application, it should be understood that the disclosed technical content can be implemented in other ways. The device embodiments described above are only schematic. For example, the division of the unit is only a logical function division. In actual implementation, there may be another division manner. For example, multiple units or components may be combined or integrated. To another system, or some features can be ignored or not implemented. In addition, the displayed or discussed mutual coupling or direct coupling or communication connection may be indirect coupling or communication connection through some interfaces, units or modules, and may be electrical or other forms.

所述作為分離元件說明的單元可以是或者也可以不是物理上分開的，作為單元顯示的元件可以是或者也可以不是物理單元，即可以位於一個地方，或者也可以分佈到多個網路單元上。可以根據實際的需要選擇其中的部分或者全部單元來實現本實施例方案的目的。 The unit described as a separate element may or may not be physically separated, and the element displayed as a unit may or may not be a physical unit, which may be located in one place, or may be distributed on multiple network units . Some or all of the units may be selected according to actual needs to achieve the objective of the solution of this embodiment.

另外，在本發明各個實施例中的各功能單元可以整合在一個處理單元中，也可以是各個單元單獨物理存在，也 可以兩個或兩個以上單元整合在一個單元中。上述整合的單元既可以採用硬體的形式實現，也可以採用軟體功能單元的形式實現。 In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist separately physically, or two or more units may be integrated into one unit. The above integrated unit may be implemented in the form of hardware or in the form of software functional unit.

所述整合的單元如果以軟體功能單元的形式實現並作為獨立的產品銷售或使用時，可以儲存在一個電腦可讀取儲存媒介中。基於這樣的理解，本發明的技術方案本質上或者說對現有技術做出貢獻的部分或者該技術方案的全部或部分可以以軟體產品的形式體現出來，該電腦軟體產品儲存在一個儲存媒介中，包括若干指令用以使得一台電腦設備(可為個人電腦、伺服器或者網路設備等)執行本發明各個實施例所述方法的全部或部分步驟。而前述的儲存媒介包括：隨身碟、只讀儲存器(ROM，Read-Only Memory)、隨機存取儲存器(RAM，Random Access Memory)、行動硬盤、磁碟或者光碟等各種可以儲存程式代碼的媒介。 When the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention essentially or part that contributes to the existing technology or all or part of the technical solution can be embodied in the form of a software product, which is stored in a storage medium, It includes several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in the embodiments of the present invention. The foregoing storage media include: various types of programs that can store program codes, such as flash drives, Read-Only Memory (ROM), Random Access Memory (RAM), mobile hard disks, magnetic disks, or optical disks. medium.

以上所述僅是本發明的較佳實施方式，應當指出，對於本技術領域的普通技術人員來說，在不脫離本發明原理的前提下，還可以做出若干改進和潤飾，這些改進和潤飾也應視為本發明的保護範圍。 The above is only a preferred embodiment of the present invention. It should be noted that for those of ordinary skill in the art, without departing from the principles of the present invention, there can be several improvements and retouches. These improvements and retouches It should also be regarded as the protection scope of the present invention.

Claims (12)

一種顯示資料的控制系統，包括：顯示設備，包括多個顯示螢幕，每個顯示螢幕用於顯示頁面內容；伺服器，與所述顯示設備連接，用於保存與所述頁面內容關聯的顯示配置資訊，其中，所述顯示配置資訊包括：所述顯示設備的桌面資訊以及所述顯示設備所包括的每個顯示螢幕展示的顯示對象的對象資訊；控制設備，與所述伺服器連接，用於根據獲取到的所述顯示配置資訊繪製對應的操作介面，並在檢測到操作行為，產生對應的操作事件，其中，所述操作介面包括：與所述桌面資訊對應的模擬桌面和與所述顯示對象對應的模擬對象；其中，所述伺服器還用於接收所述操作事件，並根據所述操作事件控制在所述顯示設備上執行與所述操作行為相同的操作。     A control system for displaying data includes: a display device including a plurality of display screens, each of which is used to display page content; and a server connected to the display device and used to save a display configuration associated with the page content Information, wherein the display configuration information includes: desktop information of the display device and object information of a display object displayed on each display screen included in the display device; and a control device, which is connected to the server and configured to: Draw a corresponding operation interface according to the obtained display configuration information, and generate a corresponding operation event upon detecting an operation behavior, wherein the operation interface includes: a simulated desktop corresponding to the desktop information and a display corresponding to the display A simulation object corresponding to the object; wherein the server is further configured to receive the operation event, and control the display device to perform the same operation as the operation behavior according to the operation event.     根據請求項1所述的方法，其中，所述桌面資訊至少包括：所述顯示設備的桌面尺寸；所述顯示對象的對象資訊至少包括：所述顯示對象的尺寸、位於所述顯示設備中的位置資訊、顯示內容和顯示深度。     The method according to claim 1, wherein the desktop information includes at least: a desktop size of the display device; the object information of the display object includes at least: a size of the display object, and a size of the display object. Location information, display content, and display depth.     根據請求項2所述的方法，其中，所述操作事件包括 如下至少之一：點擊事件、縮放事件、移動事件和滾動事件。     The method according to claim 2, wherein the operation event includes at least one of the following: a click event, a zoom event, a movement event, and a scroll event.     一種顯示資料的控制方法，包括：控制設備從伺服器獲取顯示設備的顯示配置資訊，其中，所述顯示配置資訊包括：所述顯示設備的桌面資訊以及所述顯示設備所包括的每個顯示螢幕展示的顯示對象的對象資訊；所述控制設備根據所述顯示配置資訊繪製對應的操作介面，其中，所述操作介面包括：與所述桌面資訊對應的模擬桌面和與所述顯示對象對應的模擬對象；所述控制設備的操作介面檢測到操作行為，產生對應的操作事件，其中，所述操作事件用於控制在所述顯示設備上執行與所述操作行為相同的操作。     A method for controlling display data includes: a control device obtaining display configuration information of a display device from a server, wherein the display configuration information includes: desktop information of the display device and each display screen included in the display device Object information of a displayed display object; the control device draws a corresponding operation interface according to the display configuration information, wherein the operation interface includes: a simulation desktop corresponding to the desktop information and a simulation corresponding to the display object Object; the operation interface of the control device detects an operation behavior, and generates a corresponding operation event, wherein the operation event is used to control the display device to perform the same operation as the operation behavior.     根據請求項4所述的方法，其中，所述桌面資訊至少包括：所述顯示設備的桌面尺寸；所述顯示對象的對象資訊至少包括：所述顯示對象的尺寸、位於所述顯示設備中的位置資訊、顯示內容和顯示深度。     The method according to claim 4, wherein the desktop information includes at least: a desktop size of the display device; the object information of the display object includes at least: a size of the display object, and a size of the display object. Location information, display content, and display depth.     根據請求項5所述的方法，其中，所述操作事件包括如下至少之一：點擊事件、縮放事件、移動事件和滾動事件。     The method according to claim 5, wherein the operation event includes at least one of the following: a click event, a zoom event, a movement event, and a scroll event.     根據請求項6所述的方法，其中，在所述控制設備的操作介面檢測到操作行為，產生對應的操作事件之後，所述方法還包括：將所述操作事件發送給所述伺服器；所述伺服器控制所述顯示設備上展示的顯示對象執行所述操作事件所對應的應用邏輯，其中，在所述操作事件為所述點擊事件的情況下，所述伺服器選擇顯示深度最高的顯示對象執行所述點擊事件；在所述操作事件為所述移動事件的情況下，所述伺服器對選中的顯示對象執行所述移動事件；在所述操作事件為所述縮放事件的情況下，所述伺服器對選中的顯示對象執行所述縮放事件；在所述操作事件為所述滾動事件的情況下，所述伺服器對瀏覽到的顯示對象執行所述滾動事件。     The method according to claim 6, wherein after the operation interface of the control device detects an operation behavior and generates a corresponding operation event, the method further includes: sending the operation event to the server; The server controls a display object displayed on the display device to execute application logic corresponding to the operation event, and in a case where the operation event is the click event, the server selects a display with the highest display depth The object executes the click event; when the operation event is the movement event, the server executes the movement event on the selected display object; when the operation event is the zoom event The server executes the zoom event on the selected display object; and when the operation event is the scroll event, the server executes the scroll event on the browsed display object.     根據請求項7所述的方法，其中，在所述伺服器控制所述顯示設備上展示的顯示對象執行所述操作事件所對應的應用邏輯之後，所述方法還包括：所述伺服器根據所述操作事件的執行結果更新對應的顯示對象的對象資訊，得到新的顯示配置資訊；所述伺服器將所述新的顯示配置資訊返回給所述控制設備，使得所述控制設備顯示新的操作介面。     The method according to claim 7, wherein after the server controls a display object displayed on the display device to execute application logic corresponding to the operation event, the method further includes: the server according to the The execution result of the operation event updates the object information of the corresponding display object to obtain new display configuration information; the server returns the new display configuration information to the control device, so that the control device displays a new operation interface.     根據請求項2所述的方法，其中，在控制設備從伺服 器獲取顯示設備的顯示配置資訊之前，所述方法還包括：所述伺服器接收到所述控制設備發送的對象打開指令，其中，所述對象打開指令至少包括：待顯示對象的訪問地址；所述伺服器根據所述對象打開指令創建所述待顯示對象的對象資訊，其中，所述待顯示對象的對象資訊至少包括：所述待顯示對象的尺長、顯示深度和位置資訊；所述伺服器控制所述顯示設備顯示所述待顯示對象。     The method according to claim 2, wherein before the control device obtains the display configuration information of the display device from a server, the method further includes: the server receives an object opening instruction sent by the control device, wherein, The object opening instruction includes at least: an access address of the object to be displayed; the server creates object information of the object to be displayed according to the object opening instruction, wherein the object information of the object to be displayed includes at least: the The length, depth and position information of the object to be displayed; the server controls the display device to display the object to be displayed.     根據請求項9所述的方法，其中，所述伺服器控制所述顯示設備顯示所述待顯示對象，包括：所述顯示設備從所述伺服器下載與所述待顯示對象相關的對象資訊；所述顯示設備產生與所述待顯示對象對應的DOM資料；所述顯示設備按照任意一個或多個顯示螢幕的螢幕資訊加載並顯示所述DOM資料。     The method according to claim 9, wherein the server controlling the display device to display the object to be displayed comprises: the display device downloading object information related to the object to be displayed from the server; The display device generates DOM data corresponding to the object to be displayed; the display device loads and displays the DOM data according to screen information of any one or more display screens.     一種顯示資料的控制方法，包括：伺服器獲取顯示設備的顯示配置資訊，其中，所述顯示配置資訊包括：所述顯示設備的桌面資訊以及所述顯示設備所包括的每個顯示螢幕展示的顯示對象的對象資訊；所述伺服器根據所述控制設備在操作介面上檢測到的操作行為產生對應的操作事件，其中，所述操作介面為所 述控制設備根據所述顯示配置資訊繪製，所述操作介面包括：與所述桌面資訊對應的模擬桌面和與所述顯示對象對應的模擬對象；所述伺服器根據所述操作事件控制在所述顯示設備上執行與所述操作行為相同的操作。     A method for controlling display data includes: a server obtaining display configuration information of a display device, wherein the display configuration information includes: desktop information of the display device and a display displayed by each display screen included in the display device Object information of the object; the server generates a corresponding operation event according to the operation behavior detected by the control device on the operation interface, wherein the operation interface is drawn by the control device according to the display configuration information, the The operation interface includes: a simulated desktop corresponding to the desktop information and a simulated object corresponding to the display object; and the server controls to perform the same operation as the operation behavior on the display device according to the operation event.     一種顯示資料的控制裝置，包括：獲取模組，用於從伺服器獲取顯示設備的顯示配置資訊，其中，所述顯示配置資訊包括：所述顯示設備的桌面資訊以及所述顯示設備所包括的每個顯示螢幕展示的顯示對象的對象資訊；繪製模組，用於根據所述顯示配置資訊繪製對應的操作介面，其中，所述操作介面包括：與所述桌面資訊對應的模擬桌面和與所述顯示對象對應的模擬對象；產生模組，用於如果操作介面檢測到操作行為，產生對應的操作事件，其中，所述操作事件用於控制在所述顯示設備上執行與所述操作行為相同的操作。     A control device for displaying data includes an acquisition module for acquiring display configuration information of a display device from a server, wherein the display configuration information includes: desktop information of the display device and information included in the display device. Object information of a display object displayed on each display screen; a drawing module for drawing a corresponding operation interface according to the display configuration information, wherein the operation interface includes: a simulated desktop corresponding to the desktop information and The simulation object corresponding to the display object; a generating module for generating a corresponding operation event if the operation interface detects an operation behavior, wherein the operation event is used to control execution on the display device to be the same as the operation behavior Operation.