CN112965771B - Virtual screen construction method, computing device and storage medium - Google Patents
Virtual screen construction method, computing device and storage medium Download PDFInfo
- Publication number
- CN112965771B CN112965771B CN202110231746.3A CN202110231746A CN112965771B CN 112965771 B CN112965771 B CN 112965771B CN 202110231746 A CN202110231746 A CN 202110231746A CN 112965771 B CN112965771 B CN 112965771B
- Authority
- CN
- China
- Prior art keywords
- screen
- virtual screen
- management module
- virtual
- display
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000010276 construction Methods 0.000 title claims abstract description 20
- 238000000034 method Methods 0.000 claims abstract description 57
- 238000004891 communication Methods 0.000 claims description 36
- 238000007726 management method Methods 0.000 description 103
- 230000006870 function Effects 0.000 description 10
- 230000008569 process Effects 0.000 description 9
- 238000012545 processing Methods 0.000 description 9
- 238000010586 diagram Methods 0.000 description 6
- 230000001360 synchronised effect Effects 0.000 description 4
- 230000002093 peripheral effect Effects 0.000 description 3
- 230000008901 benefit Effects 0.000 description 2
- 238000009877 rendering Methods 0.000 description 2
- 230000007723 transport mechanism Effects 0.000 description 2
- 238000012795 verification Methods 0.000 description 2
- 238000011161 development Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000007667 floating Methods 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/451—Execution arrangements for user interfaces
- G06F9/452—Remote windowing, e.g. X-Window System, desktop virtualisation
Abstract
The invention discloses a virtual screen construction method, which is suitable for being executed in a computing device, wherein an image display system and a plurality of applications are operated in the computing device, the image display system comprises a window management module and a screen management module, and the method comprises the following steps: the screen management module sets screen parameters of the virtual screen and constructs the virtual screen according to the screen parameters; the window management module constructs a display window for each running application to obtain a plurality of display windows; the screen management module draws the constructed plurality of display windows in the virtual screen so that the computing device continues to run the application. A computing device and a computer-readable storage medium are also disclosed.
Description
Technical Field
The present invention relates to the field of computer operating systems, and in particular, to a virtual screen construction method, a computing device, and a storage medium.
Background
With the development of computer technology, computers have had great progress in display and interaction, and the computer can display the running conditions of the system and the application through an external physical display, so that the user can conveniently check and continue to operate.
However, in the prior art, if the computer has no external physical display, it may be difficult for the computer to continue to run when encountering operations that require rendering of the display during the running of the operating system and applications. In this case, only the physical display is re-accessed to continue operation, nor is the computer able to engage in graphics-related operations.
For this reason, a virtual screen construction method is required.
Disclosure of Invention
To this end, the present invention provides a virtual screen construction method in an effort to solve or at least alleviate the above-presented problems.
According to one aspect of the present invention, there is provided a virtual screen construction method adapted to be executed in a computing device having an image display system and a plurality of applications running therein, the image display system including a window management module and a screen management module, the method comprising the steps of: the screen management module sets screen parameters of the virtual screen and constructs the virtual screen according to the screen parameters; the window management module constructs a display window for each running application to obtain a plurality of display windows; the screen management module draws the constructed plurality of display windows in the virtual screen so that the computing device continues to run the application.
Optionally, in the method according to the present invention, the computing device further comprises a communication interface adapted to connect to a physical screen, the screen management module comprises a mode option, the mode option comprises a physical screen and a virtual screen, and the method further comprises: the screen management module determines whether the computing device is connected with a physical screen according to the communication interface; if the computing device is connected with the physical screen, setting a mode option to be the physical screen by the screen management module; and acquiring screen parameters of the physical screen, and drawing a display window in the physical screen according to the display window constructed by the window management module.
Optionally, in the method according to the present invention, further comprising: if the computing device is determined to be not connected with the physical screen, the screen management module sets the mode option as a virtual screen; setting screen parameters of the virtual screen, and constructing the virtual screen according to the virtual screen parameters.
Optionally, in the method according to the present invention, the screen management module sets model parameters of the virtual screen, and constructing the virtual screen according to the screen parameters includes the steps of: setting the height, width and refreshing frequency of the virtual screen; and constructing the size of the virtual screen according to the width and the height of the virtual screen, and determining the frequency of drawing the display window of the virtual screen according to the refreshing frequency.
Optionally, in the method according to the invention, the window management module building a display window for each application running comprises the steps of: determining a display window according to the running state of the application; and adding a label of the virtual screen for the display window so that the window management module draws the display window.
Optionally, in the method according to the present invention, the screen management module drawing the constructed plurality of display windows in the virtual screen includes the steps of: acquiring a display window and identifying a label thereof; if the result of the identification tag is a virtual screen, the display window is drawn in the virtual screen.
Optionally, in the method according to the invention, the computing device comprises a memory, and drawing the display window in the virtual screen comprises the steps of: obtaining an allocated memory block from a memory of a computing device, the content block for storing display window data; performing association operation on the stored blocks and the virtual screen; drawing a display window in the memory block after the association operation; and merging the display windows drawn in all the memory blocks associated with the virtual screen to obtain the memory blocks of the virtual screen, wherein all the display windows drawn by the current virtual screen are stored in the content blocks of the virtual screen.
Optionally, in the method according to the present invention, further comprising: when the screen management module builds a virtual screen and draws a display window in the virtual screen, the screen management module receives a screen capturing instruction from a user; the screen management module acquires stored display information from a memory block of the virtual screen according to the screen capturing instruction, wherein the display information comprises a display window drawn by the current virtual screen; and storing the display information in a screen capturing picture, and storing the screen capturing picture in a memory.
Optionally, in the method according to the present invention, the image display system further comprises a power management module, and the method further comprises: when the screen management module builds a virtual screen and draws a display window in the virtual screen, the power management module receives a virtual screen control instruction from a user, wherein the virtual screen control instruction comprises closing the virtual screen and opening the virtual screen; and the power management module closes or opens the virtual screen according to the virtual screen control instruction.
Optionally, in the method according to the present invention, further comprising: the power management module monitors a communication interface suitable for being connected with a physical screen; and when the computing device is connected with the physical screen through the communication interface, transferring a display window drawn by the virtual screen to the physical screen for display.
According to another aspect of the present invention, there is provided a computing device comprising: one or more processors; a memory; an image display system; and one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs comprising instructions for performing any one of the methods of virtual screen construction according to the present invention.
According to yet another aspect of the present invention, there is provided a computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by a computing device, cause the computing device to perform any of the methods of virtual screen construction according to the present invention.
A virtual screen construction method in the present invention is suitable for execution in a computing device. The computing device has an image display system and a plurality of applications running therein, the image display system including a window management module and a screen management module. The screen management module constructs the virtual screen according to the screen parameters by setting the screen parameters of the virtual screen, so that the computer can conveniently draw and display the display window of the application in the virtual screen, and the continuous running is not blocked.
And further, before the virtual screen is constructed, the invention detects whether the computer is connected with the physical screen, and if the computer is detected to be connected with the physical screen, the display window of the display application can be drawn in the physical screen. The image display system also comprises a power management module, when the power management module monitors that the physical screen is connected through the communication interface of the computer in the process of displaying by using the virtual screen, the display window drawn by the virtual screen is transferred to the physical screen for displaying, so that the compatibility between the physical screen and the virtual screen and the intelligent switching between the physical screen and the virtual screen can be realized. The power management module also receives a virtual screen control instruction of the user, wherein the virtual screen control instruction comprises closing of the virtual screen and opening of the virtual screen, so that the power management module controls closing or opening of the virtual screen according to the needs of the user.
Drawings
To the accomplishment of the foregoing and related ends, certain illustrative aspects are described herein in connection with the following description and the annexed drawings, which set forth the various ways in which the principles disclosed herein may be practiced, and all aspects and equivalents thereof are intended to fall within the scope of the claimed subject matter. The above, as well as additional objects, features, and advantages of the present disclosure will become more apparent from the following detailed description when read in conjunction with the accompanying drawings. Like reference numerals generally refer to like parts or elements throughout the present disclosure.
FIG. 1 illustrates a schematic diagram 100 of an image display system operating in a computing device according to an exemplary embodiment of the invention;
FIG. 2 illustrates a block diagram of a computing device 200 according to an exemplary embodiment of the invention; and
fig. 3 shows a flow diagram of a virtual screen construction method 300 according to an exemplary embodiment of the invention.
Detailed Description
Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the disclosure to those skilled in the art. Like reference numerals generally refer to like parts or elements.
FIG. 1 illustrates a schematic diagram 100 of an image display system operating in a computing device according to an exemplary embodiment of the invention. As shown in fig. 1, the image display system 100 includes a window management module 110, a screen management module 120, and a power management module 130, wherein the screen management module 120 is communicatively coupled to the window management module 110 and the power management module 130.
The computing device on which the image display system 100 resides includes a communication interface for interfacing with a physical screen. Before the virtual screen is constructed, the screen management module 120 determines, according to the communication interface, whether the computing device is connected to a physical screen, and if the computing device is not connected to the physical screen, sets screen parameters of the virtual screen. The screen parameters of the virtual screen may be set with reference to the screen parameters of the physical screen, but the set parameters may be adjusted as needed by the computing device to run the image display system 100 and applications.
The virtual screen is a screen which does not use a physically existing screen as a medium, and the virtual screen is simulated to display a display window to be displayed in a virtual memory, and the virtual memory can be realized as a storage space constructed by display storage of a display card. The screen parameters include a function parameter, an identification parameter, a type parameter, and a configuration parameter. The functional parameters include a switch state and a scaling parameter. The switch state controls the opening and closing of the virtual screen, and when the switch state is on, the virtual screen is in an on state, and when the switch state is off, the virtual screen is in an off state. The scale parameter (scale) controls whether the virtual screen can be scaled.
The identification parameters include a display screen identification (edid) and corresponding manufacturer information (manufacturer). The display screen identifier is a unique identifier of both the physical screen and the virtual screen, and is used as an identifier for identifying the display. The manufacturer information is the manufacturer corresponding to the display screen identification. The type parameter (connector_type) is the type of display, including VGA, HDMI, DP and eDP. The screen management module 120 sets it according to actual needs.
The configuration parameters (mode_modeinfo) include the clock frequency (clock), the height (hdisplay), the width (vdisplay), the start of the high synchronization signal (hsync_start), the end of the high synchronization signal (hsync_end), the inclination (hskew), the start of the horizontal synchronization signal (vsync_start), the end of the horizontal synchronization signal (vsync_end), the refresh frequency (vrefresh) and the flag bit (flags) of the display. Wherein the height and width define the height and width, respectively, of the virtual screen, and the refresh frequency determines a frequency at which display windows are drawn in the virtual screen, at which the virtual screen refreshes the display content. Each of the configuration parameters determines a set of configuration parameters for the virtual screen. The screen management module 120 may also obtain various parameters of the physical screen to which the communication interface is connected, and establish a plurality of configuration parameters to store parameters of different physical screens.
According to one embodiment of the invention, a set of configuration parameters for a virtual screen established by the screen management module 120 is as follows:
drmModeModeInfo mode；
strcpy (mode. Name, "1920x 1080"); name of the configuration parameter
mode. Clock= 148500; frequency of the clock
mode, hdisplay=1920; height// height
mode.hsync_start=2008; start of the/(highly synchronous) signal
mode hsync_end=2052; end of highly synchronous signal
mode.hskew=0; gradient//
mode. Vdisplay=1080; width//
mode. Vsync_start=1084; start of the horizontal synchronization signal
mode. Vsync_end=1089; end of horizontal synchronization signal
mode. Vrefh=60; frequency of/(refresh)
mode. Flags=5; /(flag bit)
Window management module 110 builds a display window for each application running in the computing device, resulting in a plurality of display windows. The screen management module 120 also draws a plurality of display windows in the virtual screen at the refresh rate. The power management module 130, to which the screen management module 120 is communicatively coupled, accepts virtual screen control instructions from a user when the computing device is using a virtual screen, including turning off the virtual screen and turning on the virtual screen. When the power management module 130 receives a control instruction for closing the virtual screen, the control screen management module 120 modifies the switch state in the function parameters to be closed, so that the virtual screen can be closed; when the power management module 130 receives a control instruction for starting the virtual screen, the control screen management module 120 modifies the on-off state in the function parameters from off to on, so that the virtual screen can be started.
The image display system 100 of the present invention is adapted to operate in a computing device. FIG. 2 illustrates a block diagram of a computing device 200 according to an exemplary embodiment of the invention. As shown in FIG. 2, in a basic configuration 202, computing device 200 typically includes a system memory 206 and one or more processors 204. A memory bus 208 may be used for communication between the processor 204 and the system memory 206.
Depending on the desired configuration, the processor 204 may be any type of processing including, but not limited to: a microprocessor (μp), a microcontroller (μc), a digital information processor (DSP), or any combination thereof. Processor 204 may include one or more levels of cache, such as a first level cache 210 and a second level cache 212, a processor core 214, and registers 216. The example processor core 214 may include an Arithmetic Logic Unit (ALU), a Floating Point Unit (FPU), a digital signal processing core (DSP core), or any combination thereof. The example memory controller 218 may be used with the processor 204, or in some implementations, the memory controller 218 may be an internal part of the processor 204.
Depending on the desired configuration, system memory 206 may be any type of memory including, but not limited to: volatile memory (such as RAM), non-volatile memory (such as ROM, flash memory, etc.), or any combination thereof. The system memory 206 may include an operating system 220, one or more programs 222, and program data 224. In some implementations, the program 222 may be arranged to execute instructions 223 of the method 300 according to the present invention on an operating system by the one or more processors 204 using the program data 224. The operating system 220 includes an image display system 221. The image display system 221 is the image display system 100 shown in fig. 1 of the present invention.
Computing device 200 may also include a storage interface bus 234. Storage interface bus 234 enables communication from storage devices 232 (e.g., removable storage 236 and non-removable storage 238) to base configuration 202 via bus/interface controller 230. At least a portion of the operating system 220, applications 222, and data 224 may be stored on removable storage 236 and/or non-removable storage 238 and loaded into the system memory 206 via the storage interface bus 234 and executed by the one or more processors 204 when the computing device 200 is powered up or the application 222 is to be executed.
Computing device 200 may also include an interface bus 240 that facilitates communication from various interface devices (e.g., output devices 242, peripheral interfaces 244, and communication devices 246) to basic configuration 202 via bus/interface controller 230. The example output device 242 includes a graphics processing unit 248 and an audio processing unit 250. They may be configured to facilitate communication with various external devices, such as a display or speakers, via one or more a/V ports 252. The example peripheral interface 244 may include a serial interface controller 254 and a parallel interface controller 256, which may be configured to facilitate communication via one or more I/O ports 258 and external devices such as input devices (e.g., keyboard, mouse, pen, voice input device, touch input device) or other peripherals (e.g., printer, scanner, etc.). The example communication device 246 may include a network controller 260 that may be arranged to facilitate communication with one or more other computing devices 262 over a network communication link via one or more communication ports 264.
The network communication link may be one example of a communication medium. Communication media may typically be embodied by computer readable instructions, data structures, program modules, and may include any information delivery media in a modulated data signal, such as a carrier wave or other transport mechanism. A "modulated data signal" may be a signal that has one or more of its data set or changed in such a manner as to encode information in the signal. By way of non-limiting example, communication media may include wired media such as a wired network or special purpose network, and wireless media such as acoustic, radio Frequency (RF), microwave, infrared (IR) or other wireless media. The term computer readable media as used herein may include both storage media and communication media.
In a computing device 200 according to the invention, the application 222 includes program instructions for executing a virtual screen construction method 300 that may instruct the processor 204 to perform part of the steps in the virtual screen construction method 300 running in a computing device 200 according to the invention, so that parts of the computing device 200 implement the construction of a virtual screen by executing a virtual screen construction method 300 according to the invention.
Computing device 200 may be implemented as a server, such as file server 240, database 250, a server, an application server, etc., such as a Personal Digital Assistant (PDA), a wireless web-browsing device, an application-specific device, or a hybrid device that may include any of the above functions. May be implemented as a personal computer including desktop and notebook computer configurations, and in some embodiments, computing device 200 is configured to perform a virtual screen construction method 300.
Fig. 3 shows a flow diagram of a virtual screen construction method 300 according to an exemplary embodiment of the invention. The method 300 is suitable for execution in the computing device 200. As shown in fig. 3, a virtual screen construction method 300 begins at step S310, where the screen management module 120 sets screen parameters of a virtual screen and constructs the virtual screen according to the screen parameters.
The screen management module 120 first determines whether a physical screen is connected to the computing device according to the communication interface before constructing the virtual screen. When a physical screen is connected to the computing device, the physical screen is preferentially used for display, and a virtual screen does not need to be constructed. If it is determined that the computing device is connected to a physical screen, the screen management module 120 sets the mode option to the physical screen. The mode options of the screen management module 120 include a physical screen and a virtual screen. The screen management module 120 then acquires screen parameters of the physical screen, and draws a display window in the physical screen according to the display window constructed by the window management module 110. The screen parameter items of the physical screen and the virtual screen are the same, but when the virtual screen is constructed, the screen management module 120 can set different parameters with the physical screen according to the needs, and meanwhile, the set parameter values are more flexible, so that various requirements of display tasks can be met conveniently.
According to one embodiment of the invention, when a computing device is connected to a physical screen, window management module 110 constructs a display window for an application for display in the physical screen. The constructed plurality of display windows are transmitted to a driver corresponding to the connected physical device through a verification (valid) interface to be processed. The driver may process a certain number of display windows simultaneously, and when the number of the received display windows is greater than the processing capability, instruct the window management module 110 to add labels of physical screens to the display windows to the screen management module 120, so that the screen management module 120 processes the display windows by identifying the labels of the physical screens, and combines the display windows into one display window and sends the display window to the driver for processing through a presentation interface.
According to one exemplary embodiment of the invention, when a computing device is connected with a physical screen, window management module 110 is configured with 5 display windows. The processing power of the driver corresponding to the physical screen to which the computing device is connected is 3 display windows, i.e., the driver can process 3 display windows simultaneously. At this time, after the window management module 110 sends the 5 display windows to the driver through the verification (valid) interface, the driver instructs the window management module 110 to add a tag of a physical screen to the display window, and sends the tag to the screen management module 120, so that the screen management module 120 merges the display windows into one display window through identifying the tag of the physical screen, and sends the display window to the driver through the presentation (Present) interface for processing.
If the computing device is not connected to a physical screen, the screen management module 120 sets the mode option to a virtual screen. The image display system 100 further includes a power management module 130. Then, the screen management module 120 checks whether the power management module 130 receives a virtual screen control instruction for closing the virtual screen of the user, and if the corresponding control instruction for controlling the closing of the virtual screen is not received, sets screen parameters of the virtual screen.
The screen parameters include a function parameter, an identification parameter, a type parameter, and a configuration parameter. The configuration parameters include the height, width and refresh frequency of the virtual screen. According to one embodiment of the present invention, among the function parameters of one virtual screen established by the screen management module 120, the switch state is on, and the zoom parameter is for supporting zooming; the display screen is identified as screen1, and the manufacturer information is tx; the type parameter is VGA; the configuration parameters are as follows:
drmModeModeInfo mode；
strcpy (mode. Name, "1920x 1080"); name of the configuration parameter
mode. Clock= 148500; frequency of the clock
mode, hdisplay=1920; height// height
mode.hsync_start=2008; start of the/(highly synchronous) signal
mode hsync_end=2052; end of highly synchronous signal
mode.hskew=0; gradient//
mode. Vdisplay=1080; width//
mode. Vsync_start=1084; start of the horizontal synchronization signal
mode. Vsync_end=1089; end of horizontal synchronization signal
mode. Vrefh=60; frequency of/(refresh)
mode. Flags=5; /(flag bit)
Next, the screen management module 120 constructs a virtual screen according to the above parameters: and constructing the size of the virtual screen according to the width and the height of the virtual screen, and determining the frequency of drawing the display window of the virtual screen according to the refreshing frequency.
Subsequently, step S320 is performed, where the window management module 110 constructs a display window for each application running, resulting in a plurality of display windows. The window management module 110 determines a display window according to the running state of the application. The running state of the application may be obtained from an operating system running in the computing device. Subsequently, since the computing device is not connected to a physical screen, no corresponding driver processes the display window. Therefore, when the window management module 110 needs to send the display window to the driver through the Validate interface, the window management module 110 directly adds a label of the virtual screen to the display window so that the window management module 110 draws the display window.
Subsequently, step S330 is performed, and the screen management module 120 draws the constructed plurality of display windows in the virtual screen so that the computing device continues to run the application. The screen management module 120 acquires the display windows and identifies the labels thereof, if the result of the identification is a virtual screen, the display windows are processed and rendered, and the display windows are not transmitted to the driver through the Present interface any more, and are directly displayed in the virtual screen. The computing device can smoothly complete image processing and display related work, and when the running state of the application executing the image related task needs to be known, the image rendering and display result can be checked through screen capturing operation.
The computing device includes a memory that may be implemented as a memory of a graphics card included in the computing device for use as virtual display memory. The computing device further includes an image data manager for allocating a display memory, such as separating a memory block from the display memory, so that the screen management module stores corresponding display information after performing a drawing operation of a display window in the memory block.
The screen management module draws a display window in a virtual screen, and comprises the following steps: the memory block allocated by the image data manager is obtained from the memory of the computing device, and the memory block is associated with the virtual screen so that the virtual screen displays the display window in the memory block. And then, carrying out drawing operation of the display window in the memory block after the association operation, executing drawing sentences corresponding to the display window, and finishing drawing of the display window. And finally, the screen management module combines the display windows drawn in all the memory blocks associated with the virtual screen to obtain the memory blocks of the virtual screen, and all the display windows drawn by the current virtual screen are stored in the content blocks of the virtual screen. Because the virtual screen is the same as the physical screen, when the display windows of the application are displayed, the display information can only be read from one memory block, so that the memory blocks of a plurality of display windows need to be processed in advance and combined into the memory block of one virtual screen, and the virtual screen can display all the display windows in the memory block simultaneously.
According to one embodiment of the invention, when the screen management module builds a virtual screen and draws a display window therein, the screen management module receives a screen capturing instruction from a user, and the screen capturing instruction instructs the screen management module to perform screen capturing operation on content displayed by the current virtual screen so that the user can view the current system and application running state. And then, the screen management module acquires stored display information from the memory block of the virtual screen according to the screen capturing instruction, wherein the display information comprises all display windows drawn by the current virtual screen, stores the display information in the form of screen capturing pictures, and stores the screen capturing pictures in a memory so as to be convenient for a user to view.
According to one embodiment of the present invention, the power management module 130 receives virtual screen control instructions from a user when the screen management module 120 constructs a virtual screen and draws a display window therein. The user may send virtual screen control instructions to control the opening and closing of the virtual screen through an input device or the like to which the computing device is connected.
The virtual screen control instruction includes closing the virtual screen and opening the virtual screen, and the power management module 130 closes or opens the virtual screen according to the virtual screen control instruction. When the power management module 130 receives a control instruction for closing the virtual screen, the control screen management module 120 modifies the switch state in the function parameters to be closed, so that the virtual screen can be closed; when the power management module 130 receives a control instruction for starting the virtual screen, the control screen management module 120 modifies the on-off state in the function parameters from off to on, so that the virtual screen can be started.
According to one embodiment of the invention, the power management module 130 also monitors a communication interface adapted to connect to the physical screen, and when it is monitored that the computing device is connected to the physical screen through the communication interface, the display window drawn by the virtual screen is transferred to the physical screen for display. Therefore, in the process that the computing equipment uses the virtual screen to display, the computing equipment can switch to the physical screen to display in time after being connected with the physical screen, seamless switching of the display screen is performed, and applicability to the physical screen and the virtual screen is improved. Meanwhile, the virtual screen is released in time, so that computer resources are saved, and the running efficiency of the system and the application is improved.
A virtual screen construction method in the present invention is suitable for execution in a computing device. The computing device has an image display system and a plurality of applications running therein, the image display system including a window management module and a screen management module. The screen management module constructs the virtual screen according to the screen parameters by setting the screen parameters of the virtual screen, so that the computer can conveniently draw and display the display window of the application in the virtual screen, and the continuous running is not blocked.
And further, before the virtual screen is constructed, the invention detects whether the computer is connected with the physical screen, and if the computer is detected to be connected with the physical screen, the display window of the display application can be drawn in the physical screen. The image display system also comprises a power management module, when the power management module monitors that the physical screen is connected through the communication interface of the computer in the process of displaying by using the virtual screen, the display window drawn by the virtual screen is transferred to the physical screen for displaying, so that the compatibility between the physical screen and the virtual screen and the intelligent switching between the physical screen and the virtual screen can be realized. The power management module also receives a virtual screen control instruction of the user, wherein the virtual screen control instruction comprises closing of the virtual screen and opening of the virtual screen, so that the power management module controls closing or opening of the virtual screen according to the needs of the user.
In the description provided herein, numerous specific details are set forth. However, it is understood that embodiments of the invention may be practiced without these specific details. In some instances, well-known methods, structures and techniques have not been shown in detail in order not to obscure an understanding of this description.
The method of any one of A1-A8, wherein the image display system further comprises a power management module, the method further comprising:
when the screen management module builds a virtual screen and draws a display window in the virtual screen, the power management module receives a virtual screen control instruction from a user, wherein the virtual screen control instruction comprises closing the virtual screen and opening the virtual screen;
and the power management module closes or opens the virtual screen according to the virtual screen control instruction.
The method of a10, A9, further comprising:
the power management module monitors a communication interface suitable for being connected with a physical screen;
and when the computing equipment is monitored to be connected with a physical screen through the communication interface, transferring a display window drawn by the virtual screen to the physical screen for display.
Similarly, it should be appreciated that in the foregoing description of exemplary embodiments of the invention, various features of the invention are sometimes grouped together in a single embodiment, figure, or description thereof for the purpose of streamlining the disclosure and aiding in the understanding of one or more of the various inventive aspects. However, the disclosed method should not be construed as reflecting the intention that: i.e., the claimed invention requires more features than are expressly recited in each claim. Rather, as the following claims reflect, inventive aspects lie in less than all features of a single foregoing disclosed embodiment. Thus, the claims following the detailed description are hereby expressly incorporated into this detailed description, with each claim standing on its own as a separate embodiment of this invention.
Those skilled in the art will appreciate that the modules or units or groups of devices in the examples disclosed herein may be arranged in a device as described in this embodiment, or alternatively may be located in one or more devices different from the devices in this example. The modules in the foregoing examples may be combined into one module or may be further divided into a plurality of sub-modules.
Those skilled in the art will appreciate that the modules in the apparatus of the embodiments may be adaptively changed and disposed in one or more apparatuses different from the embodiments. The modules or units or groups of embodiments may be combined into one module or unit or group, and furthermore they may be divided into a plurality of sub-modules or sub-units or groups. Any combination of all features disclosed in this specification (including any accompanying claims, abstract and drawings), and all of the processes or units of any method or apparatus so disclosed, may be used in combination, except insofar as at least some of such features and/or processes or units are mutually exclusive. Each feature disclosed in this specification (including any accompanying claims, abstract and drawings), may be replaced by alternative features serving the same, equivalent or similar purpose, unless expressly stated otherwise.
Furthermore, those skilled in the art will appreciate that while some embodiments described herein include some features but not others included in other embodiments, combinations of features of different embodiments are meant to be within the scope of the invention and form different embodiments. For example, in the following claims, any of the claimed embodiments can be used in any combination.
Furthermore, some of the embodiments are described herein as methods or combinations of method elements that may be implemented by a processor of a computer system or by other means of performing the functions. Thus, a processor with the necessary instructions for implementing the described method or method element forms a means for implementing the method or method element. Furthermore, the elements of the apparatus embodiments described herein are examples of the following apparatus: the apparatus is for carrying out the functions performed by the elements for carrying out the objects of the invention.
The various techniques described herein may be implemented in connection with hardware or software or, alternatively, with a combination of both. Thus, the methods and apparatus of the present invention, or certain aspects or portions of the methods and apparatus of the present invention, may take the form of program code (i.e., instructions) embodied in tangible media, such as floppy diskettes, CD-ROMs, hard drives, or any other machine-readable storage medium, wherein, when the program is loaded into and executed by a machine, such as a computer, the machine becomes an apparatus for practicing the invention.
In the case of program code execution on programmable computers, the computing device will generally include a processor, a storage medium readable by the processor (including volatile and non-volatile memory and/or storage elements), at least one input device, and at least one output device. Wherein the memory is configured to store program code; the processor is configured to execute the inventive method of determining a shutdown state of the device in accordance with instructions in said program code stored in the memory.
By way of example, and not limitation, computer readable media comprise computer storage media and communication media. Computer-readable media include computer storage media and communication media. Computer storage media stores information such as computer readable instructions, data structures, program modules, or other data. Communication media typically embodies computer readable instructions, data structures, program modules or other data in a modulated data signal such as a carrier wave or other transport mechanism and includes any information delivery media. Combinations of any of the above are also included within the scope of computer readable media.
As used herein, unless otherwise specified the use of the ordinal terms "first," "second," "third," etc., to describe a general object merely denote different instances of like objects, and are not intended to imply that the objects so described must have a given order, either temporally, spatially, in ranking, or in any other manner.
While the invention has been described with respect to a limited number of embodiments, those skilled in the art, having benefit of the above description, will appreciate that other embodiments are contemplated within the scope of the invention as described herein. Furthermore, it should be noted that the language used in the specification has been principally selected for readability and instructional purposes, and may not have been selected to delineate or circumscribe the inventive subject matter. Accordingly, many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the appended claims. The disclosure of the present invention is intended to be illustrative, but not limiting, of the scope of the invention, which is defined by the appended claims.
Claims (11)
1. A virtual screen construction method adapted to be executed in a computing device having an image display system and a plurality of applications running therein, the image display system including a window management module and a screen management module, the method comprising the steps of:
the screen management module sets screen parameters of a virtual screen and constructs the virtual screen according to the screen parameters;
the window management module constructs a display window for each running application to obtain a plurality of display windows;
the screen management module draws the constructed multiple display windows in a virtual screen so that the computing device can continue to run the application;
the window management module constructs a display window for each application running, including the steps of:
determining a display window according to the running state of the application, wherein the running state of the application can be obtained from an operating system running in the computing equipment;
when the window management module needs to send the display window to the driver through the interface, the window management module adds a label of a virtual screen for the display window so that the window management module draws the display window.
2. The method of claim 1, wherein the computing device further comprises a communication interface adapted to connect to a physical screen, the screen management module comprising a mode option comprising a physical screen and a virtual screen, the method further comprising:
the screen management module determines whether a physical screen is connected to the computing device according to the communication interface;
if the computing device is determined to be connected with a physical screen, the screen management module sets the mode option as a physical screen;
and acquiring screen parameters of the physical screen, and drawing a display window in the physical screen according to the display window constructed by the window management module.
3. The method of claim 2, the method further comprising:
if the computing device is determined to be not connected with a physical screen, the screen management module sets the mode option as a virtual screen;
setting screen parameters of the virtual screen, and constructing the virtual screen according to the virtual screen parameters.
4. The method of claim 1, wherein the screen management module sets model parameters of a virtual screen, and constructing the virtual screen according to the screen parameters comprises the steps of:
setting the height, width and refreshing frequency of the virtual screen;
and constructing the size of the virtual screen according to the width and the height of the virtual screen, and determining the frequency of drawing the display window by the virtual screen according to the refreshing frequency.
5. The method of claim 1, wherein the screen management module draws the constructed plurality of display windows in the virtual screen comprises the steps of:
acquiring the display window and identifying the label of the display window;
and if the result of identifying the label is a virtual screen, drawing the display window in the virtual screen.
6. The method of claim 5, wherein the computing device includes a memory, drawing the display window in the virtual screen comprising the steps of:
obtaining an allocated memory block from a memory of a computing device, the memory block for storing display window data;
performing association operation on the memory block and the virtual screen;
drawing a display window in the memory block after the association operation;
and merging the display windows drawn in all the memory blocks associated with the virtual screen to obtain the memory blocks of the virtual screen, wherein the memory blocks of the virtual screen store the display windows drawn by the current virtual screen.
7. The method of claim 6, further comprising:
when the screen management module builds a virtual screen and draws a display window in the virtual screen, the screen management module receives a screen capturing instruction from a user;
the screen management module acquires stored display information from a memory block of the virtual screen according to the screen capturing instruction, wherein the display information comprises all display windows drawn by the current virtual screen;
and storing the display information in a screen capturing picture, and storing the screen capturing picture in a memory.
8. The method of any of claims 1-7, wherein the image display system further comprises a power management module, the method further comprising:
when the screen management module builds a virtual screen and draws a display window in the virtual screen, the power management module receives a virtual screen control instruction from a user, wherein the virtual screen control instruction comprises closing the virtual screen and opening the virtual screen;
and the power management module closes or opens the virtual screen according to the virtual screen control instruction.
9. The method of claim 8, further comprising:
the power management module monitors a communication interface suitable for being connected with a physical screen;
and when the computing equipment is monitored to be connected with a physical screen through the communication interface, transferring a display window drawn by the virtual screen to the physical screen for display.
10. A computing device, comprising:
one or more processors;
a memory storing program instructions, wherein the program instructions are configured to be adapted to be executed by at least one processor, the program instructions comprising instructions for performing the method of any one of claims 1 to 9.
11. A computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by a computing device, cause the computing device to perform any of the methods of claims 1-9.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110231746.3A CN112965771B (en) | 2021-03-02 | 2021-03-02 | Virtual screen construction method, computing device and storage medium |
| PCT/CN2021/124289 WO2022183742A1 (en) | 2021-03-02 | 2021-10-18 | Virtual screen construction method, computing device, and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110231746.3A CN112965771B (en) | 2021-03-02 | 2021-03-02 | Virtual screen construction method, computing device and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112965771A CN112965771A (en) | 2021-06-15 |
| CN112965771B true CN112965771B (en) | 2024-02-23 |
Family
ID=76277477
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110231746.3A Active CN112965771B (en) | 2021-03-02 | 2021-03-02 | Virtual screen construction method, computing device and storage medium |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN112965771B (en) |
| WO (1) | WO2022183742A1 (en) |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112965771B (en) * | 2021-03-02 | 2024-02-23 | 北京深之度科技有限公司 | Virtual screen construction method, computing device and storage medium |
| CN114489421A (en) * | 2021-12-08 | 2022-05-13 | 统信软件技术有限公司 | Virtual screen generation method, computing device and storage medium |
| CN114327723A (en) * | 2021-12-28 | 2022-04-12 | 阿波罗智联(北京)科技有限公司 | Application processing method, device and equipment based on virtual screen and storage medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1941066A (en) * | 2005-09-28 | 2007-04-04 | 联想(北京)有限公司 | Multiple display device system and method for automatically setting display-mode |
| CN102495711A (en) * | 2011-11-15 | 2012-06-13 | 中兴通讯股份有限公司 | Virtual multi-screen implementation method and device |
| CN110471734A (en) * | 2019-08-19 | 2019-11-19 | 东软集团股份有限公司 | A kind of display control method and device |
| CN111736942A (en) * | 2020-08-20 | 2020-10-02 | 北京爱奇艺智能科技有限公司 | Multi-application scene display method and device in VR system and VR equipment |
| CN112015359A (en) * | 2019-05-28 | 2020-12-01 | 华为技术有限公司 | Display method and electronic equipment |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TWI360761B (en) * | 2007-10-03 | 2012-03-21 | Inventec Corp | An electronic apparatus and a method for automatic |
| JP4676011B2 (en) * | 2009-05-15 | 2011-04-27 | 株式会社東芝 | Information processing apparatus, display control method, and program |
| US9250700B2 (en) * | 2013-02-28 | 2016-02-02 | Apple Inc. | System and method for virtual displays |
| CN112965771B (en) * | 2021-03-02 | 2024-02-23 | 北京深之度科技有限公司 | Virtual screen construction method, computing device and storage medium |
-
2021
- 2021-03-02 CN CN202110231746.3A patent/CN112965771B/en active Active
- 2021-10-18 WO PCT/CN2021/124289 patent/WO2022183742A1/en unknown
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1941066A (en) * | 2005-09-28 | 2007-04-04 | 联想(北京)有限公司 | Multiple display device system and method for automatically setting display-mode |
| CN102495711A (en) * | 2011-11-15 | 2012-06-13 | 中兴通讯股份有限公司 | Virtual multi-screen implementation method and device |
| CN112015359A (en) * | 2019-05-28 | 2020-12-01 | 华为技术有限公司 | Display method and electronic equipment |
| CN110471734A (en) * | 2019-08-19 | 2019-11-19 | 东软集团股份有限公司 | A kind of display control method and device |
| CN111736942A (en) * | 2020-08-20 | 2020-10-02 | 北京爱奇艺智能科技有限公司 | Multi-application scene display method and device in VR system and VR equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2022183742A1 (en) | 2022-09-09 |
| CN112965771A (en) | 2021-06-15 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN112965771B (en) | Virtual screen construction method, computing device and storage medium | |
| US8384738B2 (en) | Compositing windowing system | |
| US8797232B2 (en) | Information processing apparatus, display control method, and program | |
| CN113225427B (en) | Image display method and terminal equipment | |
| WO2017101493A1 (en) | Page label management method and device for browser | |
| CN105786424B (en) | The method that the quick split screen display available of the single-screen of embedded system solves | |
| WO2022194003A1 (en) | Screen capture method and apparatus, electronic device, and readable storage medium | |
| US7308565B2 (en) | Saving/restoring task state data from/to device controller host interface upon command from host processor to handle task interruptions | |
| EP3726357B1 (en) | Electronic apparatus and controlling method thereof | |
| CN105320480B (en) | Screen broadcasting method and system and device using the same | |
| US20170192673A1 (en) | Information processing apparatus, information processing method, and information processing program | |
| JP2011086050A (en) | Information processing terminal and computer program | |
| CN114510307B (en) | Dynamic wallpaper implementation method, computing device and storage medium | |
| CN113885758B (en) | Virtual screen generation method, computing device and storage medium | |
| CN113297313B (en) | Table data display method and device, electronic equipment and storage medium | |
| JP2010164972A (en) | Method and apparatus for drawing image | |
| EP3032492B1 (en) | Image processing apparatus and method | |
| CN117078499B (en) | Dual-graphics-card rendering processing method and device, computing equipment and readable storage medium | |
| JP4191212B2 (en) | Image display system | |
| CN104516694B (en) | Image display method and electronic equipment | |
| CN202003343U (en) | Display system | |
| US20160328009A1 (en) | Computing device and method for displaying sleeping interface and waking-up interface | |
| US20130300755A1 (en) | Electronic apparatus and method for data transmission from an electronic apparatus to a display device | |
| CN115457916A (en) | Method for realizing forced display of picture based on DVI port and related device | |
| JP2000181599A (en) | Display device, display control method therefor, and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| EE01 | Entry into force of recordation of patent licensing contract |
Application publication date: 20210615 Assignee: Tongxin Software Technology Co.,Ltd. Assignor: BEIJING SHENZHIDU TECHNOLOGY Co.,Ltd. Contract record no.: X2021980009936 Denomination of invention: A virtual screen construction method, computing device and storage medium License type: Common License Record date: 20210927 |
|
| EE01 | Entry into force of recordation of patent licensing contract | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |