Detailed Description
Various exemplary embodiments of the present invention will now be described in detail with reference to the accompanying drawings. It should be noted that: the relative arrangement of the components and steps, the numerical expressions and numerical values set forth in these embodiments do not limit the scope of the present invention unless specifically stated otherwise.
The following description of at least one exemplary embodiment is merely illustrative in nature and is in no way intended to limit the invention, its application, or uses.
Techniques, methods, and apparatus known to those of ordinary skill in the relevant art may not be discussed in detail but are intended to be part of the specification where appropriate.
In all examples shown and discussed herein, any particular value should be construed as merely illustrative, and not limiting. Thus, other examples of the exemplary embodiments may have different values.
It should be noted that: like reference numbers and letters refer to like items in the following figures, and thus, once an item is defined in one figure, further discussion thereof is not required in subsequent figures.
< hardware configuration composition >
Fig. 1 is a schematic diagram of a hardware structure of an electronic device according to an embodiment of the present invention.
Referring to fig. 1, the electronic device according to the embodiment of the invention includes a memory 1010, a processor 1020, and a plurality of displays 1030 (i.e., at least two displays 1030), for example, in the embodiment shown in fig. 1, the electronic device includes three displays 1030, and the plurality of displays 1030 are connected to the processor 1020.
The plurality of displays 1030 are configured to display in an extended mode, i.e., the processor 1020 collectively presents configured display content through the plurality of displays 1030, wherein the display content of each display 1030 is different.
Taking the windows operating system as an example of the processor 1020, the display modes of the plurality of displays 1030 are set as follows:
(1) and entering a setting dialog box, selecting system options through the setting dialog box, and entering a system dialog box.
(2) Selecting the "show" option via the system dialog, at which time the display currently connected to the processor 1020 is visible in the corresponding setup pane, taking fig. 1 as an example, three displays 1030 are visible in the setup pane and are numbered 1, 2, and 3, respectively; in addition, an arrangement structure setting option and a display mode setting option are further arranged in the setting pane.
(3) The arrangement structure of the plurality of displays, such as horizontal arrangement, vertical arrangement, and the like, can be set through the arrangement structure setting option.
(4) The display modes of the plurality of displays can be set by the display mode setting option, for example, the displays are expanded (expansion mode), and the displays are copied (copy mode), in which the copy mode displays the same content for the respective displays.
The memory 1010 includes, for example, a ROM (read only memory), a RAM (random access memory), a nonvolatile memory such as a hard disk, and the like.
The memory 1010 stores executable instructions for controlling the processor 1020 to operate to perform a method for presenting multi-display content according to any embodiment of the invention. The skilled person can design the instructions according to the disclosed solution. How the instructions control the operation of the processor 1020 is well known in the art and will not be described in detail herein.
In the embodiment of the present invention, the electronic device may further include an input device such as a keyboard and a mouse.
In the embodiment of the present invention, the electronic device may further include an interface device, where the interface device includes, for example, a USB interface, an earphone interface, an RS232 serial port, and the like.
In the embodiment of the present invention, the electronic device may further include a communication device, which may be capable of wired or wireless communication, for example, and specifically may include Wifi communication, bluetooth communication, 2G/3G/4G/5G communication, and the like.
In the embodiment of the present invention, the electronic device may further include a speaker, a microphone, and the like.
In an example of the present invention, the processor 1020 is, for example, a CPU of a computer host, an industrial control host, or the like.
< method examples >
FIG. 2 is a flow diagram of a method for presenting multi-display content in accordance with an embodiment of the present invention.
As shown in fig. 2, the method of an embodiment of the present invention may include the following steps:
step S2010, providing a preview window.
In an example of the present invention, a form creating function provided by the operating system may be called at step S2010 to provide a preview form for previewing the display contents of all displays.
In an example of the present invention, the step S2010 of providing a preview window may further include the following steps:
step S2011, providing a floating icon for calling out the preview window according to the opening operation, wherein the floating icon moves to the current display where the mouse pointer is located along with the mouse pointer.
According to the step S2011, in the extended mode, the plurality of displays 1030 are equivalent to splicing the display screens of the plurality of displays into a larger display screen to display the content configured and displayed by the processor 1020, and the mouse pointer stays on the display screen of one display according to the user operation, so that the user can move the floating icon to the display observed at the current viewing angle by moving the mouse, and further can call out the preview window through the floating icon without changing the current viewing angle.
In this example, providing the floating icon to move along with the mouse pointer may be performed by obtaining a current actual position of the mouse pointer, and moving the floating icon to a current display on which the mouse pointer is located or to the current actual position on which the mouse pointer is located according to the current actual position.
Step S2012, a preview form is provided on the display where the floating icon is located.
According to the step S2012, after the method of the embodiment of the present invention is started by the floating icon, a preview form is provided on the display where the floating icon is located.
After the preview window is provided, the user can drag the preview window by a mouse to move the preview window to other displays for displaying.
In step S2020, the display content of each display is captured.
According to this step S2020, the display content is a display screen on the display screen.
In one example of the invention, a screen capture function provided by the operating system may be invoked to capture the display content of each display.
In one example of the present invention, a screen capture tool provided by third-party software may be invoked to capture the display content of each display.
And step S2030, splicing and displaying the captured display content of each display in a preview window.
In an example of the present invention, the step S2030 splicing and displaying the captured display content of each display in the preview window may further include:
and S2031, splicing the captured display contents of each display into a picture.
In a further example of the present invention, the step S2031 of stitching the captured display content of each display into a picture may include the following steps:
step S2031a, acquiring resolutions and arrangements of the plurality of displays.
In an example of the present invention, after the method according to the embodiment of the present invention is started, the resolutions and the arrangement structures of the plurality of displays may be obtained according to the system setting and stored in the designated location, so that the resolutions and the arrangement structures of the plurality of displays may be directly obtained from the designated location each time the tile is performed, and the response speed is improved.
In one example of the invention, the resolution and arrangement of multiple displays may be obtained by a technician from a system setting when forming the method of the invention, and the data written directly into instructions for performing the method of an embodiment of the invention.
Step S2031b, according to the resolution and the arrangement structure of the plurality of displays, the captured display content of each display is spliced into a picture.
According to this step S2031b, the spliced picture will reflect the actual display effect of the extended display by the plurality of displays.
And step S2032, displaying the picture in a preview window.
In an example of the present invention, the step S2032 of displaying the picture in the preview window may further comprise the steps of:
step S2032a, obtaining the size ratio of the preview window to the picture.
Step S2032b, zooming the picture according to the size ratio to make the zoomed picture consistent with the size of the preview window.
Step S2032c, displaying the zoomed picture in the preview window.
According to the example of the invention, the picture content can be displayed by utilizing the preview window to the maximum extent so as to realize the clearest display.
In an example of the present invention, the capturing of the display content of each display in step S2020 above may further be: and capturing the current display content of each display at intervals of set time according to the timing setting of the timer so as to refresh the display content displayed by the preview window. Thus, the timed refresh of the content displayed in the preview window can be realized through step S2030.
The set time can be set according to the requirements of users, for example, the set time is set to be less than or equal to the time response capability of human eyes, so that the real-time refreshing of the content displayed by the preview window can be realized, and the smooth and unsmooth visual effect can be provided for the users.
For example, if the set time is 1s, the holding time of each frame of picture displayed by the preview window is 1s, the 1 st s displays the first frame of picture obtained by capturing and splicing, the 2 nd s refreshes and displays the second frame of picture obtained by capturing and splicing, the 3 rd s refreshes and displays the third frame of picture obtained by capturing and splicing, and so on.
According to the method provided by the embodiment of the invention, a user can simultaneously observe the display contents of the plurality of displays on any one of the plurality of displays through the preview window, so that the user can conveniently observe and operate the preview window, and particularly, the user experience can be greatly improved under the condition that the user cannot simultaneously observe the display contents of each display due to the arrangement positions of the plurality of displays.
FIG. 3 is a flow diagram of a method for presenting multi-display content according to another embodiment of the invention.
According to fig. 3, this embodiment is based on the embodiment shown in fig. 2, and further includes the following steps:
step S3010, after the display content of each display captured in step S2030 is displayed in a preview window in a splicing manner, acquiring a current actual position of the mouse pointer.
The current actual position may be an absolute position coordinate of the mouse pointer or a relative position coordinate of the mouse pointer, where the absolute position coordinate represents a position coordinate of the mouse pointer on a larger display screen obtained by splicing multiple displays, and the relative position coordinate represents a position coordinate of the mouse pointer on the display screen of the display where the mouse pointer is currently located.
And step S3020, determining the current preview position of the mouse pointer in the preview window according to the current actual position.
According to this step S3020, the current actual position of the mouse pointer on the display can be reflected by the current preview position of the mouse pointer on the preview window, i.e. the pixel content of the preview window at the current preview position is the same as the pixel content of the display at the current actual position.
Step S3030, providing a virtual mouse pointer at the current preview position of the preview window.
According to the step S3030, after the content displayed in the preview window is refreshed, the current preview position of the mouse pointer on the preview window is refreshed accordingly, so that the user can know the current actual position of the real mouse pointer by observing the virtual mouse pointer on the preview window, and can accurately complete the required operation by perceiving that the virtual mouse pointer on the preview window is moved, without changing the viewing angle to search for the real mouse pointer.
< example >
FIG. 4 is a flow diagram of a method for presenting multi-display content in accordance with an example of the present invention.
In this example, the method of the present invention may comprise the steps of:
step S4010, a preview form is provided according to the opening operation.
In step S4010, the user may perform an opening operation from the right-click menu of the floating icon, and call out the preview window.
In step S4020, a timer is started to set a set time for refresh.
In step S4030, display content of each display is captured.
And S4040, splicing and displaying the captured display content of each display in the preview window.
The step S4040 may further include:
step S4041, the resolution and the arrangement structure of the plurality of displays are obtained.
And S4042, splicing the captured display contents of each display into a picture according to the resolution and the arrangement structure of the plurality of displays.
Step S4043, obtaining the size ratio of the preview window and the picture, and zooming the picture according to the size ratio to make the zoomed picture consistent with the size of the preview window.
And step S4044, displaying the zoomed picture in a preview window.
Step S4050, the current actual position of the mouse pointer is obtained.
Step S4060, the current preview position of the mouse pointer in the preview window is determined according to the current actual position.
Step S4070, a virtual mouse pointer is provided at the current preview position of the preview window.
Step S4080, according to the set time of the timer, determines whether the refresh time has come, if so, returns to step S4030, and if not, continues to execute step S4080 to wait for the next refresh time to arrive.
In the process of executing the steps, if a closing operation triggered by a user is received, the method of the embodiment of the invention is stopped to close the preview window.
< apparatus embodiment >
FIG. 5 is a functional block diagram of an apparatus for presenting multi-display content in accordance with an embodiment of the present invention.
In this embodiment of the invention, multiple displays are connected to the same processor and are configured to display in an extended mode.
As shown in fig. 5, the apparatus of this embodiment of the present invention may include a window providing module 5010, a content grabbing module 5020 and a presentation module 5030.
The window providing module 5010 is used for providing a preview window.
The content grabbing module 5020 is used for grabbing the display content of each display.
The showing module 5030 is configured to splice and show the captured display content of each display in a preview window.
In an example of the present invention, the window providing module 5010 may be further configured to provide a floating icon for previewing the window according to the opening operation, where the floating icon moves to the current display where the mouse pointer is located along with the mouse pointer; and providing a preview form on the display on which the floating icon is located.
In an example of the present invention, the display module 5030 may further comprise a splicing unit and a picture display unit (not shown in the figure). The splicing unit is used for splicing the captured display contents of each display into a picture. The picture display unit is used for displaying the picture in the preview window.
In an example of the present invention, the splicing unit may be further configured to: and acquiring the resolution ratios and the arrangement structures of the plurality of displays, and splicing the display contents of each captured display into a picture according to the resolution ratios and the arrangement structures of the plurality of displays.
In an example of the present invention, the picture displaying unit may be further configured to: obtaining the size ratio of a preview window to a picture; zooming the picture according to the size proportion to enable the zoomed picture to be consistent with the size of the preview window; and displaying the zoomed picture in a preview window.
In an example of the present invention, the content grabbing module 5020 may be further configured to grab the current display content of each display at set time intervals according to the timer setting, so as to refresh the display content displayed in the preview window.
According to the device provided by the embodiment of the invention, a user can simultaneously observe the display contents of the plurality of displays on any one of the plurality of displays through the preview window, so that the user can conveniently observe and operate the device, and particularly, the user experience can be greatly improved under the condition that the user cannot simultaneously observe the display contents of each display due to the arrangement positions of the plurality of displays.
FIG. 6 is a functional block diagram of an apparatus for displaying multi-display content according to another embodiment of the present invention.
As shown in fig. 6, the apparatus according to this embodiment of the present invention further includes a mouse virtual module 6010 on the basis of the embodiment shown in fig. 5. The mouse virtual module 6010 is configured to obtain a current actual position of a mouse pointer; determining the current preview position of the mouse pointer in the preview window according to the current actual position; and providing a virtual mouse pointer at the current preview position of the preview window.
According to the device provided by the embodiment of the invention, a user can obtain the current actual position of the real mouse pointer by observing the virtual mouse pointer on the preview window, so that the user can perceive that the required operation can be accurately finished by moving the virtual mouse pointer on the preview window without changing the visual angle to search for the real mouse pointer.
The present invention may be a system, method and/or computer program product. The computer program product may include a computer-readable storage medium having computer-readable program instructions embodied therewith for causing a processor to implement various aspects of the present invention.
The computer readable storage medium may be a tangible device that can hold and store the instructions for use by the instruction execution device. The computer readable storage medium may be, for example, but not limited to, an electronic memory device, a magnetic memory device, an optical memory device, an electromagnetic memory device, a semiconductor memory device, or any suitable combination of the foregoing. More specific examples (a non-exhaustive list) of the computer readable storage medium would include the following: a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), a Static Random Access Memory (SRAM), a portable compact disc read-only memory (CD-ROM), a Digital Versatile Disc (DVD), a memory stick, a floppy disk, a mechanical coding device, such as punch cards or in-groove projection structures having instructions stored thereon, and any suitable combination of the foregoing. Computer-readable storage media as used herein is not to be construed as transitory signals per se, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through a waveguide or other transmission medium (e.g., optical pulses through a fiber optic cable), or electrical signals transmitted through electrical wires.
The computer-readable program instructions described herein may be downloaded from a computer-readable storage medium to a respective computing/processing device, or to an external computer or external storage device via a network, such as the internet, a local area network, a wide area network, and/or a wireless network. The network may include copper transmission cables, fiber optic transmission, wireless transmission, routers, firewalls, switches, gateway computers and/or edge servers. The network adapter card or network interface in each computing/processing device receives computer-readable program instructions from the network and forwards the computer-readable program instructions for storage in a computer-readable storage medium in the respective computing/processing device.
The computer program instructions for carrying out operations of the present invention may be assembler instructions, Instruction Set Architecture (ISA) instructions, machine-related instructions, microcode, firmware instructions, state setting data, or source or object code written in any combination of one or more programming languages, including an object oriented programming language such as Smalltalk, C + + or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The computer-readable program instructions may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider). In some embodiments, aspects of the present invention are implemented by personalizing an electronic circuit, such as a programmable logic circuit, a Field Programmable Gate Array (FPGA), or a Programmable Logic Array (PLA), with state information of computer-readable program instructions, which can execute the computer-readable program instructions.
Aspects of the present invention are described herein with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the invention. It will be understood that each block of the flowchart illustrations and/or block diagrams, and combinations of blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer-readable program instructions.
These computer-readable program instructions may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions/acts specified in the flowchart and/or block diagram block or blocks. These computer-readable program instructions may also be stored in a computer-readable storage medium that can direct a computer, programmable data processing apparatus, and/or other devices to function in a particular manner, such that the computer-readable medium storing the instructions comprises an article of manufacture including instructions which implement the function/act specified in the flowchart and/or block diagram block or blocks.
The computer readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other devices to cause a series of operational steps to be performed on the computer, other programmable apparatus or other devices to produce a computer implemented process such that the instructions which execute on the computer, other programmable apparatus or other devices implement the functions/acts specified in the flowchart and/or block diagram block or blocks.
The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present invention. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of instructions, which comprises one or more executable instructions for implementing the specified logical function(s). In some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions. It is well known to those skilled in the art that implementation by hardware, by software, and by a combination of software and hardware are equivalent.
Having described embodiments of the present invention, the foregoing description is intended to be exemplary, not exhaustive, and not limited to the embodiments disclosed. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described embodiments. The terms used herein were chosen in order to best explain the principles of the embodiments, the practical application, or technical improvements to the techniques in the marketplace, or to enable others of ordinary skill in the art to understand the embodiments disclosed herein. The scope of the invention is defined by the appended claims.