CN111221611B - Method for realizing synchronous switching of display pictures of multiple hosts - Google Patents

Method for realizing synchronous switching of display pictures of multiple hosts Download PDF

Info

Publication number
CN111221611B
CN111221611B CN202010005430.8A CN202010005430A CN111221611B CN 111221611 B CN111221611 B CN 111221611B CN 202010005430 A CN202010005430 A CN 202010005430A CN 111221611 B CN111221611 B CN 111221611B
Authority
CN
China
Prior art keywords
screen
split
picture
cross
frame
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202010005430.8A
Other languages
Chinese (zh)
Other versions
CN111221611A (en
Inventor
钱苏晋
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing E Techstar Co ltd
Original Assignee
Beijing E Techstar Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing E Techstar Co ltd filed Critical Beijing E Techstar Co ltd
Priority to CN202010005430.8A priority Critical patent/CN111221611B/en
Publication of CN111221611A publication Critical patent/CN111221611A/en
Application granted granted Critical
Publication of CN111221611B publication Critical patent/CN111221611B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs
    • G06F9/451Execution arrangements for user interfaces
    • G06F9/452Remote windowing, e.g. X-Window System, desktop virtualisation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1454Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Software Systems (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Processing Or Creating Images (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

The invention relates to the technical field of computers, and discloses a method for synchronously switching display pictures by a plurality of hosts, which comprises the following steps: s1) performing picture cross-screen splicing, wherein the picture cross-screen splicing is used for splitting a complete picture and splicing split-screen pictures into the complete picture through a plurality of split-screen hosts; s2) performing picture cross-screen synchronization, wherein the picture cross-screen synchronization is used for sending a synchronization message through a network, synchronizing the animation frame indexes of the split-screen pictures among a plurality of split-screen hosts, and controlling the frame synchronization of the animations on each split-screen host. Compared with the traditional command type picture synchronization, the invention greatly improves the visual synchronization effect of the picture content, and ensures that the cross-screen picture synchronization delay among a plurality of hosts is lower than 10MS; and when the synchronization effect is poor due to network delay and uneven resource load among a plurality of hosts, the invention can take remedial measures of rapid frame skip or short time pause to promote the visual synchronization effect.

Description

Method for realizing synchronous switching of display pictures of multiple hosts
Technical Field
The invention relates to the technical field of computers, in particular to a method for synchronously switching display pictures by a plurality of hosts.
Background
The traditional picture synchronization scheme among multiple hosts can only achieve command level synchronization, namely, commands for starting the animation are sent to multiple hosts at the same time, all hosts automatically execute the animation, when network delay exists and hardware loads of all hosts are uneven, picture dislocation easily occurs, visual picture asynchronization is shown, namely, pictures seen by human eyes are not a complete picture.
The objective defects existing in the prior art include:
1) The control instructions are sent to the multiple hosts simultaneously through the network, so that the problem of cross-screen animation starting deviation caused by network delay cannot be solved, the possibility that the occasions of starting the animations of the multiple hosts are inconsistent exists, part of the hosts are started first, and the other part of hosts are started later;
2) Because of different running environments of a plurality of hosts and different hardware resource loading conditions, it is difficult to ensure that the plurality of hosts keep the frame rate completely consistent on the rendering of the animation, and when the frame rate deviation exceeds a certain value, visual dislocation occurs.
Disclosure of Invention
The invention aims to provide a method for synchronously switching display pictures by a plurality of hosts, thereby solving the problems in the prior art.
In order to achieve the above purpose, the technical scheme adopted by the invention is as follows:
a method for realizing synchronous switching of display pictures of a plurality of hosts comprises the following steps:
s1) performing picture cross-screen splicing, wherein the picture cross-screen splicing is used for splitting a complete picture and splicing split-screen pictures into the complete picture through a plurality of split-screen hosts;
s2) performing picture cross-screen synchronization, wherein the picture cross-screen synchronization is used for sending a synchronization message through a network, synchronizing the animation frame indexes of the split-screen pictures among a plurality of split-screen hosts, and controlling the frame synchronization of the animations on each split-screen host.
Further, in step S1), performing a screen-crossing splicing of the frames, including the steps of:
s11) acquiring a complete picture, and splitting the complete picture into a plurality of split screen pictures;
s12) repeatedly rendering cross-screen content by each split-screen picture;
s13) designating the displacement of the split screen picture and limiting the size of the split screen window;
s14) shielding the repeatedly rendered cross-screen content through the displacement of the split-screen picture and the size of the split-screen window, so that each host computer only displays a part of the complete picture;
s15) splicing the display pictures of the split-screen hosts into a complete picture through the spliced display screen.
According to the invention, the complete picture is split into a plurality of split-screen pictures, each split-screen picture repeatedly renders the cross-screen content, the displacement of the split-screen picture is designated, the size of a split-screen window is limited, each host computer is shielded by the repeatedly rendered content, only a part of the complete picture is displayed by each host computer, and the display pictures of a plurality of host computers are spliced into a complete picture by the spliced display screen. The whole screen picture is split into a plurality of split screens through picture cross-screen splicing, each host computer only displays the split screen corresponding to the host computer, the content needing to be displayed in a cross-screen mode is required to be repeatedly rendered and shielded among a plurality of host computers, and the plurality of host computers all contain all the content needing to be displayed in a cross-screen mode.
Further, in step S2), the step of performing the cross-screen synchronization includes the steps of:
s21) sending interaction instructions to each split screen picture through a control program;
s22) acquiring an interaction instruction by the split screen picture, judging whether the interaction content in the interaction instruction relates to a cross-screen picture, and if so, entering a step S23); if not, not performing synchronous operation;
s23) the split screen picture sends cross-screen animation information to the synchronous server;
s24) starting a cross-screen animation;
s25) after the cross-screen animation is started, the split-screen picture sends a frame index of the cross-screen animation in the current split-screen picture to the synchronous server;
s26) the synchronization server waits for all split-screen pictures of the cross-screen animation to send frame indexes in preset time;
s27) when the frame indexes sent by all the split screen pictures are consistent or the time for waiting for sending the frame indexes of all the split screen pictures of the cross-screen animation exceeds the preset time, the synchronous server sends an instruction for executing the next frame animation to each split screen picture;
s28) receiving an instruction for executing the next frame by the split screen picture, setting the frame index of the cross-screen animation as the index of the next frame, and sending the frame index of the next frame to the synchronous server again;
s29) judging whether the execution of the cross-screen animation is ended, if not, returning to step S26): if yes, the picture cross-screen synchronization is completed.
The method comprises the steps that a split-screen host containing the split-screen content sends current frame indexes of the split-screen animation to a synchronous server, the synchronous server waits for the current frame indexes sent by all the split-screen hosts, after confirming that synchronization of the current frame indexes is completed, an instruction for executing a next frame is sent to each split-screen host, and after receiving the instruction for executing the next frame, all the split-screen hosts skip the split-screen animation to the next frame.
Further, the preset time in step S26) is 30 ms.
Further, in step S27), the instruction for executing the animation of the next frame includes an index value of the next frame, where the frame index value is a frame index recorded by the synchronization server, and the synchronization server adds 1 to the index value every time a frame is executed.
Further, in step S2), the method further includes setting the frame index in the next frame instruction sent to the split screen by the synchronization server to 0 after the last frame of the cross-screen animation is executed.
For the circularly executed cross-screen animation, after the last frame of the animation is executed, the frame index in the next frame instruction sent to the split-screen picture by the synchronous service is 0, namely, the execution of the cross-screen animation is restarted.
Further, in step S23), the cross-screen animation information includes a cross-screen picture name, a cross-screen animation name, a total frame number of the cross-screen animation, and a split-screen picture name.
Further, step S26) includes that the synchronization server waits for all the split-screen images of the cross-screen animation to send frame indexes within a preset time, and further includes judging whether the frame indexes of the split-screen images are lagged, if yes, using a frame skipping or short-time pause mode to speed up the cross-screen animation of the lagged split-screen images; if not, the process advances to step S27).
In the synchronization process, if the synchronization server judges that the frame index of a certain split screen picture is lagged, the frame of the lagged split screen picture is accelerated by adopting a frame skip or short-time pause mode, so that the frames of each split screen picture are kept synchronous to the maximum extent.
The beneficial effects of the invention are as follows: the invention repeatedly renders the cross-screen picture among the plurality of split-screen hosts, and then the splicing of the whole-screen picture is realized by shielding the repeated content, and the plurality of hosts realize picture synchronization among the plurality of hosts by reporting the current frame index to the synchronization server and controlling the playing time of the next frame of the animation by the synchronization service. Compared with the traditional command type synchronization, the visual synchronization effect of the picture content is greatly improved, and the cross-screen picture synchronization delay among a plurality of hosts is lower than 10MS. When the synchronization effect is poor due to network delay and uneven resource load among a plurality of hosts, the visual synchronization effect can be improved by adopting the method and the device for remedying the quick frame skip or short-time pause.
Drawings
Fig. 1 is a schematic diagram of a process of splicing pictures across screens in the first embodiment.
Fig. 2 is a schematic diagram of a synchronization animation frame index between a split screen and a synchronization server according to an embodiment.
Fig. 3 is a schematic diagram of a cross-screen synchronization process according to the first embodiment.
Detailed Description
The present invention will be described in further detail with reference to the accompanying drawings, in order to make the objects, technical solutions and advantages of the present invention more apparent. It should be understood that the detailed description is presented by way of example only and is not intended to limit the invention.
In a first embodiment, a method for implementing synchronous switching of display frames by multiple hosts includes:
s1) performing picture cross-screen splicing, wherein the picture cross-screen splicing is used for splitting a complete picture and splicing split-screen pictures into the complete picture through a plurality of split-screen hosts;
the cross-screen overlapping area in fig. 1 is a cross-screen picture, and the cross-screen picture includes a picture name attribute. The picture cross-screen splicing method comprises the following steps:
s11) acquiring a complete picture, and splitting the complete picture into a plurality of split screen pictures;
s12) repeatedly rendering cross-screen content by each split-screen picture;
s13) designating the displacement of the split screen picture and limiting the size of the split screen window;
s14) shielding the repeatedly rendered cross-screen content through the displacement of the split-screen picture and the size of the split-screen window, so that each host computer only displays a part of the complete picture;
s15) splicing the display pictures of the split-screen hosts into a complete picture through the spliced display screen.
S2) performing picture cross-screen synchronization, wherein the picture cross-screen synchronization is used for sending a synchronization message through a network, synchronizing the animation frame indexes of the split-screen pictures among a plurality of split-screen hosts, and controlling the frame synchronization of the animations on each split-screen host.
As shown in fig. 3, performing the cross-screen synchronization includes the steps of:
s21) sending interaction instructions to each split screen picture through a control program;
s22) acquiring an interaction instruction by the split screen picture, judging whether the interaction content in the interaction instruction relates to a cross-screen picture, and if so, entering a step S23); if not, not performing synchronous operation;
s23) the split screen picture sends cross-screen animation information to the synchronous server, wherein the cross-screen animation information comprises a cross-screen picture name, a cross-screen animation name, the total frame number of the cross-screen animation and the split screen picture name;
s24) starting a cross-screen animation;
s25) after the cross-screen animation is started, the split-screen picture sends a frame index of the cross-screen animation in the current split-screen picture to the synchronous server, and the principle of synchronizing the frame index of the animation between the split-screen picture and the synchronous server is shown in fig. 2;
s26) the synchronization server waits for all split screen pictures of the cross-screen animation to send frame indexes within 30 milliseconds; judging whether the frame index of the split screen picture is lagged, if so, accelerating the cross-screen animation of the lagged split screen picture in a frame skipping or short-time pause mode, so that the frame synchronization of the animation is kept to the maximum extent for each split screen picture; if not, go to step S27);
s27) when the frame indexes sent by all the split screen pictures are consistent or the time for waiting for sending the frame indexes of all the split screen pictures of the cross-screen animation exceeds 30 milliseconds, the synchronous server sends an instruction for executing the next frame animation to each split screen picture, wherein the instruction for executing the next frame animation comprises an index value of the next frame, the frame index value is the frame index recorded by the synchronous server, and the synchronous server adds 1 to the index value every time one frame is executed;
s28) receiving an instruction for executing the next frame by the split screen picture, setting the frame index of the cross-screen animation as the index of the next frame, and sending the frame index of the next frame to the synchronous server again;
s29) judging whether the execution of the cross-screen animation is ended, if not, returning to step S26): if yes, the picture cross-screen synchronization is completed.
After the last frame of the cross-screen animation is executed, setting the frame index in the next frame instruction sent to the split-screen picture by the synchronous server to be 0.
The invention realizes the process of synchronously switching display pictures of a plurality of hosts, and mainly comprises the steps of manufacturing a cross-screen picture, manufacturing a split-screen picture, shielding the repeated content of the cross-screen picture, sending the cross-screen animation information, sending a frame index, synchronizing the frame index and controlling the playing of the next frame.
By adopting the technical scheme disclosed by the invention, the following beneficial effects are obtained:
according to the invention, through repeated rendering of the cross-screen images, each frame of the cross-screen animation is accurately controlled, so that the display images are synchronously switched among a plurality of hosts, and the visual synchronization effect is greatly improved. The synchronization server controls the playing time of the next frame of the animation to realize picture synchronization among a plurality of hosts. Compared with the traditional command type synchronization, the invention not only greatly improves the visual synchronization effect of the picture content, but also enables the cross-screen picture synchronization delay among a plurality of hosts to be lower than 10MS. When the synchronization effect is poor due to network delay and uneven resource load among a plurality of hosts, remedial measures of quick frame skip or short-time pause can be taken to improve the visual synchronization effect.
The foregoing is merely a preferred embodiment of the invention, and it should be noted that modifications and adaptations to those skilled in the art may be made without departing from the principles of the invention, which is also intended to be covered by the present invention.

Claims (5)

1. The method for realizing synchronous switching of display pictures of a plurality of hosts is characterized by comprising the following steps:
s1) performing picture cross-screen splicing, wherein the picture cross-screen splicing is used for splitting a complete picture and splicing split-screen pictures into the complete picture through a plurality of split-screen hosts;
s2) performing picture cross-screen synchronization, wherein the picture cross-screen synchronization is used for sending a synchronization message through a network, synchronizing animation frame indexes of split-screen pictures among a plurality of split-screen hosts and controlling frame synchronization of animations on each split-screen host;
in the step S2), the picture cross-screen synchronization is carried out, and the method comprises the following steps:
s21) sending interaction instructions to each split screen picture through a control program;
s22) acquiring an interaction instruction by the split screen picture, judging whether the interaction content in the interaction instruction relates to a cross-screen picture, and if so, entering a step S23); if not, not performing synchronous operation;
s23) the split screen picture sends cross-screen animation information to the synchronous server; in step S23), the cross-screen animation information includes a cross-screen picture name, a cross-screen animation name, a total frame number of the cross-screen animation, and a split-screen picture name;
s24) starting a cross-screen animation;
s25) after the cross-screen animation is started, the split-screen picture sends a frame index of the cross-screen animation in the current split-screen picture to the synchronous server;
s26) the synchronization server waits for all split-screen pictures of the cross-screen animation to send frame indexes in preset time; step S26), the synchronization server waits for all the split-screen images of the cross-screen animation to send frame indexes within a preset time, and further comprises judging whether the frame indexes of the split-screen images are lagged, if so, accelerating the cross-screen animation of the lagged split-screen images in a frame skipping or short-time pause mode; if not, go to step S27);
s27) when the frame indexes sent by all the split screen pictures are consistent or the time for waiting for sending the frame indexes of all the split screen pictures of the cross-screen animation exceeds the preset time, the synchronous server sends an instruction for executing the next frame animation to each split screen picture;
s28) receiving an instruction for executing the next frame by the split screen picture, setting the frame index of the cross-screen animation as the index of the next frame, and sending the frame index of the next frame to the synchronous server again;
s29) judging whether the execution of the cross-screen animation is ended, if not, returning to step S26): if yes, the picture cross-screen synchronization is completed.
2. The method for synchronously switching display frames of a plurality of hosts according to claim 1, wherein the step S1) of performing the frame-crossing stitching comprises the steps of:
s11) acquiring a complete picture, and splitting the complete picture into a plurality of split screen pictures;
s12) repeatedly rendering cross-screen content by each split-screen picture;
s13) designating the displacement of the split screen picture and limiting the size of the split screen window;
s14) shielding the repeatedly rendered cross-screen content through the displacement of the split-screen picture and the size of the split-screen window, so that each host computer only displays a part of the complete picture;
s15) splicing the display pictures of the split-screen hosts into a complete picture through the spliced display screen.
3. The method for synchronously switching display screens of a plurality of hosts according to claim 1, wherein the preset time in step S26) is 30 ms.
4. The method for synchronously switching display images of multiple hosts according to claim 3, wherein in step S27), the instruction for executing the animation of the next frame includes an index value of the next frame, the frame index value is a frame index recorded by the synchronization server, and the synchronization server adds 1 to the index value every time a frame is executed.
5. The method for synchronously switching display frames of multiple hosts according to claim 3 or 4, wherein the step S2) of performing the cross-screen synchronization further comprises setting the frame index in the next frame instruction sent by the synchronization server to the split-screen frame to 0 after the last frame of the cross-screen animation is executed.
CN202010005430.8A 2020-01-03 2020-01-03 Method for realizing synchronous switching of display pictures of multiple hosts Active CN111221611B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010005430.8A CN111221611B (en) 2020-01-03 2020-01-03 Method for realizing synchronous switching of display pictures of multiple hosts

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010005430.8A CN111221611B (en) 2020-01-03 2020-01-03 Method for realizing synchronous switching of display pictures of multiple hosts

Publications (2)

Publication Number Publication Date
CN111221611A CN111221611A (en) 2020-06-02
CN111221611B true CN111221611B (en) 2023-11-24

Family

ID=70810670

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010005430.8A Active CN111221611B (en) 2020-01-03 2020-01-03 Method for realizing synchronous switching of display pictures of multiple hosts

Country Status (1)

Country Link
CN (1) CN111221611B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116156233A (en) * 2021-11-22 2023-05-23 华为终端有限公司 Display picture synchronization method and system and electronic equipment

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH02191065A (en) * 1989-01-20 1990-07-26 Fujitsu General Ltd Picture retrieving method
CN101587431A (en) * 2009-04-08 2009-11-25 广东威创视讯科技股份有限公司 Method for realizing multi-screen playing video
CN101841694A (en) * 2009-03-19 2010-09-22 新奥特硅谷视频技术有限责任公司 Court hearing panoramic video image relaying method
CN104168466A (en) * 2014-08-22 2014-11-26 广东威创视讯科技股份有限公司 Multi-screen video synchronous playing method and device
CN206226635U (en) * 2016-10-13 2017-06-06 上海分众软件技术有限公司 Across screen interaction systems
CN108495102A (en) * 2018-02-14 2018-09-04 中国科学院自动化研究所 Splice the seamless spliced fusion method of multi-projector of emerging system based on Unity
CN110418075A (en) * 2019-07-23 2019-11-05 中国航空无线电电子研究所 More desktop window videos are across screen Overlapping display method

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH02191065A (en) * 1989-01-20 1990-07-26 Fujitsu General Ltd Picture retrieving method
CN101841694A (en) * 2009-03-19 2010-09-22 新奥特硅谷视频技术有限责任公司 Court hearing panoramic video image relaying method
CN101587431A (en) * 2009-04-08 2009-11-25 广东威创视讯科技股份有限公司 Method for realizing multi-screen playing video
CN104168466A (en) * 2014-08-22 2014-11-26 广东威创视讯科技股份有限公司 Multi-screen video synchronous playing method and device
CN206226635U (en) * 2016-10-13 2017-06-06 上海分众软件技术有限公司 Across screen interaction systems
CN108495102A (en) * 2018-02-14 2018-09-04 中国科学院自动化研究所 Splice the seamless spliced fusion method of multi-projector of emerging system based on Unity
CN110418075A (en) * 2019-07-23 2019-11-05 中国航空无线电电子研究所 More desktop window videos are across screen Overlapping display method

Also Published As

Publication number Publication date
CN111221611A (en) 2020-06-02

Similar Documents

Publication Publication Date Title
US11016641B2 (en) Method and apparatus for taking screenshot of screen of application in mobile terminal
US10579241B2 (en) Optimizing window move actions for remoted applications
US8791877B2 (en) Image display system, image display device, and image display method
US11620784B2 (en) Virtual scene display method and apparatus, and storage medium
US11290689B2 (en) Method and system for synchronizing procedure videos for comparative learning
CN102193770B (en) Display device, terminal device, display system, display method and image modification method
US11467717B2 (en) Optimizing window resize actions for remoted applications
CN109842819B (en) Video playing interaction method, device, system, user terminal and medium
CN111221611B (en) Method for realizing synchronous switching of display pictures of multiple hosts
CN113900754A (en) Desktop sharing method and device, computer equipment and storage medium
EP4343512A1 (en) Control display method and apparatus, device, and medium
WO2023155561A1 (en) Method for splitting screen into left and right screens on linux-compatible android system
CN109218817B (en) Method and device for displaying virtual gift prompting message
CN109272923A (en) A kind of captions rolling display methods, system and storage medium based on multi-screen device
CN113868575A (en) Webpage same-screen method and system
CN106354491A (en) Picture processing method and device
CN104244065B (en) A kind of method and device of captions processing
US20230034959A1 (en) Window overlay display processing method and apparatus, and electronic device
CN109327693A (en) Anastomosing and splicing play system and its playback method for multi-projector
CN115586882A (en) Multi-device screen projection processing method and device and electronic device
CN115802092A (en) Multi-window display method based on interaction priority
CN115495185A (en) Method and device for displaying page elements
CN104133835B (en) A kind of method and apparatus that interface element is downloaded
CN111954056A (en) Video delivery method, device and system
CN104516694B (en) Image display method and electronic equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant