CN115576516A - Image synthesis method, image synthesis system, electronic device, and storage medium - Google Patents
Image synthesis method, image synthesis system, electronic device, and storage medium Download PDFInfo
- Publication number
- CN115576516A CN115576516A CN202211587461.4A CN202211587461A CN115576516A CN 115576516 A CN115576516 A CN 115576516A CN 202211587461 A CN202211587461 A CN 202211587461A CN 115576516 A CN115576516 A CN 115576516A
- Authority
- CN
- China
- Prior art keywords
- window
- terminal device
- synthesis
- equipment
- terminal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000015572 biosynthetic process Effects 0.000 title claims abstract description 114
- 238000003786 synthesis reaction Methods 0.000 title claims abstract description 114
- 238000001308 synthesis method Methods 0.000 title claims abstract description 30
- 238000000034 method Methods 0.000 claims abstract description 25
- 238000007781 pre-processing Methods 0.000 claims abstract description 18
- 239000000203 mixture Substances 0.000 claims description 41
- 230000002194 synthesizing effect Effects 0.000 claims description 37
- 238000004590 computer program Methods 0.000 claims description 14
- 238000004364 calculation method Methods 0.000 claims description 11
- 238000012216 screening Methods 0.000 claims description 4
- 238000005516 engineering process Methods 0.000 abstract description 4
- 238000004519 manufacturing process Methods 0.000 abstract description 3
- 238000010586 diagram Methods 0.000 description 18
- 230000006870 function Effects 0.000 description 9
- 238000004891 communication Methods 0.000 description 7
- 239000002131 composite material Substances 0.000 description 6
- 230000001413 cellular effect Effects 0.000 description 3
- 230000008569 process Effects 0.000 description 3
- 238000012545 processing Methods 0.000 description 3
- 230000001131 transforming effect Effects 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 2
- 230000002035 prolonged effect Effects 0.000 description 2
- 230000009466 transformation Effects 0.000 description 2
- 238000013519 translation Methods 0.000 description 2
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/1454—Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/451—Execution arrangements for user interfaces
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Software Systems (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The present application relates to the field of terminal display technologies, and in particular, to an image synthesis method, an image synthesis system, an electronic device, and a storage medium. The method comprises the following steps: receiving a first synthesis request sent by first terminal equipment; the first synthesis request comprises the synthesis of a window of the first terminal device and/or the second terminal device and is displayed on the first terminal device and/or the second terminal device; receiving the window sent by the first terminal equipment and/or the second terminal equipment through a window receiving module based on the first synthesis request; carrying out first preprocessing operation on the received windows, acquiring products of each window subjected to preprocessing operation and the corresponding weighted value, and summing the products to obtain a synthesized window; and sending the synthesis window to the first terminal device and/or the second terminal device for displaying. The image synthesis method can reduce the use of the CPU and the memory of the terminal equipment, prolong the endurance of the terminal equipment, improve the application performance, reduce the manufacturing cost of the terminal equipment and the like.
Description
Technical Field
The present application relates to the field of terminal display technologies, and in particular, to an image synthesis method, an image synthesis system, an electronic device, and a storage medium.
Background
At present, in common terminal devices, a plurality of windows are synthesized inside the terminal device itself, and then the synthesized windows are displayed on a hardware screen of the terminal device itself. When the terminal device needs to share the window content, the window content can be transmitted to another terminal device through wireless devices or wired connection, and the combined window content is displayed on another terminal device.
However, when the terminal device synthesizes the window, the CPU and the memory of the current terminal device are undoubtedly occupied, and if there are many window tables to be synthesized, the usability of the terminal device may even be reduced.
Disclosure of Invention
In order to solve or partially solve the above problems, the present application provides an image synthesis method, an image synthesis system, an electronic device, and a storage medium, which can synthesize a window by a window synthesis device independent of a terminal device, thereby reducing a CPU, a memory, and the like of the terminal device.
In a first aspect, an embodiment of the present application provides an image synthesis method, which is applied to a window synthesis device independent of a terminal device, where the window synthesis device includes a window receiving module, a window synthesis module, and a forwarding module, the terminal device includes a first terminal device and a second terminal device, and the window synthesis device is connected to the first terminal device and the second terminal device, respectively, and the method includes:
receiving a first synthesis request sent by the first terminal equipment; the first synthesis request comprises a window of the first terminal device and/or the second terminal device, and is displayed on the first terminal device and/or the second terminal device;
receiving, by the window receiving module, a window transmitted by the first terminal device and/or the second terminal device based on the first composition request;
carrying out first preprocessing operation on the received window through the window synthesis module, and acquiring and summing products of each window subjected to preprocessing operation and a corresponding weighted value to obtain a synthesized window;
and sending the synthesized window to the first terminal equipment and/or the second terminal equipment for displaying through the forwarding module.
In a second aspect, the present application further provides an electronic device comprising a processor, a memory, and a computer program stored on the memory and executable by the processor, wherein the computer program, when executed by the processor, implements the steps of the image synthesis method as described above.
In a third aspect, the present application further provides an image synthesis system, which includes a window synthesis device and a terminal device connected to the window synthesis device, where the window synthesis device is configured to execute the steps of the image synthesis method described above.
In a fourth aspect, the present application further provides a computer-readable storage medium having a computer program stored thereon, where the computer program, when executed by a processor, implements the steps of the image synthesis method as described above.
Compared with the prior art, the image synthesis method provided by the embodiment of the application comprises the following steps: receiving a first synthesis request sent by the first terminal equipment; the first synthesis request comprises a window of the first terminal device and/or the second terminal device, and is displayed on the first terminal device and/or the second terminal device; receiving, by the window receiving module, a window transmitted by the first terminal device and/or the second terminal device based on the first composition request; carrying out first preprocessing operation on the received windows through the window synthesis module, and acquiring and summing products of each window subjected to preprocessing operation and a corresponding weighted value to obtain a synthesized window; and sending the synthesis window to the first terminal device and/or the second terminal device for display through the forwarding module. The method and the device can separate the work of synthesizing the part from the terminal equipment and synthesize the part by the external independent window synthesizing equipment, so that the CPU and the memory of the terminal equipment are reduced, the endurance of the terminal equipment is prolonged, the application performance is improved, the manufacturing cost of the terminal equipment is reduced, and the like.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the application.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
Fig. 1 is a schematic flowchart of a first image synthesis method according to an embodiment of the present invention.
Fig. 2 is a schematic structural diagram of a terminal device serving as a window receiver according to an embodiment of the present invention.
Fig. 3 is a schematic structural diagram of a terminal device serving as a window provider according to an embodiment of the present invention.
Fig. 4 is a schematic structural diagram of a terminal device serving as both a window provider and a window receiver according to an embodiment of the present invention.
Fig. 5 is a schematic structural diagram of connection between a first terminal device and a window synthesis device according to an embodiment of the present invention.
Fig. 6 is a schematic structural diagram of connection between a first terminal device, a second terminal device, and a window synthesis device according to an embodiment of the present invention.
Fig. 7 is a flowchart illustrating a second image synthesis method according to an embodiment of the present invention.
Fig. 8 is a schematic structural diagram of a connection between a first terminal device, a second terminal device, and a window synthesis device according to an embodiment of the present invention.
Fig. 9 is a flowchart illustrating sub-steps of a second image synthesis method according to an embodiment of the present invention.
Fig. 10 is a schematic structural diagram of an electronic device according to an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some, but not all, of the embodiments of the present application. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
Some embodiments of the present application will be described in detail below with reference to the accompanying drawings. The embodiments described below and the features of the embodiments can be combined with each other without conflict.
It is to be understood that the terminology used in the description of the present application herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the application. As used in the specification of the present application and the appended claims, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise.
It should be understood that, for the convenience of clearly describing the technical solutions of the embodiments of the present application, the words "first", "second", and the like are used in the embodiments of the present application to distinguish the same items or similar items with basically the same functions and actions. For example, the first and second grooves are only used for distinguishing different grooves, and the sequence thereof is not limited. Those skilled in the art will appreciate that the terms "first," "second," and the like do not denote any order or importance, but rather the terms "first," "second," and the like do not denote any order or importance.
It should be further understood that the term "and/or" as used in this specification and the appended claims refers to and includes any and all possible combinations of one or more of the associated listed items.
Before introducing the embodiments of the present application, a term proprietary in some industry fields is explained first:
window (Window) provider capability of terminal device: the ability to generate Window content may capture information to generate a Window by means of an optical or acoustic sensor, or the terminal itself may generate a Window in some way. Before generating the window, the terminal device needs to have the capability of accessing the network, including the capability of transmitting the window content in the terminal device to the window synthesizing device through wireless and/or wired technologies.
Window receiver capability of terminal device: transmitting the window content to the terminal equipment through wireless and wired technologies; in addition, the terminal device also has the capability of displaying window content through the display screen of the terminal device, and the display mode can include a 2D mode or a 3D mode and the like.
The terminal device referred to in this application includes, but is not limited to, a device capable of receiving and/or transmitting communication signals connected via any one or more of the following connection methods.
(1) Via wireline connections, such as Public Switched Telephone Network (PSTN), digital Subscriber Line (DSL), digital cable, direct cable connections.
(2) Via a Wireless interface means such as a cellular network, a Wireless Local Area Network (WLAN), a digital television network such as a DVB-H network, a satellite network, an AM-FM broadcast transmitter.
A terminal device arranged to communicate over a wireless interface may be referred to as a "mobile terminal". Examples of the mobile terminal include, but are not limited to, the following electronic devices.
(1) Satellite phones or cellular phones.
(2) A Personal Communications System (PCS) terminal that may combine a cellular radiotelephone with data processing, facsimile and data Communications capabilities.
(3) Radio telephones, pagers, internet/intranet access, web browsers, notebooks, calendars, personal Digital Assistants (PDAs) equipped with Global Positioning System (GPS) receivers.
(4) Conventional laptop and/or palmtop receivers.
(5) Conventional laptop and/or palmtop radiotelephone transceivers, and the like.
Some embodiments of the present application will be described in detail below with reference to the accompanying drawings. The embodiments and features of the embodiments described below can be combined with each other without conflict.
Referring to fig. 1, fig. 1 is a schematic flow chart of a first image synthesis method according to an embodiment of the present invention. The method is applied to window synthesis equipment independent of terminal equipment, the window synthesis equipment comprises a window receiving module, a window synthesis module and a forwarding module, the terminal equipment comprises first terminal equipment and second terminal equipment, the window synthesis equipment is respectively connected with the first terminal equipment and the second terminal equipment, and the method comprises the steps of S100-S400:
step S100, receiving a first synthesis request sent by the first terminal equipment; the first composition request comprises composition of a window of the first terminal device and/or the second terminal device, and the window is displayed on the first terminal device and/or the second terminal device.
The first terminal device and the second terminal device can be connected with the window synthesis device in a wireless or wired mode. When the user wants to compose the window of the first terminal device and/or the second terminal device, the window composition device may receive the first composition request by sending the first composition request through the first terminal device.
The present application is described by taking an example that a first terminal device sends a first composition request, and actually, the first composition request may also be sent to a second terminal device, or the first terminal device and the second terminal device send composition requests to a window composition terminal respectively.
It should be noted that, in some scenarios, the first terminal device and the second terminal device may also be the same device.
For convenience of understanding the window providing and window receiving functions of the first terminal device, referring to fig. 2, fig. 3 and fig. 4, fig. 2 is a schematic structural diagram of a terminal device provided in an embodiment of the present invention as a window receiver, fig. 3 is a schematic structural diagram of a terminal device provided in an embodiment of the present invention as a window provider, and fig. 4 is a schematic structural diagram of a terminal device provided in an embodiment of the present invention as both a window provider and a window receiver. The first terminal device, the second terminal device may also act as a window receiver and/or a window provider. In fig. 2, the terminal device may be a Window receiver, that is, a Window receiver, and windows 1 and 2 are displayed on the screen, where windows 1 and 2 may be represented by windows after windows 1 and windows 2 are combined. In fig. 3, the terminal device may be a Window provider, and Window1, window2, and Window3 are shown in the dashed boxes of fig. 3, which represent three windows. In fig. 4, the terminal device can be used as a Window provider and a Window receiver, and the left part in fig. 4 also shows three windows 1, 2, and 3 that are not synthesized, and the right part shows a Window where windows 1 and 2 are synthesized.
Wherein the window providing and window receiving functions may be configured by a user in advance.
Step S200, receiving, by the window receiving module, a window sent by the first terminal device and/or the second terminal device based on the first combination request.
After the window synthesis device receives the first synthesis request, the window receiving module receives the window of the first terminal device and/or the second terminal device according to the instruction of the first synthesis request; the number of windows is typically at least two.
Step S300, performing a first preprocessing operation on the received window through the window synthesis module, and obtaining and summing products of each window after the preprocessing operation and the corresponding weighted value to obtain a synthesized window.
Typically, the number of windows to be synthesized is two or more. The window synthesis device may synthesize the received two or more windows to be synthesized by the window synthesis module. The specific synthetic operation comprises the following steps:
1) And carrying out first preprocessing operation on the window to be synthesized. Preprocessing operations include, but are not limited to, scaling, rotating, translating, flipping, transforming, superimposing, and the like.
2) And multiplying and summing the window subjected to the preprocessing operation and the corresponding weighted value to obtain a synthesized window.
In order to enable some problems to occur in the composite window, such as a window flipping, which causes the content displayed in the composite window to also flip, in a further aspect of the present application, the method further includes: and carrying out second preprocessing operation on the obtained summation result to obtain a synthesis window.
In summary, the synthesis window Z can be obtained by synthesizing according to the following formula:
Z=g（∑aifi(wi)）（1）
where wi is the ith Window to be synthesized, i is a positive integer, f is the first preprocessing operation performed on the Window, including but not limited to scaling, rotation, translation, flipping, transformation, and superposition, a is a weighted value, and g is the second preprocessing operation performed on the previous calculation result before the final Window is generated.
Step S400, the composite window is sent to the first terminal device and/or the second terminal device for displaying through the forwarding module.
To facilitate understanding of the above scheme, exemplarily, referring to fig. 5, fig. 5 is a schematic structural diagram of a connection between a first terminal device and a window synthesizing device according to an embodiment of the present invention. In this case, the first terminal device and the second terminal device are the same terminal device. That is, the first terminal device may be a Window receiver, that is, a Window receiver; the specific window synthesis method comprises the following steps:
11 The first terminal device sends a first composition request to the window composition device, which indicates that two windows on the first terminal device are to be composed, respectively: window1 and window 2.
12 The window synthesizing device processes the first synthesizing request again to obtain the window1 and the window2, synthesizes the window1 and the window2, sends the synthesized window to the first terminal device again, and displays the synthesized window1 and the synthesized window2 through the first terminal device, where the synthesized window is shown as the right part of the terminal device in fig. 5.
Referring to fig. 6 again, fig. 6 is a schematic structural diagram of connection between the first terminal device, the second terminal device, and the window synthesizing device according to the embodiment of the present invention. In this case, the first terminal device and the second terminal device are not one device, the first terminal device may serve as a window provider, and the second terminal device may serve as a window receiver. The specific window synthesis method comprises the following steps:
22 Second terminal device sends a composition request to the window composition device, indicating that it wants to compose window1 and window3 of the first terminal device;
23 Window composition device forwards a composition request to the first terminal device indicating that it is desired to compose window1 and window 3; the first terminal equipment sends the data of the window1 and the window3 to the window synthesis equipment;
24 Window composition device composes window1 and window3 to obtain a composite window, and transmits the composite window to the second terminal device and/or the first terminal device, and the second terminal device and/or the first terminal device displays the composite window on the screen.
Further, in the embodiment of the present application, referring to fig. 7, fig. 7 is a schematic flowchart of a second image synthesis method according to the embodiment of the present invention. The terminal equipment further comprises third terminal equipment, the window synthesis equipment is further connected with the third terminal equipment, and the first synthesis request comprises a window synthesized by the first terminal equipment and is displayed on the second terminal equipment; the method further comprises steps S500-S900.
Step S500, obtaining a second composition request sent by the third terminal device, where the second composition request includes composition of a window on the first terminal device and is displayed on the third terminal device.
Step S600, determining a window to be synthesized according to the first synthesis request and the second synthesis request.
According to the first synthesis request and the second synthesis request, determining the following three conditions of the window to be synthesized:
A. when the first combination request comprises combining windows on the first terminal device and the second request comprises combining windows on said first terminal device, it may be determined that the windows to be combined are all from the first terminal device, so there may be overlapping windows.
B. When the first combination request includes combining windows on the second terminal device, and the second request includes combining windows on the first terminal device, it may be determined that the windows to be combined are from the first terminal device and the second terminal device, respectively, so there is no overlapping window.
C. When the first combination request includes combining windows on the first terminal device and the second terminal device, and the second request includes combining windows on the first terminal device, it may be determined that the windows to be combined are from the first terminal device and the second terminal device, respectively, and because the windows on the first terminal device are included in both the first combination request and the second combination request, there may be overlapping windows in this case.
In order to accelerate the composition rate, in the embodiment of the present application, the determining a window to be composed according to the first composition request and the second composition request includes steps S601 to S603.
Step S601, determining a first window to be synthesized in the first synthesis request according to the first synthesis request.
Step S602, according to the second combination request, determining a second window to be combined in the first combination request.
And step S603, performing union set on the first window and the second window to obtain a window to be synthesized.
In the process of union set calculation, when the first window and the second window may both include the same window on the same device, a duplicate window exists at this time, so the duplicate window is removed by a union set calculation method.
For the case a, when the first composition request includes the window1 and the window2 of the first terminal device, and the second composition request includes the window1 and the window3 of the first terminal device, the union set is obtained, and the window to be composed includes the window1, the window2, and the window 3.
For the case B, for example, when the first composition request may include the window1 and the window2 of the second terminal device, and the second composition request may include the window1 and the window3 of the second terminal device, the union set may be obtained, and the window to be composed includes the window1 and the window2 on the first terminal device; window1, window3 on the second terminal device.
For case C, when the first composition request includes window1, window2 of the first terminal device; the window1 and the window2 of the second terminal device, the second synthesis request includes the window1 and the window3 of the first terminal device, and at this time, the union set is solved, and the window to be synthesized including the window1, the window2 and the window3 of the first terminal device can be obtained; and window1, window2 of the second terminal device.
Step S700, obtaining, by the receiving module, the window to be synthesized from the first terminal device, or obtaining the window to be synthesized from the first terminal device and the second terminal device, respectively.
And after the window to be synthesized is determined, acquiring the window to be synthesized from the first terminal device or the first terminal device and the second terminal device through the receiving module.
Step S800, according to the first synthesis request, screening out and synthesizing corresponding windows from the windows to be synthesized, and sending the windows to the second terminal equipment through the forwarding module so as to display the windows on the second terminal equipment.
And S900, screening and synthesizing corresponding windows from the windows to be synthesized according to the second synthesis request, and sending the windows to the third terminal equipment through the forwarding module for displaying at the third terminal equipment.
Further, before the step of receiving the first composition request sent by the first terminal device, the method further includes:
receiving a registration instruction of the first terminal device and/or the second terminal device; judging whether the first terminal equipment and/or the second terminal equipment are/is trustable equipment; and if the first terminal device and/or the second terminal device are/is an untrusted device, refusing to receive the registration instruction of the first terminal device and/or the second terminal device within a preset time period.
When a new terminal device is connected to the window composition device, the method may further include: receiving a registration instruction sent by the new terminal equipment, and judging whether the new terminal equipment is trusted equipment or not; and if the new terminal equipment is the untrusted equipment, refusing to receive the registration instruction of the new terminal equipment within a preset time period.
For example, the first terminal device and the fourth terminal device are configured as trusted terminals in advance. At the moment, the first terminal device, the second terminal device, the third terminal device and the fourth terminal device respectively send registration instructions to the window synthesis device; in order to increase the combining rate, the first terminal device, the second terminal device, the third terminal device, and the fourth terminal device may report the capabilities of their Window providers and Window receivers to the Window combining device, respectively, while sending the registration instruction.
The window synthesis device respectively returns registration response messages to the first terminal device, the second terminal device, the third terminal device and the fourth terminal device, and informs a registration result: the first terminal equipment and the fourth terminal equipment are successfully registered; and the second terminal equipment and the third terminal equipment are failed to register, and the second terminal equipment and the third terminal equipment are forbidden to register again within a preset time period.
The preset time period may be 10 seconds, 1 hour, or the like, and may be specifically determined according to an actual situation.
To improve safety, the method further comprises: when the device continuously sends the registration instruction to the window synthesis device within the preset time period, the device may be included in the blacklist, and after the device is included in the blacklist, the registration instruction sent by the terminal device is not received any more permanently.
In an embodiment of the present application, the first terminal device is further connected to another window composition device, and before the step of composing the received window by the window composition module, the method further includes the steps of: if the calculated amount of the current window synthesis equipment is larger than a preset calculation threshold, determining the window synthesis equipment with the maximum network speed connected with the first terminal equipment; and transferring part of the task of the current window synthesis device to the window synthesis device with the maximum network speed connected with the first terminal device, wherein the first terminal device is the terminal device of the synthesis window to be displayed.
According to the method, the step of synthesizing the window synthesizing equipment with the fastest network speed with the terminal equipment of the synthesized window to be displayed can be selected by comparing the network speeds between the plurality of window synthesizing equipment and the terminal equipment of the synthesized window to be displayed, so that the synthesizing efficiency is greatly reduced.
Illustratively, the first terminal device, the second terminal device, the third terminal device, the fourth terminal device, the fifth terminal device, the sixth terminal device, the seventh terminal device, the eighth terminal device, the Window synthesizing device 2, and the Window synthesizing device 3 register with the Window synthesizing device 1, respectively, and report their own Window provider, window receiver capability, and Window synthesizing device capability (the first terminal device, the second terminal device, the third terminal device, the fourth terminal device, the fifth terminal device, and the sixth terminal device are Window providers, and the seventh terminal device and the eighth terminal device are Window receivers).
31 Seventh terminal device sends a synthesis request to Window synthesis device 1, which indicates that it is desired to synthesize windows contained in first terminal device, second terminal device, third terminal device, fourth terminal device, and fifth terminal device, and finally displays them on seventh terminal device;
32 Seventh terminal device sends a composition request to Window composition device 1, indicating that it is desired to compose windows contained in the first terminal device, the second terminal device, the third terminal device, the fourth terminal device, the fifth terminal device, and the sixth terminal device; the window synthesis device 1 respectively forwards a synthesis request to a first terminal device, a second terminal device, a third terminal device, a fourth terminal device, a fifth terminal device and a sixth terminal device, and receives windows sent by the first terminal device, the second terminal device, the third terminal device, the fourth terminal device, the fifth terminal device and the sixth terminal device;
33 The window synthesizing apparatus 1 judges the size of the synthesized calculation amount and a preset calculation threshold, and if the current calculation amount exceeds the preset calculation threshold, transfers part of the synthesizing work to other window synthesizing apparatuses; for example, after the window synthesizing device 1 determines that the network speed between the seventh terminal device and the window synthesizing device 3 is fast, the window synthesizing device 3 forwards the synthesizing task to the window synthesizing device 3, and the window synthesizing device 3 receives and synthesizes the windows sent by the first terminal device, the second terminal device, the third terminal device, the fourth terminal device, the fifth terminal device, and the sixth terminal device.
In addition, this application further scheme still includes: the current window synthesis equipment judges whether the self calculation workload exceeds a preset range, and if so, the current window synthesis equipment prohibits receiving the synthesis tasks forwarded by other window synthesis equipment.
By the scheme, the excessive calculation workload of certain window synthesis equipment can be avoided, and the window synthesis rate is reduced.
It should be noted that, in the embodiment of the present application, the window synthesis device may further support multiple functions, including but not limited to: zooming, rotating, translating, overturning, transforming and superposing; and a quick synthesis function is also supported, namely, the Window provider only needs to provide the geometric rule and the color rule of Window.
Referring to fig. 8, fig. 8 is a schematic structural diagram of a connection between a first terminal device, a second terminal device and a window synthesizing device according to an embodiment of the present invention. The image synthesis method comprises the following steps:
41 The first terminal device and the second terminal device register with the Window synthesis device respectively and report the capabilities of own Window provider and Window receiver;
42 The second terminal device sends a composition request to the window composition device, indicating that it is desired to compose window1 and window2, and in particular, geometric rule operations such as scaling, rotating, translating, flipping, transforming, superimposing, and the like, or color operations are required for window 1;
43 Window composition apparatus forwards composition request to first terminal equipment, indicate that want to synthesize window1 and window 2; the first terminal equipment sends window1 and window2 data to the window synthesis equipment, and particularly directly sends window2 geometric rules and color rules due to the fact that the content of the window2 is simple;
44 Window synthesis equipment performs operations such as scaling, rotation, translation, turning, transformation, superposition and the like on the window1, synthesizes the window2 according to geometric rules and color rules, and then transmits the synthesized windows 1 and 2 to second terminal equipment; the second terminal device displays the synthesized windows 1, 2 on the screen.
Through the mode, the windows of the terminal devices can be synthesized respectively through the window synthesis device independent of the first terminal device, the second terminal device and other terminal devices, and the synthesized windows are displayed on the corresponding terminal devices to be displayed, so that the use of a cpu and a memory of the terminal devices can be reduced, the endurance of the terminal devices can be prolonged, the application performance can be improved, the manufacturing cost of the terminal devices can be reduced, and the like.
On the other hand, the embodiment of the present application further provides an image synthesis system, which includes a window synthesis device and a terminal device connected to the window synthesis device, where the window synthesis device is configured to execute the steps of the image synthesis method.
Each module in the window synthesis device corresponds to each step in the embodiment of the image synthesis method, and the functions and implementation processes thereof are not described in detail herein.
Fig. 10 shows an electronic device, and fig. 10 is a schematic structural diagram of an electronic device according to an embodiment of the present invention. The electronic device 50 may include a processor (CPU, GPU, FPGA, etc.) 501, which may perform some or all of the processing in the embodiments shown in the above-described figures, according to a program stored in a Read Only Memory (ROM) 502 or a program loaded from a storage section 508 into a Random Access Memory (RAM) 503. In the RAM503, various programs and data necessary for system operation are also stored. The processor 501, the ROM502, and the RAM503 are connected to each other by a bus 504. An input/output (I/O) interface 505 is also connected to bus 504.
The following components are connected to the I/O interface 505: an input portion 506 including a keyboard, a mouse, and the like; an output portion 507 including a display such as a Cathode Ray Tube (CRT), a Liquid Crystal Display (LCD), and the like, and a speaker; a storage portion 508 including a hard disk and the like; and a communication section 509 including a network interface card such as a LAN card, a modem, or the like. The communication section 509 performs communication processing via a network such as the internet. A drive 510 is also connected to the I/O interface 505 as needed. A removable medium 511 such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, or the like is mounted on the drive 510 as necessary, so that a computer program read out therefrom is mounted on the storage section 508 as necessary.
In particular, according to embodiments of the present application, the method described above with reference to the figures may be implemented as a computer software program. For example, embodiments of the present application include a computer program product comprising a computer program tangibly embodied on a medium readable thereby, the computer program comprising program code for performing the methods of the figures. In such an embodiment, the computer program may be downloaded and installed from a network through the communication section 509, and/or installed from the removable medium 511.
The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present application. In this regard, each block in the flowcharts or block diagrams may represent a module, a program segment, or a portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
The units or modules described in the embodiments of the present application may be implemented by software or hardware. The units or modules described may also be provided in a processor, and the names of the units or modules do not in some cases constitute a limitation on the units or modules themselves.
As another aspect, the present application also provides a computer-readable storage medium, which may be the computer-readable storage medium included in the above embodiments; or it may be a separate computer readable storage medium not incorporated into the device. The computer-readable storage medium stores one or more programs for use by one or more processors in performing the image synthesis methods described herein.
While the invention has been described with reference to specific embodiments, the scope of the invention is not limited thereto, and those skilled in the art can easily conceive various equivalent modifications or substitutions within the technical scope of the invention. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.
Claims (10)
1. An image synthesis method is applied to window synthesis equipment independent of terminal equipment, the window synthesis equipment comprises a window receiving module, a window synthesis module and a forwarding module, the terminal equipment comprises a first terminal equipment and a second terminal equipment, the window synthesis equipment is respectively connected with the first terminal equipment and the second terminal equipment, and the method comprises the following steps:
receiving a first synthesis request sent by the first terminal equipment; the first synthesis request comprises a window for synthesizing the first terminal device and/or the second terminal device and is displayed on the first terminal device and/or the second terminal device;
receiving, by the window receiving module, a window transmitted by the first terminal device and/or the second terminal device based on the first composition request;
carrying out first preprocessing operation on the received window through the window synthesis module, and acquiring and summing products of each window subjected to preprocessing operation and a corresponding weighted value to obtain a synthesized window;
and sending the synthesis window to the first terminal device and/or the second terminal device for display through the forwarding module.
2. The image synthesizing method according to claim 1, wherein the terminal device further includes a third terminal device, the window synthesizing device is further connected to the third terminal device, and the first synthesizing request includes synthesizing the window of the first terminal device and is displayed on the second terminal device; the method further comprises the following steps:
acquiring a second synthesis request sent by the third terminal device, wherein the second synthesis request comprises a window synthesized on the first terminal device and is displayed on the third terminal device;
determining a window to be synthesized according to the first synthesis request and the second synthesis request;
acquiring the window to be synthesized from the first terminal device through the receiving module, or respectively acquiring the window to be synthesized from the first terminal device and the second terminal device;
according to the first synthesis request, screening and synthesizing corresponding windows from the windows to be synthesized, and sending the windows to the second terminal equipment through the forwarding module so as to display the windows on the second terminal equipment;
and screening out and synthesizing corresponding windows from the windows to be synthesized according to the second synthesis request, and sending the windows to the third terminal equipment through the forwarding module so as to display the windows at the third terminal equipment.
3. The image synthesis method according to claim 2, wherein the determining a window to be synthesized according to the first synthesis request and the second synthesis request includes:
determining a first window to be synthesized in the first synthesis request according to the first synthesis request;
determining a second window to be synthesized in the first synthesis request according to the second synthesis request;
and solving a union set of the first window and the second window to obtain a window to be synthesized.
4. The image synthesis method according to claim 1, wherein before the step of receiving the first synthesis request transmitted by the first terminal device, the method further comprises:
receiving a registration instruction of the first terminal device and/or the second terminal device;
judging whether the first terminal equipment and/or the second terminal equipment are/is trustable equipment;
and if the first terminal equipment and/or the second terminal equipment are/is not trustable equipment, refusing to receive the registration instruction of the first terminal equipment and/or the second terminal equipment within a preset time period.
5. The image synthesis method according to claim 1, further comprising:
and when the terminal equipment continuously sends a registration instruction to the window synthesis equipment within a preset time period, the terminal equipment is included in a blacklist.
6. The image synthesis method according to claim 1, wherein the first terminal device is further connected to other window synthesis devices, and before the steps of performing a first preprocessing operation on the received window by the window synthesis module, acquiring and summing products of each preprocessed window and the corresponding weighted value to obtain a synthesized window, the method further comprises:
if the calculated amount of the current window synthesis equipment is larger than a preset calculation threshold value, determining the window synthesis equipment with the maximum network speed connected with the first terminal equipment;
and transferring the synthesized window task of the current window synthesizing equipment to the window synthesizing equipment with the maximum internet speed connected with the first terminal equipment.
7. The image synthesis method according to claim 1, further comprising:
and carrying out second preprocessing operation on the obtained summation result to obtain a synthesis window.
8. An electronic device, characterized in that the electronic device comprises a processor, a memory, and a computer program stored on the memory and executable by the processor, wherein the computer program, when executed by the processor, implements the steps of the image composition method according to any one of claims 1 to 7.
9. An image synthesis system comprising a window synthesis device for executing the steps of the image synthesis method according to any one of claims 1 to 7, and a terminal device connected to the window synthesis device.
10. A computer-readable storage medium, having stored thereon a computer program, wherein the computer program, when executed by a processor, implements the steps of the image synthesis method according to any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211587461.4A CN115576516A (en) | 2022-12-12 | 2022-12-12 | Image synthesis method, image synthesis system, electronic device, and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211587461.4A CN115576516A (en) | 2022-12-12 | 2022-12-12 | Image synthesis method, image synthesis system, electronic device, and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN115576516A true CN115576516A (en) | 2023-01-06 |
Family
ID=84590395
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202211587461.4A Pending CN115576516A (en) | 2022-12-12 | 2022-12-12 | Image synthesis method, image synthesis system, electronic device, and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115576516A (en) |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101984661A (en) * | 2010-11-23 | 2011-03-09 | 广东威创视讯科技股份有限公司 | Information transmission method of video conference system and video conference system |
| CN104462223A (en) * | 2014-11-11 | 2015-03-25 | 三星电子（中国）研发中心 | Web browsing method and device based on peer-to-peer network model |
| US20150294646A1 (en) * | 2014-04-09 | 2015-10-15 | Hon Hai Precision Industry Co., Ltd. | Display apparatus and method for displaying screen images from multiple electronic devices |
| CN105739771A (en) * | 2016-01-29 | 2016-07-06 | 广东欧珀移动通信有限公司 | Display interface management method and device as well as terminal |
| CN113590061A (en) * | 2021-07-01 | 2021-11-02 | 深圳康佳电子科技有限公司 | Screen projection control method and device, intelligent terminal and computer readable storage medium |
| CN113613072A (en) * | 2021-08-02 | 2021-11-05 | 海信视像科技股份有限公司 | Multi-path screen projection display method and display equipment |
| CN114071058A (en) * | 2021-11-01 | 2022-02-18 | 广州广哈通信股份有限公司 | Video transmission control method, device, medium and equipment for video conference |
| CN114489533A (en) * | 2020-11-13 | 2022-05-13 | 华为技术有限公司 | Screen projection method and device, electronic equipment and computer readable storage medium |
| CN115220906A (en) * | 2021-04-15 | 2022-10-21 | 辉达公司 | Cloud execution of audio/video synthesis applications |
| CN115270104A (en) * | 2022-07-20 | 2022-11-01 | 深圳乐播科技有限公司 | Screen projection management method and device and electronic equipment |
-
2022
- 2022-12-12 CN CN202211587461.4A patent/CN115576516A/en active Pending
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101984661A (en) * | 2010-11-23 | 2011-03-09 | 广东威创视讯科技股份有限公司 | Information transmission method of video conference system and video conference system |
| US20150294646A1 (en) * | 2014-04-09 | 2015-10-15 | Hon Hai Precision Industry Co., Ltd. | Display apparatus and method for displaying screen images from multiple electronic devices |
| CN104462223A (en) * | 2014-11-11 | 2015-03-25 | 三星电子（中国）研发中心 | Web browsing method and device based on peer-to-peer network model |
| CN105739771A (en) * | 2016-01-29 | 2016-07-06 | 广东欧珀移动通信有限公司 | Display interface management method and device as well as terminal |
| CN114489533A (en) * | 2020-11-13 | 2022-05-13 | 华为技术有限公司 | Screen projection method and device, electronic equipment and computer readable storage medium |
| CN115220906A (en) * | 2021-04-15 | 2022-10-21 | 辉达公司 | Cloud execution of audio/video synthesis applications |
| CN113590061A (en) * | 2021-07-01 | 2021-11-02 | 深圳康佳电子科技有限公司 | Screen projection control method and device, intelligent terminal and computer readable storage medium |
| CN113613072A (en) * | 2021-08-02 | 2021-11-05 | 海信视像科技股份有限公司 | Multi-path screen projection display method and display equipment |
| CN114071058A (en) * | 2021-11-01 | 2022-02-18 | 广州广哈通信股份有限公司 | Video transmission control method, device, medium and equipment for video conference |
| CN115270104A (en) * | 2022-07-20 | 2022-11-01 | 深圳乐播科技有限公司 | Screen projection management method and device and electronic equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9474103B2 (en) | Portable information terminal, a control method for a portable information terminal, a program of a method of controlling a personal information terminal and a recording medium having recorded therein a program of a method of controlling a personal information terminal | |
| US20120015673A1 (en) | Visual Representation of Contact Location | |
| EP1932321A1 (en) | System and method of obtaining directions to scheduling events | |
| KR101166651B1 (en) | Method and system for offering location information | |
| US8217983B2 (en) | Video communication terminal and method of road guidance using the same | |
| EP1326377A2 (en) | Method of selecting a communication interface to transmit data in a wireless communication network | |
| US6973324B2 (en) | Method of enabling the transmission of data in a wireless communication network | |
| JP4551546B2 (en) | Server device of network system and control method thereof | |
| CN111245845A (en) | Data processing method based on mobile edge calculation in space-ground heterogeneous network | |
| US6947760B2 (en) | Method of optimizing the transmission of data in a wireless communication network | |
| US7813968B2 (en) | Method and apparatus for bidding on broadcast service requests and offers from nearby devices | |
| CN112256371A (en) | Method and device for displaying information and electronic equipment | |
| CN112256231A (en) | Volume control method, device, terminal and storage medium | |
| US20090327310A1 (en) | Methods for providing access to files on an electronic device using a phone number for authentication and related electronic devices and computer program products | |
| CN113162836B (en) | Virtual local area network communication method and device, cloud server, medium and electronic equipment | |
| CN115576516A (en) | Image synthesis method, image synthesis system, electronic device, and storage medium | |
| CN114666736A (en) | Location subscription method and device | |
| KR20110044012A (en) | Apparatus and method for providing navigation service using video call terminals | |
| CN112243219A (en) | Display device, terminal control method and device, terminal and storage medium | |
| EP1685737A1 (en) | Method and system for providing service to wireless devices operating in a power saving mode | |
| CN115776657B (en) | Management system suitable for 5G public and private network cross-domain roaming | |
| WO2023036257A1 (en) | Image processing method and apparatus | |
| CN117149338A (en) | System interface switching method, network isolation method, device and electronic equipment | |
| US20240104703A1 (en) | Method and apparatus for adjusting image brightness, electronic device, and medium | |
| CN111489286A (en) | Picture processing method, device, equipment and medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20230106 |
|
| RJ01 | Rejection of invention patent application after publication |