CN115802092A - Multi-window display method based on interaction priority - Google Patents
Multi-window display method based on interaction priority Download PDFInfo
- Publication number
- CN115802092A CN115802092A CN202211448801.5A CN202211448801A CN115802092A CN 115802092 A CN115802092 A CN 115802092A CN 202211448801 A CN202211448801 A CN 202211448801A CN 115802092 A CN115802092 A CN 115802092A
- Authority
- CN
- China
- Prior art keywords
- signal
- rendering
- thread
- background
- window
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Landscapes
- Processing Or Creating Images (AREA)
Abstract
The invention discloses a multi-window display method based on interaction priority, which comprises the following steps of 1, establishing a background rendering thread; step 2, creating a sharing canvas; step 3, establishing a signal buffer queue; step 4, sending and receiving signals; step 5, rendering; and 6, compensating and rendering. The background rendering thread designed in the invention realizes timely response to user operation through mechanisms such as signal de-duplication, priority screening, interruption and the like; and in the compensation rendering, secondary image processing is performed by combining the rendering result of the background thread at a fixed frequency with the current operation state of a user, so that the continuous change of the window image is realized, and a better display effect is achieved. The invention can realize the continuous updating of the image when the user operates the window, improves the fluency of the user operation in the interface under the condition of not influencing the dynamic refreshing of the data, and improves the on-duty efficiency of the user.
Description
Technical Field
The invention relates to a dynamic data real-time display method in a ship traffic management system, in particular to a multi-window display method based on interactive priority.
Background
The terminal software of the VTS has higher requirements on the fluency of interaction, and is mainly embodied in that the system must respond in time when a user drags, zooms and the like on a window. Meanwhile, the system needs to continuously perform dynamic display of multiple types of data in multiple windows, the data are displayed in the windows in different layers, including a chart, an area, a radar video, a target, a track, an alarm and the like, and the data are continuously changed. And each window is spliced to form a complete supervision district by displaying data at different positions. The data refresh rate and the response time of user operation are important indexes for showing whether the user experience of the terminal interface is good or not.
At present, VTS systems running on line are all 2D graphics-based application programs, graphical interfaces are rendered by using a CPU, and a single-thread-based UI framework is generally used, that is, a main thread for processing interface update cannot be parallelized, so the response speed of interface interaction depends on the main frequency of the CPU to a great extent.
In general, when a GUI window application is designed, a graphic drawing logic is usually called by a main thread directly, a VTS system needs to display a large amount of data updated in real time at a high refresh rate, and if all data are drawn by the main thread, the data are stuck and slow response time of user operation. Aiming at the scene, the drawing logic needs to be split into the background worker threads as much as possible by combining with the service characteristics, an interaction channel between the main thread and the worker threads is established, the worker threads mainly process data rendering, and the main thread processes user operation, so that the main thread is idle as much as possible, and the data presentation and response speed are considered.
The inventor develops a multi-window display method based on interactive priority based on the analysis, and the background rendering thread designed in the invention realizes timely response to user operation through mechanisms such as signal duplicate removal, priority screening, interruption and the like. The compensation rendering designed in the invention carries out secondary image processing by combining the result of rendering the background thread at a fixed frequency with the current operation state of a user, thereby realizing the continuous change of the window image and achieving better display effect.
Disclosure of Invention
The technical problem to be solved by the present invention is to provide a multi-window display method based on interaction priority, which can realize continuous updating of images while window operation is performed by a user, improve fluency of user operation in an interface without affecting dynamic refreshing of data, and improve duty efficiency of the user.
In order to solve the technical problems, the invention adopts the technical scheme that:
a multi-window display method based on interaction priority comprises the following steps.
Step 1, establishing a background rendering thread: in a VTS system, a background rendering thread is created for background processing of rendering logic.
Step 4, sending and receiving signals:
on one hand, the main thread receives system information of an operating system through a system information array, wherein the system information comprises a user instruction and timer information; and the main thread triggers rendering logic of the background rendering thread through the signal buffer array.
The main thread sending signals stored by the signal buffer array comprise user operation signals and timer signals; wherein the processing priority of the user operation signal is higher than that of the timer signal;
and the background rendering thread on one hand calls the signals in the signal buffer array and on the other hand informs the system message array of the main thread of a rendering completion signal of each frame of image.
And step 5, rendering: and the background rendering thread renders the data in the window of the VTS system according to the signals in the signal buffer array, temporarily stores the rendered image in a shared canvas, and waits for the calling of the main thread.
And when the signal in the signal buffer array is a timer signal, the background rendering thread triggers the background rendering thread to perform rendering logic on all windows at regular time.
And when the signal in the signal buffer array is a user operation signal, the background rendering thread suspends the timed rendering triggered by the timer signal, preferentially processes the user operation signal, and performs rendering logic on the designated window according to a command used in the user operation signal.
And 6, compensation rendering: the main thread carries out compensation rendering on the image generated by the background rendering thread so as to ensure that the background rendering result and the mouse operation of the user are completely synchronous, and the image finally displayed on the window has continuous change trend.
In step 4, the user instruction includes pan, zoom, fixed point pan, fixed point zoom, and yaw.
In step 5, when the background rendering thread calls the signal from the signal buffer array, the call signal needs to be filtered, the repeated signal is removed, and only the latest signal is executed.
In step 5, the rendering frequency is 1 second/time when the background rendering thread is rendering.
In the rendering process of the step 5, the background rendering thread also checks the latest signal in the signal buffer array at a set frequency, and when the signal buffer array has the latest signal, the current rendering is skipped and the image in the rendering is written into the shared canvas.
In step 5, the user operation signal comprises a translation signal, a zoom signal, a fixed point translation signal, a fixed point zoom signal and a deflection signal; the priority order of the user operation signal and the timer signal is as follows: a pan signal = a zoom signal = a fixed point pan signal = a fixed point zoom signal = a deflection signal > a timer signal; the background rendering thread carries out preprocessing when receiving the signals of the signal buffer array, firstly carries out duplicate removal on the signals with the same priority and only executes the latest signals; for signals of different priorities, only the higher priority is performed.
When the signal in the signal buffer array is a user operation signal, the background rendering thread immediately stops the timing rendering triggered by the timer signal, and executes the user operation signal to achieve the priority response of the user operation; after one complete rendering is interrupted or completed, a pair of images can be obtained, the pair of images is firstly written into the shared canvas of the corresponding window, and the main thread is informed in a Windows message mode. And after receiving the notification, the main thread copies the image from the shared canvas and pastes the image to a corresponding window.
And (6) supplementary rendering in the step, namely, zooming, translating and rotating the image by calling a graphic display interface of an operating system.
The invention has the following beneficial effects:
1. the background rendering thread designed in the invention realizes the timely response to the user operation through the mechanisms of signal de-duplication, priority screening, interruption and the like; and in the compensation rendering, secondary image processing is performed by combining the rendering result of the background thread at a fixed frequency with the current operation state of a user, so that the continuous change of the window image is realized, and a better display effect is achieved.
2. The invention can realize the continuous updating of the image when the user operates the window, improves the fluency of the user operation in the interface under the condition of not influencing the dynamic refreshing of the data, and improves the duty efficiency of the user.
Drawings
Fig. 1 is an overall schematic diagram of a multi-window display method based on interaction priority according to the present invention.
FIG. 2 is a flow chart of a multi-window display method based on interaction priority according to the present invention.
FIG. 3 is a schematic diagram of step 1 creating a background rendering thread.
Fig. 4 is a schematic diagram of step 3 creating a signal buffer queue.
Fig. 5 is a schematic diagram of step 4 transmitting and receiving signals.
Fig. 6 is a flowchart of the processing of the step 5 rendering.
Fig. 7 is a schematic diagram of step 6 compensation rendering.
Fig. 8 is a flowchart of supplementary explanation of transmitting and receiving signals based on step 4.
Fig. 9 is a timing chart of a supplementary explanation based on step 5 rendering.
Detailed Description
The present invention will be described in further detail with reference to the accompanying drawings and specific preferred embodiments.
In the description of the present invention, it is to be understood that the terms "left side", "right side", "upper part", "lower part", etc., indicate orientations or positional relationships based on those shown in the drawings, and are only for convenience of describing the present invention and simplifying the description, but do not indicate or imply that the referred device or element must have a specific orientation, be constructed in a specific orientation, and be operated, and that "first", "second", etc., do not represent an important degree of the component parts, and thus are not to be construed as limiting the present invention. The specific dimensions used in the present example are only for illustrating the technical solution and do not limit the scope of protection of the present invention.
As shown in fig. 1 and 2, a multi-window display method based on interaction priority includes the following steps.
Step 1, establishing background rendering thread
As shown in fig. 3, in the VTS system, a background rendering thread is created for background processing of rendering logic.
Unlike the main thread, the background rendering thread does not directly process the user operation instruction, but only takes charge of drawing the data to be displayed into the designated canvas. And the time-consuming rendering logic is put in the background to process the threads, so that the main thread is light enough.
The shared canvas is a bridge for data exchange between the background thread and the main thread, the background thread temporarily stores the regularly rendered image to the shared canvas and informs the main thread, and the main thread takes out the image from the shared canvas and pastes the image to a window, and the process is repeatedly executed;
the background rendering thread has only one, but each window has a corresponding shared canvas.
As shown in fig. 4, a signal buffer queue is created between the main thread and the background rendering thread, which can store the sending signal of the main thread and trigger the rendering logic of the background rendering thread.
The main thread has two sources of sending signals, namely, the operation of a user on the base map and a timer, and the two types of signals are added into a signal buffer queue in sequence. The background rendering thread sequentially takes out the signals from the queue and processes the signals, and if the signals are user operation signals, a chart engine interface is called; if it is a timer signal, the rendering logic is executed.
Step 4, sending and receiving signals
As shown in fig. 5 and 8, the main thread receives system messages of the operating system on the one hand through the system message array, and the system messages comprise user instructions and timer messages.
The user instruction preferably includes pan, zoom, fixed point pan, fixed point zoom, and yaw. The system message array is a system-level data structure provided by the operating system for each application program, and all key and mouse messages of a user in a program interface are sent to the main thread for circular processing by the queue. The system message array and the main thread are automatically created by the operating system, one and only one.
And the main thread triggers rendering logic of the background rendering thread through the signal buffer array. The signal buffer array is also a self-defined queue, is a data structure of a message queue of a simulation operating system, and is used for driving the continuous cycle running of a background worker thread, the self-defined queue only comprises operating signals of a window base map by a user, and mainly comprises translation, positioning, scaling and the like, and the self-defined queue and the background rendering thread are created by a program developer, and only one of the self-defined queue and the background rendering thread is provided.
The main thread sending signals stored by the signal buffer array comprise user operation signals and timer signals; wherein the processing priority of the user operation signal is higher than that of the timer signal.
And the background rendering thread retrieves the signals in the signal buffer array on one hand and notifies a rendering completion signal of each frame of image to a system message array of the main thread on the other hand.
The operations of the user on the translation, the scaling and the like of the window need to call a chart engine, and the data rendering also needs to call an engine interface. Here, in order to ensure that preemption of threads by thread synchronization has a large effect on the overall performance, it is necessary to put the execution of user operations in the rendering thread, and execute and take effect together with the rendering of data.
Different operations of a user on the base map are abstracted into different signals, namely translation, scaling, fixed-point translation, fixed-point scaling and deflection, and the operation signals are specific to a certain specific window. Since the data itself is continuously changed, a timer signal is also needed for timing the rendering of the latest data, and the timing signal is global and used for triggering the rendering process of all windows. The queue for exchanging signals between the main thread and the rendering thread is a signal buffer queue, and the in-out queue is thread-safe.
As shown in fig. 6 and 9, the background rendering thread renders the data in the VTS system window according to the signal in the signal buffer array, and temporarily stores the rendered image in the shared canvas to wait for the main thread to call.
The rendering thread mainly works to render data and form images, the data in the VTS system window is layered, different data are displayed in different layers, and one complete rendering process is to finish the drawing of all the layers in sequence and write the final result for display into a canvas.
And the background rendering thread sequentially renders the data in each window at the frequency of 1 second/time, temporarily stores the data in respective shared canvas, and sequentially informs the main thread, and the main thread is attached to the respective window.
And when the signal in the signal buffer array is a timer signal, the background rendering thread triggers the background rendering thread to perform rendering logic on all windows in a timed mode.
And when the signal in the signal buffer array is the user operation signal, the background rendering thread suspends the timing rendering triggered by the timer signal, preferentially processes the user operation signal, and performs rendering logic on the designated window according to a command used in the user operation signal.
The user operation signal preferably includes a panning signal, a zooming signal, a fixed point panning signal, a fixed point zooming signal, and a deflection signal; the priority order of the user operation signal and the timer signal is as follows: pan signal = scale signal = fixed point pan signal = fixed point scale signal = deflection signal > timer signal; the background rendering thread carries out preprocessing when receiving signals of the signal buffer array, firstly carries out de-duplication on the signals with the same priority and only executes the latest signals; for signals of different priorities, only the higher priority is performed.
When the signal in the signal buffer array is a user operation signal, the background rendering thread immediately stops the timing rendering triggered by the timer signal, and executes the user operation signal to achieve the priority response of the user operation; after one complete rendering is interrupted or completed, a pair of images can be obtained, the pair of images is firstly written into the shared canvas of the corresponding window, and the main thread is informed in a Windows message mode. And after receiving the notification, the main thread copies the image from the shared canvas and pastes the image to a corresponding window.
When the background rendering thread calls the signals from the signal buffer array, the call signals need to be filtered, repeated signals are removed, and only the latest signals are executed. The filtering signal can reduce the processing amount of the rendering thread, prevent the signal buffer queue from generating extrusion, avoid the delay of the response to the operation of a user and further improve the response speed. The filtered signal can still accurately reflect the final operation state of the user.
In the process of rendering, the background rendering thread also checks the latest signal in the signal buffer array at a set frequency, and when the latest signal exists in the signal buffer array, the current rendering is skipped out and the image in the rendering is written into the shared canvas.
And 6, compensation rendering: as shown in FIG. 7, the main thread performs compensation rendering on the image generated by the rendering of the background rendering thread, so as to ensure that the results of the background rendering and the mouse operation of the user are completely synchronized, and the trend of the image finally displayed on the window is continuous.
During supplementary rendering, zooming, translation and rotation processing of the image are realized by calling a graphic display interface of an operating system.
Generally, the operation (translation, zoom, etc.) of a user on a certain window is continuous, but the rendering of data by the background rendering thread is triggered and executed by a timer at a fixed frequency, and the rendering triggered by the operation signal cannot ensure that the result of background rendering and the mouse operation of the user are completely synchronous due to signal filtering and delay. In order to make the image finally displayed on the window continuous, the image generated by the background thread needs to be compensated.
For example, a user operates to perform fixed-point zooming on a certain window, and the zooming in process is performed by 3 times as follows. 1 signal (amplified by 2 times) is generated in the mouse rolling process, and the background rendering thread performs rendering amplified by 2 times. The scroll wheel has scrolled 3 times as the image is pasted onto the window, so the compensated rendering continues to magnify the image by 1.5 times.
And 7, repeating the steps 4 to 6, and repeatedly and circularly executing the steps to realize smooth experience of data display and user operation.
As is well known, a general 2D application program in a Windows platform is constructed based on a UI framework of a single-thread model, that is, only one thread for operating a UI interface, that is, a main thread. Windows maintains a message queue for each application program, and user operation instructions and timing messages are sent to the main thread through the queue and are processed uniformly. The VTS system processes the dragging and zooming operation of a user on the base map while rendering and refreshing a large amount of dynamic data, and if the rendering is processed in a main thread, the operation of the user is likely to be jammed. The invention can refresh and display a large amount of data in a plurality of windows at the same time in real time, and simultaneously ensures the fluency of the operation (translation, zooming and the like) of a user in any window. In the implementation process, the system fully embodies the principle of priority of user operation, namely the priority of the user operation is higher than that of the timed refresh, and the system preferentially allocates all computing resources to the processing logic of the user operation, so that the interface response speed is improved. When the operation of the user is very frequent, the system automatically skips the intermediate signal by arranging the de-duplication and only executes the latest signal, thereby taking into account the display accuracy and the response timeliness. And performing secondary compensation processing on the result of the background rendering thread, so that the window content is smoothly refreshed along with the operation of a user.
Although the preferred embodiments of the present invention have been described in detail, the present invention is not limited to the details of the embodiments, and various equivalent modifications can be made within the technical spirit of the present invention, and the scope of the present invention is also within the scope of the present invention.
Claims (8)
1. A multi-window display method based on interaction priority is characterized in that: the method comprises the following steps:
step 1, establishing a background rendering thread: in a VTS system, a background rendering thread is created for background processing rendering logic;
step 2, creating a sharing canvas: creating a plurality of shared canvas between a background rendering thread and a main thread; each shared canvas can realize data exchange between the background rendering thread and the main thread;
step 3, creating a signal buffer queue: a signal buffer queue is established between the main thread and the background rendering thread, and can store the sending signal of the main thread and trigger the rendering logic of the background rendering thread;
step 4, sending and receiving signals:
on one hand, the main thread receives system information of an operating system through a system information array, wherein the system information comprises a user instruction and timer information; on the other hand, the main thread triggers rendering logic of the background rendering thread through the signal buffer array;
the main thread sending signals stored by the signal buffer array comprise user operation signals and timer signals; wherein, the processing priority of the user operation signal is higher than that of the timer signal;
the background rendering thread retrieves signals in the signal buffer array on one hand and notifies a rendering completion signal of each frame of image to a system message array of the main thread on the other hand;
step 5, rendering: the background rendering thread renders data in a VTS system window according to signals in the signal buffer array, temporarily stores rendered images in a shared canvas, and waits for the calling of the main thread;
when the signal in the signal buffer array is a timer signal, the background rendering thread triggers the background rendering thread to perform rendering logic on all windows in a timing manner;
when the signal in the signal buffer array is a user operation signal, the background rendering thread suspends the timing rendering triggered by the timer signal, preferentially processes the user operation signal, and performs rendering logic on the designated window according to a command used in the user operation signal;
and 6, compensation rendering: the main thread carries out compensation rendering on the image generated by the background rendering thread so as to ensure that the background rendering result and the mouse operation of the user are completely synchronous, and the image finally displayed on the window has continuous change trend.
2. The multi-window display method based on interaction priority according to claim 1, wherein: in step 4, the user instruction includes pan, zoom, fixed point pan, fixed point zoom, and yaw.
3. The multi-window display method based on interaction priority of claim 1, wherein: in step 5, when the background rendering thread calls the signal from the signal buffer array, the call signal needs to be filtered, the repeated signal is removed, and only the latest signal is executed.
4. The multi-window display method based on interaction priority according to claim 1, wherein: in step 5, the rendering frequency is 1 second/time when the background rendering thread is rendering.
5. The multi-window display method based on interaction priority according to claim 1, wherein: in the rendering process of step 5, the background rendering thread also checks the latest signal in the signal buffer array at a set frequency, and when the latest signal is in the signal buffer array, the current rendering is skipped and the image in the rendering is written into the shared canvas.
6. The multi-window display method based on interaction priority according to claim 2, wherein: in step 5, the user operation signal comprises a translation signal, a scaling signal, a fixed point translation signal, a fixed point scaling signal and a deflection signal; the priority order of the user operation signal and the timer signal is as follows: a pan signal = a zoom signal = a fixed point pan signal = a fixed point zoom signal = a deflection signal > a timer signal; the background rendering thread carries out preprocessing when receiving the signals of the signal buffer array, firstly carries out duplicate removal on the signals with the same priority and only executes the latest signals; for signals of different priorities, only the higher priority is performed.
7. The multi-window display method based on interaction priority according to claim 1, wherein: when the signal in the signal buffer array is a user operation signal, the background rendering thread immediately stops the timing rendering triggered by the timer signal, and executes the user operation signal to achieve the priority response of the user operation; after one complete rendering is interrupted or completed, a pair of images can be obtained, the pair of images is firstly written into the shared canvas of the corresponding window, and the main thread is informed in a Windows message mode; and after receiving the notification, the main thread copies the image from the shared canvas and pastes the image to a corresponding window.
8. The multi-window display method based on interaction priority of claim 1, wherein: and (6) supplementary rendering in the step, namely, zooming, translating and rotating the image by calling a graphic display interface of an operating system.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211448801.5A CN115802092A (en) | 2022-11-18 | 2022-11-18 | Multi-window display method based on interaction priority |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211448801.5A CN115802092A (en) | 2022-11-18 | 2022-11-18 | Multi-window display method based on interaction priority |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN115802092A true CN115802092A (en) | 2023-03-14 |
Family
ID=85439009
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202211448801.5A Pending CN115802092A (en) | 2022-11-18 | 2022-11-18 | Multi-window display method based on interaction priority |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115802092A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117130774A (en) * | 2023-04-28 | 2023-11-28 | 荣耀终端有限公司 | Thread acceleration processing method and device |
-
2022
- 2022-11-18 CN CN202211448801.5A patent/CN115802092A/en active Pending
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117130774A (en) * | 2023-04-28 | 2023-11-28 | 荣耀终端有限公司 | Thread acceleration processing method and device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109410698B (en) | Data large-screen visualization method and system | |
| CN101548277B (en) | The computer graphics system of multiple parallel processor | |
| JP2024505995A (en) | Special effects exhibition methods, devices, equipment and media | |
| CN109375980B (en) | Touch drawing method based on Andriod system | |
| US11494209B2 (en) | Multi-active browser application | |
| CN115802092A (en) | Multi-window display method based on interaction priority | |
| EP4242839A1 (en) | Page switching display method and apparatus, storage medium, and electronic device | |
| WO2023273854A9 (en) | Control display method and apparatus, device, and medium | |
| US20030016223A1 (en) | Drawing apparatus | |
| JPH01200480A (en) | Control of computer graphic system | |
| CN103581505A (en) | Digital video signal processing device and method | |
| US20240071283A1 (en) | Independent refresh rate for multiple monitors | |
| CN112130739B (en) | Touch screen display frame adjusting method and device, touch screen equipment and storage medium | |
| CN111857902B (en) | Application display method, device, equipment and readable storage medium | |
| WO2023221822A1 (en) | Data processing method, electronic device, and readable storage medium | |
| WO2023246302A1 (en) | Subtitle display method and apparatus, device and medium | |
| CN102087465B (en) | Method for directly assigning and displaying true three-dimensional simulation regions | |
| CN113253965B (en) | Mass data multi-view-port visual interaction method, system, equipment and storage medium | |
| CN112241303B (en) | Image processing method and system, electronic device and storage medium | |
| CN111221611B (en) | Method for realizing synchronous switching of display pictures of multiple hosts | |
| CN111385521B (en) | Method for distributed display of user interface and decoding equipment | |
| CN115639920B (en) | Drawing method, electronic device, and readable storage medium | |
| JP3238728B2 (en) | Image processing device and user terminal device | |
| CN115509478A (en) | Device and method for controlling multi-screen splicing display and multi-screen splicing display system | |
| CN114331807A (en) | Static image processing method, device and system and computer readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |