CN118093069A

CN118093069A - View drawing method, view drawing device and storage medium

Info

Publication number: CN118093069A
Application number: CN202211505522.8A
Authority: CN
Inventors: 黄依楷; 周至捷
Original assignee: Beijing Xiaomi Mobile Software Co Ltd
Current assignee: Beijing Xiaomi Mobile Software Co Ltd
Priority date: 2022-11-28
Filing date: 2022-11-28
Publication date: 2024-05-28

Abstract

The present disclosure relates to a view drawing method, a view drawing apparatus, and a storage medium. The view drawing method comprises the following steps: responding to the terminal triggered to draw display views frame by frame based on synchronous signal frames, and determining theoretical values of each drawing time length required for respectively drawing each display view; in response to determining that at least two display views meeting a target condition exist in each display view, adjusting the at least two display views to draw within a specified duration; the target condition comprises that the theoretical value of the total drawing time length of the at least two display views is smaller than or equal to the specified time length, and the specified time length is the time interval between adjacent synchronous signal frames. The drawing efficiency of the display view can be improved through the method and the device.

Description

View drawing method, view drawing device and storage medium

Technical Field

The present disclosure relates to the field of image processing technologies, and in particular, to a view drawing method, a view drawing device, and a storage medium.

Background

With the development of science and technology, terminals such as mobile phones are well known, and because of their wide application prospects, the terminals are in various scenes of daily life. Currently, a terminal may respond to a user touch operation and control a controlled application (app) to perform display view drawing to update its own display screen through the drawn display view, thereby completing man-machine interaction.

In the related art, a phenomenon that a display screen is stuck often occurs in a terminal in a process of updating the display screen through a drawn display view.

Disclosure of Invention

To overcome the problems in the related art, the present disclosure provides a view drawing method, a view drawing apparatus, and a storage medium.

According to a first aspect of an embodiment of the present disclosure, there is provided a view drawing method including:

Responding to the terminal triggered to draw display views frame by frame based on synchronous signal frames, and determining theoretical values of each drawing time length required for respectively drawing each display view; in response to determining that at least two display views meeting a target condition exist in each display view, adjusting the at least two display views to draw within a specified duration; the target condition comprises that the theoretical value of the total drawing time length of the at least two display views is smaller than or equal to the specified time length, and the specified time length is the time interval between adjacent synchronous signal frames.

In one embodiment, the adjusting the at least two display views to draw for a specified duration includes: determining a target synchronous signal frame for triggering drawing of a first display view, wherein the first display view is the first drawn display view in the at least two display views; and adjusting the at least two display views to draw in a specified duration taking the triggering time of the target synchronous signal frame as the starting time.

In one embodiment, the adjusting the at least two display views to draw within a specified duration with a trigger time of the target synchronization signal frame as a start time includes: in response to the target synchronization signal frame being triggered, determining a view accommodation number stored in a buffer queue, wherein the buffer queue is used for storing display views which are drawn but not displayed yet; and in response to determining that the view accommodation quantity meets the requirement that the buffer queue stores the at least two display views, adjusting the at least two display views to draw within a specified duration taking the triggering time of the target synchronous signal frame as the starting time.

In one embodiment, the method further comprises: monitoring the actual value of the drawing time length for drawing each display view; and in response to the fact that the actual drawing time length value is larger than the second display view of the appointed time length, adjusting the view accommodating quantity of the buffer queue based on the actual drawing time length value of the second display view.

In one embodiment, the adjusting the view accommodation number of the buffer queue based on the actual drawing duration value of the second display view includes: determining a first number of synchronous signal frames for triggering drawing of the second display view based on the designated time length and the actual drawing time length value of the second display view; based on the first number, a view accommodation number of the buffer queue is adjusted.

In one embodiment, the adjusting the view accommodation number of the buffer queue based on the first number includes: the view accommodation number of the buffer queue is adjusted to be larger than the first number.

In one embodiment, the adjusting the view accommodation number of the buffer queue based on the first number includes: obtaining a preconfigured second quantity, wherein the second quantity is the maximum quantity of the view accommodation quantity support which is adjusted; in response to determining that the second number is greater than the first number, adjusting a view holding number of the buffer queue to be greater than the first number; in response to determining that the second number is less than or equal to the first number, the view accommodation number of the buffer queue is adjusted to be greater than the second number.

In one embodiment, before determining the theoretical value of each drawing duration required for drawing each display view, the method further includes: the rendered display view is determined for use in response to a sliding operation of the terminal being triggered.

According to a second aspect of the embodiments of the present disclosure, there is provided a view drawing apparatus including:

A determining unit, which is used for responding to the terminal to be triggered to draw the display views frame by frame based on the synchronous signal frames and determining each drawing duration theoretical value required for respectively drawing each display view; a processing unit for adjusting at least two display views meeting a target condition to draw within a specified duration in response to determining that the at least two display views exist in each display view; the target condition comprises that the theoretical value of the total drawing time length of the at least two display views is smaller than or equal to the specified time length, and the specified time length is the time interval between adjacent synchronous signal frames.

In one embodiment, the processing unit adjusts the at least two display views to be rendered for a specified duration in the following manner: determining a target synchronous signal frame for triggering drawing of a first display view, wherein the first display view is the first drawn display view in the at least two display views; and adjusting the at least two display views to draw in a specified duration taking the triggering time of the target synchronous signal frame as the starting time.

In one embodiment, the processing unit adjusts the at least two display views to draw within a specified duration with a trigger time of the target synchronization signal frame as a start time in the following manner: in response to the target synchronization signal frame being triggered, determining a view accommodation number stored in a buffer queue, wherein the buffer queue is used for storing display views which are drawn but not displayed yet; and in response to determining that the view accommodation quantity meets the requirement that the buffer queue stores the at least two display views, adjusting the at least two display views to draw within a specified duration taking the triggering time of the target synchronous signal frame as the starting time.

In one embodiment, the processing unit is further configured to: monitoring the actual value of the drawing time length for drawing each display view; and in response to the fact that the actual drawing time length value is larger than the second display view of the appointed time length, adjusting the view accommodating quantity of the buffer queue based on the actual drawing time length value of the second display view.

In one embodiment, the processing unit adjusts the view accommodation number of the buffer queue based on the actual drawing duration value of the second display view in the following manner: determining a first number of synchronous signal frames for triggering drawing of the second display view based on the designated time length and the actual drawing time length value of the second display view; based on the first number, a view accommodation number of the buffer queue is adjusted.

In one embodiment, the processing unit adjusts the view holding number of the buffer queue based on the first number in the following manner: the view accommodation number of the buffer queue is adjusted to be larger than the first number.

In one embodiment, the processing unit adjusts the view holding number of the buffer queue based on the first number in the following manner: obtaining a preconfigured second quantity, wherein the second quantity is the maximum quantity of the view accommodation quantity support which is adjusted; in response to determining that the second number is greater than the first number, adjusting a view holding number of the buffer queue to be greater than the first number; in response to determining that the second number is less than or equal to the first number, the view accommodation number of the buffer queue is adjusted to be greater than the second number.

According to a third aspect of the embodiments of the present disclosure, there is provided a view drawing apparatus including:

A processor; a memory for storing processor-executable instructions;

wherein the processor is configured to: the view drawing method described in the first aspect or any implementation manner of the first aspect is performed.

According to a fourth aspect of the disclosed embodiments, there is provided a storage medium having stored therein instructions which, when executed by a processor, enable the processor to perform the view drawing method of the first aspect or any one of the embodiments of the first aspect.

The technical scheme provided by the embodiment of the disclosure can comprise the following beneficial effects: in the case where the terminal is triggered to draw the display views frame by frame based on the synchronization signal frame, the respective theoretical drawing time periods required to draw the respective display views may be determined. On the basis, if it is determined that at least two display views needing to be continuously drawn exist, and the theoretical value of total drawing duration is smaller than or equal to the time interval between adjacent synchronous signal frames, at least two display views which originally need to be drawn in at least two time intervals can be adjusted to be drawn in one time interval.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the disclosure and together with the description, serve to explain the principles of the disclosure.

Fig. 1 is a logic diagram of a terminal update display in the related art.

Fig. 2 is a flow chart illustrating a method of drawing a view according to an exemplary embodiment.

Fig. 3 is a flowchart illustrating a method of drawing a view according to an exemplary embodiment.

Fig. 4 is a flowchart illustrating a method of drawing a view according to an exemplary embodiment.

Fig. 5 is a flowchart illustrating a method of drawing a view according to an exemplary embodiment.

Fig. 6 is a flowchart illustrating a method of drawing a view according to an exemplary embodiment.

Fig. 7 is a flowchart illustrating a method of drawing a view according to an exemplary embodiment.

Fig. 8 is a flowchart illustrating a method of drawing a view according to an exemplary embodiment.

Fig. 9 is a logic diagram of a terminal updating a display screen based on processing logic provided by the present disclosure.

Fig. 10 is a flowchart illustrating a method of drawing a view according to an exemplary embodiment.

Fig. 11 is a flowchart illustrating a terminal adjusting the view accommodation amount by monitoring a sliding operation and an application layer dropping frame according to an exemplary embodiment.

Fig. 12 is a block diagram of a view drawing apparatus according to an exemplary embodiment.

Fig. 13 is a block diagram illustrating an apparatus for view drawing according to an exemplary embodiment.

Detailed Description

Reference will now be made in detail to exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, the same numbers in different drawings refer to the same or similar elements, unless otherwise indicated. The implementations described in the following exemplary examples are not representative of all implementations consistent with the present disclosure.

In the drawings, the same or similar reference numerals denote the same or similar elements or elements having the same or similar functions throughout. The described embodiments are some, but not all, embodiments of the present disclosure. The embodiments described below by referring to the drawings are exemplary and intended for the purpose of explaining the present disclosure and are not to be construed as limiting the present disclosure. Based on the embodiments in this disclosure, all other embodiments that a person of ordinary skill in the art would obtain without making any inventive effort are within the scope of protection of this disclosure. Embodiments of the present disclosure are described in detail below with reference to the attached drawings.

The method provided by the embodiment of the disclosure can be applied to the display scene of the terminal. For example, the terminal may perform a corresponding touch operation, and update the scene of the display screen through the rendered display view.

With the development of science and technology, terminals such as mobile phones are well known, and because of their wide application prospects, the terminals are in various scenes of daily life. Currently, a terminal can respond to a touch operation of a user to execute display view drawing so as to update a display picture of the terminal through the drawn display view, thereby completing man-machine interaction.

In the related technology, with the rise of an Android system, various applications expand a large amount of own business on the Android, and the fluency of each application is uneven, and the application logic is mostly caused, so that the application cannot be modified from the system. Based on this, *** (Google) introduced a triple-cache (TrippleBuffer) mechanism after android 4.1, i.e. three buffers (buffers) were fixed allocated at application start-up. When the application (app) end draws a display view with a longer time, the synthesizer (SurfaceFlinger) can call the display view which is drawn and stored in the buffer, and then transmit the called display view to the display layer, so that the display layer updates the display picture based on the display view, and the problem that the display picture cannot be updated due to the longer time for drawing the display view, so that the terminal display picture is blocked is solved.

Fig. 1 is a logic diagram of a terminal update display in the related art. As shown in fig. 1, the terminal may control the coordination among the application layer, the synthesizer, and the display layer based on the vertical synchronization signal frame. Specifically, in a scenario where the terminal is triggered to update the display screen, the application layer starts drawing the display view frame by frame from the first frame ①, and stores the drawn display view in a buffer queue (QueueBuffer) formed by a buffer (see a flow direction identified by "one" in fig. 1). The compositor acquires display views from the buffer queue from the second frame ② on a frame-by-frame basis (see the flow direction indicated by "two" in fig. 1), and transfers the acquired display views to the display layer (see the flow direction indicated by "three" in fig. 1) so that the display layer starts to display the display views supplied by the compositor from the third frame on a frame-by-frame basis, thereby completing updating of the display screen. Since, in general, the application layer performs display view drawing only once when each vertical synchronization signal frame is triggered. Thus, when the rendering duration of a certain display view exceeds the time interval between adjacent vertical synchronization signal frames (i.e., the application layer drops frames), there is a possibility that the display view stored in the buffer queue is emptied (i.e., the stored display view has been acquired by the compositor in its entirety). At this time, the synthesizer cannot acquire the display view (i.e., the synthesizer drops the frame), and the display layer cannot acquire a new display view from the synthesizer, so that the display screen is blocked. For example, taking the second frame display view of the application layer drawing in fig. 1 as an example, the display view that would have been drawn during the period from the trigger vertical synchronization signal frame ② to the trigger vertical synchronization signal frame ③ is not drawn until the period from the trigger vertical synchronization signal frame ④ to the trigger vertical synchronization signal frame ⑤ is completed. At this time, for the buffer queue, the first to display views are acquired from the compositor, and the buffer queue is in a state of being emptied until the application layer completes drawing of the second frame display view. Accordingly, when the vertical synchronization signal frames ④ and ⑤ are triggered accordingly and the display layer needs to acquire the display view, the synthesizer cannot acquire the display view from the buffer queue. In this case, the display layer can display only in the first frame display view during the period from when the vertical synchronization signal frame ③ is triggered to when the vertical synchronization signal frame ⑥ is triggered, and the actual display effect of the terminal appears as a stuck state.

In view of this, the present disclosure provides a view drawing method that further improves the logic of drawing a display view on the basis of drawing the display view frame by a terminal application layer according to a synchronization signal frame. Specifically, the present disclosure may determine respective theoretical values of drawing durations required to draw respective display views, respectively, in a case where a terminal is triggered to draw the display views frame by frame based on a synchronization signal frame. On the basis, if it is determined that at least two display views needing to be continuously drawn exist, and the theoretical value of the total drawing duration is smaller than or equal to the time interval between adjacent synchronous signal frames, at least two display views which originally need to be drawn in at least two time intervals can be adjusted to be drawn in one time interval. Because the method can improve the overall efficiency of drawing the display views by the application layer, compared with the view drawing mode in the related art, the method can enable the buffer queue to store more display views as much as possible. On the basis, when the application layer drops frames, the synthesizer can still acquire a sufficient number of display views from the buffer queue frame by frame, and the synthesizer can correspondingly supply the sufficient number of display views to the display layer for display, so that the terminal display is ensured not to be blocked.

Fig. 2 is a flowchart illustrating a view drawing method according to an exemplary embodiment, which is used in a terminal as shown in fig. 2, including the following steps.

In step S11, respective theoretical values of drawing durations required to draw the respective display views are determined in response to the terminal being triggered to draw the display views frame by frame based on the synchronization signal frame.

The theoretical drawing duration value required for drawing the display view may be determined according to the size of the display view and the terminal performance, for example. For example, in the case of determining a display view, the terminal determines a drawing speed based on its own performance, and estimates a drawing duration theoretical value therefrom.

In step S12, in response to determining that there are at least two display views satisfying the target condition among the respective display views, the at least two display views are adjusted to be drawn for a specified period of time.

In the embodiments of the present disclosure, the specified duration may be understood as a time interval between adjacent synchronization signal frames. Taking fig. 1 as an example, the specified duration may be, for example, a time interval between the trigger time of the vertical synchronization signal frame ① and the trigger time of the vertical synchronization signal frame ②.

For example, the target condition includes that a total drawing duration theoretical value of at least two display views is less than or equal to a specified duration. The total drawing duration theoretical value can be understood as the sum of the drawing duration theoretical values of each of at least two display views.

In the embodiment of the present disclosure, the above step S11 and step S12 may be performed when it is determined that the terminal is triggered to draw at least two display views. In this case, the terminal may determine whether there are at least two display views satisfying the target condition among the display views to be drawn. Further, when the terminal determines that at least two display views meeting the target condition exist in the display views, the at least two display views meeting the target condition are adjusted to be drawn within a specified duration.

Compared with the prior logic for respectively drawing at least two display views through drawing at least two designated time periods, the method can finish drawing the display views through less time consumption, can more efficiently provide storable display views for the buffer queue, so as to reduce the pressure of the buffer queue for supplying the display views, and further solve the problem that a terminal can not acquire the display views from the buffer queue due to the synthesizer so as to cause the display images to be blocked.

As a possible implementation, for at least two display views satisfying the target condition, the drawing manner may be adjusted as follows. The present disclosure is hereinafter for convenience of description, and among at least two display views of a target condition, a display view drawn first is referred to as a first display view.

Fig. 3 is a flowchart illustrating a view drawing method according to an exemplary embodiment, as shown in fig. 3, including the following steps.

In step S21, a target synchronization signal frame for triggering the drawing of the first display view is determined.

In step S22, at least two display views are adjusted to be drawn within a specified period of time with the trigger time of the target synchronization signal frame as the start time.

For the purposes of this disclosure, taking fig. 1 as an example, the seventh and eighth frame display views in fig. 1 may be regarded as at least two display views satisfying the target condition, the seventh frame display view may be regarded as the first display view, and the vertical synchronization signal frame ⑨ may be regarded as the target synchronization signal frame for triggering drawing of the first display view. As can be seen, compared to the existing logic, the present disclosure can adjust the eighth frame display view that would otherwise need to be drawn in the period from the trigger vertical synchronization signal frame ⑨ to the trigger vertical synchronization signal frame ⑩ to be drawn in the period from the trigger vertical synchronization signal frame ⑧ to the trigger vertical synchronization signal frame ⑨, which can improve the display view drawing efficiency.

By way of example, it may be that in the case where it is determined that the buffer queue has sufficient space, the drawing manner of the display view is adjusted in the above manner, as follows.

Fig. 4 is a flowchart of a method of drawing a view, as shown in fig. 4, according to an exemplary embodiment, including the following steps.

In step S31, respective theoretical values of drawing durations required to draw the respective display views are determined in response to the terminal being triggered to draw the display views frame by frame based on the synchronization signal frame.

In step S32, a target synchronization signal frame for triggering the drawing of the first display view is determined.

In step S33, the view accommodation number stored in the buffer queue is determined in response to the target synchronization signal frame being triggered.

The buffer queue is used for storing display views which are drawn but not displayed, and the view accommodation quantity characterizes the quantity of the display views which can be stored by the buffer queue.

In step S34, in response to determining that the view accommodation number satisfies the requirement that the buffer queue store at least two display views, the at least two display views are adjusted to be drawn within a specified duration starting from the trigger time of the target synchronization signal frame.

According to the method provided by the embodiment of the disclosure, when the number of the view accommodation is determined to be enough to enable the buffer queue to store at least two display views, the at least two display views are adjusted to be drawn within the appointed duration taking the target synchronous signal frame as the starting frame.

In general, in one aspect, the buffer queue is configured by default to accommodate a number of views of 2 or 3, i.e., the buffer queue may store two or three display views simultaneously. On the other hand, each synchronization signal frame is triggered, and the synthesizer extracts and displays one display view in the buffer queue. On this basis, when there is a single display view for a drawing period exceeding two or three specified periods, there is still a possibility that the compositor extracts and displays all display views in the buffer queue even if the buffer queue is already full of drawn display views.

In this regard, the present disclosure contemplates adjusting the view accommodation number of the buffer queue so that the buffer queue can simultaneously store a greater number of display views while improving the display view drawing efficiency in the above manner. Correspondingly, when the drawing duration of a single display view exceeds two or three specified durations, the buffer queue can supply the stored display views with the number more than 3 to the synthesizer frame by frame, so that the synthesizer can always acquire a new display view, and further the smoothness of a display picture is ensured.

Moreover, considering the increase of the view accommodation quantity, the memory occupied by the running buffer queue increases. Therefore, to control the memory cost, the following provides a way to trigger adjustment of the view accommodation amount only in the scene that the terminal may display a jam. For convenience of description, a display view in which an actual value of a drawing time period is greater than a specified time period is referred to as a second display view.

Fig. 5 is a flowchart of a method of drawing a view, as shown in fig. 5, according to an exemplary embodiment, including the following steps.

In step S41, the actual values of the rendering durations for rendering the respective display views are monitored.

For example, the actual value of the drawing duration for drawing each display view may be monitored in case the terminal is triggered to draw the display view frame by frame based on the synchronization signal frame.

In step S42, in response to the detection that the actual drawing time length value is greater than the second display view of the specified time length, the view accommodation number of the buffer queue is adjusted based on the actual drawing time length value of the second display view.

The method provided by the embodiment of the disclosure can improve the view accommodating quantity of the buffer queue under the condition that the second display view with the actual drawing time length larger than the appointed time length is monitored.

On the basis, when the second display view with the actual drawing time length larger than the designated time length is monitored, on the one hand, the view accommodation number of the buffer queue can be increased. On the other hand, the terminal application layer can draw the display view with higher efficiency through the drawing logic implementation of the present disclosure. Based on the two aspects, the buffer queue stores a more abundant number of display views. When the display view with the actual value of the drawing time length being longer than the appointed time length appears next time, the buffer queue can supply the stored display views with more sufficient quantity to the synthesizer frame by frame before the drawing of the display view is completed, until the display view with the actual value of the drawing time length being longer than the appointed time length is drawn, and the method can ensure that the synthesizer side does not appear frame dropping under the condition that the frame dropping occurs at the application layer, so that the display fluency of the terminal is improved.

By way of example, one possible way to adjust the view accommodation number is provided below. The number of synchronization signal frames used to trigger drawing of the second display view is referred to as the first number hereinafter for convenience of description.

Fig. 6 is a flowchart of a method of drawing a view, as shown in fig. 6, according to an exemplary embodiment, including the following steps.

In step S51, a first number of synchronization signal frames for triggering drawing of the second display view is determined based on the specified duration and the actual value of the drawing duration of the second display view.

For example, taking fig. 1 as an example, the second display view may be a second frame display view, the synchronization signal frames for triggering drawing of the second display view may be vertical synchronization signal frames ② and ③, and the first number may be the number of frames corresponding to the vertical synchronization signal frames ② and ③, i.e., 2. Furthermore, the first number may also be understood as the dropped frame number of the dropped frame application layer. For example, the second frame display view should have been rendered in a single specified duration, while the actual rendering takes three specified durations, the first number is 2.

In step S52, the view accommodation number of the buffer queue is adjusted based on the first number.

As a possible implementation, the view holding number of the buffer queue may be adjusted to be larger than the first number.

Fig. 7 is a flowchart of a view drawing method according to an exemplary embodiment, as shown in fig. 7, including the following steps.

In step S61, a first number of synchronization signal frames for triggering drawing of the second display view is determined based on the specified duration and the actual value of the drawing duration of the second display view.

In step S62, the view accommodation number of the buffer queue is adjusted to be larger than the first number.

For example, if the first number is a, the view holding number of the buffer queue may be adjusted to a+1. Of course, the view holding number of the buffer queue may be adjusted to any other value larger than a in addition to a+1, which is not particularly limited in this disclosure.

As another possible implementation, an upper limit number may be preconfigured for the view accommodation number so that the adjusted view accommodation number does not exceed the configured upper limit number. For ease of description, the upper limit number preconfigured for the view-holding number is referred to as a second number, which may be understood as the maximum number that the view-holding number supports to be adjusted when performing the method provided by the embodiments of the present disclosure.

Fig. 8 is a flowchart of a view drawing method according to an exemplary embodiment, as shown in fig. 8, including the following steps.

In step S71, a first number of synchronization signal frames for triggering drawing of the second display view is determined based on the specified duration and the actual value of the drawing duration of the second display view.

In step S72, a second number of preconfigured values is acquired.

By way of example, the second number may be preconfigured to 5.

In step S73a, in response to determining that the second number is greater than the first number, the view accommodation number of the buffer queue is adjusted to be greater than the first number.

In step S73b, in response to determining that the second number is less than or equal to the first number, the view accommodation number of the buffer queue is adjusted to be greater than the second number.

The method provided by the embodiment of the present disclosure, as described above, increases the memory occupied by the running buffer queue due to the increase in the view accommodation amount. Accordingly, the present disclosure pre-configures an upper limit number for the view holding number for controlling the memory cost.

In addition, it is noted that the present disclosure adjusts the view accommodation number to the first number (or the second number) when it is determined that the view accommodation number is adjusted by the first number (or the second number) and it is determined that the first number (or the second number) is inconsistent with the view accommodation number. If the view accommodation quantity is consistent with the quantity to be adjusted, the current view accommodation quantity is maintained, and the adjustment is not performed.

For ease of understanding, the following exemplary shows an implementation flow in which a terminal updates a display based on processing logic provided by the present disclosure.

For example, as shown in fig. 9, the terminal may monitor whether the application layer drops frames during controlling the application layer to draw the display view frame by frame based on the vertical synchronization signal frame, and determine the dropped frames and adjust the view accommodation number of the buffer queue to be the dropped frames+1 if it is determined that the application layer drops frames. For example, the view accommodation number of the default configuration of the buffer queue may be 2, and when it is monitored that the actual drawing duration of the application layer drawing the second frame display view exceeds the specified duration, it is determined that the application layer drops frames. Based on the above, the terminal determines that the corresponding frame dropping number is 2 when the application layer draws the second frame display view, and adjusts the view accommodation number of the buffer queue from 2 to 3.

In addition, the terminal may optimize the drawing procedure of the display view based on the view drawing logic related to the disclosure. For example, the terminal may estimate a theoretical drawing duration value for drawing each display view based on the size of the display view and its own view drawing speed, in the case that the terminal is triggered to draw the display view frame by frame based on the vertical synchronization signal frame control application layer. And then, under the condition that at least two display views to be continuously drawn exist and the theoretical value of the total drawing time length is smaller than or equal to the appointed time length, the drawing mode of the display views is adjusted. For example, as shown in fig. 9, if it is determined that the theoretical value of the total drawing time length of the fourth frame display view and the fifth frame display view is less than or equal to the specified time length, the fourth frame display view and the fifth frame display view are used as candidates, so that the fourth frame display view and the fifth frame display view are adjusted to be drawn in a single specified time length when it is determined that the buffer queue has sufficient capacity. Specifically, as shown in fig. 9, based on the default drawing logic in the related art, the vertical synchronization signal frame ⑤ is used to trigger drawing of a single display view, that is, to trigger drawing of a fourth frame display view. In the embodiment of the present disclosure, the view accommodation number in the buffer queue may be determined in the case where the vertical synchronization signal frame ⑤ is triggered. Further, if it is determined that the view accommodation amount satisfies that the buffer queue stores the fourth frame display view and the fifth frame display view before the vertical synchronization signal frame ⑥ is triggered, the fifth frame display view that is originally required to be drawn in the specified duration from ⑥ to ⑦ can be adjusted to be drawn in the specified duration from ⑤ to ⑥.

On this basis, when the application layer next appears dropped frames (as shown in the drawing process of the sixth frame display view in fig. 9), three frame display views are stored in the buffer queue. Therefore, before the sixth frame display view is drawn, the synthesizer can still acquire the display view to be displayed from the buffer queue frame by frame, so that the effect of 'the application layer dropping frames and the synthesizer not dropping frames' is achieved. In addition, the synthesizer does not drop frames, so that the display layer can correctly update the display picture, and further the display effect of smooth display of the terminal is achieved.

In addition, generally, the scene of the control terminal drawing view includes two kinds of:

scene 1: the terminal draws the display view in response to the triggered sliding operation.

Scene 2: and the terminal responds to the triggered clicking operation to draw the display view.

For the above-described scene 1, the terminal is generally required to control the display screen to be updated frame by frame based on the sliding operation in order to realize the movement of the display screen. Wherein, it involves drawing frame by the application layer and displaying frame by the display layer. In this scenario, display stuck may be improved by the rendering logic provided by the present disclosure described above. For scenario 2, the terminal often triggers resource loading of a single display view based on a click operation, and the scenario does not often involve frame-by-frame drawing and display of the display view.

In view of this, the present disclosure may set a corresponding trigger manner so that the terminal performs the above scheme only when the terminal is triggered to slide. For example, before determining the theoretical value of each drawing duration required to draw each display view separately, it may be determined that the drawn display view is used for a sliding operation that is triggered in response to the terminal.

Fig. 10 is a flowchart illustrating a view drawing method according to an exemplary embodiment, which is used in a terminal as shown in fig. 10, including the following steps.

In step S81, the display views are drawn frame by frame based on the synchronization signal frame in response to the terminal being triggered, and it is determined that the drawn display views are used for a sliding operation in response to the terminal being triggered, and respective drawing time period theoretical values required for drawing the respective display views are determined.

In step S82, in response to determining that there are at least two display views satisfying the target condition among the respective display views, the at least two display views are adjusted to be drawn for a specified period of time.

For example, determining that the rendered display view is for a sliding operation in response to the terminal being triggered may be accomplished by monitoring an input event to which the terminal is triggered. For example, when a user performs a touch operation on a terminal, three input events, namely, a press event (DOWN), a MOVE event (MOVE), and a release event (UP), are generally included. When the user clicks on the screen, the event sequence of the input event is DOWN- > UP. When the user slides the screen, the event sequence of the input event is DOWN- > move..what is done here is to omit at least one movement event) - > UP.

As a possible implementation, the terminal may be configured to determine that the rendered display view is for a sliding operation in response to the terminal being triggered in case a movement event (MOVE) is detected.

For example, as shown in fig. 11, the terminal may monitor whether the input event includes a movement event in case that the mode input event is monitored. Further, if the movement event is not detected, it is determined that the input event is a click operation triggered by the user, and the process is ended at this time. Correspondingly, if the movement event is monitored, judging that the input event is a movement operation triggered by a user, and at the moment, starting from a first frame display view to be drawn, monitoring whether the application layer drops frames in the process of drawing the display view frame by frame.

On the basis, if the application layer frame dropping is determined, the terminal adjusts the view accommodating quantity according to the first quantity determined by the occurrence of the application layer frame dropping. For example, the view accommodation number is adjusted to the first number upon determining that the first number is less than the preconfigured second number. For another example, the view accommodation number is adjusted to the second number upon determining that the first number is greater than or equal to the preconfigured second number. In this process, the terminal adjusts the drawing mode of the display view according to the real-time mode related to the disclosure according to the dynamically changing view accommodation number all the time. Further, the terminal may monitor whether a new input event is monitored. If a new input event is detected, the display view to be drawn is changed to be matched with the newly triggered input event, the monitoring of the application layer is stopped at the moment, and the adjustment of the view accommodation quantity is finished. Correspondingly, if no new input event is detected, continuing to monitor the display view of the next frame to be drawn until all the display views are drawn.

Based on the same conception, the embodiment of the disclosure also provides a view drawing device.

It will be appreciated that, in order to achieve the above-mentioned functions, the view drawing apparatus provided in the embodiments of the present disclosure includes corresponding hardware structures and/or software modules that perform the respective functions. The disclosed embodiments may be implemented in hardware or a combination of hardware and computer software, in combination with the various example elements and algorithm steps disclosed in the embodiments of the disclosure. Whether a function is implemented as hardware or computer software driven hardware depends upon the particular application and design constraints imposed on the solution. Those skilled in the art may implement the described functionality using different approaches for each particular application, but such implementation is not to be considered as beyond the scope of the embodiments of the present disclosure.

Fig. 12 is a block diagram of a view drawing apparatus according to an exemplary embodiment. Referring to fig. 12, the apparatus 100 includes a determination unit 101 and a processing unit 102.

The determining unit 101 determines respective theoretical values of drawing durations required to draw the respective display views, respectively, in response to the terminal being triggered to draw the display views frame by frame based on the synchronization signal frame. The processing unit 102 adjusts at least two display views to draw for a specified period of time in response to determining that there are at least two display views satisfying the target condition among the respective display views. The target condition includes that the theoretical value of the total drawing time length of at least two display views is smaller than or equal to a specified time length, and the specified time length is the time interval between adjacent synchronous signal frames.

In one embodiment, the processing unit 102 adjusts at least two display views to be rendered for a specified duration in the following manner: and determining a target synchronous signal frame for triggering drawing of a first display view, wherein the first display view is the first drawn display view of the at least two display views. And adjusting at least two display views to draw in a specified duration taking the triggering time of the target synchronous signal frame as the starting time.

In one embodiment, the processing unit 102 adjusts at least two display views to be drawn within a specified duration starting from the trigger time of the target synchronization signal frame in the following manner: in response to the target synchronization signal frame being triggered, a view accommodation number stored in a buffer queue for storing display views that have been drawn but have not yet been displayed is determined. In response to determining that the view accommodation number satisfies the requirement that the buffer queue store at least two display views, the at least two display views are adjusted to be drawn within a specified duration starting at a trigger time of the target synchronization signal frame.

In one embodiment, the processing unit 102 is further configured to: and monitoring the actual drawing time length value of each display view. And in response to the second display view with the actual drawing time length value being larger than the designated time length, adjusting the view accommodating quantity of the buffer queue based on the actual drawing time length value of the second display view.

In one embodiment, the processing unit 102 adjusts the view accommodation number of the buffer queue based on the actual drawing duration value of the second display view in the following manner: a first number of synchronization signal frames for triggering drawing of the second display view is determined based on the specified duration and the actual value of the drawing duration of the second display view. Based on the first number, a view accommodation number of the buffer queue is adjusted.

In one embodiment, the processing unit 102 adjusts the view holding number of the buffer queue based on the first number in the following manner: the view holding number of the buffer queue is adjusted to be greater than the first number.

In one embodiment, the processing unit 102 adjusts the view holding number of the buffer queue based on the first number in the following manner: a second number of preconfigured support for the maximum number of view-holding numbers is obtained. In response to determining that the second number is greater than the first number, the view holding number of the buffer queue is adjusted to be greater than the first number. In response to determining that the second number is less than or equal to the first number, the view-holding number of the buffer queue is adjusted to be greater than the second number.

In one embodiment, before determining the theoretical value of each drawing duration required for drawing each display view, the method further comprises: the rendered display view is determined for use in response to a sliding operation of the terminal being triggered.

The specific manner in which the various modules perform the operations in the apparatus of the above embodiments have been described in detail in connection with the embodiments of the method, and will not be described in detail herein.

Fig. 13 is a block diagram illustrating an apparatus 200 for view drawing according to an exemplary embodiment. For example, apparatus 200 may be a mobile phone, computer, digital broadcast terminal, messaging device, game console, tablet device, medical device, exercise device, personal digital assistant, or the like.

Referring to fig. 13, the apparatus 200 may include one or more of the following components: a processing component 202, a memory 204, a power component 206, a multimedia component 208, an audio component 210, an input/output (I/O) interface 212, a sensor component 214, and a communication component 216.

The processing component 202 generally controls overall operation of the apparatus 200, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations. The processing component 202 may include one or more processors 220 to execute instructions to perform all or part of the steps of the methods described above. Further, the processing component 202 can include one or more modules that facilitate interactions between the processing component 202 and other components. For example, the processing component 202 may include a multimedia module to facilitate interaction between the multimedia component 208 and the processing component 202.

The memory 204 is configured to store various types of data to support operations at the apparatus 200. Examples of such data include instructions for any application or method operating on the device 200, contact data, phonebook data, messages, pictures, videos, and the like. The memory 204 may be implemented by any type or combination of volatile or nonvolatile memory devices such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disk.

The power component 206 provides power to the various components of the device 200. The power components 206 may include a power management system, one or more power sources, and other components associated with generating, managing, and distributing power for the device 200.

The multimedia component 208 includes a screen between the device 200 and the user that provides an output interface. In some embodiments, the screen may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from a user. The touch panel includes one or more touch sensors to sense touches, swipes, and gestures on the touch panel. The touch sensor may sense not only the boundary of a touch or slide action, but also the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 208 includes a front-facing camera and/or a rear-facing camera. The front camera and/or the rear camera may receive external multimedia data when the apparatus 200 is in an operation mode, such as a photographing mode or a video mode. Each front camera and rear camera may be a fixed optical lens system or have focal length and optical zoom capabilities.

The audio component 210 is configured to output and/or input audio signals. For example, the audio component 210 includes a Microphone (MIC) configured to receive external audio signals when the device 200 is in an operational mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signals may be further stored in the memory 204 or transmitted via the communication component 216. In some embodiments, audio component 210 further includes a speaker for outputting audio signals.

The I/O interface 212 provides an interface between the processing assembly 202 and peripheral interface modules, which may be keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to: homepage button, volume button, start button, and lock button.

The sensor assembly 214 includes one or more sensors for providing status assessment of various aspects of the apparatus 200. For example, the sensor assembly 214 may detect the on/off state of the device 200, the relative positioning of the components, such as the display and keypad of the device 200, the sensor assembly 214 may also detect a change in position of the device 200 or a component of the device 200, the presence or absence of user contact with the device 200, the orientation or acceleration/deceleration of the device 200, and a change in temperature of the device 200. The sensor assembly 214 may include a proximity sensor configured to detect the presence of nearby objects in the absence of any physical contact. The sensor assembly 214 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 214 may also include an acceleration sensor, a gyroscopic sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

The communication component 216 is configured to facilitate communication between the apparatus 200 and other devices in a wired or wireless manner. The device 200 may access a wireless network based on a communication standard, such as WiFi,4G or 5G, or a combination thereof. In one exemplary embodiment, the communication component 216 receives broadcast signals or broadcast related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 216 further includes a Near Field Communication (NFC) module to facilitate short range communications. For example, the NFC module may be implemented based on Radio Frequency Identification (RFID) technology, infrared data association (IrDA) technology, ultra Wideband (UWB) technology, bluetooth (BT) technology, and other technologies.

In an exemplary embodiment, the apparatus 200 may be implemented by one or more Application Specific Integrated Circuits (ASICs), digital Signal Processors (DSPs), digital Signal Processing Devices (DSPDs), programmable Logic Devices (PLDs), field Programmable Gate Arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic elements for executing the methods described above.

In an exemplary embodiment, a non-transitory computer readable storage medium is also provided, such as memory 204, including instructions executable by processor 220 of apparatus 200 to perform the above-described method. For example, the non-transitory computer readable storage medium may be ROM, random Access Memory (RAM), CD-ROM, magnetic tape, floppy disk, optical data storage device, etc.

It is understood that the term "plurality" in this disclosure means two or more, and other adjectives are similar thereto. "and/or", describes an association relationship of an association object, and indicates that there may be three relationships, for example, a and/or B, and may indicate: a exists alone, A and B exist together, and B exists alone. The character "/" generally indicates that the context-dependent object is an "or" relationship. The singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise.

It is further understood that the terms "first," "second," and the like are used to describe various information, but such information should not be limited to these terms. These terms are only used to distinguish one type of information from another and do not denote a particular order or importance. Indeed, the expressions "first", "second", etc. may be used entirely interchangeably. For example, first information may also be referred to as second information, and similarly, second information may also be referred to as first information, without departing from the scope of the present disclosure.

It will be further understood that "connected" includes both direct connection where no other member is present and indirect connection where other element is present, unless specifically stated otherwise.

It will be further understood that although operations are depicted in the drawings in a particular order, this should not be understood as requiring that such operations be performed in the particular order shown or in sequential order, or that all illustrated operations be performed, to achieve desirable results. In certain circumstances, multitasking and parallel processing may be advantageous.

Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure disclosed herein. This application is intended to cover any adaptations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.

It is to be understood that the present disclosure is not limited to the precise arrangements and instrumentalities shown in the drawings, and that various modifications and changes may be effected without departing from the scope thereof. The scope of the present disclosure is limited only by the scope of the appended claims.

Claims

1. A view drawing method, characterized in that it is applied to a terminal, the method comprising:

Responding to the terminal triggered to draw display views frame by frame based on synchronous signal frames, and determining theoretical values of each drawing time length required for respectively drawing each display view;

In response to determining that at least two display views meeting a target condition exist in each display view, adjusting the at least two display views to draw within a specified duration;

The target condition comprises that the theoretical value of the total drawing time length of the at least two display views is smaller than or equal to the specified time length, and the specified time length is the time interval between adjacent synchronous signal frames.

2. The view drawing method according to claim 1, wherein the adjusting the at least two display views to draw for a specified period of time includes:

Determining a target synchronous signal frame for triggering drawing of a first display view, wherein the first display view is the first drawn display view in the at least two display views;

And adjusting the at least two display views to draw in a specified duration taking the triggering time of the target synchronous signal frame as the starting time.

3. The view drawing method according to claim 2, wherein the adjusting the at least two display views to draw within a specified duration with a trigger time of the target synchronization signal frame as a start time includes:

In response to the target synchronization signal frame being triggered, determining a view accommodation number stored in a buffer queue, wherein the buffer queue is used for storing display views which are drawn but not displayed yet;

And in response to determining that the view accommodation quantity meets the requirement that the buffer queue stores the at least two display views, adjusting the at least two display views to draw within a specified duration taking the triggering time of the target synchronous signal frame as the starting time.

4. A view drawing method according to any one of claims 1 to 3, wherein the method further comprises:

monitoring the actual value of the drawing time length for drawing each display view;

And in response to the fact that the actual drawing time length value is larger than the second display view of the appointed time length, adjusting the view accommodating quantity of the buffer queue based on the actual drawing time length value of the second display view.

5. The view drawing method according to claim 4, wherein the adjusting the view accommodation number of the buffer queue based on the drawing duration actual value of the second display view includes:

determining a first number of synchronous signal frames for triggering drawing of the second display view based on the designated time length and the actual drawing time length value of the second display view;

Based on the first number, a view accommodation number of the buffer queue is adjusted.

6. The view drawing method according to claim 5, wherein the adjusting the view accommodation number of the buffer queue based on the first number includes:

the view accommodation number of the buffer queue is adjusted to be larger than the first number.

7. The view drawing method according to claim 5, wherein the adjusting the view accommodation number of the buffer queue based on the first number includes:

obtaining a preconfigured second quantity, wherein the second quantity is the maximum quantity of the view accommodation quantity support which is adjusted;

In response to determining that the second number is greater than the first number, adjusting a view holding number of the buffer queue to be greater than the first number;

in response to determining that the second number is less than or equal to the first number, the view accommodation number of the buffer queue is adjusted to be greater than the second number.

8. The view drawing method according to claim 1, wherein before determining the respective drawing time period theoretical values required to draw the respective display views, further comprising:

The rendered display view is determined for use in response to a sliding operation of the terminal being triggered.

9. A view drawing apparatus, characterized by being applied to a terminal, comprising:

a determining unit, which is used for responding to the terminal to be triggered to draw the display views frame by frame based on the synchronous signal frames and determining each drawing duration theoretical value required for respectively drawing each display view;

A processing unit for adjusting at least two display views meeting a target condition to draw within a specified duration in response to determining that the at least two display views exist in each display view;

10. The view drawing apparatus according to claim 9, wherein the processing unit adjusts the at least two display views to be drawn for a specified period of time by:

11. The view drawing apparatus according to claim 10, wherein the processing unit adjusts the at least two display views to draw within a specified period of time starting from a trigger time of the target synchronization signal frame in such a manner that:

12. The view drawing device according to any one of claims 9 to 11, wherein the processing unit is further configured to:

13. The view drawing apparatus according to claim 12, wherein the processing unit adjusts the view accommodation number of the buffer queue based on the drawing duration actual value of the second display view in such a manner that:

14. The view drawing apparatus according to claim 13, wherein the processing unit adjusts the view accommodation number of the buffer queue based on the first number in such a manner that:

15. The view drawing apparatus according to claim 13, wherein the processing unit adjusts the view accommodation number of the buffer queue based on the first number in such a manner that:

16. The view drawing apparatus according to claim 9, wherein before determining the respective drawing time period theoretical values required to draw the respective display views, further comprising:

17. A view drawing apparatus, characterized by comprising:

A processor;

A memory for storing processor-executable instructions;

wherein the processor is configured to: a view drawing method as claimed in any one of claims 1 to 8.

18. A storage medium having instructions stored therein that, when executed by a processor, enable the processor to perform the view drawing method of any one of claims 1 to 8.