CN112199067B - Display switching method and device - Google Patents
Display switching method and device Download PDFInfo
- Publication number
- CN112199067B CN112199067B CN202011407305.6A CN202011407305A CN112199067B CN 112199067 B CN112199067 B CN 112199067B CN 202011407305 A CN202011407305 A CN 202011407305A CN 112199067 B CN112199067 B CN 112199067B
- Authority
- CN
- China
- Prior art keywords
- display
- frame
- display content
- processing unit
- content
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/1407—General aspects irrespective of display type, e.g. determination of decimal point position, display with fixed or driving decimal point, suppression of non-significant zeros
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Controls And Circuits For Display Device (AREA)
Abstract
The embodiment of the application relates to the technical field of display control, and provides a display switching method and a display switching device, wherein the method comprises the following steps: receiving and processing first display content of a first running application through a first processing unit to obtain a first image frame of the first display content and a first frame tail signal of the first image frame; receiving and processing second display content of a second running application through a second processing unit to obtain a second image frame of the second display content and a second frame tail signal of the second image frame; when the display unit is determined to be switched from displaying the first display content to displaying the second display content, the data connection between the first processing unit and the display unit is closed according to the first frame tail signal; and starting the data connection between the second processing unit and the display unit so as to display a second image frame of second display content through the display unit. The embodiment of the application can realize seamless switching between the display contents of different applications.
Description
Technical Field
The embodiment of the application relates to the technical field of display control, in particular to a display switching method and device.
Background
In a System with a System on a chip, different applications are usually implemented by a plurality of Operating systems, and the applications may be divided according to domains, such as domains based on Linux or Real Time Operating System (RTOS) or android System, where different domains are based on different Operating systems, and the different Operating systems are completely isolated and not virtualized. When Display contents of applications from different operating systems need to be displayed on the same Display screen, switching between different hardware Display Processing Units (DPUs) is involved.
In the system with the system-on-chip, when the display contents of different applications need to be switched on the same display screen, if the display contents are not processed, a black screen phenomenon occurs in the switching process, and the seamless switching between the display contents of different applications cannot be realized.
Disclosure of Invention
The embodiment of the application provides a display switching method and device, which can realize seamless switching between display contents of different applications.
In a first aspect, an embodiment of the present application provides a display switching method, including:
receiving and processing first display content of a first running application through a first processing unit to obtain a first image frame of the first display content and a first frame tail signal of the first image frame;
receiving and processing second display content of a second running application through a second processing unit to obtain a second image frame of the second display content and a second frame tail signal of the second image frame;
when the display unit is determined to be switched from displaying the first display content to displaying the second display content, closing the data connection between the first processing unit and the display unit according to the first frame tail signal;
and starting the data connection between the second processing unit and the display unit so as to display a second image frame of the second display content through the display unit.
Optionally, in some possible implementations of the present application, the step of starting a data connection between the second processing unit and the display unit to display a second image frame of the second display content through the display unit further includes:
when the display unit is determined to be switched from displaying the second display content to displaying the first display content, closing the data connection between the second processing unit and the display unit according to the second frame tail signal;
and starting the data connection between the first processing unit and the display unit so as to display a first image frame of the first display content through the display unit.
Optionally, in some possible implementation manners of the present application, the step of determining that the display unit is to be switched from displaying the first display content to displaying the second display content includes:
receiving a first display request for the first display content;
starting data connection between the first processing unit and the display unit according to the first frame tail signal so as to display the first display content on the display unit;
receiving a second display request for the second display content;
judging whether the content display priority of the second running application is higher than the content display priority of the first running application;
and if the content display priority of the second running application is higher than that of the first running application, determining that the display unit is to be switched from displaying the first display content to displaying the second display content.
Optionally, in some possible implementations of the present application, the method further includes:
and if the content display priority of the second running application is lower than that of the first running application, the first display content is kept displayed on the display unit.
Optionally, in some possible implementations of the present application, the step of maintaining to display the first display content on the display unit further includes:
and if a display stopping request aiming at the first display content is received, determining that the display unit is to be switched from displaying the first display content to displaying the second display content.
Optionally, in some possible implementations of the present application, the step of starting the data connection between the second processing unit and the display unit includes:
and releasing the back pressure signal of the second processing unit to start the data connection between the second processing unit and the display unit, wherein the back pressure signal is a back pressure signal configured for the second processing unit in advance.
Optionally, in some possible implementations of the present application, the step of closing the data connection between the first processing unit and the display unit according to the first end-of-frame signal includes:
and when the first frame tail signal is detected through a connection control, closing the data connection between the first processing unit and the display unit through the connection control, wherein the connection control is connected between the first processing unit and the display unit.
Optionally, in some possible implementations of the present application, the step of closing the data connection between the second processing unit and the display unit according to the second end-of-frame signal includes:
and when the second frame tail signal is detected through a connection control, closing the data connection between the second processing unit and the display unit through the connection control, wherein the connection control is connected between the second processing unit and the display unit.
Optionally, in some possible implementations of the present application, the step of receiving and processing, by a first processing unit, first display content of a first running application to obtain a first image frame of the first display content and a first frame end signal of the first image frame includes:
receiving, by a first processing unit, first display content of a first running application;
obtaining the last pixel of the last line of each frame image of the first display content according to the counter of the first processing unit so as to determine the frame tail of each frame image of the first display content;
and generating a first frame end signal at the frame end of each frame of image of the first display content.
In a second aspect, an embodiment of the present application provides a display switching apparatus, including:
the first processing module is used for receiving and processing first display content of a first running application through a first processing unit to obtain a first image frame of the first display content and a first frame tail signal of the first image frame;
the second processing module is used for receiving and processing second display content of a second running application through a second processing unit to obtain a second image frame of the second display content and a second frame tail signal of the second image frame;
a closing module, configured to close a data connection between the first processing unit and the display unit according to the first frame tail signal when it is determined that the display unit is to be switched from displaying the first display content to displaying the second display content;
and the starting module is used for starting the data connection between the second processing unit and the display unit so as to display a second image frame of the second display content through the display unit.
Yet another aspect of the embodiments of the present application provides a computer apparatus, which includes a memory, a processor, and a computer program stored in the memory and running on the processor, wherein the processor is configured to call the computer program in the memory to execute the method according to the first aspect.
In yet another aspect, embodiments of the present application provide a storage medium including instructions that, when executed on a computer, cause the computer to perform the method of the first aspect.
Compared with the prior art, in the scheme provided by the embodiment of the application, since the first frame end signal and the second frame end signal are respectively generated at the frame ends of the frame images of the first display content and the second display content in advance, when the first display content displayed on the display unit needs to be switched to the second display content, the data connection between the second processing unit and the display unit is immediately started after the data connection between the first processing unit and the display unit is closed according to the first frame end signal. The process of closing the data connection between the first processing unit and the display unit and opening the data connection between the second processing unit and the display unit takes a very short time, so that the switching process takes a very short time, and therefore seamless switching between display contents of different applications is achieved.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without inventive labor.
Fig. 1 is a system architecture diagram illustrating the operation of a switching device according to an embodiment of the present disclosure;
fig. 2 is a schematic diagram of a handover process based on a DPU handover mechanism according to an embodiment of the present application;
fig. 3 is a schematic diagram illustrating a display switching method based on a display arbitration mechanism according to an embodiment of the present application;
fig. 4 is a flowchart of a display switching method according to an embodiment of the present application;
fig. 5 is a schematic structural diagram of a display switching apparatus according to an embodiment of the present disclosure;
fig. 6 is a schematic physical structure diagram of a computer device according to an embodiment of the present application.
Detailed Description
The terms "first," "second," and the like in the description and in the claims of the embodiments of the application and in the drawings described above are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It will be appreciated that the data so used may be interchanged under appropriate circumstances such that the embodiments described herein may be practiced otherwise than as specifically illustrated or described herein. Furthermore, the terms "comprise" and "have," and any variations thereof, are intended to cover non-exclusive inclusions, such that a process, method, system, article, or apparatus that comprises a list of steps or modules is not necessarily limited to those steps or modules expressly listed, but may include other steps or modules not expressly listed or inherent to such process, method, article, or apparatus, such that the division of modules presented in the present application is merely a logical division and may be implemented in a practical application in a different manner, such that multiple modules may be combined or integrated into another system or some features may be omitted or not implemented, and such that couplings or direct couplings or communicative connections shown or discussed may be through interfaces, indirect couplings or communicative connections between modules may be electrical or the like, the embodiments of the present application are not limited. Moreover, the modules or sub-modules described as separate components may or may not be physically separated, may or may not be physical modules, or may be distributed in a plurality of circuit modules, and some or all of the modules may be selected according to actual needs to achieve the purpose of the embodiments of the present application.
The embodiment of the present application provides a display switching method, which is mainly applied to a switching scene of display contents of running applications under different operating systems, a shared screen, and the like, and is executed by a display switching device, and in order to facilitate description of the technical solution of the present application, in the embodiment of the present application, a display switching device installed in an intelligent vehicle-mounted system is taken as an example for description, specifically, please refer to fig. 1, where fig. 1 is a system architecture diagram of a running display switching device provided in the embodiment of the present application, and the display switching device in the diagram includes the following components: the device comprises an instrument domain, an entertainment domain, a connection control, a display interface and a central control display screen, wherein the instrument domain is realized by operating systems such as Linux or RTOS (real time operating system), the entertainment domain is realized by an android system, the instrument domain comprises a hardware display processing unit 1 (DPU 1), the entertainment domain comprises a hardware display processing unit 2 (DPU 2), the DPU1 and the DPU2 share the same display interface and the central control display screen, and the central control display screen respectively receives an input picture 1 from an external camera and an input picture 2 from android application. In the figures, only two DPUs are taken as an example for description, and in an actual application scenario, the number of DPUs is not limited, and may be two, three, four, or the like. Of course, the design of the DPUs can be modified, so that the same DPU can be used by two isolated operating systems at the same time in a virtualization control mode, and therefore, when switching is displayed, the DPUs do not need to be switched. The following is a description of the components in the drawings:
DPU 1: receiving display content 1 from an application 1, such as receiving display content input from an external image pickup apparatus, and processing the display content, including superimposing, rotating, scaling a display layer, and the like, and generating a frame end (frame end) signal of each frame image of the display content 1.
DPU 2: receiving the display content 2 from the application 2, such as receiving the display content from the android terminal input, and processing the display content, including superimposing, rotating, scaling the display layer, etc., and generating a frame end (frame end) signal of each frame image of the display content 2.
Connecting a control: connecting or disconnecting the DPU to the display interface, the connection control may be represented as a Pixel connection (Pixel Link) control.
A display interface: and transmitting the display content output by the DPU to a central control display screen according to a certain protocol, wherein the display Interface comprises but is not limited to a display Interface (DP) and a Mobile Industry Processor Interface (MIPI), and the MIPI comprises but is not limited to a digital-speech interpolation (DSI) Interface and a Camera Serial Interface (CSI).
The central control display screen: including but not limited to liquid crystal displays.
In one display switching scheme, when the content displayed on the central control display screen needs to be switched from the display content 1 to the display content 2, the connection control switches the connection object from the DPU1 to the DPU2 according to the frame tail signal of the DPU1, so that the switching from the display content 1 to the display content 2 on the central control display screen is realized. Further, the connection control may also switch the connection object from the DPU1 to the DPU2 according to the frame end signal of the DPU1 and the display priority (display arbitration mechanism) of the display content, so as to switch from the display content 1 to the display content 2 on the central control display screen. Similarly, the connection control switches the connection object from the DPU2 to the DPU1 according to the frame tail signal of the DPU2, so that the display content 2 is switched to the display content 1 on the central control display screen. Further, the connection control may also switch the connection object from the DPU2 to the DPU1 according to the frame end signal of the DPU2 and the display priority (display arbitration mechanism) of the display content.
It should be noted that the system architecture diagram shown in fig. 1 is only an example, and the system architecture described in this application is for more clearly illustrating the technical solution of the embodiment of the application, and does not constitute a limitation on the technical solution provided by the embodiment of the application.
Based on the above system architecture, in order to implement the display switching method according to the embodiment of the present application, a DPU switching mechanism and a display arbitration mechanism are provided in the embodiment of the present application, and the DPU switching mechanism and the display arbitration mechanism are described below:
referring to fig. 2, fig. 2 is a schematic diagram of a handover process based on a DPU handover mechanism according to an embodiment of the present application, where a reference numeral "1" in the diagram indicates a handover event, i.e., a handover request is received; the reference "2" refers to the first end-of-frame signal of DPU1 after the handover event; the reference numeral "3" refers to the first Vertical Synchronization (vsync) of the DPU2 after the switching event, i.e. corresponding to the beginning of the first frame of the DPU2 after the switching event, vsync indicates the beginning of a frame, vsync1 in the figure refers to the vsync signal of the DPU1, vsync2 refers to the vsync signal of the DPU2, and the user perception time is almost 0, because the switching process from the display 1 to the display 2 in the figure takes a very short time, so the user perception time is very short and can be considered as almost 0.
With reference to the foregoing schematic switching process diagram, an embodiment of the present application provides a DPU switching mechanism as follows:
1. firstly, the display switching device receives an event (switching event) for switching display contents, which is sent from the outside;
2. configuring the DPU2 to start working, and configuring a backpressure signal, where the backpressure signal can backpressure a Display Pixel Interface (DPI) of the DPU2 in real time, so that the DPI interface of the DPU2 does not output any data and timing;
3. DPU1 and DPU2 will generate a frame end signal for each frame by means of vertical and horizontal counters;
specifically, according to the vsync signal, a frame start signal, which is a start signal of one frame, is obtained, first, in the horizontal direction, according to the specification of the display screen, the number of pixels in each line is obtained by counting pixel (pixel)/valid (valid) signals, for example, the specification of the display screen is 1920 × 1080, and then the number of pixels in each line is 1920; at the beginning of each line, the DPU1 generates a horizontal Synchronization signal (hsync), and counts the hsync signal to obtain the number of lines of the frame image, for example, 1920 × 1080 is the specification of the display screen, and 1080 hsync signals are generated.
The frame end signal is generated by starting to count the hsync signal after the DPU1 sends out the vsync signal, obtaining the first pixel of the last line of the frame image, then obtaining the last pixel of the last line of the frame image through a pixel (pixel)/valid (valid) signal, and finally generating the frame end signal.
4. When a current frame of an event for switching display contents is received, a Pixel Link cancels mapping (connection) between DPU 1-display interfaces at the frame tail (the last line of the current frame) of the current frame to ensure that the current frame is completely transmitted;
5. after the Pixel Link cancels the mapping between the DPU 1-display interfaces, the back pressure signal of the DPU2 is released, at this time, the DPU2 starts outputting data and timing, and starts outputting vsync, i.e., a frame start signal of the DPU2, and at this time, the Pixel Link validates the mapping connection relationship between the DPU 2-display interfaces.
Based on the above-mentioned DPU switching mechanism, two applications from different operating systems process the display content through the DPU1 and the DPU2, respectively, and generate a frame end signal at the end of each frame through the vertical and horizontal counters, in order to ensure that a complete output of a frame is guaranteed when the mapping between the DPU and the display interface is cancelled. In addition, through the back pressure signal real-time back pressure DPI interface, no data and time sequence are output, and meanwhile when the frame end signal arrives, the back pressure signal is released, and the frame start signal and the data are output.
Referring to fig. 3, fig. 3 is a schematic view of a display switching method based on a display arbitration mechanism according to an embodiment of the present application, and in combination with the schematic view of the display switching method shown in fig. 3, the embodiment of the present application provides the following display arbitration mechanism:
1. it is assumed that there are two display applications, application 1 is a Reversing Camera System (RVC) to display a Reversing image; the application 2 is an In-Vehicle infotainment (IVI) and displays an android application image;
2. the display priority of the RVC is higher than the display priority of the IVI;
3. the display switching device (system) is started, the system is in an IDLE (IDLE) state (RVC =0, IVI = 0), the state is RVC _ ONLY (RVC =1, IVI = 0) when the RVC sends out a display request, the Pixel Link is connected with the DPU1 according to a frame end signal sent by the DPU1, and the display screen displays the RVC content;
4. at this time, if the IVI issues a display request, the status at this time is RVC _ MIX (RVC =1, IVI = 1), since the display priority of the RVC is higher than that of the IVI, the Pixel Link does not switch the DPU, and the display screen continues to display the RVC content;
5. when the RVC issues a stop display request, the state at this time is switched TO the state IVI _ ONLY (RVC =0, IVI = 1) via RVC _ TO _ IVI (RVC =1, IVI = 1), the Pixel Link will release the DPU1 (release RVC) according TO the frame end signal of the DPU1, i.e. close the connection of the DPU1 TO the display interface of the display screen, and then release the back pressure signal of the DPU2, and the display screen displays the IVI content;
6. if the RVC issues a display request again, the state at this time is switched TO the state RVC _ MIX (RVC =1, IVI = 1) via IVI _ TO _ RVC (RVC =0, IVI = 1), the Pixel Link will release DPU2 (release IVI) according TO the frame end signal of DPU2, i.e. close the connection of DPU2 TO the display interface of the display screen, and then release the back pressure signal of DPU1, the display screen displays the RVC content;
7. the system starts, and if the system is in an IDLE state at the moment, and the state is IVI _ ONLY (RVC =0, IVI = 1) at the moment when the IVI sends out a display request, the Pixel Link is connected with the DPU2 according to a frame end signal of the DPU2, and the display screen displays the IVI content; at this time, if the RVC issues a display request, step 6 is performed.
With reference to the above system architecture, the DPU switching mechanism and the display arbitration mechanism, a display switching method in the present application will be described below, please refer to fig. 4, where fig. 4 is a flowchart of a display switching method provided in an embodiment of the present application, and the embodiment of the present application at least includes the following steps:
401. receiving and processing first display content of a first running application through a first processing unit to obtain a first image frame of the first display content and a first frame tail signal of the first image frame;
402. receiving and processing second display content of a second running application through a second processing unit to obtain a second image frame of the second display content and a second frame tail signal of the second image frame;
in this embodiment, a first processing unit (for example, DPU 1) and a second processing unit (for example, DPU 2) are disposed inside the display switching apparatus, the first processing unit may receive, in real time, first display content of a running first application (for short, a first running application) through its own receiving port, and the second processing unit may receive, in real time, second display content of a running second application (for short, a second running application) through its own receiving port; in addition, for each frame image (first image frame) of the first display content, the first processing unit may generate an end-of-frame signal (first end-of-frame signal) at the end of each frame image, and also for each frame image (second image frame) of the second display content, the second processing unit may generate an end-of-frame signal (second end-of-frame signal) at the end of each frame image.
In some possible embodiments, step 401 receives and processes the first display content of the first running application through the first processing unit, and obtains a first image frame of the first display content and a first end-of-frame signal of the first image frame, including:
receiving, by a first processing unit, first display content of a first running application;
obtaining the last pixel of the last line of each frame image of the first display content according to the counter of the first processing unit so as to determine the frame tail of each frame image of the first display content;
and generating a first frame end signal at the frame end of each frame of image of the first display content.
Specifically, after the first processing unit receives first display content of the first running application, the first processing unit generates corresponding vsync signals for each frame of image of the first display content, and obtains a start signal of one frame of image, that is, a frame start signal. Taking a certain frame of image as an example, first, in the horizontal direction, according to the specification of the screen, the number of pixels in each line is obtained by counting pixel (pixel)/valid (valid) signals, for example, the specification of the screen is 1920 × 1080, and then the number of pixels in each line is 1920; at the beginning of each line, the first processing unit generates an hsync signal, and counts the hsync signal to obtain the number of lines of the frame image, for example, the specification of the screen is 1920 × 1080, and 1080 hsync signals are required to be generated. The frame end signal is generated by starting to count the hsync signal after the first processing unit sends out the vsync signal, obtaining the first pixel of the last line of the frame image, then obtaining the last pixel of the last line of the frame image through a pixel (pixel)/valid (valid) signal, and finally generating the frame end signal. Therefore, a specific implementation mode for acquiring the first frame tail signal is provided, complete display of subsequent frame images on the display unit is facilitated, the condition that the frame images are not displayed completely is avoided, and the technical scheme of the application is perfected.
Similarly, in some possible embodiments, the step 402 receives and processes the second display content of the second running application through the second processing unit to obtain a second image frame of the second display content and a second frame end signal of the second image frame, including:
receiving, by a second processing unit, second display content of a second running application;
obtaining the last pixel of the last line of each frame image of the second display content according to the counter of the second processing unit so as to determine the frame tail of each frame image of the second display content;
and generating a second frame end signal at the frame end of each frame of image of the second display content.
Specifically, since the specific description of acquiring the second end of frame signal is similar to the specific description of acquiring the first end of frame signal, the specific description of acquiring the second end of frame signal may refer to the specific description of acquiring the first end of frame signal, and is not repeated here.
403. When the display unit is determined to be switched from displaying the first display content to displaying the second display content, closing the data connection between the first processing unit and the display unit according to the first frame tail signal;
in this embodiment, after the display switching device obtains each frame image of the first display content and the end signal of each frame image (the first end signal), and obtains each frame image of the second display content and the end signal of each frame image (the second end signal), if the content displayed by the display unit of the current display switching device is the first display content, and if it is necessary for the display unit to switch from displaying the first display content to displaying the second display content, the data connection between the first processing unit and the display unit is closed according to the first end signal, so as to stop displaying the first display content on the display unit.
In some possible embodiments, it is explained how to close the data connection between the first processing unit and the display unit according to the first end-of-frame signal, for example, the following ways may be adopted:
and when the first frame tail signal is detected through a connection control, closing the data connection between the first processing unit and the display unit through the connection control, wherein the connection control is connected between the first processing unit and the display unit.
Specifically, when the display unit needs to switch from displaying the first display content to displaying the second display content, the first processing unit sends the received first display content to the display unit for displaying through the connection control in real time, and since the frame end of each frame image of the first display content generates the first frame end signal, the connection control can detect the first frame end signal. The following is illustrated by a specific example: assuming that the first processing unit sends each frame image of the first display content to the display unit in real time, at a certain moment (assuming that the first processing unit has sent 500 frame images, each frame image carries an end-of-frame signal), a switching request for switching the first display content displayed by the display unit to display the second display content is received, so that the connection control starts to detect the end-of-frame signal of the frame image of the first display content, and when the connection control detects the end-of-frame signal (usually, the 501 th frame image) of the first display content, the connection control immediately closes the data connection between the first processing unit and the display unit, thereby ensuring that the 501 th frame image can be completely displayed on the display unit after being transmitted to the display unit.
In some possible embodiments, how to determine that the display unit is to be switched from displaying the first display content to displaying the second display content is described, for example, the following manners may be adopted:
receiving a first display request for the first display content;
starting data connection between the first processing unit and the display unit according to the first frame tail signal so as to display the first display content on the display unit;
receiving a second display request for the second display content;
judging whether the content display priority of the second running application is higher than the content display priority of the first running application;
if the content display priority of the second running application is higher than that of the first running application, determining that the display unit is to be switched from displaying the first display content to displaying the second display content;
and if the content display priority of the second running application is lower than that of the first running application, the first display content is kept displayed on the display unit.
Specifically, after the display switching device obtains each frame image of the first display content and the end signal of each frame image (first end signal), and obtains each frame image of the second display content and the end signal of each frame image (second end signal), if the display switching device receives the first display request for the first display content, the display switching device will start the data connection between the first processing unit and the display unit according to the first end signal, so as to display the first display content on the display unit. It should be noted that the display switching device may invoke the connection control to detect the first end-of-frame signal, and immediately start the data connection between the first processing unit and the display unit after detecting the first end-of-frame signal, so as to display the first display content on the display unit.
After the display unit displays the first display content of the first running application, if the display switching device receives a second display request for the second display content of the second running application, the display switching device judges whether the content display priority of the second running application is higher than that of the first running application, if the content display priority of the second running application is higher than that of the first running application, it is determined that the display unit is required to switch from displaying the first display content to displaying the second display content, if the content display priority of the second running application is lower than that of the first running application, it is determined that the display unit is not required to switch from displaying the first display content to displaying the second display content, and at the moment, the display unit keeps displaying the first display content.
It should be understood that, in an actual scenario, it is considered that the first running application and the second running application from different operating systems need to set different display priorities, for example, the display priority of the important application is higher than that of the secondary application, the display priority of the frequently-used application is higher than that of the infrequently-used application, the display priority of the application with high user preference is higher than that of the application with low user preference, the display priority may be set by the system according to a fixed mode, or may be set by the system in combination with related parameters such as user habits and usage frequency, or may be set by the user in a customized manner, or may be set in a manner of combining system setting and user setting, which is not limited herein. It should be understood that if the display priority is not set to the application, when requests for content display by applications of different priorities are simultaneously received on the same display unit, the display switching apparatus may not know how to respond to the request for content display, i.e., the display switching apparatus may not determine which application's content is displayed. Or when the display unit currently displays the content of the first application, if a display request for the content of the second application is received, but the display priority of the second application is the display priority of the first application, then the display switching device does not switch to display the content of the second application at this time, because in some practical scenes, such as a reversing scene, when a user is reversing by using a reversing picture provided by a reversing image application, if a display request for a video picture of the video application is received, it is currently better not to switch to the video picture, because the reversing experience of the user is influenced, and the reversing safety is also influenced.
Further, in some possible embodiments, after the step of maintaining the display of the first display content on the display unit, the method further includes:
and if a display stopping request aiming at the first display content is received, determining that the display unit is to be switched from displaying the first display content to displaying the second display content.
Specifically, after the display unit keeps displaying the first display content, the second display content is always in a state of waiting for display on the display unit (if the second display request always exists), and if the display switching device receives a display stop request for the first display content, for example, a user actively closes the first running application, the current display unit is switched from displaying the first display content to displaying the second display content.
In some possible embodiments, how to keep displaying the first display content on the display unit is described, for example, the following ways may be adopted:
and according to a preset back pressure signal of a second processing unit, rejecting the second processing unit to send the second display content so as to enable the display unit to keep displaying the first display content.
Specifically, the display switching device configures a backpressure signal for the second processing unit in advance, and the backpressure signal can backpressure the DPI interface in real time, so that the DPI interface of the second processing unit does not actually output any data and time sequence. It will be appreciated that the second processing unit is able to output data and frame start almost immediately after the backpressure signal is released, i.e. to generate the vsync signal.
Correspondingly, the above rejecting the second processing unit to send the second display content according to the pre-configured backpressure signal of the second processing unit further includes:
if a display stopping request aiming at the first display content is received, closing the data connection between the first processing unit and the display unit according to the first frame tail signal;
and releasing the back pressure signal of the second processing unit.
Specifically, after the display switching device closes the data connection between the first processing unit and the display unit according to the first frame end signal, since the backpressure signal still exists, in order to enable the second processing unit to output the second display content, the backpressure signal of the second processing unit needs to be released.
404. And starting the data connection between the second processing unit and the display unit so as to display a second image frame of the second display content through the display unit.
In this embodiment, after the display switching device closes the data connection between the first processing unit and the display unit according to the first frame end signal, the display switching device opens the data connection between the second processing unit and the display unit again, so as to display the second image frame of the second display content through the display unit.
In some possible embodiments, step 404 opens a data connection between the second processing unit and the display unit, including:
and releasing the back pressure signal of the second processing unit to start the data connection between the second processing unit and the display unit, wherein the back pressure signal is a back pressure signal configured for the second processing unit in advance.
Specifically, when the display unit is required to switch from displaying the first display content to displaying the second display content, and the data connection between the first processing unit and the display unit is closed, the backpressure signal of the second processing unit is released immediately to open the data connection between the second processing unit and the display unit, and then the second display content output by the second processing unit is transmitted to the display unit for displaying, namely, the frame tail of the first processing unit and the frame head of the second processing unit can be connected within a very short time, the time consumed by the display switching mode is very short, and a user hardly perceives that there is a pause in switching.
In some possible embodiments, the step 404 of starting a data connection between the second processing unit and the display unit to display a second image frame of the second display content through the display unit further includes:
when the display unit is determined to be switched from displaying the second display content to displaying the first display content, closing the data connection between the second processing unit and the display unit according to the second frame tail signal;
and starting the data connection between the first processing unit and the display unit so as to display a first image frame of the first display content through the display unit.
Specifically, after it is determined that the display unit switches from displaying the first display content to displaying the second display content, if it is required that the display unit switches back from displaying the second display content to displaying the first display content, the data connection between the second processing unit and the display unit is closed according to the second frame end signal, and the data connection between the first processing unit and the display unit is immediately opened, so as to display the first image frame of the first display content through the display unit.
Further, the step of closing the data connection between the second processing unit and the display unit according to the second frame end signal includes:
and when the second frame tail signal is detected through a connection control, closing the data connection between the second processing unit and the display unit through the connection control, wherein the connection control is connected between the second processing unit and the display unit.
Specifically, since the specific description of closing the data connection between the second processing unit and the display unit through the connection control is similar to the specific description of closing the data connection between the first processing unit and the display unit through the connection control, the specific description of closing the data connection between the second processing unit and the display unit through the connection control may refer to the specific description of closing the data connection between the first processing unit and the display unit through the connection control, and is not repeated here.
Further, the step of opening the data connection between the first processing unit and the display unit includes:
and releasing the back pressure signal of the first processing unit to start the data connection between the first processing unit and the display unit, wherein the back pressure signal is a back pressure signal configured for the first processing unit in advance.
Therefore, the first display content and the second display content can be switched bidirectionally and seamlessly, the first display content displayed by the display unit can be switched to display the second display content seamlessly, and the second display content displayed by the display unit can also be switched back to display the first display content seamlessly.
In this embodiment, since the first end-of-frame signal and the second end-of-frame signal are respectively generated at the end of each frame of image of the first display content and the second display content in advance, when the first display content displayed on the display unit needs to be switched to the second display content, the data connection between the second processing unit and the display unit is immediately started after the data connection between the first processing unit and the display unit is closed according to the first end-of-frame signal. The process of closing the data connection between the first processing unit and the display unit and opening the data connection between the second processing unit and the display unit takes a very short time, so that the switching process takes a very short time, and therefore seamless switching between display contents of different applications is achieved.
Secondly, when the first display content displayed on the display screen needs to be switched into the second display content, when the connection control detects the frame end signal of the first display content sent by the current first DPU, the connection between the first DPU and the display screen is closed through the connection control, so that the frame image of the last frame of the first display content sent by the first DPU before the connection is closed is ensured to be completely displayed on the display screen, and the condition that the frame image is not completely displayed is avoided.
And finally, controlling the data connection between the second processing unit and the display unit based on the back pressure signal, namely controlling the output of the second display content of the second processing unit, so as to facilitate the seamless switching between subsequent different display contents. In addition, the first running application and the second running application are completely independent, communication is not needed between the first running application and the second running application, and the switching display of the first display content and the second display content can be realized.
In order to better implement the above solution of the embodiment of the present application, a related apparatus for implementing the above solution is further provided below, please refer to fig. 5, fig. 5 is a schematic structural diagram of a display switching apparatus provided in the embodiment of the present application, and the display switching apparatus includes:
a first processing module 501, configured to receive and process first display content of a first running application through a first processing unit, so as to obtain a first image frame of the first display content and a first frame end signal of the first image frame;
a second processing module 502, configured to receive and process a second display content of a second running application through a second processing unit, to obtain a second image frame of the second display content and a second frame end signal of the second image frame;
a closing module 503, configured to close the data connection between the first processing unit and the display unit according to the first frame tail signal when it is determined that the display unit is to be switched from displaying the first display content to displaying the second display content;
a starting module 504, configured to start a data connection between the second processing unit and the display unit, so as to display a second image frame of the second display content through the display unit.
In this embodiment, since the first end-of-frame signal and the second end-of-frame signal are respectively generated at the end of each frame of image of the first display content and the second display content in advance, when the first display content displayed on the display unit needs to be switched to the second display content, the data connection between the second processing unit and the display unit is immediately started after the data connection between the first processing unit and the display unit is closed according to the first end-of-frame signal. The process of closing the data connection between the first processing unit and the display unit and opening the data connection between the second processing unit and the display unit takes a very short time, so that the switching process takes a very short time, and therefore seamless switching between display contents of different applications is achieved.
Optionally, in some possible embodiments of the present application, the closing module 503 is further configured to close the data connection between the second processing unit and the display unit according to the second frame end signal when it is determined that the display unit is to be switched from displaying the second display content to displaying the first display content;
the starting module 504 is further configured to start a data connection between the first processing unit and the display unit, so as to display a first image frame of the first display content through the display unit.
Optionally, in some possible embodiments of the present application, the closing module 503 is specifically configured to receive a first display request for the first display content;
starting data connection between the first processing unit and the display unit according to the first frame tail signal so as to display the first display content on the display unit;
receiving a second display request for the second display content;
judging whether the content display priority of the second running application is higher than the content display priority of the first running application;
and if the content display priority of the second running application is higher than that of the first running application, determining that the display unit is to be switched from displaying the first display content to displaying the second display content.
Further, in some possible embodiments of the present application, the method further includes:
and the display unit is used for keeping displaying the first display content on the display unit if the content display priority of the second running application is lower than the content display priority of the first running application.
Further, in some possible embodiments of the present application, the method further includes:
and the determining unit is used for determining that the display unit is to be switched from displaying the first display content to displaying the second display content if a display stopping request aiming at the first display content is received.
Optionally, in some possible embodiments of the present application, the starting module 504 is specifically configured to release a backpressure signal of the second processing unit to start a data connection between the second processing unit and the display unit, where the backpressure signal is a backpressure signal configured for the second processing unit in advance.
Optionally, in some possible embodiments of the present application, the closing module 503 is specifically configured to close, by using a connection control, data connection between the first processing unit and the display unit when the first end-of-frame signal is detected by using the connection control, where the connection control is connected between the first processing unit and the display unit.
Further, in some possible embodiments of the present application, the closing module 503 is further configured to close, by using a connection control, data connection between the second processing unit and the display unit when the second end-of-frame signal is detected by using the connection control, where the connection control is connected between the second processing unit and the display unit.
Optionally, in some possible embodiments of the present application, the first processing module 501 is specifically configured to receive, by a first processing unit, first display content of a first running application;
obtaining the last pixel of the last line of each frame image of the first display content according to the counter of the first processing unit so as to determine the frame tail of each frame image of the first display content;
and generating a first frame end signal at the frame end of each frame of image of the first display content.
Fig. 6 illustrates a physical structure diagram of a computer device, and as shown in fig. 6, the computer device may include: a processor (processor)601, a communication Interface (Communications Interface)602, a memory (memory)603 and a communication bus 604, wherein the processor 601, the communication Interface 602 and the memory 603 complete communication with each other through the communication bus 604. The processor 601 may call logic instructions in the memory 603 to perform the following method: receiving and processing first display content of a first running application through a first processing unit to obtain a first image frame of the first display content and a first frame tail signal of the first image frame; receiving and processing second display content of a second running application through a second processing unit to obtain a second image frame of the second display content and a second frame tail signal of the second image frame; when the display unit is determined to be switched from displaying the first display content to displaying the second display content, closing the data connection between the first processing unit and the display unit according to the first frame tail signal; and starting the data connection between the second processing unit and the display unit so as to display a second image frame of the second display content through the display unit.
In addition, the logic instructions in the memory 603 may be implemented in the form of software functional units and stored in a computer readable storage medium when the logic instructions are sold or used as independent products. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.
On the other hand, the embodiments of the present application also provide a storage medium, on which a computer program is stored, where the computer program is implemented to perform the method provided by the foregoing embodiments when executed by a processor, for example, the method includes: receiving and processing first display content of a first running application through a first processing unit to obtain a first image frame of the first display content and a first frame tail signal of the first image frame; receiving and processing second display content of a second running application through a second processing unit to obtain a second image frame of the second display content and a second frame tail signal of the second image frame; when the display unit is determined to be switched from displaying the first display content to displaying the second display content, closing the data connection between the first processing unit and the display unit according to the first frame tail signal; and starting the data connection between the second processing unit and the display unit so as to display a second image frame of the second display content through the display unit.
The above-described embodiments of the apparatus are merely illustrative, and the units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the present embodiment. One of ordinary skill in the art can understand and implement it without inventive effort.
Through the above description of the embodiments, those skilled in the art will clearly understand that each embodiment can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware. With this understanding in mind, the above-described technical solutions may be embodied in the form of a software product, which can be stored in a computer-readable storage medium such as ROM/RAM, magnetic disk, optical disk, etc., and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the methods described in the embodiments or some parts of the embodiments.
Finally, it should be noted that: the above examples are only intended to illustrate the technical solution of the present invention, but not to limit it; although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and such modifications or substitutions do not depart from the spirit and scope of the corresponding technical solutions of the embodiments of the present invention.
Claims (10)
1. A display switching method, comprising:
receiving and processing first display content of a first running application through a first processing unit to obtain a first image frame of the first display content and a first frame tail signal of the first image frame;
receiving and processing second display content of a second running application through a second processing unit to obtain a second image frame of the second display content and a second frame tail signal of the second image frame;
when the display unit is determined to be switched from displaying the first display content to displaying the second display content, closing the data connection between the first processing unit and the display unit according to the first frame tail signal;
and starting the data connection between the second processing unit and the display unit so as to display a second image frame of the second display content through the display unit.
2. The display switching method according to claim 1, wherein the step of starting a data connection between the second processing unit and the display unit to display a second image frame of the second display content through the display unit further comprises:
when the display unit is determined to be switched from displaying the second display content to displaying the first display content, closing the data connection between the second processing unit and the display unit according to the second frame tail signal;
and starting the data connection between the first processing unit and the display unit so as to display a first image frame of the first display content through the display unit.
3. The display switching method according to claim 1, wherein the step of determining that the display unit is to be switched from displaying the first display content to displaying the second display content comprises:
receiving a first display request for the first display content;
starting data connection between the first processing unit and the display unit according to the first frame tail signal so as to display the first display content on the display unit;
receiving a second display request for the second display content;
judging whether the content display priority of the second running application is higher than the content display priority of the first running application;
and if the content display priority of the second running application is higher than that of the first running application, determining that the display unit is to be switched from displaying the first display content to displaying the second display content.
4. The display switching method according to claim 3, further comprising:
and if the content display priority of the second running application is lower than that of the first running application, the first display content is kept displayed on the display unit.
5. The display switching method according to claim 4, wherein the step of maintaining display of the first display content on the display unit further comprises, after:
and if a display stopping request aiming at the first display content is received, determining that the display unit is to be switched from displaying the first display content to displaying the second display content.
6. The display switching method according to claim 1, wherein the step of opening the data connection between the second processing unit and the display unit comprises:
and releasing the back pressure signal of the second processing unit to start the data connection between the second processing unit and the display unit, wherein the back pressure signal is a back pressure signal configured for the second processing unit in advance.
7. The method according to claim 1, wherein the step of closing the data connection between the first processing unit and the display unit according to the first end-of-frame signal comprises:
and when the first frame tail signal is detected through a connection control, closing the data connection between the first processing unit and the display unit through the connection control, wherein the connection control is connected between the first processing unit and the display unit.
8. The method according to claim 2, wherein the step of closing the data connection between the second processing unit and the display unit according to the second end-of-frame signal comprises:
and when the second frame tail signal is detected through a connection control, closing the data connection between the second processing unit and the display unit through the connection control, wherein the connection control is connected between the second processing unit and the display unit.
9. The method according to any one of claims 1 to 8, wherein the step of receiving and processing the first display content of the first running application by the first processing unit to obtain the first image frame of the first display content and the first end-of-frame signal of the first image frame comprises:
receiving, by a first processing unit, first display content of a first running application;
obtaining the last pixel of the last line of each frame image of the first display content according to the counter of the first processing unit so as to determine the frame tail of each frame image of the first display content;
and generating a first frame end signal at the frame end of each frame of image of the first display content.
10. A display switching apparatus, comprising:
the first processing module is used for receiving and processing first display content of a first running application through a first processing unit to obtain a first image frame of the first display content and a first frame tail signal of the first image frame;
the second processing module is used for receiving and processing second display content of a second running application through a second processing unit to obtain a second image frame of the second display content and a second frame tail signal of the second image frame;
a closing module, configured to close a data connection between the first processing unit and the display unit according to the first frame tail signal when it is determined that the display unit is to be switched from displaying the first display content to displaying the second display content;
and the starting module is used for starting the data connection between the second processing unit and the display unit so as to display a second image frame of the second display content through the display unit.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202011407305.6A CN112199067B (en) | 2020-12-04 | 2020-12-04 | Display switching method and device |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202011407305.6A CN112199067B (en) | 2020-12-04 | 2020-12-04 | Display switching method and device |
Publications (2)
Publication Number | Publication Date |
---|---|
CN112199067A CN112199067A (en) | 2021-01-08 |
CN112199067B true CN112199067B (en) | 2021-02-19 |
Family
ID=74034507
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202011407305.6A Active CN112199067B (en) | 2020-12-04 | 2020-12-04 | Display switching method and device |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN112199067B (en) |
Families Citing this family (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN112817685B (en) * | 2021-04-16 | 2021-07-23 | 湖北芯擎科技有限公司 | Display switching method and device, electronic equipment and storage medium |
CN114327721B (en) * | 2021-12-28 | 2024-05-10 | 展讯通信(上海)有限公司 | Display method of multiple operating systems and electronic equipment |
CN117472483A (en) * | 2022-07-21 | 2024-01-30 | 荣耀终端有限公司 | Image display method and related device |
Family Cites Families (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR101864333B1 (en) * | 2011-03-21 | 2018-07-05 | 삼성전자 주식회사 | Supporting Method For Icon Change Function And Portable Device thereof |
US9930270B2 (en) * | 2015-10-15 | 2018-03-27 | Microsoft Technology Licensing, Llc | Methods and apparatuses for controlling video content displayed to a viewer |
CN107678824A (en) * | 2017-10-11 | 2018-02-09 | 青岛海信移动通信技术股份有限公司 | Screen picture switching method and device based on system switching |
CN108399060B (en) * | 2018-03-12 | 2021-02-26 | 宁波大学 | Video switching method for mobile intelligent terminal |
CN111949118A (en) * | 2019-05-17 | 2020-11-17 | 深圳欧博思智能科技有限公司 | Equipment state switching method and device, storage medium and sound box |
-
2020
- 2020-12-04 CN CN202011407305.6A patent/CN112199067B/en active Active
Also Published As
Publication number | Publication date |
---|---|
CN112199067A (en) | 2021-01-08 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN112199067B (en) | Display switching method and device | |
KR100751861B1 (en) | Synchronization of image frame update | |
US9609270B2 (en) | Method for performing a video talk enhancement function and an electric device having the same | |
US20160255521A1 (en) | Method and apparatus for testing a smart device | |
CN114302219A (en) | Display equipment and variable frame rate display method | |
CN112235519B (en) | Video display method and device, electronic equipment and storage medium | |
CN102662514A (en) | Touch screen control method and mobile terminal | |
CN111629239A (en) | Screen projection processing method, device, equipment and computer readable storage medium | |
US9525829B2 (en) | Video display apparatus, video switching apparatus, and video display method | |
CN102902457A (en) | Display device with screen display menu function | |
CN105635668A (en) | Image displaying method and device | |
JP2017531339A (en) | Method and apparatus for interconnecting smart terminals and in-vehicle terminals | |
CN113672184A (en) | Screen expansion method and device, terminal equipment and computer readable storage medium | |
CN112188294B (en) | Signal source display method and device | |
US20180151156A1 (en) | Method and terminal for displaying boot graphic and storage medium | |
CN107317687B (en) | Remote control method, equipment and system | |
WO2018143975A1 (en) | Configuration options for display devices | |
CA2732781A1 (en) | Method and apparatus for selecting video channel, video device and tv device | |
CN107729136B (en) | Processing priority configuration method and device based on FPGA | |
CN113031895A (en) | Screen projection control method and device and electronic equipment | |
CN114780052A (en) | Method, system, device, processor and storage medium for realizing remote display between two SOC systems based on PCIe | |
CN114356489A (en) | Image display method, device, equipment and storage medium of virtual vehicle-mounted system | |
CN110753194B (en) | Dual-screen different display method, storage medium and electronic equipment | |
CN115437723A (en) | Application scene fast switching method and device, electronic equipment and storage medium | |
US20150261282A1 (en) | Information processing apparatus, method of controlling the same, and storage medium |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |