WO2023093458A1 - 确定墨水屏的刷新模式的方法、电子设备和存储介质 - Google Patents

确定墨水屏的刷新模式的方法、电子设备和存储介质 Download PDF

Info

Publication number
WO2023093458A1
WO2023093458A1 PCT/CN2022/128300 CN2022128300W WO2023093458A1 WO 2023093458 A1 WO2023093458 A1 WO 2023093458A1 CN 2022128300 W CN2022128300 W CN 2022128300W WO 2023093458 A1 WO2023093458 A1 WO 2023093458A1
Authority
WO
WIPO (PCT)
Prior art keywords
display unit
display
page
displayed
refresh mode
Prior art date
Application number
PCT/CN2022/128300
Other languages
English (en)
French (fr)
Inventor
周亮
王波
段利华
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Publication of WO2023093458A1 publication Critical patent/WO2023093458A1/zh

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs
    • G06F9/451Execution arrangements for user interfaces
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G3/00Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
    • G09G3/20Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
    • G09G3/34Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters by control of light from an independent source

Definitions

  • the embodiments of the present application relate to the field of display technologies, and in particular, to a method for determining a refresh mode of an ink screen, an electronic device, and a storage medium.
  • Electronic ink is a flicker-free and non-self-illuminating display technology.
  • the ink screen developed based on electronic ink has the obvious advantage of protecting eyes. More and more electronic devices such as e-books, electronic writing tablets, and electronic signs use ink screens. .
  • the ink drop in the ink screen is a kind of electrochemical material, relying on the movement of black and white ink droplets under the electric field to change the display content.
  • electronic screens such as liquid crystal display (LCD) or organic light-emitting semiconductor (organic electroluminescence display, OLED)
  • the display update speed of the ink screen is slower, and smearing, stuttering, and flickering may occur. Therefore, the ink screen usually has multiple refresh modes, and different refresh modes have different display effects. In this way, it is very important to reasonably configure the refresh mode of the ink screen.
  • the method of configuring the refresh mode of the ink screen is not reasonable, which leads to poor display effect of the ink screen.
  • Embodiments of the present application provide a method for determining a refresh mode of an ink screen, an electronic device, and a storage medium, which improve the accuracy and rationality of configuring the refresh mode of the ink screen, and improve the display effect of the ink screen.
  • the embodiment of the present application provides a method for determining the refresh mode of the ink screen, including: determining the content type and display area of the first display unit in the page to be displayed of the application program; the first display unit is a non-web page control Or the webpage element in the webpage control; set the refresh mode corresponding to the display area of the first display unit according to the content type of the first display unit; the refresh mode is used for the ink screen to display the display area of the first display unit in the page to be displayed.
  • the electronic device can set the refresh mode of the ink screen for the display unit, and set the refresh mode according to the content type of the display unit, so that different display units or different screens in the page to be displayed can be realized.
  • Setting different refresh modes in different regions improves the accuracy and rationality of setting the refresh mode of the ink screen, and improves the display effect.
  • the electronic device directly sets the refresh mode of the ink screen for the display unit in the page to be displayed of the application program at the operating system level, which reduces the workload and difficulty of the application program developer.
  • determining the content type and display area of the first display unit in the page to be displayed of the application program includes: determining the content type and display area of the first display unit when performing layout processing on the page to be displayed.
  • the content type and display area of the display unit can be determined at the layout stage, thereby determining the refresh mode corresponding to the display area of the display unit, which greatly reduces the amount of data processing and improves processing efficiency.
  • the page to be displayed includes non-webpage controls
  • the first display unit is a non-webpage control
  • determining the content type and display area of the first display unit includes: identifying at least one non-webpage control used when laying out the page to be displayed
  • the webpage control, at least one non-webpage control includes a first display unit; determine the identified content type and display area of the first display unit.
  • the content type and display area of the non-web page control are determined during the layout of the page to be displayed of the application program.
  • the page to be displayed includes a webpage control
  • the first display unit is a webpage element
  • determining the content type and display area of the first display unit includes: obtaining the webpage control included in the page to be displayed in the browser kernel
  • At least one webpage element in the at least one webpage element includes a first display unit; according to the document objectification model corresponding to the first display unit, determine the content type and display area of the first display unit.
  • the content type and display area of the webpage element in the webpage control are determined during the layout of the page to be displayed of the application program.
  • the method for determining the refresh mode of the ink screen further includes: acquiring event information; the event information includes the content refresh area and refresh period corresponding to the user operation on the page to be displayed, and the user operation is used to trigger the content refresh area
  • the content in is refreshed and displayed within the refresh period, and the content refresh area includes the display area of the first display unit; if the current moment is within the refresh period, the refresh mode corresponding to the display area of the first display unit is determined according to the refresh display mode.
  • the refresh mode corresponding to the content refresh area is determined according to the way of refresh display, compared to determining the refresh mode according to the content type of the first display unit in the content refresh area. mode, which improves the accuracy and rationality of determining the refresh mode corresponding to the content refresh area, thereby improving the display effect of the ink screen.
  • the manner of refreshing the display includes any one of the following: sliding display, scrolling display, page turning display, zooming out display or zooming in display.
  • the page to be displayed further includes a second display unit, the content types of the first display unit and the second display unit are the same, and the display area between the display area of the first display unit and the display area of the second display area There are no display units of other content types between them; setting the refresh mode corresponding to the display area of the first display unit according to the content type of the first display unit includes: setting the refresh mode corresponding to the target area according to the content type of the first display unit; the target area It includes a display area of the first display unit, a display area of the second display unit, and a display area between the first display unit and the second display unit.
  • the refresh mode can be set for the entire target area where the multiple display units are located, avoiding setting the display area of each display unit separately, Improved processing efficiency.
  • the page to be displayed also includes a fifth display unit
  • the method for determining the refresh mode of the ink screen further includes: obtaining a configuration file; if the configuration file includes If the corresponding relationship between the modes, set the refresh mode corresponding to the window to which the fifth display unit belongs to the refresh mode corresponding to the display area of the fifth display unit; or, if the configuration file includes the application program and the refresh mode to which the fifth display unit belongs If there is a corresponding relationship between them, the refresh mode corresponding to the application program to which the fifth display unit belongs is set as the refresh mode corresponding to the display area of the fifth display unit.
  • the corresponding relationship between different application programs and refresh modes, or the corresponding relationship between windows displaying different pages and refresh modes is preset in the configuration file.
  • the refresh mode of the display area of the fifth display unit can be set directly according to the configuration file, which provides a supplementary scheme for setting the refresh mode.
  • the refresh mode corresponding to the display area of the first display unit is set according to the content type of the first display unit, including : Obtain the page coverage relationship between multiple pages to be displayed; when the first display unit is the display unit in the first page to be displayed at the highest level, set according to the content type of the first display unit in the first page to be displayed The refresh mode corresponding to the display area of the first display unit in the first page to be displayed; or, when the first display unit is a display unit in the second page to be displayed below the highest layer, in the second page to be displayed Determine the non-overlapping area that does not overlap with the target page to be displayed in the display area of the first display unit, and set the refresh mode corresponding to the non-overlapping area according to the content type of the first display unit in the second page to be displayed; the target page to be displayed Including the sum of areas of all pages to be displayed above the second page to be displayed.
  • the refresh mode can be set directly according to the content type of the display unit, which improves accuracy and rationality.
  • the display unit in the page to be displayed below the top layer part or all of the display area of the display unit may be blocked, while the unblocked part is visible to the user.
  • the content type of the unit sets the refresh mode, which improves the accuracy and rationality, and improves the display effect of the ink screen.
  • determining the content type and display area of the first display unit in the page to be displayed of the application program includes: obtaining composite display data after performing layout processing, drawing processing, and layer composition processing on the page to be displayed ; Determine the content type and display area of the first display unit according to the composite display data.
  • composite display data is generated after the page to be displayed has been processed by a layout process, a drawing process, and a layer composition process.
  • the electronic device obtains the content type of the display unit by analyzing the synthesized display data, so that the refresh mode corresponding to the display area of the display unit can be set according to the content type, which improves the accuracy and rationality of setting the refresh mode of the ink screen.
  • the page to be displayed further includes a third display unit
  • the method for determining the refresh mode of the ink screen further includes: setting the preset refresh mode of the third display unit to correspond to the display area of the third display unit refresh mode.
  • a preset refresh mode can be directly set for a specific display unit to improve the display effect of the ink screen.
  • the page to be displayed further includes a fourth display unit, the content types of the first display unit and the fourth display unit are different, and the method for determining the refresh mode of the ink screen further includes: according to the fourth display unit The content type sets a refresh mode corresponding to the display area of the fourth display unit.
  • the page to be displayed includes display units of at least two content types, for example, the first display unit and the fourth display unit, then corresponding refresh modes are set according to different content types, which improves the Set the accuracy and rationality of the refresh mode of the ink screen. If the page to be displayed includes display units of one content type, the entire area of the page to be displayed can be set to the same refresh mode, which does not need to be set separately for each display unit, thereby improving processing efficiency.
  • the method for determining the refresh mode of the ink screen further includes: determining whether to use a dithering algorithm for the display area of the first display unit according to the refresh mode corresponding to the display area of the first display unit.
  • the display effect of the ink screen can be further improved.
  • the content type includes any one of the following: text, picture or video.
  • the first display unit includes any one of the following: a text control, a picture control, a video playback control, a text element in a web page control, a picture element in a web page control, or a video element in a web page control .
  • the embodiment of the present application provides a device for determining the refresh mode of the ink screen, including: a determination module for determining the content type and display area of the first display unit in the page to be displayed of the application program; the first display unit It is a webpage element in a non-webpage control or a webpage control; the setting module is used to set the refresh mode corresponding to the display area of the first display unit according to the content type of the first display unit; the refresh mode is used for the ink screen to display the second page in the page to be displayed A display area of a display unit.
  • the determining module is configured to: determine the content type and display area of the first display unit when performing layout processing on the page to be displayed.
  • the page to be displayed includes a non-webpage control
  • the first display unit is a non-webpage control
  • the determining module is configured to: identify at least one non-webpage control used when laying out the page to be displayed, and the at least one non-webpage control includes The first display unit: determining the content type and display area of the identified first display unit.
  • the page to be displayed includes webpage controls
  • the first display unit is a webpage element
  • the determining module is configured to: acquire at least one webpage element in the webpage controls included in the page to be displayed in the browser kernel, at least one
  • the web page element includes a first display unit; according to the document objectification model corresponding to the first display unit, the content type and display area of the first display unit are determined.
  • the setting module is also used to: obtain event information; the event information includes the content refresh area and refresh period corresponding to the user operation in the page to be displayed, and the user operation is used to trigger the refresh of the content in the content refresh area
  • the display is refreshed within the period, and the content refresh area includes the display area of the first display unit; if the current moment is within the refresh period, the refresh mode corresponding to the display area of the first display unit is determined according to the refresh display mode.
  • the manner of refreshing the display includes any one of the following: sliding display, scrolling display, page turning display, zooming out display or zooming in display.
  • the page to be displayed further includes a second display unit, the content types of the first display unit and the second display unit are the same, and the display area between the display area of the first display unit and the display area of the second display area There are no display units of other content types between them; the setting module is used to: set the refresh mode corresponding to the target area according to the content type of the first display unit; the target area includes the display area of the first display unit, the display area of the second display unit, and A display area between the first display unit and the second display unit.
  • the page to be displayed also includes a fifth display unit
  • the setting module is also used to: obtain a configuration file; if the configuration file includes the correspondence between the window of the page to be displayed to which the fifth display unit belongs and the refresh mode relationship, then set the refresh mode corresponding to the window to which the fifth display unit belongs to the refresh mode corresponding to the display area of the fifth display unit; or, if the configuration file includes the corresponding relationship between the application program to which the fifth display unit belongs and the refresh mode , the refresh mode corresponding to the application program to which the fifth display unit belongs is set as the refresh mode corresponding to the display area of the fifth display unit.
  • the setting module is used to: obtain the page coverage relationship between the multiple pages to be displayed; the first display unit When it is the display unit in the first page to be displayed at the highest level, set the refresh mode corresponding to the display area of the first display unit in the first page to be displayed according to the content type of the first display unit in the first page to be displayed or, when the first display unit is the display unit in the second page to be displayed below the highest level, determine the non-overlapping target page to be displayed in the display area of the first display unit in the second page to be displayed In the non-overlapping area, the refresh mode corresponding to the non-overlapping area is set according to the content type of the first display unit in the second page to be displayed; the target page to be displayed includes the sum of the areas of all pages to be displayed above the second page to be displayed.
  • the determining module is configured to: obtain composite display data after performing layout processing, drawing processing, and layer composition processing on the page to be displayed; determine the content type and display area of the first display unit according to the composite display data .
  • the page to be displayed further includes a third display unit
  • the setting module is further configured to: set the preset refresh mode of the third display unit to the refresh mode corresponding to the display area of the third display unit.
  • the page to be displayed further includes a fourth display unit, the content types of the first display unit and the fourth display unit are different, and the setting module is further configured to: set the fourth display unit according to the content type of the fourth display unit.
  • the setting module is further configured to: determine whether to use a dithering algorithm for the display area of the first display unit according to a refresh mode corresponding to the display area of the first display unit.
  • the content type includes any one of the following: text, picture or video.
  • the first display unit includes any one of the following: a text control, a picture control, a video playback control, a text element in a web page control, a picture element in a web page control, or a video element in a web page control .
  • an electronic device including a processor, and the processor is configured to be coupled with a memory, read instructions in the memory, and make the electronic device execute the method provided in the first aspect according to the instructions.
  • a program is provided, which is used to execute the method provided in the first aspect when executed by a processor.
  • a computer-readable storage medium is provided. Instructions are stored in the computer-readable storage medium. When the instructions are run on a computer or a processor, the method provided in the first aspect is implemented.
  • a program product in a sixth aspect, includes a computer program, the computer program is stored in a readable storage medium, at least one processor of an electronic device can read the computer program from the readable storage medium program, the at least one processor executes the computer program so that the electronic device implements the method provided in the first aspect.
  • FIG. 1A is a schematic diagram of a scene applicable to the embodiment of the present application.
  • Fig. 1B is a schematic structural diagram of the ink screen provided by the embodiment of the present application.
  • FIG. 2 is a schematic diagram of a control waveform provided by an embodiment of the present application.
  • FIG. 3 is a software architecture diagram of an electronic device provided in an embodiment of the present application.
  • 4A to 4C are a set of schematic diagrams of the interface of the ink screen provided by the embodiment of the present application.
  • Figures 5A to 5H are a set of schematic diagrams of the pages provided by the embodiment of the present application.
  • FIG. 6 is another software architecture diagram of the electronic device provided by the embodiment of the present application.
  • FIG. 7A is a schematic diagram of setting a refresh mode using the software architecture shown in FIG. 6;
  • FIG. 7B is a schematic diagram of a display effect of FIG. 7A
  • FIG. 8 is an interface diagram for setting a refresh mode of an electronic device provided in an embodiment of the present application.
  • FIG. 9 is a schematic diagram of setting the refresh mode in the manner shown in FIG. 8;
  • Figures 10A to 10H are diagrams for setting the refresh mode of the pages shown in Figures 5A to 5H;
  • FIG. 11 is a schematic diagram of a display effect of FIG. 10D.
  • FIG. 12 is another software architecture diagram of the electronic device provided by the embodiment of the present application.
  • FIG. 13 is another software architecture diagram of the electronic device provided by the embodiment of the present application.
  • Fig. 14 is a flowchart of a method for determining the refresh mode of the ink screen provided by the embodiment of the present application.
  • Fig. 15 is a schematic diagram of the page to be displayed provided by the embodiment of the present application.
  • FIG. 16 is a schematic diagram of refresh modes corresponding to each area in FIG. 15;
  • Fig. 17 is a schematic structural diagram of the device for determining the refresh mode of the ink screen provided by the embodiment of the present application.
  • FIG. 18 is a schematic structural diagram of an electronic device provided by an embodiment of the present application.
  • FIG. 1A is a schematic diagram of a scene applicable to this embodiment of the present application.
  • an electronic device 100 has an ink screen 101 .
  • the ink screen 101 can display content of an application program (application, APP) installed in the electronic device 100 .
  • the ink screen 101 includes a window 102 , and a page 103 to be displayed of the APP is displayed in the window 102 .
  • the embodiment of the present application does not limit the type, model, and shape of the electronic device.
  • examples of some electronic devices are: mobile phones, tablet computers, handheld computers, e-books, electronic tablet, electronic signage, wearable devices, smart screens, teaching equipment, Internet of things (internet of things, IOT) devices, or smart Wireless terminals in a home (smart home), etc.
  • the embodiment of the present application does not limit the name and type of the APP installed in the electronic device.
  • FIG. 1B is a schematic structural diagram of an ink screen provided in an embodiment of the present application.
  • Fig. 1B may be a cross-sectional view of the ink screen 101 in Fig. 1A along the direction AA'.
  • a large number of ink droplets 13 are included in the ink screen.
  • the ink droplets 13 are also called microcapsules, and the size of these microcapsules is about the diameter of a human hair.
  • the ink droplet 13 contains clear liquid and white particles 15 and black particles 16 suspended in the clear liquid.
  • the white particles 15 are positively charged, and the black particles 16 are negatively charged.
  • the ink screen also includes a top transparent electrode 11 and a bottom electrode 12 for applying an electric field to control the movement of white particles 15 and black particles 16 in ink droplets 13 .
  • the ink screen appears white to the user, and at the same time, the black particles 16 in the ink droplet 13 are pulled to the bottom of the ink droplet, thereby being hidden.
  • the electric field is set to be negative, and the bottom electrode 12 applies a negative voltage, and the black particles 16 in the ink drop 13 move to the top of the ink drop, that is, to move upward on the screen,
  • the ink screen appears black to the user, and at the same time, the white particles 15 in the ink droplet 13 are pulled to the bottom of the ink droplet, thereby being hidden.
  • the electric field applied by the top transparent electrode 11 and the bottom electrode 12 can control the movement of white particles and black particles in ink droplets, so that the ink screen can display colors and display screen content.
  • the colors include white, black, and gray scales (also called gray scales) between white and black.
  • the embodiment of the present application does not limit the number of gray levels, for example, 16 gray levels, 32 gray levels, and so on.
  • the control chip of the ink screen can receive the control waveform, and apply an electric field to the top transparent electrode 11 and the bottom electrode 12 according to the control waveform.
  • FIG. 2 is a schematic diagram of a control waveform provided by the embodiment of the present application.
  • the control waveform has different voltage values at different time points, and the voltage value can be positive, negative or zero.
  • the control waveform has a refresh frequency, which is also the frequency for refreshing the screen of the ink screen. The higher the refresh rate, the faster the screen refresh rate when the ink screen is displayed, on the contrary, the lower the refresh rate, the slower the screen refresh rate when the ink screen is displayed.
  • the ink screen Based on the display principle of the ink screen, the ink screen has the obvious advantages of low power consumption and eye protection.
  • the ink screen is usually refreshed slowly when displaying, and the displayed color gradation is usually limited.
  • the ink screen displays animations, videos, etc.
  • smear is also called afterimage, which refers to the afterimage on the display. It can be understood that when the display switches the screen, the previous screen will not disappear immediately, and the visual effect will show that the previous screen and the next screen are at the same time. Appears, the previous screen gradually disappears.
  • the ink screen has a variety of refresh modes.
  • the control waveforms are different, for example, the frequencies of the control waveforms are different and/or the voltage amplitudes of the control waveforms are different, so as to meet the requirements of different application scenarios and provide different display effects.
  • Table 1 shows various refresh modes, including: INIT (initial mode), DU, GC16, GL16, GLR16, GLD16, A2 and DU4.
  • the parameters of each refresh mode include: grayscale and refresh rate.
  • the refresh frequency is represented by a typical time consumption at 25°C.
  • a typical time-consuming of 450ms at 25°C corresponds to a refresh frequency of 1s/450ms, which is approximately 2Hz;
  • a typical time-consuming of 250ms at 25°C corresponds to a refresh frequency of 4Hz.
  • the larger the typical time-consuming at 25°C the lower the refresh frequency, which is suitable for static display content, such as text and pictures.
  • the smaller the typical time consumption at 25°C the higher the refresh rate, which is suitable for dynamic display content, such as video, animation, etc.
  • the greater the number of gray scales the more colors the ink screen can display, which is suitable for display content that requires color diversity, such as pictures and videos.
  • the smaller the number of gray scales the fewer colors the ink screen displays, which is suitable for display content that requires less color diversity, such as text.
  • the typical time-consuming at 25°C is 260ms, and the refresh frequency is about 4Hz, which is usually used to display scenes with gray scale changes, such as monochrome menus, mouse pointers , text input, touch screen input, touch pen input, stylus input, quick page turning, pop-up window, item selection (for example, font size selection), highlight mark, etc., with little or no afterimage, and no flickering on the screen.
  • the GC16 refresh mode it has 16 gray levels, the typical time-consuming at 25°C is 450ms, and the refresh frequency is about 2Hz. The refresh is very slow.
  • the GLR16 refresh mode is usually used to display text, icons, etc. under a white background, with little or no afterimage, and the flicker when the screen changes is relatively light.
  • the A2 refresh mode it has 2 gray levels, the typical time-consuming at 25°C is 120ms, and the refresh frequency is about 8Hz. The refresh is fast but the contrast is poor. It is usually used to display scenes that require fast refresh, such as fast page turning, playing video or , animation, etc.
  • Table 1 is only an example, and does not limit the refresh mode, parameters of the refresh mode, application scenarios, and display effects.
  • the dithering algorithm refers to a kind of image processing algorithm.
  • color blocks or deformation problems are prone to occur.
  • the occurrence of color blocks or deformation problems can be greatly reduced by the dithering algorithm, and the display can be improved. Effect.
  • the specific implementation of the dithering algorithm is not described in detail in the embodiment of the present application, and an existing algorithm implementation manner may be used.
  • the display effect can be improved by combining the dithering algorithm.
  • DU refresh mode and A2 refresh mode in Table 1.
  • the embodiment of the present application does not limit the preset value.
  • the software system of the electronic device may adopt a layered architecture, an event-driven architecture, a micro-kernel architecture, a micro-service architecture, a cloud architecture, and the like.
  • the embodiment of the present application is described by taking an electronic device adopting a layered architecture as an example.
  • the layered architecture divides the software into several layers, each layer has a clear role and division of labor, and the layers communicate through software interfaces.
  • FIG. 3 is a software architecture diagram of an electronic device provided in an embodiment of the present application.
  • the software architecture includes the application (Application) layer, framework (framework) layer, local services (Native Services) layer and kernel layer from top to bottom.
  • the application layer is also called the application program layer, including the APP provided by the system to the user.
  • the application program can be identified as APP 1 to APP N, where N is a positive integer.
  • Applications may include, but are not limited to: gallery, calendar, map, navigation, bluetooth, music, video, short message, etc.
  • APP 1 ⁇ APP N can generate the data to be displayed, and the electronic device will display the data on the display after processing the data to be displayed.
  • the display screen is an ink screen.
  • the framework layer also known as the framework service layer, is used to provide application programming interfaces (application programming interface, API) and programming frameworks to applications in the application layer.
  • the framework layer can include some predefined functions, for example, layout subsystem and drawing subsystem.
  • layout subsystem is used to implement the layout process
  • drawing subsystem is used to implement the drawing process.
  • the local service layer is used to provide the system-level implementation required by the framework layer, such as graphics cache, database storage, etc.
  • the local service layer may include a display compositing subsystem, which is used to implement a layer (SurfaceFlinger) compositing process.
  • the kernel layer also known as the device driver layer, is the layer between hardware and software.
  • the device driver layer includes at least a display driver.
  • a waveform (waveform) module is also included for generating a control waveform.
  • the control chip of the ink screen can apply an electric field according to the control waveform, so that the ink screen can display.
  • the electronic device processes the data to be displayed generated by the application program according to the display pipeline, and presents a display interface to the user.
  • the display pipeline mainly includes the layout process, drawing process and SurfaceFlinger synthesis process.
  • the layout process obtains the data to be displayed of at least one application program, and performs layout on the data to be displayed of each application program.
  • the drawing process generates layers according to the layout drawing content corresponding to the data to be displayed in each application.
  • the SurfaceFlinger synthesis process synthesizes multiple layers generated by the drawing process and sends them to the display, that is, pushes the synthesized data to the display.
  • Applications display content in windows, windows are tools that display pages, and pages are content displayed in windows. for example.
  • the electronic device displays the content of APP1 in window 1 .
  • APP1 is an application program for viewing pictures, and the page currently displayed in window 1 includes picture 1.
  • the user can switch the display content of APP1 through operations. For example, the user performs an operation of switching pictures, and switches picture 1 to picture 2 .
  • the electronic device refreshes the page displayed in window 1 to include picture 2 .
  • the frame of the window can be displayed or not.
  • an application program may display pages in one window, or may display pages in multiple windows respectively.
  • the multiple pages may or may not have overlapping areas.
  • there is an overlapping area among the multiple pages there is a page coverage relationship in the up-down direction between the multiple pages.
  • APP1 corresponds to window 411 and window 412 in ink screen 40, page 1 is displayed in window 411, page 2 is displayed in window 412, and page 1 and page 2 do not have overlap area.
  • FIG. 4B APP1 corresponds to window 421 and window 422 in ink screen 40, page 1 is displayed in window 421, page 2 is displayed in window 422, page 1 and page 2 have an overlapping area, and page 2 Located on top of page 1.
  • the electronic device can display a page of an application program, or can display pages of multiple application programs. See the description above for the pages of each application, so I won't repeat them here.
  • the electronic device displays pages of multiple application programs, the electronic device displays at least two pages. There may or may not be overlapping regions between at least two pages. When there is an overlapping area between at least two pages, there is a page covering relationship in the up-down direction between the at least two pages.
  • APP1 corresponds to a window 431
  • page 1 is displayed in the window 431
  • APP2 corresponds to window 432
  • page 2 is displayed in window 432 .
  • APP3 corresponds to window 433 and window 434 , page 3 is displayed in window 433 , page 4 is displayed in window 434 , and page 4 is located on the upper layer of page 3 .
  • APP4 corresponds to window 435 , and page 5 is displayed in window 435 .
  • page 2 and page 5 have an overlapping area, and page 5 is located on the upper layer of page 2.
  • page 5 is still on top of page 3.
  • the page coverage relationship among pages 1 to 5 includes: page 1, page 4 and page 5 are at the highest level, the pages above page 2 include page 5, and the pages above page 3 include page 4 and page 5.
  • page 4 is a floating window page
  • page 5 is a display page of an input method or a display page of a stylus.
  • a page may include at least one view (view), and a view is also called a control.
  • the refresh mode of the ink screen can be set for the control.
  • the control may include a web view (WebView) and a non-web view. Non-Web Views are also known as Non-Web Controls.
  • WebView web view
  • Non-Web Views are also known as Non-Web Controls.
  • a web page view is also referred to as a web page control, and the web page control includes web page elements.
  • the refresh mode of the ink screen can also be set for web page elements.
  • the unit that can set the refresh mode of the ink screen is defined as a display unit.
  • the display unit includes any one of the following: a non-webpage control or a webpage element in a webpage control.
  • non-webpage controls may include but not limited to text controls, image controls or video playback controls.
  • the web page elements may include but not limited to text elements, picture elements or video elements.
  • the display unit has content types, and different content types may correspond to different refresh modes.
  • the content types may include dynamic display types and static display types.
  • the static display type includes but not limited to: text, picture.
  • Dynamic display types include but are not limited to: video, animation.
  • the page may include one display unit, or may include multiple display units.
  • the content types of the multiple display units may be the same or different.
  • the page may only include non-webpage controls, or only include webpage controls, or include both webpage controls and non-webpage controls.
  • FIGS. 5A to 5H the relationship between the page and the display unit is exemplarily described through FIGS. 5A to 5H , and the display scene applicable to the embodiment of the present application is exemplarily described, but FIG. 5A to 5H are not limited thereto.
  • the display unit may be a non-webpage control or a webpage element.
  • the page 1 includes a display unit, which is a non-webpage control 1 , and the content type of the non-webpage control 1 is text.
  • the page includes multiple display units, and the content types of the multiple display units are the same.
  • the multiple display units include non-webpage controls and/or webpage elements.
  • the page 2 includes two display units, which are non-webpage control 1 to non-webpage control 2 respectively, and the content types are all text.
  • the page includes multiple display units, all of which are non-webpage controls, and the content types of the multiple display units include at least two types.
  • page 3 includes three display units, which are non-webpage control 1 to non-webpage control 3 respectively, the content type of non-webpage control 1 is text, and the content type of non-webpage control 2 is image, The content type of the non-web page control 3 is video.
  • the page includes multiple display units, all of which are web page elements, and the content types of the multiple display units include at least two types.
  • page 4 includes a webpage control
  • the webpage control includes 3 webpage elements, that is, page 4 includes 3 display units, which are respectively webpage element 1 to webpage element 3 .
  • the content type of webpage element 1 is text
  • the content type of webpage element 2 is image
  • the content type of webpage element 3 is video.
  • the page includes multiple display units, the multiple display units include non-web page controls and or web page elements, and the content types of the multiple display units include at least two types.
  • page 5 includes webpage control and non-webpage control 1
  • webpage control includes 2 webpage elements, that is, page 5 includes 3 display units, which are respectively webpage element 1, webpage element 2 and non-webpage element Web Control1.
  • the content type of webpage element 1 is text
  • the content type of webpage element 2 is image
  • the content type of non-webpage control 1 is video.
  • page 6 includes non-webpage control 1 and non-webpage control 2
  • page 7 is located on the upper layer of page 6 and includes non-webpage control 3
  • the area where the non-webpage control 3 and the non-webpage control 2 are located has an overlapping area, and the non-webpage control 3 is located on the upper layer of the non-webpage control 2 .
  • the user sees that the non-webpage control 3 covers a part of the non-webpage control 2 .
  • page 8 includes controls 1 to 7, all of which are non-webpage controls.
  • the content types of controls 4 to 7 are pictures, and the areas where controls 4 to 7 are located are adjacent, or it can be understood that there is no other display unit between the areas where controls 4 to 7 are located.
  • the page has a content refresh area, specifically a sliding display area.
  • page 9 has a sliding display area 61 , and at this time, the sliding display area 61 includes controls 1 to 3 , all of which are non-web page controls.
  • the user can perform a pull-down operation on the sliding control 62 to refresh the content displayed in the sliding display area 61 .
  • the sliding display area 61 includes controls 3 to 5 , all of which are non-webpage controls.
  • Page 9 also includes control 5, which is a non-web page control.
  • the electronic device opens a software interface for setting the refresh mode of the ink screen to the application program at the upper level at the operating system level.
  • the application program at the upper layer can call the software interface provided by the system to set the refresh mode of the ink screen, and transmit the set refresh mode of the ink screen to the system side.
  • FIG. 6 is another software architecture diagram of the electronic device provided by the embodiment of the present application.
  • the software architecture of an electronic device includes an application layer, an interface layer, a framework layer, a local service layer and a kernel layer from top to bottom.
  • the application layer, the framework layer, the local service layer and the kernel layer can refer to the relevant description in FIG.
  • the interface layer includes a software development kit (software development kit, SDK), which is an interface opened by the operating system to the APP, and is used for the APP to set the refresh mode of the ink screen. Take APP1 as an example for description.
  • SDK software development kit
  • APP1 will call the SDK to set the refresh mode for view 11-view 14 respectively, and pass the refresh mode of view 11-view 14 to the framework layer & local service layer, so as to set the refresh mode to the control chip of the ink screen.
  • the operating system of the electronic device can provide an interface for setting the refresh mode to the upper-layer application program, and the upper-layer application program should actively call this interface according to the content to be displayed, so as to set an appropriate refresh mode for the control to be displayed.
  • model Due to the variety of applications, each application needs to be adapted to the interface during the development process, which has high requirements for application development. Moreover, the content that the application program needs to display is complex and changeable, and the interface provided by the system side must be called for each control, and the workload of the application program developer is heavy and difficult. Moreover, the application program sets the refresh mode for the control, and a control sets a refresh mode. When the control includes multiple types of content, for example, when the web page control includes multiple types of web page elements, a unified refresh mode is still set for the control, resulting in poor display effect of some types of content.
  • FIG. 7A is a schematic diagram of setting a refresh mode using the software architecture shown in FIG. 6 .
  • a browser application needs to display page 4 shown in FIG. 5D
  • page 4 includes webpage controls, specifically including three types of content: text, picture and video.
  • the refresh mode of the entire webpage control is set to GL16, as shown on the right side of FIG. 7A , and the display effect is shown in FIG. 7B .
  • the text and pictures on page 4 are displayed normally, but the video has problems such as freezing and discontinuous images, and the display effect is very poor.
  • the refresh mode of the ink screen can be set by the user.
  • the embodiment of the present application does not limit the way for the user to set the refresh mode, for example, by operating on a relevant interface displayed by the electronic device, by voice setting, and the like.
  • FIG. 8 is an interface diagram for setting a refresh mode of an electronic device provided in an embodiment of the present application.
  • the electronic device displays an interface 80 for setting the refresh mode of the ink screen.
  • the interface 80 includes multiple refresh modes, for example, normal refresh, fast refresh and extremely fast refresh.
  • the refresh modes included in the interface 80 have a corresponding relationship with the refresh modes shown in Table 1.
  • Each refresh mode corresponds to a selection control, for example, normal refresh corresponds to a selection control 81 .
  • each refresh mode also has prompt information for guiding the user to make a choice.
  • the prompt information for normal refresh is "good display effect”
  • the prompt information for fast refresh is "slight afterimage, suitable for quick browsing of pictures and texts”
  • the prompt information for ultra-fast refresh is "severe afterimage, suitable for fast swipe browsing”.
  • the electronic device sets the refresh mode of the ink screen to the normal refresh mode.
  • the electronic device sets the refresh mode of the ink screen according to the refresh mode set by the user, requiring the user to manually switch the refresh mode according to different display scenarios, which requires frequent operations and poor user experience. For example, if the user is currently browsing pictures, the refresh mode can be set to fast refresh. When the user reads a novel, the user needs to manually switch the refresh mode from fast refresh to normal refresh. Moreover, when the page includes multiple types of content, such as the pages shown in FIG. 5C to FIG. 5H , different types of display units will be set to a unified refresh mode, which will result in poor display effects for some types of content.
  • FIG. 9 is a schematic diagram of setting a refresh mode in the manner shown in FIG. 8 .
  • a shopping application needs to display page 3 shown in FIG. 5C
  • page 3 includes three types of non-webpage controls, namely text, picture and video.
  • the refresh mode currently set by the user is extremely fast refresh, which corresponds to the A2 refresh mode in Table 1, and the refresh mode is shown on the right side of Figure 9.
  • the high refresh rate of A2 will result in poor display effect of the text on page 3.
  • the embodiment of the present application also provides a method for determining the refresh mode of the ink screen, by directly setting the refresh mode of the ink screen for the display unit in the page to be displayed of the application program at the operating system level of the electronic device, compared to the APP calling the system
  • the method of setting the refresh mode through the interface provided by the side reduces the workload and development difficulty of the application developer.
  • the page to be displayed of the application program can include display units of various content types, and the electronic device can respectively set refresh modes according to the content types of the display units, so as to realize setting different refresh modes for different regions or different display units, thereby improving the setting refresh rate.
  • the accuracy, adaptability and rationality of the mode enable the ink screen to present different display effects for different content types of display units, which improves the user's viewing experience.
  • FIG. 10A Referring to FIG. 5A on the left side in FIG. 10A , the set refresh mode is shown on the right side in FIG. 10A .
  • the electronic device can set the refresh mode according to the content type (text) of the non-webpage control 1, for example, GLR16, which improves the accuracy of setting the refresh mode.
  • FIG. 10B refers to FIG. 10B.
  • the left side in FIG. 10B refers to FIG. 5B , and the set refresh mode is shown on the right side in FIG. 10B .
  • the electronic device can set the refresh mode according to the content type (text) of the non-webpage control 1 to the non-webpage control 2, for example, GLR16, which improves the accuracy of setting the refresh mode.
  • FIG. 10C refers to FIG. 10C.
  • the left side in FIG. 10C refers to FIG. 5C , and the set refresh mode is shown on the right side in FIG. 10C .
  • the electronic device can set the refresh mode of non-webpage control 1 (text) to GLR16, set the refresh mode of non-webpage control 2 (picture) to GL16, and set the refresh mode of non-webpage control 3 (video) to A2, for different non-webpage Controls set the refresh mode separately, which improves the display effect of different non-web controls.
  • FIG. 10D The left side in FIG. 10D refers to FIG. 5D , and the set refresh mode is shown on the right side in FIG. 10D .
  • the electronic device can set the refresh mode of webpage element 1 (text) to GLR16, the refresh mode of webpage element 2 (picture) to GL16, and the refresh mode of webpage element 3 (video) to A2, and set the refresh mode respectively for different webpage elements, Improved display of different web page elements.
  • the display effect is shown in Figure 11. It can be seen that, compared to the display effect in FIG. 7B , in this example, since the refresh mode of webpage element 3 (video) is A2, and the refresh frequency of A2 is relatively high, the video on page 4 is displayed normally, which improves the display effect.
  • FIG. 10E The left side in FIG. 10E refers to FIG. 5E , and the set refresh mode is shown on the right side in FIG. 10E .
  • the electronic device can set the refresh mode of webpage element 1 (text) to GLR16, the refresh mode of webpage element 2 (picture) to GL16, and the refresh mode of non-webpage control 1 (video) to A2, for different webpage elements or non-webpage controls
  • the refresh mode is set separately, which improves the display effect of different display contents.
  • FIG. 10F refers to FIG. 10F.
  • the left side in FIG. 10F refers to FIG. 5F , and the set refresh mode is shown on the right side in FIG. 10F .
  • the area where the non-webpage control 3 in page 7 is located overlaps with the area where the non-webpage control 2 in page 6 is located, and the non-overlapping area is shown in the dotted line box in FIG. upper layer.
  • the electronic device can set the refresh mode of non-webpage control 1 (text) to GLR16, the refresh mode of non-overlapping areas in non-webpage control 2 (text) to GLR16, and the refresh mode of non-webpage control 3 (video) to A2.
  • Refresh modes are set separately for non-webpage controls, which improves the display effect of different display contents.
  • FIG. 10G Refer to FIG. 5G for the left side in FIG. 10G , and the set refresh mode is shown on the right side in FIG. 10G .
  • the areas where controls 4 to 7 are located are adjacent, and the content types of controls 4 to 7 are the same, all of which are pictures, and the refresh mode can be set by merging the areas. See the dotted box in FIG. 10G for merging areas.
  • the electronic device can set the refresh mode of control 1 (text) and control 3 (text) to GLR16, the refresh mode of control 2 (video) to A2, and the refresh mode of the merged area to GL16, which improves the efficiency of setting the refresh mode, and is aimed at Different controls set the refresh mode separately, which improves the display effect of different display contents.
  • FIG. 10H refers to FIG. 10H.
  • the left side in FIG. 10H refers to the left side in FIG. 5H
  • the set refresh mode is shown on the right side in FIG. 10H .
  • the page 9 includes a sliding display area 61 .
  • the electronic device can set the refresh mode corresponding to the sliding display area 61 to DU, and the refresh mode of the control 5 (picture) to GL16, which improves the efficiency of setting the refresh mode and improves the display effect of different display contents.
  • FIG. 12 is another software architecture diagram of the electronic device provided in the embodiment of the present application.
  • the software architecture of an electronic device includes an application layer, a framework layer, a local service layer and a kernel layer from top to bottom.
  • the application layer, the framework layer, the local service layer, and the kernel layer can refer to the relevant description in FIG. 3 , and will not be repeated here.
  • the framework layer also includes a first mode decision module 121, configured to determine a refresh mode corresponding to a display area of a display unit in a single page to be displayed.
  • the display unit may be the first display unit, the second display unit or the third display unit in the embodiment of the present application.
  • the first mode decision module 121 may include: a type identification module 1211 , an event identification module 1212 , a combination module 1213 , a configuration module 1214 and a determination module 1215 .
  • the type identification module 1211 is configured to determine the content type and display area of the display unit in the page to be displayed during the layout stage.
  • the event identification module 1212 is used to obtain event information, the event information includes the effective duration of the user operation and the content refresh area corresponding to the user operation in the page to be displayed, and the user operation is used to trigger the refresh display of the content in the content refresh area within the effective duration .
  • the merging module 1213 is configured to merge regions occupied by at least two display units that are adjacent to each other and of the same content type on the page to be displayed. Wherein, adjacent positions mean that there is no other display unit between areas occupied by at least two display units.
  • the configuration module 1214 is configured to set the refresh mode of the display unit according to the preset refresh mode.
  • the preset refresh mode may be a preset refresh mode corresponding to different granularities.
  • the determining module 1215 is configured to determine a refresh mode corresponding to the display area of the display unit according to the content type of the display unit.
  • the refresh mode corresponding to the display area of the display unit may also be determined in combination with conditions such as a dynamically refreshed display content refresh area in the page to be displayed or a preset refresh mode.
  • the local service layer may also include a second mode decision module 122 , a dithering algorithm module 124 and a display module 123 .
  • the second mode decision module 122 is configured to determine refresh modes corresponding to display areas of display units in different pages to be displayed in a compound display scene where there are multiple pages to be displayed.
  • the multiple pages to be displayed may include multiple pages to be displayed of one application program and/or pages to be displayed respectively corresponding to multiple application programs.
  • the dithering algorithm module 124 is configured to determine whether the dithering algorithm needs to be used in the display area of the display unit. If necessary, a dithering algorithm is used on the display area of the display unit to further improve the display effect.
  • the display module 123 is configured to set the refresh mode corresponding to the display area of the display unit determined by the first mode decision module 121 or the second mode decision module 122 into the control chip of the ink screen.
  • the electronic device can determine the content type of the display unit in the page to be displayed during the layout process of the page to be displayed in the application program, so as to set the refresh mode corresponding to the display area of the display unit.
  • data display needs to go through a layout process, a drawing process, and a layer synthesis process. Since the content type of the display unit is obtained at the layout stage, the calculation amount is small, thereby improving the efficiency of determining the refresh mode.
  • the electronic device sets the refresh mode for the display unit, which improves the accuracy, adaptability and rationality of setting the refresh mode, makes the ink screen present different display effects for display units of different content types, and improves the user's viewing experience .
  • FIG. 13 is another software architecture diagram of the electronic device provided in the embodiment of the present application.
  • the software architecture of an electronic device includes an application layer, a framework layer, a local service layer and a kernel layer from top to bottom.
  • the application layer, the framework layer, the local service layer, and the kernel layer can refer to the relevant description in FIG. 3 , and will not be repeated here.
  • the local service layer also includes an analysis module 131 , a dithering algorithm module 124 and a display module 123 .
  • the analysis module 131 is configured to obtain composite display data, and determine the content type and display area of the display unit according to the composite display data.
  • the electronic device acquires the content type of the display unit by analyzing the synthesized display data, so as to set the refresh mode corresponding to the display area of the display unit. Since the electronic device determines the refresh mode on the system side, compared with the method of determining the refresh mode by the APP, the workload and difficulty of the APP developer are reduced. Moreover, the electronic device sets the refresh mode for the display unit, which improves the accuracy, adaptability and rationality of setting the refresh mode, makes the ink screen present different display effects for display units of different content types, and improves the user's viewing experience .
  • determining the refresh mode of the ink screen refers to the refresh mode used when determining the display area of the display unit in the page to be displayed of the ink screen display application.
  • FIG. 14 is a flowchart of a method for determining the refresh mode of the ink screen provided by the embodiment of the present application.
  • the method for determining the refresh mode of the ink screen provided in this embodiment can be applied to an electronic device with an ink screen.
  • the method for determining the refresh mode of the ink screen provided by this embodiment may include:
  • the first display unit includes any one of the following: non-webpage controls or webpage elements in the webpage controls.
  • the number of display units included in the page to be displayed is not limited.
  • the number of display units in the page to be displayed may be one, for example, page 1 shown in FIG. 5A .
  • the number of display units in the page to be displayed may be 2 or more, for example, the pages shown in FIGS. 5B to 5E and 5G to 5H.
  • the first display unit may be any unit in the page to be displayed. for example. Assume that the to-be-displayed page of APP1 includes 10 display units. Optionally, the first display unit may be any one of the 10 display units. Optionally, the first display unit may be any number of display units among the 10 display units, and any number includes two or more. Optionally, the first display unit may be any one or any number of display units visible to the user among the 10 display units, wherein, being visible to the user means that at least a part of the display area of the display unit is not blocked, and the user can See.
  • the content type may include but not limited to any one of the following: text, picture or video.
  • the display area of the first display unit is used to indicate the position of the first display unit in the page to be displayed.
  • the display area may be in a regular shape, for example, a rectangle, square, circle, and the like. Of course, the display area can also be of irregular shape.
  • the shapes of the display regions may be different.
  • the display area may be represented by coordinates of edge points.
  • the display area can be represented by the coordinates of the four vertices of the rectangle.
  • the display area when the display area is a circle, it can be represented by the coordinates of the center of the circle and the radius.
  • the content type and the refresh mode have a preset corresponding relationship, which is not limited in this embodiment.
  • text corresponds to GLR16 mode
  • picture corresponds to GL16 mode
  • video corresponds to A2 mode.
  • the first display unit may be each display unit in the page to be displayed.
  • a refresh mode can be set for each display unit in the page to be displayed.
  • the first display unit may be a display unit of a preset content type, and when it is determined that the content type of the first display unit is a preset content type, then determine the second display unit according to the preset content type.
  • This implementation can set a refresh mode for display units of a specific content type.
  • the page to be displayed of APP1 includes 10 display units, of which 3 display units have a content type of text, and the preset content type is text. Then, the refresh modes of the display areas of the three display units can be set according to the text type.
  • the electronic device can directly set the refresh mode of the ink screen for the display unit in the page to be displayed of the application program at the operating system level, compared with the related art by APP
  • the method of calling the interface provided by the system side to set the refresh mode reduces the workload and difficulty of APP developers.
  • the electronic device can set a refresh mode for the display unit, which improves the accuracy, adaptability and rationality of setting the refresh mode, so that the ink screen presents different display effects for display units of different content types, and improves the viewing experience of users. feel.
  • the page to be displayed may also include a third display unit, and the method for determining the refresh mode of the ink screen provided by this embodiment further includes:
  • the preset refresh mode corresponding to the third identification information of the third display unit is set as the refresh mode corresponding to the display area of the third display unit.
  • the identification information of the third display unit is referred to as third identification information, and the identification information of the display unit can uniquely distinguish different display units, for example, a name, an identification sequence, and the like.
  • the third display unit is preset with a preset refresh mode.
  • a refresh mode can be set for a specific display unit to improve the display effect.
  • a display scene may be: among multiple refresh modes, when the third display unit is set to the first refresh mode, the display effect is the best, then the third display unit may correspond to the first refresh mode. If there is a third display unit in the page to be displayed, the refresh mode corresponding to the display area of the third display unit is set as the first refresh mode.
  • the page to be displayed may also include a fourth display unit.
  • the content types of the first display unit and the fourth display unit are different.
  • the method for determining the refresh mode of the ink screen provided by this embodiment further includes:
  • the refresh mode corresponding to the display area of the fourth display unit is set according to the content type of the fourth display unit.
  • the display of the first display unit is set according to the content type of the first display unit
  • the refresh mode corresponding to the area set the refresh mode corresponding to the display area of the fourth display unit according to the content type of the fourth display unit. Since the refresh modes corresponding to the display areas of different display units are respectively set according to different content types, the accuracy, adaptability and rationality of setting the refresh mode are improved.
  • the page to be displayed includes a display unit of a content type, for example, at least one first display unit has the same content type, see page 2 shown in FIG. 5B, or page 1 shown in FIG. 5A, Then, the display area of the entire page to be displayed can be set to the same refresh mode, and there is no need to set a refresh mode for each first display unit separately, which improves the processing efficiency.
  • the method for determining the refresh mode of the ink screen may also include:
  • Whether to use the dithering algorithm for the display area of the first display unit is determined according to the refresh mode corresponding to the display area of the first display unit.
  • the display area of the first display unit is processed according to the dithering algorithm, so as to improve the display effect. If it is determined not to use the dithering algorithm, dithering processing does not need to be performed on the display area of the first display unit.
  • the refresh mode there is a preset correspondence between the refresh mode and whether a dithering algorithm needs to be used.
  • the number of gray scales in the refresh mode is small, and when the number of displayed colors is small, for example, less than a preset value, then a dithering algorithm can be used.
  • DU mode and A2 mode can combine dithering algorithms.
  • another embodiment of the present application provides an implementation of the method for determining the refresh mode of the ink screen, which is applicable to the software architecture shown in FIG. 12 .
  • determining the content type and display area of the first display unit in the page to be displayed of the application may include:
  • the content type and display area of the first display unit are determined.
  • the method for determining the refresh mode of the ink screen provided by this embodiment can determine the content type and display area of the first display unit in the layout stage, thereby determining the refresh mode corresponding to the display area of the first display unit, which greatly reduces the The data processing volume has improved the processing efficiency.
  • the page to be displayed includes non-webpage controls
  • the first display unit is a non-webpage control
  • determining the content type and display area of the first display unit may include:
  • At least one non-webpage control used when laying out the page to be displayed is identified, and the at least one non-webpage control includes a first display unit.
  • This implementation manner can determine the content type and display area of the non-web page control. Wherein, this embodiment does not limit the number of at least one non-web page control included in the page to be displayed.
  • the page to be displayed may also include web page controls.
  • the first display unit may be any non-web page control on the page to be displayed.
  • the page to be displayed includes web page controls
  • the first display unit is a web page element
  • determining the content type and display area of the first display unit may include:
  • At least one webpage element in the webpage controls included in the page to be displayed is acquired in the browser kernel, and the at least one webpage element includes the first display unit.
  • the content type and display area of the first display unit are determined.
  • This implementation manner can realize determining the content type and display area of the webpage element in the webpage control.
  • this embodiment does not limit the number of webpage controls included in the page to be displayed and the number of at least one webpage element included in each webpage control.
  • the page to be displayed may also include non-web page controls.
  • the first display unit may be any webpage element in the page to be displayed.
  • the page to be displayed may also include a second display unit, the content types of the first display unit and the second display unit are the same, and there is no other display area between the display area of the first display unit and the display area of the second display area.
  • setting the refresh mode corresponding to the display area of the first display unit according to the content type of the first display unit may include:
  • the refresh mode corresponding to the target area is set according to the content type of the first display unit.
  • the target area includes a display area of the first display unit, a display area of the second display unit, and a display area between the first display unit and the second display unit.
  • the page to be displayed is page 8 .
  • the first display unit is control 4 on page 8
  • the second display unit includes control 5 to control 7 on page 8
  • the content types are pictures.
  • the target area is shown by a dotted line, and the refresh mode corresponding to the target area can be uniformly set according to the type of picture content. That is to say, it is only necessary to set the refresh mode once for the target area, and it is not necessary to separately set the display areas of the controls 4 to 7, which avoids redundant processing of setting four times, and improves the processing efficiency.
  • the refresh mode corresponding to the target area according to the content type of the first display unit it may further include:
  • FIG. 10G For an illustration, see Figure 10G.
  • the display areas corresponding to controls 4 to 7 on page 8 may be combined to form a target area, as shown in the dotted line box on the right side of FIG. 10G .
  • the method for determining the refresh mode of the ink screen may also include:
  • the event information includes the refresh period corresponding to the user operation and the content refresh area corresponding to the user operation on the page to be displayed, and the user operation is used to trigger refresh display of the content in the content refresh area within the refresh period.
  • the content refresh area includes the display area of the first display unit.
  • the refresh mode corresponding to the display area of the first display unit is determined according to the refresh display mode.
  • this embodiment does not limit the user's operation, for example, a click operation, a slide operation, a two-finger pinch-to-zoom operation, and the like.
  • the user operation is used to trigger the refresh display of the content in the content refresh area within the refresh period.
  • the refresh period may include a valid start time point and an effective end time point.
  • the user operation can be a user's pull-down operation on the sliding control 62
  • the content refresh area can be the sliding display area 61
  • the user operation is used to trigger the content in the sliding display area 61 to slide down and display within the refresh period. If the current moment is within the refresh period, it means that the sliding display triggered by the user is still in effect.
  • the refresh mode corresponding to the sliding display area 61 should be set based on the sliding display method. Compared with setting the refresh area according to the content types of the controls 1 to 3 in the sliding display area 61 , the setting is more accurate and reasonable, and the display effect is improved.
  • the manner of refreshing the display includes but is not limited to any one of the following: sliding display, scrolling display, page-up display, page-up display, zoom-out display or zoom-in display.
  • determining that the content refresh area includes the display area of the first display unit may include:
  • the display area of the first display unit is located in the content refreshing area.
  • determining the refresh mode corresponding to the display area of the first display unit according to the refresh display method may include:
  • the refresh mode corresponding to the display area of the first display unit is determined according to the content type of the first display unit and the refresh display mode.
  • the refresh mode corresponding to the content refresh area determines the refresh mode corresponding to the content refresh area, not only set based on the way of refresh display, but also consider the content type of the first display unit in the content refresh area, to further improve
  • the accuracy and rationality of setting the refresh mode are improved, and the display effect is improved.
  • different refresh modes can be set for sliding to display text and sliding to display pictures in the content refresh area.
  • the page to be displayed may further include a fifth display unit.
  • the content type of the fifth display unit cannot be determined.
  • the content type of the fifth display unit is not text, picture or video, and may be marked as other types.
  • the method for determining the refresh mode of the ink screen provided in this embodiment may also include:
  • the configuration file is obtained, and the configuration file includes the corresponding relationship between the identification information and the refresh mode at different granularities.
  • the refresh mode corresponding to the display area of the fifth display unit is set according to the corresponding relationship between the identification information and the refresh mode at different granularities.
  • the identification information of the fifth display unit is referred to as fifth identification information, and the identification information of the display unit can uniquely distinguish different display units, for example, a name, an identification sequence, and the like.
  • This implementation provides a supplementary solution for setting the refresh mode of the display unit, especially in a scenario where the content type of the display unit is not determined. Since the corresponding relationship between identification information and refresh modes at different granularities is preset in the configuration file, the refresh mode corresponding to the display area of the fifth display unit can be directly set according to the configuration file.
  • the identification information is different.
  • the granularity may include but not limited to at least one of the following: application granularity, window granularity, or control granularity.
  • the granularity of the application program means that each display unit in each page included in the application program can adopt the preset refresh mode corresponding to the application program.
  • the configuration file includes the corresponding relationship between the identification information of the application and the refresh mode, and the identification information of the application can uniquely distinguish different applications.
  • the preset refresh mode corresponding to the application program to which the fifth display unit belongs may be set as the refresh mode corresponding to the display area of the fifth display unit.
  • APP1 includes page 1 and page 2
  • page 1 includes controls 1 to 3
  • page 2 includes controls 4 to 10.
  • the identification information of APP1 is preset with refresh mode 1 .
  • the fifth display unit is control 5 on page 2 .
  • the refresh mode 1 corresponding to the application program APP1 to which the widget 5 belongs may be set as the refresh mode corresponding to the display area of the widget 5 .
  • Window granularity means that each display unit in each page in the window can adopt the preset refresh mode corresponding to the window.
  • the configuration file includes the corresponding relationship between the identification information of the window and the preset refresh mode, and the identification information of the window can uniquely distinguish different windows.
  • the refresh mode corresponding to the window to which the fifth display unit belongs may be set as the refresh mode corresponding to the display area of the fifth display unit.
  • window 1 includes page 1 and page 2
  • page 1 includes controls 1 to 3
  • page 2 includes controls 4 to 10.
  • the identification information of window 1 is preset with refresh mode 2 .
  • the fifth display unit is control 3 in page 1 .
  • the refresh mode 2 corresponding to the window 1 to which the control 3 belongs may be set as the refresh mode corresponding to the display area of the control 3 .
  • Control granularity means that a certain display unit can adopt the preset refresh mode corresponding to the display unit.
  • the configuration file includes the corresponding relationship between the identification information of the display unit and the preset refresh mode, and the identification information of the display unit can uniquely distinguish different display units.
  • the refresh mode corresponding to the fifth display unit may be set as the refresh mode corresponding to the display area of the fifth display unit. For example, as shown in FIG. 5H , the fifth display unit is control 5 in page 9 , and the identification information of control 5 is preset with refresh mode 3 . Then, the refresh mode 3 corresponding to the control 5 may be set as the refresh mode corresponding to the display area of the control 5 .
  • setting the refresh mode corresponding to the display area of the fifth display unit according to the correspondence between identification information and refresh modes at different granularities may include: In order, the refresh mode corresponding to the display area of the fifth display unit is set.
  • APP1 includes window 1 and window 2.
  • Window 1 includes Page 1 and Page 2
  • Window 2 includes Page 3.
  • Page 1 includes controls 1 to 3
  • page 2 includes controls 4 to 10
  • page 3 includes controls 11.
  • the identification information of APP1 corresponds to refresh mode 1.
  • the identification information of window 1 corresponds to refresh mode 2.
  • the identification information of control 2 corresponds to refresh mode 3.
  • the fifth display unit is control 2 included in page 1 of window 1 in APP1. According to the order of granularity levels from small to large, it can be found that the identification information of the control 2 corresponds to the refresh mode 3 at the minimum granularity (control granularity). Therefore, set the refresh mode corresponding to the display area of control 2 to refresh mode 3.
  • the fifth display unit is control 1 included in page 1 of window 1 in APP1.
  • the refresh mode corresponding to the identification information of the control 1 is not found under the control granularity. Then continue to search under the window granularity. Under window granularity, window 1 of page 1 to which control 1 belongs corresponds to refresh mode 2, then set the refresh mode corresponding to the display area of control 1 to refresh mode 2.
  • the fifth display unit is the control 11 included in the page 3 of the window 2 in the APP1.
  • no refresh mode corresponding to the identification information of the widget 11 is found under widget granularity. Then continue to search under the window granularity.
  • the refresh mode corresponding to the identification information of the window 2 to which the control 11 belongs is not found, continue searching at the application granularity.
  • the application program APP1 to which window 2 of page 3 to which control 11 belongs corresponds to refresh mode 1, and the refresh mode corresponding to the display area of control 11 is set to refresh mode 1.
  • the refresh mode corresponding to the display area of the fifth display unit is set in ascending order of the granularity level, the smaller the granularity level, the higher the accuracy of the set refresh mode, which improves the accuracy of the set refresh mode.
  • the refresh mode corresponding to the display area of the fifth display unit may be set according to a preset granularity.
  • this embodiment does not limit the preset granularity.
  • the preset granularity may be control granularity, window granularity or application granularity. This implementation is easy to implement.
  • configuration files can be updated periodically or triggered by conditions. For example, when it is determined that the display effect of the display unit in refresh mode 1 is better, the configuration file may be updated, and the identification information of the display unit is associated with refresh mode 1 in the configuration file.
  • the electronic device may receive the configuration file sent by the cloud server.
  • the multiple pages to be displayed include multiple pages to be displayed of the application program and/or the pages corresponding to the multiple application programs respectively.
  • setting a refresh mode corresponding to the display area of the first display unit according to the content type of the first display unit may include:
  • the first display unit When the first display unit is located in the topmost first page to be displayed, according to the content type of the first display unit in the first page to be displayed, set the refresh corresponding to the display area of the first display unit in the first page to be displayed model.
  • the content type of the first display unit in the page to be displayed sets the refresh mode corresponding to the non-overlapping area.
  • the target to-be-displayed page includes the sum of areas of all to-be-displayed pages above the second to-be-displayed page.
  • APP1 includes page 6 and page 7, that is, the multiple to-be-displayed pages include multiple to-be-displayed pages of the same APP.
  • page 7 is located on the upper layer of page 6.
  • the refresh mode can be set to A2 according to the content type (video) of the non-webpage control 3.
  • the refresh mode can be set to GLR16 according to the content type (text) of non-webpage control 1.
  • the first page to be displayed at the highest level and the second page to be displayed at the lower level can be determined through the page coverage relationship among the multiple pages to be displayed.
  • the refresh mode can be set directly according to the content type of the display units.
  • the display unit in the second to-be-displayed page part or all of the display area of the display unit may be blocked, while the unblocked part is visible to the user, and the refresh mode can be set according to the content type of the display unit. This makes the set refresh mode more accurate and reasonable, and improves the display effect.
  • FIG. 15 is a schematic diagram of a page to be displayed provided by an embodiment of the present application
  • FIG. 16 is a schematic diagram of refresh modes corresponding to each area in FIG. 15 . But Fig. 15 and Fig. 16 do not form a limitation.
  • the page 151 to be displayed includes multiple non-web page controls.
  • the content type of the control corresponding to the area indicated by the solid line box is video, which is marked as control 152 .
  • the content type of the control corresponding to the area indicated by the dotted line box is text, marked as control 153, and there are multiple controls 153.
  • the user may perform a pull-down operation on the sliding control 154 , so that the area on the left side of the sliding control 154 is displayed in a sliding manner.
  • the controls used include: a control 154 , a control 152 and a plurality of controls 153 , and the content type and display area of each control are obtained respectively.
  • the content type of the control 152 is video
  • the content type of the control 153 is text
  • the content type of the control 154 is not determined.
  • the event information includes a content refresh area 164, as shown in FIG. 16 .
  • the content in the content refresh area 164 is displayed in a sliding manner.
  • the control 152 determines that the refresh mode corresponding to the display area 161 of the control 152 is A2 mode; according to the content type (text) of the control 153, determine that the refresh mode corresponding to the merged area 162 and the merged area 163 is GLR16 mode ; According to the sliding display mode and the content type (text) of the control 153, it is determined that the refresh mode corresponding to the content refresh area 164 is the DU mode;
  • the electronic device can set different refresh modes for different areas in the page, and the set refresh mode is more accurate and reasonable, and the display effect is improved. Moreover, the method for determining the refresh mode of the ink screen provided in this embodiment realizes setting the refresh mode on the system side, which reduces the workload and difficulty of APP developers.
  • another embodiment of the present application provides an implementation of the method for determining the refresh mode of the ink screen, which is applicable to the software architecture shown in FIG. 13 .
  • determining the content type and display area of the first display unit in the page to be displayed of the application may include:
  • a content type and a display area of the first display unit are determined according to the synthesized display data.
  • optical character recognition optical character recognition, OCR
  • OCR optical character recognition
  • other technologies may be used to identify and classify image data for synthetic display data, and to segment different content types (for example, text, pictures, videos) according to regions, thereby Get the content type and display area of different display units.
  • the electronic device acquires the content type of the display unit by analyzing the synthesized display data, so as to set the refresh mode corresponding to the display area of the display unit. Since the electronic device determines the refresh mode on the system side, compared with the method of determining the refresh mode by the APP, the workload and difficulty of the APP developer are reduced. Moreover, the electronic device sets the refresh mode for the display unit, which improves the accuracy, adaptability and rationality of setting the refresh mode, makes the ink screen present different display effects for display units of different content types, and improves the user's viewing experience .
  • the electronic device includes hardware and/or software modules corresponding to each function.
  • the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a certain function is executed by hardware or computer software drives hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art may use different methods to implement the described functions in combination with the embodiments for each specific application, but such implementation should not be regarded as exceeding the scope of the present application.
  • the embodiment of the present application may divide the electronic device into functional modules according to the above method examples. For example, each functional module may be divided corresponding to each function, or two or more functions may be integrated into one module. It should be noted that the division of modules in the embodiment of the present application is schematic, and is only a logical function division, and there may be other division methods in actual implementation. It should be noted that the names of the modules in the embodiments of the present application are illustrative, and the names of the modules are not limited during actual implementation.
  • FIG. 17 is a schematic structural diagram of an apparatus for determining a refresh mode of an ink screen provided by an embodiment of the present application.
  • the device for determining the refresh mode of the ink screen provided in this embodiment is used to execute the method for determining the refresh mode of the ink screen provided in the method embodiment of the present application, and the technical principle and technical effect are similar.
  • the device for determining the refresh mode of the ink screen may include:
  • the determining module 1701 is configured to determine the content type and display area of the first display unit in the page to be displayed of the application program; the first display unit is a non-webpage control or a webpage element in a webpage control;
  • the setting module 1702 is configured to set the refresh mode corresponding to the display area of the first display unit according to the content type of the first display unit; the refresh mode is used for the ink screen to display the page to be displayed The display area of the first display unit.
  • the determining module 1701 is used for:
  • the page to be displayed includes a non-webpage control
  • the first display unit is a non-webpage control
  • the determining module 1701 is configured to:
  • the at least one non-webpage control includes the first display unit
  • the page to be displayed includes a webpage control
  • the first display unit is a webpage element
  • the determining module 1701 is configured to:
  • the content type and display area of the first display unit are determined according to the document objectification model corresponding to the first display unit.
  • the setting module 1702 is also used for:
  • the event information includes a user operation corresponding to a content refresh area and a refresh period in the page to be displayed, and the user operation is used to trigger refresh display of content in the content refresh area within the refresh period , the content refresh area includes the display area of the first display unit;
  • the manner of refreshing the display includes any one of the following: sliding display, scrolling display, page turning display, zooming out display or zooming in display.
  • the page to be displayed further includes a second display unit, the content types of the first display unit and the second display unit are the same, and the display area of the first display unit is the same as that of the second display unit. There are no display cells of other content types between the display areas of the display area;
  • the setting module 1702 is used for:
  • the target area includes the display area of the first display unit, the display area of the second display unit, and the first display unit and the display area between the second display unit.
  • the page to be displayed further includes a fifth display unit, and the setting module 1702 is further configured to:
  • the configuration file includes the corresponding relationship between the window of the page to be displayed to which the fifth display unit belongs and the refresh mode, then set the refresh mode corresponding to the window to which the fifth display unit belongs to the fifth display unit The refresh mode corresponding to the display area;
  • the configuration file includes the correspondence between the application program to which the fifth display unit belongs and the refresh mode, then set the refresh mode corresponding to the application program to which the fifth display unit belongs to the fifth display unit The corresponding refresh mode of the display area.
  • the multiple pages to be displayed there are multiple pages to be displayed, and the multiple pages to be displayed belong to one or more application programs, and the setting module 1702 is used for:
  • the first display unit is a display unit in the first page to be displayed at the highest level, set the first page to be displayed according to the content type of the first display unit in the first page to be displayed a refresh mode corresponding to the display area of the first display unit;
  • the target to-be-displayed page includes the 2. The sum of the areas of all pages to be displayed above the page to be displayed.
  • the determining module 1701 is used for:
  • a content type and a display area of the first display unit are determined according to the combined display data.
  • the page to be displayed further includes a third display unit, and the setting module 1702 is also used for:
  • the preset refresh mode of the third display unit is set as the refresh mode corresponding to the display area of the third display unit.
  • the page to be displayed further includes a fourth display unit, the content types of the first display unit and the fourth display unit are different, and the setting module 1702 is further configured to:
  • the refresh mode corresponding to the display area of the fourth display unit is set according to the content type of the fourth display unit.
  • the setting module 1702 is also used for:
  • Whether to use a dithering algorithm for the display area of the first display unit is determined according to a refresh mode corresponding to the display area of the first display unit.
  • the content type includes any one of the following: text, picture or video.
  • FIG. 18 shows a structure of an electronic device provided by an embodiment of the present application, and the electronic device has an ink screen.
  • the electronic device further includes: a processor 1801 , a receiver 1802 , a transmitter 1803 , a memory 1804 and a bus 1805 .
  • the processor 1801 includes one or more processing cores, and the processor 1801 executes applications of various functions and information processing by running software programs and modules.
  • the receiver 1802 and the transmitter 1803 can be implemented as a communication component, and the communication component can be a baseband chip.
  • the memory 1804 is connected to the processor 1801 through a bus 1805 .
  • the memory 1804 may be used to store at least one program instruction, and the processor 1801 may be used to execute the at least one program instruction, so as to implement the technical solutions of the foregoing embodiments. Its implementation principle and technical effect are similar to those of the related embodiments of the method above, and will not be repeated here.
  • the processor can read the software program in the memory, interpret and execute the instructions of the software program, and process the data of the software program.
  • the processor performs baseband processing on the data to be sent, and outputs the baseband signal to the control circuit in the control circuit. send.
  • the control circuit receives the radio frequency signal through the antenna, converts the radio frequency signal into a baseband signal, and outputs the baseband signal to the processor, and the processor converts the baseband signal into data and processes the data.
  • FIG. 18 only shows a memory and a processor. In an actual electronic device, there may be multiple processors and memories.
  • the storage may also be called a storage medium or a storage electronic device, etc., which is not limited in this embodiment of the present application.
  • the processor may include a baseband processor and a central processing unit, the baseband processor is mainly used for processing communication data, and the central processing unit is mainly used for executing software programs and processing data of the software programs.
  • the baseband processor and the central processing unit may be integrated into one processor, or may be independent processors interconnected through technologies such as a bus.
  • an electronic device may include multiple baseband processors to adapt to different network standards, an electronic device may include multiple central processors to enhance its processing capability, and various components of the electronic device may be connected through various buses.
  • the baseband processor may also be expressed as a baseband processing circuit or a baseband processing chip.
  • the central processing unit may also be expressed as a central processing circuit or a central processing chip.
  • the function of processing the communication protocol and communication data can be built in the processor, or can be stored in the memory in the form of a software program, and the processor executes the software program to realize the baseband processing function.
  • the memory can be integrated in the processor, or it can be independent from the processor.
  • the memory includes a high-speed cache, which can store frequently accessed data/instructions.
  • the processor may be a general-purpose processor, a digital signal processor, an application-specific integrated circuit, a field programmable gate array or other programmable logic device, a discrete gate or transistor logic device, or a discrete hardware component, and may implement or Execute the methods, steps and logic block diagrams disclosed in the embodiments of the present application.
  • a general purpose processor may be a microprocessor or any conventional processor or the like. The steps of the methods disclosed in connection with the embodiments of the present application may be directly implemented by a hardware processor, or implemented by a combination of hardware and software modules in the processor.
  • the memory may be a non-volatile memory, such as a hard disk (hard disk drive, HDD) or a solid-state drive (solid-state drive, SS), etc., or a volatile memory (volatile memory), such as Random-access memory (RAM).
  • a memory is, without limitation, any other medium that can be used to carry or store desired program code in the form of instructions or data structures and that can be accessed by a computer.
  • the memory in the embodiment of the present application may also be a circuit or any other device capable of implementing a storage function, and is used for storing program instructions and/or data.
  • the methods provided in the various embodiments of the present application may be fully or partially implemented by software, hardware, firmware or any combination thereof. When implemented using software, it may be implemented in whole or in part in the form of a computer program product.
  • the computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on the computer, the processes or functions according to the embodiments of the present application will be generated in whole or in part.
  • the computer may be a general purpose computer, a special purpose computer, a computer network, network equipment, user equipment or other programmable devices.
  • the computer instructions may be stored in or transmitted from one computer-readable storage medium to another computer-readable storage medium, for example, the computer instructions may be transmitted from a website, computer, server or data center Transmission to another website site, computer, server, or data center by wired (such as coaxial cable, optical fiber, digital subscriber line (DSL) or wireless (such as infrared, wireless, microwave, etc.).
  • the readable storage medium can be any available medium that can be accessed by a computer or a data storage device such as a server, data center, etc. that includes one or more available media integrated.
  • the available medium can be a magnetic medium (for example, a floppy disk, a hard disk, a magnetic tape, etc.) ), optical media (for example, digital video disc (DWD), or semiconductor media (for example, SSD), etc.
  • An embodiment of the present application provides a computer program product.
  • the computer program product When the computer program product is running on an electronic device, it enables the electronic device to execute the technical solution in the above-mentioned method embodiment, and its realization principle and technical effect are similar to those of the above-mentioned related embodiments. , which will not be repeated here.
  • An embodiment of the present application provides a computer-readable storage medium, on which program instructions are stored, and when the program instructions are executed by an electronic device, the electronic device executes the technical solutions of the foregoing embodiments. Its implementation principle and technical effect are similar to those of the above-mentioned related embodiments, and will not be repeated here.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Software Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • General Engineering & Computer Science (AREA)
  • Computer Hardware Design (AREA)
  • Controls And Circuits For Display Device (AREA)

Abstract

提供一种确定墨水屏的刷新模式的方法、电子设备和存储介质。电子设备具有墨水屏。确定墨水屏的刷新模式的方法,包括:确定应用程序的待显示页面中第一显示单元的内容类型和显示区域;第一显示单元为非网页控件或网页控件中的网页元素;根据第一显示单元的内容类型设置第一显示单元的显示区域对应的刷新模式;刷新模式用于墨水屏显示第一显示单元的显示区域。针对显示单元,根据显示单元的内容类型设置墨水屏显示待显示页面时显示单元的显示区域的刷新模式,实现了待显示页面中不同显示区域可以设置不同的刷新模式,提高了设置墨水屏的刷新模式的准确性和合理性,提高了墨水屏的显示效果。

Description

确定墨水屏的刷新模式的方法、电子设备和存储介质
本申请要求于2021年11月23日提交国家知识产权局、申请号为202111398365.0、申请名称为“确定墨水屏的刷新模式的方法、电子设备和存储介质”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。
技术领域
本申请实施例涉及显示技术领域,尤其涉及一种确定墨水屏的刷新模式的方法、电子设备和存储介质。
背景技术
电子墨水是一种无闪烁、无自发光的显示技术,基于电子墨水研发出来的墨水屏具有保护眼睛的明显优势,电子书、电子手写板、电子标牌等电子设备越来越多的使用墨水屏。
墨水屏中的墨滴是一种电化学材料,依靠电场下黑白两种墨滴的移动来改变显示内容。墨水屏相比于液晶显示器(liquid crystal display,LCD)或有机发光半导体(organic electroluminescence display,OLED)等电子屏,墨水屏的显示更新速度较慢,可能出现拖影、卡顿、闪烁等情况。因此,墨水屏通常具有多种刷新模式,不同的刷新模式具有不同的显示效果。这样,合理的配置墨水屏的刷新模式就非常重要。
目前,配置墨水屏的刷新模式的方法合理性较差,导致墨水屏的显示效果不佳。
发明内容
本申请实施例提供一种确定墨水屏的刷新模式的方法、电子设备和存储介质,提高了配置墨水屏的刷新模式的准确性和合理性,提高了墨水屏的显示效果。
第一方面,本申请实施例提供了一种确定墨水屏的刷新模式的方法,包括:确定应用程序的待显示页面中第一显示单元的内容类型和显示区域;第一显示单元为非网页控件或者网页控件中的网页元素;根据第一显示单元的内容类型设置第一显示单元的显示区域对应的刷新模式;刷新模式用于墨水屏显示待显示页面中第一显示单元的显示区域。
通过第一方面提供的确定墨水屏的刷新模式的方法,电子设备可以针对显示单元设置墨水屏的刷新模式,而且根据显示单元的内容类型设置刷新模式,实现了待显示页面中不同显示单元或不同区域设置不同的刷新模式,提高了设置墨水屏的刷新模式的准确性和合理性,提高了显示效果。并且,电子设备在操作***层面直接针对应用程序的待显示页面中的显示单元设置墨水屏的刷新模式,降低了应用程序开发者的工作量和难度。
一种可能的实现方式中,确定应用程序的待显示页面中第一显示单元的内容类型和显示区域,包括:在对待显示页面进行布局处理时,确定第一显示单元的内容类型和显示区域。
在该实现方式中,在布局阶段就可以确定显示单元的内容类型和显示区域,从而确定显示单元的显示区域对应的刷新模式,大大减少了数据处理量,提高了处理效率。
一种可能的实现方式中,待显示页面包括非网页控件,第一显示单元为非网页控件,确定第一显示单元的内容类型和显示区域,包括:识别布局待显示页面时使用的至少一个非网页控件,至少一个非网页控件包括第一显示单元;确定识别出的第一显示单元的内容类型和显示区域。
在该实现方式中,实现了在对应用程序的待显示页面进行布局的过程中确定非网页控件的内容类型和显示区域。
一种可能的实现方式中,待显示页面包括网页控件,第一显示单元为网页元素,确定第一显示单元的内容类型和显示区域,包括:在浏览器内核中获取待显示页面包括的网页控件中的至少一个网页元素,至少一个网页元素包括第一显示单元;根据第一显示单元对应的文档对象化模型,确定第一显示单元的内容类型和显示区域。
在该实现方式中,实现了在对应用程序的待显示页面进行布局的过程中确定网页控件中网页元素的内容类型和显示区域。
一种可能的实现方式中,确定墨水屏的刷新模式的方法还包括:获取事件信息;事件信息包括用户操作在待显示页面中对应的内容刷新区域和刷新时段,用户操作用于触发内容刷新区域中的内容在刷新时段内刷新显示,内容刷新区域包括第一显示单元的显示区域;若当前时刻处于刷新时段内,则根据刷新显示的方式确定第一显示单元的显示区域对应的刷新模式。
在该实现方式中,对于待显示页面中存在内容刷新动态显示的场景,根据刷新显示的方式确定内容刷新区域对应的刷新模式,相比于根据内容刷新区域中第一显示单元的内容类型确定刷新模式,提高了确定内容刷新区域对应的刷新模式的准确性和合理性,进而提高了墨水屏的显示效果。
一种可能的实现方式中,刷新显示的方式包括下列中的任意一项:滑动显示、滚动显示、翻页显示、缩小显示或放大显示。
一种可能的实现方式中,待显示页面中还包括第二显示单元,第一显示单元和第二显示单元的内容类型相同,且第一显示单元的显示区域和第二显示区域的显示区域之间没有其他内容类型的显示单元;根据第一显示单元的内容类型设置第一显示单元的显示区域对应的刷新模式,包括:根据第一显示单元的内容类型设置目标区域对应的刷新模式;目标区域包括第一显示单元的显示区域、第二显示单元的显示区域,以及第一显示单元和第二显示单元之间的显示区域。
在该实现方式中,当多个显示单元的内容类型相同且位置相邻时,可以针对多个显示单元所在的整个目标区域设置刷新模式,避免了分别针对每个显示单元的显示区域进行设置,提高了处理效率。
一种可能的实现方式中,待显示页面中还包括第五显示单元,确定墨水屏的刷新模式的方法还包括:获取配置文件;若配置文件包括第五显示单元所属待显示页面的窗口与刷新模式之间的对应关系,则将第五显示单元所属窗口对应的刷新模式设置为第五显示单元的显示区域对应的刷新模式;或者,若配置文件包括第五显示单元所属的应用程序与刷新模式之间的对应关系,则将第五显示单元所属应用程序对应的刷新模式设置为第五显示单元的显示区域对应的刷新模式。
在该实现方式中,配置文件中预先设置了不同应用程序和刷新模式之间的对应关系, 或者,不同显示页面的窗口和刷新模式之间的对应关系。对于第五显示单元,可以直接根据配置文件设置第五显示单元的显示区域的刷新模式,提供了设置刷新模式的一种补充方案。
一种可能的实现方式中,待显示页面为多个,多个待显示页面属于一个或多个应用程序,根据第一显示单元的内容类型设置第一显示单元的显示区域对应的刷新模式,包括:获取多个待显示页面之间的页面覆盖关系;第一显示单元为位于最高层的第一待显示页面中的显示单元时,根据第一待显示页面中的第一显示单元的内容类型设置第一待显示页面中的第一显示单元的显示区域对应的刷新模式;或者,第一显示单元为位于最高层之下的第二待显示页面中的显示单元时,在第二待显示页面中的第一显示单元的显示区域中确定与目标待显示页面未重叠的非重叠区域,根据第二待显示页面中的第一显示单元的内容类型设置非重叠区域对应的刷新模式;目标待显示页面包括位于第二待显示页面上方的所有待显示页面的区域之和。
在该实现方式中,待显示页面为多个,多个待显示页面之间可能存在重叠区域,也可能不存在重叠区域。对于最上层的待显示页面中的显示单元,显示单元均为用户可见,可以直接根据显示单元的内容类型设置刷新模式,提高了准确性和合理性。对于最上层下方的待显示页面中的显示单元,显示单元的显示区域中的部分或全部区域可能被遮挡,而未被遮挡的部分为用户可见,对于显示单元中的非重叠区域,可以根据显示单元的内容类型设置刷新模式,提高了准确性和合理性,提升了墨水屏的显示效果。
一种可能的实现方式中,确定应用程序的待显示页面中第一显示单元的内容类型和显示区域,包括:在对待显示页面进行布局处理、绘制处理和图层合成处理之后,获取合成显示数据;根据合成显示数据确定第一显示单元的内容类型和显示区域。
在该实现方式中,待显示页面经过了布局流程、绘制流程和图层合成流程的处理后,生成了合成显示数据。电子设备通过对合成显示数据进行分析,获取了显示单元的内容类型,从而可以根据内容类型设置显示单元的显示区域对应的刷新模式,提高了设置墨水屏的刷新模式的准确性和合理性。
一种可能的实现方式中,待显示页面中还包括第三显示单元,确定墨水屏的刷新模式的方法还包括:将第三显示单元的预设刷新模式设置为第三显示单元的显示区域对应的刷新模式。
在该实现方式中,可以针对特定的显示单元直接设置预设的刷新模式,以提升墨水屏的显示效果。
一种可能的实现方式中,待显示页面中还包括第四显示单元,第一显示单元和第四显示单元的内容类型不同,确定墨水屏的刷新模式的方法还包括:根据第四显示单元的内容类型设置第四显示单元的显示区域对应的刷新模式。
在该实现方式中,如果待显示页面中包括至少两种内容类型的显示单元时,例如,第一显示单元和第四显示单元,那么,分别根据不同的内容类型设置对应的刷新模式,提高了设置墨水屏的刷新模式的准确性和合理性。如果待显示页面中包括一种内容类型的显示单元时,则可以将整个待显示页面的区域设置为同一种刷新模式,不需要针对每个显示单元分别设置,提高了处理效率。
一种可能的实现方式中,确定墨水屏的刷新模式的方法还包括:根据第一显示单元的 显示区域对应的刷新模式确定是否对第一显示单元的显示区域使用抖动算法。
在该实现方式中,通过确定是否使用抖动算法,可以进一步提高墨水屏的显示效果。
一种可能的实现方式中,内容类型包括下列中的任意一项:文本、图片或视频。
一种可能的实现方式中,第一显示单元包括下列中的任意一项:文本控件、图片控件、视频播放控件、网页控件中的文本元素、网页控件中的图片元素或网页控件中的视频元素。
第二方面,本申请实施例提供一种确定墨水屏的刷新模式的装置,包括:确定模块,用于确定应用程序的待显示页面中第一显示单元的内容类型和显示区域;第一显示单元为非网页控件或者网页控件中的网页元素;设置模块,用于根据第一显示单元的内容类型设置第一显示单元的显示区域对应的刷新模式;刷新模式用于墨水屏显示待显示页面中第一显示单元的显示区域。
一种可能的实现方式中,确定模块用于:在对待显示页面进行布局处理时,确定第一显示单元的内容类型和显示区域。
一种可能的实现方式中,待显示页面包括非网页控件,第一显示单元为非网页控件,确定模块用于:识别布局待显示页面时使用的至少一个非网页控件,至少一个非网页控件包括第一显示单元;确定识别出的第一显示单元的内容类型和显示区域。
一种可能的实现方式中,待显示页面包括网页控件,第一显示单元为网页元素,确定模块用于:在浏览器内核中获取待显示页面包括的网页控件中的至少一个网页元素,至少一个网页元素包括第一显示单元;根据第一显示单元对应的文档对象化模型,确定第一显示单元的内容类型和显示区域。
一种可能的实现方式中,设置模块还用于:获取事件信息;事件信息包括用户操作在待显示页面中对应的内容刷新区域和刷新时段,用户操作用于触发内容刷新区域中的内容在刷新时段内刷新显示,内容刷新区域包括第一显示单元的显示区域;若当前时刻处于刷新时段内,则根据刷新显示的方式确定第一显示单元的显示区域对应的刷新模式。
一种可能的实现方式中,刷新显示的方式包括下列中的任意一项:滑动显示、滚动显示、翻页显示、缩小显示或放大显示。
一种可能的实现方式中,待显示页面中还包括第二显示单元,第一显示单元和第二显示单元的内容类型相同,且第一显示单元的显示区域和第二显示区域的显示区域之间没有其他内容类型的显示单元;设置模块用于:根据第一显示单元的内容类型设置目标区域对应的刷新模式;目标区域包括第一显示单元的显示区域、第二显示单元的显示区域,以及第一显示单元和第二显示单元之间的显示区域。
一种可能的实现方式中,待显示页面中还包括第五显示单元,设置模块还用于:获取配置文件;若配置文件包括第五显示单元所属待显示页面的窗口与刷新模式之间的对应关系,则将第五显示单元所属窗口对应的刷新模式设置为第五显示单元的显示区域对应的刷新模式;或者,若配置文件包括第五显示单元所属的应用程序与刷新模式之间的对应关系,则将第五显示单元所属应用程序对应的刷新模式设置为第五显示单元的显示区域对应的刷新模式。
一种可能的实现方式中,待显示页面为多个,多个待显示页面属于一个或多个应用程序,设置模块用于:获取多个待显示页面之间的页面覆盖关系;第一显示单元为位于最高层的第一待显示页面中的显示单元时,根据第一待显示页面中的第一显示单元的内容类型 设置第一待显示页面中的第一显示单元的显示区域对应的刷新模式;或者,第一显示单元为位于最高层之下的第二待显示页面中的显示单元时,在第二待显示页面中的第一显示单元的显示区域中确定与目标待显示页面未重叠的非重叠区域,根据第二待显示页面中的第一显示单元的内容类型设置非重叠区域对应的刷新模式;目标待显示页面包括位于第二待显示页面上方的所有待显示页面的区域之和。
一种可能的实现方式中,确定模块用于:在对待显示页面进行布局处理、绘制处理和图层合成处理之后,获取合成显示数据;根据合成显示数据确定第一显示单元的内容类型和显示区域。
一种可能的实现方式中,待显示页面中还包括第三显示单元,设置模块还用于:将第三显示单元的预设刷新模式设置为第三显示单元的显示区域对应的刷新模式。
一种可能的实现方式中,待显示页面中还包括第四显示单元,第一显示单元和第四显示单元的内容类型不同,设置模块还用于:根据第四显示单元的内容类型设置第四显示单元的显示区域对应的刷新模式。
一种可能的实现方式中,设置模块还用于:根据第一显示单元的显示区域对应的刷新模式确定是否对第一显示单元的显示区域使用抖动算法。
一种可能的实现方式中,内容类型包括下列中的任意一项:文本、图片或视频。
一种可能的实现方式中,第一显示单元包括下列中的任意一项:文本控件、图片控件、视频播放控件、网页控件中的文本元素、网页控件中的图片元素或网页控件中的视频元素。
第三方面,提供一种电子设备,包括处理器,处理器用于与存储器耦合,并读取存储器中的指令并根据指令使得电子设备执行第一方面提供的方法。
第四方面,提供一种程序,该程序在被处理器执行时用于执行第一方面提供的方法。
第五方面,提供一种计算机可读存储介质,计算机可读存储介质中存储有指令,当指令在计算机或处理器上运行时,实现第一方面提供的方法。
第六方面,提供一种程序产品,所述程序产品包括计算机程序,所述计算机程序存储在可读存储介质中,电子设备的至少一个处理器可以从所述可读存储介质读取所述计算机程序,所述至少一个处理器执行所述计算机程序使得该电子设备实施第一方面提供的方法。
附图说明
图1A为本申请实施例适用的一种场景示意图;
图1B为本申请实施例提供的墨水屏的一种结构示意图;
图2为本申请实施例提供的控制波形的一种示意图;
图3为本申请实施例提供的电子设备的一种软件架构图;
图4A~图4C为本申请实施例提供的墨水屏的一组界面示意图;
图5A~图5H为本申请实施例提供的页面的一组示意图;
图6为本申请实施例提供的电子设备的另一种软件架构图;
图7A为采用图6所示软件架构设置刷新模式的一种示意图;
图7B为图7A的一种显示效果示意图;
图8为本申请实施例提供的电子设备设置刷新模式的一种界面图;
图9为采用图8所示方式设置刷新模式的一种示意图;
图10A~图10H为图5A~图5H所示页面的刷新模式的设置图;
图11为图10D的一种显示效果示意图;
图12为本申请实施例提供的电子设备的又一种软件架构图;
图13为本申请实施例提供的电子设备的又一种软件架构图;
图14为本申请实施例提供的确定墨水屏的刷新模式的方法的一种流程图;
图15为本申请实施例提供的待显示页面的一个示意图;
图16为图15中各个区域对应的刷新模式的示意图;
图17为本申请实施例提供的确定墨水屏的刷新模式的装置的一种结构示意图;
图18为本申请实施例提供的电子设备的一种结构示意图。
具体实施方式
下面结合附图描述本申请实施例。
本申请实施例提供的确定墨水屏的刷新模式的方法,应用于具有墨水屏的电子设备。示例性的,图1A为本申请实施例适用的一种场景示意图。如图1A所示,电子设备100具有墨水屏101。墨水屏101可以显示电子设备100中安装的应用程序(application,APP)的内容。具体的,墨水屏101中包括窗口102,窗口102中显示有APP的待显示页面103。
本申请实施例对电子设备的类型、型号和形状不做限定。例如,一些电子设备的举例为:手机、平板电脑、掌上电脑、电子书、电子手写板、电子标牌、可穿戴设备、智慧屏、教学设备、物联网(internet of things,IOT)设备、或智慧家庭(smart home)中的无线终端等。
本申请实施例对电子设备中安装的APP的名称和类型不做限定。
首先,对本申请实施例涉及的概念进行说明。
1、墨水屏
示例性的,图1B为本申请实施例提供的墨水屏的一种结构示意图。图1B可以为图1A中墨水屏101在AA’方向上的剖面图。如图1B所示,墨水屏中包括大量的墨滴13。墨滴13也称为微胶囊(microcapsules),这些微胶囊的尺寸约为人类头发直径的大小。墨滴13中包含澄清液体以及悬浮于澄清液体之中的白粒子15和黑粒子16,白粒子15带有正电荷,黑粒子16带有负电荷。墨水屏还包括顶部透明电极11和底部电极12,用于施加电场,从而控制墨滴13中白粒子15和黑粒子16的移动。
例如,如图1B中左侧的墨滴13所示,电场设置为正,底部电极12施加正电压,墨滴13中的白粒子15向墨滴的顶部移动,即向屏幕向上的方向移动,从而墨水屏向用户呈现出白色,同时,墨滴13中的黑粒子16被拉到墨滴的底部,从而隐藏。
例如,如图1B中右侧的墨滴13所示,电场设置为负,底部电极12施加负电压,墨滴13中的黑粒子16向墨滴的顶部移动,即向屏幕向上的方向移动,从而墨水屏向用户呈现出黑色,同时,墨滴13中的白粒子15被拉到墨滴的底部,从而隐藏。
可见,通过顶部透明电极11和底部电极12施加的电场,可以控制墨滴中白粒子和黑粒子的移动,从而墨水屏可以呈现出颜色并显示画面内容。其中,颜色包括白色、黑色以及介于白色与黑色之间的灰度色阶(也称为灰阶)。本申请实施例对灰阶的数量不做限定, 例如,16灰阶、32灰阶等。
墨水屏的控制芯片可以接收控制波形,并根据控制波形对顶部透明电极11和底部电极12施加电场。示例性的,图2为本申请实施例提供的控制波形的一种示意图。如图2所示,控制波形在不同的时间点上具有不同的电压值,电压值可以为正值、负值或0。其中,控制波形具有刷新频率,也是墨水屏刷新画面的频率。刷新频率越高,墨水屏显示时的画面刷新频率越快,相反的,刷新频率越低,墨水屏显示时的画面刷新频率越慢。
2、墨水屏的刷新模式
基于墨水屏的显示原理,墨水屏具有低功耗、保护眼睛的明显优势。但是,墨水屏在显示时通常刷新较慢,显示的色阶通常有限。当墨水屏显示动画、视频等内容时,可能出现拖影、卡顿、闪烁等情况。其中,拖影也称为残影,是指显示器上的残留影像,可以理解为,当显示器进行画面切换时,前一个画面不会立即消失,在视觉效果上呈现出前一个画面与后一个画面同时出现,前一个画面慢慢消失的现象。
为了应对不同的显示场景,墨水屏具有多种刷新模式。在不同的刷新模式下,控制波形有所不同,例如,控制波形的频率不同和/或控制波形的电压幅值不同,从而满足不同应用场景的需求,提供不同的显示效果。
表1
Figure PCTCN2022128300-appb-000001
示例性的,表1示出了多种刷新模式,包括:INIT(初始模式)、DU、GC16、GL16、GLR16、GLD16、A2和DU4。每种刷新模式的参数包括:灰阶和刷新频率。其中,刷新频率采用25℃时的典型耗时表示。例如,25℃时的典型耗时450ms对应的刷新频率为1s/450ms,近似为2Hz;25℃时的典型耗时250ms对应的刷新频率为4Hz。25℃时的典型耗时越大,刷新频率越低,适用于静态的显示内容,例如,文字、图片等。相反的,25℃ 时的典型耗时越小,刷新频率越高,适用于动态的显示内容,例如,视频、动画等。其中,灰阶数量越大,墨水屏显示的颜色越多,适用于对颜色多样性有需求的显示内容,例如,图片、视频等。相反的,灰阶数量越小,墨水屏显示的颜色越少,适用于对颜色多样性需求较低的显示内容,例如,文本等。
举例说明。如表1所示,对于DU刷新模式,具有2灰阶,25℃时的典型耗时为260ms,刷新频率大约为4Hz,通常用于显示灰阶变动的场景,例如,单色菜单、鼠标指针、文本输入、触摸屏输入、触摸笔输入、手写笔输入、快速翻页、跳出窗口、项目选择(例如,字号选择)、高亮标记等,残影很少或者无残影,画面无闪烁。对于GC16刷新模式,具有16灰阶,25℃时的典型耗时为450ms,刷新频率大约为2Hz,刷新很慢,通常用于显示高质量图像、细致文字等,残影很少或者无残影,可以提供较佳的画面显示效果。GLR16刷新模式通常用于显示白色背景下的文本、图示等,残影很少或者无残影,画面变换时的闪烁较轻。对于A2刷新模式,具有2灰阶,25℃时的典型耗时为120ms,刷新频率大约为8Hz,刷新快但对比度较差,通常用于显示要求快速刷新场景,比如快速翻页、播放视频或,动画等。
需要说明,表1仅是示例,并不对刷新模式、刷新模式的参数、应用场景和显示效果形成限定。
3、抖动算法
抖动算法是指一类图像处理算法,当彩色图像降为低灰阶图像进行显示时,容易出现色块或变形问题,此时,可以通过抖动算法大大减少色块或变形问题的发生,提高显示效果。本申请实施例对抖动算法的具体实现不做详细说明,可以采用现有的算法实现方式。
通常,如果墨水屏的刷新模式的灰阶数量较少,小于预设数值,可以结合抖动算法提高显示效果。例如,表1中的DU刷新模式和A2刷新模式。其中,本申请实施例对预设数值不做限定。
4、电子设备进行显示时的通用软件架构
为了方便理解电子设备显示数据的处理流程,对电子设备进行显示时涉及的通用软件架构进行说明。电子设备的软件***可以采用分层架构、事件驱动架构、微核架构、微服务架构、云架构等。本申请实施例以电子设备采用分层架构为例进行说明。分层架构将软件分成若干个层,每一层都有清晰的角色和分工,层与层之间通过软件接口通信。
示例性的,图3为本申请实施例提供的电子设备的一种软件架构图。如图3所示,软件架构从上至下包括应用(Application)层、框架(framework)层、本地服务(Native Services)层和内核层。
应用层也称为应用程序层,包括***对用户所提供的APP,如图3所示,应用程序可以标识为APP 1~APP N,N为正整数。应用程序可以包括但不限于:图库、日历、地图、导航、蓝牙、音乐、视频、短信息等。APP 1~APP N可以生成待显示数据,电子设备对待显示数据进行处理后,在显示屏上进行显示。在本申请实施例中,显示屏为墨水屏。
框架层也称为框架服务层,用于向应用层的应用程序提供应用编程接口(application programming interface,API)和编程框架。框架层可以包括一些预先定义的函数,例如,布局子***和绘制子***。布局子***用于实现布局流程,绘制子***用于实现绘制流程。
本地服务层用于提供框架层所需要的***级实现,比如,图形缓存、数据库存储等。 本地服务层可以包括显示合成子***,显示合成子***用于实现图层(SurfaceFlinger)合成流程。
内核层也称为设备驱动层,是硬件和软件之间的层。设备驱动层至少包含显示(display)驱动。在本申请实施例中,还包括波形(waveform)模块,用于生成控制波形。墨水屏的控制芯片可以根据控制波形施加电场,从而使得墨水屏进行显示。
电子设备对应用程序生成的待显示数据按照显示流水线进行处理,向用户呈现显示界面。显示流水线主要包括布局流程、绘制流程和SurfaceFlinger合成流程。布局流程获取至少一个应用程序的待显示数据,对每个应用程序的待显示数据进行布局。绘制流程根据每个应用程序的待显示数据对应的布局绘制内容,生成图层。SurfaceFlinger合成流程将绘制流程生成的多个图层进行合成并送显,即将合成后的数据推送至显示屏。
5、窗口、页面、视图(控件)、网页视图(WebView)、网页元素、显示单元
应用程序在窗口中显示内容,窗口是显示页面的工具,页面是窗口中显示的内容。举例说明。电子设备运行APP1后,在窗口1中显示APP1的内容。假设,APP1为看图类应用程序,当前在窗口1中显示的页面包括图片1。用户可以通过操作切换APP1的显示内容。例如,用户进行切换图片的操作,将图片1切换为图片2。相应的,电子设备响应于用户切换图片的操作,在窗口1中显示的页面刷新为包括图片2。
可选的,窗口的边框可以显示出来,也可以不显示出来。
可选的,一个应用程序可以在一个窗口中显示页面,也可以在多个窗口中分别显示页面。当一个应用程序对应多个页面时,多个页面之间可能具有重叠区域,也可能不具有重叠区域。当多个页面之间具有重叠区域时,多个页面之间具有上下方向的页面覆盖关系。示例性的,在一个示例中,如图4A所示,APP1对应墨水屏40中的窗口411和窗口412,窗口411中显示页面1,窗口412中显示页面2,页面1和页面2不具有重叠区域。在另一个示例中,如图4B所示,APP1对应墨水屏40中的窗口421和窗口422,窗口421中显示页面1,窗口422中显示页面2,页面1和页面2具有重叠区域,页面2位于页面1的上层。
电子设备可以显示一个应用程序的页面,也可以显示多个应用程序的页面。每个应用程序的页面参见上面描述,此处不再赘述。当电子设备显示多个应用程序的页面时,电子设备显示的页面为至少两个。至少两个页面之间可能具有重叠区域,也可能不具有重叠区域。当至少两个页面之间具有重叠区域时,至少两个页面之间具有上下方向的页面覆盖关系。示例性的,如图4C所示,在墨水屏40中,APP1对应窗口431,窗口431中显示页面1。APP2对应窗口432,窗口432中显示页面2。APP3对应窗口433和窗口434,窗口433中显示页面3,窗口434中显示页面4,页面4位于页面3的上层。APP4对应窗口435,窗口435中显示页面5。其中,页面2和页面5具有重叠区域,页面5位于页面2的上层。相似的,页面5还位于页面3的上层。页面1~页面5之间的页面覆盖关系包括:页面1、页面4和页面5位于最高层,页面2上方的页面包括页面5,页面3上方的页面包括页面4和页面5。
本申请实施例对应用程序的类型、名称、需要显示的页面内容不做限定。例如,在图4C中,页面4为悬浮窗类页面,页面5为输入法的显示页面或手写笔的显示页面。
页面中可以包括至少一个视图(view),视图也称为控件。在本申请实施例中,可以针 对控件设置墨水屏的刷新模式。可选的,控件可以包括网页视图(WebView)和非网页视图。非网页视图也称为非网页控件。网页视图也称为网页控件,网页控件包括网页元素。在本申请实施例中,还可以针对网页元素设置墨水屏的刷新模式。
为了方便说明,将可以设置墨水屏的刷新模式的单位定义为显示单元。显示单元包括下列中的任意一项:非网页控件或者网页控件中的网页元素。可选的,非网页控件可以包括但不限于文本控件、图片控件或视频播放控件。可选的,网页元素可以包括但不限于文本元素、图片元素或视频元素。
显示单元具有内容类型,不同的内容类型可以对应不同的刷新模式。可选的,内容类型可以包括动态显示类型和静态显示类型。可选的,静态显示类型包括但不限于:文本、图片。动态显示类型包括但不限于:视频、动画。
可选的,页面中可以包括一个显示单元,也可以包括多个显示单元。当页面中包括多个显示单元时,多个显示单元的内容类型可以相同,也可以不同。可选的,页面中可以只包括非网页控件,或者,只包括网页控件,或者,同时包括网页控件和非网页控件。
下面,通过图5A~图5H对页面和显示单元的关系进行示例性说明,对本申请实施例适用的显示场景进行示例性说明,但图5A~图5H并不对此形成限定。
可选的,在一个示例中,页面中只包括1个显示单元。可选的,显示单元可以为非网页控件或网页元素。示例性的,如图5A所示,页面1包括1个显示单元,为非网页控件1,非网页控件1的内容类型为文本。
可选的,在另一个示例中,页面中包括多个显示单元,多个显示单元的内容类型相同。可选的,多个显示单元包括非网页控件和/或网页元素。示例性的,如图5B所示,页面2包括2个显示单元,分别为非网页控件1~非网页控件2,内容类型均为文本。
可选的,在又一个示例中,页面中包括多个显示单元,均为非网页控件,且多个显示单元的内容类型包括至少两种。示例性的,如图5C所示,页面3包括3个显示单元,分别为非网页控件1~非网页控件3,非网页控件1的内容类型为文本,非网页控件2的内容类型为图片,非网页控件3的内容类型为视频。
可选的,在又一个示例中,页面中包括多个显示单元,均为网页元素,且多个显示单元的内容类型包括至少两种。示例性的,如图5D所示,页面4包括网页控件,网页控件包括3个网页元素,即,页面4包括3个显示单元,分别为网页元素1~网页元素3。网页元素1的内容类型为文本,网页元素2的内容类型为图片,网页元素3的内容类型为视频。
可选的,在又一个示例中,页面中包括多个显示单元,多个显示单元包括非网页控件和或网页元素,且多个显示单元的内容类型包括至少两种。示例性的,如图5E所示,页面5包括网页控件和非网页控件1,网页控件包括2个网页元素,即,页面5包括3个显示单元,分别为网页元素1、网页元素2和非网页控件1。网页元素1的内容类型为文本,网页元素2的内容类型为图片,非网页控件1的内容类型为视频。
可选的,在又一个示例中,如图5F所示,页面6包括非网页控件1和非网页控件2,页面7位于页面6的上层,包括非网页控件3。非网页控件3和非网页控件2所在的区域具有重叠区域,非网页控件3位于非网页控件2的上层。用户看到非网页控件3遮挡了非网页控件2的一部分。
可选的,在又一个示例中,如图5G所示,页面8包括控件1~控件7,均为非网页控 件。其中,控件4~控件7的内容类型均为图片,且控件4~控件7所在的区域相邻,或者理解为,控件4~控件7所在的区域之间没有其他的显示单元。
可选的,在又一个示例中,页面中具有内容刷新区域,具体为滑动显示区域。如图5H中左侧所示,页面9中具有滑动显示区域61,此时,滑动显示区域61中包括控件1~控件3,均为非网页控件。用户可以对滑动控件62进行下拉操作,从而刷新滑动显示区域61中显示的内容。如图5H中右侧所示,滑动显示区域61中的内容刷新后,包括控件3~控件5,均为非网页控件。页面9中还包括控件5,为非网页控件。
下面,对相关技术中设置墨水屏的刷新模式的实现方式进行说明。
可选的,在一种实现方式中,电子设备在操作***层面向位于高层的应用程序开放设置墨水屏的刷新模式的软件接口。相应的,位于高层的应用程序可以在不同的显示场景和显示内容下,调用***侧提供的软件接口设置墨水屏的刷新模式,并将所设置的墨水屏的刷新模式传递到***侧。
示例性的,图6为本申请实施例提供的电子设备的另一种软件架构图。如图6所示,电子设备的软件架构从上至下包括应用层、接口层、框架层、本地服务层和内核层。其中,应用层、框架层、本地服务层和内核层可以参见图3的相关描述,为了简化结构,将框架层和本地服务层简化为框架层&本地服务层,并且没有示出布局子***、绘制子***和显示合成子***。如图6所示,接口层包括软件开发工具包(software development kit,SDK),是操作***向APP开放的接口,用于APP设置墨水屏的刷新模式。以APP1为例进行说明。假设,APP1需要显示的内容包括视图11、视图12、视图13和视图14。那么,APP1将调用SDK分别对视图11~视图14设置刷新模式,并将视图11~视图14的刷新模式传递至框架层&本地服务层,从而设置刷新模式到墨水屏的控制芯片中。
在该实现方式中,电子设备的操作***可以向上层的应用程序提供设置刷新模式的接口,要由上层的应用程序根据需要显示的内容主动调用该接口,从而针对需要显示的控件设置合适的刷新模式。由于应用程序多种多样,需要每个应用程序在开发的过程中都适配该接口,对应用程序的开发要求较高。而且,应用程序需要显示的内容复杂多变,针对每个控件都要调用***侧提供的接口,应用程序开发者的工作量大,难度高。并且,应用程序针对控件设置刷新模式,一个控件设置一种刷新模式。当控件中包括多种类型的内容时,例如,网页控件包括多种类型的网页元素时,还是针对控件设置统一的刷新模式,导致一些类型的内容显示效果不佳。
示例性的,图7A为采用图6所示软件架构设置刷新模式的一种示意图。如图7A中左侧所示,假设,浏览器类应用程序需要显示图5D所示的页面4,页面4包括网页控件,具体包括文本、图片和视频三种类型的内容。浏览器类应用程序调用操作***提供的接口后,设置整个网页控件的刷新模式为GL16,如图7A中右侧所示,显示效果如图7B所示。可见,由于设置了同一的刷新模式GL16,导致页面4中的文本和图片显示正常,但视频却会出现卡顿、画面不连续等问题,显示效果很差。
可选的,在另一种实现方式中,可以由用户设置墨水屏的刷新模式。本申请实施例对用户设置刷新模式的方式不做限定,例如,通过在电子设备显示的相关界面上进行操作、通过语音设置等等。
示例性的,图8为本申请实施例提供的电子设备设置刷新模式的一种界面图。如图8所示,电子设备显示墨水屏的刷新模式的设置界面80。界面80中包括多种刷新模式,例如,普通刷新、快速刷新和极速刷新。可选的,界面80中包括的刷新模式与表1所示的刷新模式具有对应关系。每种刷新模式对应有选择控件,例如,普通刷新对应选择控件81。可选的,每种刷新模式还具有提示信息,用于引导用户进行选择。例如,普通刷新的提示信息为“显示效果好”,快速刷新的提示信息为“轻微残影,适合图文快速翻阅”,极速刷新的提示信息为“残影严重,适合快速滑动浏览”。假设,用户点击选择控件81,选择普通刷新模式。相应的,电子设备响应于用户点击选择控件81的操作,设置墨水屏的刷新模式为普通刷新模式。
在该实现方式中,电子设备根据用户设置的刷新模式设置墨水屏的刷新模式,需要用户根据不同的显示场景手动切换刷新模式,操作频繁,用户使用感受很差。例如,用户当前浏览图片,可以设置刷新模式为快速刷新。当用户阅读小说时,则需要用户手动操作将刷新模式由快速刷新切换为普通刷新。而且,当页面中包括多种类型的内容时,例如图5C~图5H所示的页面,不同类型的显示单元将设置成统一的刷新模式,将导致一些类型的内容显示效果不佳。
示例性的,图9为采用图8所示方式设置刷新模式的一种示意图。如图9中左侧所示,假设,购物类应用程序需要显示图5C所示的页面3,页面3包括的3个非网页控件分别为文本、图片和视频三种类型。用户当前设置的刷新模式为极速刷新,对应表1中的A2刷新模式,刷新模式参见图9中右侧所示。但是,A2的刷新频率较高,将导致页面3中的文本的显示效果很差。
本申请实施例还提供一种确定墨水屏的刷新模式的方法,通过在电子设备的操作***层面直接针对应用程序的待显示页面中的显示单元设置墨水屏的刷新模式,相比于APP调用***侧提供的接口设置刷新模式的方式,降低了应用程序开发者的工作量和开发难度。而且,应用程序的待显示页面中可以包括多种内容类型的显示单元,电子设备可以根据显示单元的内容类型分别设置刷新模式,实现不同区域或不同显示单元设置不同的刷新模式,提高了设置刷新模式的准确性、适配性和合理性,使得墨水屏针对不同内容类型的显示单元呈现出不同的显示效果,提高了用户的观看感受。
下面,针对图5A~图5H所示的显示场景,对通过该实现方式设置的刷新模式进行示例性说明。
可选的,在一个示例中,参见图10A。图10A中的左侧参见图5A,设置的刷新模式如图10A中的右侧所示。电子设备可以根据非网页控件1的内容类型(文本)设置刷新模式,例如,GLR16,提高了设置刷新模式的准确性。
可选的,在另一个示例中,参见图10B。图10B中的左侧参见图5B,设置的刷新模式如图10B中的右侧所示。电子设备可以根据非网页控件1~非网页控件2的内容类型(文本)设置刷新模式,例如,GLR16,提高了设置刷新模式的准确性。
可选的,在又一个示例中,参见图10C。图10C中的左侧参见图5C,设置的刷新模式如图10C中的右侧所示。电子设备可以设置非网页控件1(文本)的刷新模式为GLR16,设置非网页控件2(图片)的刷新模式为GL16,设置非网页控件3(视频)的刷新模式为 A2,针对不同的非网页控件分别设置刷新模式,提高了不同非网页控件的显示效果。
可选的,在又一个示例中,参见图10D。图10D中的左侧参见图5D,设置的刷新模式如图10D中的右侧所示。电子设备可以设置网页元素1(文本)的刷新模式为GLR16,网页元素2(图片)的刷新模式为GL16,网页元素3(视频)的刷新模式为A2,针对不同的网页元素分别设置刷新模式,提高了不同网页元素的显示效果。显示效果如图11所示。可见,相比于图7B的显示效果,在本示例中,由于网页元素3(视频)的刷新模式为A2,A2的刷新频率较高,使得页面4中的视频显示正常,提高了显示效果。
可选的,在又一个示例中,参见图10E。图10E中的左侧参见图5E,设置的刷新模式如图10E中的右侧所示。电子设备可以设置网页元素1(文本)的刷新模式为GLR16,网页元素2(图片)的刷新模式为GL16,非网页控件1(视频)的刷新模式为A2,针对不同的网页元素或非网页控件分别设置刷新模式,提高了不同显示内容的显示效果。
可选的,在又一个示例中,参见图10F。图10F中的左侧参见图5F,设置的刷新模式如图10F中的右侧所示。其中,页面7中的非网页控件3所在区域和页面6中的非网页控件2所在区域有重叠区域,非重叠区域参见图10F中的虚线框所示,非网页控件3位于非网页控件2的上层。电子设备可以设置非网页控件1(文本)的刷新模式为GLR16,非网页控件2(文本)中的非重叠区域的刷新模式为GLR16,非网页控件3(视频)的刷新模式为A2,针对不同的非网页控件分别设置刷新模式,提高了不同显示内容的显示效果。
可选的,在又一个示例中,参见图10G。图10G中的左侧参见图5G,设置的刷新模式如图10G中的右侧所示。其中,控件4~控件7所在的区域相邻,且控件4~控件7的内容类型相同,均为图片,可以合并区域设置刷新模式,合并区域参见图10G中的虚线框所示。电子设备可以设置控件1(文本)和控件3(文本)的刷新模式为GLR16,控件2(视频)的刷新模式为A2,合并区域的刷新模式为GL16,提高了设置刷新模式的效率,并且针对不同的控件分别设置刷新模式,提高了不同显示内容的显示效果。
可选的,在又一个示例中,参见图10H。图10H中的左侧参见图5H中的左侧,设置的刷新模式如图10H中的右侧所示。其中,页面9中包括滑动显示区域61。电子设备可以设置滑动显示区域61对应的刷新模式为DU,控件5(图片)的刷新模式为GL16,提高了设置刷新模式的效率,提高了不同显示内容的显示效果。
下面,对该实现方式下电子设备的软件架构进行说明。
可选的,在一种实现方式中,图12为本申请实施例提供的电子设备的又一种软件架构图。如图12所示,电子设备的软件架构从上至下包括应用层、框架层、本地服务层和内核层。其中,应用层、框架层、本地服务层、内核层可以参见图3的相关描述,此处不再赘述。
框架层还包括第一模式决策模块121,用于确定单个待显示页面中显示单元的显示区域对应的刷新模式。可选的,显示单元可以为本申请实施例中的第一显示单元、第二显示单元或第三显示单元。其中,第一模式决策模块121可以包括:类型识别模块1211、事件识别模块1212、合并模块1213、配置模块1214和确定模块1215。
类型识别模块1211,用于在布局阶段确定待显示页面中显示单元的内容类型和显示区域。
事件识别模块1212,用于获取事件信息,事件信息包括用户操作的有效时长和用户操 作在待显示页面中对应的内容刷新区域,用户操作用于触发内容刷新区域中的内容在有效时长内刷新显示。
合并模块1213,用于对待显示页面中位置相邻且内容类型相同的至少两个显示单元占用的区域进行区域合并。其中,位置相邻是指至少两个显示单元占用的区域之间没有其他的显示单元。
配置模块1214,用于按照预设刷新模式设置显示单元的刷新模式。预设刷新模式可以为不同颗粒度对应的预设刷新模式。
确定模块1215,用于根据显示单元的内容类型确定显示单元的显示区域对应的刷新模式。可选的,也可以结合待显示页面中动态刷新显示的内容刷新区域或者预设的刷新模式等条件,确定显示单元的显示区域对应的刷新模式。
本地服务层中还可以包括第二模式决策模块122,抖动算法模块124和送显模块123。
第二模式决策模块122,用于确定存在多个待显示页面的复合显示场景中,不同待显示页面中显示单元的显示区域对应的刷新模式。可选的,多个待显示页可以包括一个应用程序的多个待显示页面和/或多个应用程序分别对应的待显示页面。
抖动算法模块124,用于确定显示单元的显示区域是否需要使用抖动算法。若需要,则对显示单元的显示区域使用抖动算法,以进一步提高显示效果。
送显模块123,用于将第一模式决策模块121或第二模式决策模块122确定的显示单元的显示区域对应的刷新模式,设置到墨水屏的控制芯片中。
可见,在该实现方式中,电子设备可以在应用程序的待显示页面的布局过程中,确定待显示页面中显示单元的内容类型,从而设置显示单元的显示区域对应的刷新模式。通常,数据显示需要经过布局流程、绘制流程和图层合成流程,由于在布局阶段就获取显示单元的内容类型,计算量小,从而提高了确定刷新模式的效率。而且,电子设备针对显示单元设置刷新模式,提高了设置刷新模式的准确性、适配性和合理性,使得墨水屏针对不同内容类型的显示单元呈现出不同的显示效果,提高了用户的观看感受。
可选的,在另一种实现方式中,图13为本申请实施例提供的电子设备的又一种软件架构图。如图13所示,电子设备的软件架构从上至下包括应用层、框架层、本地服务层和内核层。其中,应用层、框架层、本地服务层、内核层可以参见图3的相关描述,此处不再赘述。
本地服务层还包括分析模块131,抖动算法模块124和送显模块123。
分析模块131,用于获取合成显示数据,并根据合成显示数据确定显示单元的内容类型和显示区域。
抖动算法模块124和送显模块123可以参见图12中的相关描述,此处不再赘述。
可见,在该实现方式中,至少一个应用程序的待显示页面经过布局流程、绘制流程和图层合成流程的处理后,生成了合成显示数据。电子设备通过对合成显示数据进行分析,获取显示单元的内容类型,从而可以设置显示单元的显示区域对应的刷新模式。由于电子设备在***侧确定刷新模式,相比于APP确定刷新模式的方式,降低了APP开发者的工作量和难度。而且,电子设备针对显示单元设置刷新模式,提高了设置刷新模式的准确性、适配性和合理性,使得墨水屏针对不同内容类型的显示单元呈现出不同的显示效果,提高了用户的观看感受。
下面通过具体的实施例对本申请的技术方案进行详细说明。下面的实施例可以相互结合,对于相同或相似的概念或过程可能在某些实施例中不再赘述。
本申请实施例可以相互结合,对于相同或相似的概念或过程可能在某些实施例中不再赘述。本申请实施例中的术语“第一”、“第二”、“第三”、“第四”等(如果存在)是用于区别类似的对象,而不必用于描述特定的顺序或先后次序。
需要说明,在本申请的一些描述中,设置显示单元的刷新模式和设置显示单元的显示区域对应的刷新模式,具有相同含义。在本申请实施例中,确定墨水屏的刷新模式,是指确定墨水屏显示应用程序的待显示页面中显示单元的显示区域时所使用的刷新模式。
图14为本申请实施例提供的确定墨水屏的刷新模式的方法的一种流程图。本实施例提供的确定墨水屏的刷新模式的方法,可以应用于具有墨水屏的电子设备。如图14所示,本实施例提供的确定墨水屏的刷新模式的方法,可以包括:
S1401、确定应用程序的待显示页面中第一显示单元的内容类型和显示区域。第一显示单元包括下列中的任意一项:非网页控件或者网页控件中的网页元素。
其中,对待显示页面中包括的显示单元的个数不做限定。可选的,待显示页面中显示单元的个数可以为1个,例如,图5A所示的页面1。可选的,待显示页面中显示单元的个数可以为2个或2个以上,例如,图5B~图5E、图5G~图5H所示的页面。
其中,第一显示单元可以为待显示页面中的任意单元。举例说明。假设,APP1的待显示页面中包括10个显示单元。可选的,第一显示单元可以为10个显示单元中的任意一个显示单元。可选的,第一显示单元可以为10个显示单元中的任意多个显示单元,任意多个包括两个及两个以上。可选的,第一显示单元可以为10个显示单元中对用户可见的任意一个或任意多个显示单元,其中,对用户可见是指显示单元的显示区域中的至少一部分没有被遮挡,用户可以看到。
可选的,内容类型可以包括但不限于下列中的任意一项:文本、图片或视频。
其中,第一显示单元的显示区域用于表示第一显示单元在待显示页面中的位置。为了便于处理,显示区域可以为规则形状,例如,长方形、正方形、圆形等。当然,显示区域也可以为不规则形状。显示单元不同、显示场景不同时,显示区域的形状可以不同。
可选的,显示区域可以通过边缘点的坐标表示。例如,如果显示区域为矩形,可以通过矩形4个顶点的坐标表示。又例如,显示区域为圆形时,可以通过圆心的坐标和半径表示。
S1402、根据第一显示单元的内容类型设置第一显示单元的显示区域对应的刷新模式。
其中,内容类型和刷新模式具有预设的对应关系,本实施例对对应关系不做限定。例如,文本对应GLR16模式,图片对应GL16模式,视频对应A2模式。
可选的,在一种实现方式中,第一显示单元可以为待显示页面中的每个显示单元。该实现方式可以针对待显示页面中的每个显示单元设置刷新模式。
可选的,在另一种实现方式中,第一显示单元可以为预设内容类型的显示单元,当确定第一显示单元的内容类型为预设内容类型时,则根据预设内容类型确定第一显示单元的显示区域对应的刷新模式。该实现方式可以针对特定内容类型的显示单元设置刷新模式。 例如,APP1的待显示页面中包括10个显示单元,其中3个显示单元的内容类型为文本,预设内容类型为文本。那么,可以根据文本类型设置这3个显示单元的显示区域的刷新模式。
可见,本实施例提供的确定墨水屏的刷新模式的方法,电子设备可以在操作***层面直接针对应用程序的待显示页面中的显示单元设置墨水屏的刷新模式,相比于相关技术中由APP调用***侧提供的接口设置刷新模式的方式,降低了APP开发者的工作量和难度。而且,电子设备可以针对显示单元设置刷新模式,提高了设置刷新模式的准确性、适配性和合理性,使得墨水屏针对不同内容类型的显示单元呈现出不同的显示效果,提高了用户的观看感受。
可选的,待显示页面中还可以包括第三显示单元,本实施例提供的确定墨水屏的刷新模式的方法还包括:
将第三显示单元的第三标识信息对应的预设刷新模式设置为第三显示单元的显示区域对应的刷新模式。
为了方便说明,第三显示单元的标识信息称为第三标识信息,显示单元的标识信息可以唯一的区分不同的显示单元,例如,名称、标识序列等。第三显示单元预先设置有预设刷新模式。
在该实现方式中,可以针对特定的显示单元设置刷新模式,以提升显示效果。一个显示场景可以为:在多种刷新模式中,当第三显示单元设置为第一刷新模式时显示效果最好,那么,第三显示单元可以对应第一刷新模式。如果待显示页面中存在第三显示单元,则设置第三显示单元的显示区域对应的刷新模式为第一刷新模式。
可选的,待显示页面中还可以包括第四显示单元,第一显示单元和第四显示单元的内容类型不同,本实施例提供的确定墨水屏的刷新模式的方法还包括:
根据第四显示单元的内容类型设置第四显示单元的显示区域对应的刷新模式。
在该实现方式中,如果待显示页面中包括至少两种内容类型的显示单元,例如,第一显示单元和第四显示单元,那么,根据第一显示单元的内容类型设置第一显示单元的显示区域对应的刷新模式,根据第四显示单元的内容类型设置第四显示单元的显示区域对应的刷新模式。由于根据不同的内容类型分别设置不同显示单元的显示区域对应的刷新模式,提高了设置刷新模式的准确性、适配性和合理性。
可选的,如果待显示页面中包括一种内容类型的显示单元,例如,至少一个第一显示单元的内容类型相同,参见图5B所示的页面2,或者,图5A所示的页面1,那么,可以将整个待显示页面的显示区域设置为同一种刷新模式,不需要针对每个第一显示单元分别设置刷新模式,提高了处理效率。
可选的,本实施例提供的确定墨水屏的刷新模式的方法,还可以包括:
根据第一显示单元的显示区域对应的刷新模式确定是否对第一显示单元的显示区域使用抖动算法。
若确定使用抖动算法,则根据抖动算法对第一显示单元的显示区域进行处理,以提高显示效果。若确定不使用抖动算法,则不需要对第一显示单元的显示区域进行抖动处理。
可选的,刷新模式和是否需要使用抖动算法之间具有预设的对应关系。通常,刷新模式的灰阶数量较少,显示颜色较少时,例如,小于预设数值,那么可以使用抖动算法。例 如,DU模式和A2模式可以结合抖动算法。
在图14所示实施例的基础上,本申请另一实施例提供了确定墨水屏的刷新模式的方法的一种实现方式,适用于图12所示的软件架构。
在本实施例中,S1401中,确定应用程序的待显示页面中第一显示单元的内容类型和显示区域,可以包括:
在对待显示页面进行布局处理时,确定第一显示单元的内容类型和显示区域。
可见,本实施例提供的确定墨水屏的刷新模式的方法,在布局阶段就可以确定第一显示单元的内容类型和显示区域,从而确定第一显示单元的显示区域对应的刷新模式,大大减少了数据处理量,提高了处理效率。
可选的,在一种实现方式中,待显示页面包括非网页控件,第一显示单元为非网页控件,确定第一显示单元的内容类型和显示区域,可以包括:
识别布局待显示页面时使用的至少一个非网页控件,至少一个非网页控件包括第一显示单元。
确定第一显示单元的内容类型和显示区域。
该实现方式可以实现确定非网页控件的内容类型和显示区域。其中,本实施例对待显示页面中包括的至少一个非网页控件的个数不做限定。例如,图5A~图5C、图5E~图5F所示的页面。可选的,待显示页面还可以包括网页控件。其中,第一显示单元可以为待显示页面中的任意非网页控件。
可选的,在另一种实现方式中,待显示页面包括网页控件,第一显示单元为网页元素,确定第一显示单元的内容类型和显示区域,可以包括:
在浏览器内核中获取待显示页面包括的网页控件中的至少一个网页元素,至少一个网页元素包括第一显示单元。
根据第一显示单元对应的文档对象化模型,确定第一显示单元的内容类型和显示区域。
该实现方式可以实现确定网页控件中网页元素的内容类型和显示区域。其中,本实施例对待显示页面中包括的网页控件的个数和每个网页控件中包括的至少一个网页元素的个数不做限定。例如,图5D~图5E所示的页面。可选的,待显示页面还可以包括非网页控件。其中,第一显示单元可以为待显示页面中的任意网页元素。
可选的,待显示页面中还可以包括第二显示单元,第一显示单元和第二显示单元的内容类型相同,且第一显示单元的显示区域和第二显示区域的显示区域之间没有其他内容类型的显示单元。S1402中,根据第一显示单元的内容类型设置第一显示单元的显示区域对应的刷新模式,可以包括:
根据第一显示单元的内容类型设置目标区域对应的刷新模式。其中,目标区域包括第一显示单元的显示区域、第二显示单元的显示区域,以及第一显示单元和第二显示单元之间的显示区域。
举例说明。如图5G所示,假设,待显示页面为页面8。第一显示单元为页面8中的控件4,第二显示单元包括页面8中的控件5~控件7,内容类型均为图片。控件4~控件7分别对应的显示区域之间没有其他内容类型的显示单元。那么,如图10G中的右侧所示,目标区域为虚线所示,可以根据图片内容类型统一设置目标区域对应的刷新模式。也就是说, 针对目标区域设置1次刷新模式即可,不需要分别针对控件4~控件7的显示区域单独进行设置,避免了设置4次的冗余处理,提高了处理效率。
可选的,根据第一显示单元的内容类型设置目标区域对应的刷新模式之前,还可以包括:
将第一显示单元的显示区域和第二显示单元的显示区域进行区域合并,形成目标区域。
举例说明,参见图10G。如图10G中的左侧所示,可以对页面8中的控件4~控件7分别对应的显示区域进行区域合并,形成目标区域,如图10G中右侧所示的虚线框。根据图片内容类型设置虚线框所示目标区域对应的刷新模式。由于只需要设置1次刷新模式,提高了处理效率。
可选的,本实施例提供的确定墨水屏的刷新模式的方法,还可以包括:
获取事件信息。事件信息包括用户操作对应的刷新时段和用户操作在待显示页面中对应的内容刷新区域,用户操作用于触发内容刷新区域中的内容在刷新时段内刷新显示。内容刷新区域包括第一显示单元的显示区域。
相应的,若当前时刻处于刷新时段内,则根据刷新显示的方式确定为第一显示单元的显示区域对应的刷新模式。
其中,本实施例对用户的操作不做限定,例如,点击操作、滑动操作、双指的捏合缩放操作等。用户操作用于触发内容刷新区域中的内容在刷新时段内刷新显示。可选的,刷新时段可以包括开始生效时间点和结束生效时间点。
举例说明。如图5H所示,用户操作可以为用户对滑动控件62进行的下拉操作,内容刷新区域可以为滑动显示区域61,用户操作用于触发滑动显示区域61中的内容在刷新时段内向下滑动显示。如果当前时刻处于刷新时段内,说明用户触发的滑动显示依然生效。为了提高显示效果,对于存在内容刷新动态显示的场景,滑动显示区域61对应的刷新模式应该基于滑动显示方式进行设置。相比于根据滑动显示区域61中控件1~控件3的内容类型设置刷新区域,设置更加准确和合理,提高了显示效果。
可选的,刷新显示的方式包括但不限于下列中的任意一项:滑动显示、滚动显示、上翻页显示、上翻页显示、缩小显示或放大显示。
可选的,确定内容刷新区域包括第一显示单元的显示区域,可以包括:
确定第一显示单元的显示区域位于内容刷新区域内。
可选的,根据刷新显示的方式确定为第一显示单元的显示区域对应的刷新模式,可以包括:
根据第一显示单元的内容类型和刷新显示的方式确定为第一显示单元的显示区域对应的刷新模式。
在该实现方式中,对于存在内容刷新动态显示的场景,确定内容刷新区域对应的刷新模式,不仅基于刷新显示的方式进行设置,还考虑了内容刷新区域内第一显示单元的内容类型,进一步提高了设置刷新模式的准确性和合理性,提高了显示效果。例如,内容刷新区域中滑动显示文本和滑动显示图片,可以设置不同的刷新模式。
可选的,待显示页面中还可以包括第五显示单元。可选的,第五显示单元的内容类型无法确定。例如,第五显示单元的内容类型不是文本、图片或者视频,可以标记为其他类型。本实施例提供的确定墨水屏的刷新模式的方法,还可以包括:
获取配置文件,配置文件包括不同颗粒度下标识信息与刷新模式之间的对应关系。
根据不同颗粒度下标识信息与刷新模式之间的对应关系设置第五显示单元的显示区域对应的刷新模式。
为了方便说明,第五显示单元的标识信息称为第五标识信息,显示单元的标识信息可以唯一的区分不同的显示单元,例如,名称、标识序列等。
该实现方式提供了一种设置显示单元的刷新模式的补充方案,尤其是在没有确定出显示单元的内容类型的场景中。由于配置文件中预设了不同颗粒度下标识信息与刷新模式之间的对应关系,因此可以根据配置文件直接设置第五显示单元的显示区域对应的刷新模式。
其中,颗粒度不同时,标识信息不同。
可选的,颗粒度可以包括但不限于下列中的至少一项:应用程序颗粒度、窗口颗粒度或控件颗粒度。
其中,应用程序颗粒度是指应用程序包括的每个页面中的每个显示单元都可以采用该应用程序对应的预设刷新模式。在应用程序颗粒度下,配置文件包括应用程序的标识信息与刷新模式之间的对应关系,应用程序的标识信息可以唯一区分不同的应用程序。在应用程序颗粒度下,可以将第五显示单元所属应用程序对应的预设刷新模式设置为第五显示单元的显示区域对应的刷新模式。例如,APP1包括页面1和页面2,页面1包括控件1~控件3,页面2包括控件4~控件10。APP1的标识信息预设有刷新模式1。第五显示单元为页面2中的控件5。那么,可以将控件5所属的应用程序APP1对应的刷新模式1,设置为控件5的显示区域对应的刷新模式。
窗口颗粒度是指窗口中每个页面中的每个显示单元都可以采用该窗口对应的预设刷新模式。在窗口颗粒度下,配置文件包括窗口的标识信息与预设刷新模式之间的对应关系,窗口的标识信息可以唯一区分不同的窗口。在窗口颗粒度下,可以将第五显示单元所属窗口对应的刷新模式设置为第五显示单元的显示区域对应的刷新模式。例如,窗口1包括页面1和页面2,页面1包括控件1~控件3,页面2包括控件4~控件10。窗口1的标识信息预设有刷新模式2。第五显示单元为页面1中的控件3。那么,可以将控件3所属窗口1对应的刷新模式2,设置为控件3的显示区域对应的刷新模式。
控件颗粒度是指某个显示单元可以采用该显示单元对应的预设刷新模式。在控件颗粒度下,配置文件包括显示单元的标识信息与预设刷新模式之间的对应关系,显示单元的标识信息可以唯一区分不同的显示单元。在控件颗粒度下,可以将第五显示单元对应的刷新模式设置为第五显示单元的显示区域对应的刷新模式。例如,如图5H所示,第五显示单元为页面9中的控件5,控件5的标识信息预设有刷新模式3。那么,可以将控件5对应的刷新模式3,设置为控件5的显示区域对应的刷新模式。
可选的,在一种实现方式中,根据不同颗粒度下标识信息与刷新模式之间的对应关系设置第五显示单元的显示区域对应的刷新模式,可以包括:按照颗粒度等级从小到大的顺序,设置第五显示单元的显示区域对应的刷新模式。
举例说明。颗粒度等级从小到大的顺序依次为:控件颗粒度、窗口颗粒度和应用程序颗粒度。假设,APP1包括窗口1和窗口2。窗口1包括页面1和页面2,窗口2包括页面3。页面1包括控件1~控件3,页面2包括控件4~控件10,页面3包括控件11。APP1的标识信息对应刷新模式1。窗口1的标识信息对应刷新模式2。控件2的标识信息对应刷 新模式3。
在一个示例中,第五显示单元为APP1中窗口1的页面1包括的控件2。按照颗粒度等级从小到大的顺序,可以找到最小颗粒度(控件颗粒度)下,控件2的标识信息对应刷新模式3。所以,设置控件2的显示区域对应的刷新模式为刷新模式3。
在另一个示例中,第五显示单元为APP1中窗口1的页面1包括的控件1。按照颗粒度等级从小到大的顺序,在控件颗粒度下没有找到控件1的标识信息对应的刷新模式。则继续在窗口颗粒度下查找。在窗口颗粒度下,控件1所属页面1的窗口1对应刷新模式2,则设置控件1的显示区域对应的刷新模式为刷新模式2。
在又一个示例中,第五显示单元为APP1中窗口2的页面3包括的控件11。按照颗粒度等级从小到大的顺序,在控件颗粒度下没有找到控件11的标识信息对应的刷新模式。则继续在窗口颗粒度下查找。在窗口颗粒度下,没有找到控件11所属窗口2的标识信息对应的刷新模式,则继续在应用程序颗粒度下查找。在应用程序颗粒度下,控件11所属页面3的窗口2所属的应用程序APP1对应刷新模式1,则设置控件11的显示区域对应的刷新模式为刷新模式1。
可见,按照颗粒度等级从小到大的顺序设置第五显示单元的显示区域对应的刷新模式,颗粒度等级越小,设置的刷新模式的准确率越高,提高了设置刷新模式的准确性。
可选的,在另一种实现方式中,可以根据预设颗粒度设置第五显示单元的显示区域对应的刷新模式。其中,本实施例对预设颗粒度不做限定。例如,预设颗粒度可以为控件颗粒度、窗口颗粒度或者应用程序颗粒度。该实现方式易于实现。
可选的,配置文件可以周期更新或者条件触发更新。例如,当确定显示单元在刷新模式1下的显示效果更好时,可以更新配置文件,在配置文件将显示单元的标识信息和刷新模式1对应起来。
可选的,电子设备可以接收云服务器发送的配置文件。
可选的,本实施例提供的确定墨水屏的刷新模式的方法,若待显示页面为多个,多个待显示页面包括应用程序的多个待显示页面和/或多个应用程序分别对应的待显示页面,S1402中,根据第一显示单元的内容类型设置第一显示单元的显示区域对应的刷新模式,可以包括:
获取多个待显示页面之间的页面覆盖关系。
当第一显示单元位于最高层的第一待显示页面中时,根据第一待显示页面中的第一显示单元的内容类型设置第一待显示页面中的第一显示单元的显示区域对应的刷新模式。
当第一显示单元位于最高层之下的第二待显示页面中时,在第二待显示页面中的第一显示单元的显示区域中确定与目标待显示页面未重叠的非重叠区域,根据第二待显示页面中的第一显示单元的内容类型设置非重叠区域对应的刷新模式。目标待显示页面包括位于第二待显示页面上方的所有待显示页面的区域之和。
举例说明。
参见图10F。假设,APP1包括页面6和页面7,即,多个待显示页面包括同一个APP的多个待显示页面。其中,页面7位于页面6的上层。对于页面7中的非网页控件3,可以根据非网页控件3的内容类型(视频)设置刷新模式为A2。对于页面6中的非网页控件1,没有受到网页7的遮挡,可以根据非网页控件1的内容类型(文本)设置刷新模式为 GLR16。对于页面6中的非网页控件2,受到了网页7的遮挡,存在重叠区域和非重叠区域,非重叠区域如图10F中右侧所示的虚线框,则根据非网页控件2的内容类型(文本)设置虚线框所示非重叠区域的刷新模式为GLR16。
可见,通过多个待显示页面之间的页面覆盖关系,可以确定位于最高层的第一待显示页面,以及位于下层的第二待显示页面。对于第一待显示页面中的显示单元,显示单元均为用户可见,可以直接根据显示单元的内容类型设置刷新模式。对于第二待显示页面中的显示单元,显示单元的显示区域中的部分或全部区域可能被遮挡,而未被遮挡的部分为用户可见,可以根据显示单元的内容类型设置刷新模式。使得设置的刷新模式更加准确和合理,提升了显示效果。
下面,通过示例对本实施例提供的确定墨水屏的刷新模式的方法进行说明。图15为本申请实施例提供的待显示页面的一个示意图,图16为图15中各个区域对应的刷新模式的示意图。但图15和图16并不形成限定。
如图15所示,待显示页面151中包括多个非网页控件。其中,实线框所示区域对应的控件的内容类型为视频,标记为控件152。虚线框所示区域对应的控件的内容类型为文本,标记为控件153,控件153为多个。用户可以对滑动控件154进行下拉操作,使得滑动控件154左侧的区域滑动显示。
本实施例提供的确定墨水屏的刷新模式的方法,可以包括:
1.在对待显示页面151进行布局处理时,识别出使用的控件包括:控件154、控件152和多个控件153,分别获取每个控件的内容类型和显示区域。其中,控件152的内容类型为视频,控件153的内容类型为文本,没有确定出控件154的内容类型。
2.获取事件信息,事件信息包括内容刷新区域164,如图16所示。内容刷新区域164中的内容进行滑动显示。
3.对多个控件153进行区域合并,获得合并区域162和合并区域163,如图16所示。
4.根据控件152的内容类型(视频)确定控件152的显示区域161对应的刷新模式为A2模式;根据控件153的内容类型(文本)确定合并区域162和合并区域163对应的刷新模式为GLR16模式;根据滑动显示方式和控件153的内容类型(文本)确定内容刷新区域164对应的刷新模式为DU模式;
5.根据刷新模式与是否使用抖动算法之间的对应关系,确定显示区域161和内容刷新区域164使用抖动算法。
可见,通过本实施例提供的确定墨水屏的刷新模式的方法,电子设备可以针对页面中的不同区域设置不同的刷新模式,设置的刷新模式更加准确和合理,提高了显示效果。而且,本实施例提供的确定墨水屏的刷新模式的方法,在***侧实现设置刷新模式,降低了APP开发者的工作量和难度。
在图14所示实施例的基础上,本申请另一实施例提供了确定墨水屏的刷新模式的方法的一种实现方式,适用于图13所示的软件架构。
在本实施例中,S1401中,确定应用程序的待显示页面中第一显示单元的内容类型和显示区域,可以包括:
在对待显示页面进行布局处理、绘制处理和图层合成处理之后,获取合成显示数据。
根据合成显示数据确定第一显示单元的内容类型和显示区域。
可选的,可以使用光学字符识别(optical character recognition,OCR)等技术,对合成显示数据进行图像数据的识别分类,并将不同内容类型(例如,文本,图片,视频)按照区域进行分割,从而获得不同显示单元的内容类型和显示区域。
可见,本实施例提供的确定墨水屏的刷新模式的方法,待显示页面经过了布局流程、绘制流程和图层合成流程的处理后,生成了合成显示数据。电子设备通过对合成显示数据进行分析,获取显示单元的内容类型,从而可以设置显示单元的显示区域对应的刷新模式。由于电子设备在***侧确定刷新模式,相比于APP确定刷新模式的方式,降低了APP开发者的工作量和难度。而且,电子设备针对显示单元设置刷新模式,提高了设置刷新模式的准确性、适配性和合理性,使得墨水屏针对不同内容类型的显示单元呈现出不同的显示效果,提高了用户的观看感受。
可以理解的是,电子设备为了实现上述功能,其包含了执行各个功能相应的硬件和/或软件模块。结合本文中所公开的实施例描述的各示例的算法步骤,本申请能够以硬件或硬件和计算机软件的结合形式来实现。某个功能究竟以硬件还是计算机软件驱动硬件的方式来执行,取决于技术方案的特定应用和设计约束条件。本领域技术人员可以结合实施例对每个特定的应用来使用不同方法来实现所描述的功能,但是这种实现不应认为超出本申请的范围。
本申请实施例可以根据上述方法示例对电子设备进行功能模块的划分,例如,可以对应各个功能划分各个功能模块,也可以将两个或两个以上的功能集成在一个模块中。需要说明的是,本申请实施例中对模块的划分是示意性的,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式。需要说明的是,本申请实施例中模块的名称是示意性的,实际实现时对模块的名称不做限定。
示例性的,图17为本申请实施例提供的确定墨水屏的刷新模式的装置的一种结构示意图。本实施例提供的确定墨水屏的刷新模式的装置,用于执行本申请方法实施例提供的确定墨水屏的刷新模式的方法,技术原理和技术效果相似。
如图17所示,本实施例提供的确定墨水屏的刷新模式的装置,可以包括:
确定模块1701,用于确定应用程序的待显示页面中第一显示单元的内容类型和显示区域;所述第一显示单元为非网页控件或者网页控件中的网页元素;
设置模块1702,用于根据所述第一显示单元的内容类型设置所述第一显示单元的显示区域对应的刷新模式;所述刷新模式用于所述墨水屏显示所述待显示页面中所述第一显示单元的显示区域。
可选的,所述确定模块1701用于:
在对所述待显示页面进行布局处理时,确定所述第一显示单元的内容类型和显示区域。
可选的,所述待显示页面包括非网页控件,所述第一显示单元为非网页控件,所述确定模块1701用于:
识别布局所述待显示页面时使用的至少一个非网页控件,所述至少一个非网页控件包括所述第一显示单元;
确定识别出的所述第一显示单元的内容类型和显示区域。
可选的,所述待显示页面包括网页控件,所述第一显示单元为网页元素,所述确定模块1701用于:
在浏览器内核中获取所述待显示页面包括的网页控件中的至少一个网页元素,所述至少一个网页元素包括所述第一显示单元;
根据所述第一显示单元对应的文档对象化模型,确定所述第一显示单元的内容类型和显示区域。
可选的,所述设置模块1702还用于:
获取事件信息;所述事件信息包括用户操作在所述待显示页面中对应的内容刷新区域和刷新时段,所述用户操作用于触发所述内容刷新区域中的内容在所述刷新时段内刷新显示,所述内容刷新区域包括所述第一显示单元的显示区域;
若当前时刻处于所述刷新时段内,则根据所述刷新显示的方式确定所述第一显示单元的显示区域对应的刷新模式。
可选的,所述刷新显示的方式包括下列中的任意一项:滑动显示、滚动显示、翻页显示、缩小显示或放大显示。
可选的,所述待显示页面中还包括第二显示单元,所述第一显示单元和所述第二显示单元的内容类型相同,且所述第一显示单元的显示区域和所述第二显示区域的显示区域之间没有其他内容类型的显示单元;
所述设置模块1702用于:
根据所述第一显示单元的内容类型设置目标区域对应的刷新模式;所述目标区域包括所述第一显示单元的显示区域、所述第二显示单元的显示区域,以及所述第一显示单元和所述第二显示单元之间的显示区域。
可选的,所述待显示页面中还包括第五显示单元,所述设置模块1702还用于:
获取配置文件;
若所述配置文件包括所述第五显示单元所属待显示页面的窗口与刷新模式之间的对应关系,则将所述第五显示单元所属窗口对应的刷新模式设置为所述第五显示单元的显示区域对应的刷新模式;
或者,若所述配置文件包括所述第五显示单元所属的应用程序与刷新模式之间的对应关系,则将所述第五显示单元所属应用程序对应的刷新模式设置为所述第五显示单元的显示区域对应的刷新模式。
可选的,待显示页面为多个,所述多个待显示页面属于一个或多个应用程序,所述设置模块1702用于:
获取所述多个待显示页面之间的页面覆盖关系;
所述第一显示单元为位于最高层的第一待显示页面中的显示单元时,根据所述第一待显示页面中的所述第一显示单元的内容类型设置所述第一待显示页面中的所述第一显示单元的显示区域对应的刷新模式;
或者,所述第一显示单元为位于最高层之下的第二待显示页面中的显示单元时,在所述第二待显示页面中的所述第一显示单元的显示区域中确定与目标待显示页面未重叠的非重叠区域,根据所述第二待显示页面中的所述第一显示单元的内容类型设置所述非重叠区域对应的刷新模式;所述目标待显示页面包括位于所述第二待显示页面上方的所有待显 示页面的区域之和。
可选的,所述确定模块1701用于:
在对所述待显示页面进行布局处理、绘制处理和图层合成处理之后,获取合成显示数据;
根据所述合成显示数据确定所述第一显示单元的内容类型和显示区域。
可选的,所述待显示页面中还包括第三显示单元,所述设置模块1702还用于:
将第三显示单元的预设刷新模式设置为所述第三显示单元的显示区域对应的刷新模式。
可选的,所述待显示页面中还包括第四显示单元,所述第一显示单元和所述第四显示单元的内容类型不同,所述设置模块1702还用于:
根据所述第四显示单元的内容类型设置所述第四显示单元的显示区域对应的刷新模式。
可选的,所述设置模块1702还用于:
根据所述第一显示单元的显示区域对应的刷新模式确定是否对所述第一显示单元的显示区域使用抖动算法。
可选的,所述内容类型包括下列中的任意一项:文本、图片或视频。
请参考图18,其示出了本申请实施例提供的电子设备的一种结构,电子设备具有墨水屏。电子设备还包括:处理器1801、接收器1802、发射器1803、存储器1804和总线1805。处理器1801包括一个或者多个处理核心,处理器1801通过运行软件程序以及模块,从而执行各种功能的应用以及信息处理。接收器1802和发射器1803可以实现为一个通信组件,该通信组件可以是一块基带芯片。存储器1804通过总线1805和处理器1801相连。存储器1804可用于存储至少一个程序指令,处理器1801用于执行至少一个程序指令,以实现上述实施例的技术方案。其实现原理和技术效果与上述方法相关实施例类似,此处不再赘述。
当电子设备开机后,处理器可以读取存储器中的软件程序,解释并执行软件程序的指令,处理软件程序的数据。当需要通过天线发送数据时,处理器对待发送的数据进行基带处理后,输出基带信号至控制电路中的控制电路,控制电路将基带信号进行射频处理后将射频信号通过天线以电磁波的形式向外发送。当有数据发送到电子设备时,控制电路通过天线接收到射频信号,将射频信号转换为基带信号,并将基带信号输出至处理器,处理器将基带信号转换为数据并对该数据进行处理。
本领域技术人员可以理解,为了便于说明,图18仅示出了一个存储器和处理器。在实际的电子设备中,可以存在多个处理器和存储器。存储器也可以称为存储介质或者存储电子设备等,本申请实施例对此不做限制。
作为一种可选的实现方式,处理器可以包括基带处理器和中央处理器,基带处理器主要用于对通信数据进行处理,中央处理器主要用于执行软件程序,处理软件程序的数据。本领域技术人员可以理解,基带处理器和中央处理器可以集成在一个处理器中,也可以是各自独立的处理器,通过总线等技术互联。本领域技术人员可以理解,电子设备可以包括多个基带处理器以适应不同的网络制式,电子设备可以包括多个中央处理器以增强其处理 能力,电子设备的各个部件可以通过各种总线连接。该基带处理器也可以表述为基带处理电路或者基带处理芯片。该中央处理器也可以表述为中央处理电路或者中央处理芯片。对通信协议以及通信数据进行处理的功能可以内置在处理器中,也可以以软件程序的形式存储在存储器中,由处理器执行软件程序以实现基带处理功能。该存储器可以集成在处理器中,也可以独立在处理器之外。该存储器包括高速缓存Cache,可以存放频繁访问的数据/指令。
在本申请实施例中,处理器可以是通用处理器、数字信号处理器、专用集成电路、现场可编程门阵列或者其他可编程逻辑器件、分立门或者晶体管逻辑器件、分立硬件组件,可以实现或者执行本申请实施例中的公开的各方法、步骤及逻辑框图。通用处理器可以是微处理器或者任何常规的处理器等。结合本申请实施例所公开的方法的步骤可以直接体现为硬件处理器执行完成,或者用处理器中的硬件及软件模块组合执行完成。
在本申请实施例中,存储器可以是非易失性存储器,比如硬盘(hard disk drive,HDD)或固态硬盘(solid-state drive,SS)等,还可以是易失性存储器(volatile memory),例如随机存取存储器(random-access memory,RAM)。存储器是能够用于携带或存储具有指令或数据结构形式的期望的程序代码并能够由计算机存取的任何其他介质,不限于此。
本申请实施例中的存储器还可以是电路或者其它任意能够实现存储功能的装置,用于存储程序指令和/或数据。本申请各实施例提供的方法中,可以全部或部分地通过软件、硬件、固件或者其任意组合来实现。当使用软件实现时,可以全部或部分地以计算机程序产品的形式实现。所述计算机程序产品包括一个或多个计算机指令。在计算机上加载和执行所述计算机程序指令时,全部或部分地产生按照本申请实施例所述的流程或功能。所述计算机可以是通用计算机、专用计算机、计算机网络、网络设备、用户设备或者其他可编程装置。所述计算机指令可以存储在计算机可读存储介质中,或者从一个计算机可读存储介质向另一个计算机可读存储介质传输,例如,所述计算机指令可以从一个网站站点、计算机、服务器或数据中心通过有线(例如同轴电缆、光纤、数字用户线(digital subscriber line,DSL)或无线(例如红外、无线、微波等)方式向另一个网站站点、计算机、服务器或数据中心进行传输。所述计算机可读存储介质可以是计算机可以存取的任何可用介质或者是包含一个或多个可用介质集成的服务器、数据中心等数据存储设备。所述可用介质可以是磁性介质(例如,软盘、硬盘、磁带)、光介质(例如,数字视频光盘(digital video disc,DWD)、或者半导体介质(例如,SSD)等。
本申请实施例提供一种计算机程序产品,当所述计算机程序产品在电子设备运行时,使得所述电子设备执行上述方法实施例中的技术方案,其实现原理和技术效果与上述相关实施例类似,此处不再赘述。
本申请实施例提供一种计算机可读存储介质,其上存储有程序指令,所述程序指令被电子设备执行时,使得所述电子设备执行上述实施例的技术方案。其实现原理和技术效果与上述相关实施例类似,此处不再赘述。
综上所述,以上实施例仅用以说明本申请的技术方案,而非对其限制;尽管参照前述实施例对本申请进行了详细的说明,本领域的普通技术人员应当理解:其依然可以对前述各实施例所记载的技术方案进行修改,或者对其中部分技术特征进行等同替换;而这些修改或者替换,并不使相应技术方案的本质脱离本申请各实施例技术方案的范围。

Claims (17)

  1. 一种确定墨水屏的刷新模式的方法,其特征在于,包括:
    确定应用程序的待显示页面中第一显示单元的内容类型和显示区域;所述第一显示单元为非网页控件或者网页控件中的网页元素;
    根据所述第一显示单元的内容类型设置所述第一显示单元的显示区域对应的刷新模式;所述刷新模式用于所述墨水屏显示所述待显示页面中所述第一显示单元的显示区域。
  2. 根据权利要求1所述的方法,其特征在于,所述确定应用程序的待显示页面中第一显示单元的内容类型和显示区域,包括:
    在对所述待显示页面进行布局处理时,确定所述第一显示单元的内容类型和显示区域。
  3. 根据权利要求2所述的方法,其特征在于,所述待显示页面包括非网页控件,所述第一显示单元为非网页控件,所述确定所述第一显示单元的内容类型和显示区域,包括:
    识别布局所述待显示页面时使用的至少一个非网页控件,所述至少一个非网页控件包括所述第一显示单元;
    确定识别出的所述第一显示单元的内容类型和显示区域。
  4. 根据权利要求2所述的方法,其特征在于,所述待显示页面包括网页控件,所述第一显示单元为网页元素,所述确定所述第一显示单元的内容类型和显示区域,包括:
    在浏览器内核中获取所述待显示页面包括的网页控件中的至少一个网页元素,所述至少一个网页元素包括所述第一显示单元;
    根据所述第一显示单元对应的文档对象化模型,确定所述第一显示单元的内容类型和显示区域。
  5. 根据权利要求1-4中任一项所述的方法,其特征在于,所述方法还包括:
    获取事件信息;所述事件信息包括用户操作在所述待显示页面中对应的内容刷新区域和刷新时段,所述用户操作用于触发所述内容刷新区域中的内容在所述刷新时段内刷新显示,所述内容刷新区域包括所述第一显示单元的显示区域;
    若当前时刻处于所述刷新时段内,则根据所述刷新显示的方式确定所述第一显示单元的显示区域对应的刷新模式。
  6. 根据权利要求5所述的方法,其特征在于,所述刷新显示的方式包括下列中的任意一项:滑动显示、滚动显示、翻页显示、缩小显示或放大显示。
  7. 根据权利要求1-4中任一项所述的方法,其特征在于,所述待显示页面中还包括第二显示单元,所述第一显示单元和所述第二显示单元的内容类型相同,且所述第一显示单元的显示区域和所述第二显示区域的显示区域之间没有其他内容类型的显示单元;
    所述根据所述第一显示单元的内容类型设置所述第一显示单元的显示区域对应的刷新模式,包括:
    根据所述第一显示单元的内容类型设置目标区域对应的刷新模式;所述目标区域包括所述第一显示单元的显示区域、所述第二显示单元的显示区域,以及所述第一显示单元和所述第二显示单元之间的显示区域。
  8. 根据权利要求1-4中任一项所述的方法,其特征在于,所述待显示页面中还包括第五显示单元,所述方法还包括:
    获取配置文件;
    若所述配置文件包括所述第五显示单元所属待显示页面的窗口与刷新模式之间的对应关系,则将所述第五显示单元所属窗口对应的刷新模式设置为所述第五显示单元的显示区域对应的刷新模式;
    或者,若所述配置文件包括所述第五显示单元所属的应用程序与刷新模式之间的对应关系,则将所述第五显示单元所属应用程序对应的刷新模式设置为所述第五显示单元的显示区域对应的刷新模式。
  9. 根据权利要求1-8中任一项所述的方法,其特征在于,待显示页面为多个,所述多个待显示页面属于一个或多个应用程序,所述根据所述第一显示单元的内容类型设置所述第一显示单元的显示区域对应的刷新模式,包括:
    获取所述多个待显示页面之间的页面覆盖关系;
    所述第一显示单元为位于最高层的第一待显示页面中的显示单元时,根据所述第一待显示页面中的第一显示单元的内容类型设置所述第一待显示页面中的所述第一显示单元的显示区域对应的刷新模式;
    或者,所述第一显示单元为位于最高层之下的第二待显示页面中的显示单元时,在所述第二待显示页面中的第一显示单元的显示区域中确定与目标待显示页面未重叠的非重叠区域,根据所述第二待显示页面中的所述第一显示单元的内容类型设置所述非重叠区域对应的刷新模式;所述目标待显示页面包括位于所述第二待显示页面上方的所有待显示页面的区域之和。
  10. 根据权利要求1所述的方法,其特征在于,所述确定应用程序的待显示页面中第一显示单元的内容类型和显示区域,包括:
    在对所述待显示页面进行布局处理、绘制处理和图层合成处理之后,获取合成显示数据;
    根据所述合成显示数据确定所述第一显示单元的内容类型和显示区域。
  11. 根据权利要求1-10中任一项所述的方法,其特征在于,所述待显示页面中还包括第三显示单元,所述方法还包括:
    将第三显示单元的预设刷新模式设置为所述第三显示单元的显示区域对应的刷新模式。
  12. 根据权利要求1-11中任一项所述的方法,其特征在于,所述待显示页面中还包括第四显示单元,所述第一显示单元和所述第四显示单元的内容类型不同,所述方法还包括:
    根据所述第四显示单元的内容类型设置所述第四显示单元的显示区域对应的刷新模式。
  13. 根据权利要求1-11中任一项所述的方法,其特征在于,所述方法还包括:
    根据所述第一显示单元的显示区域对应的刷新模式确定是否对所述第一显示单元的显示区域使用抖动算法。
  14. 根据权利要求1-11中任一项所述的方法,其特征在于,所述内容类型包括下列中的任意一项:文本、图片或视频。
  15. 一种电子设备,其特征在于,所述电子设备包括处理器,所述处理器用于与存储器耦合,并读取存储器中的指令并根据所述指令使得所述电子设备执行权利要求1-14中任一项所述的方法。
  16. 一种计算机可读存储介质,其特征在于,所述计算机可读存储介质存储有计算机指令,当所述计算机指令在电子设备上运行时,使得所述电子设备执行如权利要求1-14中任一项所述的方法。
  17. 一种包含指令的计算机程序产品,其特征在于,当所述计算机程序产品在电子设备上运行时,使得所述电子设备执行如权利要求1-14中任一项所述的方法。
PCT/CN2022/128300 2021-11-23 2022-10-28 确定墨水屏的刷新模式的方法、电子设备和存储介质 WO2023093458A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202111398365.0A CN116149765A (zh) 2021-11-23 2021-11-23 确定墨水屏的刷新模式的方法、电子设备和存储介质
CN202111398365.0 2021-11-23

Publications (1)

Publication Number Publication Date
WO2023093458A1 true WO2023093458A1 (zh) 2023-06-01

Family

ID=86356583

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/128300 WO2023093458A1 (zh) 2021-11-23 2022-10-28 确定墨水屏的刷新模式的方法、电子设备和存储介质

Country Status (2)

Country Link
CN (1) CN116149765A (zh)
WO (1) WO2023093458A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117437889A (zh) * 2023-10-20 2024-01-23 广州文石信息科技有限公司 墨水屏的页面滚动显示方法、装置、电子设备和存储介质

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116935808A (zh) * 2023-07-28 2023-10-24 广州文石信息科技有限公司 电子墨水屏的显示方法、装置、设备及可读存储介质

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106023904A (zh) * 2016-05-16 2016-10-12 深圳市博阅科技股份有限公司 基于电子墨水屏的显示控制方法及装置
CN109144440A (zh) * 2018-06-26 2019-01-04 努比亚技术有限公司 一种显示刷新控制方法、终端及计算机可读存储介质
CN109817168A (zh) * 2019-03-29 2019-05-28 联想(北京)有限公司 显示控制方法及设备
CN109961747A (zh) * 2019-04-02 2019-07-02 上海墨案智能科技有限公司 电子墨水屏显示方法、装置及电子设备
CN111179862A (zh) * 2019-12-30 2020-05-19 掌阅科技股份有限公司 显示页面的刷新方法、阅读器及计算机存储介质

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106023904A (zh) * 2016-05-16 2016-10-12 深圳市博阅科技股份有限公司 基于电子墨水屏的显示控制方法及装置
CN109144440A (zh) * 2018-06-26 2019-01-04 努比亚技术有限公司 一种显示刷新控制方法、终端及计算机可读存储介质
CN109817168A (zh) * 2019-03-29 2019-05-28 联想(北京)有限公司 显示控制方法及设备
CN109961747A (zh) * 2019-04-02 2019-07-02 上海墨案智能科技有限公司 电子墨水屏显示方法、装置及电子设备
CN111179862A (zh) * 2019-12-30 2020-05-19 掌阅科技股份有限公司 显示页面的刷新方法、阅读器及计算机存储介质

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117437889A (zh) * 2023-10-20 2024-01-23 广州文石信息科技有限公司 墨水屏的页面滚动显示方法、装置、电子设备和存储介质
CN117437889B (zh) * 2023-10-20 2024-04-09 广州文石信息科技有限公司 墨水屏的页面滚动显示方法、装置、电子设备和存储介质

Also Published As

Publication number Publication date
CN116149765A (zh) 2023-05-23

Similar Documents

Publication Publication Date Title
WO2023093458A1 (zh) 确定墨水屏的刷新模式的方法、电子设备和存储介质
US10031712B2 (en) System and method for display mirroring
AU2014223629B2 (en) System and method for virtual displays
US9600595B2 (en) Modification of windows across multiple displays
KR102207106B1 (ko) 사용자 단말 장치 및 그 제어 방법
US20140101535A1 (en) Multi-display apparatus and method of controlling display thereof
US20130139186A1 (en) Application programming interface for providing native and non-native display utility
US10049625B1 (en) Context-based rendering
WO2018120546A1 (zh) 一种图像显示的方法及终端设备
WO2022111569A1 (zh) 页面切换显示方法、装置、存储介质及电子设备
WO2018119575A1 (zh) 一种显示方法及电子设备
CN114648951A (zh) 控制屏幕刷新率动态变化的方法及电子设备
WO2017113624A1 (en) System and method for operating system of mobile device
US11610563B2 (en) Location-based display of pixel history
WO2024007703A1 (zh) 任务显示区的显示方法、窗口的显示方法及电子设备
WO2023093476A1 (zh) 页面处理方法及设备
US10019969B2 (en) Presenting digital images with render-tiles
CN115639936A (zh) 一种转屏控制方法、装置及电子设备
JP7362486B2 (ja) 表示パネル、表示装置、入出力装置、情報処理装置
JP2013205731A (ja) 画像処理装置、画像処理装置の表示制御方法、プログラム及び情報記憶媒体
US20240184443A1 (en) Display control method, electronic device, and readable storage medium
GB2505403A (en) Efficient usage of screen real estate on the electronic device

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22897541

Country of ref document: EP

Kind code of ref document: A1