CN113362775B - Display screen control method and device, electronic equipment and storage medium - Google Patents
Display screen control method and device, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN113362775B CN113362775B CN202110706683.2A CN202110706683A CN113362775B CN 113362775 B CN113362775 B CN 113362775B CN 202110706683 A CN202110706683 A CN 202110706683A CN 113362775 B CN113362775 B CN 113362775B
- Authority
- CN
- China
- Prior art keywords
- display screen
- target user
- display
- reducing
- frame rate
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 51
- 230000003068 static effect Effects 0.000 claims abstract description 14
- 210000001747 pupil Anatomy 0.000 claims description 24
- 230000015654 memory Effects 0.000 claims description 20
- 238000013507 mapping Methods 0.000 claims description 10
- 230000000694 effects Effects 0.000 abstract description 11
- 238000001514 detection method Methods 0.000 abstract description 9
- 239000002609 medium Substances 0.000 description 13
- 239000011521 glass Substances 0.000 description 12
- 238000007726 management method Methods 0.000 description 12
- 230000008569 process Effects 0.000 description 6
- 238000004422 calculation algorithm Methods 0.000 description 5
- 230000006870 function Effects 0.000 description 5
- 230000003247 decreasing effect Effects 0.000 description 4
- 230000007613 environmental effect Effects 0.000 description 4
- 238000004891 communication Methods 0.000 description 3
- 238000010586 diagram Methods 0.000 description 3
- 230000009286 beneficial effect Effects 0.000 description 2
- 230000008859 change Effects 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 238000001028 reflection method Methods 0.000 description 2
- 239000002699 waste material Substances 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000004590 computer program Methods 0.000 description 1
- 238000013527 convolutional neural network Methods 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 238000013135 deep learning Methods 0.000 description 1
- 238000000605 extraction Methods 0.000 description 1
- 230000005484 gravity Effects 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 239000012120 mounting media Substances 0.000 description 1
- 230000008707 rearrangement Effects 0.000 description 1
- 230000011514 reflex Effects 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
- G09G3/20—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
- G09G3/34—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters by control of light from an independent source
- G09G3/3406—Control of illumination source
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/013—Eye tracking input arrangements
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2320/00—Control of display operating conditions
- G09G2320/06—Adjustment of display parameters
- G09G2320/0626—Adjustment of display parameters for control of overall brightness
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2330/00—Aspects of power supply; Aspects of display protection and defect management
- G09G2330/02—Details of power systems and of start or stop of display operation
- G09G2330/021—Power management, e.g. power saving
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Computer Hardware Design (AREA)
- Controls And Circuits For Display Device (AREA)
Abstract
The embodiment of the application discloses a display screen control method and device, electronic equipment and a storage medium. According to the technical scheme provided by the embodiment of the application, when the display screen is in a bright screen state, the eye image of the target user is acquired in real time in the appointed shooting range, and the eye fixation position of the target user is determined based on the eye image; determining that a target user does not watch the display screen for a first set time period according to the eye watching position, and reducing the backlight brightness of the display screen; and judging whether the display picture of the display screen is in a static state, and if so, reducing the display frame rate of the display screen. By adopting the technical means, the brightness and the display frame rate of the display screen can be adaptively adjusted according to the detection result that a user does not watch the display screen, so that the power consumption of the display screen is reduced, the cruising ability of the intelligent terminal is improved, and a better power consumption management effect is realized.
Description
Technical Field
The embodiment of the application relates to the technical field of intelligent terminals, in particular to a display screen control method and device, electronic equipment and a storage medium.
Background
Along with the updating iteration of the intelligent terminal equipment, more and more attention is paid to the power consumption management of the display screen of the intelligent terminal equipment. At present, the common power consumption management modes of a display screen mainly include: 1. detecting environmental factors (such as environmental light brightness), and automatically reducing the brightness of the display screen according to the environmental factors; 2. whether the intelligent terminal is not operated for a long time or not is detected, and then the brightness of the display screen is automatically reduced or the refreshing frequency of the display screen is reduced. The power consumption of the display screen is reduced by managing the power consumption of the display screen when the display screen is in a non-working state.
However, for the situation that the display screen is in the working state and the user is not used, the backlight of the display screen still keeps the high-brightness state for a period of time, so that the power consumption of the display screen is undoubtedly increased, and the cruising ability of the intelligent terminal is influenced.
Disclosure of Invention
The embodiment of the application provides a display screen control method and device, electronic equipment and a storage medium, which can manage power consumption of a display screen, reduce power consumption of the display screen and solve the problem of power consumption waste of the display screen.
In a first aspect, an embodiment of the present application provides a display screen control method, including:
when the display screen is in a bright screen state, acquiring a human eye image of a target user in real time in a specified shooting range, and determining the eye fixation position of the target user based on the human eye image;
determining that the target user does not watch the display screen for a first set time period according to the eye watching position, and reducing the backlight brightness of the display screen;
and judging whether the display picture of the display screen is in a static state, if so, reducing the display frame rate of the display screen.
Further, reducing the backlight brightness of the display screen comprises:
and reducing the backlight brightness of the display screen to a set value, or gradually reducing the backlight brightness of the display screen according to the time length when the target user does not watch the display screen.
Further, reducing the display frame rate of the display screen includes:
and reducing the display frame rate of the display screen to a minimum value, or gradually reducing the display frame rate of the display screen according to the duration that the target user does not watch the display screen.
Further, acquiring a human eye image of a target user in real time in a specified shooting range, and determining an eye fixation position of the target user based on the human eye image, including:
acquiring a human eye image of a target user in real time through an infrared camera within a specified shooting range, wherein the pupil of the human eye image has a light spot;
determining pupil center coordinates and light spot center coordinates from the human eye image;
and determining corresponding fixation point coordinates based on the pre-constructed mapping relation among the pupil center coordinates, the light spot center coordinates and the fixation point coordinates, and taking the fixation point coordinates as the eye fixation position.
Further, the method for acquiring the human eye image of the target user in real time through the infrared camera in the appointed shooting range comprises the following steps:
and detecting eyes of a target user in real time in a specified shooting range through an infrared camera, and intercepting a corresponding eye image.
Further, after reducing the display frame rate of the display screen, the method further includes:
and when the target user is detected to watch the display screen within a second set period, restoring the backlight brightness and the display frame rate of the display screen to initial values.
Further, after the display frame rate of the display screen is reduced, the method further includes:
and determining that the target user does not watch the display screen for a third set time period, and controlling the display screen to be in a screen-off state, wherein the third set time period is longer than the first set time period.
In a second aspect, an embodiment of the present application provides a display screen control apparatus, including:
the acquisition module is used for acquiring a human eye image of a target user in a specified shooting range in real time when the display screen is in a bright screen state, and determining the eye fixation position of the target user based on the human eye image;
the backlight adjusting module is used for determining that the target user does not watch the display screen for a first set time period according to the eye watching position and reducing the backlight brightness of the display screen;
and the frame rate adjusting module is used for judging whether a display picture of the display screen is in a static state or not, and if so, reducing the display frame rate of the display screen.
In a third aspect, an embodiment of the present application provides an electronic device, including:
a memory and one or more processors;
the memory for storing one or more programs;
when the one or more programs are executed by the one or more processors, the one or more processors are caused to implement the display screen control method according to the first aspect.
In a fourth aspect, embodiments of the present application provide a storage medium containing computer-executable instructions for performing the display screen control method according to the first aspect when executed by a computer processor.
According to the method and the device, when the display screen is in a bright screen state, the eye images of the target user are obtained in a specified shooting range in real time, and the eye gaze position of the target user is determined based on the eye images; determining that a target user does not watch the display screen for a first set time period according to the eye watching position, and reducing the backlight brightness of the display screen; and judging whether a display picture of the display screen is in a static state, and if so, reducing the display frame rate of the display screen. By adopting the technical means, the brightness and the display frame rate of the display screen can be adaptively adjusted according to the detection result that a user does not watch the display screen, so that the power consumption of the display screen is reduced, the cruising ability of the intelligent terminal is improved, and a better power consumption management effect is realized.
Drawings
Fig. 1 is a flowchart of a display screen control method according to an embodiment of the present application;
FIG. 2 is a flowchart of glasses fixation position determination in the first embodiment of the present application;
FIG. 3 is a flowchart illustrating power consumption management of a display screen according to a first embodiment of the present application;
fig. 4 is a schematic structural diagram of a display screen control device according to a second embodiment of the present application;
fig. 5 is a schematic structural diagram of an electronic device according to a third embodiment of the present application.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application more apparent, specific embodiments of the present application will be described in detail with reference to the accompanying drawings. It is to be understood that the specific embodiments described herein are merely illustrative of the application and are not limiting of the application. It should be further noted that, for the convenience of description, only some but not all of the relevant portions of the present application are shown in the drawings. Before discussing exemplary embodiments in more detail, it should be noted that some exemplary embodiments are described as processes or methods depicted as flowcharts. Although a flowchart may describe the operations (or steps) as a sequential process, many of the operations can be performed in parallel, concurrently, or simultaneously. In addition, the order of the operations may be re-arranged. The process may be terminated when its operations are completed, but may have additional steps not included in the figure. The processes may correspond to methods, functions, procedures, subroutines, and the like.
The application provides a display screen control method, which aims to determine the glasses watching position of a target user when a display screen is in a bright screen state, and when the target user is determined not to watch the display screen according to the glasses watching position, power consumption management of the current display screen is performed, and backlight brightness and display frame rate of the display screen are adjusted, so that power consumption of the display screen is reduced, and cruising ability of an intelligent terminal is improved. Compared with the traditional display screen control method, when the display screen is controlled, the brightness of the display screen is generally automatically reduced according to environmental factors, or whether the intelligent terminal is not operated for a long time is measured, so that the brightness of the display screen is automatically reduced or the refresh frequency of the display screen is reduced. Because when the detection terminal is operated for a long time and then the power consumption of the display screen is managed, a buffer period of a period of time is generated, and because a user uses the intelligent terminal for operation, the power consumption of the operation equipment is still wasted. Therefore, the display screen control method provided by the embodiment of the application is provided to solve the problem of power consumption waste of the existing display screen.
The first embodiment is as follows:
fig. 1 is a flowchart of a display screen control method according to an embodiment of the present disclosure, where the display screen control method provided in this embodiment may be executed by a display screen control device, the display screen control device may be implemented in a software and/or hardware manner, and the display screen control device may be formed by two or more physical entities or may be formed by one physical entity. Generally, the display screen control device may be an intelligent terminal device such as a mobile phone, a tablet or a computer.
The following description will be given taking the display control apparatus as an example of a main body that performs the display control method. Referring to fig. 1, the display screen control method specifically includes:
s110, when the display screen is in a bright screen state, acquiring a human eye image of the target user in a specified shooting range in real time, and determining the eye fixation position of the target user based on the human eye image.
According to the method, whether the glasses of the target user watch the display screen is detected, and when the time that the target user does not watch the display screen is detected to reach the set duration (such as 1 s), power consumption management of the current display screen is carried out, so that the display screen control method is achieved.
Specifically, in the using process of the display screen control device, the running state of the display screen is detected in real time, and whether the display screen is in a bright screen state or a dead screen state is determined. And when the display screen is detected to be in a bright screen state, starting to detect whether the user gazes at the display screen. And detecting the target user in the appointed shooting range through a front camera of the display screen control equipment, and further acquiring the human eye image of the target user. Note that, in order to ensure detection of the user in front of the display screen, the display screen control apparatus sets a shooting range of the front camera, that is, the designated shooting range. And regarding people outside the designated shooting range, the people are not considered to be in the area facing the display screen currently, and the front-facing camera does not detect the people. Further, when a target user is detected, a target detection model based on a convolutional neural network is adopted to detect the face in the appointed shooting range, the detected face is taken as the target user, the face image of the target user is extracted, the eye position of the face image is further detected, the corresponding eye image is intercepted from the face image, and the eye watching position of the target user can be identified and detected based on the eye image.
Optionally, referring to fig. 2, the process for determining the glasses fixation position according to the embodiment of the present application includes:
s1101, acquiring a human eye image of a target user in real time through an infrared camera in a specified shooting range, wherein the pupil of the human eye image has a light spot;
s1102, determining pupil center coordinates and light spot center coordinates from the human eye image;
s1103, determining a corresponding fixation point coordinate based on the pre-constructed mapping relation between the pupil center coordinate, the spot center coordinate and the fixation point coordinate, and taking the fixation point coordinate as the eye fixation position.
Illustratively, the display screen control device in the embodiment of the application adopts an infrared camera as a front-facing camera, detects a target user by using the infrared camera or a common optical lens added with an infrared filter, and acquires a human eye image of the target user to obtain a human eye image with a pupil having a light spot. It can be understood that the pupil of the human eye image acquired by the infrared camera contains the light spot, so that the eye fixation position of the target user can be determined according to the pupil and the light spot mapping relation with the eye fixation position of the glasses.
The display screen control equipment detects eyes of a target user in real time through the infrared camera in a specified shooting range and intercepts corresponding eye images. Human eye regions can be extracted from the human face image of the target user by a human eye extraction algorithm or a deep learning method to obtain a human eye image. Determining a point with the largest pixel value change in the human eye image by using a gradient algorithm as a pupil point; dividing a pupil area by taking the pupil point as a center; an OTSU algorithm is applied to the pupil area to generate a pupil image. Further, carrying out negation processing on the human eye image to generate a human eye region image after negation; determining the point with the maximum pixel value change in the inverted human eye image by using a gradient algorithm as a light spot; dividing a light spot area by taking the light spot point as a center; and sequentially utilizing an OTSU algorithm to the light spot area to generate a light spot image.
Further, the center coordinates of the pupil and the center coordinates of the light spot are respectively solved by using a gravity center method. Wherein, the pupil center coordinate formula is:
wherein (x) a ，y a ) Is the central coordinate of the pupil, x n 、y n Respective pixel value is I n Abscissa and ordinate of (I) n And (4) representing pixel points in the pupil area, wherein n is the number of the pixel points.
Similarly, the center coordinates of the light spot are calculated, and the calculation formula of the center coordinates of the light spot is as follows:
wherein (x) b ，y b ) As spot center coordinate, x n ′、y n ' respective pixel value is I n Abscissa and ordinate of `, I n 'indicating the pixel points of the spot area, and n' is the number of the pixel points.
Further, a mapping relation between the central coordinates of the pupil and the light spot and the fixation point is established, and the mapping relation between the central coordinates of the pupil and the light spot and the fixation point is established by utilizing a pupil-cornea vector reflection method. First, the P-CR vector between the center coordinates of the pupil and the center coordinates of the spot is calculated:
wherein (x) a ，y a ) Is the center coordinate of the pupil, (x) b ，y b ) As spot center coordinates, (x) c ，y c ) Is the P-CR (Pupil Corneal Reflex) vector.
Then, a six-parameter pupil-cornea vector reflection method is utilized to establish a mapping relation between the fixation point and the P-CR vector as follows:
X＝a 0 +a 1 x c +a 2 y c +a 3 x c 2 +a 4 x c y c +a 5 y c 2
Y＝b 0 +b 1 x c +b 2 y c +b 3 x c 2 +b 4 x c y c +b 5 y c 2
wherein (X, Y) is the coordinate of the fixation point on the calibration plane, a 0 -a 5 ,b 0 -b 5 Respectively the abscissa and ordinate of the corresponding index point. And calibrating the coordinates of the known points on the display screen, so that the mapping relation between the central coordinates of the pupil and the facula and the fixation point can be determined. Further according to the central coordinates of the pupil and the faculaAnd inputting the pupil center coordinate and the facula center coordinate into the mapping relation formula to obtain the current fixation point coordinate of the eyes of the target user, and taking the fixation point coordinate as the eye fixation position of the target user.
In one embodiment, for the determination of the glasses fixation position of the target user, a face model can be obtained by performing face detection on a face image of the target user when the target user watches the display screen. And determining the current positions of the centers of the pupils of the two eyes according to the human face model. And acquiring binocular sight parameters according to the calibrated face image when the user watches the calibrated point on the display screen. And calculating the current position of the fixation point of the two-eye sight according to the parameters of the two-eye sight and the current position of the center of the two-eye pupil. And fusing the current positions of the gaze fixation points of the two eyes to obtain gaze point positions of the two eyes on the display screen, and taking the gaze point positions as eye fixation positions of the target user. There are many ways to identify and locate the eye gaze position of the target user, and this is not fixedly limited in the embodiments of the present application, which is not described herein repeatedly.
S120, determining that the target user does not watch the display screen for a first set time period according to the eye watching position, and reducing the backlight brightness of the display screen.
S130, judging whether the display picture of the display screen is in a static state, and if so, reducing the display frame rate of the display screen.
Further, based on the eye gaze position of the target user determined in step S110, the embodiment of the present application correspondingly determines whether the eye gaze position of the target user is on the display screen. Specifically, a coordinate area corresponding to the display screen is determined according to the plane where the display screen is located, and whether the glasses watching position of the target user falls into the coordinate area of the display screen is judged, so that whether the target user watches the display screen at the current moment is determined.
Referring to fig. 3, a flowchart of power consumption management of a display screen according to an embodiment of the present application is provided. After the display screen control device detects that the display screen is lighted, the glasses fixation position of the target user is detected through the step S110, and whether the glasses of the target user are fixed on the display screen is judged according to the eye fixation position. And when the glasses watching position of the target user does not fall into the coordinate area of the display screen, the current glasses of the target user are not watched on the display screen. When detecting that the target user does not watch the display screen, the display screen control device starts timing, and when determining that the time that the target user does not watch the display screen reaches a first set time period (such as 2S), in order to reduce the power consumption of the display screen, the backlight brightness of the display screen is controlled and adjusted at the moment, so that the backlight brightness of the display screen is reduced.
Optionally, when the backlight brightness of the display screen is adjusted, the backlight brightness of the display screen is gradually reduced by reducing the backlight brightness of the display screen to a set value, or according to a time length during which the target user does not watch the display screen. According to the actual display requirement, the display screen control device can directly adjust the backlight brightness of the display screen to the set backlight brightness value so as to reduce the power consumption of the current display screen. And the problem that when the target user gazes the display screen again, a short-time large display fall occurs in the backlight brightness of the display screen, and the watching experience of the user is influenced is avoided. The display screen control device may gradually turn down the backlight brightness of the display screen following the duration when the target user is not gazing at the display screen. For example, as the duration that the target user is not gazing at the display screen, the backlight brightness value of a set unit is decreased every second increase until the display screen backlight brightness reaches a specified threshold. Therefore, the effect of gradually reducing the backlight brightness of the display screen can be provided, the situation of large display fall when the user gazes the display screen again is avoided, and the watching experience of the user is optimized.
In addition, after determining that the eyes of the target user do not watch the display screen for the first set time period and reducing the brightness of the display screen, the embodiment of the application further determines whether the current display screen is in a static state, and if the display screen is not in the static state, the display frame rate of the display screen is kept to continue working. If the display screen is in a static state, in order to further save the power consumption of the display screen, the display screen control device controls the display screen to reduce the display frame rate so as to achieve a better power consumption management effect.
Optionally, when the display frame rate of the display screen is adjusted, the display frame rate of the display screen is gradually decreased by decreasing the display frame rate of the display screen to a minimum value, or according to a duration that the target user does not watch the display screen. According to the actual display requirement, the display screen control equipment can directly adjust the display frame rate of the display screen to the lowest display frame rate value so as to reduce the power consumption of the current display screen and optimize the cruising ability of the display screen control equipment to the maximum extent. And the problem that the watching experience of the user is influenced due to the fact that a short-time large display fall appears in the display frame rate of the display screen when the target user gazes the display screen again is avoided. The display screen control device may gradually decrease the display frame rate of the display screen following the duration that the target user is not gazing at the display screen. For example, as the target user does not look at the display screen for a period of time, the display frame rate value of the set unit is decreased every second increase until the display frame rate of the display screen reaches the lowest display frame rate value. Therefore, the effect of gradually reducing the display frame rate of the display screen can be provided, the situation of large display fall when the user gazes the display screen again is avoided, and the watching experience of the user is optimized.
Optionally, in the embodiment of the application, when it is detected that the target user gazes at the display screen within a second set period, the backlight brightness and the display frame rate of the display screen are restored to initial values. It can be understood that, after the display screen control device reduces the backlight brightness and the display frame rate of the display screen, and when it is detected that the target user gazes the display screen again within a second set time period (for example, within 30 s), in order to optimize the viewing experience of the target user, the backlight brightness and the display frame rate of the display screen need to be restored to initial values at this time, so as to provide the same display effect when the previous user gazes the display screen, and avoid that the user gazes the display screen twice before and after, and the display effect of the display screen has a great difference.
In one embodiment, the display screen control device further controls the display screen to be in a screen-off state by determining that the target user does not watch the display screen for a third set time period, where the third set time period is longer than the first set time period. It can be understood that, in general, when the user does not look at the display screen for a long time, indicating that the current user does not tend to use the display screen, in order to save the power consumption of the display screen to the maximum extent, by setting the third set time period (e.g. 30 s), when the target user does not look at the display screen for the third set time period, the display screen is controlled to be in the off-screen state. The third set time period is longer than the first set time period, and the third set time period may be equal to the second set time period. For example, if it is detected that the target user gazes the display screen again within 30s, the display brightness and the display frame rate of the display screen are returned to the initial values, and if it is not detected that the target user gazes the display screen again within 30s, it indicates that the current user does not use the display screen, and the display screen is controlled to be in the screen-off state. The power consumption management of the display screen is carried out through different using states of corresponding users, so that a better power consumption management effect of the display screen is achieved.
In one embodiment, the display control apparatus further generates history data by counting different use states of the user's gazing display and non-gazing display, and adaptively adjusts the value of the first set period based on the history data. It can be understood that, according to the usage habit of the user, if the user often switches between different states of watching the display screen and not watching the display screen within a short time (for example, the switching state reaches a set number of times in a set time period), the first set time period needs to be lengthened to provide a better control effect of the display screen.
When the display screen is in a bright screen state, the eye image of the target user is acquired in real time in the appointed shooting range, and the eye fixation position of the target user is determined based on the eye image; determining that a target user does not watch the display screen for a first set time period according to the eye watching position, and reducing the backlight brightness of the display screen; and judging whether the display picture of the display screen is in a static state, and if so, reducing the display frame rate of the display screen. By adopting the technical means, the brightness and the display frame rate of the display screen can be adaptively adjusted according to the detection result that the user does not watch the display screen, so that the power consumption of the display screen is reduced, the cruising ability of the intelligent terminal is improved, and a better power consumption management effect is realized.
Example two:
on the basis of the foregoing embodiments, fig. 4 is a schematic structural diagram of a display screen control device according to a second embodiment of the present application. Referring to fig. 4, the display screen control device provided in this embodiment specifically includes: an obtaining module 21, a backlight adjusting module 22 and a frame rate adjusting module 23.
The acquisition module 21 is configured to acquire a human eye image of a target user in a specified shooting range in real time when the display screen is in a bright screen state, and determine an eye fixation position of the target user based on the human eye image;
the backlight adjusting module 22 is configured to determine, according to the eye gaze position, that the target user does not gaze the display screen for a first set time period, and reduce the backlight brightness of the display screen;
the frame rate adjusting module 23 is configured to determine whether a display frame of the display screen is in a static state, and if so, reduce a display frame rate of the display screen.
Specifically, the backlight adjusting module 22 includes:
the first adjusting unit is used for reducing the backlight brightness of the display screen to a set value, or gradually reducing the backlight brightness of the display screen according to the duration that the target user does not watch the display screen.
The frame rate adjusting module 23 includes:
and the second adjusting unit is used for reducing the display frame rate of the display screen to a minimum value, or gradually reducing the display frame rate of the display screen according to the duration that the target user does not watch the display screen.
Specifically, the obtaining module 21 includes:
the device comprises a shooting unit, a processing unit and a control unit, wherein the shooting unit is used for acquiring a human eye image of a target user in real time through an infrared camera in a specified shooting range, and the pupil of the human eye image has light spots;
the first positioning unit is used for determining pupil center coordinates and light spot center coordinates from the human eye image;
and the second positioning unit is used for determining corresponding fixation point coordinates based on the pre-constructed mapping relation among the pupil center coordinates, the facula center coordinates and the fixation point coordinates, and taking the fixation point coordinates as the eye fixation position.
And the detection unit is used for detecting the eyes of the target user in real time in the appointed shooting range through the infrared camera and intercepting the corresponding eye images.
Specifically, the display screen control device further comprises
And the restoring module is used for restoring the backlight brightness and the display frame rate of the display screen to initial values when the target user is detected to watch the display screen within a second set period.
And the screen extinguishing module is used for determining that the target user does not watch the display screen for a third set time period, controlling the display screen to be in a screen extinguishing state, and the third set time period is greater than the first set time period.
When the display screen is in a bright screen state, the eye image of the target user is acquired in real time in the appointed shooting range, and the eye fixation position of the target user is determined based on the eye image; determining that a target user does not watch the display screen for a first set time period according to the eye watching position, and reducing the backlight brightness of the display screen; and judging whether the display picture of the display screen is in a static state, and if so, reducing the display frame rate of the display screen. By adopting the technical means, the brightness and the display frame rate of the display screen can be adaptively adjusted according to the detection result that a user does not watch the display screen, so that the power consumption of the display screen is reduced, the cruising ability of the intelligent terminal is improved, and a better power consumption management effect is realized.
The display screen control device provided by the second embodiment of the present application can be used for executing the display screen control method provided by the first embodiment of the present application, and has corresponding functions and beneficial effects.
Example three:
an embodiment of the present application provides an electronic device, and with reference to fig. 5, the electronic device includes: a processor 31, a memory 32, a communication module 33, an input device 34, and an output device 35. The number of processors in the electronic device may be one or more, and the number of memories in the electronic device may be one or more. The processor, memory, communication module, input device, and output device of the electronic device may be connected by a bus or other means.
The memory 32 is a computer readable storage medium, and can be used for storing software programs, computer executable programs, and modules, such as program instructions/modules corresponding to the display screen control method according to any embodiment of the present application (for example, the obtaining module, the backlight adjusting module, and the frame rate adjusting module in the display screen control device). The memory can mainly comprise a program storage area and a data storage area, wherein the program storage area can store an operating system and an application program required by at least one function; the storage data area may store data created according to use of the device, and the like. Further, the memory may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid state storage device. In some examples, the memory may further include memory located remotely from the processor, and these remote memories may be connected to the device over a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The communication module 33 is used for data transmission.
The processor 31 executes various functional applications and data processing of the device by running software programs, instructions and modules stored in the memory, that is, implements the display screen control method described above.
The input device 34 may be used to receive entered numeric or character information and to generate key signal inputs relating to user settings and function controls of the apparatus. The output device 35 may include a display device such as a display screen.
The electronic device provided by the above can be used to execute the display screen control method provided by the first embodiment, and has corresponding functions and beneficial effects.
Example four:
embodiments of the present application also provide a storage medium containing computer-executable instructions, which when executed by a computer processor, are configured to perform a display screen control method, including: when the display screen is in a bright screen state, acquiring a human eye image of a target user in real time within a specified shooting range, and determining the eye fixation position of the target user based on the human eye image; determining that the target user does not watch the display screen for a first set time period according to the eye watching position, and reducing the backlight brightness of the display screen; and judging whether the display picture of the display screen is in a static state, if so, reducing the display frame rate of the display screen.
Storage medium-any of various types of memory devices or storage devices. The term "storage medium" is intended to include: mounting media such as CD-ROM, floppy disk, or tape devices; computer system memory or random access memory such as DRAM, DDR RAM, SRAM, EDO RAM, lanbas (Rambus) RAM, etc.; non-volatile memory such as flash memory, magnetic media (e.g., hard disk or optical storage); registers or other similar types of memory elements, etc. The storage medium may also include other types of memory or combinations thereof. In addition, the storage medium may be located in a first computer system in which the program is executed, or may be located in a different second computer system connected to the first computer system through a network (such as the internet). The second computer system may provide program instructions to the first computer for execution. The term "storage medium" may include two or more storage media residing in different locations, e.g., in different computer systems connected by a network. The storage medium may store program instructions (e.g., embodied as a computer program) that are executable by one or more processors.
Of course, the storage medium provided in the embodiments of the present application and containing computer-executable instructions is not limited to the display screen control method described above, and may also perform related operations in the display screen control method provided in any embodiments of the present application.
The display screen control device, the storage medium, and the electronic device provided in the foregoing embodiments may execute the display screen control method provided in any embodiment of the present application, and reference may be made to the display screen control method provided in any embodiment of the present application without detailed technical details described in the foregoing embodiments.
The foregoing is considered as illustrative of the preferred embodiments of the invention and the technical principles employed. The present application is not limited to the particular embodiments described herein, but is capable of various obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the invention. Therefore, although the present application has been described in more detail with reference to the above embodiments, the present application is not limited to the above embodiments, and may include other equivalent embodiments without departing from the spirit of the present application, and the scope of the present application is determined by the scope of the claims.
Claims (9)
1. A display screen control method is characterized by comprising the following steps:
when the display screen is in a bright screen state, acquiring a human eye image of a target user in real time in a specified shooting range, and determining the eye fixation position of the target user based on the human eye image;
determining that the target user does not watch the display screen for a first set time period according to the eye watching position, and reducing the backlight brightness of the display screen, wherein the method comprises the following steps: reducing the backlight brightness of the display screen to a set value, or gradually reducing the backlight brightness of the display screen according to the time length when the target user does not watch the display screen;
and further judging whether a display picture of the display screen is in a static state after the backlight brightness of the display screen is reduced, and if so, reducing the display frame rate of the display screen.
2. The display screen control method of claim 1, wherein reducing the display frame rate of the display screen comprises:
and reducing the display frame rate of the display screen to a minimum value, or gradually reducing the display frame rate of the display screen according to the duration that the target user does not watch the display screen.
3. The display screen control method of claim 1, wherein acquiring a human eye image of a target user in real time within a specified shooting range, and determining an eye gaze position of the target user based on the human eye image comprises:
acquiring a human eye image of a target user in real time through an infrared camera within a specified shooting range, wherein the pupil of the human eye image has a light spot;
determining pupil center coordinates and light spot center coordinates from the human eye image;
and determining corresponding fixation point coordinates based on the pre-constructed mapping relation among the pupil center coordinates, the light spot center coordinates and the fixation point coordinates, and taking the fixation point coordinates as the eye fixation position.
4. The display screen control method of claim 3, wherein the acquiring of the image of the human eye of the target user in real time by the infrared camera within the designated shooting range comprises:
and detecting eyes of a target user in real time in the appointed shooting range through an infrared camera, and intercepting corresponding eye images.
5. The display screen control method according to claim 1, further comprising, after reducing the display frame rate of the display screen:
and when the target user is detected to watch the display screen within a second set period, restoring the backlight brightness and the display frame rate of the display screen to initial values.
6. The display screen control method according to claim 1, further comprising, after reducing the display frame rate of the display screen:
and determining that the target user does not watch the display screen for a third set time period, and controlling the display screen to be in a screen-off state, wherein the third set time period is greater than the first set time period.
7. A display screen control apparatus, comprising:
the acquisition module is used for acquiring a human eye image of a target user in real time within a specified shooting range when the display screen is in a bright screen state, and determining the eye fixation position of the target user based on the human eye image;
the backlight adjusting module is used for determining that the target user does not watch the display screen for a first set time period according to the eye watching position and reducing the backlight brightness of the display screen;
the backlight adjusting module comprises a first adjusting unit, and the first adjusting unit is used for reducing the backlight brightness of the display screen to a set value, or gradually reducing the backlight brightness of the display screen according to the duration that the target user does not watch the display screen;
the frame rate adjusting module is used for reducing the backlight brightness of the display screen to a set value, or gradually reducing the backlight brightness of the display screen according to the duration that the target user does not watch the display screen, and after the backlight brightness of the display screen is reduced, the frame rate adjusting module is used for judging whether a display picture of the display screen is in a static state, and if so, reducing the display frame rate of the display screen.
8. An electronic device, comprising:
a memory and one or more processors;
the memory for storing one or more programs;
the one or more programs, when executed by the one or more processors, cause the one or more processors to implement the display screen control method of any of claims 1-6.
9. A storage medium containing computer-executable instructions for performing the display screen control method of any one of claims 1-6 when executed by a computer processor.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110706683.2A CN113362775B (en) | 2021-06-24 | 2021-06-24 | Display screen control method and device, electronic equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110706683.2A CN113362775B (en) | 2021-06-24 | 2021-06-24 | Display screen control method and device, electronic equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113362775A CN113362775A (en) | 2021-09-07 |
| CN113362775B true CN113362775B (en) | 2023-03-21 |
Family
ID=77536136
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110706683.2A Active CN113362775B (en) | 2021-06-24 | 2021-06-24 | Display screen control method and device, electronic equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113362775B (en) |
Families Citing this family (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113723351B (en) * | 2021-09-13 | 2024-07-02 | 中国银行股份有限公司 | Interface optimization method, system, storage medium and electronic equipment |
| CN113903317B (en) * | 2021-10-19 | 2023-06-27 | Oppo广东移动通信有限公司 | Screen brightness adjusting method and device of electronic equipment and electronic equipment |
| CN113885708A (en) * | 2021-10-22 | 2022-01-04 | Oppo广东移动通信有限公司 | Screen control method and device of electronic equipment, electronic equipment and storage medium |
| CN114655132A (en) * | 2022-03-31 | 2022-06-24 | 东风汽车集团股份有限公司 | Automatic regulating system and method for passenger side entertainment audio-visual display screen |
| CN115547264A (en) * | 2022-11-07 | 2022-12-30 | 北京显芯科技有限公司 | Backlight dimming method and system based on human eye tracking |
| CN116451338A (en) * | 2023-02-10 | 2023-07-18 | 重庆蓝鲸智联科技有限公司 | MCU-based integrated architecture design method |
| CN116204059B (en) * | 2023-04-28 | 2023-09-26 | 荣耀终端有限公司 | Frame rate adjustment method and device for eye movement tracking |
| CN116795212B (en) * | 2023-06-19 | 2024-03-01 | 深圳市晚成辉电子有限公司 | Control method of plasma display screen |
Family Cites Families (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TW200729112A (en) * | 2006-01-18 | 2007-08-01 | Gigno Technology Co Ltd | Video display driving method of LCD |
| CN103500061B (en) * | 2013-09-26 | 2017-11-07 | 三星电子（中国）研发中心 | Control the method and apparatus of display |
| CN106686257B (en) * | 2017-03-10 | 2019-07-16 | Oppo广东移动通信有限公司 | A kind of control method of mobile terminal, device and mobile terminal |
| CN107729871A (en) * | 2017-11-02 | 2018-02-23 | 北方工业大学 | Infrared light-based human eye movement track tracking method and device |
| CN110113665A (en) * | 2019-04-25 | 2019-08-09 | 深圳市国华识别科技开发有限公司 | Show equipment autocontrol method, device, computer equipment and storage medium |
| JP7341729B2 (en) * | 2019-05-29 | 2023-09-11 | キヤノン株式会社 | Electronic devices, control methods for electronic devices, programs, storage media |
| US10842430B1 (en) * | 2019-09-12 | 2020-11-24 | Logitech Europe S.A. | Eye fatigue detection using visual imaging |
| CN111737775A (en) * | 2020-06-23 | 2020-10-02 | 广东小天才科技有限公司 | Privacy peep-proof method and intelligent equipment based on user eyeball tracking |
| CN112328068A (en) * | 2020-09-21 | 2021-02-05 | 深圳Tcl新技术有限公司 | Method, device and readable storage medium for reducing power consumption of display device |
| CN112328069A (en) * | 2020-11-26 | 2021-02-05 | 广东小天才科技有限公司 | Power consumption control method and device of liquid crystal display module and electronic equipment |
-
2021
- 2021-06-24 CN CN202110706683.2A patent/CN113362775B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN113362775A (en) | 2021-09-07 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN113362775B (en) | Display screen control method and device, electronic equipment and storage medium | |
| CN110619860B (en) | Screen refresh rate adjusting method and device, storage medium and electronic equipment | |
| CN106445151B (en) | Terminal screen brightness control method and terminal | |
| WO2017032017A1 (en) | Method for controlling screen of user terminal and user terminal | |
| US10255874B2 (en) | Display controlling method and display device | |
| CN108510963B (en) | Screen brightness adjusting method and device, storage medium and intelligent terminal | |
| US20150309568A1 (en) | Electronic apparatus and eye-gaze input method | |
| CN109032351B (en) | Fixation point function determination method, fixation point determination device and terminal equipment | |
| US20190377464A1 (en) | Display method and electronic device | |
| US20170277258A1 (en) | Method for adjusting screen luminance and electronic device | |
| WO2020014275A1 (en) | Electronic devices with display operation based on eye activity | |
| CN111736793B (en) | Screen light adjusting method and device | |
| WO2020063077A1 (en) | Eyeball tracking information processing method and apparatus applied to terminal | |
| CN111045577A (en) | Horizontal and vertical screen switching method, wearable device and device with storage function | |
| CN108874134A (en) | Eyeshield mode treatment method, mobile terminal and computer readable storage medium | |
| CN109658904A (en) | A kind of screen luminance adjustment method and device | |
| WO2023279923A1 (en) | Wearable display apparatus, light transmittance regulation method and apparatus, and device and medium | |
| CN113900616B (en) | Method and device for displaying static picture of electronic ink screen as computer display | |
| CN116795212B (en) | Control method of plasma display screen | |
| US20240000312A1 (en) | System and Method for Monitoring and Responding to Surrounding Context | |
| CN114510183B (en) | Dynamic effect duration management method and electronic equipment | |
| CN113495616A (en) | Terminal display control method, terminal, and computer-readable storage medium | |
| CN110716642A (en) | Method and equipment for adjusting display interface | |
| CN114895790A (en) | Man-machine interaction method and device, electronic equipment and storage medium | |
| CN112203131B (en) | Prompting method and device based on display equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |