CN112860200A

CN112860200A - Display control method, display control device, storage medium and electronic equipment

Info

Publication number: CN112860200A
Application number: CN202110116620.1A
Authority: CN
Inventors: 莫荣斌
Original assignee: Guangzhou Shiyuan Electronics Thecnology Co Ltd; Guangzhou Shirui Electronics Co Ltd
Current assignee: Guangzhou Shiyuan Electronics Thecnology Co Ltd; Guangzhou Shirui Electronics Co Ltd
Priority date: 2021-01-28
Filing date: 2021-01-28
Publication date: 2021-05-28

Abstract

The embodiment of the application discloses a display control method, a display control device, a storage medium and electronic equipment, wherein the method comprises the following steps: controlling each light emitter to emit light detection signals outwards, and controlling each light sensor to collect light sensing signals corresponding to the light detection signals; when the push-pull plate covers the display, the light sensing signal comprises a light signal generated when the light detection signal is reflected by the push-pull plate, the coverage degree of the display by the push-pull plate is determined based on the light sensing signal, and the display is controlled based on the coverage degree. By adopting the embodiment of the application, the intelligence of display control can be improved based on the actual environment.

Description

Display control method, display control device, storage medium and electronic equipment

Technical Field

The present application relates to the field of computer technologies, and in particular, to a display control method and apparatus, a storage medium, and an electronic device.

Background

With the development of information technology, many products in the industries of education equipment, office equipment and the like are being innovated in the direction of informatization and intellectualization. Display devices having picture display and audio playback functions are particularly common.

Common display devices (such as optical touch-control integrated machines, intelligent display blackboards including displays) are generally configured with a push-pull plate and a display, wherein the push-pull plate is generally configured on the upper layer of the display; when the display device is used, a user can push the push-pull plate away so as to enable the display contained in the display device to normally display, and when the use is finished, the user can close the push-pull plate so as to protect the display device and prevent the display device from being damaged.

Disclosure of Invention

The embodiment of the application provides a display control method and device, a storage medium and electronic equipment, which can improve the intelligence of display control based on actual environment. The technical scheme of the embodiment of the application is as follows:

in a first aspect, an embodiment of the present application provides a display control method applied to a display device, where the display device includes a display, a push-pull plate, at least one light emitter and at least one light sensor, where the at least one light emitter and the at least one light sensor are disposed on the display, and the push-pull plate is disposed on an upper layer of the display and is slidable with respect to the display, and the method includes:

controlling each light emitter to emit light detection signals outwards, and controlling each light sensor to collect light sensing signals corresponding to the light detection signals; wherein, when the push-pull plate covers the display, the light-induced signal comprises a light signal generated when the light-detected signal is reflected by the push-pull plate;

determining the coverage degree of the push-pull plate on the display based on the light sensing signal;

and performing display control on the display based on the coverage.

In a second aspect, an embodiment of the present application provides a display control apparatus, including:

the signal control module 11 is configured to control each light emitter to emit a light detection signal to the outside, and control each light sensor to collect a light sensing signal corresponding to the light detection signal; wherein, when the push-pull plate covers the display, the light-induced signal comprises a light signal generated when the light-detected signal is reflected by the push-pull plate;

a coverage determining module 12, configured to determine, based on the light sensing signal, a coverage of the display by the push-pull plate;

and the display control module 13 is used for performing display control on the display based on the coverage.

In a third aspect, embodiments of the present application provide a computer storage medium storing a plurality of instructions adapted to be loaded by a processor and to perform the above-mentioned method steps.

In a fourth aspect, an embodiment of the present application provides an electronic device, which may include: a processor and a memory; wherein the memory stores a computer program adapted to be loaded by the processor and to perform the above-mentioned method steps.

The beneficial effects brought by the technical scheme provided by some embodiments of the application at least comprise:

in one or more embodiments of the present application, the display device controls each light emitter to emit a light detection signal to the outside, and controls each light sensor to collect a light sensing signal corresponding to the light detection signal; wherein, when the push-pull plate covers the display, the light-induced signal comprises a light signal generated when the light-detected signal is reflected by the push-pull plate; and determining the coverage of the push-pull plate on the display based on the light sensing signal, and performing display control on the display based on the determined coverage. The display control can be performed based on the coverage of the push-pull plate on the display by combining with the actual environment, so that the intelligence of the display control is further improved; and the display power consumption of the display device can be saved by combining with the actual environment to carry out display control (such as controlling the display to enter a standby state).

Drawings

In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present application, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.

Fig. 1 is a schematic flowchart of a display control method according to an embodiment of the present disclosure;

fig. 2 is a schematic view of a scene involved in a display control method provided in an embodiment of the present application;

FIG. 3 is a schematic diagram of a light detection scenario involved in display control provided by an embodiment of the present application;

fig. 4 is a schematic flowchart of a display control method according to an embodiment of the present application;

fig. 5 is a schematic structural diagram of a display control apparatus according to an embodiment of the present application;

fig. 6a is a schematic structural diagram of a display control module according to an embodiment of the present disclosure;

FIG. 6b is a schematic structural diagram of a coverage determination module according to an embodiment of the present disclosure;

fig. 7 is a schematic structural diagram of a coverage determining unit provided in an embodiment of the present application;

fig. 8 is a schematic structural diagram of an electronic device according to an embodiment of the present application;

FIG. 9 is a schematic structural diagram of an operating system and a user space provided in an embodiment of the present application;

FIG. 10 is an architectural diagram of the android operating system of FIG. 8;

FIG. 11 is an architectural diagram of the IOS operating system of FIG. 8.

Detailed Description

The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.

In the description of the present application, it is to be understood that the terms "first," "second," and the like are used for descriptive purposes only and are not to be construed as indicating or implying relative importance. In the description of the present application, it is noted that, unless explicitly stated or limited otherwise, "including" and "having" and any variations thereof, are intended to cover non-exclusive inclusions. For example, a process, method, system, article, or apparatus that comprises a list of steps or elements is not limited to only those steps or elements listed, but may alternatively include other steps or elements not listed, or inherent to such process, method, article, or apparatus. The specific meaning of the above terms in the present application can be understood in a specific case by those of ordinary skill in the art. Further, in the description of the present application, "a plurality" means two or more unless otherwise specified. "and/or" describes the association relationship of the associated objects, meaning that there may be three relationships, e.g., a and/or B, which may mean: a exists alone, A and B exist simultaneously, and B exists alone. The character "/" generally indicates that the former and latter associated objects are in an "or" relationship.

The present application will be described in detail with reference to specific examples.

In one embodiment, as shown in fig. 1, a display control method is proposed, which can be implemented by means of a computer program and can be run on a display control device based on the von neumann architecture. The computer program may be integrated into the application or may run as a separate tool-like application.

Specifically, the display control method includes:

step S101: controlling each light emitter to emit light detection signals outwards, and controlling each light sensor to collect light sensing signals corresponding to the light detection signals; wherein, when the push-pull plate covers the display, the light-induced signal comprises a light signal generated when the light-detected signal is reflected by the push-pull plate;

the display device includes a display 102, a push-pull plate 101, at least one light emitter 103, and at least one light sensor 104, wherein the at least one light emitter 103 and the at least one light sensor 104 are disposed on the display 102, and the push-pull plate 101 is disposed on an upper layer of the display 102 and can slide relative to the display 102.

Schematically, as shown in fig. 2, the display device may be configured with a bezel, and the display 102 and the at least one push-pull plate 101 may be configured in the bezel included in the display device; the display 102 may be fixedly mounted in the bezel, and the push-pull plate 101 is slidably disposed in the bezel of the display device and can slide in any configuration direction relative to the display 102, such as in the direction indicated by the arrow in fig. 2. The push-pull plate 101 covers at least a portion of the display 102 during sliding, e.g., to a certain position.

Further, the display device may be applied to teaching, meeting and other scenes, when the display device is used for teaching, the display device including the push-pull plate 101 and the display 102 may be arranged on a wall surface in advance, the push-pull plate 101 may move in the direction of the arrow shown in fig. 2 for writing or drawing, and the display 102 of the display device may be used for displaying multimedia courseware or teaching videos.

The Display 102 is a Display device with a screen Display function, and includes, but is not limited to, touch screens, Liquid Crystal Displays (LCDs), Light-Emitting Diode (LED) displays, and other types of displays.

The light emitter 103 is a device having a light emitting function, and in the embodiment of the present application, the light emitter can be used in cooperation with the light sensor 104 to detect the current state of the push-pull plate, such as whether the display is covered. The light emitter 103 may be a hybrid integrated module or a monolithically integrated component with light emitting function, which is composed of a light source (laser or light emitting diode) and its driving circuit in some embodiments; the light emitter 103 may be a laser emitter, a light emitting diode, an infrared light emitter, or other light emitting devices. In the present application, the light emitter 103 may be independently disposed on the display 102, or may be disposed in the display 102 as a functional component of the display 102, that is, the display 102 includes the light emitter 103 during production. In addition, the number of the light emitters to be disposed and the disposition position on the display 102 are not limited in the present application, and the actual application may be determined in combination with the actual application environment, for example, the light emitters may be disposed on the peripheral side of the display 102.

The light sensors 104 may collect light from an environment where the display is deployed, in this application, at least one of the light sensors 104 is disposed on the display 102, and the light sensors 104 may collect light from the environment where the display is located in real time or periodically during operation, when the light emitters 103 are used cooperatively, the light emitters 103 may emit light according to preset operational emission parameters (such as emission intensity, amplitude-frequency parameters, emission angle, etc.), and in addition, when the push-pull plate slides to a position where the display can be covered, at least a portion of the push-pull plate covers the display.

Further, the method comprises the following steps of; in the present application, due to the relative position relationship between the push-pull plate, the display and the optical transmitter, an optical path corresponding to the optical signal generated when the optical detection signal is reflected by the push-pull plate may pass through the display, for example, the optical sensor may be configured on the display to collect the optical detection signal for the optical detection signal The light sensing signal corresponding to the number can determine the coverage degree of the push-pull plate on the display, such as partial coverage, full coverage and the like.

In actual use, after a user uses a display included in the display device to display, for example, the display device (such as an optical touch all-in-one machine) displays in teaching, a teacher directly closes a blackboard when the display device is not used, and forgets to close the display included in the display device, so that power consumption is caused, and the temperature of internal components of the whole machine is high due to the fact that the whole machine runs in a closed space for a long time, and the service life is influenced. For example, due to the requirements of the practical application environment, the user slides the push-pull plate, and at this time, the push-pull plate partially shields the display image of the display, so that a part of the display image cannot be normally displayed to the viewer of the display, and the like.

In a possible embodiment, a photo-detection trigger condition may be preset, and the photo-detection trigger condition is used to detect the coverage of the display by the push-pull plate when the push-pull plate may slide. Therefore, when the light detection triggering condition is triggered, the light emitters are controlled to emit light detection signals outwards, and the light sensors are controlled to collect light sensing signals corresponding to the light detection signals.

Optionally, the light detection triggering condition may be that a detection period is set, the display device may control each light emitter to emit a light detection signal to the outside every detection period, and the light sensor may be controlled to collect a light sensing signal corresponding to the light detection signal while emitting the light detection signal.

Alternatively, the light detection trigger condition may be an identification of a sliding audio signal generated when the push-pull plate slides, wherein the sliding audio signal is uniquely distinguishable from the ambient sound, thereby uniquely indicating that the push-pull plate is determined (operated by the user) to slide when the sliding audio signal is detected. In practical application, a sound signal generated when the push-pull plate slides can be collected, an acoustic analysis means is adopted to determine a sliding audio signal of the push-pull plate of the display device when the push-pull plate slides, an environmental sound signal of the environment where the display device is located can be collected through an acoustic collection device in the using process of the display device, the environmental sound signal is subjected to acoustic matching with the sliding audio signal, the acoustic similarity between the environmental sound signal and the sliding audio signal can be calculated, and whether the sliding audio signal generated when the push-pull plate slides is identified or not is determined based on the acoustic similarity.

Optionally, the light detection trigger condition may be to identify the acoustic signal of the marker in the marker scene based on the actual application environment, in general, in the marker scene such as a display ending scene, a scene using a push-pull plate (a function using a push-pull plate (e.g. a writing function) may be considered to cause coverage on the display), and there may be a case where the push-pull plate causes coverage on the display, for example, in the display ending scene, a teacher may end teaching using a display device, a conference participant may end a conference using a display device, and at this time, a first acoustic library in the display ending scene may be preset, and the first acoustic library may store the pre-collected acoustic signal of the marker, such as an acoustic signal of ending teaching (a class acoustics, an acoustic signal of playing a school, an acoustic signal of ending a conference, and the like), and during the use of the display device, the environmental acoustic signal of the environment where the marker is located may be collected by the, and performing acoustic matching on the environment sound signal and the tag acoustic signal in the first acoustic library, determining whether the current environment sound signal is the signal in the first acoustic library based on the acoustic similarity with the acoustic similarity of the acoustic tag signal, and if so, meeting the optical detection triggering condition.

Optionally, the light detection triggering condition may be based on monitoring of temperature and humidity parameters of the current environment, the temperature and humidity parameters of the current environment may fluctuate if the push-pull plate covers the display, a parameter fluctuation threshold may be preset, the fluctuation value is compared with the parameter fluctuation threshold by detecting the fluctuation value of the temperature and humidity parameters at the fluctuation moment, and when the fluctuation value is greater than the parameter fluctuation threshold, the light detection condition is determined to be satisfied.

Step S102: and determining the coverage of the push-pull plate on the display based on the light sensing signal.

The coverage is used to characterize the degree of coverage of the display by the push-pull plate when the display is covered by the push-pull plate, for example, the coverage may be in percentage form.

Specifically, the display device may control each light sensor to collect a light sensing signal corresponding to the light detection signal, and may determine a signal characteristic of each light sensing new number, and since a plurality of light sensors may be disposed on the display in practical applications, a difference between signal characteristics corresponding to a plurality of light sensing signals is associated with "coverage of the push-pull plate on the display", it may be understood that, in a coverage area of the display, which is covered by the push-pull plate, a certain difference exists between a signal characteristic collected by the light sensor below the coverage area and a signal characteristic collected by the light sensor outside the coverage area, and in this application, the coverage may be determined by analyzing and processing the difference. Wherein the signal characteristics can be signal strength, signal receiving power, amplitude-frequency characteristics of the signal, and the like

Taking the signal intensity as an example (the signal receiving powers are also similar, and only the reference parameters are different), in a covered area where the push-pull plate covers the display, the covered area can reflect the optical detection signal due to the reflection effect of the push-pull plate and the optical detection signal, and generate a corresponding reflected signal to be reflected onto the display, the signal intensity of at least one optical sensor, which is usually located on the display and in the covered area, is usually higher than the signal intensity of the optical sensing signal collected by each optical sensor in the uncovered area. In the present application, the signal intensity processing may be performed on the photo-sensing signals collected by each photo-sensor on the display:

one processing method may be to calculate a difference value between the signal intensities of the light sensing signals collected by every two light sensors from the signal intensities corresponding to the light sensing signals collected by all the light sensors, and further determine two target light sensors indicated by the maximum signal intensity difference value, and based on the positions of the two target light sensors disposed on the display, the coverage of the push-pull plate on the display may be determined. In practical applications, the position of the "reference target light sensor" may be determined based on the signal intensities of the two target light sensors, with the target light sensor indicated by the maximum signal intensity as a reference;

one processing method may be to determine an average value of signal intensities from signal intensities corresponding to light sensing signals collected by all the light sensors, and then determine a plurality of target light sensors whose collected signal intensities are greater than the average value of signal intensities, where the "plurality of target light sensors" are disposed on the display, to feed back the coverage of the display, where the "plurality of target light sensors" are disposed on the display, and if the "a" areas are determined to be all distributed on the display based on the "plurality of target light sensors" disposed on the display, the "a" areas may be taken as the coverage based on a ratio of an area of the a "area to a total area.

Optionally, in order to reduce the amount of calculation of the display device and reduce the power consumption of the coverage calculation, the operating parameters of the light emitter are configured to operate according to preset operating parameters, in a possible embodiment, the light emitter and the light receiver are configured in pairs, a pair of the light emitter and the light receiver can be in the same plane a, the light detection signal emitted by the light emitter is emitted along a plane B perpendicular to the plane a, and the light detection signal can generally propagate along a reflection optical path in the case of generating a reflection effect with the push-pull plate, and the light receiver is configured on the reflection optical path. Fig. 3 is a schematic view of a light detection scene according to the present application, where the at least one light emitter and the at least one light sensor are disposed in pairs on the display, and the light emitter 103 and the light sensor 104 in fig. 3 are disposed in pairs on the same plane, and the light path of the light detection signal emitted by the light emitter 103 is perpendicular to the plane, and the light sensor 104 is located on the reflected light path of the "light detection signal generated by the light detection signal under the reflection effect with the push-pull plate", and further, the light sensing signal collected by the light sensor may generally include an ambient light signal and a reflected light signal, and when the light sensor is not covered, the light sensor may generally collect only an ambient light signal.

Step S103: and performing display control on the display based on the coverage.

Specifically, after the coverage is determined, the display device can perform display control on the display based on the coverage, and the display control in the application aims to perform intelligent display control on the display under the condition that the push-pull plate at least covers the display, so that the effect of reducing the display power consumption of the display by combining with an actual application environment is realized.

In a possible embodiment, the display device may determine an operation mode for the display based on the coverage, where the operation mode includes at least a standby display mode and an operation display mode, and it is understood that in the standby display mode, the display device does not display a screen, and the coverage is usually higher, such as 3/4 blocking the screen of the whole display, and it may be that the user does not turn off the display device in time, such as turning off the display and closing the push-pull plate, after using the display device. In order to save unnecessary power consumption, the display device can be controlled to enter a standby display mode, thereby saving power consumption. Further, when the coverage is small, it may be that the user is using an extended function of the push-pull plate, for example, the push-pull plate may be a blackboard with a writing function, the user may at least partially cover the display during use, and the display may be controlled to continue to be in a working display mode based on an actual usage scene, where the working display mode may be understood as a display device performing a picture display. In actual use, a mapping relation between the reference coverage and at least one working mode can be preset, the working mode corresponding to the display is determined according to the mapping relation, then the display device controls the display to enter the corresponding working mode, and if the working mode standby display mode is determined, the display is controlled to be in the standby display mode, and no picture display is performed. The working display mode may further include a plurality of working display sub-modes, each working display sub-mode corresponds to at least one display function item to be adjusted, and the display function item includes but is not limited to an audio function (such as volume reduction), a display parameter function (such as brightness adjustment and saturation adjustment), and a display screen adjustment function (such as adjustment of a display scale or a display area of a display screen).

Optionally, a first threshold for the coverage may be set, where the first threshold may be understood as a threshold or a critical value for distinguishing a standby display mode from a working display mode, and the first threshold may enable the display device to determine an empirical value by means of mathematical analysis based on a large amount of acquired sample data when the display device leaves a factory, and in a use process of the later display device, a human-computer interaction interface may be provided, and the user defines the setting of the first threshold.

Further, when the coverage is greater than a first threshold, the display device may determine that the display is in a standby display mode, and control the display to enter the standby display mode;

when the coverage is less than or equal to the first threshold, the display device may determine that the display is in a working display mode, and control the display to be in the working display mode.

In a possible embodiment, the display device may perform display area control on the display screen of the display in combination with the coverage degree under the condition that the display is determined to be the working display model, that is, the display screen may be displayed only in the area not covered by the push-pull plate and not in the area covered by the push-pull plate. In practical applications, the display device determines a target display area for generating the coverage based on the coverage, and performs picture adjustment processing (for example, scaling the display picture in an equal scale) on a display picture to be currently output based on a display specification of the target display area, so that the adjusted target display picture can be displayed in the target display area.

Optionally, in order to implement accurate control on the screen display and avoid misoperation of screen adjustment, a second threshold may be preset, where the second threshold is a coverage proximity value or a threshold for adjusting a screen display area on the display, it may be understood that when the coverage is small, the display shielding effect on the display is small, and no screen adjustment is required.

In a specific implementation scenario, after the display device controls the display to enter the standby display mode, the coverage may then be continuously monitored, and when the coverage is less than or equal to a first threshold, the display is then controlled to switch from the standby display mode to the active display mode.

In the embodiment of the application, the display device controls each light emitter to emit a light detection signal to the outside, and controls each light sensor to collect a light sensing signal corresponding to the light detection signal; wherein, when the push-pull plate covers the display, the light-induced signal comprises a light signal generated when the light-detected signal is reflected by the push-pull plate; and determining the coverage of the push-pull plate on the display based on the light sensing signal, and performing display control on the display based on the determined coverage. The display control can be performed based on the coverage of the push-pull plate on the display by combining with the actual environment, so that the intelligence of the display control is further improved; and can combine the actual environment, carry on the display control (such as controlling the display to enter the standby state), can save the display power consumption of the display device; and based on different coverage degrees, different working modes can be determined, and the display control mode is richer.

Referring to fig. 4, fig. 4 is a schematic flowchart illustrating another embodiment of a display control method according to the present application. Specifically, the method comprises the following steps:

step S201: and controlling each light emitter to emit light detection signals outwards, and controlling each light sensor to collect light sensing signals corresponding to the light detection signals.

According to some embodiments, the trigger condition for optical detection may be preset, and the trigger condition for optical detection is used to determine that the push-pull plate may slide, so as to achieve the detection of the coverage of the display by the push-pull plate. Therefore, when the light detection triggering condition is triggered, the light emitters are controlled to emit light detection signals outwards, and the light sensors are controlled to collect light sensing signals corresponding to the light detection signals.

For example, the light detection trigger condition may be to set a detection period, the display device may control each light emitter to emit a light detection signal to the outside every detection period, and the light sensor may be controlled to collect a light sensing signal corresponding to the light detection signal while emitting the light detection signal.

Step S202: and determining the signal intensity of each light induction signal, and determining a target light emitter from each light emitter based on the signal intensity.

The target light emitter may be understood as a light emitter falling into a reference when determining the coverage, and the coverage may be determined based on position configuration information (parameter information such as relative position, relative coordinates when configuring the display) of the target light emitter corresponding to the display.

According to some embodiments, in a covered area of the display covered by the push-pull plate, the covered area may reflect the photo-detection signal due to a reflection effect of the push-pull plate and the photo-detection signal, and generate a corresponding reflection signal to be reflected onto the display, and the signal intensity of the photo-sensing signal collected by at least one photo-sensor generally located on the display and in the covered area is generally higher than the signal intensity of the photo-sensing signal collected by each photo-sensor in the uncovered area. The numerical value change difference of the corresponding signal intensity of the light sensing signal collected by at least one light sensor positioned in the coverage area is small;

specifically, signal division may be performed based on the signal intensity corresponding to each light-sensing signal, to determine a first light-sensing signal with a first signal intensity characteristic belonging to a covered area, and to determine a second light-sensing signal with a second signal intensity characteristic belonging to an uncovered area. Wherein the first signal strength characteristic is greater than the second signal strength characteristic;

in one embodiment, it is assumed that the push-pull plate covers the area a of the display, and the area B of the display other than the area a is not covered. The light sensing signal collected by at least one light sensor covered by the area a is generally higher than the light sensing signal collected by at least one light sensor covered by the area B, so that signal division can be performed on the signal intensity corresponding to each light sensing signal, mathematical analysis and processing are performed to determine the light sensing signal collected by at least one light sensor covered by the area a, that is, the first light sensing signal, and the light sensing signal collected by at least one light sensor covered by the area B, that is, the second light sensing signal; the first signal strength characteristic may be understood as a signal strength parameter of the first light-induced signal, such as a signal strength value; the second signal strength characteristic may be understood as a signal strength parameter of the second light-induced signal, such as a signal strength value; further, the mathematical analysis processing means may be: and calculating an average value of signal intensity based on signal intensities corresponding to the light-induced signals collected by all the light sensors, wherein the light-induced signal when the signal intensity is greater than the average value of the signal intensity is taken as a first light-induced signal, and the light-induced signal when the signal intensity is less than the average value of the signal intensity is taken as a second light-induced signal.

Specifically, after each second light sensing signal is determined, the light emitter receiving the second light sensing signal may be used as a target light emitter.

Step S203: determining a coverage of the push-pull plate relative to the display based on the positional configuration information of the target light emitter relative to the display.

The position configuration information may be understood as a deployment position of the light emitter relative to the display during configuration, where the position configuration information may be characterized in a form of coordinates, a form of relative position, and an absolute position, and may be determined based on an actual application environment, and is not specifically limited herein, and a position of the target light emitter on the display, such as an a coordinate point deployed on the display, may be determined based on the position configuration information.

Specifically, after the target light emitter is determined, the target light emitter may be generally multiple, and based on the configuration information of the positions of the multiple target light emitters relative to the display, that is, the positions of the target light emitters, the coverage area of the push-pull plate for covering the display may be determined, and based on the coverage area and the display area of the display, the coverage of the push-pull plate relative to the display may be determined.

Step S204: determining a first amplitude-frequency characteristic corresponding to each light sensing signal, and determining a second amplitude-frequency characteristic corresponding to the light detection signal emitted by each light emitter, wherein the second amplitude-frequency characteristic is different from a third amplitude-frequency characteristic corresponding to the ambient light.

In the present application, the optical detection signal with specific amplitude-frequency characteristics or amplitude-frequency characteristics can be transmitted by setting the operating parameters of the optical transmitter, so as to distinguish the optical detection signal from the ambient light.

The amplitude-frequency characteristic may be a parameter characterizing the amplitude-frequency characteristic of the optical signal, such as signal frequency, spectrum width, phase, signal amplitude, frequency interval, etc., and the second amplitude-frequency characteristic is not specifically limited in this application, and the purpose of differentiating the optical detection signal from the ambient light may be achieved. Further, if the light sensor collecting the light-induced signal is not covered by the push-pull plate, the light-induced signal may generally only include the ambient light signal.

In this application, the first amplitude-frequency characteristic is used to characterize an amplitude-frequency characteristic corresponding to the optical sensing signal, such as a signal frequency, a spectrum width, a phase, and the like, and the second amplitude-frequency characteristic is used to characterize an amplitude-frequency characteristic corresponding to the optical detection signal, such as a signal frequency, a spectrum width, a phase, and the like. And the third amplitude-frequency characteristic is used for representing the amplitude-frequency characteristics such as signal frequency, spectrum width and phase corresponding to the ambient light signal.

Specifically, after receiving each light sensing signal, the light sensing signal may be subjected to signal measurement processing to determine a first amplitude-frequency characteristic corresponding to the light sensing signal, such as a signal frequency, a frequency spectrum width, a phase, and the like corresponding to the light sensing signal; determining a second amplitude-frequency characteristic corresponding to the optical detection signal when each optical transmitter transmits the optical detection signal, such as determining a signal frequency, a spectrum width, a phase and the like corresponding to the optical detection signal; in addition, the second amplitude-frequency characteristic of the optical detection signal is different from the third amplitude-frequency characteristic of the ambient light, such as different signal frequencies, different spectrum widths, different phases and the like.

Step S205: determining a coverage of the push-pull plate relative to the display based on the first amplitude-frequency characteristic and the second amplitude-frequency characteristic.

In a feasible implementation scenario, a third amplitude-frequency feature corresponding to ambient light of an environment where the light sensor is located may be measured in advance, ambient light filtering processing may be performed on each of the light-induced signals based on the third amplitude-frequency feature, and then a first amplitude-frequency feature corresponding to each of the light-induced signals, that is, a first amplitude-frequency feature that does not include an ambient light portion may be obtained; the ambient light filtering process may be a filter constructed based on a third amplitude-frequency characteristic, and then the filter is used to perform the ambient light filtering process on each of the photo-induced signals.

Then, matching is carried out on the basis that the first amplitude-frequency characteristic corresponding to each light induction signal is sequentially matched with the second amplitude-frequency characteristic of the light detection signal, the matching degree is calculated, a matching threshold value can be preset, when the matching degree is greater than the matching threshold value, matching is determined, and at the moment, a light inductor indicated by the current second amplitude-frequency characteristic can be used as a target light inductor; further, generally, if the number of the light emitters is multiple, the above steps are performed based on second amplitude-frequency features of the light detection signals emitted by the plurality of light emitters, the first amplitude-frequency feature corresponding to each light sensing signal is sequentially matched with the current second amplitude-frequency feature (for example, the second amplitude-frequency feature when the light detection signal sent by the light emitter to be currently matched is determined based on the sequence of the light emitters), the matching is ended, the next second amplitude-frequency feature is obtained by mismatching, and the matching is continued. Until the determination of all the target light sensors is completed, the target light sensors then perform step S203. The coverage of the push-pull plate with respect to the display can be determined.

Step S206: and performing display control on the display based on the coverage.

Specifically, refer to step S103, which is not described herein again.

The following are embodiments of the apparatus of the present application that may be used to perform embodiments of the method of the present application. For details which are not disclosed in the embodiments of the apparatus of the present application, reference is made to the embodiments of the method of the present application.

Referring to fig. 5, a schematic structural diagram of a display control apparatus according to an exemplary embodiment of the present application is shown. The display control means may be implemented as all or part of the apparatus by software, hardware or a combination of both. The apparatus 1 comprises a signal control module 11, a coverage determination module 12 and a display control module 13.

Optionally, the display control module 13 is specifically configured to:

based on the coverage, determining an operating mode for the display, and controlling the display to enter the operating mode.

Optionally, as shown in fig. 6a, the display control module 13 includes:

a standby control unit 131, configured to determine that the display is in a standby display mode when the coverage is greater than a first threshold;

an operation control unit 132, configured to determine that the display is in an operation display mode when the coverage is less than or equal to the first threshold.

Optionally, the operation control unit 132 is specifically configured to, when the operation mode is an operation display mode, determine that the coverage is greater than a second threshold, determine an uncovered area of the display based on the coverage, and control the display to perform screen display in the uncovered area.

Optionally, as shown in fig. 6b, the coverage determining module 12 includes:

a signal characteristic determining unit 121, configured to determine a signal characteristic corresponding to each of the light-induced signals;

a coverage determination unit 122, configured to determine a coverage of the push-pull plate with respect to the display based on each of the signal characteristics.

Optionally, as shown in fig. 7, the coverage determining unit 122 includes:

an emitter determination subunit 1221 configured to determine a signal intensity of each of the light-induced signals, and determine a target light emitter from each of the light emitters based on the signal intensity;

a coverage determination subunit 1222 to determine a coverage of the push-pull plate with respect to the display based on the positional configuration information of the target light emitter with respect to the display.

Optionally, the transmitter determines the subunit 1221, and is specifically configured to:

performing signal division based on the signal intensity corresponding to each light sensing signal, and determining a first light sensing signal corresponding to a first signal intensity characteristic and a second light sensing signal corresponding to a second signal intensity characteristic, wherein the first signal intensity characteristic is greater than the second signal intensity characteristic;

and taking the light transmitter receiving the second light sensing signal as a target light transmitter.

Optionally, the coverage determining module 12 is specifically configured to:

determining a first amplitude-frequency characteristic corresponding to each light induction signal, and determining a second amplitude-frequency characteristic corresponding to the light detection signal emitted by each light emitter, wherein the second amplitude-frequency characteristic is different from a third amplitude-frequency characteristic corresponding to the ambient light;

determining a coverage of the push-pull plate relative to the display based on the first amplitude-frequency characteristic and the second amplitude-frequency characteristic.

Optionally, the coverage determining module 12 is specifically configured to:

and performing ambient light filtering processing on each photo-induced signal based on the third amplitude-frequency characteristic to obtain a first amplitude-frequency characteristic corresponding to each photo-induced signal.

It should be noted that, when the display control apparatus provided in the foregoing embodiment executes the display control method, only the division of the functional modules is illustrated, and in practical applications, the functions may be distributed and completed by different functional modules according to needs, that is, the internal structure of the device may be divided into different functional modules to complete all or part of the functions described above. In addition, the display control apparatus and the display control method provided by the above embodiments belong to the same concept, and details of implementation processes thereof are referred to in the method embodiments and are not described herein again.

The above-mentioned serial numbers of the embodiments of the present application are merely for description and do not represent the merits of the embodiments.

An embodiment of the present application further provides a computer storage medium, where the computer storage medium may store a plurality of instructions, where the instructions are suitable for being loaded by a processor and executing the display control method according to the embodiment shown in fig. 1 to 4, and a specific execution process may refer to specific descriptions of the embodiment shown in fig. 1 to 4, which is not described herein again.

The present application further provides a computer program product, where at least one instruction is stored, and the at least one instruction is loaded by the processor and executes the display control method according to the embodiment shown in fig. 1 to 4, where a specific execution process may refer to specific descriptions of the embodiment shown in fig. 1 to 4, and is not described herein again.

Referring to fig. 8, a block diagram of an electronic device according to an exemplary embodiment of the present application is shown. The electronic device in the present application may comprise one or more of the following components: a processor 110, a memory 120, an input device 130, an output device 140, and a bus 150. The processor 110, memory 120, input device 130, and output device 140 may be connected by a bus 150.

Processor 110 may include one or more processing cores. The processor 110 connects various parts within the overall electronic device using various interfaces and lines, and performs various functions of the electronic device 100 and processes data by executing or executing instructions, programs, code sets, or instruction sets stored in the memory 120 and calling data stored in the memory 120. Alternatively, the processor 110 may be implemented in hardware using at least one of Digital Signal Processing (DSP), field-programmable gate Array (FPGA), and Programmable Logic Array (PLA). The processor 110 may integrate one or more of a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), a modem, and the like. Wherein, the CPU mainly processes an operating system, a user interface, an application program and the like; the GPU is used for rendering and drawing display content; the modem is used to handle wireless communications. It is understood that the modem may not be integrated into the processor 110, but may be implemented by a communication chip.

The Memory 120 may include a Random Access Memory (RAM) or a read-only Memory (ROM). Optionally, the memory 120 includes a non-transitory computer-readable medium. The memory 120 may be used to store instructions, programs, code sets, or instruction sets. The memory 120 may include a program storage area and a data storage area, wherein the program storage area may store instructions for implementing an operating system, instructions for implementing at least one function (such as a touch function, a sound playing function, an image playing function, etc.), instructions for implementing various method embodiments described below, and the like, and the operating system may be an Android (Android) system, including a system based on Android system depth development, an IOS system developed by apple, including a system based on IOS system depth development, or other systems. The data storage area may also store data created by the electronic device during use, such as phone books, audio and video data, chat log data, and the like.

Referring to fig. 9, the memory 120 may be divided into an operating system space, in which an operating system runs, and a user space, in which native and third-party applications run. In order to ensure that different third-party application programs can achieve a better operation effect, the operating system allocates corresponding system resources for the different third-party application programs. However, the requirements of different application scenarios in the same third-party application program on system resources are different, for example, in a local resource loading scenario, the third-party application program has a higher requirement on the disk reading speed; in the animation rendering scene, the third-party application program has a high requirement on the performance of the GPU. The operating system and the third-party application program are independent from each other, and the operating system cannot sense the current application scene of the third-party application program in time, so that the operating system cannot perform targeted system resource adaptation according to the specific application scene of the third-party application program.

In order to enable the operating system to distinguish a specific application scenario of the third-party application program, data communication between the third-party application program and the operating system needs to be opened, so that the operating system can acquire current scenario information of the third-party application program at any time, and further perform targeted system resource adaptation based on the current scenario.

Taking an operating system as an Android system as an example, programs and data stored in the memory 120 are as shown in fig. 10, and a Linux kernel layer 320, a system runtime library layer 340, an application framework layer 360, and an application layer 380 may be stored in the memory 120, where the Linux kernel layer 320, the system runtime library layer 340, and the application framework layer 360 belong to an operating system space, and the application layer 380 belongs to a user space. The Linux kernel layer 320 provides underlying drivers for various hardware of the electronic device, such as a display driver, an audio driver, a camera driver, a bluetooth driver, a Wi-Fi driver, power management, and the like. The system runtime library layer 340 provides a main feature support for the Android system through some C/C + + libraries. For example, the SQLite library provides support for a database, the OpenGL/ES library provides support for 3D drawing, the Webkit library provides support for a browser kernel, and the like. Also provided in the system runtime library layer 340 is an Android runtime library (Android runtime), which mainly provides some core libraries that can allow developers to write Android applications using the Java language. The application framework layer 360 provides various APIs that may be used in building an application, and developers may build their own applications by using these APIs, such as activity management, window management, view management, notification management, content provider, package management, session management, resource management, and location management. At least one application program runs in the application layer 380, and the application programs may be native application programs carried by the operating system, such as a contact program, a short message program, a clock program, a camera application, and the like; or a third-party application developed by a third-party developer, such as a game application, an instant messaging program, a photo beautification program, a display control program, and the like.

Taking an operating system as an IOS system as an example, programs and data stored in the memory 120 are shown in fig. 11, and the IOS system includes: a Core operating system Layer 420(Core OS Layer), a Core Services Layer 440(Core Services Layer), a Media Layer 460(Media Layer), and a touchable Layer 480(Cocoa Touch Layer). The kernel operating system layer 420 includes an operating system kernel, drivers, and underlying program frameworks that provide functionality closer to hardware for use by program frameworks located in the core services layer 440. The core services layer 440 provides system services and/or program frameworks, such as a Foundation framework, an account framework, an advertisement framework, a data storage framework, a network connection framework, a geographic location framework, a motion framework, and so forth, as required by the application. The media layer 460 provides audiovisual related interfaces for applications, such as graphics image related interfaces, audio technology related interfaces, video technology related interfaces, audio video transmission technology wireless playback (AirPlay) interfaces, and the like. Touchable layer 480 provides various common interface-related frameworks for application development, and touchable layer 480 is responsible for user touch interaction operations on the electronic device. Such as a local notification service, a remote push service, an advertising framework, a game tool framework, a messaging User Interface (UI) framework, a User Interface UIKit framework, a map framework, and so forth.

In the framework illustrated in FIG. 11, the framework associated with most applications includes, but is not limited to: a base framework in the core services layer 440 and a UIKit framework in the touchable layer 480. The base framework provides many basic object classes and data types, provides the most basic system services for all applications, and is UI independent. While the class provided by the UIKit framework is a basic library of UI classes for creating touch-based user interfaces, iOS applications can provide UIs based on the UIKit framework, so it provides an infrastructure for applications for building user interfaces, drawing, processing and user interaction events, responding to gestures, and the like.

The Android system can be referred to as a mode and a principle for realizing data communication between the third-party application program and the operating system in the IOS system, and details are not repeated herein.

The input device 130 is used for receiving input instructions or data, and the input device 130 includes, but is not limited to, a keyboard, a mouse, a camera, a microphone, or a touch device. The output device 140 is used for outputting instructions or data, and the output device 140 includes, but is not limited to, a display device, a speaker, and the like. In one example, the input device 130 and the output device 140 may be combined, and the input device 130 and the output device 140 are touch display screens for receiving touch operations of a user on or near the touch display screens by using any suitable object such as a finger, a touch pen, and the like, and displaying user interfaces of various applications. Touch displays are typically provided on the front panel of an electronic device. The touch display screen may be designed as a full-face screen, a curved screen, or a profiled screen. The touch display screen can also be designed to be a combination of a full-face screen and a curved-face screen, and a combination of a special-shaped screen and a curved-face screen, which is not limited in the embodiment of the present application.

In addition, those skilled in the art will appreciate that the configurations of the electronic devices illustrated in the above-described figures do not constitute limitations on the electronic devices, which may include more or fewer components than illustrated, or some components may be combined, or a different arrangement of components. For example, the electronic device further includes a radio frequency circuit, an input unit, a sensor, an audio circuit, a wireless fidelity (WiFi) module, a power supply, a bluetooth module, and other components, which are not described herein again.

In the embodiment of the present application, the main body of execution of each step may be the electronic device described above. Optionally, the execution subject of each step is an operating system of the electronic device. The operating system may be an android system, an IOS system, or another operating system, and the operating systems mentioned above in this embodiment of the present application are merely illustrative, and the types of the operating systems mentioned in this application are not limited.

The electronic device of the embodiment of the application can also be provided with a display device, and the display device can be various devices capable of realizing a display function, for example: a cathode ray tube display (CR), a light-emitting diode display (LED), an electronic ink panel, a Liquid Crystal Display (LCD), a Plasma Display Panel (PDP), and the like. A user may utilize a display device on the electronic device 101 to view information such as displayed text, images, video, and the like. The electronic device may be a smartphone, a tablet computer, a gaming device, an AR (Augmented Reality) device, an automobile, a data storage device, an audio playback device, a video playback device, a notebook, a desktop computing device, a wearable device such as an electronic watch, an electronic glasses, an electronic helmet, an electronic bracelet, an electronic necklace, an electronic garment, or the like.

In the electronic device shown in fig. 8, where the electronic device may be a display device, the processor 110 may be configured to call the display control application program stored in the memory 120 and specifically perform the following operations:

and performing display control on the display based on the coverage.

In one embodiment, when performing the display control on the display based on the coverage, the processor 110 specifically performs the following steps:

In one embodiment, the processor 110 specifically performs the following steps when determining the operation mode of the display based on the coverage:

when the coverage is larger than a first threshold, determining that the display is in a standby display mode;

when the coverage is less than or equal to the first threshold, determining that the display is in a working display mode.

In an embodiment, when the processor 110 executes that the operating mode is the operating display mode, and the controller controls the display to enter the operating mode, the following steps are specifically executed:

and determining that the coverage is greater than a second threshold, determining an uncovered area of the display based on the coverage, and controlling the display to display in the uncovered area.

In one embodiment, the processor 110, when executing the step of determining the coverage of the display by the push-pull plate based on the light sensing signal, specifically executes the following steps:

determining signal characteristics corresponding to each light sensing signal;

based on each of the signal features, a coverage of the push-pull plate relative to the display is determined.

In one embodiment, the processor 110, when executing the determining the coverage of the push-pull plate with respect to the display based on each of the signal features, specifically executes the following steps:

determining a signal intensity of each light-induced signal, and determining a target light emitter from each light emitter based on the signal intensity;

determining a coverage of the push-pull plate relative to the display based on the positional configuration information of the target light emitter relative to the display.

In one embodiment, the processor 110 specifically performs the following steps when executing the determining of the target light emitter from the light emitters based on the signal strength:

In one embodiment, when the determining the signal characteristic corresponding to each light-induced signal and the determining the coverage of the push-pull plate relative to the display based on each signal characteristic are performed by the processor 110, the following steps are specifically performed:

In an embodiment, when the processor 110 determines the first amplitude-frequency characteristic corresponding to each of the photo-sensing signals, the following steps are specifically performed:

It is clear to a person skilled in the art that the solution of the present application can be implemented by means of software and/or hardware. The "unit" and "module" in this specification refer to software and/or hardware that can perform a specific function independently or in cooperation with other components, where the hardware may be, for example, a Field-ProgrammaBLE Gate Array (FPGA), an Integrated Circuit (IC), or the like.

It should be noted that, for simplicity of description, the above-mentioned method embodiments are described as a series of acts or combination of acts, but those skilled in the art will recognize that the present application is not limited by the order of acts described, as some steps may occur in other orders or concurrently depending on the application. Further, those skilled in the art should also appreciate that the embodiments described in the specification are preferred embodiments and that the acts and modules referred to are not necessarily required in this application.

In the foregoing embodiments, the descriptions of the respective embodiments have respective emphasis, and for parts that are not described in detail in a certain embodiment, reference may be made to related descriptions of other embodiments.

In the embodiments provided in the present application, it should be understood that the disclosed apparatus may be implemented in other manners. For example, the above-described embodiments of the apparatus are merely illustrative, and for example, the division of the units is only one type of division of logical functions, and there may be other divisions when actually implementing, for example, a plurality of units or components may be combined or may be integrated into another system, or some features may be omitted, or not implemented. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection of some service interfaces, devices or units, and may be an electrical or other form.

The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.

In addition, functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.

The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a computer readable memory. Based on such understanding, the technical solution of the present application may be substantially implemented or a part of or all or part of the technical solution contributing to the prior art may be embodied in the form of a software product stored in a memory, and including several instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method described in the embodiments of the present application. And the aforementioned memory comprises: various media capable of storing program codes, such as a usb disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a removable hard disk, a magnetic disk, or an optical disk.

Those skilled in the art will appreciate that all or part of the steps in the methods of the above embodiments may be implemented by a program, which is stored in a computer-readable memory, and the memory may include: flash disks, Read-Only memories (ROMs), Random Access Memories (RAMs), magnetic or optical disks, and the like.

The above description is only an exemplary embodiment of the present disclosure, and the scope of the present disclosure should not be limited thereby. That is, all equivalent changes and modifications made in accordance with the teachings of the present disclosure are intended to be included within the scope of the present disclosure. Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure herein. This application is intended to cover any variations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.

Claims

1. A display control method applied to a display device, the display device including a display, a push-pull plate, at least one light emitter and at least one light sensor, the at least one light emitter and the at least one light sensor being disposed on the display, the push-pull plate being disposed on an upper layer of the display and being slidable with respect to the display, the method comprising:

and performing display control on the display based on the coverage.

2. The method of claim 1, wherein the performing display control on the display based on the coverage comprises:

3. The method of claim 2, wherein determining the operating mode of the display based on the coverage comprises:

4. The method of claim 3, wherein when the operational mode is an operational display mode,

the controlling the display to enter the operating mode includes:

5. The method of claim 1, wherein the determining the coverage of the display by the push-pull plate based on the light-induced signal comprises:

determining signal characteristics corresponding to each light sensing signal;

6. The method of claim 5, wherein determining the coverage of the push-pull plate relative to the display based on each of the signal features comprises:

7. The method of claim 6, wherein determining a target light emitter from each of the light emitters based on the signal strength comprises:

8. The method of claim 5, wherein determining a signal characteristic corresponding to each of the light-induced signals and determining a coverage of the push-pull plate relative to the display based on each of the signal characteristics comprises:

9. The method of claim 8, wherein said determining a first amplitude-frequency characteristic corresponding to each of said photo-induced signals comprises:

10. A computer storage medium, characterized in that it stores a plurality of instructions adapted to be loaded by a processor and to carry out the method steps according to any one of claims 1 to 9.

11. An electronic device, comprising: a processor and a memory; wherein the memory stores a computer program adapted to be loaded by the processor and to perform the method steps of any of claims 1 to 9.