CN116803089A

CN116803089A - Display equipment and sound and picture parameter adjusting method

Info

Publication number: CN116803089A
Application number: CN202280010310.4A
Authority: CN
Inventors: 卢平光; 姜俊厚; 王昊; 张瑞吉; 陈冲; 于新磊; 何营昊; 解廷福; 刘芳
Original assignee: Hisense Visual Technology Co Ltd
Current assignee: Hisense Visual Technology Co Ltd
Priority date: 2021-06-30
Filing date: 2022-01-24
Publication date: 2023-09-22
Also published as: CN115547267A

Abstract

Some embodiments of the application disclose a display device and an audio-video parameter adjusting method, which can execute image recognition on the corresponding picture content of audio-video data after a control instruction for adjusting the audio-video parameter is input by a user, obtain the current scene classification, and inquire the audio-video quality mode conforming to the scene classification, thereby playing the audio-video data according to the audio-video quality mode.

Description

Display equipment and sound and picture parameter adjusting method

The application is claimed to be filed in 2021, 1 and 14 days, and the application number is 202110046140.2; application number 202111087473.6 filed on day 9 and 16 of 2021; application number 202110805331.2 filed on day 7 and 16 of 2021; priority of chinese patent application No. 202110736156.6 filed at 30, 6, 2021 is incorporated herein by reference in its entirety.

Technical Field

The application relates to the technology of display equipment, in particular to display equipment and a sound and picture parameter adjusting method.

Background

The display device may be connected to the game device through an HDMI interface, and the game device may output video data and audio data by running a game-related program during use of the game device by a user. The video data and the audio data can be transmitted to the display device through the HDMI protocol, and output through a screen and a speaker of the display device, and video and audio of the game device are played. When a plurality of external devices are connected to the display device, a user can switch audio and video data input to the display device by switching signal sources.

Disclosure of Invention

Some embodiments of the application provide a display device comprising: a display, an external device interface, and a controller. Wherein the display is configured to display a user interface; the external device interface is configured to be connected with external equipment so as to receive audio and video data sent by the external equipment; the controller is configured to:

acquiring a control instruction for adjusting audio and video quality, which is input by a user;

in response to the control instruction, identifying a scene classification from the audio-video data, the scene classification being obtained by performing image recognition on picture content in the audio-video data;

inquiring the audio and video quality modes conforming to the scene classification;

and playing the audio and video data according to the audio and video quality mode.

Some embodiments of the present application provide a method for adjusting audio and video parameters of a display device, where the display device establishes communication connection with an external device to receive audio and video data sent by the external device; the sound and picture parameter adjusting method comprises the following steps:

Some embodiments of the application provide a display device comprising: a display, an external device interface, and a controller. Wherein the display is configured to display a user interface; the external device interface is configured to connect to an external device; the controller is configured to perform the following program steps:

detecting a new version function mark after monitoring that the external device is connected with the external device interface, wherein the new version function mark is a mark added in transmission data when the external device configures the new version function, and the new version function is an additional transmission function of a first version transmission protocol relative to a second version transmission protocol;

if the new version function mark is detected, switching a transmission protocol to the first version;

and if the new version function mark is not detected, switching a transmission protocol to the second version.

In some embodiments, in the step of extracting the display in the media data via the ALLM protocol, the controller is further configured to:

reading ALLM state parameters in media data through a thread loop body;

If the ALLM state parameter is equal to 1, extracting a display picture in the media data;

and if the ALLM state parameter is equal to 0, recovering the image quality parameter and/or the tone quality parameter to be user-defined values.

In some embodiments, after the step of reading the almm switch state of the external device from the media asset data, the controller is further configured to:

if the ALLM switch state is closed, acquiring a device data frame of the external device;

analyzing the device type in the device data frame;

if the equipment type is the first equipment type, extracting a display picture in the media data;

identifying a picture type in the display picture;

and setting image quality parameters and sound quality parameters according to the picture types.

In some embodiments, after the step of parsing the device type in the device data frame, the controller is further configured to:

and if the equipment type is the first equipment type, recovering the image quality parameter and/or the tone quality parameter to be user-defined values.

Some embodiments of the application provide a display device comprising: the display comprises a display module and a backlight module, wherein the backlight module is used for providing light sources with different backlight brightness for the display module so that the display module displays pictures with different display brightness; a controller coupled to the display, the controller configured to: when the display equipment is detected to enter a variable refresh rate VRR mode, adjusting a dimming mode of the backlight module to an analog dimming mode; and adjusting the power supply voltage/power supply current of the backlight module according to the target brightness when the display data are displayed on the display module, so that the backlight brightness of the light source provided by the backlight module is consistent with the target brightness.

In some embodiments, the controller is configured to: judging whether the display equipment starts a partition light control function or not; if the display equipment has started the partition light control function, judging whether the display equipment supports the analog partition light control; and if the display equipment supports the analog partition light control, adjusting the power supply voltage/power supply current of the backlight module corresponding to each partition according to the target brightness of the display data when the display data is displayed in different partitions on the display module.

In some embodiments, the controller is configured to: and determining color temperature correction amounts corresponding to the subareas according to the power supply voltage/power supply current of the backlight module corresponding to the subareas, and performing color temperature correction processing of the subareas based on the color temperature correction amounts.

In some embodiments, the controller is configured to: increasing target brightness corresponding to the first display data in each partition, and reducing target brightness corresponding to the second display data in each partition; the first display data are display data with gray scale values larger than or equal to a preset threshold value, and the second display data are display data with gray scale values smaller than the preset threshold value.

In some embodiments, the controller is configured to: if the display equipment does not start the zone light control function, determining a corresponding color temperature correction amount according to the power supply voltage/power supply current of the backlight module, and performing color temperature correction processing based on the color temperature correction amount.

In some embodiments, the controller is configured to: if the display equipment does not support the analog partition light control, adjusting the power supply voltage/power supply current of the backlight module according to the target brightness when the display data is displayed on the display module; wherein, the power supply voltage/power supply current of the backlight module corresponding to each partition is the same.

In some embodiments, the controller is configured to: and controlling the display equipment to close the partition light control function and closing the image compensation function corresponding to the partition light control function.

In some embodiments, the controller is configured to: and determining a corresponding color temperature correction amount according to the power supply voltage/power supply current of the backlight module, and performing color temperature correction processing based on the color temperature correction amount.

Drawings

FIG. 1 is a schematic diagram of an operational scenario between a display device and a control apparatus according to one or more embodiments of the present application;

fig. 2 is a hardware configuration block diagram of a display device 200 in accordance with one or more embodiments of the application;

fig. 3 is a hardware configuration block diagram of a control device 100 according to one or more embodiments of the present application;

FIG. 4 is a schematic diagram of a software configuration in a display device 200 according to one or more embodiments of the application;

FIG. 5 is a schematic diagram of a frame tearing according to one or more embodiments of the present application;

FIG. 6 is a diagram illustrating a screen click according to one or more embodiments of the present application;

FIG. 7 is a schematic diagram of a digital dimming principle according to one or more embodiments of the present application;

FIG. 8 is a schematic diagram of an analog dimming principle according to one or more embodiments of the present application;

FIG. 9 is a schematic diagram of a fitted curve of a color temperature correction process in accordance with one or more embodiments of the present application;

FIG. 10 is a schematic diagram illustrating compatibility of a display device with an external device according to one or more embodiments of the present application;

FIG. 11 is a flow diagram of an automatic switching method of transmission protocols according to one or more embodiments of the application;

FIG. 12 is a flow diagram of detecting an external device protocol version through a device management list in accordance with one or more embodiments of the present application;

FIG. 13 is a flow diagram of updating a device management list in accordance with one or more embodiments of the application;

FIG. 14 is a flow diagram of a process for detecting a new version of a functional configuration in accordance with one or more embodiments of the present application;

FIG. 15 is a flow diagram of a configuration process according to initiation flag detection in accordance with one or more embodiments of the present application;

FIG. 16 is a schematic diagram of a detection mode parameter consistency flow in accordance with one or more embodiments of the present application;

fig. 17 is a schematic flow diagram of a process for transmitting a listening media asset signal according to one or more embodiments of the present application;

fig. 18 is a flow diagram of switching transmission protocol versions according to a transmission bit rate in accordance with one or more embodiments of the present application;

FIG. 19 is a flow diagram of switching transmission protocol versions according to clock source rate in accordance with one or more embodiments of the application;

FIG. 20 is a schematic flow diagram of adaptive parameters for a display device according to one or more embodiments of the application;

FIG. 21 is a flow diagram of determining a first access state according to one or more embodiments of the application;

FIG. 22 is a timing diagram of a method for tuning audio and video parameters according to one or more embodiments of the present application;

FIG. 23 is a schematic diagram of a signal source selection interface in accordance with one or more embodiments of the present application;

FIG. 24 is a schematic view of a game optimizer window in accordance with one or more embodiments of the application;

FIG. 25 is a flow diagram of identifying scene classification by keyframes in accordance with one or more embodiments of the application;

FIG. 26 is a schematic diagram of a game detail interface in accordance with one or more embodiments of the application;

FIG. 27 is a flow diagram of a query scene classification by a server in accordance with one or more embodiments of the application;

FIG. 28 is a flow diagram of identifying scene classification by an image recognition model in accordance with one or more embodiments of the application;

FIG. 29 is a prompt window control flow diagram in accordance with one or more embodiments of the application;

FIG. 30 is a schematic diagram of a hint window according to one or more embodiments of the present application.

Detailed Description

For the purposes of making the objects, embodiments and advantages of the present application more apparent, an exemplary embodiment of the present application will be described more fully hereinafter with reference to the accompanying drawings in which exemplary embodiments of the application are shown, it being understood that the exemplary embodiments described are merely some, but not all, of the examples of the application.

The partial terms referred to herein are explained:

refresh Rate (Refresh Rate): also known as Field Frequency (Field Frequency), refers to the vertical scanning Frequency of a screen, i.e., the number of images that can be displayed per second by the screen, in hertz (Hz). The higher the refresh frequency, the more the number of image refreshes, the smaller the flicker of the image display, and the higher the picture quality.

Tear (Tearing): when the previous Frame (n)) displayed on the screen has not completely disappeared, a new Frame (n+1)) is output to the display screen, and two different frames simultaneously appear on the panel of the screen, namely, two frames correspond to one scanning signal (Scan) period, at this time, the refresh node of the screen is not reached, and the screen is torn.

The backlight frequency is the adjustment frequency of a backlight pulse width modulation (Pulse Width Modulation, PWM) signal of a Light-Emitting Diode (LED) in a screen backlight module.

The variable refresh rate (Variable Refresh Rate, VRR) technology refers to that the refresh frequency of the display screen dynamically changes along with the output frequency of the GPU, and is mainly used for reducing or eliminating the situations of picture delay, jamming, tearing and the like (in games) and ensuring the display smoothness and detail integrity of pictures.

Zonal light control (Local Dimming): by dividing the display area of the whole screen, a plurality of subareas are obtained, and then brightness adjustment is performed on each subarea (namely, a local area) of the screen respectively, instead of performing overall brightness adjustment on the whole display area of the screen.

As shown in fig. 1, a user may operate the display apparatus 200 through the mobile terminal 300 and the control device 100. The control apparatus 100 may be a remote control, and the communication between the remote control and the display device includes infrared protocol communication, bluetooth protocol communication, and wireless or other wired manner to control the display device 200. The user may control the display device 200 by inputting user instructions through keys on a remote control, voice input, control panel input, etc. In some embodiments, mobile terminals, tablet computers, notebook computers, and other smart devices may also be used to control the display device 200.

In some embodiments, the mobile terminal 300 may install a software application with the display device 200, implement connection communication through a network communication protocol, or may transmit audio and video contents displayed on the mobile terminal 300 to the display device 200, so that the display device 200 can perform data communication with the server 400 through a plurality of communication modes. The server 400 may provide various contents and interactions to the display device 200. The display device 200 may additionally provide an intelligent network television function of a computer support function in addition to the broadcast receiving television function. As shown in fig. 2, the control device 100 includes a controller 110, a communication interface 130, a user input/output interface 140, a memory, a power supply, and the like. The control apparatus 100 may receive an input operation instruction of a user and convert the operation instruction into an instruction recognizable and responsive by the display device 200. The communication interface 130 is for communicating with the outside and the user input/output interface 140 comprises at least one of a microphone, a touch pad, a sensor, keys or an alternative module.

The display apparatus 200 shown in fig. 3 includes at least one of a modem 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, an external memory, a power supply, and a user input interface 280. The controller includes a central processor, a video processor, an audio processor, a graphic processor, a RAM, a ROM, an input/output interface, and the like. The display 260 may be at least one of a liquid crystal display, an OLED display, a touch display, and a projection display. The modem 210 receives broadcast television signals through a wired or wireless reception manner, and demodulates audio and video signals from a plurality of wireless or wired broadcast television signals. The detector 230 is used to collect signals of the external environment or interaction with the outside. In some embodiments, the controller 250 controls the operation of the display device and responds to user operations through various software control programs stored on the memory. A user may input a user command through a graphical user interface (Graphic User Interface, GUI) displayed on the display 260, and the user input interface receives the user input command through the GUI. The user interface is a medium interface for interaction and information exchange between an application program or an operating system and a user, and can realize conversion between an internal form of information and an acceptable form of the user, and can be an interface element such as an icon, a window, a control and the like displayed in a display screen of the electronic equipment, wherein the control can comprise at least one of visible interface elements such as an icon, a button, a menu, a tab, a text box, a dialog box, a status bar, a navigation bar and the like.

As shown in fig. 4, in some embodiments, the system is divided into four layers, from top to bottom, an application layer (application layer), an application framework layer (Application Framework layer), a An Zhuoyun row (Android run) and a system library layer (system runtime layer), and a kernel layer, respectively. The kernel layer contains at least one of the following drivers: audio drive, display drive, bluetooth drive, camera drive, WIFI drive, USB drive, HDMI drive, sensor drive (e.g., fingerprint sensor, temperature sensor, pressure sensor, etc.), and power supply drive, etc.

< analog dimming and digital dimming >

The display device is connected with the game device, and can output video data and audio data in real time for the game process during the use of the game device by a user, and send the video data and the audio data to the display device so as to output the video data and the audio data as video pictures and sounds through the display device. At this time, the game device serves as a transmitting end, and the display device serves as a receiving end. Because the sheet source input by the game equipment is mostly based on the VRR technology, a plurality of challenges are presented to the processing capacity of the display equipment, and because the game is not optimized in place or the hardware configuration of the equipment is not required, part links in the process of generating (game) pictures are dragged slowly, so that dislocation exists between the time nodes output by the GPU and the refreshing time of the panel, and the phenomenon of picture blocking and the like occurs on the screen.

In some embodiments, fig. 5 is a schematic diagram of Frame tearing according to one or more embodiments of the present application, as shown in fig. 5, a Panel (Panel) refresh frequency of a screen is fixed, a first Frame (1) of a graphics processor (Graphics Processing Unit, GPU) is displayed on the Panel during a first Scan signal Scan (0/1) of the Panel, and a second Frame (2) is output to the Panel for display when the Frame (1) has not completely disappeared, at this time, the first Scan signal Scan (0/1) corresponds to the frames Frame (1) and Frame (2), two frames of frames are simultaneously displayed at a point a, but point a does not reach a first refresh node (16 ms) of the Panel, i.e., the point a shows the Frame tearing. And similarly, the picture is torn at the point b, the point c and the point d.

In some embodiments, fig. 6 is a schematic diagram of screen blocking according to one or more embodiments of the present application, as shown in fig. 6, a panel refresh frequency of a screen is fixed, and during a first Scan signal Scan, a first Frame (1) output by a GPU is displayed on a panel; when the first refreshing node reaches 16ms, the second scanning signal Scan (1) corresponds to a second Frame (2); when the second refreshing node is 32ms, the GPU does not output a new picture, time dislocation occurs, and thus, a picture is blocked at the point e; when the third refresh node is reached for 48ms, a third Frame (3) output by the GPU is displayed on the panel.

The display device designed for the game scene adopts a display screen with a variable refresh rate mode, and because the refresh frequency of the screen can be adjusted in real time, if a phase difference exists between the refresh frequency of the liquid crystal display screen and the backlight frequency of the LED backlight, the phenomenon of screen flashing or screen water ripple occurs in a dark field can be caused, so that the display quality of the screen is affected. Some embodiments of the present application provide a display device, when the display device is in a variable refresh rate VRR mode, a dimming mode of a backlight module may be adjusted to an analog dimming mode, and in the analog dimming mode, the display device may adjust backlight brightness of the backlight module by adjusting a supply voltage/supply current of the backlight module, and since the analog dimming mode does not have a refresh frequency, a screen flash or a water ripple is avoided, thereby ensuring display quality of a screen and improving viewing experience of a user. Wherein the controller is configured to: when the display equipment is detected to enter a variable refresh rate VRR mode, adjusting a dimming mode of the backlight module into an analog dimming mode; and adjusting the power supply voltage/power supply current of the backlight module according to the target brightness when the display data are displayed on the display module, so that the backlight brightness of the light source provided by the backlight module is consistent with the target brightness. Specifically, the dimming mode of the backlight module includes a digital dimming mode and an analog dimming mode.

The digital dimming mode is a dimming mode for realizing LED backlight adjustment by adopting a PWM technology. Fig. 7 is a schematic diagram of digital dimming principle according to one or more embodiments of the present application, as shown in fig. 7, the backlight power supply circuit is turned on during a period when the PWM output is high level, the backlight is turned on, and the backlight power supply circuit is turned off during a period when the PWM output is low level, and the backlight is turned off. In this example, a PWM output with a duty cycle of 100% is used to adjust the backlight to 100% brightness, a PWM output with a duty cycle of 50% is used to adjust the backlight to medium brightness, and a PWM output with a duty cycle of 20% is used to adjust the backlight to low brightness.

In addition, the dimming principle of the analog dimming method is to maintain a continuous on state of the backlight power supply circuit and adjust the backlight luminance by adjusting the power supply voltage/power supply current. FIG. 8 is a schematic diagram of an analog dimming principle according to one or more embodiments of the present application, wherein the backlight can be adjusted to have high brightness when the power supply voltage/current is a larger value as shown in FIG. 8; when the power supply voltage/power supply current is an intermediate value, the backlight can be adjusted to be at the intermediate brightness; when the supply voltage/supply current is small, the backlight can be adjusted to a low luminance.

Because the dimming principle of the digital dimming mode is different from that of the analog dimming mode, for the digital dimming mode, the backlight of the screen is changed in brightness all the time due to the refresh period of the PWM signal, and the screen is still tired in viewing for a long time although the change is beyond the perceivable range of human eyes. Meanwhile, since the display image has the same refreshing period, when the refreshing frequency of the screen and the refreshing frequency of the PWM have a phase difference, a screen flash or water ripple phenomenon can occur, and the display effect is affected. In addition, the backlight power supply circuit is frequently turned on and off under the control of the PWM signal, and part of electric energy is consumed in the on and off of the components, so that the photoelectric conversion efficiency is reduced, and the efficiency index of the display equipment is lower. For the analog dimming mode, the refresh period does not exist, so that visual fatigue and water ripple phenomenon are not caused, and the photoelectric conversion efficiency is higher.

Based on the above principle, when the controller detects that the display device enters the VRR mode, since the refresh frequency of the screen in the VRR mode changes correspondingly with the output frequency of the GPU, at this time, if the current dimming mode of the backlight module is a digital dimming mode, a phase difference between the refresh frequency of the screen and the backlight frequency of the LED backlight may occur, which further results in a phenomenon that the screen flashes or water waves of the screen occur in a dark field.

In some embodiments, the adjustment of the dimming manner by the controller can be divided into the following two cases according to actual situations: (1) If the display equipment enters the VRR mode, the dimming mode of the backlight module is a digital dimming mode, and the display equipment is switched to an analog dimming mode; (2) If the display device enters the VRR mode, the dimming mode of the backlight module is an analog dimming mode, and the analog dimming mode is continuously maintained. After the controller adjusts the dimming mode of the backlight module into the analog dimming mode, if the display equipment obtains the display data needing to display the picture at the moment, the controller can adjust the power supply voltage/power supply current of the backlight module according to the target brightness when the display data is displayed on the display module, so that the backlight brightness of the light source provided by the backlight module is consistent with the target brightness, and the display module can display the picture corresponding to the display data according to the target brightness.

In some embodiments, the controller is configured to: judging whether the display equipment starts the partition light control function or not; if the display equipment has started the partition light control function, judging whether the display equipment supports the analog partition light control; if the display equipment supports the analog partition light control, the power supply voltage/power supply current of the backlight module corresponding to each partition is adjusted according to the target brightness of the display data when the display data are displayed in different partitions on the display module. Specifically, for a display device with a partition light control function, a screen may be divided into a plurality of partitions, for example, the whole screen is divided into m×n partitions, and then light control processing is performed on each partition, that is, backlight brightness of a backlight module corresponding to each partition is adjusted.

After the controller judges that the display equipment is started with the partition light control function, the display equipment is indicated to support the light control of different partitions of the screen at present, at this time, the controller further judges whether the display equipment supports the light control of different partitions through an analog dimming mode, if the display equipment supports the analog partition light control, the controller adjusts the power supply voltage/power supply current of the backlight module corresponding to each partition according to the target brightness of the display data when the display data is displayed on different partitions of the display module, so that the display brightness of different partitions of the screen is different, and analog light control processing of each partition is realized. In the technical scheme of the embodiment, on one hand, through regional light control, brightness distribution can be performed according to brightness requirements of different regions, so that bright regions of a screen picture are brighter, dark regions are darker, and picture contrast can be optimized; on the other hand, through the regional accuse light of simulation, also can avoid appearing the phenomenon of screen flashing or ripple to guarantee the display quality of screen, improve user's viewing experience.

In some embodiments, the controller is configured to: and determining color temperature correction amounts corresponding to the partitions according to the power supply voltage/power supply current of the backlight module corresponding to the partitions, and performing color temperature correction processing of the partitions based on the color temperature correction amounts. When the regional light control is performed by simulating the regional light control, the color temperature of the LED is also changed along with the change of the power supply voltage/power supply current due to the need of adjusting the power supply voltage/power supply current of different regions. Taking a power type white light LED as an example for explanation, when the power supply current changes in the working range, the corresponding color temperatures are different. When the power supply current increases, blue light emitted from the LED increases, and the thickness of the phosphor layer is constant, so that the blue light component in the emitted white light increases, resulting in an increase in color temperature. For example, when the supply current is 100mA, the color temperature of the power type white LED is 5636K; and when the supply current increases to 350mA, the color temperature of the power white LED increases to 5734K.

In some embodiments, since the color temperature change may further cause color shift phenomena of the screen, such as blue shift of the cold tone, yellow shift of the warm tone, etc., when the area light control is performed by simulating the area light control, local color temperature shift correction is also required to achieve white balance. For example, when the controller determines that the color temperature offset correction is required, the controller first determines the color temperature correction amount corresponding to each partition according to the power supply voltage/power supply current of the backlight module corresponding to each partition, and then performs the color temperature correction process of each partition based on the color temperature correction amount corresponding to each partition after obtaining the color temperature correction amount. Table 1 below is an example of an analog dimming color temperature correction table:

TABLE 1

Fig. 9 is a schematic diagram of a fitted curve of a color temperature correction process according to one or more embodiments of the present application, where the larger the supply current is, the more blue components in white light emitted from an LED are, so that the color temperature correction can be performed on the blue light according to the magnitude of the supply current, thereby achieving white balance and improving display quality, as shown in the above table and fig. 9.

In some embodiments, the controller is configured to: and increasing the target brightness corresponding to the first display data in each partition, and reducing the target brightness corresponding to the second display data in each partition. In the case of performing the division light control by simulating the division light control, the contrast of the display screen can be adjusted in order to further improve the display quality. For example, the first display data is display data with a gray level value greater than or equal to a preset threshold value, namely, the first display data can be understood as display data with middle and high gray levels (wherein the middle and high gray levels can be continuously divided according to another larger preset threshold value); the second display data is the display data with the gray scale value smaller than the preset threshold value, namely the display data with low gray scale can be understood.

For the display data with different gray scales, the brightness of the display data with low gray scale (namely the second display data) can be properly reduced, and the brightness of the display data with medium and high gray scale (namely the first display data) can be properly increased, so that the contrast ratio of the display picture can be improved. Table 2 below is an example of adjustment of contrast by adjusting display brightness:

TABLE 2

Gray scale value	Gray scale type	Initial display brightness	Adjusted display brightness
X1	Low gray scale	L0_x1	L1_x1(L0_x1>L1_x1)
X2	Middle gray scale	L0_x2	L1_x2(L0_x1<L1_x1)
X3	High gray scale	L0_x3	L1_x3(L0_x1<L1_x1)

In some embodiments of the present application, brightness adjustment is performed on display data with different gray scales in each partition, so that contrast of a display picture can be improved, and display quality is further improved.

In some embodiments, the controller is configured to: if the display device does not start the zonal light control function, determining a corresponding color temperature correction amount according to the power supply voltage/power supply current of the backlight module, and performing color temperature correction processing based on the color temperature correction amount. If the controller determines that the display device does not turn on the partition light control function, for example, the display device does not have the partition light control function, or the display device has the partition light control function but does not turn on the partition light control function currently, the controller can also perform global color temperature correction processing in the process of performing analog light control on the whole area of the screen. Specifically, the processor may determine a color temperature correction amount corresponding to the overall display screen according to the overall supply voltage/supply current of the backlight module, and perform color temperature correction processing on the overall display screen based on the color temperature correction amount. In some embodiments of the present application, when the display device does not turn on the partition light control function, the display quality of the overall display screen may be improved by performing global color temperature correction processing.

In some embodiments, the controller is configured to: if the display equipment does not support the analog partition light control, adjusting the power supply voltage/power supply current of the backlight module according to the target brightness when the display data are displayed on the display module; wherein, the power supply voltage/power supply current of the backlight module corresponding to each partition is the same. If the controller determines that the display device has started the partition light control function, but does not support the analog partition light control, it is indicated that the controller cannot perform the light control processing of each partition in the analog light control mode, and at this time, the controller may fix the display brightness of each partition, that is, the display brightness of each partition is the same. For example, since the display device does not support analog partition light control, in order to ensure that no screen flash or water ripple phenomenon caused by phase difference occurs, the controller may perform global overall synchronous light control processing in an analog dimming manner, that is, adjust the power supply voltage/power supply current of the backlight module according to the target brightness when the display data is displayed on the display module; the power supply voltage/power supply current of the backlight module corresponding to each partition is the same, so that the display brightness of each partition is the same. In some embodiments of the present application, for the case that the display device has turned on the partition light control function, but does not support the analog partition light control, the global overall synchronous light control process may be performed by using an analog light control manner, so as to avoid the phenomenon of screen flashing or water ripple caused by a phase difference, and improve the display quality.

In some embodiments, the controller is configured to: and controlling the display equipment to close the partition light control function and closing the image compensation function corresponding to the partition light control function. If the controller determines that the display device has turned on the partition light control function, but does not support the analog partition light control, it indicates that the partition light control mode of the display device is a digital light control mode, that is, the brightness is adjusted by adjusting the duty ratio of the PWM signal, at this time, when the controller performs dimming by the analog dimming mode, the dimming process may be interfered by a vertical synchronization (Vsync) signal sent by data of the serial peripheral interface (Serial Peripheral Interface, SPI), so that a fine water ripple appears in a large-area solid color area. Thus, to avoid signal interference, the controller may control the display device to turn off the zone light control function.

Meanwhile, in order to reduce the influence of the partition light control on the display quality, the display equipment is correspondingly started with an image compensation function corresponding to the partition light control function while the partition light control function is started. Therefore, after the partition light control function is turned off, the image compensation function corresponding to the partition light control function is also required to be turned off, so that the influence of the image compensation function on the display screen is avoided. In some embodiments of the present application, for the case that the display device has turned on the partition light control function but does not support the analog partition light control, the partition light control function and the image compensation function corresponding to the partition light control function may be turned off, so as to avoid signal interference caused by the partition light control to the analog light control, and improve display quality.

In some embodiments, the controller is configured to: and determining a corresponding color temperature correction amount according to the power supply voltage/power supply current of the backlight module, and performing color temperature correction processing based on the color temperature correction amount. For the case that the display device has turned on the partition light control function but does not support the analog partition light control, after the partition light control function is turned off and the image compensation function corresponding to the partition light control function is turned off, the color temperature correction amount corresponding to the whole display picture can be determined according to the whole power supply voltage/power supply current of the backlight module, and the color temperature correction processing of the whole picture can be performed based on the color temperature correction amount. In some embodiments of the present application, after the partition light control function is turned off and the image compensation function corresponding to the partition light control function is turned off, the overall color temperature correction processing is performed, so that the display quality of the overall display picture can be improved.

In some embodiments, the present application provides a driving method of a backlight module, which mainly includes the following steps: s100, when the display equipment is detected to enter a variable refresh rate VRR mode, adjusting a dimming mode of a backlight module into an analog dimming mode; and S200, adjusting the power supply voltage/power supply current of the backlight module according to the target brightness when the display data are displayed on the display module, so that the backlight brightness of the light source provided by the backlight module is consistent with the target brightness.

In some embodiments, the method further comprises: s310, judging whether the display equipment starts a partition light control function or not; s320, if the display equipment has started the partition light control function, judging whether the display equipment supports the analog partition light control; s321, if the display equipment supports the analog partition light control, adjusting the power supply voltage/power supply current of the backlight module corresponding to each partition according to the target brightness of the display data when the display data is displayed in different partitions on the display module.

In some embodiments, the method further comprises: s322, determining color temperature correction amounts corresponding to the subareas according to the power supply voltage/power supply current of the backlight module corresponding to the subareas, and performing color temperature correction processing of the subareas based on the color temperature correction amounts.

In some embodiments, the method further comprises: s323, increasing the target brightness corresponding to the first display data in each partition, and reducing the target brightness corresponding to the second display data in each partition.

In some embodiments, the method further comprises: s330, if the display device does not start the zone light control function, determining a corresponding color temperature correction amount according to the power supply voltage/power supply current of the backlight module, and performing color temperature correction processing based on the color temperature correction amount.

In some embodiments, the method further comprises: s324, if the display equipment does not support the analog partition light control, adjusting the power supply voltage/power supply current of the backlight module according to the target brightness when the display data are displayed on the display module; wherein, the power supply voltage/power supply current of the backlight module corresponding to each partition is the same.

In some embodiments, the method further comprises: s325, controlling the display device to close the partition light control function and closing the image compensation function corresponding to the partition light control function.

In some embodiments, the method further comprises: s326, determining a corresponding color temperature correction amount according to the power supply voltage/power supply current of the backlight module, and performing color temperature correction processing based on the color temperature correction amount.

< EDID compatible with HDMI version >

The display device may be connected to the game device through an HDMI interface. The user can output video data and audio data by running a game-related program while using the game device. The video data and the audio data can be transmitted to the display device through the HDMI protocol, and output through a screen and a speaker of the display device, and video and audio of the game device are played. After the external device is connected with the display device, data transmission can be performed based on specific standards, so that the display device and the external device can be mutually identified and a data transmission channel can be established. For example, the display device may establish a connection with the external device based on the extended display identification data (Extended Display Identification Data, EDID) and achieve mutual identification.

After the external device is connected with the display device, data transmission can be performed based on specific standards, so that the display device and the external device can be mutually identified and a data transmission channel can be established. For example, the display device may be identified by the external device based on EDID. In order to be able to establish a connection relationship with different external devices, the display device needs to switch its EDID version for the different external devices. For example, fig. 10 is a schematic diagram showing compatibility between a display device and an external device according to one or more embodiments of the present application, as shown in fig. 10, the display device may switch EDID versions for HDMI1.4 and HDMI2.0 versions, so that after the external device is connected to the display device, data transmission may be performed based on the same transmission protocol version. That is, when the display device is connected to an external device only supporting the 1.4 version of HDMI, the EDID version needs to be switched to the 1.4 version so that the display device is compatible with the external device. When the types of HDMI versions supported by the display device and the external device are not matched, there is a possibility that the display device and the external device are not compatible. For example, selecting 2.0 EDID version of the display device and accessing a DVD supporting only 1.4 may cause the DVD to not recognize EDID of the display device, and cause a problem of no sound when the DVD transmits DVI signal.

The display device and the external device can mutually identify and realize the preset data transmission effect only by adopting the same transmission protocol version. Therefore, the display device can detect the transmission protocol version supported by the external device and automatically switch to an adaptive mode. In order to alleviate compatibility problem between the display device and the external device, an EDID dynamic adjustment (auto EDID) algorithm may be built in the display device, for automatically switching the HDMI version supported by the external device. That is, if the display device adopts auto EDID algorithm, EDID is dynamically adjusted, so that the display device can switch freely between EDID1.4 and EDID 2.0. Therefore, the display device can be dynamically switched to various external devices by embedding different forms of EDID dynamic adjustment algorithms. However, due to the iteration of the transmission protocol version, the automatic switching algorithm adopted by the display device can not accurately identify the device partially adopting the new version transmission protocol after the new version transmission protocol is used. For example, however, with the formulation of HDMI2.1 version, more and more external devices may support HDMI2.1 protocol. However, the conventional auto EDID algorithm does not involve the EDID switching related to HDMI 2.1. Therefore, when the display device still employs the auto EDID algorithm before, an unavoidable problem arises of incompatibility, affecting data transmission between devices.

In some embodiments, if the display device presets the EDID version to 2.0, if the external device of the HDMI2.1 version is connected, the external device also supports HDMI2.0 because the external device has a downward compatible characteristic, at which time the display device may detect the bit rate of the minimized transmission differential signal (Transition Minimized Differential Signaling, TMDS) in the status and control data channels (Status and Control Data Channel, SCDC) through the display data channel (Display Data Channel, DDC) pin, at which time the auto EDID algorithm does not dynamically switch to EDID2.1, resulting in the external device reading the EDID version of 2.0, and misthinking that the current display device does not support HDMI2.1 version, thereby resulting in the external device not being able to transmit the 8K signal. If the EDID version of the display device is preset to 2.1 and an external device only supporting the 2.0 HDMI version is connected, the external device will send TMDS bit rate or write a value in SCDC, so that the EDID will not be dynamically switched to the 2.0 version, and if the external device supporting the 2.0 HDMI version is read, the 2.1EDID condition may not be identified, resulting in compatibility problems.

In order to improve compatibility between a display device and an external device, some embodiments of the present application provide a display device, including: a display 260, an external device interface 240, and a controller 250. The display 260 is configured to display a user interface, where the user interface may include a media asset screen sent by an external device. The external device interface 240 is an interface for connecting to an external device, and may be an HDMI interface. The controller 250 may be configured to perform a method for automatically switching a transmission protocol, so that when different external devices are accessed, the external devices can automatically identify the transmission protocol version supported by the external devices and switch to the identification information of the corresponding version, so that the external devices can identify the display device.

In some embodiments, fig. 11 is a flowchart of a method for automatically switching a transmission protocol according to one or more embodiments of the present application, as shown in fig. 11, the controller is configured to detect a configuration process of a new version function initiated by an external device after the external device is monitored to connect to the external device interface 240, where the new version function is an additional transmission function of a first version transmission protocol relative to a second version transmission protocol. When the external device is connected to the external device interface 240, the voltage change at the external device interface 240 may be triggered, so that the display device may determine whether the external device is connected by monitoring the voltage change condition at the external device interface 240. For example, the display device may start a signal detection thread for HDMI to perform an incoming call detection. When the external device is connected, the display device can detect the 5V voltage provided by the external device, so that the external device is connected. When the external device is monitored to be connected to the display device, the display device can detect the transmission protocol version supported by the external device, so that the external device can identify the display device by adjusting the EDID form of the display device, and a data communication connection relationship is established based on the corresponding transmission protocol version.

< FRL Pattern >

In some embodiments of the present application, the transport protocol may be divided into a plurality of version types, such as a first version and a second version, in a version update iteration order. The transport protocol may also have more versions, such as a third version, a fourth version, etc., depending on the particular transport protocol. Since the new version of the transmission protocol generally has new data transmission functions, i.e. additional functions, with respect to the old version. After the external device is connected to the display device, the configuration is performed based on the additional function of the new version, so that the display device can determine whether the external device supports the new version of the transmission protocol based on whether the external device successfully configures the new version of the function. When the new version function is configured, the external device can add the new version function identification mark in the transmission data, so that the display device can determine whether the new version function is successfully configured by detecting the new version function mark.

And if the new version function mark is detected, switching the transmission protocol to the first version. By detecting the configuration process initiated by the external device, the display device can determine whether the external device can provide the additional function of the new version, thereby determining that the current external device supports the new version of the transmission protocol. Thus, the display device may correspondingly switch to a new version of the transmission protocol. Similarly, if the new version function flag is not detected, it may be determined that the external device cannot provide the additional function of the new version, that is, the external device does not support the new version transmission protocol, and therefore, it is required to switch the transmission protocol to the second version. For example, compared with the HDMI2.0, the HDMI2.1 has a Fixed Rate Link (FRL) transmission mode, and the FRL mode can embed a Clock (Clock) signal into a Data (Data) signal, and then analyze the Clock signal by a subsequent Clock Recovery method, so that the HDMI protocol can transmit video signals one more channel, and the signal transmission bandwidth is improved. Meanwhile, in the FRL mode, a new physical layer transmission mode can be introduced, a 16b/18b coding mode is used, the utilization rate of the channel bandwidth is further improved, the channel can transmit higher resolution and image update rate, in the FRL mode, the bandwidth can be improved to 48Gbps, and the image transmission with the resolution of up to 10K can be transmitted by using a compression mode.

Based on the additional function of the FRL transmission mode, the external device supporting the HDMI2.1 protocol may initiate an FRL mode training (FRL training) procedure to the display device after accessing the external device interface 240 (i.e., HDMI interface). If the external device does not initiate the FRL mode training process after being connected with the HDMI interface, the external device can be directly determined that the external device does not support the transmission protocol of the new version, namely the external device does not support the HDMI2.1 protocol, at the moment, the EDID of the display device can be switched to the form of the 2.0 version, so that the external device can be identified, and the data connection relation based on the HDMI2.0 version is established.

When the external device initiates the FRL mode training process to the display device, it can be determined that the current external device may support the HDMI2.1 version, but if the external device initiates the FRL training to judge the adaptive transmission protocol only through whether the external device initiates the FRL training, but the FRL training process fails, so that the FRL training process is always performed, and the situation that the external device does not send signals under the EDID2.1 occurs. Therefore, after determining that the external device initiates the FRL tracking process, the display device can also determine that the current external device supports the HDMI2.1 version by detecting whether the current FRL tracking process is successfully completed, if so, the display device can be controlled to switch the EDID version to the 2.1 version, so that the external device is compatible.

In some embodiments, in order to detect whether the FRL tracking process is successfully completed, the display device may detect whether a path mode (pattern) sent by the external device is consistent with a path mode parameter preset by the display device, and determine whether the FRL tracking process is successfully completed according to a detection result. When the pattern parameter sent by the external device is consistent with the pattern parameter preset by the display device, determining that the FRL tracking process is successfully completed. It can be seen that in some embodiments, when the external device is accessed, the display device may determine whether the external device can implement the additional function of the new version of the transmission protocol by detecting the configuration process of the new version function, so that the display device and the external device may be automatically switched to the corresponding transmission protocol version according to the detection result, and the communication connection relationship is established based on the corresponding transmission protocol version, so as to improve the compatibility between the display device and the external device.

In some embodiments, fig. 12 is a schematic flow chart of detecting a protocol version of an external device through a device management list according to one or more embodiments of the present application, as shown in fig. 12, in order to quickly determine a type of a transmission protocol supported by the external device, a device management list may also be constructed in a display device, where device information of the external device accessing the display device and the transmission protocol version supported by the external device may be stored in the device management list. Thus, after hearing the external device connected to the external device interface 240 of the display device, the display device may obtain device information frame (Source Product Description, SPD) data of the external device. The SPD data is a data frame which is specified in the HDMI protocol and used for describing the information of the source equipment, the SPD data frame can be generated based on the basic HDMI protocol, and auxiliary information which is used for describing the equipment information can be sent to the display equipment under the condition that the external equipment is not required to be additionally configured. Because the external device can transmit the SPD data frames according to the preset time interval while transmitting the media information data, the display device can acquire the SPD data frames transmitted by the external device when the external device is connected to the HDMI interface.

After the SPD data is acquired, the display device may also read device identification information from the SPD data. The read device identification information may include a device type and a model, for example, the device type may be a game machine, a multimedia player, an intelligent terminal, etc., and the model may be written into a specific signal form according to a product iteration sequence under the device type. The new and old degree of the product of the external equipment can be identified through the signals, and the specific protocol version which can be supported by the product is determined based on different models. For example, for an early model of gaming machine, it generally did not support a new version of the transmission protocol because the new version of the transmission protocol was not yet established at the time of its marketing. With the continuous updating of products, the game machine with recent signals can support new version of transmission protocol.

After the device identification information of the external device is read, the display device can be matched in the stored device management list according to the device identification information so as to determine whether the content related to the current external device is recorded in the device management list. If the device identification information is in the device management list, the transmission protocol version supported by the current external device can be determined according to the device management list. And switching the transmission protocol to the transmission protocol version stored in the device management list. For example, by reading SPD data, device identification information of an external device, that is, a Game machine model "Game xx-2020s" is obtained, and according to the device identification information, an entry including the Game machine model may be matched in a device management list stored in the display device. When the display device matches an entry containing "Game xx-2020s" in the device management list, a transmission protocol version supported by the current external device, that is, a parameter value corresponding to the HDMI2.1 item is 1, which indicates that the current external device supports the HDMI2.1 version, may be extracted from the entry.

Similarly, if the device identification information is not in the device management list, that is, the device management list does not record information about the current external device, the display device may execute the step of detecting the new version function flag, that is, detect the version of the transport protocol supported by the external device in the manner described in some embodiments. Therefore, by storing the device management list in the display device, the transmission protocol version supported by the external device can be obtained directly through the device management list when the external device is accessed, so that the transmission protocol version can be switched rapidly.

In some embodiments, fig. 13 is a schematic flow diagram of updating a device management list according to one or more embodiments of the present application, as shown in fig. 13, in order to enable an external device connected to a display device to quickly determine a supported transmission protocol version when accessing later, for an external device not recorded in the device management list, the display device may extract device information of the external device and the supported transmission protocol version of the external device after switching transmission protocols; and storing the equipment information and the transmission protocol version into the equipment management list according to the data storage rule in the equipment management list, so as to update the equipment management list. Based on the above, when the external device is connected with the display device again, the display device can directly acquire the transmission protocol version supported by the external device based on the updated device management list, so as to improve the switching speed of the subsequent transmission protocol version.

For an external device that is not recorded in the device management list, in order to enable the external device to configure a new version function, fig. 14 is a schematic flow chart of a process for detecting a new version function configuration according to one or more embodiments of the present application, as shown in fig. 14, in some embodiments, the display device may control a pull-up hot plug detection (hotplug detection, hpd) voltage to trigger the external device to initiate a configuration process of the new version function when detecting the new version function mark. For example, fig. 15 is a schematic flow chart of a configuration process according to an initiation flag detection according to one or more embodiments of the present application, as shown in fig. 15, after determining that there is no device identification information of a currently connected external device in the device management list, the display device may pull hpd high, and set "flt_ready" to 1, so as to trigger the external device to start executing the FRL tracking process. The external device may analyze EDID corresponding to the display device when starting to execute the FRL tracking process, and determine whether the display device supports the FRL mode.

After triggering the external device to initiate the configuration process of the new version function, the display device can read the initiation mark in a preset detection period so as to detect whether the external device configures the new version function. The initiation flag is a flag field set in a register by the external device. For example, for an external device supporting HDMI version 2.1, when it detects: frl_max_rate > 0, scdc_present=1, sink Version is not 0, it is determined that the current display device supports FRL, so whether SCDC flt_ready is 1 will be read next; when the external device reads flt_ready=1, the frl_rate and the forward feedback equalization (Feed Forward Equalization, FFE) level (level) are set in the corresponding register, and the display device can determine whether the external device initiates the FRL tracking process by detecting whether the frl_rate and the FFE level are set in the corresponding register.

If the initiation mark is not read in the preset detection period, the configuration process of the new version function is determined to be not initiated by the current external device, so that the new version function mark is marked to be undetected, and further, the current external device is determined to not support the new version transmission protocol, and the data connection relation is established through the old version transmission protocol. If the initiation flag is read in the preset detection period, the external device may initiate a configuration process of the new version function, so as to accurately determine whether the external device supports the new version of the transmission protocol, in some embodiments, the display device may further send a mode setting request of each data transmission path to the external device, and receive mode information fed back by the external device according to the mode setting request. For example, fig. 16 is a schematic diagram of a detection mode parameter consistency flow according to one or more embodiments of the present application, as shown in fig. 16, the display device may make frl_start=0 by setting parameters and request a mode (pattern) for each path (lane) through an Ln (x) _ltp_req register. After detecting the register parameters, the external device may send out the pattern of the corresponding path pair according to the Ln (x) _ltp_req register, so as to set a mode for each path.

The display device compares the mode information with the set mode parameters of the new version function, and if the mode information is consistent with the set mode parameters of the new version function, the mark detects the new version function mark. Similarly, if the mode information is inconsistent with the set mode parameters of the new version function, the mark does not detect the new version function mark. For example, when detecting that the received pattern is consistent with the HDMI version 2.1 setting parameter pattern, the display device may determine that the FRL tracking has been completed successfully, and thus may set the Ln (x) _ltp_req register to 0 as a flag for determining that the FRL tracking is completed, that is, detecting determines that the external device supports the HDMI version 2.1.

When the display device detects the transmission protocol version supported by the external device, a data connection relationship can be established between the display device and the external device based on the corresponding version, and media data can be transmitted. In order to stabilize the subsequent media data transmission process, after the display device detects that the FRL tracking process is successfully completed, the display device may not directly maintain EDID at version 2.1 and still needs to determine whether error is generated in the signal transmission process and whether the detected resolution is correct. In some embodiments, fig. 17 is a schematic flow chart of a process of monitoring a transmission procedure of a media asset signal according to one or more embodiments of the present application, as shown in fig. 17, a display device may receive a media asset signal sent by an external device after switching a transmission protocol to a first version, and monitor an error report in the media asset signal. If the error report is not monitored in the preset monitoring period, maintaining the transmission protocol as a first version; and if the error report is monitored in the preset monitoring period, switching the transmission protocol to the second version.

Meanwhile, the display device can also detect the image resolution in the media information signal after switching the transmission protocol to the first version; and comparing the detected image resolution with the preset resolution in the new version function, and if the image resolution is equal to the preset resolution in the new version function, determining that the resolution in the signal transmission process is correct, so that the transmission protocol can be maintained as the first version. If the resolution of the image is not equal to the preset resolution in the new version of the function, it may be determined that the resolution in the signal transmission process is incorrect, and thus the transmission protocol may be switched to the second version. For example, through error report and resolution detection in the signal transmission process, when error report is not generated in the signal transmission process and the resolution is correct, the EDID of the display device is kept unchanged by 2.1, and the external device is marked as 2.1 device; if error and resolution abnormality exist all the time, it indicates that there is a problem in signal quality when the device transmits a signal, and at this time, the abnormality of the device or wire affects user experience, so that EDID can be switched to version 2.0 at this time.

After the display device determines that the configuration process of the new version function is unsuccessful and switches the transmission protocol to the old version, the display device can also detect a specific transmission protocol version supported by the external device. For example, after switching the EDID to 2.0, the display device may further detect the protocol to determine the specific protocol version supported by the current external device.

The display device may determine whether the external device supports the HDMI version 2.0 protocol by determining whether the register contents exist, but in some cases, SCDC communication may fail, resulting in a problem of inaccurate determination. Thus, fig. 18 is a flow diagram of switching transmission protocol versions according to a transmission bit rate according to one or more embodiments of the present application, as shown in fig. 18, in some embodiments, the display device may further detect a transmission bit rate (bit ratio) sent by the external device when switching the transmission protocol to the second version. Wherein the transmission bit rate is a transmission parameter additionally set by the second version of the transmission protocol relative to the third version of the transmission protocol. If the external equipment sends the transmission bit rate, switching the transmission protocol to the second version; and if the external device does not send the transmission bit rate, switching the transmission protocol to the third version. For example, after judging whether the register content exists, the display device needs to judge whether the external device transmits the TMDS bit rate, and if the display device detects that the external device transmits the TMDS bit rate, it can be determined that the external device is a device supporting the HDMI2.0 protocol. If the register content exists or the TMDS bit rate is not detected, the current external device is determined not to support the HDMI2.0 version, and therefore the display device can be controlled to switch to the EDID1.4 version.

Different data transmission modes can be adopted by different transmission protocols, and correspondingly, different signal transmission rates are possessed. For example, the most important part of the HDMI2.1 protocol is the increase of the transmission bandwidth of the HDMI channel, from 18Gbit/s to 48Gbit/s of HDMI2.0, and meanwhile, the transmission-minimized differential signaling (TMDS) coding format used by HDMI1.4/2.0 is omitted, and a 16b/18b coding mode is adopted. Thus, the display device can determine the transmission protocol version to which the current signal transmission process conforms by detecting the transmission bit rate.

FIG. 19 is a flow diagram of switching transmission protocol versions according to clock source rates according to one or more embodiments of the present application, as shown in FIG. 19, in some embodiments, the display device may detect the clock source rate of media asset signals sent by the external device when switching the transmission protocol to the second version; if the clock source rate accords with the rate specified by the second version of transmission protocol, switching the transmission protocol to the second version; and if the clock source rate meets the rate specified by the third version of the transmission protocol, switching the transmission protocol to the third version. For example, the display device may detect a clock source rate (clk rate) of a signal transmitted by the external device, and since the transmission rate is different from that of HDMI2.0 in HDMI1.4, it may be determined whether the external device is a 2.0 device according to the detected transmission rate.

< use scene matching Pattern >

When the user realizes connection between the display device and the game device through the HDMI interface, the game device is responsible for running the game application and forms video data and audio data according to the interactive operation of the user, the display device can only passively acquire the audio data and the video data output by the game device, and the game device can acquire better image quality and sound quality only by different video and audio output modes under different game modes. The game device cannot directly adjust the output mode of the display device, so that the output mode is not consistent with the use scene, and the video and audio effects are affected. FIG. 20 is a schematic flow diagram of adaptive parameters of a display device according to one or more embodiments of the present application for adapting a usage scenario of an external device; as shown in fig. 20, some embodiments of the present application provide a display device including a display, a communicator, and a controller. The display is configured to present a user interface and a picture corresponding to the video signal transmitted by the external device; the communicator is configured to establish a communication connection with the external device, thereby receiving video data and/or audio data transmitted by the external device. The controller is configured to detect the received video data and/or audio data, so as to judge the use scene information of the external device according to the video data and/or audio data, and adjust the output mode according to the use scene information, thereby implementing the adaptive parameter implementation method.

In some embodiments, the display device may be built in a Low-latency Mode (LLM), and the external device is built in an Auto Low-latency Mode (all). The low-delay mode can be automatically started or forbidden by the source terminal according to a preset rule under the condition that a user of the Sink terminal display equipment terminal does not need to set manually. For example, when a user receives a video phone while watching a movie, the external device at the source end automatically stops playing the movie and notifies the Sink end display device to switch to a low-delay mode, so as to ensure the real-time interaction performance of the video phone. After the user receives the video telephone, the source end external device can resume the film playing process and inform the Sink end display device to exit the state of the low-delay mode. In the process that the external device transmits the video signal and the audio signal to the display device, the display device can detect the use mode of the external device by executing the self-adaptive parameter implementation method, and automatically adjust the output mode according to different use modes.

In some embodiments, the controller of the display device may be configured to perform the following program steps: and receiving media information sent by the external equipment, and detecting the use mode of the external equipment according to the media information. When the external device is connected to the display device each time, the display device can detect the behavior of the external device in real time, so that the use mode of the external device is determined. The specific detection mode can be that the display equipment reads the data frames in the media information, and the use mode of the external equipment is determined according to the reading result. For example, an HDMI protocol specifies a data frame (SPD) describing information of the device itself, and the external device may transmit the data frame at a preset time interval while transmitting media information data. The display device then reads the device class at the specific byte position from the data frame after receiving the data frame, e.g. "8" for "game device", "9" for "host device", "10" for "DVD device", etc.

Before the judging of the usage mode of the external device, the display device may also judge whether the external device supports the function of transmitting the usage mode. For example, it may be determined whether the external device supports ALLM by reading an ALLM flag location value in the VSIF (Vendor Specific info Frame, vendor specific information frame), and if the ALLM flag location in the VSIF is 1 at a certain time, it is indicated that the device supports ALLM. Therefore, the ALLM function of the display device is automatically started when the type of equipment is accessed again later by reading the SPD description information of the external equipment and recording the SPD description information in the database.

If the external equipment supports ALLM, the display equipment can automatically start an ALLM processing mechanism, so that the image quality and tone quality parameters of the display equipment are dynamically updated according to the ALLM state sent by the external equipment. For example, when the almm state of the game device is 0, it indicates that the game is not being played, and possibly a movie is being played, and at this time, the image quality and sound quality parameters of the display device should be kept in a user-defined state; when the ALLM state of the game device is 1, the game device is played, so that the display device can further classify the game types through image recognition, and set image quality and tone quality parameters corresponding to the display device according to the preset value of the game types, so that a better display effect is obtained. If the external device does not support ALLM, the display device can acquire SPD information of the external device. If the external device is determined to be game device in the SPD information, the external device can be assumed to be in a game playing state all the time, at the moment, the display device further classifies the game types through image recognition, and image quality and sound quality parameters corresponding to the display device are set according to the preset value of the game types.

In some embodiments, when the external device accesses the display device for the first time, adaptive logic may also be executed, and the recognition result may be saved. Therefore, fig. 21 is a schematic flow chart of determining a first access state according to one or more embodiments of the present application, as shown in fig. 21, when an external device is connected to a display device, the display device may determine whether the external device is currently connected to the display device for the first time, and if the external device is connected to the display device for the first time, extract SPD description information of the external device, perform the above-mentioned picture and sound quality parameter adjustment, and store and record adjustment parameters. When the external equipment is connected with the display equipment, if the current external equipment is judged not to be accessed to the display equipment for the first time, the stored adjustment parameters can be directly called according to the equipment information, and the self-adaptive result can be directly obtained. Meanwhile, the display device can also set an ALLM switch according to the self-adaptive result, and execute different image quality and tone quality adjusting programs according to the switch state of the ALLM.

In some embodiments, when the almm switch is in an on state, the display device may detect, in real time, an almm state change of the external device through the thread loop body, and if the almm state change is almm=1, further obtain video data and/or audio data sent by the external device, so as to detect a usage scenario of the external device according to the data. For example, the display device may acquire a game screen of the external device at this time, and perform image analysis processing on the game screen to determine a game type class to which the current game screen belongs, and set different image quality and sound quality parameters according to different game types. For example, for shooting type, sport type and action type games, it is necessary to reduce the delay of game pictures so as to make the game experience smoother. If the ALLM state is changed to 0, the processing of the image quality and the sound quality can be stopped, and the image quality and the sound quality parameters are restored to user-defined values so as to ensure the normal viewing experience of the user.

In some embodiments, when the all switch is in the off state, the display device cannot directly obtain the usage scenario of the external device through the all protocol, so that SPD information of the external device can be obtained. If the media data sent by the external equipment has SPD information, the SPD information can be analyzed, the equipment type of the external equipment is obtained, and then different image quality and tone quality adjustment modes are selected according to different types of the external equipment. For example, by analyzing the SPD information, the display device may determine whether the external device is a game device, and if the external device is a game device, may determine a currently running game type according to the game image pair, and set different image quality and sound quality parameters according to different game types. If the external device is not game equipment, the image quality and tone quality parameters can be restored to user-defined values so as to ensure the normal viewing experience of the user.

< game type match Sound image quality Pattern >

In order to obtain a better playing effect, the display device may perform image quality adjustment or sound quality adjustment on the played audio and video content. For example, the display device may estimate the trajectory of the object motion in the display frame by running a motion estimation and motion compensation (Motion Estimation and Motion Compensation, MEMC) algorithm, and compensate for frames that are not in the video source itself, so that the frame dynamic effect is smoother. The user can control the display device to play according to the set parameters by presetting parameters of image quality adjustment and sound quality adjustment. After the display device is connected with the external device, different pictures or sounds can be presented according to different audio/video data sent by the external device. And a picture or sound needs to be in a specific audio-video quality adjusting mode to obtain a better playing effect. For example, the shooting game screen is suitable for running in a higher brightness and freshness mode, and is more beneficial for a player to capture a fine scene of the game screen; the leisure game picture can be used for adjusting the color temperature to be warm so as to relieve visual fatigue. However, the audio/video quality adjustment mode of the display device is generally set by the user, and then the display device is always set to play audio/video. Therefore, in some scenes, there is a problem that the audio/video data is not compatible with the audio/video quality adjustment method, and the display or sound effect is poor.

In order to solve the problem that the audio and video data are inconsistent with the audio and video quality adjustment mode, some embodiments of the present application provide an audio and video parameter adjustment method, which can be used for a display device, so that the display device can automatically identify scene classification and automatically select a suitable audio and video quality mode according to the scene classification. In some embodiments, the controller may implement the audio-visual parameter adjustment method by running an application program corresponding to the audio-visual parameter adjustment method, and fig. 22 is a timing chart of the audio-visual parameter adjustment method according to one or more embodiments of the present application, as shown in fig. 22, specifically including the following: and acquiring a control instruction for adjusting the audio and video quality, which is input by a user. After the display device and the external device are in communication connection, the display device can receive audio and video data sent by the external device through an external device interface. The audio and video data can present different picture contents according to different operation scenes of the external equipment. For example, when the display device is connected to the game device, the game device may generate and render audio-video data by running a game program, that is, when the game device runs a shooting game, a shooting game screen may be generated and transmitted to the display device in the form of audio-video data.

The user can control the display device to play the audio and video data sent by the external device by inputting a series of interaction actions. For example, fig. 23 is a schematic diagram of a signal source selection interface according to one or more embodiments of the present application, as shown in fig. 23, after a game device is connected to an HDMI1 interface of a display device, a user may control the display device to switch signal sources by controlling a "signal source" key, or a direction key and a confirm key on the apparatus 100 and based on the signal source selection interface, so that the signal source of the display device is the HDMI1 interface. After the signal source is set, the display device may receive the game picture generated by the game device from the HDMI1 interface, and automatically play the audio/video data corresponding to the game picture, that is, when the user controls the display device to switch the signal source through the control apparatus 100, a control instruction for adjusting the audio/video quality is input.

In some embodiments, the display device may also automatically switch to playing a signal corresponding to the external device when the external device is connected or has a signal input. For example, the display device may continuously detect the connection state of the HDMI1 interface, and when a game device is connected to the HDMI1 interface of the display device, the display device may automatically switch the signal source to the HDMI1 interface to play the audio/video data sent by the game device.

Since the purpose of the control command is to trigger the display device to perform audio and video quality adjustment, and the audio and video quality adjustment process is generally directed to a specific audio and video picture, in some embodiments, the display device may detect whether the external device transmits audio and video data that needs to perform audio and video quality adjustment, and perform audio and video quality processing when detecting that the external device transmits corresponding audio and video data. For example, when the game device is connected to the display device but a specific game program is not run, the display device does not need to perform audio-video quality adjustment; when the game device runs a specific game program, a mark is added in the HDMI protocol frame, and when the mark is detected, the display device can start to execute the audio and video quality adjustment related program, which is equivalent to inputting a control instruction for triggering audio and video adjustment.

In some embodiments, the user may also manually control the display device for audio and video quality adjustment. For example, FIG. 24 is a schematic diagram of a game optimizer window in accordance with one or more embodiments of the application, as shown in FIG. 24, wherein the display device may display a game optimizer window that may include a "sound and picture matching" control for selection by a user as the display device plays a game screen sent by the game device. After the user selects the "sound and image matching" control and presses the confirm key, the display device starts to execute the subsequent sound and image quality adjusting program, i.e. inputs a control instruction for sound and image quality adjustment.

After a control instruction for audio-video quality adjustment is input by a user, the display device may analyze received audio-video data in response to the input control instruction to identify scene classification from the audio-video data. The scene classification refers to scene classification of the external device when sending audio and video data. For example, when the external device to which the display device is connected is a game machine, the game machine has different sound and image quality effects when running different types of games, and thus the game type can be classified as a scene, that is, the scene classification includes a shooting class, a motion class, a sports class, a leisure class, and the like. Scene classification may be obtained by performing image recognition on picture content in audio-video data. That is, after the control instruction is acquired, the display device may determine at least one image to be identified in the audio and video data, and perform image identification on the image to be identified, so as to acquire information related to scene classification from the image to be identified. For example, the display device may sample audio-video data transmitted by the game device, extract an image identical to the display screen, perform optical character recognition (Optical Character Recognition, OCR) on the image to identify characters from the extracted image, and match segments in the characters to obtain a game name of the running game.

In some embodiments, in the process of identifying the scene classification, the display device may further identify feature information in the image to be identified after extracting the image to be identified from the audio/video data, so as to determine the corresponding scene classification when the image to be identified contains the preset feature information. For example, for a shooting-class game screen, a firearm model may be generally included, so when the firearm model is included in the image to be recognized, it may be determined that the scene corresponding to the current game screen is classified as a shooting class. Similarly, for action-like game visuals, a cold weapon model is typically included; for athletic game play, vehicle, sporting goods models are typically included. The display device may determine a scene classification to which the corresponding game screen belongs by identifying the above-described model feature in the image to be identified. And for the leisure game screen, since it generally does not include specific model features, the display device can determine that the current game screen belongs to the leisure game when the features of the above three game categories are not recognized in the image to be recognized.

In some embodiments, in the process of identifying scene classification, the display device may also perform identification analysis on the characteristics of the picture with the identification image, including the color type, color element, scene style, and the like of the picture. For example, shooting and action games are characterized by rich color composition, sports games are characterized by more realistic scenes, and leisure games are characterized by single color elements, etc. The display device can further confirm the scene classification of the current audio and video data according to the picture characteristics. It should be noted that, in the process of performing scene classification recognition on the audio/video data, the display device may adopt one of the above recognition modes, or combine multiple of the above recognition modes, so as to obtain a more accurate scene classification recognition result.

After performing image recognition on the audio and video to obtain a scene classification, the display device may query based on the determined scene classification to query for an audio and video quality pattern conforming to the scene classification. Because the characteristics of the pictures presented by different scene classifications are different, in order to obtain a better display effect, the display device can preset different audio and video quality adjustment strategies according to different scene classifications. For example, for shooting-type games, in order to facilitate the user to quickly recognize shooting targets, the definition and brightness of the game screen may be appropriately increased so that the user can see dark detail. For action-like games, the chroma value may be increased to make the color more saturated. For athletic games, standard hues may be maintained to restore more realistic scene effects. For leisure games, the color tone of the picture can be adjusted to be mainly warm, so that the user can watch the process more comfortably.

Similarly, for the tone quality adjustment process, different tone quality adjustment strategies can be set according to different scene classifications. For example, for shooting games, the middle-high frequency sound in the audio output process can be controlled to be improved so as to enhance the sound definition and improve the positioning sense; for action games, the bass volume can be increased to make the striking sense stronger; for sports games, the gain of the output path of the surround sound can be improved so as to improve the surround feeling and create a scene feeling experience. The audio and video quality adjustment strategy corresponding to each scene classification can be stored in the database in advance as a comparison table. After the display device determines the scene classification through image recognition, the display device may call a comparison table from the database, and match in the comparison table according to the scene classification name (or code) to determine the audio-video quality mode conforming to the scene classification. For example, when the display device recognizes that the scene is classified as a shooting game, the comparison table 3 may be called from the database.

Table 3:

according to the comparison table, the display device can query the tone quality adjustment strategy and the image quality adjustment strategy corresponding to the shooting game, namely when playing the audio, the gain of the output path of the middle-high frequency band in the audio needs to be increased by n1 percent so as to improve the sound positioning feeling. When the video is played, the definition of the display picture is improved by m1 percent, and the brightness is improved by m2 percent, so that the details of the dark part can be clearly displayed. The specific adjustment values of the sound quality policy and the image quality policy need to be comprehensively set according to the hardware configuration of the display device so as to achieve the optimal display effect. After the audio and video quality mode is obtained through inquiry, the display device can play the audio and video data according to the audio and video quality mode. That is, the display device may parse the audio-visual quality mode to obtain image parameters and/or sound parameters; and then setting an image output mode in the audio and video data according to the image parameters and/or setting an audio output path gain in the audio and video data according to the sound parameters.

In the process of adjusting the gain of the image output mode and the audio input path, the display device needs to detect the output mode before adjustment, and comprehensively determine the final effect according to the output mode before adjustment and the audio/video quality mode to be adjusted. For example, when the display device detects that the current external device runs the shooting game, the display device may first acquire the current image quality output mode and the audio output path gain, that is, the standard image quality mode (definition 50%, brightness 50%), and the standard sound quality mode (audio output path gain is equal to each frequency band, both are 50%). At this time, the display device determines the image quality adjustment policy and the audio adjustment policy according to the above-mentioned comparison table. According to the image quality adjustment policy, the display device may adjust the output screen of the display 260 to: the sharpness is increased by 30 percent (namely, the sharpness after adjustment is 80 percent), and the brightness is increased by 20 percent (namely, the brightness after adjustment is 70 percent); meanwhile, the display device sets the gain of the audio output path as follows according to the tone quality adjustment strategy: the medium-high frequency is increased by 20% (i.e. the output gain of the adjusted medium-high frequency band audio path is 70%), and meanwhile, in order to obtain stronger sound immersion, the display device can also start sound effects such as surround sound when shooting games are detected.

In some embodiments, since different audio and video quality adjustment strategies are required for different scene classifications, when the display device monitors that the scene classification of the external device changes, audio and video quality adjustment is also required to adapt to the new scene classification. For example, when the display device monitors that the external device is switched from the shooting game to the action game, the audio and video quality mode is switched back to the standard mode, and then the audio and video quality adjustment adapting to the action game is performed based on the standard mode. Namely, according to the tone quality adjustment strategy, the bass volume is adjusted from 50% to 75%, so as to increase the striking sense sound effect; according to the image quality adjusting strategy, the chromaticity value is adjusted from 50% to 60% so as to make the picture color more full. Therefore, in some embodiments, the display device may automatically identify the scene classification of the external device, and automatically adjust the playing mode of the audio and video data according to the identified scene classification, so as to automatically match the scene classification with the audio and video parameters, so that the display device may maintain the audio and video quality adjustment mode according with the audio and video data, and improve the picture display effect under different scene classifications.

Based on the above embodiments, it can be known that, in the process of performing automatic matching of the audio and video quality modes, the display device mainly receives audio and video data in the step of identifying the scene classification according to the audio and video data, and then generates video data to be identified according to the audio and video data, so as to improve the identification accuracy of the scene classification. The video data to be identified are specially used for identifying the current scene classification of the external equipment. The period of time for acquiring the video to be identified is referred to as an analysis period for convenience of description, i.e. the analysis period starts when the external device interface receives the audio/video data and ends when the external device enters the application scene.

For example, the display device may determine the data received by the HDMI interface by detecting the hot plug voltage, when the external game device sends audio and video data to the display device through the HDMI interface, the display device may save the video data in the received audio and video data, and when the user controls the display game device to run the game application into the game state, the display device may read notification information of entering the game state from the received audio and video data. And in the period from the start of receiving the audio and video data to the entering of the game state, the video data stored by the display equipment are the video data to be identified.

Since a portion of the audio/video data does not support storage during transmission, fig. 25 is a flowchart illustrating a scene classification identified by a key frame according to one or more embodiments of the present application, as shown in fig. 25, in some embodiments, the display apparatus may detect the audio/video data received by the external device interface, and start recording the screen content displayed by the display 260 when detecting that the external device interface has the audio/video data input. Meanwhile, the display device may further obtain notification information of the external device entering the application scene, and when the notification information is obtained, end recording the picture content displayed by the display 260 to generate the video data to be identified. After generating the video data to be identified, the display device may extract key frames from the video data to be identified in reverse order of time. The key frame is a display picture containing a scene name of an application scene in a multi-frame display picture of the data to be identified. For example, fig. 26 is a schematic diagram of a game details interface according to one or more embodiments of the present application, as shown in fig. 26, a key frame may be a display frame corresponding to the game details interface, that is, a user may select any game icon in a game list interface during use of the game device, where the game device may jump to the game details interface, and the game details interface may include content such as a specific logo, a game name, a game classification, a game developer, and a game description of the selected game.

After extracting the key frame, the display device may perform image recognition on the key frame image, so as to identify an application scene name from the key frame image, and query scene classification according to the scene name. For example, after extracting a key frame image corresponding to the game detail interface, the display device may obtain a game specific logo in the key frame image through an OCR word recognition algorithm, and analyze the logo content, including a word content, a graphic content, and the like. And comparing the logo content obtained through analysis with game names preset in a database, so that more accurate game names can be obtained, and further the game types can be obtained.

Because the external device 200 is complicated in variety, and the corresponding application scenes are numerous, which is not beneficial to storing a large amount of scene information in the display device, fig. 27 is a schematic flow chart of querying the scene classification by the server according to one or more embodiments of the present application, as shown in fig. 27, in some embodiments, the application scene name and the belonging classification may also be maintained by the cloud server. That is, the display device may further include a communicator 220, where the communicator 220 is configured to connect to the server 400, and the server 400 may maintain the scene names and the scene information including a large number of scenes as preset scene information for the display device to query.

Based on this, the display device may further generate a query request according to the scene name in the step of querying the scene classification according to the scene name, and send the query request to the server 400 to trigger the server 400 to calculate the matching degree between the scene name and the preset scene information. The preset scene information comprises a standard scene name and a scene classification corresponding to the standard scene name. When the degree of matching is greater than the matching threshold, the server 400 may feed back the scene classification to which the scene name belongs to the display device. The display device may obtain the corresponding scene classification by receiving the scene classification fed back by the server 400 for the query request. For example, the display device may continuously record video data to be recognized from when the HDMI starts to have a signal to when the notification of entering the game is turned off, and perform picture detection from back to front in reverse order of time, and determine the game name selected when the user enters the game state, i.e., "infin×". And then the game name is sent to the cloud server in a query request mode, the cloud server can maintain the game name and the category of the game, and the proportion of the same character number between the game name and the preset name to the total character number is determined as the matching degree according to the comparison of the predefined game information and the query information. When the matching degree is greater than a certain threshold value, the game type which is matched with the game name 'INFIN×' best is returned to the display device as 'shooting type'.

According to the embodiment, in order to identify the current scene classification, the display device can identify the scene name from the key frame image based on the recorded video data to be identified, so that the scene classification is queried through the scene name, and the method for identifying the scene classification has the advantages of less data processing amount, wide application range and more accurate identification of the game type.

To further improve the recognition accuracy of the scene classification, in some embodiments, the display device may also recognize the scene classification based on the image recognition model. In the step of identifying scene classification according to the audio and video data, the display device may acquire a sampling image, where the sampling image is an image extracted from the audio and video data after the external device enters the application scene. The display device may extract one or more frames of images from the audio-video data as sampled images. When the display device extracts a plurality of frame images as sampling images, the plurality of frame images should have a certain sampling interval therebetween, for example, the display device may extract one frame image every 1s in time order. The interval sampling can relieve the excessive similarity of picture contents among multi-frame sampling images, so that the recognition result is more universal, and the accuracy of scene classification recognition is improved.

The display device may also extract the sampled image by means of screen capturing, fig. 28 is a schematic flow diagram of identifying scene classification by means of an image identification model according to one or more embodiments of the present application, as shown in fig. 28, in some embodiments, the display device may monitor interaction actions input by the user for triggering scene identification; and after the user inputs the interaction action for triggering scene recognition, screenshot operation is performed on the current display picture so as to acquire the sampling image. For example, the display device may check the access device, and when it is determined that the external device is a device such as a PC or a game machine through information such as a model of the external device, a "game optimizer" window may be displayed during playing of the game screen, and monitor interaction of the user based on the "game optimizer" window. After the user clicks the "sound and picture matching" control on the "game optimizer" window, the display device may start a background screenshot procedure, and perform a screenshot operation on the currently displayed game screen to obtain a sampled image.

After extracting the sampled image, the display device may load an image recognition model for scene classification recognition of the sampled image. The image recognition model is a machine learning model obtained through training by using sample images in a plurality of application scenes. That is, in some embodiments, the display device may construct an image recognition model through sample training prior to recognizing the scene classification, i.e., the display device may first acquire training sample images. The training sample image may be provided by an operator or a server, and the training sample image includes a scene classification label, i.e. label information for marking the scene classification to which the current image content belongs. Different training sample images may contain different image content, as well as different label information. And defining image recognition features, wherein the image recognition features comprise model features and picture features, and importing the image recognition features into a machine learning model as high-weight information through a protocol stack. And inputting the training sample image into a machine learning model to obtain an image recognition model after multiple iterations.

For example, the display device may input a large number of different kinds of game pictures as training sample images in advance, and since current game classification standards are different, game types are also various, so the display device may divide games into four major categories based on the game pictures, namely: the running pictures of the four games have remarkable characteristics, namely, the following image recognition characteristics can be defined for training sample images, as shown in table 4:

TABLE 4 Table 4

Game type	Shooting type	Action class	Sports athletic class	Leisure type
Model features	Firearm	Cold weapon	Vehicle with a vehicle body having a vehicle body support	Without any means for
Picture characteristics	Rich in color composition	Rich in color composition	Scene fidelity	Single color element

The display device can use the machine learning protocol stack to guide the characteristics as information with higher weight into the machine learning model, and uses the four types as classification labels, and can obtain the image recognition model capable of outputting accurate scene classification results after repeated iterative learning training.

After training to obtain the image recognition model, the display device can store the image recognition model obtained through training, so that the stored image recognition model can be called when the display device performs scene classification recognition. It should be noted that, since the training process of the image recognition model needs to be performed with multiple iterative learning through a large number of sample images, the training process of the image recognition model may occupy the operation resources of the display device, and therefore, in some embodiments, the training process of the image recognition model may be further completed by the server 400 connected to the display device and uniformly issued to the display device, so as to relieve the operation pressure of the display device.

The image recognition model obtained through training can be applied to subsequent scene classification recognition. The display device can automatically judge scene classification of the sampled image through the image recognition model. That is, the display device may input the sampled image into the image recognition model after extracting the sampled image and the image recognition model. After the image recognition model is calculated, a model output result can be obtained, so that the display device can obtain the output result of the image recognition model, the output result comprises the classification probability of the sampled image relative to the scene classification, and the scene classification with the highest classification probability in the output result is extracted to be used as the scene classification of the external device at present.

According to the embodiment, the method for classifying and identifying the scenes through the image identification model is high in universality, and a comparison table with huge data quantity is not required to be maintained continuously, so that the display equipment can accurately identify the scene classification. Obviously, the method of the image recognition model and the method of the key frame character recognition can be used together in the scene classification recognition process of the display device, namely the display device can firstly recognize the scene name through the key frame and inquire to obtain scene classification, then recognize the classification probability of multi-frame sampling images through the image recognition model, and when the scene classification result obtained through the key frame is consistent with the scene classification result obtained through the image recognition model, the scene classification result is determined to be the scene classification of the current external device, so that a more accurate recognition result is obtained.

To meet the requirements of different users for image quality effects, in some embodiments, the display device may also prompt the user whether to perform related operations before performing automatic audio/video quality processing. Fig. 29 is a flowchart illustrating control of a prompt window according to one or more embodiments of the present application, as shown in fig. 29, after the step of extracting a scene classification with the highest classification probability in the output result, a controller of a display device may control a display to display the prompt window, and fig. 30 is a schematic view of the prompt window according to one or more embodiments of the present application, as shown in fig. 30. In the prompt window, a conversion control and an exit control may be included, and the user may control the display device to perform the automatic audio-visual quality processing based on the conversion control, and may also control the display device not to perform the automatic audio-visual quality processing based on the exit control.

Therefore, after the prompt window is displayed, the display device can detect the interaction instruction input by the user based on the prompt window; if the interactive instruction is to select the conversion control, that is, control the display device to execute automatic audio and video quality processing, a step of inquiring the audio and video quality mode conforming to the scene classification can be executed, so that the audio and video data can be played according to the audio and video quality mode. If the interaction instruction is that the exit control is selected, namely, the display equipment is controlled not to execute the related program of automatic audio and video quality processing, the display equipment still plays the audio and video data according to the default audio and video quality mode.

The foregoing description, for purposes of explanation, has been presented in conjunction with specific embodiments. However, the above discussion in some examples is not intended to be exhaustive or to limit the embodiments to the precise forms disclosed above. Many modifications and variations are possible in light of the above teaching. The embodiments were chosen and described in order to best explain the principles and the practical application, to thereby enable others skilled in the art to best utilize the embodiments and various embodiments with various modifications as are suited to the particular use contemplated.

Claims

A display device, comprising:

a display;

an external device interface configured to connect to an external device to receive audio/video data transmitted by the external device;

a controller configured to:

acquiring a control instruction for adjusting audio and video quality, which is input by a user;

in response to the control instruction, identifying a scene classification from the audio-video data, the scene classification being obtained by performing image recognition on picture content in the audio-video data;

inquiring the audio and video quality modes conforming to the scene classification;

and playing the audio and video data according to the audio and video quality mode.
The display device of claim 1, the controller configured to:

Receiving the audio and video data;

generating video data to be identified according to the audio and video data, wherein the video data to be identified is the video data stored in an analysis period; the analysis period starts when the external device interface receives audio and video data and ends when the external device enters an application scene;

extracting key frames from the video data to be identified according to a time reverse order, wherein the key frames comprise scene names of the application scenes;

and inquiring the scene classification according to the scene name.
The display device of claim 2, the controller configured to:

detecting audio and video data received by the external device interface;

when the audio and video data input of the external device interface is detected, starting to record the picture content displayed by the display;

acquiring notification information of the external device entering an application scene;

and when the notification information is acquired, finishing recording the picture content displayed by the display so as to generate the video data to be identified.
The display device of claim 2, further comprising a communicator configured to connect to a server, the controller configured to:

In the step of inquiring the scene classification according to the scene name, generating an inquiry request according to the scene name;

sending the query request to the server to trigger the server to calculate the matching degree between the scene name and preset scene information, and feeding back the scene classification to which the scene name belongs when the matching degree is greater than a matching threshold, wherein the preset scene information comprises a standard scene name and the scene classification corresponding to the standard scene name;

and receiving scene classification fed back by the server aiming at the query request.
The display device of claim 1, the controller configured to:

in the step of identifying scene classification according to the audio and video data, a sampling image is obtained, wherein the sampling image is an image extracted from the audio and video data after the external equipment enters an application scene;

loading an image recognition model, wherein the image recognition model is a machine learning model obtained by training sample images in a plurality of application scenes;

inputting the sampled image into the image recognition model;

obtaining an output result of the image recognition model, wherein the output result comprises classification probability of the sampled image relative to the scene classification;

And extracting the scene classification with the highest classification probability in the output result.
The display device of claim 5, the controller configured to:

after the step of extracting the scene classification with the highest classification probability in the output result, controlling the display to display a prompt window, wherein the prompt window comprises a conversion control and an exit control;

detecting an interaction instruction input by a user based on the prompt window;

if the interaction instruction is that the conversion control is selected, inquiring a sound and image quality mode conforming to the scene classification;

and if the interaction instruction is that the exit control is selected, playing the audio and video data according to a default audio and video quality mode.
The display device of claim 5, the controller configured to:

acquiring a training sample image, wherein the training sample image comprises scene classification labels;

defining image recognition features, wherein the image recognition features comprise model features and picture features;

importing the image recognition features serving as high-weight information into a machine learning model through a protocol stack;

inputting the training sample image into the machine learning model to obtain the image recognition model after a plurality of iterations;

The image recognition model is stored.
The display device of claim 5, the controller configured to:

monitoring interaction actions input by a user and used for triggering scene recognition;

after the user inputs the interaction action for triggering scene recognition, a screenshot operation is performed on the current display screen to acquire the sampling image.
The display device of claim 1, the controller configured to:

in the step of playing the audio and video data according to the audio and video quality mode, analyzing the audio and video quality mode to obtain image parameters and/or sound parameters;

and setting an image output mode in the audio-video data according to the image parameters and/or setting an audio output path gain in the audio-video data according to the sound parameters.
A sound and picture parameter adjusting method of display equipment, the said display equipment establishes communication connection with external equipment, in order to receive the audio and video data that the external equipment sends; the sound and picture parameter adjusting method comprises the following steps:

acquiring a control instruction for adjusting audio and video quality, which is input by a user;

in response to the control instruction, identifying a scene classification from the audio-video data, the scene classification being obtained by performing image recognition on picture content in the audio-video data;

Inquiring the audio and video quality modes conforming to the scene classification;

and playing the audio and video data according to the audio and video quality mode.
The method of claim 10, further comprising, in the step of identifying scene classification from the audio-video data:

receiving the audio and video data;

generating video data to be identified according to the audio and video data, wherein the video data to be identified is the video data stored in an analysis period; the analysis period starts when the external device interface receives audio and video data and ends when the external device enters an application scene;

extracting key frames from the video data to be identified according to a time reverse order, wherein the key frames comprise scene names of the application scenes;

and inquiring the scene classification according to the scene name.
The method of claim 11, further comprising, in the step of generating video data to be identified from the audio-video data:

detecting audio and video data received by the external device interface;

when the audio and video data input of the external device interface is detected, starting to record the picture content displayed by the display;

acquiring notification information of the external device entering an application scene;

And when the notification information is acquired, finishing recording the picture content displayed by the display so as to generate the video data to be identified.
The method of claim 11, wherein the step of querying the scene classification based on the scene name further comprises:

generating a query request according to the scene name;

sending the query request to the server to trigger the server to calculate the matching degree between the scene name and preset scene information, and feeding back the scene classification to which the scene name belongs when the matching degree is greater than a matching threshold, wherein the preset scene information comprises a standard scene name and the scene classification corresponding to the standard scene name;

and receiving scene classification fed back by the server aiming at the query request.
The method of claim 10, wherein the step of identifying scene classification from the audio-video data further comprises:

acquiring a sampling image, wherein the sampling image is an image extracted from the audio and video data after the external equipment enters an application scene;

loading an image recognition model, wherein the image recognition model is a machine learning model obtained by training sample images in a plurality of application scenes;

Inputting the sampled image into the image recognition model;

obtaining an output result of the image recognition model, wherein the output result comprises classification probability of the sampled image relative to the scene classification;

and extracting the scene classification with the highest classification probability in the output result.
The method of claim 14, further comprising, after the step of extracting a scene classification with a highest classification probability from the output result:

controlling the display to display a prompt window, wherein the prompt window comprises a conversion control and an exit control;

detecting an interaction instruction input by a user based on the prompt window;

if the interaction instruction is that the conversion control is selected, inquiring a sound and image quality mode conforming to the scene classification;

and if the interaction instruction is that the exit control is selected, playing the audio and video data according to a default audio and video quality mode.