CN113807375B

CN113807375B - Display equipment

Info

Publication number: CN113807375B
Application number: CN202010538074.6A
Authority: CN
Inventors: 杨鲁明; 王卫明; 王大勇
Original assignee: Hisense Visual Technology Co Ltd
Current assignee: Hisense Visual Technology Co Ltd
Priority date: 2020-06-12
Filing date: 2020-06-12
Publication date: 2024-05-31
Anticipated expiration: 2040-06-12
Also published as: WO2021248671A1; CN113807375A

Abstract

Embodiments of the present application illustrate a display device, which may include: display, camera and controller. The camera is used for collecting images, the controller is used for controlling the display to display an eye chart when receiving a starting instruction for vision test, and the eye chart at least comprises a first identification which is an identification required to be identified by a user; when the first mark is displayed on the display, the controller controls the camera to acquire a first image, matches the first image with the first mark, and generates a vision test result of the user according to the matching result. The display device shown in the embodiment of the application can help the user to perform vision test, and the user experience is good.

Description

Display equipment

Technical Field

The application relates to the technical field of social televisions, in particular to display equipment.

Background

Currently, a display device is receiving a great deal of attention from users because it can provide a user with a play screen such as audio, video, pictures, etc. With the development of big data and artificial intelligence, the functional demands of users on display devices are increasing. For example, a user may want to perform a vision test using a display device. The current display device cannot realize the realization of the above scene. Accordingly, there is an urgent need for a display device that can help a user to perform vision testing.

Disclosure of Invention

A first aspect of an embodiment of the present application shows a display apparatus, including:

The display device is provided with a display device,

The camera is used for collecting images;

The controller is used for responding to the received starting instruction and controlling the display to display an eye chart, and the eye chart at least comprises a first identification which is an identification required to be identified by a user;

When the display displays a first mark, controlling the camera to acquire a first image, wherein the first image is acquired after the display displays the first mark;

And generating a vision test result according to the matching result of the first mark and the first image.

A second aspect of an embodiment of the present application shows a display apparatus including:

A display;

receiving recognition voice input by a user, wherein the recognition voice is the user voice shown by the user according to a first identifier;

and generating a vision test result according to the matching result of the first identifier and the recognition voice.

A third aspect of an embodiment of the present application shows a display apparatus including:

A display;

The camera is used for collecting images;

The first controller is used for responding to the received starting instruction and controlling the starting of the camera; when the display displays a first mark, controlling the camera to acquire a first image; transmitting the first image to a second controller;

The second controller is used for responding to the received starting instruction and controlling the display to display an eye chart, and the eye chart at least comprises a first identification which is an identification required to be identified by a user; and generating a vision test result according to the matching result of the first mark and the first image.

A fourth aspect of an embodiment of the present application shows a display apparatus including:

A display;

The camera is used for collecting images;

The second controller is used for responding to the received starting instruction and controlling the display to display an eye chart, and the eye chart at least comprises a first mark; transmitting the direction information corresponding to the first identifier to a first controller;

The first controller is used for responding to the received starting instruction and controlling the starting of the camera; when the display displays a first mark, controlling the camera to acquire a first image; and generating a vision testing result according to the direction information and the matching result of the first image.

A fifth aspect of an embodiment of the present application shows a display apparatus including:

A display;

A camera;

The first controller is used for responding to the received starting instruction and sending an eye chart to the second controller, wherein the eye chart at least comprises a first identifier, and the first identifier is an identifier which needs to be identified by a user; when the display displays a first mark, controlling the camera to acquire a first image; generating a vision test result according to the matching result of the first mark and the first image;

And the second controller is used for controlling the display to display the visual chart.

From the above technical solutions, it can be seen that the embodiments of the present application show a display device, which may include: the visual testing device comprises a display, a camera and a controller, wherein the camera is used for collecting images, and the controller is used for controlling the display to display an visual chart when receiving a starting instruction for visual testing, and the visual chart at least comprises a first identifier which is an identifier required to be identified by a user; when the first mark is displayed on the display, the controller controls the camera to acquire a first image, matches the first image with the first mark, and generates a vision test result of the user according to the matching result. The display device shown in the embodiment of the application can help the user to perform vision test, and the user experience is good.

Drawings

In order to more clearly illustrate the embodiments of the present application or the implementation of the related art, the drawings that are required for the embodiments or the related art description will be briefly described, and it is apparent that the drawings in the following description are some embodiments of the present application and that other drawings may be obtained according to these drawings for a person having ordinary skill in the art.

A schematic diagram of an operational scenario between a display device and a control apparatus according to some embodiments is schematically shown in fig. 1;

a hardware configuration block diagram of a display device 200 according to some embodiments is exemplarily shown in fig. 2;

a hardware configuration block diagram of the control device 100 according to some embodiments is exemplarily shown in fig. 3;

A schematic diagram of the software configuration in a display device 200 according to some embodiments is exemplarily shown in fig. 4;

An icon control interface display schematic of an application in a display device 200 according to some embodiments is illustrated in fig. 5;

FIG. 6 is a flow chart illustrating interaction of components of a display device according to one possible embodiment;

FIG. 7A is a schematic diagram of a display interface according to one possible embodiment;

FIG. 7B is a schematic diagram of a display interface according to one possible embodiment;

FIG. 7C is a schematic diagram of a display interface according to one possible embodiment;

FIG. 7D is a schematic diagram of a display interface according to one possible embodiment;

FIG. 8A is a schematic diagram of a display interface according to one possible embodiment;

FIG. 8B is a schematic diagram of a display interface according to one possible embodiment;

FIG. 9A is a schematic diagram of a display interface according to one possible embodiment;

FIG. 9B is a schematic diagram of a display interface according to one possible embodiment;

FIG. 10 is a schematic diagram of a display interface shown according to one possible embodiment;

FIG. 11 is a schematic diagram of a prompt interface shown in accordance with some embodiments;

FIG. 12 is a simulation diagram illustrating a test procedure according to one possible embodiment;

FIG. 13 is a schematic diagram of a display interface shown according to one possible embodiment;

FIG. 14 is a schematic diagram of a display interface shown according to one possible embodiment;

FIG. 15 is a simulation diagram illustrating a test procedure according to one possible embodiment;

FIG. 16 is a flow chart illustrating interaction of components of a display device according to one possible embodiment;

FIG. 17 is a block diagram of a display device according to one possible embodiment;

FIG. 18 is an interactive flow diagram of components of a display device, shown according to one possible embodiment;

FIG. 19 is an interactive flow diagram of components of a display device, shown according to one possible embodiment;

FIG. 20 is a flow chart illustrating interaction of components of a display device according to one possible embodiment.

Detailed Description

For the purposes of making the objects, embodiments and advantages of the present application more apparent, an exemplary embodiment of the present application will be described more fully hereinafter with reference to the accompanying drawings in which exemplary embodiments of the application are shown, it being understood that the exemplary embodiments described are merely some, but not all, of the examples of the application.

Based on the exemplary embodiments described herein, all other embodiments that may be obtained by one of ordinary skill in the art without making any inventive effort are within the scope of the appended claims. Furthermore, while the present disclosure has been described in terms of an exemplary embodiment or embodiments, it should be understood that each aspect of the disclosure can be practiced separately from the other aspects.

It should be noted that the brief description of the terminology in the present application is for the purpose of facilitating understanding of the embodiments described below only and is not intended to limit the embodiments of the present application. Unless otherwise indicated, these terms should be construed in their ordinary and customary meaning.

The terms first, second, third and the like in the description and in the claims and in the above-described figures are used for distinguishing between similar or similar objects or entities and not necessarily for describing a particular sequential or chronological order, unless otherwise indicated (Unless otherwise indicated). It is to be understood that the terms so used are interchangeable under appropriate circumstances such that the embodiments of the application are, for example, capable of operation in sequences other than those illustrated or otherwise described herein.

Furthermore, the terms "comprise" and "have," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a product or apparatus that comprises a list of elements is not necessarily limited to those elements expressly listed, but may include other elements not expressly listed or inherent to such product or apparatus.

The term "module" as used in this disclosure refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and/or software code that is capable of performing the function associated with that element.

The term "remote control" as used herein refers to a component of an electronic device (such as a display device as disclosed herein) that can be controlled wirelessly, typically over a relatively short distance. Typically, the electronic device is connected to the electronic device using infrared and/or Radio Frequency (RF) signals and/or bluetooth, and may also include functional modules such as WiFi, wireless USB, bluetooth, motion sensors, etc. For example: the hand-held touch remote controller replaces most of the physical built-in hard keys in a general remote control device with a touch screen user interface.

The term "gesture" as used herein refers to a user behavior by which a user expresses an intended idea, action, purpose, and/or result through a change in hand shape or movement of a hand, etc.

A schematic diagram of an operation scenario between a display device and a control apparatus according to an embodiment is exemplarily shown in fig. 1. As shown in fig. 1, a user may operate the display apparatus 200 through the mobile terminal 300 and the control device 100.

In some embodiments, the control apparatus 100 may be a remote controller, and the communication between the remote controller and the display device includes infrared protocol communication or bluetooth protocol communication, and other short-range communication modes, etc., and the display device 200 is controlled by a wireless or other wired mode. The user may control the display device 200 by inputting user instructions through keys on a remote control, voice input, control panel input, etc. Such as: the user can input corresponding control instructions through volume up-down keys, channel control keys, up/down/left/right movement keys, voice input keys, menu keys, on-off keys, etc. on the remote controller to realize the functions of the control display device 200.

In some embodiments, mobile terminals, tablet computers, notebook computers, and other smart devices may also be used to control the display device 200. For example, the display device 200 is controlled using an application running on a smart device. The application program, by configuration, can provide various controls to the user in an intuitive User Interface (UI) on a screen associated with the smart device.

In some embodiments, the mobile terminal 300 may install a software application with the display device 200, implement connection communication through a network communication protocol, and achieve the purpose of one-to-one control operation and data communication. Such as: it is possible to implement a control command protocol established between the mobile terminal 300 and the display device 200, synchronize a remote control keyboard to the mobile terminal 300, and implement a function of controlling the display device 200 by controlling a user interface on the mobile terminal 300. The audio/video content displayed on the mobile terminal 300 can also be transmitted to the display device 200, so as to realize the synchronous display function.

As also shown in fig. 1, the display device 200 is also in data communication with the server 400 via a variety of communication means. The display device 200 may be permitted to make communication connections via a Local Area Network (LAN), a Wireless Local Area Network (WLAN), and other networks. The server 400 may provide various contents and interactions to the display device 200. By way of example, display device 200 receives software program updates, or accesses a remotely stored digital media library by sending and receiving information, as well as Electronic Program Guide (EPG) interactions. The server 400 may be a cluster, or may be multiple clusters, and may include one or more types of servers. Other web service content such as video on demand and advertising services are provided through the server 400.

The display device 200 may be a liquid crystal display, an OLED display, a projection display device. The particular display device type, size, resolution, etc. are not limited, and those skilled in the art will appreciate that the display device 200 may be modified in performance and configuration as desired.

The display apparatus 200 may additionally provide a smart network television function of a computer support function, including, but not limited to, a network television, a smart television, an Internet Protocol Television (IPTV), etc., in addition to the broadcast receiving television function.

A hardware configuration block diagram of the display device 200 according to an exemplary embodiment is illustrated in fig. 2.

In some embodiments, at least one of the controller 250, the modem 210, the communicator 220, the detector 230, the input/output interface 255, the display 275, the audio output interface 285, the memory 260, the power supply 290, the user interface 265, and the external device interface 240 is included in the display apparatus 200.

In some embodiments, the display 275 is configured to receive image signals from the first processor output, and to display video content and images and components of the menu manipulation interface.

In some embodiments, display 275 includes a display screen assembly for presenting pictures, and a drive assembly for driving the display of images.

In some embodiments, the video content is displayed from broadcast television content, or alternatively, from various broadcast signals that may be received via a wired or wireless communication protocol. Or may display various image content received from a network communication protocol from a network server side.

In some embodiments, the display 275 is used to present a user-manipulated UI interface generated in the display device 200 and used to control the display device 200.

In some embodiments, depending on the type of display 275, a drive assembly for driving the display is also included.

In some embodiments, display 275 is a projection display and may further include a projection device and a projection screen.

In some embodiments, communicator 220 is a component for communicating with external devices or external servers according to various communication protocol types. For example: the communicator may include at least one of a Wifi chip, a bluetooth communication protocol chip, a wired ethernet communication protocol chip, or other network communication protocol chip or a near field communication protocol chip, and an infrared receiver.

In some embodiments, the display device 200 may establish control signal and data signal transmission and reception between the communicator 220 and the external control device 100 or the content providing device.

In some embodiments, the user interface 265 may be used to receive infrared control signals from the control device 100 (e.g., an infrared remote control, etc.).

In some embodiments, the detector 230 is a signal that the display device 200 uses to capture or interact with the external environment.

In some embodiments, the detector 230 includes an optical receiver, a sensor for capturing the intensity of ambient light, a parameter change may be adaptively displayed by capturing ambient light, etc.

In some embodiments, the detector 230 may further include an image collector, such as a camera, a video camera, etc., which may be used to collect external environmental scenes, collect attributes of a user or interact with a user, adaptively change display parameters, and recognize a user gesture to realize an interaction function with the user.

In some embodiments, the detector 230 may also include a temperature sensor or the like, such as by sensing ambient temperature.

In some embodiments, the display device 200 may adaptively adjust the display color temperature of the image. The display device 200 may be adjusted to display a colder color temperature shade of the image, such as when the temperature is higher, or the display device 200 may be adjusted to display a warmer color shade of the image when the temperature is lower.

In some embodiments, the detector 230 may also be a sound collector or the like, such as a microphone, that may be used to receive the user's sound. Illustratively, a voice signal including a control instruction for a user to control the display apparatus 200, or an acquisition environmental sound is used to recognize an environmental scene type so that the display apparatus 200 can adapt to environmental noise.

In some embodiments, as shown in fig. 2, the input/output interface 255 is configured to enable data transfer between the controller 250 and external other devices or other controllers 250. Such as receiving video signal data and audio signal data of an external device, command instruction data, or the like.

In some embodiments, external device interface 240 may include, but is not limited to, the following: any one or more interfaces of a high definition multimedia interface HDMI interface, an analog or data high definition component input interface, a composite video input interface, a USB input interface, an RGB port, and the like can be used. The plurality of interfaces may form a composite input/output interface.

In some embodiments, as shown in fig. 2, the modem 210 is configured to receive the broadcast television signal by a wired or wireless receiving manner, and may perform modulation and demodulation processes such as amplification, mixing, and resonance, and demodulate the audio/video signal from a plurality of wireless or wired broadcast television signals, where the audio/video signal may include a television audio/video signal carried in a television channel frequency selected by a user, and an EPG data signal.

In some embodiments, the frequency point demodulated by the modem 210 is controlled by the controller 250, and the controller 250 may send a control signal according to the user selection, so that the modem responds to the television signal frequency selected by the user and modulates and demodulates the television signal carried by the frequency.

In some embodiments, the broadcast television signal may be classified into a terrestrial broadcast signal, a cable broadcast signal, a satellite broadcast signal, an internet broadcast signal, or the like according to a broadcasting system of the television signal. Or may be differentiated into digital modulation signals, analog modulation signals, etc., depending on the type of modulation. Or it may be classified into digital signals, analog signals, etc. according to the kind of signals.

In some embodiments, the controller 250 and the modem 210 may be located in separate devices, i.e., the modem 210 may also be located in an external device to the main device in which the controller 250 is located, such as an external set-top box or the like. In this way, the set-top box outputs the television audio and video signals modulated and demodulated by the received broadcast television signals to the main body equipment, and the main body equipment receives the audio and video signals through the first input/output interface.

In some embodiments, the controller 250 controls the operation of the display device and responds to user operations through various software control programs stored on the memory. The controller 250 may control the overall operation of the display apparatus 200. For example: in response to receiving a user command to select to display a UI object on the display 275, the controller 250 may perform an operation related to the object selected by the user command.

In some embodiments, the object may be any one of selectable objects, such as a hyperlink or an icon. Operations related to the selected object, such as: displaying an operation of connecting to a hyperlink page, a document, an image, or the like, or executing an operation of a program corresponding to the icon. The user command for selecting the UI object may be an input command through various input means (e.g., mouse, keyboard, touch pad, etc.) connected to the display device 200 or a voice command corresponding to a voice uttered by the user.

As shown in fig. 2, the controller 250 includes at least one of a random access Memory 251 (Random Access Memory, RAM), a Read-Only Memory 252 (ROM), a video processor 270, an audio processor 280, other processors 253 (e.g., a graphics processor (Graphics Processing Unit, GPU), a central processing unit 254 (Central Processing Unit, CPU), a communication interface (Communication Interface), and a communication Bus 256 (Bus), which connects the respective components.

In some embodiments, RAM 251 is used to store temporary data for the operating system or other on-the-fly programs

In some embodiments, ROM 252 is used to store instructions for various system boots.

In some embodiments, ROM 252 is used to store a basic input output system, referred to as a basic input output system (Basic Input Output System, BIOS). The system comprises a drive program and a boot operating system, wherein the drive program is used for completing power-on self-checking of the system, initialization of each functional module in the system and basic input/output of the system.

In some embodiments, upon receipt of the power-on signal, the display device 200 power starts up, the CPU runs system boot instructions in the ROM 252, copies temporary data of the operating system stored in memory into the RAM 251, in order to start up or run the operating system. When the operating system is started, the CPU copies temporary data of various applications in the memory to the RAM 251, and then, facilitates starting or running of the various applications.

In some embodiments, CPU processor 254 is used to execute operating system and application program instructions stored in memory. And executing various application programs, data and contents according to various interactive instructions received from the outside, so as to finally display and play various audio and video contents.

In some exemplary embodiments, the CPU processor 254 may comprise a plurality of processors. The plurality of processors may include one main processor and one or more sub-processors. A main processor for performing some operations of the display apparatus 200 in the pre-power-up mode and/or displaying a picture in the normal mode. One or more sub-processors for one operation in a standby mode or the like.

In some embodiments, the graphics processor 253 is configured to generate various graphical objects, such as: icons, operation menus, user input instruction display graphics, and the like. The device comprises an arithmetic unit, wherein the arithmetic unit is used for receiving various interaction instructions input by a user to carry out operation and displaying various objects according to display attributes. And a renderer for rendering the various objects obtained by the arithmetic unit, wherein the rendered objects are used for being displayed on a display.

In some embodiments, video processor 270 is configured to receive external video signals, perform video processing such as decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, image composition, etc., according to standard codec protocols for input signals, and may result in signals that are displayed or played on directly displayable device 200.

In some embodiments, video processor 270 includes a demultiplexing module, a video decoding module, an image compositing module, a frame rate conversion module, a display formatting module, and the like.

The demultiplexing module is used for demultiplexing the input audio/video data stream, such as the input MPEG-2, and demultiplexes the input audio/video data stream into video signals, audio signals and the like.

And the video decoding module is used for processing the demultiplexed video signals, including decoding, scaling and the like.

And an image synthesis module, such as an image synthesizer, for performing superposition mixing processing on the graphic generator and the video image after the scaling processing according to the GUI signal input by the user or generated by the graphic generator, so as to generate an image signal for display.

The frame rate conversion module is configured to convert the input video frame rate, for example, converting the 60Hz frame rate into the 120Hz frame rate or the 240Hz frame rate, and the common format is implemented in an inserting frame manner.

The display format module is used for converting the received frame rate into a video output signal, and changing the video output signal to a signal conforming to the display format, such as outputting an RGB data signal.

In some embodiments, the graphics processor 253 may be integrated with the video processor, or may be separately configured, where the integrated configuration may perform processing of graphics signals output to the display, and the separate configuration may perform different functions, such as gpu+frc (FRAME RATE Conversion) architecture, respectively.

In some embodiments, the audio processor 280 is configured to receive an external audio signal, decompress and decode the audio signal according to a standard codec protocol of an input signal, and perform noise reduction, digital-to-analog conversion, and amplification processing, so as to obtain a sound signal that can be played in a speaker.

In some embodiments, video processor 270 may include one or more chips. The audio processor may also comprise one or more chips.

In some embodiments, video processor 270 and audio processor 280 may be separate chips or may be integrated together with the controller in one or more chips.

In some embodiments, the audio output, under the control of the controller 250, receives sound signals output by the audio processor 280, such as: the speaker 286, and an external sound output terminal that can be output to a generating device of an external device, other than the speaker carried by the display device 200 itself, such as: external sound interface or earphone interface, etc. can also include the close range communication module in the communication interface, for example: and the Bluetooth module is used for outputting sound of the Bluetooth loudspeaker.

The power supply 290 supplies power input from an external power source to the display device 200 under the control of the controller 250. The power supply 290 may include a built-in power circuit installed inside the display device 200, or may be an external power source installed in the display device 200, and a power interface for providing an external power source in the display device 200.

The user interface 265 is used to receive an input signal from a user and then transmit the received user input signal to the controller 250. The user input signal may be a remote control signal received through an infrared receiver, and various user control signals may be received through a network communication module.

In some embodiments, a user inputs a user command through the control apparatus 100 or the mobile terminal 300, the user input interface is then responsive to the user input through the controller 250, and the display device 200 is then responsive to the user input.

In some embodiments, a user may input a user command through a Graphical User Interface (GUI) displayed on the display 275, and the user input interface receives the user input command through the Graphical User Interface (GUI). Or the user may input the user command by inputting a specific sound or gesture, the user input interface recognizes the sound or gesture through the sensor, and receives the user input command.

In some embodiments, a "user interface" is a media interface for interaction and exchange of information between an application or operating system and a user that enables conversion between an internal form of information and a form acceptable to the user. A commonly used presentation form of a user interface is a graphical user interface (Graphic User Interface, GUI), which refers to a graphically displayed user interface that is related to computer operations. It may be an interface element such as an icon, a window, a control, etc. displayed in a display screen of the electronic device, where the control may include a visual interface element such as an icon, a button, a menu, a tab, a text box, a dialog box, a status bar, a navigation bar, a Widget, etc.

The memory 260 includes memory storing various software modules for driving the display device 200. Such as: various software modules stored in the first memory, including: at least one of a base module, a detection module, a communication module, a display control module, a browser module, various service modules, and the like.

The base module is a bottom software module for signal communication between the various hardware in the display device 200 and for sending processing and control signals to the upper modules. The detection module is used for collecting various information from various sensors or user input interfaces and carrying out digital-to-analog conversion and analysis management.

For example, the voice recognition module includes a voice analysis module and a voice instruction database module. The display control module is used for controlling the display to display the image content, and can be used for playing the multimedia image content, the UI interface and other information. And the communication module is used for carrying out control and data communication with external equipment. And the browser module is used for executing data communication between the browsing servers. And the service module is used for providing various services and various application programs. Meanwhile, the memory 260 also stores received external data and user data, images of various items in various user interfaces, visual effect maps of focus objects, and the like.

Fig. 3 exemplarily shows a block diagram of a configuration of the control apparatus 100 in accordance with an exemplary embodiment. As shown in fig. 3, the control device 100 includes a controller 110, a communication interface 130, a user input/output interface, a memory, and a power supply.

The control device 100 is configured to control the display device 200, and may receive an input operation instruction of a user, and convert the operation instruction into an instruction recognizable and responsive to the display device 200, to function as an interaction between the user and the display device 200. Such as: the user responds to the channel addition and subtraction operation by operating the channel addition and subtraction key on the control apparatus 100, and the display apparatus 200.

In some embodiments, the control device 100 may be a smart device. Such as: the control apparatus 100 may install various applications for controlling the display apparatus 200 according to user's needs.

In some embodiments, as shown in fig. 1, a mobile terminal 300 or other intelligent electronic device may function similarly to the control device 100 after installing an application that manipulates the display device 200. Such as: the user may implement the functions of controlling the physical keys of the device 100 by installing various function keys or virtual buttons of a graphical user interface available on the mobile terminal 300 or other intelligent electronic device.

The controller 110 includes a processor 112 and RAM 113 and ROM 114, a communication interface 130, and a communication bus. The controller is used to control the operation and operation of the control device 100, as well as the communication collaboration among the internal components and the external and internal data processing functions.

The communication interface 130 enables communication of control signals and data signals with the display device 200 under the control of the controller 110. Such as: the received user input signal is transmitted to the display device 200. The communication interface 130 may include at least one of a WiFi chip 131, a bluetooth module 132, an NFC module 133, and other near field communication modules.

A user input/output interface 140, wherein the input interface includes at least one of a microphone 141, a touchpad 142, a sensor 143, keys 144, and other input interfaces. Such as: the user can implement a user instruction input function through actions such as voice, touch, gesture, press, and the like, and the input interface converts a received analog signal into a digital signal and converts the digital signal into a corresponding instruction signal, and sends the corresponding instruction signal to the display device 200.

The output interface includes an interface that transmits the received user instruction to the display device 200. In some embodiments, an infrared interface may be used, as well as a radio frequency interface. Such as: when the infrared signal interface is used, the user input instruction needs to be converted into an infrared control signal according to an infrared control protocol, and the infrared control signal is sent to the display device 200 through the infrared sending module. And the following steps: when the radio frequency signal interface is used, the user input instruction is converted into a digital signal, and then the digital signal is modulated according to a radio frequency control signal modulation protocol and then transmitted to the display device 200 through the radio frequency transmission terminal.

In some embodiments, the control device 100 includes at least one of a communication interface 130 and an input-output interface 140. The control device 100 is provided with a communication interface 130 such as: the WiFi, bluetooth, NFC, etc. modules may send the user input instruction to the display device 200 through a WiFi protocol, or a bluetooth protocol, or an NFC protocol code.

A memory 190 for storing various operation programs, data and applications for driving and controlling the control device 200 under the control of the controller. The memory 190 may store various control signal instructions input by a user.

A power supply 180 for providing operating power support for the various elements of the control device 100 under the control of the controller. May be a battery and associated control circuitry.

In some embodiments, the system may include a Kernel (Kernel), a command parser (shell), a file system, and an application. The kernel, shell, and file system together form the basic operating system architecture that allows users to manage files, run programs, and use the system. After power-up, the kernel is started, the kernel space is activated, hardware is abstracted, hardware parameters are initialized, virtual memory, a scheduler, signal and inter-process communication (IPC) are operated and maintained. After the kernel is started, shell and user application programs are loaded again. The application program is compiled into machine code after being started to form a process.

Referring to FIG. 4, in some embodiments, the system is divided into four layers, from top to bottom, an application layer (referred to as an "application layer"), an application framework layer (Application Framework) layer (referred to as a "framework layer"), a An Zhuoyun row layer (Android runtime) and a system library layer (referred to as a "system runtime layer"), and a kernel layer, respectively.

In some embodiments, at least one application program is running in the application program layer, and these application programs may be a Window (Window) program of an operating system, a system setting program, a clock program, a camera application, and the like; and may be an application program developed by a third party developer, such as a hi-see program, a K-song program, a magic mirror program, etc. In particular implementations, the application packages in the application layer are not limited to the above examples, and may actually include other application packages, which the embodiments of the present application do not limit.

The framework layer provides an application programming interface (application programming interface, API) and programming framework for the application programs of the application layer. The application framework layer includes a number of predefined functions. The application framework layer corresponds to a processing center that decides to let the applications in the application layer act. An application program can access resources in a system and acquire services of the system in execution through an API interface

As shown in fig. 4, the application framework layer in the embodiment of the present application includes a manager (Managers), a Content Provider (Content Provider), and the like, where the manager includes at least one of the following modules: an activity manager (ACTIVITY MANAGER) is used to interact with all activities running in the system; a Location Manager (Location Manager) is used to provide system services or applications with access to system Location services; a package manager (PACKAGE MANAGER) for retrieving various information about the application packages currently installed on the device; a notification manager (Notification Manager) for controlling the display and clearing of notification messages; a Window Manager (Window Manager) is used to manage bracketing icons, windows, toolbars, wallpaper, and desktop components on the user interface.

In some embodiments, the activity manager is to: the lifecycle of each application program is managed, as well as the usual navigation rollback functions, such as controlling the exit of the application program (including switching the currently displayed user interface in the display window to the system desktop), opening, backing (including switching the currently displayed user interface in the display window to the previous user interface of the currently displayed user interface), etc.

In some embodiments, the window manager is configured to manage all window procedures, such as obtaining a display screen size, determining whether there is a status bar, locking the screen, intercepting the screen, controlling display window changes (e.g., scaling the display window down, dithering, distorting, etc.), and so on.

In some embodiments, the system runtime layer provides support for the upper layer, the framework layer, and when the framework layer is in use, the android operating system runs the C/C++ libraries contained in the system runtime layer to implement the functions to be implemented by the framework layer.

In some embodiments, the kernel layer is a layer between hardware and software. As shown in fig. 4, the kernel layer contains at least one of the following drivers: audio drive, display drive, bluetooth drive, camera drive, WIFI drive, USB drive, HDMI drive, sensor drive (e.g., fingerprint sensor, temperature sensor, touch sensor, pressure sensor, etc.), and the like.

In some embodiments, the kernel layer further includes a power driver module for power management.

In some embodiments, the software programs and/or modules corresponding to the software architecture in fig. 4 are stored in the first memory or the second memory shown in fig. 2 or fig. 3.

In some embodiments, taking a magic mirror application (photographing application) as an example, when the remote control receiving device receives an input operation of the remote control, a corresponding hardware interrupt is sent to the kernel layer. The kernel layer processes the input operation into the original input event (including the value of the input operation, the timestamp of the input operation, etc.). The original input event is stored at the kernel layer. The application program framework layer acquires an original input event from the kernel layer, identifies a control corresponding to the input event according to the current position of the focus and takes the input operation as a confirmation operation, wherein the control corresponding to the confirmation operation is a control of a magic mirror application icon, the magic mirror application calls an interface of the application framework layer, the magic mirror application is started, and further, a camera driver is started by calling the kernel layer, so that a still image or video is captured through a camera.

In some embodiments, for a display device with a touch function, taking a split screen operation as an example, the display device receives an input operation (such as a split screen operation) acted on a display screen by a user, and the kernel layer may generate a corresponding input event according to the input operation and report the event to the application framework layer. The window mode (e.g., multi-window mode) and window position and size corresponding to the input operation are set by the activity manager of the application framework layer. And window management of the application framework layer draws a window according to the setting of the activity manager, then the drawn window data is sent to a display driver of the kernel layer, and the display driver displays application interfaces corresponding to the window data in different display areas of the display screen.

In some embodiments, as shown in fig. 5, the application layer contains at least one icon control that the application can display in the display, such as: a live television application icon control, a video on demand application icon control, a media center application icon control, an application center icon control, a game application icon control, and the like.

In some embodiments, the live television application may provide live television via different signal sources. For example, a live television application may provide television signals using inputs from cable television, radio broadcast, satellite services, or other types of live television services. And, the live television application may display video of the live television signal on the display device 200.

In some embodiments, the video on demand application may provide video from different storage sources. Unlike live television applications, video-on-demand provides video displays from some storage sources. For example, video-on-demand may come from the server side of cloud storage, from a local hard disk storage containing stored video programs.

In some embodiments, the media center application may provide various multimedia content playing applications. For example, a media center may be a different service than live television or video on demand, and a user may access various images or audio through a media center application.

In some embodiments, an application center may be provided to store various applications. The application may be a game, an application, or some other application associated with a computer system or other device but which may be run in a smart television. The application center may obtain these applications from different sources, store them in local storage, and then be run on the display device 200.

With the development of big data and artificial intelligence, the functional demands of users on display devices are increasing. For example, a user may want to perform a vision test using a display device. The current display device cannot realize the realization of the above scene. Accordingly, there is an urgent need for a display device that can help a user to perform vision testing.

Embodiments of the present application illustrate a display device that may be used for user vision testing, the display device may include: the interaction process of the camera, the controller and the display can refer to fig. 6, and fig. 6 is an interaction flow chart of each component of the display device according to a feasible embodiment.

In the technical scheme shown in the embodiment of the application, the display is configured to display a corresponding interface based on the control of the controller. For example, in an application scenario of video playback, the display may display a video interface based on control of the controller; in an application scene of the video call, the display can display a related interface of the video call based on the control of the controller; in an application scene of the game, the display can display a relevant interface of the game based on the control of the controller; the visual testing method and the visual testing device are particularly applied to a 'visual testing' scene applicable to the embodiment of the application, and the display can display the visual chart based on the control of the controller.

The camera is used for collecting images;

In the technical scheme shown in the embodiment of the application, the camera is configured to start, close or collect images based on the control of the controller. For example, in an application scenario of video call, the camera may collect call video based on control of the controller, and in a video call process, the camera is always in a state of image collection. The method is particularly applied to a vision test scene applicable to the embodiment of the application, and the camera can acquire a user image (the user image can be also called a first image or a second image in the embodiment) based on the control of the controller.

The controller is configured to execute step S101, and in response to receiving the starting instruction, the controller controls the display to display an eye chart, wherein the eye chart at least comprises a first identification, and the first identification is an identification which needs to be identified by a user;

The start instruction in the application is a start instruction for pulling up the vision test function of the display device. In some feasible embodiments, the start instruction may be a start instruction sent by a user in the form of voice; the sending process of the starting instruction can be as follows: the user outputs a wake-up word in advance, and then outputs a start-up instruction, and connection is established between the user and the controller based on the wake-up word, so that the controller can respond to the start-up instruction output by the user correspondingly. For example, the user enters the wake-up word "college classmate" and an activate instruction "activate vision testing function". In some feasible embodiments, the start instruction may be a start instruction sent by a user through a remote controller; the sending process of the starting instruction can be as follows: the user can touch the related control of the remote controller so that the controller can send a corresponding starting instruction, and the controller can respond to the starting instruction correspondingly. For example, a user may trigger the remote control to send a start command to the controller by touching control a of the remote control.

The eye chart shown in the embodiments of the present application is a chart for measuring vision. The visual acuity chart may be any one of an international standard visual acuity chart, a logarithmic visual acuity chart and a Landolt (Landolt) circular visual acuity chart. Typically, the eye chart is made up of a plurality of indicia of varying opening orientations, wherein the indicia may be "E" or "C". It should be noted that this embodiment shows only two kinds of marks by way of example, and the marks are not limited to the two forms described above in the practical application.

In a feasible example, the marks with the same volume in the visual acuity chart are positioned in the same row to form a visual acuity row; the volume of the marks displayed on each row gradually decreases from top to bottom in the vertical direction, and each vision row corresponds to one vision grade. Referring specifically to fig. 7A, fig. 7A is a display interface for displaying an eye chart according to a possible embodiment. As can be seen from the chart shown in fig. 7A, the same volume of marks (E) are located in the same row to form a vision row; the volume of the marks displayed on each row gradually decreases from top to bottom in the vertical direction; each vision row corresponds to a vision grade.

The identifiers in the technical scheme shown in the embodiment of the application comprise a first identifier and a second identifier, wherein the first identifier is the identifier which needs to be identified by the user, and the second identifier is the identifier which does not need to be identified by the user. In the displaying process, the displaying mode of the second mark is different from the displaying mode of the first mark. For example, the first identifier may be displayed in a black font, the second identifier may be displayed in a gray font, and specifically, referring to fig. 7A, reference numeral 1 in fig. 7A is the first identifier, and the remaining identifiers are the second identifiers. For another example, the first identifier may be determined by the position of the cursor, where the identifier corresponding to the position of the cursor is the first identifier, and the other identifiers are the second identifiers, and referring to fig. 7B, specifically, fig. 7B may show that identifier 1 is the first identifier, and the other identifiers are the second identifiers. It should be noted that the embodiment of the present application is merely an exemplary manner of showing two first identifiers, and the manner of showing the first identifiers is not limited to the two manners in the practical process.

In a feasible embodiment, only one row of marks may be displayed in the visual chart, and in particular, referring to fig. 7C, fig. 7C is a display interface, which is shown in accordance with a feasible embodiment, and is used to display the visual chart. The identifiers in the technical scheme shown in the embodiment of the application comprise a first identifier and a second identifier, wherein the first identifier is the identifier which needs to be identified by the user, and the second identifier is the identifier which does not need to be identified by the user. In the displaying process, the displaying mode of the second mark is different from the displaying mode of the first mark. For example, the first identifier may be displayed in a black font, the second identifier may be displayed in a gray font, and specifically, referring to fig. 7C, in fig. 7C, identifier 1 is the first identifier, and the remaining identifiers are the second identifiers.

In a possible embodiment, only the first identifier may be displayed in the visual chart, and in particular, referring to fig. 7D, fig. 7D is a display interface, which is shown in accordance with a possible embodiment, and is used to display the visual chart. In the technical scheme shown in the embodiment of the application, only the first mark is displayed in the visual chart.

S102, when the display displays a first mark, controlling the camera to acquire a first image, wherein the first image is acquired after the display displays the first mark;

And when the display displays the first mark, controlling the camera to acquire a first image. Specifically, after the controller controls the display to display the preset time after the action of the eye chart is sent, the controller sends a control signal for controlling the camera to collect the first image to the camera, so that the camera collects the image of the user at the moment. The preset time may be determined according to the rendering time of the visual acuity chart, for example, the preset time may be 0.1ms in a feasibility real-time.

S103, generating a vision test result according to the matching result of the first mark and the first image.

In the technical solution shown in the embodiment of the application, the first image at least includes a direction indicated by the user. The controller recognizes the user indication direction in the first image, calculates a degree of matching of the user indication direction with the direction of the first mark, and generates a vision test result according to the matching result.

For the eye charts shown in fig. 7A and 7B, the test procedure may be: the controller selects the mark with the largest volume as a first mark; and if the first image is matched with the first identifier, selecting any identifier in the next row of the currently displayed identifiers as the first identifier until the first image is not matched with the first identifier, and obtaining a vision test result.

The display interface during the test may be referred to as 8A. The controller determines the mark with the largest volume in the visual acuity chart as the first mark, and the corresponding display interface can refer to the interface 11 in fig. 8A. When the display displays the interface 11, the user makes a corresponding action on the content displayed on the interface 11, and the controller sends an acquisition instruction to the camera so that the camera acquires the first image corresponding to the acquisition instruction. The controller identifies the user indication direction in the first image, then calculates the matching degree of the user indication direction and the direction of the first mark, if the first image is matched with the first mark, selects any mark in the next row of the currently displayed mark as the first mark, the corresponding display interface can refer to the interface 12 in fig. 8A at the moment, when the display displays the interface 12, the user makes corresponding action on the content displayed on the interface 12, the controller sends an acquisition instruction to the camera so that the camera acquires the first image corresponding to the moment, and so on until the first image is not matched with the first mark, and a vision test result is obtained

In a feasible embodiment, if the vision line where the first identifier is located includes a plurality of identifiers, the controller may respectively select a plurality of first identifiers in the vision line (each display interface only displays one first identifier), and if only the first images acquired multiple times are matched with the corresponding first identifiers, the controller selects any identifier in the next line of the currently displayed identifiers as the first identifier. For example, the display interface shown by the display is interface 21 in fig. 8B (in this embodiment, the controller is configured to select two identifiers in each vision line as the first identifier), the controller selects identifier 1 as the first identifier for the first time, and the controller identifies that the user indication direction in the first image matches the first identifier in vision line B where the first identifier is located. The controller continues to select any one of the marks (mark 2) as the first mark in the vision line B, and at this time, the display interface of the display may refer to the interface 22 in fig. 8B, and if the controller recognizes that the user indication direction in the first image matches the first mark at this time, the controller determines any one of the marks in the next line of the vision line B as the first mark.

In a feasible embodiment, if the vision line where the first marks are located includes a plurality of marks, the controller may respectively select a plurality of first marks in the vision line (each display interface only displays one first mark), and the controller may generate the instance test result only if none of the first images acquired multiple times matches the corresponding first mark. For example, the display interface shown by the display is interface 21 in fig. 8B (in this embodiment, the controller is configured to select two identifiers in each vision line as the first identifier), the controller selects identifier 1 as the first identifier for the first time, and the controller identifies that the user indication direction in the first image does not match with the first identifier in vision line B where the first identifier is located. The controller continues to select any one of the marks (mark 2) as the first mark in the vision line B, at this time, the display interface of the display may refer to the interface 22 in fig. 8B, and if the controller recognizes that the user indication direction in the first image does not match with the first mark at this time, the controller determines that the vision grade corresponding to the vision line B is the vision grade of the user.

In some possible embodiments, the controller may control the speaker to play the vision test results, and in other possible embodiments, the controller may control the display to present the vision test results.

The operation flow of the displayed device shown in the embodiment of the present application will be described in detail with reference to specific examples. In one possible embodiment, the user enters the wake-up word "college classmate" and the control command "initiate the vision testing function". When the controller receives a starting instruction input by a user, the visual chart is called, the mark with the largest volume is selected from the visual chart to be used as a first mark, and then the controller controls the display to display the visual chart, and at the moment, the display interface of the display can refer to the interface 11 in fig. 8A. When the user sees the interface 11, a gesture of "right" is made to the first identity presented by the interface 11. In the embodiment of the application, the controller acquires a first image after controlling the display to display 0.5s after the visual chart is displayed, and a user in the first image makes a gesture of 'right' (the first image is matched with a first mark). When the controller determines that the first image matches the first identifier, the controller selects any identifier in the vision line B as the first identifier, and the display interface of the display may refer to the interface 12 in fig. 8A. When the user sees the interface 12, a gesture is made "left" to the first identifier presented by the interface 12. After the controller selects the first mark in the vision row B for 0.5s, the controller controls the camera to acquire the first image again, and at the moment, a gesture (the first image is matched with the first mark) of leftwards is made in the first image. When the controller determines that the first image matches the first identifier, the controller selects any identifier in the eyesight line C as the first identifier, and the display interface of the display can refer to the interface 13 in fig. 8A. When the user sees interface 13, a gesture is made "left" to the first identifier presented by interface 12. After the controller selects the first mark for 0.5s in the vision row C, the controller camera collects a first image, and at the moment, the gesture of the user in the first image is leftwards. The controller determines that the first image is not matched with the first mark at the moment, generates a vision test result of which the your vision grade is 3, and controls the display to display the vision test result.

In some possible embodiments, the controller is further configured to perform the steps of:

Step (11) responding to receiving a user instruction, and reading the user vision grade carried by the user instruction;

The user instruction may be an instruction issued by the user based on the condition of his own vision, and in some possible embodiments, the user instruction may be a user instruction sent by the user in the form of voice, for example, the user instruction may be "my vision class is XXX". In some feasible embodiments, the user instruction may be a user instruction sent by a user through a remote controller; the sending process of the user instruction may be that the user touches the relevant control of the remote controller, so that the controller may send a corresponding user instruction, and further, the controller may respond to the user instruction correspondingly. For example, a user may trigger the remote control to send a user instruction carrying "My Vision class is XXX" to the controller by touching control B of the remote control.

Step (12) screening out a target vision line from the first vision chart, wherein the target vision line corresponds to the vision grade of the user; selecting any mark in the target vision row as a first mark;

In the visual chart shown in the application, the marks with the same volume are positioned in the same row to form a visual row; the volume of the marks displayed on each row gradually decreases from top to bottom in the vertical direction; each vision row corresponds to a vision grade. When the controller reads the vision grade of the user carried by the user instruction, the vision row matched with the vision grade of the user is selected as a target vision row in the vision chart. Selecting any mark in the target vision row as a first mark; fig. 9A and 9B are schematic diagrams illustrating a display interface for displaying a target vision line according to a possible embodiment, where the mark 1 is a first mark.

Step (13), if the first image is matched with the first identifier, selecting any identifier in the next row of the currently displayed identifier as the first identifier until the first image is not matched with the first identifier;

When the display displays the target vision line, the user makes corresponding actions on the content displayed by the target vision line. The controller sends an acquisition instruction to the camera so that the camera acquires the first image corresponding to the acquisition instruction. The controller identifies the user indication direction in the first image, then calculates the matching degree of the user indication direction and the direction of the first mark, if the first image is matched with the first mark, selects any mark in the next row of the currently displayed mark as the first mark, and so on until the first image is not matched with the first mark.

And (14) if the first image is not matched with the first identifier, selecting any identifier in the previous row of the currently displayed identifier as the first identifier until the first image is matched with the first identifier.

When the display displays the target vision line for the first time, the user makes corresponding actions on the content displayed by the target vision line. The controller sends an acquisition instruction to the camera so that the camera acquires the first image corresponding to the acquisition instruction. The controller identifies the user indication direction in the first image, then calculates the matching degree of the user indication direction and the direction of the first mark, if the first image is not matched with the first mark, selects any mark in the last row of the currently displayed mark as the first mark, and so on until the first image is matched with the first mark.

The operation flow of the displayed device shown in the embodiment of the present application will be described in detail with reference to specific examples.

In one possible embodiment the user command is "My vision grade is 4". The controller reads that the user eyesight grade carried by the user command is 'my eyesight grade is 4' when receiving the user command input by the user, and determines that the eyesight line D is the target eyesight line, and the display interface of the display can refer to the interface 31 in fig. 9A. When the user sees the interface 31, an "up" gesture is made to the first identifier presented by the interface 31. In the embodiment of the application, the controller acquires the first image after controlling the display to display 0.5s after the visual chart is displayed, and the direction information displayed in the first image is upward (the first image is matched with the first mark). When the controller determines that the first image matches the first identifier, the controller selects any one of the identifiers in the vision line E as the first identifier, and the display interface of the display may refer to the interface 32 in fig. 9A. When the user sees the interface 32, a gesture is made "left" to the first identifier presented by the interface 32. After the controller selects the first mark in the vision line E for 0.5s, the controller controls the camera to acquire the first image again, and a gesture of leftwards is made in the first image. The first image is not matched with the first mark, the controller generates a vision test result of which the vision grade is 4, and the display is controlled to display the vision test result.

In one possible embodiment the user command is "My vision grade is 4". The controller, upon receiving a user command input by a user, reads that the user vision level carried by the user command is "my vision level is 4", and determines that the vision line D is the target vision line, at this time, the display interface of the display may refer to the interface 41 in fig. 9B. When the user sees the interface 41, a gesture is made "down" to the first identifier presented by the interface 41. In the embodiment of the application, the controller acquires the first image after controlling the display to display 0.5s after the visual chart is displayed, and the direction information displayed in the first image is downward (the first image is not matched with the first mark). When the controller determines that the first image does not match the first identifier, the controller selects any one of the identifiers in the vision line C as the first identifier, and the display interface of the display may refer to the interface 42 in fig. 9B. When the user sees interface 42, a gesture is made "right" to the first identifier presented by interface 42. After the controller selects the first mark in the vision line E for 0.5s, the controller controls the camera to acquire the first image again, and the user makes a gesture of 'right' (the first image is matched with the first mark). The matching of the first image and the first identifier, the controller generates a vision test result of 'your vision grade is vision grade 3', and the speaker is controlled to broadcast the vision test result.

The visual acuity chart mentioned in the above embodiment is an international standard visual acuity chart, which consists of E-shaped characters with different opening directions and different sizes; measuring from 0.1 to 1.5 (or from 4.0 to 5.2); each row has a label (vision grade) and the test person starts to test 5 meters from the visual chart. Under some application scenes, the test distance cannot meet the requirement of 5 meters due to the limitation of the display installation space, so that the vision test result is inaccurate. In order to solve the above technical problem, according to an embodiment of the present application, on the basis of the display device shown in the above embodiment, the controller is further configured to perform the following steps:

In the technical scheme shown in the embodiment of the application, the corresponding relation between the visual acuity chart and the first distance is stored in the table 1 in advance, wherein the first distance is the distance between the human eyes and the center of the display. The specific corresponding relation is as follows: the standard visual acuity chart is taken as a reference 1, and the scaling value of the standard visual acuity chart is determined according to the proportional relation between the first distance and 5 meters. Fig. 10 is a schematic diagram of a display interface according to a possible embodiment, where the display interface is configured to display eye charts corresponding to different first distances, where a first distance corresponding to a distance 1 is 5 meters, a first distance corresponding to a distance 2 is 4 meters, and a first distance corresponding to a distance 3 is 3 meters.

TABLE 1

Sequence number	First distance	Visual acuity chart scaling factor	Remarks
				1	5	1	-
2	4	4/5	-
				3	3	3/5	-
……	……	……	-
				N	N	N/5	-

Step (21) is used for responding to the received starting instruction and collecting a second image, wherein the second image is an image collected before the display displays the first mark;

The embodiment of the application shows display equipment, and the controller controls the camera to acquire the second image when receiving the starting instruction.

In one implementation, in response to receiving the initiation instruction, the controller is further configured to control the display to display a prompt interface (and a guide interface) for instructing the user to enter the predetermined area. A specific prompt interface may be seen in fig. 11. Specifically, fig. 11 is a schematic diagram of a prompt interface shown according to some embodiments, where a user adjusts the position of the user according to the prompt interface. When the user finishes entering the preset area, the controller controls the display to display the visual chart. The method is characterized in that the acquisition area of the camera is marginal, the camera acquires a current image (second image) in order to acquire local data better, a floating layer is newly built above the image layer displaying the current image in the displaying process, the optimal acquisition area is determined according to the position and the angle of the camera in the floating layer, and the optimal position frame is displayed in the floating layer according to the optimal acquisition area. The method comprises the steps of guiding a user to move the position, enabling the position in the acquired current image to coincide with the best position frame in the floating layer, displaying a successful prompt message by display equipment when the overlapping degree reaches a preset threshold value, canceling the floating layer, and jumping to any one of display interfaces shown in fig. 7A-7D.

Step (22) calculating a first distance according to the second acquired image, wherein the first distance is the distance between the human eye and the center of the display;

In one possible embodiment, the calculation process of the first distance may be: the controller is further configured to: referring to fig. 12, fig. 12 is a simulation diagram illustrating a test procedure according to a feasibility embodiment, and in the embodiment illustrated in fig. 12, the distance between AB considered for myopia is a first distance cd:

wherein cd is a first distance, h is a perpendicular from the human eye to the camera, and d ₁ is a second distance.

(1) The calculation process of the second distance comprises the following steps:

The size of a picture taken by a camera is determined by the length of the object (user) and the distance between the object and the camera (second distance). The following relationship is generally satisfied: distance (d) =focal length (fl) ×subject length (B)/image size (a);

Distance between the subject and camera (d ₁) =focal length (fl) ×subject length (B ₁)/subject image size (a ₁);

Distance between standard and camera (d ₂) =focal length (fl) ×standard object length (B ₂)/standard object image size (a ₂);

From a large amount of statistics, it is known that the width of a person's head (or canthus), whether ethnicity, height, should be the smallest part of the difference. According to the technical scheme, the human eye distance or the head distance is used as a substitute for the size of the measured object or the standard object, so that B ₁＝B₂ can be considered approximately in the relation, and d ₁＝d₂*A₁/A₂ is obtained, wherein d ₁ is the distance between the photographed object and the camera, A ₁ is the image size of the photographed object, d ₂ is the distance between the standard object and the camera, and A ₂ is the image size of the standard object. In the scheme shown in the embodiment of the application, the image size A ₂ of the standard substance and the distance d ₂ between the standard substance and the camera are stored in advance.

There are various calculation methods for the size of the image of the subject:

For example, the human eye distance is used as the length of the object to be measured. The subject image size a ₁ can be obtained by the following method. The controller reads the coordinate value corresponding to the human eye in the display in the second image; and calculating a first eye distance according to the coordinate values, wherein the first eye distance is the distance between two eyes in the second image. Or, reading the pixel value of the interval between the two eyes in the second image, and determining the size A ₁ of the shot object image according to the pixel value.

For example, using the head width as the length of the object to be measured, specifically, the object image size a ₁ can be obtained by the following method. The controller reads the coordinate values corresponding to the two ends of the head in the second image in the display; and calculating a first width value according to the coordinate values, wherein the first width value is the distance between two sides of the head of the person in the second image. Or, reading the pixel values of the intervals at two sides of the head in the second image, and determining the size A of the shot object image according to the pixel values ₁

The following describes in detail a process of calculating the distance d ₁ between the subject and the camera in connection with the specific embodiment:

In a possible embodiment, the controller controls the display to display the second image, and the display interface of the display may refer to fig. 13, and a rectangular coordinate system is constructed with the bottom left corner of the display as the origin. In the coordinate system, the coordinate value of the left eye corner of the object is (X1, Y1), the coordinate value of the right eye corner of the object is (X2, Y2), and the heights of the two eyes of the human are generally uniform, that is, y1=y2, and corresponding a ₁ =x1-X2. The controller pre-obtains the eye distance of the standard image as A2, and when the standard image is shot, the distance d ₂ between the eyes and the camera can be calculated according to the data.

In a possible embodiment, the controller controls the display to display the second image, and at this time, the display interface of the display may refer to fig. 14, and the controller reads the pixel value between the two eyes in the second image, and determines a ₁ according to the pixel value. The controller pre-obtains the eye distance of the standard image as A ₂, and when the standard image is shot, the distance d ₂ between the eyes and the camera can be calculated according to the data.

(2) A calculation process of the vertical h from the human eyes to the camera;

According to the application, the distance h between the human eye and the center of the camera can be calculated through the width of the human eye and the imaging size of the human eye image by acquiring the position coordinates of the human eye in the imaging image.

Vertical H from human eye to camera = human eye angle width a ₁ x imaging focal length H of camera/width a ₁ of human eye angle in the second image;

The method for calculating the imaging focal length H of the camera comprises the following steps: knowing the actual object size realObjectSize, the distance from the camera, and the pixel size objectSizePixel of the actual object in the screen image, the imaging focal length h=distance is objectSizePixel/realObjectSize.

The test method of a ₁ can be a test method which is conventional in the art, and will not be described in detail herein.

The width a ₁ of the corner of the eye in the second image may be measured by the above-mentioned coordinate method, or may be measured by a pixel method, or may be measured by a test method commonly used in the art, which will not be described herein.

To promote accuracy of the test results, the controller may be further configured to:

Calculating the distance d ₁ between the human eyes and the camera according to the second image and the pre-stored standard image;

The first distance is calculated according to the following formula:

Specifically, referring to fig. 15, fig. 15 is a simulation diagram of a test procedure according to a feasible embodiment, where cd is a first distance, h is a distance from a camera to a center of a display, l is a distance from the camera to the center of the display, and d ₁ is a second distance (a distance from a human eye to the camera).

The calculation process of d ₁ can be referred to herein, and the above embodiments are not repeated here.

The calculation process of h can be referred to, and the above embodiments are not described herein.

And l is the distance between the camera and the center of the display, and the data is pre-stored in a memory and can be called according to the requirement in the application process.

Step (23) adjusting a prestored visual acuity chart according to the first distance to obtain a first visual acuity chart;

Step (24) controls the display to display the first visual acuity chart, wherein the first visual acuity chart at least comprises a first mark.

In the practical application process, the user can interact with the display device through voice, and in a feasible embodiment, the display device can comprise: the controller and display interaction process may refer to fig. 16, where fig. 16 is an interaction flow chart of each component of the display device according to a feasible embodiment.

Wherein the controller is configured to execute the following step 201, in response to receiving a user instruction, control the display to display an eye chart, the eye chart at least comprising a first identification, the first identification being an identification that a user needs to identify;

S202, receiving recognition voice input by a user, wherein the recognition voice is the user voice shown by the user according to a first identifier;

The controller of the display device has a radio function, and the corresponding controller can receive the voice output by the user, wherein the voice can be a control instruction, such as 'control the starting of the display device'; the voice may also be a play instruction, such as "play Zhou Jielun song". In an application scenario of the instance test, the voice may be a recognition voice, where the recognition voice is a user voice shown by the user according to the first identifier. For example, when the user sees the first identification shown on the display as "E", the corresponding user shows the recognized speech as "right, or to the right".

S203, generating a vision test result according to the matching result of the first identifier and the recognition voice.

The display device shown in this embodiment may include: the visual testing device comprises a display and a controller, wherein when a starting instruction for visual testing is received, the controller controls the display to display a visual chart, the visual chart at least comprises a first identifier, and the first identifier is an identifier which needs to be identified by a user; when the first identifier is displayed on the display, the controller receives the recognition voice through the user interface, and generates a vision test result according to the matching result of the first identifier and the recognition voice. The display device shown in the embodiment of the application can help the user to perform vision test, and the user experience is good.

In general, in order to reduce the data processing amount of one controller, two controllers may be disposed in the display device, and in the technical solution shown in the embodiment of the present application, the controllers may include a first controller and a second controller. The block diagram of the dual controller display device may refer to fig. 17, and the dual controller display device may be provided with a display, a first controller, a second controller, a camera, and a speaker, wherein the interaction process of the display, the first controller, the second controller, and the camera may refer to fig. 18-20.

FIG. 18 is a flow chart illustrating a process of interaction of components in a display device according to one possible embodiment.

The first controller is configured to execute step S301 to control the camera to be turned on in response to receiving a user instruction;

the second controller is configured to execute step S302, in response to receiving a user instruction, control the display to display an eye chart, wherein the eye chart at least comprises a first identifier, and the first identifier is an identifier which needs to be identified by a user;

the manner of displaying the eye chart can refer to the above embodiments, and will not be described herein.

When the display shows the first identifier, the first controller is configured to execute step S303 to control the camera to acquire a first image:

the process of acquiring the first image may refer to the above embodiment, and will not be described herein.

Step S304 of transmitting the first image to a second controller;

the transmission manner of the first image may be a transmission manner commonly used in the art, and will not be described herein.

Step S305 generates a vision test result according to the matching result of the first identifier and the first image.

The specific test matching process may refer to the implementation manner of the foregoing embodiment, which is not described in detail herein.

In some possible embodiments, the second controller may control the speaker to play the vision test results, and in other possible embodiments, the second controller may control the display to present the vision test results.

In the embodiment of the present application, the second controller is further configured to execute steps (21) - (24) of the above embodiment, so as to ensure accuracy of the test result of the display device shown in the present application. The above embodiments may be referred to for the retrieval or calculation of parameters involved in the data processing, and the applicant will not be reiterated here.

The display device shown in this embodiment may include: the visual testing device comprises a display, a camera, a first controller and a second controller, wherein when a starting instruction for visual testing is received, the first controller controls the camera to be started, and meanwhile, the second controller controls the display to display an visual chart, the visual chart at least comprises a first identification, and the first identification is an identification which needs to be identified by a user; when the display displays the first mark, the first controller controls the camera to acquire a first image and sends the first image to the second controller. And the second controller generates a vision test result according to the matching result of the first mark and the first image. The display device shown in the embodiment of the application can help to perform vision test, and has good user experience.

FIG. 19 is a flow chart illustrating a process of interaction of components in a display device according to one possible embodiment.

The first controller is configured to execute step S401 to control the camera to be turned on in response to receiving a user instruction;

The second controller is configured to execute step S402 to control the display to present an eye chart in response to receiving a user instruction, the eye chart including at least a first identification;

The second controller is configured to execute step S403 to send the direction information corresponding to the first identifier to the first controller;

the transmission method of the direction information may be a transmission method that is conventional in the art, and will not be described in detail herein.

When the display shows a first mark, the first controller is configured to execute step S404 to control the camera to acquire a first image;

The first controller is configured to perform step S405 to generate a vision test result based on the direction information and the matching result of the first image.

The display device shown in this embodiment may include: the visual testing device comprises a display, a camera, a first controller and a second controller, wherein when a starting instruction for visual testing is received, the first controller controls the camera to be started, and meanwhile, the second controller controls the display to display an visual chart, the visual chart at least comprises a first identification, and the first identification is an identification which needs to be identified by a user; the second controller is further used for sending the direction information corresponding to the first identifier to the first controller; when the display displays a first mark, the first controller controls the camera to acquire a first image and generates a vision test result according to a matching result of the first mark and the first image. The display device shown in the embodiment of the application can help to perform vision test, and has good user experience.

FIG. 20 is a flow chart illustrating a process of interaction of components in a display device according to one possible embodiment.

The first controller is configured to execute step S501 to control the camera to be turned on in response to receiving a user instruction;

The first controller is configured to execute step S502, in response to receiving a user instruction, to send an eye chart to the second controller, where the eye chart includes at least a first identifier, and the first identifier is an identifier that the user needs to identify;

the second controller is configured to perform step 503 to control the display to present the eye chart. When the display shows a first identifier, the first controller is further configured to execute step S504 to control the camera to acquire a first image;

the first controller is further configured to execute step S505 to generate a vision testing result according to the matching result of the first identifier and the first image;

in the embodiment of the present application, the first controller is further configured to execute steps (21) - (24) of the above embodiment, so as to ensure accuracy of the test result of the display device shown in the present application. The above embodiments may be referred to for the retrieval or calculation of parameters involved in the data processing, and the applicant will not be reiterated here.

The display device shown in this embodiment may include: the visual testing device comprises a display, a camera, a first controller and a second controller, wherein when a starting instruction for visual testing is received, the first controller controls the camera to be started, and meanwhile, an visual chart is sent to the second controller, the visual chart at least comprises a first identification, the first identification is an identification which a user needs to identify, and the second controller controls the display to display the visual chart; when the display displays a first mark, the first controller controls the camera to acquire a first image and generates a vision test result according to a matching result of the first mark and the first image. The display device shown in the embodiment of the application can help to perform vision test, and has good user experience.

In a specific implementation, the present invention further provides a computer storage medium, where the computer storage medium may store a program, where the program may include some or all of the steps in each embodiment of the method for customizing and starting a control key provided by the present invention when executed. The storage medium may be a magnetic disk, an optical disk, a read-only memory (ROM), a random-access memory (random access memory RAM), or the like.

It will be apparent to those skilled in the art that the techniques of embodiments of the present invention may be implemented in software plus a necessary general purpose hardware platform. Based on such understanding, the technical solutions in the embodiments of the present invention may be embodied in essence or what contributes to the prior art in the form of a software product, which may be stored in a storage medium, such as a ROM/RAM, a magnetic disk, an optical disk, etc., including several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the method described in the embodiments or some parts of the embodiments of the present invention.

Finally, it should be noted that: the above embodiments are only for illustrating the technical solution of the present application, and not for limiting the same; although the application has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical scheme described in the foregoing embodiments can be modified or some or all of the technical features thereof can be replaced by equivalents; such modifications and substitutions do not depart from the spirit of the application.

The foregoing description, for purposes of explanation, has been presented in conjunction with specific embodiments. The illustrative discussions above are not intended to be exhaustive or to limit the embodiments to the precise forms disclosed above. Many modifications and variations are possible in light of the above teaching. The embodiments were chosen and described in order to best explain the principles and the practical application, to thereby enable others skilled in the art to best utilize the embodiments and various embodiments with various modifications as are suited to the particular use contemplated.

Claims

1. A display device, characterized by comprising:

The display device is provided with a display device,

The camera is used for collecting images;

The controller is used for responding to the received starting instruction and controlling the display to display a prompt interface, and the prompt interface is used for indicating a user to enter a preset area;

when the display displays the prompt interface, controlling the camera to acquire a current image and displaying the current image in the display;

Creating a floating layer above the layer of the current image, and controlling the display to display an optimal position frame in the floating layer, wherein the optimal position frame is determined according to the position and the angle of the camera;

When the position of the user in the current image coincides with the optimal position frame and the coincidence degree reaches a preset threshold, controlling the display to display a prompt message and canceling the display of the floating layer, wherein the prompt message is used for indicating that the user enters a preset area;

Controlling the display to display an eye chart, wherein the eye chart at least comprises a first mark, and the first mark is a mark which needs to be identified by a user;

2. The display device of claim 1, wherein the eye chart further comprises a second logo, the second logo being displayed in a different manner than the first logo.

3. A display device according to claim 1 or 2, wherein in the eye chart, the same volume of indicia are located in the same row; the volume of the marks displayed on each row gradually decreases from top to bottom in the vertical direction;

The controller is further configured to: selecting the mark with the largest volume as a first mark;

And if the first image is matched with the first identifier, selecting any identifier in the next row of the current display identifier as the first identifier until the first image is not matched with the first identifier.

4. A display device according to claim 1 or 2, wherein in the eye chart, the same volume of indicia are located in the same row forming an eye row; the volume of the marks displayed on each row gradually decreases from top to bottom in the vertical direction;

The controller is further configured to: responding to a received user instruction, and reading the user vision grade carried by the user instruction, wherein the user instruction is an instruction sent by a user according to the vision condition of the user;

Screening out a target vision line from the vision chart, wherein the target vision line is matched with the vision grade of the user;

Selecting any mark in the target vision row as a first mark;

if the first image is matched with the first identifier, selecting any identifier in the next row of the currently displayed identifiers as the first identifier until the first image is not matched with the first identifier;

and if the first image is not matched with the first identifier, selecting any identifier in the previous row of the currently displayed identifier as the first identifier until the first image is matched with the first identifier.

5. The display device of claim 1, wherein in response to receiving the start-up instruction, the controller is further configured to:

Collecting a second image, wherein the second image is an image collected before the display displays the first mark;

calculating a first distance according to the second image, wherein the first distance is the distance between the human eye and the center of the display;

Adjusting a prestored visual acuity chart according to the first distance to obtain a first visual acuity chart;

And controlling the display to display the first visual acuity chart, wherein the first visual acuity chart at least comprises a first mark.

6. The display device of claim 5, wherein the controller is further configured to:

Calculating a second distance according to the second image and a pre-stored standard image, wherein the second distance is the distance from the human eye to the camera;

The first distance is calculated according to the following formula:

The cd is a first distance, h is a vertical distance from the human eye to the camera, and d ₁ is a second distance.

7. The display device of claim 5, wherein the controller is further configured to:

according to the second image and the pre-stored standard image, calculating the distance from the human eye to the camera;

The first distance is calculated according to the following formula:

The camera is positioned at the center of the display, wherein cd is a first distance, h is a vertical distance from the human eye to the camera, l is a distance from the camera to the center of the display, and d ₁ is a second distance.

8. The display device of claim 6 or 7, wherein the controller is further configured to:

Reading corresponding coordinate values of eyes in the second image in a display;

Calculating a first eye distance according to the coordinate values, wherein the first eye distance is the distance between eyes of a person in the second image;

A second eye distance and a third distance are called, wherein the second eye distance is the distance between two eyes of a person in the standard image, and the third distance is the distance between the eyes of the person and the camera when the standard image is shot;

The second distance is calculated according to the following formula:

d ₁＝d₂*A₁/A₂, wherein d ₁ is a second distance, a ₁ is a first eye distance, a ₂ is a second eye distance, and d ₂ is a third distance.

9. The display device of claim 6 or 7, wherein the controller is further configured to:

reading pixel values between two eyes in the second image;

Calculating a first eye distance according to the pixel value, wherein the first eye distance is the distance between two eyes of a person in the second image;

The second distance is calculated according to the following formula:

10. A display device, characterized by comprising:

A display;

When the display displays the prompt interface, controlling a camera to acquire a current image and displaying the current image in the display;