WO2017059577A1

WO2017059577A1 - Eyeball tracking device and auxiliary light source control method and related device thereof

Info

Publication number: WO2017059577A1
Application number: PCT/CN2015/091535
Authority: WO
Inventors: 刘峰
Original assignee: 华为技术有限公司
Priority date: 2015-10-09
Filing date: 2015-10-09
Publication date: 2017-04-13
Also published as: CN107004132B; CN107004132A

Abstract

An eyeball tracking device (100), comprising: a processor (110), an infrared camera (130) and an auxiliary light source (150); the processor (110) is electrically connected with the infrared camera (130) and the auxiliary light source (150); the infrared camera (150) is used to output a frame sync signal; the processor (110) is used to receive the frame sync signal; the auxiliary light source (150) is controlled, according to the frame sync signal, to continuously output infrared auxiliary light in a preset period of time; the infrared camera (130) is controlled to expose in the preset period of time; the duration of the preset period of time is shorter than the frame period, which is the cycle period of the frame sync signal. An auxiliary light source (150) control method and a control device (300) for the eyeball tracking device (100) and a non-volatile computer-readable storage medium storing one or more programs. The eyeball tracking device (100) has the advantages of low power consumption, and can effectively improve the image quality of an eyeball image.

Description

眼球跟踪装置及其辅助光源控制方法及相关装置Eyeball tracking device and auxiliary light source control method thereof and related device

技术领域Technical field

本发明涉及人机交互领域，尤其涉及一种眼球跟踪装置及其辅助光源控制方法、控制装置及一种存储一个或多个程序的非易失性计算机可读存储介质。The present invention relates to the field of human-computer interaction, and in particular to an eyeball tracking device and an auxiliary light source control method thereof, a control device, and a non-volatile computer readable storage medium storing one or more programs.

背景技术Background technique

随着人机交互技术的发展，在智能手机、平板电脑等智能终端中，已经实现了通过眼球跟踪来进行如控制电子书翻页、网页滚屏等简单的操作。目前，眼球跟踪技术主要体现在三个方面：一是根据眼球和眼球周边的特征变化进行跟踪；二是根据虹膜角度变化进行跟踪；三是主动投射红外线等光束到虹膜来提取特征。其中，主动投射红外线等光束到虹膜来提取特征的眼球跟踪技术具有较好的精确度，在基于眼球跟踪的人机交互领域已经得到了较为广泛的应用。然而，在现有的红外投射式眼球跟踪设备中，作为辅助光源的红外发光二极管(Light Emitting Diode，LED)在开启眼球跟踪功能时始终处于发射红外光的开启状态，无疑会增加整个设备的功耗。同时，在超薄化发展的智能手机、平板电脑等智能终端中，因红外LED长时间开启而产生的热量无法及时散出，从而导致终端发热严重，影响产品的用户体验。此外，因红外LED始终处于开启状态，使得红外摄像头在整个帧周期内均能捕捉到红外光，曝光时间较长，若终端或眼球因处于颠簸环境下，则会导致所述红外摄像头捕捉到眼球图像存在拖影等缺陷，进而影响眼球跟踪的精度。With the development of human-computer interaction technology, in smart terminals such as smart phones and tablet computers, simple operations such as controlling e-book page turning and web page scrolling have been realized through eye tracking. At present, the eye tracking technology is mainly embodied in three aspects: one is to track according to the changes in the characteristics of the eyeball and the periphery of the eyeball; the second is to track according to the change of the iris angle; the third is to actively project the infrared beam and other beams to the iris to extract features. Among them, the eyeball tracking technology that actively projects infrared light and other beams to the iris to extract features has better accuracy, and has been widely used in the field of human-computer interaction based on eye tracking. However, in the existing infrared projection type eye tracking device, the Light Emitting Diode (LED) as an auxiliary light source is always in the state of emitting infrared light when the eye tracking function is turned on, which undoubtedly increases the work of the entire device. Consumption. At the same time, in smart terminals such as smartphones and tablet computers that are ultra-thin, the heat generated by the infrared LEDs for a long time cannot be dissipated in time, resulting in serious heat generation of the terminals and affecting the user experience of the products. In addition, because the infrared LED is always on, the infrared camera can capture infrared light throughout the frame period, and the exposure time is long. If the terminal or the eyeball is in a bumpy environment, the infrared camera will catch the eyeball. The image has defects such as smear, which in turn affects the accuracy of eye tracking.

发明内容Summary of the invention

本发明实施例所要解决的技术问题在于，提供一种眼球跟踪装置及其辅助光源控制方法、控制装置及一种存储一个或多个程序的非易失性计算机可读存储介质，以解决现有技术中因辅助光源长时间开启而导致发热严重及因颠簸而导致眼球图像存在拖影的问题，从而降低眼球跟踪装置的功耗，提升眼球图像的成像质量及眼球跟踪精度。 The technical problem to be solved by the embodiments of the present invention is to provide an eyeball tracking device, an auxiliary light source control method thereof, a control device, and a non-volatile computer readable storage medium storing one or more programs to solve the existing In the technology, the auxiliary light source is turned on for a long time, causing serious heat generation and smearing of the eyeball image due to bumps, thereby reducing the power consumption of the eyeball tracking device, improving the imaging quality of the eyeball image and the eyeball tracking accuracy.

第一方面，提供一种眼球跟踪装置，包括处理器、红外摄像头及辅助光源；In a first aspect, an eyeball tracking device is provided, including a processor, an infrared camera, and an auxiliary light source;

所述处理器与所述红外摄像头及辅助光源均电气连接；The processor is electrically connected to the infrared camera and the auxiliary light source;

所述红外摄像头用于输出帧同步信号；The infrared camera is configured to output a frame synchronization signal;

所述处理器用于接收所述帧同步信号；根据帧同步信号控制所述辅助光源在预设时间段内持续输出红外辅助光；控制所述红外摄像头在所述预设时间段内曝光；The processor is configured to receive the frame synchronization signal; control the auxiliary light source to continuously output infrared auxiliary light for a preset time period according to the frame synchronization signal; and control the infrared camera to be exposed within the preset time period;

所述预设时间段的时长小于帧周期，所述帧周期为所述帧同步信号的循环周期。The duration of the preset time period is less than a frame period, and the frame period is a cycle period of the frame synchronization signal.

结合第一方面，在第一种可能的实现方式中，所述红外摄像头包括红外图像传感器，所述红外图像传感器包括多个像素行，所述多个像素行包括依次相邻设置的多个有效像素行，所述预设时间段的起始时刻不早于所述红外图像传感器的最后一个有效像素行的曝光扫描起始时刻，所述预设时间段的终止时刻不晚于当前帧周期的终止时刻。In conjunction with the first aspect, in a first possible implementation, the infrared camera includes an infrared image sensor, the infrared image sensor includes a plurality of pixel rows, and the plurality of pixel rows include a plurality of effective adjacently disposed a pixel row, the start time of the preset time period is not earlier than the exposure scan start time of the last effective pixel row of the infrared image sensor, and the termination time of the preset time period is no later than the current frame period. The moment of termination.

结合第一方面，在第二种可能的实现方式中，所述辅助光源包括驱动器和红外LED，所述红外LED通过所述驱动器与所述处理器电气连接，所述处理器还用于获取所述红外摄像头采集到的眼球图像的质量参数，并将所述质量参数与预设质量参数进行对比，进而根据对比结果生成驱动配置参数，并根据所述驱动配置参数控制所述驱动器调节驱动电流，进而驱动所述红外LED调节红外光强度，以提升下一帧眼球图像的质量。In conjunction with the first aspect, in a second possible implementation, the auxiliary light source includes a driver and an infrared LED, the infrared LED is electrically connected to the processor through the driver, and the processor is further configured to acquire Describe the quality parameter of the eyeball image collected by the infrared camera, compare the quality parameter with the preset quality parameter, generate a driving configuration parameter according to the comparison result, and control the driver to adjust the driving current according to the driving configuration parameter, The infrared LED is further driven to adjust the infrared light intensity to improve the quality of the next frame of the eyeball image.

结合第一方面，在第三种可能的实现方式中，所述处理器还用于获取所述红外摄像头采集到的眼球图像的质量参数，并将所述质量参数与预设质量参数进行对比，进而根据对比结果生成发光时间配置参数，并根据所述发光时间配置参数调整所述预设时间段的时长，进而控制所述辅助光源调整红外辅助光的发光时间，并控制所述红外摄像头同步调整曝光时间，以提升下一帧眼球图像的质量。With reference to the first aspect, in a third possible implementation, the processor is further configured to acquire a quality parameter of an eyeball image collected by the infrared camera, and compare the quality parameter with a preset quality parameter, And generating a lighting time configuration parameter according to the comparison result, and adjusting a duration of the preset time period according to the lighting time configuration parameter, thereby controlling the auxiliary light source to adjust the lighting time of the infrared auxiliary light, and controlling the infrared camera to synchronously adjust Exposure time to improve the quality of the next frame of the eyeball image.

第二方面，提供一种眼球跟踪装置的辅助光源控制方法，包括：In a second aspect, an auxiliary light source control method for an eyeball tracking device is provided, including:

根据帧同步信号控制辅助光源在预设时间段内持续输出红外辅助光；Controlling the auxiliary light source to continuously output the infrared auxiliary light for a preset period of time according to the frame synchronization signal;

控制红外摄像头在所述预设时间段内曝光；Controlling the infrared camera to be exposed during the preset time period;

其中，所述预设时间段的时长小于帧周期，所述帧周期为所述帧同步信号的循环周期。The duration of the preset time period is less than a frame period, and the frame period is the frame synchronization signal. Cycle time.

结合第二方面，在第一种可能的实现方式中，所述红外摄像头包括红外图像传感器，所述红外图像传感器包括多个像素行，所述多个像素行包括依次相邻设置的多个有效像素行，所述预设时间段的起始时刻不早于所述红外图像传感器的最后一个有效像素行的曝光扫描起始时刻，所述预设时间段的终止时刻不晚于当前帧周期的终止时刻。In conjunction with the second aspect, in a first possible implementation, the infrared camera includes an infrared image sensor, the infrared image sensor includes a plurality of pixel rows, and the plurality of pixel rows include a plurality of effective adjacently disposed a pixel row, the start time of the preset time period is not earlier than the exposure scan start time of the last effective pixel row of the infrared image sensor, and the termination time of the preset time period is no later than the current frame period. The moment of termination.

结合第二方面，在第二种可能的实现方式中，所述辅助光源包括驱动器和红外LED，所述红外LED通过所述驱动器与所述处理器电气连接，所述方法还包括：With reference to the second aspect, in a second possible implementation, the auxiliary light source includes a driver and an infrared LED, and the infrared LED is electrically connected to the processor through the driver, the method further includes:

所述处理器获取所述红外摄像头采集到的眼球图像的质量参数，并将所述质量参数与预设质量参数进行对比，获得对比结果；The processor acquires a quality parameter of the eyeball image collected by the infrared camera, and compares the quality parameter with a preset quality parameter to obtain a comparison result;

根据所述对比结果生成驱动配置参数，并根据所述驱动配置参数控制所述驱动器调节驱动电流，进而驱动所述红外LED调节红外光强度，以提升下一帧眼球图像的质量。Generating driving configuration parameters according to the comparison result, and controlling the driver to adjust the driving current according to the driving configuration parameter, thereby driving the infrared LED to adjust the infrared light intensity to improve the quality of the next frame of the eyeball image.

结合第二方面，在第三种可能的实现方式中，所述方法还包括：With reference to the second aspect, in a third possible implementation, the method further includes:

根据所述对比结果生成发光时间配置参数，并根据所述发光时间配置参数调整所述预设时间段的时长，进而控制所述辅助光源调整红外辅助光的发光时间，并控制所述红外摄像头同步调整曝光时间，以提升下一帧眼球图像的质量。Generating a lighting time configuration parameter according to the comparison result, and adjusting a duration of the preset time period according to the lighting time configuration parameter, thereby controlling the auxiliary light source to adjust an illumination time of the infrared auxiliary light, and controlling the infrared camera synchronization Adjust the exposure time to improve the quality of the next frame of the eye.

第三方面，提供一种眼球跟踪装置的辅助光源控制装置，包括：In a third aspect, an auxiliary light source control device for an eyeball tracking device is provided, including:

时序控制模块，用于根据帧同步信号控制辅助光源在预设时间段内持续输出红外辅助光；a timing control module, configured to control the auxiliary light source to continuously output the infrared auxiliary light for a preset period of time according to the frame synchronization signal;

所述时序控制模块，还用于控制红外摄像头在所述预设时间段内曝光；The timing control module is further configured to control the infrared camera to be exposed during the preset time period;

其中，所述预设时间段的时长小于帧周期，所述帧周期为所述帧同步信号的循环周期。The duration of the preset time period is less than a frame period, and the frame period is a cycle period of the frame synchronization signal.

结合第三方面，在第一种可能的实现方式中，所述红外摄像头包括红外图像传感器，所述红外图像传感器包括多个像素行，所述多个像素行包括依次相邻设置的多个有效像素行，所述预设时间段的起始时刻不早于所述红外图像传感器的最后一个有效像素行的曝光扫描起始时刻，所述预设时间段的终止时刻不晚于当前帧周期的终止时刻。In conjunction with the third aspect, in a first possible implementation, the infrared camera includes an infrared image sensor, the infrared image sensor includes a plurality of pixel rows, and the plurality of pixel rows include a plurality of effective adjacently disposed a pixel row, the start time of the preset time period is not earlier than the infrared image transmission The exposure scan start time of the last valid pixel row of the sensor, the termination time of the preset time period is no later than the end time of the current frame period.

结合第三方面，在第二种可能的实现方式中，所述辅助光源包括驱动器和红外LED，所述红外LED通过所述驱动器与所述处理器电气连接，所述装置还包括：In conjunction with the third aspect, in a second possible implementation, the auxiliary light source includes a driver and an infrared LED, and the infrared LED is electrically connected to the processor through the driver, the device further includes:

图像处理模块，用于获取所述红外摄像头采集到的眼球图像的质量参数，并将所述质量参数与预设质量参数进行对比，获得对比结果；An image processing module, configured to acquire a quality parameter of an eyeball image collected by the infrared camera, and compare the quality parameter with a preset quality parameter to obtain a comparison result;

驱动控制模块，用于根据所述对比结果生成驱动配置参数，并根据所述驱动配置参数控制所述驱动器调节驱动电流，进而驱动所述红外LED调节红外光强度，以提升下一帧眼球图像的质量。a driving control module, configured to generate a driving configuration parameter according to the comparison result, and control the driver to adjust a driving current according to the driving configuration parameter, thereby driving the infrared LED to adjust an infrared light intensity to improve an image of an eyeball of a next frame. quality.

结合第三方面，在第三种可能的实现方式中，所述装置还包括：In conjunction with the third aspect, in a third possible implementation, the apparatus further includes:

所述时序控制模块，还用于根据所述对比结果生成发光时间配置参数，并根据所述发光时间配置参数调整所述预设时间段的时长，进而控制所述辅助光源调整红外辅助光的发光时间，并控制所述红外摄像头同步调整曝光时间，以提升下一帧眼球图像的质量。The timing control module is further configured to generate a lighting time configuration parameter according to the comparison result, and adjust a duration of the preset time period according to the lighting time configuration parameter, thereby controlling the auxiliary light source to adjust the illumination of the infrared auxiliary light. Time, and control the infrared camera to adjust the exposure time synchronously to improve the quality of the next frame of the eyeball image.

第四方面，提供一种存储一个或多个程序的非易失性计算机可读存储介质，所述一个或多个程序包括指令，所述指令当被处理器调用时使处理器执行以下事件：In a fourth aspect, a non-transitory computer readable storage medium storing one or more programs is provided, the one or more programs comprising instructions that, when invoked by a processor, cause the processor to:

其中，所述预设时间段小于帧周期，所述帧周期为所述帧同步信号的循环周期。The preset time period is smaller than a frame period, and the frame period is a cycle period of the frame synchronization signal.

结合第四方面，在第一种可能的实现方式中，所述红外摄像头包括红外图像传感器，所述红外图像传感器包括多个像素行，所述多个像素行包括依次相邻设置的多个有效像素行，所述预设时间段的起始时刻不早于所述红外图像传感器的最后一个有效像素行的曝光扫描起始时刻，所述预设时间段的终止时刻不晚于当前帧周期的终止时刻。 With reference to the fourth aspect, in a first possible implementation manner, the infrared camera includes an infrared image sensor, the infrared image sensor includes a plurality of pixel rows, and the plurality of pixel rows include a plurality of effective adjacently disposed a pixel row, the start time of the preset time period is not earlier than the exposure scan start time of the last effective pixel row of the infrared image sensor, and the termination time of the preset time period is no later than the current frame period. The moment of termination.

结合第四方面，在第二种可能的实现方式中，所述辅助光源包括驱动器和红外LED，所述红外LED通过所述驱动器与所述处理器电气连接，所述事件还包括：In conjunction with the fourth aspect, in a second possible implementation, the auxiliary light source includes a driver and an infrared LED, and the infrared LED is electrically connected to the processor through the driver, and the event further includes:

结合第四方面，在第三种可能的实现方式中，所述事件还包括：In conjunction with the fourth aspect, in a third possible implementation manner, the event further includes:

所述眼球跟踪装置通过根据帧同步信号控制所述辅助光源在小于所述帧周期的预设时间段内持续输出红外辅助光，并控制所述红外摄像头在所述预设时间段内曝光，完成一帧眼球图像的采集，有效缩短了所述辅助光源的开启时间，以及所述红外摄像头的曝光时间，解决了现有技术中因辅助光源长时间开启而导致发热严重及因颠簸而导致眼球图像存在拖影的问题，降低了眼球跟踪装置的功耗，提升了眼球图像的成像质量及眼球跟踪精度。The eyeball tracking device controls the auxiliary light source to continuously output infrared auxiliary light within a preset time period less than the frame period according to the frame synchronization signal, and controls the infrared camera to be exposed within the preset time period to complete The acquisition of one frame of the eyeball effectively shortens the opening time of the auxiliary light source and the exposure time of the infrared camera, and solves the problem of the eyeball caused by the long-term opening of the auxiliary light source due to the auxiliary light source being turned on for a long time. There is a problem of smear, which reduces the power consumption of the eye tracking device, improves the imaging quality of the eyeball image and the eyeball tracking accuracy.

附图说明DRAWINGS

为了更清楚地说明本发明实施例或现有技术中的技术方案，下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍，显而易见地，下面描述中的附图仅仅是本发明的一些实施例，对于本领域普通技术人员来讲，在不付出创造性劳动的前提下，还可以根据这些附图获得其他的附图。In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the embodiments or the description of the prior art will be briefly described below. Obviously, the drawings in the following description are only It is a certain embodiment of the present invention, and other drawings can be obtained from those skilled in the art without any creative work.

图1是本发明提供的眼球跟踪装置的结构示意图；1 is a schematic structural view of an eyeball tracking device provided by the present invention;

图2是本发明提供的眼球跟踪装置的红外图像传感器的曝光时序示意图；2 is a schematic diagram showing exposure timing of an infrared image sensor of the eyeball tracking device provided by the present invention;

图3是本发明提供的眼球跟踪装置的另一结构示意图； 3 is another schematic structural view of an eyeball tracking device provided by the present invention;

图4是图3所示眼球跟踪装置的工作时序逻辑示意图；4 is a schematic diagram showing the operation timing of the eyeball tracking device shown in FIG. 3;

图5是本发明提供的眼球跟踪装置的辅助光源控制方法的流程示意图；5 is a schematic flow chart of an auxiliary light source control method of an eyeball tracking device provided by the present invention;

图6是本发明提供的眼球跟踪装置的示辅助光源控制方法的另一流程示意图；6 is another schematic flow chart of the method for controlling the auxiliary light source of the eyeball tracking device provided by the present invention;

图7是本发明提供的眼球跟踪装置的辅助光源控制装置的结构示意图；7 is a schematic structural view of an auxiliary light source control device of an eyeball tracking device provided by the present invention;

图8是图7所示辅助光源控制装置的应用场景示意图。FIG. 8 is a schematic diagram of an application scenario of the auxiliary light source control device shown in FIG. 7.

具体实施方式detailed description

下面将结合本发明实施例中的附图，对本发明实施例中的技术方案进行清楚、完整地描述，显然，所描述的实施例仅仅是本发明一部分实施例，而不是全部的实施例。基于本发明中的实施例，本领域普通技术人员在没有作出创造性劳动前提下所获得的所有其他实施例，都属于本发明保护的范围。The technical solutions in the embodiments of the present invention are clearly and completely described in the following with reference to the accompanying drawings in the embodiments of the present invention. It is obvious that the described embodiments are only a part of the embodiments of the present invention, but not all embodiments. All other embodiments obtained by those skilled in the art based on the embodiments of the present invention without creative efforts are within the scope of the present invention.

本发明第一实施例提供一种眼球跟踪装置100，应用于智能手机、平板电脑等智能终端(图未示)中，以通过跟踪眼球的运动轨迹控制所述智能终端，从而实现基于眼球跟踪的人机交互，例如，控制智能终端翻页、滚屏、多媒体播放等操作，所述操作功能不做具体限定。The first embodiment of the present invention provides an eyeball tracking device 100, which is applied to a smart terminal (not shown) such as a smart phone or a tablet computer to control the smart terminal by tracking the motion track of the eyeball, thereby implementing eyeball tracking. Human-computer interaction, for example, controlling the operation of the smart terminal to turn pages, scrolling, multimedia playback, etc., the operation function is not specifically limited.

图1是本发明提供的眼球跟踪装置的结构示意图。1 is a schematic structural view of an eyeball tracking device provided by the present invention.

请参阅图1，所述眼球跟踪装置100可以包括处理器110、红外摄像头130及辅助光源150，所述处理器110与所述红外摄像头130及辅助光源150均电气连接，所述红外摄像头130用于生成并输出帧同步信号，所述处理器110用于接收所述红外摄像头输出的帧同步信号，且根据所述帧同步信号控制所述辅助光源150在预设时间段内持续输出红外辅助光，并控制所述红外摄像头130在所述预设时间段内曝光，进而完成一帧眼球图像的采集。其中，所述帧周期为所述帧同步信号的循环周期，所述预设时间段的时长小于所述帧周期。Referring to FIG. 1 , the eyeball tracking device 100 may include a processor 110 , an infrared camera 130 , and an auxiliary light source 150 . The processor 110 is electrically connected to the infrared camera 130 and the auxiliary light source 150 , and the infrared camera 130 is used by the infrared camera 130 . Generating and outputting a frame synchronization signal, the processor 110 is configured to receive a frame synchronization signal output by the infrared camera, and control the auxiliary light source 150 to continuously output infrared auxiliary light for a preset period of time according to the frame synchronization signal. And controlling the infrared camera 130 to be exposed during the preset time period, thereby completing the acquisition of one frame of the eyeball image. The frame period is a cycle period of the frame synchronization signal, and the duration of the preset time period is smaller than the frame period.

可以理解，所述辅助光源150发出的红外辅助光投射到眼球表面，并在眼球表面形成反光点。在所述辅助光源150输出红外辅助光的同时，通过所述红外摄像头130采集所述形成有反光点的眼球图像，进而通过所述处理器110对所述采集到的眼球图像进行处理，并根据眼球跟踪算法计算得到眼球所注视的屏幕位置的坐标。进一步地，所述眼球跟踪装置100在所述预设时间段内控制所述辅助光源150输出红外辅助光，并控制所述红外摄像头130在所述预设时间段内曝光，完成一帧眼球图像的采集；所述处理器110通过对所述眼球图像进行处理，并根据眼球跟踪算法计算得到所述眼球图像对应的眼球所注视的屏幕位置的坐标，从而根据所述眼球所注视的屏幕位置的坐标的变化计算出眼球的运动轨迹，再进一步根据所述运动轨迹控制所述智能终端进行对应的翻页、滚屏、多媒体播放等操作。It can be understood that the infrared auxiliary light emitted by the auxiliary light source 150 is projected onto the surface of the eyeball, and a reflective spot is formed on the surface of the eyeball. While the auxiliary light source 150 outputs the infrared auxiliary light, the eyeball image formed by the reflective spot is collected by the infrared camera 130, and the collected eyeball image is processed by the processor 110, and according to The eye tracking algorithm calculates the coordinates of the screen position at which the eye is looking. Further, the eyeball tracking device 100 controls within the preset time period The auxiliary light source 150 outputs infrared auxiliary light, and controls the infrared camera 130 to be exposed during the preset time period to complete acquisition of one frame of the eyeball image; the processor 110 processes the image of the eyeball by And calculating, according to the eyeball tracking algorithm, the coordinates of the screen position that the eyeball corresponding to the eyeball image is watching, thereby calculating the motion trajectory of the eyeball according to the change of the coordinates of the screen position that the eyeball looks at, and further according to the motion trajectory. Controlling the smart terminal to perform corresponding operations such as page turning, scrolling, multimedia playing, and the like.

图2是本发明提供的眼球跟踪装置的红外图像传感器的曝光时序示意图。2 is a schematic diagram showing the exposure timing of an infrared image sensor of the eyeball tracking device provided by the present invention.

所述红外摄像头130包括红外图像传感器，所述红外图像传感器可以包括多个像素行，其中，所述多个像素行可以包括依次相邻设置的多个有效像素行(Valid Line)L1～LN和依次相邻设置的多个伪像素行(Dummy Line)D1～DM，所述有效像素行L1～LN在曝光时形成有效数据，所述伪像素行D1～DM为在所述有效像素行L1～LN之外增加的一些不作为有效数据输出的像素行。其中，至少存在一个伪像素行。所述有效像素行在每一个帧周期的曝光时序包括数据读取时间(对应图2中的R部分)和曝光扫描时间(对应图2中的Expo＝full)。其中，在所述曝光扫描时间内，所述有效像素行在红外辅助光发光时曝光以完成图像数据采集；所述数据读取时间用于读取所述有效像素行在前一帧采集到的图像数据。可以理解，不同的红外图像传感器的数据读取时间可以不同。所述红外图像传感器对所述有效像素行进行逐行扫描，所述有效像素行在红外辅助光发光时曝光。The infrared camera 130 includes an infrared image sensor, and the infrared image sensor may include a plurality of pixel rows, wherein the plurality of pixel rows may include a plurality of valid pixel rows (Lid Lines) L1 to LN and sequentially disposed adjacent to each other. a plurality of dummy pixel rows D1 to DM which are sequentially disposed adjacent to each other, wherein the effective pixel rows L1 to LN form valid data when exposed, and the dummy pixel rows D1 to DM are in the effective pixel row L1 to Some additional rows of pixels that are not output as valid data outside of LN. There is at least one dummy pixel row. The exposure timing of the effective pixel row at each frame period includes a data read time (corresponding to the R portion in FIG. 2) and an exposure scan time (corresponding to Expo=full in FIG. 2). Wherein, during the exposure scanning time, the effective pixel row is exposed when the infrared auxiliary light is illuminated to complete image data acquisition; and the data reading time is used to read the effective pixel row collected in the previous frame. Image data. It can be understood that the data reading time of different infrared image sensors can be different. The infrared image sensor performs progressive scan on the effective pixel row, and the effective pixel row is exposed when the infrared auxiliary light emits light.

在本实施例中，以所述红外图像传感器包括8个有效像素行L1～L8和4个伪像素行D1～D4为例进行说明，具体如图2所示。其中，Vsync为帧同步信号，所述Vsync为周期信号，其周期为一个帧周期；T0为一个帧周期的起始时刻，T1为最后一个有效像素行L8的曝光扫描起始时刻，T2为一个帧周期的终止时刻。当所述红外图像传感器对所述多个像素行进逐行扫描时，所述8个有效像素行L1～L8在一个帧周期内存在一段同步曝光扫描时间，所述同步曝光扫描时间的起始时刻等于所述第8个有效像素行L8的曝光扫描起始时刻T1，所述同步曝光扫描时间的终止时刻等于当前帧周期的终止时刻T2。In this embodiment, the infrared image sensor includes eight effective pixel rows L1 to L8 and four dummy pixel rows D1 to D4 as an example, as shown in FIG. 2 . Wherein, Vsync is a frame synchronization signal, the Vsync is a periodic signal, and its period is one frame period; T0 is a start time of one frame period, and T1 is an exposure scan start time of the last effective pixel row L8, and T2 is a The end time of the frame period. When the infrared image sensor scans the plurality of pixels progressively, the 8 effective pixel rows L1 L L8 have a synchronous exposure scan time in one frame period, and the start time of the synchronous exposure scan time Equal to the exposure scan start time T1 of the eighth effective pixel row L8, the end time of the synchronous exposure scan time is equal to the end time T2 of the current frame period.

可以理解，所述红外图像传感器可以包括不同的有效像素行和伪像素行，同时，通过配置所述有效像素行与伪像素行的搭配比例，可以调整所述同步曝光扫描时间的长短。在本实施例中，若将所述预设时间设置于所述同步曝光扫描时间段内，并在所述预设时间段内控制所述辅助光源150开启，即可保证所述多个有效像素在所述预设时间段内具有相同的曝光时间长度，进而在所述预设时间段内完成一帧眼球图像的采集。It can be understood that the infrared image sensor may include different effective pixel rows and dummy pixel rows, and the synchronous exposure may be adjusted by configuring a ratio of the effective pixel rows to the pseudo pixel rows. The length of the light scan time. In this embodiment, if the preset time is set in the synchronous exposure scanning period, and the auxiliary light source 150 is controlled to be turned on within the preset time period, the plurality of effective pixels may be ensured. The same exposure time length is included in the preset time period, and then the acquisition of one frame of the eyeball image is completed within the preset time period.

为避免所述辅助光源150在整个帧周期内始终处于发射红外光的开启状态，增加所述眼球跟踪装置100的功耗和发热量；同时，为了避免在颠簸环境下因曝光时间过长而导致所述红外摄像头130采集到的眼球图像存在拖影缺陷，在本实施例中，通过所述处理器110根据所述帧同步信号控制所述辅助光源150在预设时间段内持续输出红外辅助光，并控制所述红外摄像头130在所述预设时间段内曝光，完成一帧眼球图像的采集。其中，所述预设时间段的起始时刻不早于所述红外图像传感器的最后一个有效像素行的曝光扫描起始时刻，所述预设时间段的终止时刻不晚于当前帧周期的终止时刻。如此，即可以在缩短所述辅助光源150的发光时间及所述红外摄像头130的曝光时间的同时，保证所述多个有效像素行具有相同的曝光时间长度，从而有效降低所述眼球跟踪装置的功耗，并提升所述红外摄像头130在颠簸环境下的眼球图像成像质量。In order to prevent the auxiliary light source 150 from being in an open state of emitting infrared light throughout the frame period, the power consumption and heat generation of the eyeball tracking device 100 are increased; at the same time, in order to avoid excessive exposure time in a bumpy environment, The eyeball image collected by the infrared camera 130 has a smear defect. In the embodiment, the processor 110 controls the auxiliary light source 150 to continuously output infrared auxiliary light for a preset period of time according to the frame synchronization signal. And controlling the infrared camera 130 to be exposed during the preset time period to complete acquisition of one frame of the eyeball image. The start time of the preset time period is not earlier than the start time of the exposure scan of the last effective pixel row of the infrared image sensor, and the end time of the preset time period is not later than the end of the current frame period. time. In this way, it is possible to ensure that the plurality of effective pixel rows have the same exposure time length while shortening the illumination time of the auxiliary light source 150 and the exposure time of the infrared camera 130, thereby effectively reducing the eyeball tracking device. The power consumption is increased, and the image quality of the eyeball image of the infrared camera 130 in a bumpy environment is improved.

其中，所述预设时间段的起始时刻不早于所述红外图像传感器的最后一个有效像素行的曝光扫描起始时刻，所述预设时间段的终止时刻不晚于当前帧周期的终止时刻，可以为以下四种情况之一：The start time of the preset time period is not earlier than the start time of the exposure scan of the last effective pixel row of the infrared image sensor, and the end time of the preset time period is not later than the end of the current frame period. At the moment, you can do one of the following four situations:

所述预设时间段的起始时刻等于所述红外图像传感器的最后一个有效像素行的曝光扫描起始时刻，所述预设时间段的终止时刻等于当前帧周期的终止时刻；或The start time of the preset time period is equal to the exposure scan start time of the last effective pixel row of the infrared image sensor, and the end time of the preset time period is equal to the end time of the current frame period; or

所述预设时间段的起始时刻等于所述红外图像传感器的最后一个有效像素行的曝光扫描起始时刻，所述预设时间段的终止时刻早于当前帧周期的终止时刻；或The start time of the preset time period is equal to the exposure scan start time of the last effective pixel row of the infrared image sensor, and the end time of the preset time period is earlier than the end time of the current frame period; or

所述预设时间段的起始时刻晚于所述红外图像传感器的最后一个有效像素行的曝光扫描起始时刻，所述预设时间段的终止时刻等于当前帧周期的终止时刻；或The start time of the preset time period is later than the exposure scan start time of the last effective pixel row of the infrared image sensor, and the end time of the preset time period is equal to the end time of the current frame period; or

所述预设时间段的起始时刻晚于所述红外图像传感器的最后一个有效像素行的曝光扫描起始时刻，所述预设时间段的终止时刻早于当前帧周期的终止时刻。The starting time of the preset time period is later than the last effective image of the infrared image sensor The start time of the exposure scan of the prime line, the end time of the preset time period is earlier than the end time of the current frame period.

具体地，所述处理器110根据帧同步信号控制所述辅助光源150在预设时间段内持续输出红外辅助光，控制所述红外摄像头130在所述预设时间段内曝光，包括：Specifically, the processor 110 controls the auxiliary light source 150 to continuously output infrared auxiliary light for a preset period of time according to the frame synchronization signal, and controls the infrared camera 130 to be exposed during the preset time period, including:

所述处理器110在所述帧同步信号的帧周期的起始时刻T0开始计时，并在计时到达所述预设时间段的起始时刻时输出开启控制信号，以通过所述开启控制信号控制所述辅助光源150输出红外辅助光，并控制所述红外摄像头130开始曝光；其中，所述预设时间段的起始时刻可以等于或晚于所述红外图像传感器的最后一个有效像素行的曝光扫描起始时刻。The processor 110 starts counting at a starting time T0 of a frame period of the frame synchronization signal, and outputs an opening control signal when the timing reaches a starting time of the preset time period to be controlled by the opening control signal. The auxiliary light source 150 outputs infrared auxiliary light, and controls the infrared camera 130 to start exposure; wherein the start time of the preset time period may be equal to or later than the exposure of the last effective pixel row of the infrared image sensor. Scan start time.

所述处理器110在计时到达所述预设时间段的终止时刻时输出关闭控制信号，以通过所述关闭控制信号控制所述辅助光源150关闭红外辅助光，并控制所述红外摄像头130结束曝光；其中，所述预设时间段的终止时刻可以等于或早于当前帧周期的终止时刻。The processor 110 outputs a shutdown control signal when the timing reaches the termination time of the preset time period, to control the auxiliary light source 150 to turn off the infrared auxiliary light by the shutdown control signal, and control the infrared camera 130 to end the exposure. The termination time of the preset time period may be equal to or earlier than the termination time of the current frame period.

图3是本发明提供的眼球跟踪装置的另一结构示意图。FIG. 3 is another schematic structural view of an eyeball tracking device provided by the present invention.

请参阅图3，在本实施例中，所述处理器110包括第一通用输入/输出端口GPIO_A和第二通用输入/输出端口GPIO_B，所述红外摄像头130通过所述第一通用输入/输出端口GPIO_A与所述处理器110电气连接。所述辅助光源150包括驱动器151和红外LED 153，所述辅助光源150通过第二通用输入/输出端口GPIO_B与所述处理器110电气连接。所述帧同步信号由所述红外摄像头130生成，并通过所述第一通用输入/输出端口GPIO_A传输给所述处理器110。所述帧同步信号的周期与所述红外摄像头130的帧周期相同。所述处理器110在所述帧同步信号的帧周期的起始时刻T0开始计时，并在计时到达所述预设时间段的起始时刻时生成开启控制信号，并通过所述第二通用输入/输出端口GPIO_B传递至所述驱动器151，以控制所述驱动器151输出驱动电流，进而驱动所述红外LED 153输出红外辅助光，并控制所述红外摄像头130开始曝光。当所述处理器110在计时到达所述预设时间段的终止时刻时生成关闭控制信号，并通过第二通用输入/输出端口GPIO_B传递至所述驱动器151，以控制所述驱动器151停止输出驱动电流，进而控制所述红外LED 153关闭，并控制所述红外摄像头130结束曝光。可以理解，所述帧同步信号并不限定由所述红外摄像头130生成，还可以由所述处理器110或者另外的时序控制器生成，只需要在所述帧同步信号的周期与所述红外摄像头130的帧周期相同即可。Referring to FIG. 3, in the embodiment, the processor 110 includes a first general-purpose input/output port GPIO_A and a second universal input/output port GPIO_B, and the infrared camera 130 passes through the first universal input/output port. The GPIO_A is electrically connected to the processor 110. The auxiliary light source 150 includes a driver 151 and an infrared LED 153 that is electrically connected to the processor 110 through a second universal input/output port GPIO_B. The frame synchronization signal is generated by the infrared camera 130 and transmitted to the processor 110 through the first general purpose input/output port GPIO_A. The period of the frame synchronization signal is the same as the frame period of the infrared camera 130. The processor 110 starts timing at a start time T0 of a frame period of the frame synchronization signal, and generates an enable control signal when the timing reaches a start time of the preset time period, and passes the second universal input. The output port GPIO_B is passed to the driver 151 to control the driver 151 to output a driving current, thereby driving the infrared LED 153 to output infrared auxiliary light, and controlling the infrared camera 130 to start exposure. When the processor 110 reaches the termination time of the preset time period, the shutdown control signal is generated and transmitted to the driver 151 through the second universal input/output port GPIO_B to control the driver 151 to stop output driving. Current, thereby controlling the infrared LED 153 to be turned off, and controlled The infrared camera 130 is caused to end exposure. It can be understood that the frame synchronization signal is not limited to be generated by the infrared camera 130, and may also be generated by the processor 110 or another timing controller, only during the period of the frame synchronization signal and the infrared camera. The frame period of 130 is the same.

图4是图3所示眼球跟踪装置的工作时序逻辑示意图。4 is a schematic diagram showing the operation timing of the eyeball tracking device shown in FIG.

请参阅图4，其中，Sync/GPIO_A为所述处理器110通过所述第一通用输入/输出端口GPIO_A接收到的帧同步信号，GPIO_B为所述处理器110通过所述第二通用输入/输出端口GPIO_B传递的控制信号；T0为当前帧周期的起始时刻，T1为所述预设时间段的起始时刻，T2为当前帧周期的终止时刻(本实施例中即为所述预设时间段的终止时刻)。具体地，所述处理器110在接收到所述帧同步信号时，从所述当前帧周期的起始时刻T0开始计时，计时时长为T1-T0；当计时到达所述预设时间段的起始时刻T1时，所述处理器110通过所述第二通用输入/输出端口GPIO_B输出所述控制信号，并传递至所述驱动器151，以控制所述驱动器151输出驱动电流，进而驱动所述红外LED 153输出红外辅助光；当计时到达所述预设时间段的终止时刻(本实施例中即为当前帧周期的终止时刻T2)时，所述处理器110通过所述第二通用输入/输出端口GPIO_B输出所述控制信号，并传递至所述驱动器151，以控制所述驱动器151停止输出驱动电流，进而控制所述红外LED 153停止输出红外辅助光。在本实施例中，所述控制信号为电平触发信号。如图4中所示，当所述处理器110在计时到达所述预设时间段的起始时刻时，由所述第二通用输入/输出端口GPIO_B输出高电平信号(即开启控制信号)，以控制所述辅助光源150输出红外辅助光，并控制所述红外摄像头130开始曝光；所述处理器110在计时到达所述预设时间段的终止时刻时，将所述第二通用输入/输出端口GPIO_B的输出信号由高电平信号切换为低电平信号(即关闭控制信号)，以控制所述辅助光源150关闭红外辅助光，并控制所述红外摄像头130结束曝光。可以理解，所述开启控制信号及关闭控制信号还可以是脉冲触发信号，当所述处理器110在计时到达所述预设时间段的起始时刻时，输出一个脉冲信号，以控制所述辅助光源150输出红外辅助光，并控制所述红外摄像头130开始曝光；当所述处理器110在计时到达所述预设时间段的终止时刻时输出输出一个脉冲信号，以控制所述辅助光源150关闭红外辅助光，并控制所述红外摄像头130结束曝光。可以理解，本发明的实施例中给出的电平高低或输出脉冲的正负只是本发明实施例的一种实现方式，所述控制信号各参数值可以根据电路的需要进行适当的调整。例如，当所述开启控制信号及关闭控制信号为电平触发信号时，所述处理器110还可以通过所述第二通用输入/输出端口GPIO_B输出低电平信号作为所述开启控制信号，相应地通过所述第二通用输入/输出端口GPIO_B输出高电平信号作为所述关闭控制信号；当所述开启控制信号及关闭控制信号为脉冲触发信号时，所述处理器110可以通过所述第二通用输入/输出端口GPIO_B输出高、低脉冲分别作为所述开启控制信号和关闭控制信号，或者通过所述第二通用输入/输出端口GPIO_B输出正、负脉冲分别分别作为所述开启控制信号和关闭控制信号。Please refer to FIG. 4, wherein Sync/GPIO_A is a frame synchronization signal received by the processor 110 through the first general-purpose input/output port GPIO_A, and GPIO_B is the second general-purpose input/output of the processor 110. The control signal transmitted by the port GPIO_B; T0 is the start time of the current frame period, T1 is the start time of the preset time period, and T2 is the end time of the current frame period (in the present embodiment, the preset time is The termination time of the segment). Specifically, when receiving the frame synchronization signal, the processor 110 starts timing from a start time T0 of the current frame period, and the time duration is T1-T0; when the timing reaches the preset time period At the start time T1, the processor 110 outputs the control signal through the second universal input/output port GPIO_B, and transmits the control signal to the driver 151 to control the driver 151 to output a driving current, thereby driving the infrared The LED 153 outputs infrared auxiliary light; when the timing reaches the end time of the preset time period (in this embodiment, the end time T2 of the current frame period), the processor 110 passes the second universal input/output. The port GPIO_B outputs the control signal and transmits it to the driver 151 to control the driver 151 to stop outputting the driving current, thereby controlling the infrared LED 153 to stop outputting the infrared auxiliary light. In this embodiment, the control signal is a level trigger signal. As shown in FIG. 4, when the processor 110 reaches the start time of the preset time period, the second general-purpose input/output port GPIO_B outputs a high-level signal (ie, turns on the control signal). Controlling the auxiliary light source 150 to output infrared auxiliary light, and controlling the infrared camera 130 to start exposure; the processor 110, when the timing reaches the end time of the preset time period, the second universal input / The output signal of the output port GPIO_B is switched from a high level signal to a low level signal (ie, the control signal is turned off) to control the auxiliary light source 150 to turn off the infrared auxiliary light, and to control the infrared camera 130 to end the exposure. It can be understood that the turn-on control signal and the turn-off control signal may also be pulse trigger signals. When the processor 110 reaches the start time of the preset time period, the processor 110 outputs a pulse signal to control the auxiliary. The light source 150 outputs infrared auxiliary light, and controls the infrared camera 130 to start exposure; when the processor 110 reaches the end time of the preset time period, outputs a pulse signal to control the auxiliary light source 150 to be turned off. The infrared assists the light and controls the infrared camera 130 to end the exposure. It can be understood that the level of the level or the positive or negative of the output pulse in the embodiment of the present invention is only one implementation of the embodiment of the present invention, and the parameter values of the control signal can be appropriately adjusted according to the needs of the circuit. For example, when the turn-on control signal and the turn-off control signal are level trigger signals, the processor 110 may further output a low-level signal as the turn-on control signal through the second general-purpose input/output port GPIO_B, correspondingly The second general-purpose input/output port GPIO_B outputs a high-level signal as the shutdown control signal; when the on-control signal and the off-control signal are pulse trigger signals, the processor 110 may pass the The two general-purpose input/output ports GPIO_B output high and low pulses as the turn-on control signal and the turn-off control signal, respectively, or output positive and negative pulses respectively through the second general-purpose input/output port GPIO_B as the turn-on control signal and Turn off the control signal.

在第一可选实施例中，所述红外摄像头130在完成一帧眼球图像的采集后，所述眼球图像被传送至所述处理器110，所述处理器110通过调用眼球跟踪算法对所述帧眼球图像进行处理，计算得到每一帧眼球图像对应的眼球所注视的屏幕位置的坐标，从而根据所述眼球所注视的屏幕位置的坐标的变化计算出眼球的运动轨迹。同时，所述处理器110还用于获取所述眼球图像的质量参数，并将所述质量参数与预设质量参数进行对比，进而根据对比结果生成驱动配置参数，并根据所述驱动配置参数控制所述驱动器151调节驱动电流，进而驱动所述红外LED 153调节红外光强度，以提升下一个帧周期内所述红外摄像头130采集到的眼球图像的质量。具体地，所述眼球图像的质量参数可以包括清晰度、噪点数、对比度等，所述预设质量参数为根据所述眼球跟踪装置100的精度需求，通过调试而得到的较佳的清晰度范围、噪点数范围、对比度范围等。例如，当所述处理器110获取到所述眼球图像的清晰度后，将该清晰度与所述预设清晰度范围进行对比，当所述眼球图像的清晰度小于所述预设清晰度范围时，生成驱动配置参数，以控制所述驱动器151增大驱动电流，进而驱动所述红外光LED 153增大红外光强度，以在下一帧眼球图像采集时，提升眼球图像的清晰度。In a first alternative embodiment, after the infrared camera 130 completes the acquisition of one frame of the eyeball image, the eyeball image is transmitted to the processor 110, and the processor 110 calls the eyeball tracking algorithm to The frame eyeball image is processed, and the coordinates of the screen position that the eyeball corresponding to each eyeball image is looked at are calculated, so that the motion track of the eyeball is calculated according to the change of the coordinates of the screen position that the eyeball looks at. At the same time, the processor 110 is further configured to acquire a quality parameter of the eyeball image, compare the quality parameter with a preset quality parameter, and generate a driving configuration parameter according to the comparison result, and control according to the driving configuration parameter. The driver 151 adjusts the driving current, thereby driving the infrared LED 153 to adjust the infrared light intensity to improve the quality of the eyeball image collected by the infrared camera 130 in the next frame period. Specifically, the quality parameter of the eyeball image may include sharpness, noise number, contrast, and the like, and the preset quality parameter is a better definition range obtained by debugging according to the accuracy requirement of the eyeball tracking device 100. , noise range, contrast range, etc. For example, when the processor 110 acquires the sharpness of the eyeball image, the sharpness is compared with the preset sharpness range, when the sharpness of the eyeball image is smaller than the preset sharpness range. At this time, a driving configuration parameter is generated to control the driver 151 to increase the driving current, thereby driving the infrared light LED 153 to increase the infrared light intensity to enhance the sharpness of the eyeball image when the next frame of the eyeball image is acquired.

在第二可选实施例中，所述处理器110在获取所述眼球图像的质量参数，并将所述质量参数与预设质量参数进行对比之后，还用于根据所述对比结果生成发光时间配置参数，并根据所述发光时间配置参数调整所述预设时间段的时长，进而控制所述辅助光源150调整红外辅助光的发光时间，并控制所述红外摄像头130同步调整曝光时间，以提升下一个帧周期内所述红外摄像头采集到的眼球图像的质量。例如，当所述处理器110获取到所述眼球图像的噪点数后，将该噪点数与所述预设噪点数范围进行对比，当所述眼球图像的噪点数大于所述预设噪点数范围时，生成发光时间配置参数，并根据所述发光时间配置参数缩短所述预设时间段的时长，进而控制所述辅助光源150缩短红外辅助光的发光时间，并控制所述红外摄像头130同步缩短曝光时间，以在下一帧眼球图像采集时，降低眼球图像的噪点数。In a second optional embodiment, after acquiring the quality parameter of the eyeball image and comparing the quality parameter with the preset quality parameter, the processor 110 is further configured to generate a lighting time according to the comparison result. Configuring parameters, and adjusting the preset time period according to the lighting time configuration parameter Long, and then controlling the auxiliary light source 150 to adjust the illumination time of the infrared auxiliary light, and controlling the infrared camera 130 to synchronously adjust the exposure time to improve the quality of the eyeball image collected by the infrared camera in the next frame period. For example, after the processor 110 acquires the number of noises of the eyeball image, comparing the number of noises with the preset noise number range, when the number of noises of the eyeball image is greater than the preset noise number range. And generating a lighting time configuration parameter, and shortening the duration of the preset time period according to the lighting time configuration parameter, thereby controlling the auxiliary light source 150 to shorten the lighting time of the infrared auxiliary light, and controlling the infrared camera 130 to be shortened simultaneously Exposure time to reduce the number of noise of the eyeball image when the next frame of eyeball image is acquired.

图5是本发明提供的眼球跟踪装置的辅助光源控制方法的流程示意图。FIG. 5 is a schematic flow chart of an auxiliary light source control method of the eyeball tracking device provided by the present invention.

请参阅图5，本发明第二实施例提供一种眼球跟踪装置的辅助光源控制方法，应用于本发明第一实施例所述提供的眼球跟踪装置100中，以降低所述眼球跟踪装置100的功耗，并提升眼球图像的成像质量，改善眼球跟踪的精度。所述辅助光源控制方法至少包括如下步骤：Referring to FIG. 5, a second embodiment of the present invention provides an auxiliary light source control method for an eyeball tracking device, which is applied to the eyeball tracking device 100 provided in the first embodiment of the present invention to reduce the eyeball tracking device 100. Power consumption, and improve the image quality of the eyeball image, improving the accuracy of eye tracking. The auxiliary light source control method includes at least the following steps:

步骤S201：根据帧同步信号控制辅助光源在预设时间段内持续输出红外辅助光；Step S201: controlling the auxiliary light source to continuously output the infrared auxiliary light for a preset period of time according to the frame synchronization signal;

步骤S202：控制红外摄像头在所述预设时间段内曝光；Step S202: controlling the infrared camera to be exposed during the preset time period;

可以理解，图5中用流程图表示所述步骤S201与步骤S202，只是为了方便描述清楚所述辅助光源控制方法中所包含的执行动作，并不对所述步骤S201与步骤S202的执行顺序构成限定。在本实施例中，所述步骤S201与步骤S202可以同步执行。It can be understood that the step S201 and the step S202 are represented by a flowchart in FIG. 5, but the execution actions included in the auxiliary light source control method are not described for convenience of description, and the execution order of the step S201 and the step S202 is not limited. . In this embodiment, the step S201 and the step S202 can be performed synchronously.

所述红外摄像头包括红外图像传感器，所述红外图像传感器包括多个像素行，其中，所述多个像素行可以包括依次相邻设置的多个有效像素行和依次相邻设置的多个伪像素行，当所述红外图像传感器对所述多个像素行逐行扫描时，所述依次相邻设置的多个有效像素行在一个帧周期内存在一段同步曝光扫描时间，所述同步曝光扫描时间的起始时刻等于最后一个有效像素行的曝光扫描起始时刻，所述同步曝光扫描时间的终止时刻等于当前帧周期的终止时刻。可以理解，若将所述预设时间设置于所述同步曝光扫描时间段内，并在所述预设时间段内控制所述辅助光源开启，即可保证所述多个有效像素在所述预设时间段内具有相同的曝光时间长度，进而在所述预设时间段内完成一帧眼球图像的采集。因此，可以设置所述预设时间段的起始时刻不早于所述红外图像传感器的最后一个有效像素行的曝光扫描起始时刻，所述预设时间段的终止时刻不晚于当前帧周期的终止时刻。The infrared camera includes an infrared image sensor, and the infrared image sensor includes a plurality of pixel rows, wherein the plurality of pixel rows may include a plurality of effective pixel rows sequentially disposed adjacent to each other and a plurality of dummy pixels disposed adjacent to each other in sequence In the row, when the infrared image sensor scans the plurality of pixel rows row by row, the plurality of effective pixel rows disposed adjacent to each other have a synchronous exposure scan time in one frame period, and the synchronous exposure scan time The start time is equal to the exposure scan start time of the last valid pixel row, and the end time of the synchronous exposure scan time is equal to the end time of the current frame period. It can be understood that if the preset time is set in the synchronous exposure scanning period, and in the pre- Controlling the auxiliary light source to be turned on within a time period, that is, ensuring that the plurality of effective pixels have the same exposure time length in the preset time period, and further completing one frame of the eyeball image in the preset time period. collection. Therefore, the start time of the preset time period may be set not earlier than the exposure scan start time of the last effective pixel row of the infrared image sensor, and the end time of the preset time period is no later than the current frame period. The moment of termination.

所述预设时间段的起始时刻晚于所述红外图像传感器的最后一个有效像素行的曝光扫描起始时刻，所述预设时间段的终止时刻早于当前帧周期的终止时刻。The start time of the preset time period is later than the exposure scan start time of the last effective pixel row of the infrared image sensor, and the end time of the preset time period is earlier than the end time of the current frame period.

其中，所述预设时间段的设置还可以参照图2及本发明第一实施例中的相关描述，此处不再赘述。For the setting of the preset time period, refer to FIG. 2 and related descriptions in the first embodiment of the present invention, and details are not described herein again.

图6是本发明提供的眼球跟踪装置的示辅助光源控制方法的另一流程示意图。FIG. 6 is another schematic flow chart of the method for controlling the auxiliary light source of the eyeball tracking device provided by the present invention.

请参阅图6，所述根据帧同步信号控制所述辅助光源在预设时间段内持续输出红外辅助光；控制所述红外摄像头在所述预设时间段内曝光，包括：Referring to FIG. 6, the auxiliary light source is continuously controlled to output infrared auxiliary light according to a frame synchronization signal; and controlling the infrared camera to be exposed during the preset time period includes:

步骤S211：触发处理器在所述帧同步信号的帧周期的起始时刻开始计时，并在计时到达所述预设时间段的起始时刻时输出开启控制信号，以通过所述开启控制信号控制所述辅助光源输出红外辅助光，并控制所述红外摄像头开始曝光；Step S211: The trigger processor starts timing at the start time of the frame period of the frame synchronization signal, and outputs an open control signal when the timing reaches the start time of the preset time period, to be controlled by the open control signal. The auxiliary light source outputs infrared auxiliary light, and controls the infrared camera to start exposure Light;

步骤S212：触发所述处理器在计时到达所述预设时间段的终止时刻时输出关闭控制信号，以通过所述关闭控制信号控制所述辅助光源关闭红外辅助光，并控制所述红外摄像头结束曝光。Step S212: triggering the processor to output a shutdown control signal when the timing reaches the termination time of the preset time period, to control the auxiliary light source to turn off the infrared auxiliary light by the shutdown control signal, and control the infrared camera to end exposure.

其中，所述帧同步信号与所述开启控制信号及关闭控制信号之间的关系，以及所述预设时间段与所述帧同步信号的关系还可以参照图3、图4及本发明第一实施例中的相关描述，此处不再赘述。The relationship between the frame synchronization signal and the opening control signal and the closing control signal, and the relationship between the preset time period and the frame synchronization signal may also refer to FIG. 3, FIG. 4 and the first aspect of the present invention. Related descriptions in the embodiments are not described herein again.

所述辅助光源可以包括驱动器和红外LED，所述红外LED通过所述驱动器与所述处理器电气连接，可选地，所述方法还包括：The auxiliary light source may include a driver and an infrared LED, and the infrared LED is electrically connected to the processor through the driver. Optionally, the method further includes:

根据所述对比结果生成驱动配置参数，并根据所述驱动配置参数控制所述驱动器调节驱动电流，进而驱动所述红外LED调节红外光强度，以提升下一个帧周期内所述红外摄像头采集到的眼球图像的质量。Generating a driving configuration parameter according to the comparison result, and controlling the driver to adjust a driving current according to the driving configuration parameter, thereby driving the infrared LED to adjust an infrared light intensity, so as to improve the infrared camera collected in the next frame period. The quality of the eyeball image.

其中，所述根据所述比对结果生成驱动配置参数，并根据所述驱动配置参数控制所述驱动器调节驱动电流的步骤的具体执行还可以参照本发明第一实施例中第一可选实施例中的相关描述，此处不再赘述。The specific implementation of the step of generating the driving configuration parameter according to the comparison result and controlling the driver to adjust the driving current according to the driving configuration parameter may also refer to the first optional embodiment in the first embodiment of the present invention. The related descriptions are not repeated here.

可选地，所述处理器获取所述红外摄像头采集到的眼球图像的质量参数，并将所述质量参数与预设质量参数进行对比，获得对比结果之后，所述方法还包括：Optionally, the processor acquires a quality parameter of the eyeball image collected by the infrared camera, and compares the quality parameter with a preset quality parameter to obtain a comparison result, where the method further includes:

根据所述对比结果生成发光时间配置参数，并根据所述发光时间配置参数调整所述预设时间段的时长，进而控制所述辅助光源调整红外辅助光的发光时间，并控制所述红外摄像头同步调整曝光时间，以提升下一个帧周期内所述红外摄像头采集到的眼球图像的质量。Generating a lighting time configuration parameter according to the comparison result, and adjusting a duration of the preset time period according to the lighting time configuration parameter, thereby controlling the auxiliary light source to adjust an illumination time of the infrared auxiliary light, and controlling the infrared camera synchronization The exposure time is adjusted to improve the quality of the eyeball image acquired by the infrared camera in the next frame period.

其中，所述根据所述对比结果生成发光时间配置参数，并根据所述发光时间配置参数调整所述预设时间段的时长的步骤的具体执行还可以参照本发明第一实施例中第二可选实施例中的相关描述，此处不再赘述。The specific implementation of the step of generating the illuminating time configuration parameter according to the comparison result and adjusting the duration of the preset time period according to the illuminating time configuration parameter may also refer to the second acquisition in the first embodiment of the present invention. The related description in the embodiment is omitted, and details are not described herein again.

图7是本发明提供的眼球跟踪装置的辅助光源控制装置的结构示意图。7 is a schematic structural view of an auxiliary light source control device of an eyeball tracking device provided by the present invention.

请参阅图7，本发明第三实施例提供一种眼球跟踪装置的辅助光源控制装置300，应用于本发明第一实施例所述提供的眼球跟踪装置100中，以降低所述眼球跟踪装置100的功耗，并提升眼球图像的成像质量，改善眼球跟踪的精度。所述辅助光源控制装置300包括：Referring to FIG. 7, a third embodiment of the present invention provides an auxiliary light source control device for an eyeball tracking device. 300 is applied to the eyeball tracking device 100 provided by the first embodiment of the present invention to reduce the power consumption of the eyeball tracking device 100, improve the imaging quality of the eyeball image, and improve the accuracy of the eyeball tracking. The auxiliary light source control device 300 includes:

时序控制模块310，用于根据帧同步信号控制辅助光源在所述预设时间段内持续输出红外辅助光；The timing control module 310 is configured to control, according to the frame synchronization signal, the auxiliary light source to continuously output the infrared auxiliary light during the preset time period;

所述时序控制模块310，还用于控制红外摄像头在所述预设时间段内曝光；其中，所述帧周期为所述帧同步信号的循环周期，所述预设时间段的时长小于所述帧周期。The timing control module 310 is further configured to control the infrared camera to be exposed during the preset time period; wherein the frame period is a cycle period of the frame synchronization signal, and the duration of the preset time period is less than the Frame period.

所述红外摄像头包括红外图像传感器，所述红外图像传感器包括多个像素行，其中，所述多个像素行可以包括依次相邻设置的多个有效像素行和依次相邻设置的多个伪像素行，当所述红外图像传感器对所述多个像素行逐行扫描时，所述依次相邻设置的多个有效像素行在一个帧周期内存在一段同步曝光扫描时间，所述同步曝光扫描时间的起始时刻等于最后一个有效像素行的曝光扫描起始时刻，所述同步曝光扫描时间的终止时刻等于当前帧周期的终止时刻。可以理解，若将所述预设时间设置于所述同步曝光扫描时间段内，并在所述预设时间段内控制所述辅助光源开启，即可保证所述多个有效像素在所述预设时间段内具有相同的曝光时间长度，进而在所述预设时间段内完成一帧眼球图像的采集。因此，可以设置所述预设时间段的起始时刻不早于所述红外图像传感器的最后一个有效像素行的曝光扫描起始时刻，所述预设时间段的终止时刻不晚于当前帧周期的终止时刻。The infrared camera includes an infrared image sensor, and the infrared image sensor includes a plurality of pixel rows, wherein the plurality of pixel rows may include a plurality of effective pixel rows sequentially disposed adjacent to each other and a plurality of dummy pixels disposed adjacent to each other in sequence In the row, when the infrared image sensor scans the plurality of pixel rows row by row, the plurality of effective pixel rows disposed adjacent to each other have a synchronous exposure scan time in one frame period, and the synchronous exposure scan time The start time is equal to the exposure scan start time of the last valid pixel row, and the end time of the synchronous exposure scan time is equal to the end time of the current frame period. It can be understood that if the preset time is set in the synchronous exposure scanning period and the auxiliary light source is turned on within the preset time period, the plurality of effective pixels can be guaranteed in the pre-predetermined It is assumed that the time period has the same exposure time length, and then the acquisition of one frame of the eyeball image is completed within the preset time period. Therefore, the start time of the preset time period may be set not earlier than the exposure scan start time of the last effective pixel row of the infrared image sensor, and the end time of the preset time period is no later than the current frame period. The moment of termination.

所述预设时间段的起始时刻等于所述红外图像传感器的最后一个有效像素行的曝光扫描起始时刻，所述预设时间段的终止时刻早于当前帧周期的终止时刻；或 The start time of the preset time period is equal to the exposure scan start time of the last effective pixel row of the infrared image sensor, and the end time of the preset time period is earlier than the end time of the current frame period; or

其中，所述时间窗口的形成及所述预设时间段与所述时间窗口的关系还可以参照图2及本发明第一实施例中的相关描述，此处不再赘述。For the formation of the time window and the relationship between the preset time period and the time window, refer to FIG. 2 and the related description in the first embodiment of the present invention, and details are not described herein again.

所述时序控制模块310，还用于：The timing control module 310 is further configured to:

触发处理器在所述帧同步信号的帧周期的起始时刻开始计时，并在计时到达所述预设时间段的起始时刻时输出开启控制信号，以通过所述开启控制信号控制所述辅助光源输出红外辅助光，并控制所述红外摄像头开始曝光；以及The triggering processor starts timing at a start time of a frame period of the frame synchronization signal, and outputs an on-control signal when the timing reaches a start time of the preset time period to control the auxiliary by the opening control signal The light source outputs infrared auxiliary light and controls the infrared camera to start exposure;

触发所述处理器在计时到达所述预设时间段的终止时刻时输出关闭控制信号，以通过所述关闭控制信号控制所述辅助光源关闭红外辅助光，并控制所述红外摄像头结束曝光。The processor is triggered to output a shutdown control signal when the timing reaches the termination time of the preset time period, to control the auxiliary light source to turn off the infrared auxiliary light by the shutdown control signal, and to control the infrared camera to end exposure.

所述辅助光源包括驱动器和红外LED，所述红外LED通过所述驱动器与所述处理器电气连接，可选地，所述装置300还包括：The auxiliary light source includes a driver and an infrared LED, and the infrared LED is electrically connected to the processor through the driver. Optionally, the device 300 further includes:

图像处理模块330，用于获取所述红外摄像头采集到的眼球图像的质量参数，并将所述质量参数与预设质量参数进行对比，获得对比结果；The image processing module 330 is configured to acquire a quality parameter of the eyeball image collected by the infrared camera, and compare the quality parameter with a preset quality parameter to obtain a comparison result;

驱动控制模块350，用于根据所述对比结果生成驱动配置参数，并根据所述驱动配置参数控制所述驱动器调节驱动电流，进而驱动所述红外LED调节红外光强度，以提升下一个帧周期内所述红外摄像头采集到的眼球图像的质量。The driving control module 350 is configured to generate a driving configuration parameter according to the comparison result, and control the driver to adjust the driving current according to the driving configuration parameter, thereby driving the infrared LED to adjust the infrared light intensity to improve the next frame period. The quality of the eyeball image collected by the infrared camera.

其中，所述驱动控制模块350的功能及执行还可以参照本发明第一实施例中第一可选实施例中的相关描述，此处不再赘述。For the function and the execution of the driving control module 350, reference may be made to the related description in the first alternative embodiment of the first embodiment of the present invention, and details are not described herein again.

可选地，所述图像处理模块330获取所述红外摄像头采集到的眼球图像的质量参数，并将所述质量参数与预设质量参数进行对比，获得对比结果之后；Optionally, the image processing module 330 acquires an eyeball image collected by the infrared camera. a quality parameter, and comparing the quality parameter with a preset quality parameter to obtain a comparison result;

所述时序控制模块310，还用于根据所述对比结果生成发光时间配置参数，并根据所述发光时间配置参数调整所述预设时间段的时长，进而控制所述辅助光源调整红外辅助光的发光时间，并控制所述红外摄像头同步调整曝光时间，以提升下一个帧周期内所述红外摄像头采集到的眼球图像的质量。The timing control module 310 is further configured to generate a lighting time configuration parameter according to the comparison result, and adjust a duration of the preset time period according to the lighting time configuration parameter, thereby controlling the auxiliary light source to adjust infrared auxiliary light. The illumination time is controlled, and the infrared camera is controlled to synchronously adjust the exposure time to improve the quality of the eyeball image collected by the infrared camera in the next frame period.

其中，所述时序控制模块310的功能及执行还可以参照本发明第一实施例中第二可选实施例中的相关描述，此处不再赘述。For the function and execution of the timing control module 310, refer to the related description in the second alternative embodiment of the first embodiment of the present invention, and details are not described herein again.

请参阅图8，在本实施例中，所述辅助光源控制装置300应用于所述眼球跟踪装置100中。可以理解，所述辅助光源控制装置300的各模块为程序算法模块，所述辅助光源控制装置300的各模块可以独立于所述处理器110设置，或者设置于所述处理器110内，所述处理器110用于调用所述辅助光源控制装置300的各模块，以完成对应功能的执行。其中，所述辅助光源控制装置300各模块功能的执行可参照本发明第一实施例中的相关描述，此处不再赘述。Referring to FIG. 8, in the present embodiment, the auxiliary light source control device 300 is applied to the eyeball tracking device 100. It can be understood that each module of the auxiliary light source control device 300 is a program algorithm module, and each module of the auxiliary light source control device 300 can be disposed independently of the processor 110 or disposed in the processor 110. The processor 110 is configured to invoke each module of the auxiliary light source control device 300 to perform execution of a corresponding function. For the execution of the functions of the modules of the auxiliary light source control device 300, refer to the related description in the first embodiment of the present invention, and details are not described herein again.

本发明第四实施例提供一种存储一个或多个程序的非易失性计算机可读存储介质，所述一个或多个程序包括指令，所述指令当被处理器调用时使处理器执行以下事件：A fourth embodiment of the present invention provides a non-transitory computer readable storage medium storing one or more programs, the one or more programs including instructions that, when invoked by a processor, cause the processor to execute the following event:

可选地，所述红外摄像头包括红外图像传感器，所述红外图像传感器包括多个像素行，所述多个像素行包括依次相邻设置的多个有效像素行，所述预设时间段的起始时刻不早于所述红外图像传感器的最后一个有效像素行的曝光扫描起始时刻，所述预设时间段的终止时刻不晚于当前帧周期的终止时刻。Optionally, the infrared camera includes an infrared image sensor, the infrared image sensor includes a plurality of pixel rows, and the plurality of pixel rows include a plurality of effective pixel rows disposed adjacently in sequence, starting from the preset time period The start time is not earlier than the exposure scan start time of the last effective pixel row of the infrared image sensor, and the end time of the preset time period is not later than the end time of the current frame period.

可选地，所述预设时间段的起始时刻等于所述红外图像传感器的最后一个有效像素行的曝光扫描起始时刻，所述预设时间段的终止时刻等于当前帧周期的终止时刻；或Optionally, a start time of the preset time period is equal to an exposure scan start time of a last valid pixel row of the infrared image sensor, and a termination time of the preset time period is equal to a termination time of a current frame period; or

所述预设时间段的起始时刻等于所述红外图像传感器的最后一个有效像素行的曝光扫描起始时刻，所述预设时间段的终止时刻早于当前帧周期的终止时刻；或The starting time of the preset time period is equal to the last effective image of the infrared image sensor a start time of the exposure scan, the end time of the preset time period is earlier than the end time of the current frame period; or

可选地，所述根据帧同步信号控制所述辅助光源在预设时间段内持续输出红外辅助光；控制所述红外摄像头在所述预设时间段内曝光，包括：Optionally, the controlling the auxiliary light source to continuously output infrared auxiliary light for a preset time period according to the frame synchronization signal; and controlling the infrared camera to be exposed during the preset time period, comprising:

触发处理器在所述帧同步信号的帧周期的起始时刻开始计时，并在计时到达所述预设时间段的起始时刻时输出开启控制信号，以通过所述开启控制信号控制所述辅助光源输出红外辅助光，并控制所述红外摄像头开始曝光；The triggering processor starts timing at a start time of a frame period of the frame synchronization signal, and outputs an on-control signal when the timing reaches a start time of the preset time period to control the auxiliary by the opening control signal The light source outputs infrared auxiliary light, and controls the infrared camera to start exposure;

可选地，所述辅助光源包括驱动器和红外LED，所述红外LED通过所述驱动器与所述处理器电气连接，则所述事件还包括：Optionally, the auxiliary light source includes a driver and an infrared LED, and the infrared LED is electrically connected to the processor through the driver, and the event further includes:

可选地，所述事件还包括：Optionally, the event further includes:

根据所述对比结果生成发光时间配置参数，并根据所述发光时间配置参数调整所述预设时间段的时长，进而控制所述辅助光源调整红外辅助光的发光时间，并控制所述红外摄像头同步调整曝光时间，以提升下一帧眼球图像的质量。 Generating a lighting time configuration parameter according to the comparison result, and adjusting a duration of the preset time period according to the lighting time configuration parameter, thereby controlling the auxiliary light source to adjust an illumination time of the infrared auxiliary light, and controlling the infrared camera synchronization Adjust the exposure time to improve the quality of the next frame of the eye.

可以理解，本实施例中所述指令当被处理器调用时使处理器执行的事件还可以参照本发明第二实施例及第三实施例中的描述，此处不再赘述。It can be understood that the events that are executed by the processor when the instructions are invoked by the processor in the embodiment can also refer to the description in the second embodiment and the third embodiment of the present invention, and details are not described herein again.

所述眼球跟踪装置100通过根据帧同步信号控制所述辅助光源150在小于所述帧周期的预设时间段内持续输出红外辅助光，并控制所述红外摄像头130在所述预设时间段内曝光，完成一帧眼球图像的采集，有效缩短了所述辅助光源150的开启时间，以及所述红外摄像头130的曝光时间，解决了现有技术中因辅助光源长时间开启而导致发热严重及因颠簸而导致眼球图像存在拖影的问题，降低了所述眼球跟踪装置100的功耗，提升了眼球图像的成像质量及眼球跟踪精度。The eyeball tracking device 100 controls the auxiliary light source 150 to continuously output infrared auxiliary light within a preset time period less than the frame period according to a frame synchronization signal, and controls the infrared camera 130 to be within the preset time period. Exposure, complete the acquisition of one frame of the eyeball image, effectively shortening the opening time of the auxiliary light source 150, and the exposure time of the infrared camera 130, solving the serious heat generation caused by the auxiliary light source being turned on for a long time in the prior art. The bump causes the smear of the eyeball image to be reduced, the power consumption of the eyeball tracking device 100 is reduced, and the imaging quality of the eyeball image and the eyeball tracking accuracy are improved.

以上所揭露的仅为本发明的较佳实施例而已，当然不能以此来限定本发明之权利范围，本领域普通技术人员可以理解实现上述实施例的全部或部分流程，并依本发明权利要求所作的等同变化，仍属于发明所涵盖的范围。 The above is only the preferred embodiment of the present invention, and the scope of the present invention is not limited thereto, and those skilled in the art can understand all or part of the process of implementing the above embodiments, and according to the claims of the present invention. Equivalent changes made are still within the scope of the invention.

Claims

一种眼球跟踪装置，其特征在于，所述装置包括处理器、红外摄像头以及辅助光源；An eyeball tracking device, characterized in that the device comprises a processor, an infrared camera and an auxiliary light source;

所述处理器与所述红外摄像头以及辅助光源电气连接；The processor is electrically connected to the infrared camera and the auxiliary light source;

所述红外摄像头用于输出帧同步信号；The infrared camera is configured to output a frame synchronization signal;

所述处理器用于接收所述帧同步信号；根据所述帧同步信号控制所述辅助光源在预设时间段内持续输出红外辅助光；控制所述红外摄像头在所述预设时间段内曝光；The processor is configured to receive the frame synchronization signal, and control the auxiliary light source to continuously output infrared auxiliary light for a preset time period according to the frame synchronization signal; and control the infrared camera to be exposed during the preset time period;

所述预设时间段的时长小于帧周期，所述帧周期为所述帧同步信号的循环周期。The duration of the preset time period is less than a frame period, and the frame period is a cycle period of the frame synchronization signal.
如权利要求1所述的眼球跟踪装置，其特征在于，所述红外摄像头包括红外图像传感器，所述红外图像传感器包括多个像素行，所述多个像素行包括依次相邻设置的多个有效像素行，所述预设时间段的起始时刻不早于所述红外图像传感器的最后一个有效像素行的曝光扫描起始时刻，所述预设时间段的终止时刻不晚于当前帧周期的终止时刻。The eyeball tracking device according to claim 1, wherein said infrared camera comprises an infrared image sensor, said infrared image sensor comprising a plurality of pixel rows, said plurality of pixel rows comprising a plurality of effective adjacently arranged a pixel row, the start time of the preset time period is not earlier than the exposure scan start time of the last effective pixel row of the infrared image sensor, and the termination time of the preset time period is no later than the current frame period. The moment of termination.
如权利要求1所述的眼球跟踪装置，其特征在于，所述辅助光源包括驱动器和红外LED，所述红外LED通过所述驱动器与所述处理器电气连接，所述处理器还用于获取所述红外摄像头采集到的眼球图像的质量参数，并将所述质量参数与预设质量参数进行对比，进而根据对比结果生成驱动配置参数，并根据所述驱动配置参数控制所述驱动器调节驱动电流，进而驱动所述红外LED调节红外光强度，以提升下一帧眼球图像的质量。The eyeball tracking device of claim 1 wherein said auxiliary light source comprises a driver and an infrared LED, said infrared LED being electrically coupled to said processor by said driver, said processor further for acquiring Describe the quality parameter of the eyeball image collected by the infrared camera, compare the quality parameter with the preset quality parameter, generate a driving configuration parameter according to the comparison result, and control the driver to adjust the driving current according to the driving configuration parameter, The infrared LED is further driven to adjust the infrared light intensity to improve the quality of the next frame of the eyeball image.
如权利要求1所述的眼球跟踪装置，其特征在于，所述处理器还用于获取所述红外摄像头采集到的眼球图像的质量参数，并将所述质量参数与预设质量参数进行对比，进而根据对比结果生成发光时间配置参数，并根据所述发光时间配置参数调整所述预设时间段的时长，进而控制所述辅助光源调整红外辅助光的发光时间，并控制所述红外摄像头同步调整曝光时间，以提升下一帧眼球图像的质量。The eyeball tracking device according to claim 1, wherein the processor is further configured to acquire a quality parameter of the eyeball image collected by the infrared camera, and compare the quality parameter with a preset quality parameter. And generating a lighting time configuration parameter according to the comparison result, and adjusting a duration of the preset time period according to the lighting time configuration parameter, thereby controlling the auxiliary light source to adjust the infrared The illumination time of the auxiliary light is controlled, and the infrared camera is controlled to synchronously adjust the exposure time to improve the quality of the image of the next frame of the eye.
一种眼球跟踪装置的辅助光源控制方法，其特征在于，所述方法包括：An auxiliary light source control method for an eyeball tracking device, characterized in that the method comprises:

根据帧同步信号控制辅助光源在预设时间段内持续输出红外辅助光；Controlling the auxiliary light source to continuously output the infrared auxiliary light for a preset period of time according to the frame synchronization signal;

控制红外摄像头在所述预设时间段内曝光；Controlling the infrared camera to be exposed during the preset time period;

其中，所述预设时间段的时长小于帧周期，所述帧周期为所述帧同步信号的循环周期。The duration of the preset time period is less than a frame period, and the frame period is a cycle period of the frame synchronization signal.
如权利要求5所述的辅助光源控制方法，其特征在于，所述红外摄像头包括红外图像传感器，所述红外图像传感器包括多个像素行，所述多个像素行包括依次相邻设置的多个有效像素行，所述预设时间段的起始时刻不早于所述红外图像传感器的最后一个有效像素行的曝光扫描起始时刻，所述预设时间段的终止时刻不晚于当前帧周期的终止时刻。The auxiliary light source control method according to claim 5, wherein the infrared camera comprises an infrared image sensor, the infrared image sensor comprises a plurality of pixel rows, and the plurality of pixel rows comprise a plurality of pixel rows arranged in sequence An effective pixel row, the start time of the preset time period is not earlier than the exposure scan start time of the last effective pixel row of the infrared image sensor, and the termination time of the preset time period is no later than the current frame period The moment of termination.
如权利要求5所述的辅助光源控制方法，其特征在于，所述辅助光源包括驱动器和红外LED，所述红外LED通过所述驱动器与所述处理器电气连接，所述方法还包括：The auxiliary light source control method according to claim 5, wherein the auxiliary light source comprises a driver and an infrared LED, and the infrared LED is electrically connected to the processor through the driver, the method further comprising:

所述处理器获取所述红外摄像头采集到的眼球图像的质量参数，并将所述质量参数与预设质量参数进行对比，获得对比结果；The processor acquires a quality parameter of the eyeball image collected by the infrared camera, and compares the quality parameter with a preset quality parameter to obtain a comparison result;

根据所述对比结果生成驱动配置参数，并根据所述驱动配置参数控制所述驱动器调节驱动电流，进而驱动所述红外LED调节红外光强度，以提升下一帧眼球图像的质量。Generating driving configuration parameters according to the comparison result, and controlling the driver to adjust the driving current according to the driving configuration parameter, thereby driving the infrared LED to adjust the infrared light intensity to improve the quality of the next frame of the eyeball image.
如权利要求5所述的辅助光源控制方法，其特征在于，所述方法还包括：The auxiliary light source control method according to claim 5, wherein the method further comprises:

所述处理器获取所述红外摄像头采集到的眼球图像的质量参数，并将所述质量参数与预设质量参数进行对比，获得对比结果；The processor acquires a quality parameter of the eyeball image collected by the infrared camera, and compares the quality parameter with a preset quality parameter to obtain a comparison result;

根据所述对比结果生成发光时间配置参数，并根据所述发光时间配置参数调整所述预设时间段的时长，进而控制所述辅助光源调整红外辅助光的发光时间，并控制所述红外摄像头同步调整曝光时间，以提升下一帧眼球图像的质量。Generating a lighting time configuration parameter according to the comparison result, and configuring parameters according to the lighting time Adjusting the duration of the preset time period, thereby controlling the auxiliary light source to adjust the illumination time of the infrared auxiliary light, and controlling the infrared camera to synchronously adjust the exposure time to improve the quality of the next frame of the eyeball image.
一种眼球跟踪装置的辅助光源控制装置，其特征在于，所述装置包括：An auxiliary light source control device for an eyeball tracking device, characterized in that the device comprises:

时序控制模块，用于根据帧同步信号控制辅助光源在预设时间段内持续输出红外辅助光；a timing control module, configured to control the auxiliary light source to continuously output the infrared auxiliary light for a preset period of time according to the frame synchronization signal;

所述时序控制模块，还用于控制红外摄像头在所述预设时间段内曝光；The timing control module is further configured to control the infrared camera to be exposed during the preset time period;

其中，所述预设时间段的时长小于帧周期，所述帧周期为所述帧同步信号的循环周期。The duration of the preset time period is less than a frame period, and the frame period is a cycle period of the frame synchronization signal.
如权利要求9所述的辅助光源控制装置，其特征在于，所述红外摄像头包括红外图像传感器，所述红外图像传感器包括多个像素行，所述多个像素行包括依次相邻设置的多个有效像素行，所述预设时间段的起始时刻不早于所述红外图像传感器的最后一个有效像素行的曝光扫描起始时刻，所述预设时间段的终止时刻不晚于当前帧周期的终止时刻。The auxiliary light source control apparatus according to claim 9, wherein said infrared camera comprises an infrared image sensor, said infrared image sensor comprises a plurality of pixel rows, said plurality of pixel rows comprising a plurality of adjacently arranged ones An effective pixel row, the start time of the preset time period is not earlier than the exposure scan start time of the last effective pixel row of the infrared image sensor, and the termination time of the preset time period is no later than the current frame period The moment of termination.
如权利要求9所述的辅助光源控制装置，其特征在于，所述辅助光源包括驱动器和红外LED，所述红外LED通过所述驱动器与所述处理器电气连接，所述装置还包括：The auxiliary light source control device according to claim 9, wherein the auxiliary light source comprises a driver and an infrared LED, and the infrared LED is electrically connected to the processor through the driver, the device further comprising:

图像处理模块，用于获取所述红外摄像头采集到的眼球图像的质量参数，并将所述质量参数与预设质量参数进行对比，获得对比结果；An image processing module, configured to acquire a quality parameter of an eyeball image collected by the infrared camera, and compare the quality parameter with a preset quality parameter to obtain a comparison result;

驱动控制模块，用于根据所述对比结果生成驱动配置参数，并根据所述驱动配置参数控制所述驱动器调节驱动电流，进而驱动所述红外LED调节红外光强度，以提升下一帧眼球图像的质量。a driving control module, configured to generate a driving configuration parameter according to the comparison result, and control the driver to adjust a driving current according to the driving configuration parameter, thereby driving the infrared LED to adjust an infrared light intensity to improve an image of an eyeball of a next frame. quality.
如权利要求9所述的辅助光源控制装置，其特征在于，所述装置还包括：The auxiliary light source control device according to claim 9, wherein the device further comprises:

图像处理模块，用于获取所述红外摄像头采集到的眼球图像的质量参数，并将所述质量参数与预设质量参数进行对比，获得对比结果； An image processing module, configured to acquire a quality parameter of an eyeball image collected by the infrared camera, and compare the quality parameter with a preset quality parameter to obtain a comparison result;

所述时序控制模块，还用于根据所述对比结果生成发光时间配置参数，并根据所述发光时间配置参数调整所述预设时间段的时长，进而控制所述辅助光源调整红外辅助光的发光时间，并控制所述红外摄像头同步调整曝光时间，以提升下一帧眼球图像的质量。The timing control module is further configured to generate a lighting time configuration parameter according to the comparison result, and adjust a duration of the preset time period according to the lighting time configuration parameter, thereby controlling the auxiliary light source to adjust the illumination of the infrared auxiliary light. Time, and control the infrared camera to adjust the exposure time synchronously to improve the quality of the next frame of the eyeball image.
一种存储一个或多个程序的非易失性计算机可读存储介质，其特征在于，所述一个或多个程序包括指令，所述指令当被处理器调用时使处理器执行以下事件：A non-transitory computer readable storage medium storing one or more programs, wherein the one or more programs include instructions that, when invoked by a processor, cause the processor to:

根据帧同步信号控制辅助光源在预设时间段内持续输出红外辅助光；Controlling the auxiliary light source to continuously output the infrared auxiliary light for a preset period of time according to the frame synchronization signal;

控制红外摄像头在所述预设时间段内曝光；Controlling the infrared camera to be exposed during the preset time period;

其中，所述预设时间段小于帧周期，所述帧周期为所述帧同步信号的循环周期。The preset time period is smaller than a frame period, and the frame period is a cycle period of the frame synchronization signal.
如权利要求13所述的非易失性计算机可读存储介质，其特征在于，所述红外摄像头包括红外图像传感器，所述红外图像传感器包括多个像素行，所述多个像素行包括依次相邻设置的多个有效像素行，所述预设时间段的起始时刻不早于所述红外图像传感器的最后一个有效像素行的曝光扫描起始时刻，所述预设时间段的终止时刻不晚于当前帧周期的终止时刻。A non-transitory computer readable storage medium according to claim 13 wherein said infrared camera comprises an infrared image sensor, said infrared image sensor comprising a plurality of pixel rows, said plurality of pixel rows comprising sequential a plurality of effective pixel rows disposed adjacent to each other, the start time of the preset time period is not earlier than the exposure scan start time of the last effective pixel row of the infrared image sensor, and the termination time of the preset time period is not Late than the end of the current frame period.
如权利要求13所述的非易失性计算机可读存储介质，其特征在于，所述辅助光源包括驱动器和红外LED，所述红外LED通过所述驱动器与所述处理器电气连接，则所述事件还包括：The non-transitory computer readable storage medium of claim 13 wherein said auxiliary light source comprises a driver and an infrared LED, said infrared LED being electrically coupled to said processor by said driver, said Events also include:

所述处理器获取所述红外摄像头采集到的眼球图像的质量参数，并将所述质量参数与预设质量参数进行对比，获得对比结果；The processor acquires a quality parameter of the eyeball image collected by the infrared camera, and compares the quality parameter with a preset quality parameter to obtain a comparison result;

根据所述对比结果生成驱动配置参数，并根据所述驱动配置参数控制所述驱动器调节驱动电流，进而驱动所述红外LED调节红外光强度，以提升下一帧眼球图像的质量。Generating driving configuration parameters according to the comparison result, and controlling the driver to adjust the driving current according to the driving configuration parameter, thereby driving the infrared LED to adjust the infrared light intensity to improve the quality of the next frame of the eyeball image.
如权利要求13所述的非易失性计算机可读存储介质，其特征在于，所述事件还包括：A non-transitory computer readable storage medium according to claim 13 wherein: The event also includes:

所述处理器获取所述红外摄像头采集到的眼球图像的质量参数，并将所述质量参数与预设质量参数进行对比，获得对比结果；The processor acquires a quality parameter of the eyeball image collected by the infrared camera, and compares the quality parameter with a preset quality parameter to obtain a comparison result;

根据所述对比结果生成发光时间配置参数，并根据所述发光时间配置参数调整所述预设时间段的时长，进而控制所述辅助光源调整红外辅助光的发光时间，并控制所述红外摄像头同步调整曝光时间，以提升下一帧眼球图像的质量。 Generating a lighting time configuration parameter according to the comparison result, and adjusting a duration of the preset time period according to the lighting time configuration parameter, thereby controlling the auxiliary light source to adjust an illumination time of the infrared auxiliary light, and controlling the infrared camera synchronization Adjust the exposure time to improve the quality of the next frame of the eye.