WO2016033877A1 - 一种动态调整终端屏幕文字显示的方法及终端 - Google Patents

一种动态调整终端屏幕文字显示的方法及终端 Download PDF

Info

Publication number
WO2016033877A1
WO2016033877A1 PCT/CN2014/092173 CN2014092173W WO2016033877A1 WO 2016033877 A1 WO2016033877 A1 WO 2016033877A1 CN 2014092173 W CN2014092173 W CN 2014092173W WO 2016033877 A1 WO2016033877 A1 WO 2016033877A1
Authority
WO
WIPO (PCT)
Prior art keywords
terminal
screen
resolution
ratio
face region
Prior art date
Application number
PCT/CN2014/092173
Other languages
English (en)
French (fr)
Inventor
何道敬
张炯衍
曾慧鹏
Original Assignee
中兴通讯股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 中兴通讯股份有限公司 filed Critical 中兴通讯股份有限公司
Publication of WO2016033877A1 publication Critical patent/WO2016033877A1/zh

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range

Definitions

  • the present invention relates to a terminal screen management technology, and in particular, to a method and a terminal for dynamically adjusting a screen display of a terminal screen.
  • a mobile terminal refers to a computer device that can be used in mobile, and broadly includes a mobile phone, a notebook, a tablet, a wearable smart terminal, a vehicle-mounted computer, and the like. However, it usually refers to a mobile phone or a smart phone, a tablet computer, and a wearable smart terminal having multiple application functions. With the rapid development of integrated circuit technology, the functions of mobile terminals are becoming more and more abundant and powerful, and their use in work and life is becoming more and more extensive.
  • users can use mobile terminals such as smart phones, tablet computers, and wearable smart terminals during the exercise, but during the exercise, the user and the mobile terminal usually have different degrees of shaking, which causes the screen text of the mobile terminal to follow.
  • the human eye's line of sight produces a relative displacement.
  • the user can usually correct the position of the mobile terminal or the mobile terminal in time to see the terminal screen text, it will inevitably cause the user's discomfort, especially when the shaking frequency is high, the user's discomfort. The response is more pronounced, causing the user to stop using the mobile terminal.
  • the existing terminal screen text display adjustment scheme 1 is based on the assumption that the user remains motionless and only the mobile terminal is in motion, and the terminal screen text display adjustment is performed according to the mobile terminal's own sensor, on the premise of the above assumptions.
  • the existing program one has a more desirable effect.
  • the second terminal screen font adjustment scheme 2 is to combine the external measuring device and the mobile terminal's own sensor to perform screen text display adjustment, and install a measuring device on the user's body to measure the human body motion, and combine with the human body motion measured by the mobile terminal itself. And thus in a variety of situations The terminal screen text display can be adjusted correctly.
  • the existing scheme for adjusting the screen display of the terminal screen has at least the following defects:
  • Solution 1 When the user is exercising or moving together with the mobile terminal, the program will have a large error, that is, when the user needs to adjust the screen text display, there is a phenomenon that there is no timely response, but the user does not need An error occurred when adjusting the screen text display.
  • Solution 2 This solution is better than the solution that relies solely on the mobile terminal's own sensor, but additional measurement equipment is needed, so additional cost will be added; and the addition of measurement equipment will cause inconvenience to the user, easy to lose, and endurance is difficult to guarantee. And other issues.
  • embodiments of the present invention are expected to provide a method and a terminal for dynamically adjusting a screen display of a terminal screen.
  • the embodiment of the invention provides a method for dynamically adjusting the screen display of a terminal screen, the method comprising:
  • the terminal collects the first frame face image and the second frame face image of the current user through the camera of the terminal;
  • an embodiment of the present invention provides a terminal, where the terminal includes: an image collection unit, an area detection unit, and a display adjustment unit;
  • the image acquisition unit is configured to receive the screen font adjustment instruction
  • the camera of the end captures the first frame face image and the second frame face image of the current user
  • the area detecting unit is configured to detect a first face area in the first frame face image and a second face area in the second frame face image;
  • the display adjustment unit is configured to send a screen font adjustment instruction to the image collection unit; and according to a resolution of the first face region, a resolution of the second face region, and a screen resolution of the terminal Rate, adjust the screen text display of the terminal.
  • the method and terminal for dynamically adjusting the screen text display of the terminal provided by the embodiment of the present invention, when receiving the screen text display adjustment instruction, the terminal collects the first frame face image and the second frame face of the current user through the camera of the terminal An image; detecting a first face region in the first frame face image and a second face region in the second frame face image; according to a resolution of the first face region, the second person The resolution of the face area and the screen resolution of the terminal adjust the screen text display of the terminal.
  • the embodiment of the present invention can perform real-time without increasing cost and carrying complexity according to the resolution of the first face region, the resolution of the second face region, and the screen resolution of the terminal. And dynamically adjusting the screen text display of the terminal to enhance the user experience.
  • FIG. 1 is a schematic flowchart of a method for dynamically adjusting a screen display of a terminal screen according to an embodiment of the present invention
  • FIG. 2 is a schematic structural diagram of a terminal structure according to an embodiment of the present invention.
  • the terminal when receiving the screen text display adjustment instruction, collects the first frame face image and the second frame face image of the current user through the camera of the terminal; and detects the first frame face image. a first face region and a second face region in the second frame face image; a resolution according to the first face region, a resolution of the second face region, and the end
  • the screen resolution of the terminal adjusts the screen text display of the terminal.
  • the terminal may be a device with an intelligent display function, and may be, for example, a smart phone, a tablet ipad, a computer, or the like.
  • the embodiment of the invention provides a method for dynamically adjusting the screen display of the terminal screen. As shown in FIG. 1 , the method includes:
  • Step S100 When the terminal receives the screen text display adjustment instruction, the terminal captures the first frame face image and the second frame face image of the current user through the camera of the terminal.
  • the first frame face image represents a current frame face image
  • the second frame face image represents a next frame face image of a current frame face image
  • the control device of the terminal and the like can recognize the operation function of the user's on-screen text display adjustment function, and the control device such as the processor sends the screen text display adjustment instruction.
  • the terminal when receiving the screen text display adjustment instruction, the terminal first initializes the front camera of the terminal and runs the front camera in the background, and then passes the said time interval according to the set time interval manner.
  • the front camera of the terminal collects a frame of the face image of the current user, and the specific implementation manner is as follows:
  • the terminal When receiving the screen font adjustment instruction, the terminal collects the current frame face image of the current user through the front camera of the terminal; after the set time interval, starts collecting the next frame face image of the current frame face image; The next frame face image is used as the current frame face image, and after the next set time interval, the next user frame image of the current user is continuously collected.
  • the time interval is set according to actual needs.
  • the set time interval is 0.5S
  • a frame image of the current user is collected by the front camera of the terminal every 0.5S, thereby reducing the screen text per unit time.
  • Step S101 Detect a first face area in the first frame face image and a second face area in the second frame face image.
  • a rectangular area including only a face image is called a face area.
  • a minimum detectable face area is required. If the minimum face area is too small, a face area false detection phenomenon may occur if the minimum face area is too large. , the face area cannot be detected.
  • the resolution of the minimum face area can be set to 20% of the terminal screen resolution to ensure that the face area can be detected correctly.
  • Step 1 pre-processing the first frame face image and the second frame face image respectively; wherein the pre-processing includes image denoising, image brightness and contrast enhancement;
  • the pre-processing algorithm is not specifically limited, and the pre-processing algorithm may be selected to perform pre-processing on the face image according to actual conditions; specifically, according to the pre-processing algorithm, the first frame face image and the second frame person are The preprocessing of the face images separately belongs to the prior art, and is not described here;
  • Step 2 detecting a first face region in the pre-processed first frame face image and a second face region in the preprocessed second frame face image according to the face detection algorithm and the face tracking algorithm , the implementation is as follows:
  • the first frame face image is preprocessed, and then the machine-based face detection algorithm is used to detect the preprocessed first frame.
  • the first face area in the face image because the face detection algorithm consumes more system resources, therefore, it is not necessary to continuously use the face detection algorithm to detect the face area in the subsequently collected face image, but can adopt A face tracking algorithm that consumes less system resources tracks the face region in the subsequently acquired face image, for example, the Camshift algorithm, using Camshift Before the algorithm, the first face area needs to be pre-processed, for example, performing histogram equalization, normalization, binarization, color space conversion, and the like on the first face area, where The processing of histogram equalization, color space conversion and the like is performed to ensure the subsequent tracking effect; then the Camplay algorithm is used to generate a tracking object in the processed first face region, and the second frame is tracked according to the tracking object.
  • the second face area in the face image because the face detection algorithm consumes more system resources, therefore, it is not necessary to continuously use the face detection algorithm to
  • the face detection algorithm and the face tracking algorithm are not specifically limited; how to detect the first face region and the pre-processing in the pre-processed first frame face image according to the face detection algorithm and the face tracking algorithm
  • the second face area in the second frame of the face image belongs to the prior art, and details are not described herein again.
  • Step S102 Adjust the screen text display of the terminal according to the resolution of the first face region, the resolution of the second face region, and the screen resolution of the terminal.
  • the resolution of the first face region is preset to X 1 *Y 1
  • the resolution of the second face region is preset to X 2 *Y 2 , that is, the first face
  • the vertical resolution of the region is X 1 and the lateral resolution is Y 1
  • the vertical resolution of the second human face region is X 2 and the horizontal resolution is Y 2 .
  • the screen text display of the terminal may adopt the following two methods:
  • the ratio interval corresponding to the second ratio R 2 The screen displays the font size, and the screen text display of the terminal is adjusted according to the corresponding screen display font size.
  • the second mode adjusts the screen text display of the terminal according to the horizontal resolution of the second human face region Y 1 and the horizontal resolution of the second human face region is Y 2 :
  • the third ratio R 3 and the fourth ratio R 4 do not belong to the same ratio interval, determining, according to the correspondence between the preset ratio interval and the screen display font size, the ratio interval corresponding to the fourth ratio R 4
  • the screen displays the font size, and the screen text display of the terminal is adjusted according to the corresponding screen display font size.
  • a plurality of ratio intervals may be preset from the interval 0 to 1 according to actual needs, for example, preset five ratio intervals (0 to 0.2), (0.2 to 0.33), (0.33 to 0.5), (0.5 to 0.75), (0.75 ⁇ 1], and set the corresponding screen display font size for the ratio interval; because the smaller the value in the ratio interval is, the smaller the face area is, that is, the farther the face is from the front camera of the terminal, therefore, for convenience
  • the user needs to set a corresponding relatively large screen font according to the above-mentioned rule, and set a relatively small screen display font size for a larger value interval, for example, setting a ratio interval (0 to 0.2).
  • the screen displays the font size 16sp, where sp is Android
  • the default font size unit set the ratio range (0.2 to 0.33) corresponding screen display font size is 15sp; set the ratio interval (0.33 ⁇ 0.5) corresponding screen display font size is 14sp; set the ratio interval (0.5 ⁇ 0.75) corresponding screen display font size is 13sp; set the ratio range (0.75 ⁇ 1) corresponding to the screen display font size is 12sp; the preset ratio range and the screen display font size correspondence as shown in Table 1.
  • Ratio interval Screen font size (0 ⁇ 0.2] 16sp (0.2 ⁇ 0.33) 15sp (0.33 ⁇ 0.5) 14sp (0.5 ⁇ 0.75] 13sp (0.75 ⁇ 1] 12sp
  • the terminal when receiving the screen text display adjustment instruction, collects the first frame face image and the second frame face image of the current user through the camera of the terminal; and detects the first frame face image. a first face region and a second face region in the second frame face image; according to a resolution of the first face region, a resolution of the second face region, and a screen resolution of the terminal Rate, adjust the screen text display of the terminal.
  • the embodiment of the present invention can adjust the screen text display of the terminal in real time and dynamically according to the resolution of the first face region, the resolution of the second face region, and the screen resolution of the terminal. To enhance the user experience.
  • the correspondence between the ratio interval preset and the screen text display according to the actual demand is as shown in Table 1.
  • the detected vertical resolution of the face region in the current frame face image is 100 pixels, and is determined according to the vertical resolution of 100 pixels and the screen vertical resolution of the terminal is 300 pixels.
  • First ratio After the time interval of 0.5S, the detected vertical resolution of the face region in the next frame of the current frame is 140 pixels, which is determined according to the vertical resolution of 140 pixels and the screen vertical resolution of the terminal is 300 pixels.
  • Second ratio Since 0.333 and 0.47 belong to the same ratio interval (0.33 to 0.5), the screen text display of the terminal is not adjusted, and the screen text display of the terminal is still adjusted according to the screen display font number corresponding to 0.333;
  • the next frame face image is used as the current frame face image, then After the time interval of 0.5S, it is detected that the vertical resolution of the face region in the next frame of the face image is 160 pixels, and the second ratio is determined according to the vertical resolution of 160 pixels and the screen lateral resolution of the terminal of 300 pixels. Since 0.47 and 0.533 do not belong to the same ratio interval, they belong to two ratio intervals (0.33 to 0.5) and (0.5 to 0.75). Therefore, the screen text of the terminal is adjusted according to the screen display font number corresponding to the ratio interval of 0.533. Display, that is, adjust the screen display font size 14 to the number 13, so that the terminal screen text display is adjusted in real time and dynamically, thereby enhancing the user experience.
  • the embodiment of the present invention provides a terminal.
  • the principle and method for solving the problem are similar. Therefore, the implementation process and implementation principles of the terminal can be described in the implementation process and implementation principles of the foregoing method. I won't go into details here.
  • the terminal provided by the embodiment of the present invention includes: an image collecting unit 200, an area detecting unit 201, and a display adjusting unit 202;
  • the image capturing unit 200 is configured to collect, by the camera of the terminal, a first frame face image and a second frame face image of the current user when receiving the screen text display adjustment instruction;
  • the area detecting unit 201 is configured to detect a first face area in the first frame face image and a second face area in the second frame face image;
  • the font adjustment unit 202 is configured to send a screen text display adjustment instruction to the image collection unit 200; and according to the resolution of the first face region, the resolution of the second face region, and the terminal The screen resolution adjusts the screen text display of the terminal.
  • the image collection unit 200 is specifically configured to:
  • the first frame face image and the second frame face image of the current user are collected by the camera of the terminal.
  • the area detecting unit 201 is specifically configured to:
  • the first face region in the preprocessed first frame face image and the second face region in the preprocessed second frame face image are detected.
  • the display adjustment unit 202 is specifically configured to:
  • the resolution of the first face region is preset to be X 1 *Y 1
  • the resolution of the second face region is preset to be X 2 *Y 2 ;
  • the ratio interval corresponding to the second ratio R 2 The screen displays the font size, and the screen text display of the terminal is adjusted according to the corresponding screen display font size.
  • the display adjustment unit 202 is specifically configured to:
  • the resolution of the first face region is preset to be X 1 *Y 1
  • the resolution of the second face region is preset to be X 2 *Y 2 ;
  • the third ratio R 3 and the fourth ratio R 4 do not belong to the same ratio interval, determining, according to the correspondence between the preset ratio interval and the screen display font size, the ratio interval corresponding to the fourth ratio R 4
  • the screen displays the font size, and the screen text display of the terminal is adjusted according to the corresponding screen display font size.
  • the image acquisition unit 200, the area detecting unit 201, and the display adjustment unit 202 may be located by a central processing unit (CPU), a microprocessor (MPU), a digital signal processor (DSP), or Field Programmable Gate Array (FPGA) implementation.
  • CPU central processing unit
  • MPU microprocessor
  • DSP digital signal processor
  • FPGA Field Programmable Gate Array
  • the real-time and dynamic adjustment can be performed according to the resolution of the first face region, the resolution of the second face region, and the screen resolution of the terminal without increasing cost and carrying complexity.
  • the screen text display of the terminal enhances the user experience.

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Controls And Circuits For Display Device (AREA)
  • Image Processing (AREA)

Abstract

本发明公开了一种动态调整终端屏幕文字显示的方法,该方法包括:终端接收到屏幕文字显示调整指令时,通过所述终端的摄像头采集当前用户的第一帧人脸图像及第二帧人脸图像;检测所述第一帧人脸图像中第一人脸区域及所述第二帧人脸图像中第二人脸区域;根据所述第一人脸区域的分辨率、所述第二人脸区域的分辨率以及所述终端的屏幕分辨率,调整所述终端的屏幕文字显示。本发明还同时公开了一种终端。

Description

一种动态调整终端屏幕文字显示的方法及终端 技术领域
本发明涉及终端屏幕管理技术,尤其涉及一种动态调整终端屏幕文字显示的方法及终端。
背景技术
移动终端是指可以在移动中使用的计算机设备,广义的讲包括手机、笔记本、平板电脑、可穿戴智能终端、车载电脑等。但是,通常情况下是指手机或者具有多种应用功能的智能手机、平板电脑及可穿戴智能终端。随着集成电路技术的飞速发展,移动终端的功能越来越丰富和强大,在工作、生活中的使用也越来越广泛。
目前,用户可以在运动过程中使用智能手机、平板电脑、可穿戴智能终端等移动终端,但在运动过程中,用户与移动终端通常会发生不同程度的晃动,这会导致移动终端的屏幕文字跟人眼视线产生相对位移,虽然用户通常情况下可以及时修正自身或移动终端的位置以看清终端屏幕文字,但不可避免的会造成用户的不适,尤其是当晃动频率较高时,用户的不适反应更为明显,使得用户不得不停止使用移动终端。
为了提高用户的体验,现有终端屏幕文字显示调整方案一,是基于用户始终保持不动、仅移动终端在运动的假设,根据移动终端自身的传感器进行终端屏幕文字显示调整,在上述假设的前提下,现有方案一拥有较为理想的效果。
现有终端屏幕字体调整方案二,是结合外部测量设备与移动终端自身的传感器进行屏幕文字显示调整,在用户身体上安装测量设备测量人体运动情况,并与移动终端自身测量的人体运动情况相结合,从而在多种情况 下均可正确调整终端屏幕文字显示。
然而,现有调整终端屏幕文字显示的方案至少存在以下缺陷:
方案一、当用户在运动或者与移动终端共同运动时,方案一会出现较大的误差,即:在用户需要对屏幕文字显示进行调整时,出现了没有及时反应的现象,而在用户不需要对屏幕文字显示进行调整时,出现了错误反应。
方案二、该方案比单纯依赖移动终端自身传感器的方案效果更好,但需要额外增设测量设备,因此,会增加额外的成本;并且,增设测量设备会造成用户佩戴不便、易丢失、续航难以保证等问题。
由此可见,目前亟需一种实时且动态地调整终端屏幕文字显示的方案。
发明内容
为解决现有存在的技术问题,本发明实施例期望提供一种动态调整终端屏幕文字显示的方法及终端。
本发明实施例的技术方案是这样实现的:
本发明实施例提供了一种动态调整终端屏幕文字显示的方法,该方法包括:
终端接收到屏幕文字显示调整指令时,通过所述终端的摄像头采集当前用户的第一帧人脸图像及第二帧人脸图像;
检测所述第一帧人脸图像中第一人脸区域及所述第二帧人脸图像中第二人脸区域;
根据所述第一人脸区域的分辨率、所述第二人脸区域的分辨率以及所述终端的屏幕分辨率,调整所述终端的屏幕文字显示。
基于上述方法,本发明实施例提供了一种终端,该终端包括:图像采集单元、区域检测单元、显示调整单元;其中,
所述图像采集单元,配置为接收到屏幕字体调整指令时,通过所述终 端的摄像头采集当前用户的第一帧人脸图像及第二帧人脸图像;
所述区域检测单元,配置为检测所述第一帧人脸图像中第一人脸区域及所述第二帧人脸图像中第二人脸区域;
所述显示调整单元,配置为向所述图像采集单元发送屏幕字体调整指令;并根据所述第一人脸区域的分辨率、所述第二人脸区域的分辨率以及所述终端的屏幕分辨率,调整所述终端的屏幕文字显示。
本发明实施例所提供的动态调整终端屏幕文字显示的方法及终端,终端接收到屏幕文字显示调整指令时,通过所述终端的摄像头采集当前用户的第一帧人脸图像及第二帧人脸图像;检测所述第一帧人脸图像中第一人脸区域及所述第二帧人脸图像中第二人脸区域;根据所述第一人脸区域的分辨率、所述第二人脸区域的分辨率以及所述终端的屏幕分辨率,调整所述终端的屏幕文字显示。如此,本发明实施例能根据所述第一人脸区域的分辨率、所述第二人脸区域的分辨率以及所述终端的屏幕分辨率,在不增加成本和携带复杂度的同时,实时且动态地调整所述终端的屏幕文字显示,从而增强用户体验。
附图说明
图1为本发明实施例动态调整终端屏幕文字显示的方法实现流程示意图;
图2为本发明实施例终端组成结构示意图。
具体实施方式
本发明实施例中,终端接收到屏幕文字显示调整指令时,通过所述终端的摄像头采集当前用户的第一帧人脸图像及第二帧人脸图像;检测所述第一帧人脸图像中第一人脸区域及所述第二帧人脸图像中第二人脸区域;根据所述第一人脸区域的分辨率、所述第二人脸区域的分辨率以及所述终 端的屏幕分辨率,调整所述终端的屏幕文字显示。
本发明实施例中,所述终端可以是具备智能化显示功能的设备,例如可以为:智能手机、平板电脑ipad、电脑等设备。
下面结合附图和具体实施方式对本发明所述方法和装置作进一步说明。
本发明实施例提出了一种动态调整终端屏幕文字显示的方法,如图1所示,该方法包括:
步骤S100:终端接收到屏幕文字显示调整指令时,通过所述终端的摄像头采集当前用户的第一帧人脸图像及第二帧人脸图像。
这里,所述第一帧人脸图像表示当前帧人脸图像,所述第二帧人脸图像表示当前帧人脸图像的下一帧人脸图像。
这里,用户开启终端的屏幕文字显示调整功能时,终端的处理器等控制器件能够识别出用户的开启屏幕文字显示调整功能操作,处理器等控制器件会发送屏幕文字显示调整指令。
这里,终端接收到屏幕文字显示调整指令时,首先初始化所述终端的前置摄像头并将所述前置摄像头运行在后台,然后按照设定时间间隔方式,每隔设定时间间隔,通过所述终端的前置摄像头采集当前用户的一帧人脸图像,具体实现方式如下:
终端接收到屏幕字体调整指令时,通过所述终端的前置摄像头采集当前用户的当前帧人脸图像;在设定时间间隔之后,开始采集当前帧人脸图像的下一帧人脸图像;将下一帧人脸图像作为当前帧人脸图像,在下一设定时间间隔之后,继续采集当前用户的下下一帧人脸图像。
这里,根据实际需求设定时间间隔,例如,设定时间间隔为0.5S,每隔0.5S通过所述终端的前置摄像头采集当前用户的一帧人脸图像,这样能够降低单位时间内屏幕文字显示的调整次数,从而降低所述终端的资源消 耗。
步骤S101:检测所述第一帧人脸图像中第一人脸区域及所述第二帧人脸图像中第二人脸区域。
这里,仅包括人脸面部图像的矩形区域称为人脸区域,首先需要可检测的最小人脸区域,如果最小人脸区域过小,会出现人脸区域误检测现象,如果最小人脸区域过大,会导致无法检测出人脸区域,通常,可以将最小人脸区域的分辨率设置为终端屏幕分辨率的20%,以确保能够正确检测到人脸区域。
下面对如何检测所述第一帧人脸图像中第一人脸区域及所述第二帧人脸图像中第二人脸区域,进行具体说明:
步骤一:对所述第一帧人脸图像及所述第二帧人脸图像分别进行预处理;其中,所述预处理包括图像去噪、图像亮度及对比度增强等操作;
这里,对预处理算法不作具体限定,可以根据实际情况选择预处理算法对人脸图像进行预处理操作;具体如何根据预处理算法,对所述第一帧人脸图像及所述第二帧人脸图像分别进行预处理属于现有技术,这里不再赘述;
步骤二:根据人脸检测算法以及人脸追踪算法,检测预处理后的第一帧人脸图像中的第一人脸区域及预处理后的第二帧人脸图像中的第二人脸区域,实现方式如下:
采集的当前用户的第一帧人脸图像为初始帧人脸图像时,对所述第一帧人脸图像进行预处理,然后采用基于机器学习的人脸检测算法检测预处理后的第一帧人脸图像中的第一人脸区域,由于人脸检测算法消耗***资源较多,因此,后续就不需要持续采用人脸检测算法检测后续采集的人脸图像中的人脸区域,而可以采用消耗***资源较少的人脸追踪算法对后续采集的人脸图像中的人脸区域进行追踪,例如,Camshift算法,采用Camshift 算法之前需要对所述第一人脸区域进行预处理,例如,对所述第一人脸区域进行直方图均衡、归一化、二值化、色彩空间转换等处理,其中,对所述第一人脸区域进行直方图均衡、色彩空间转换等处理是为了保证后续的追踪效果;然后采用Camshift算法将处理后的第一人脸区域生成追踪对象,根据所述追踪对象追踪所述第二帧人脸图像中的第二人脸区域。
这里,对人脸检测算法及人脸追踪算法不作具体限定;具体如何根据人脸检测算法以及人脸追踪算法,检测预处理后的第一帧人脸图像中的第一人脸区域及预处理后的第二帧人脸图像中的第二人脸区域属于现有技术,这里不再赘述。
步骤S102:根据所述第一人脸区域的分辨率、所述第二人脸区域的分辨率以及所述终端的屏幕分辨率,调整所述终端的屏幕文字显示。
这里,所述第一人脸区域的分辨率预设为X1*Y1、所述第二人脸区域的分辨率预设为X2*Y2,也就是说,所述第一人脸区域的纵向分辨率为X1,横向分辨率为Y1;所述第二人脸区域的纵向分辨率为X2,横向分辨率为Y2
这里,如何根据所述第一人脸区域的分辨率X1*Y1、所述第二人脸区域的分辨率X2*Y2以及所述终端的屏幕分辨率Xc*Yc,调整所述终端的屏幕文字显示,具体可采用如下两种方式:
方式一、根据所述第一人脸区域的纵向分辨率为X1及所述第二人脸区域的纵向分辨率为X2,调整所述终端的屏幕文字显示:
根据所述第一人脸区域的纵向分辨率X1以及所述终端的屏幕纵向分辨率Xc,确定第一比值
Figure PCTCN2014092173-appb-000001
以及根据所述第二人脸区域的纵向分辨率X2以及所述终端的屏幕纵向分辨率Xc,确定第二比值
Figure PCTCN2014092173-appb-000002
预设比值区间与屏幕显示字号的对应关系;
若所述第一比值R1与所述第二比值R2属于同一比值区间,则不对所述 终端的屏幕文字显示进行调整;
若所述第一比值R1与所述第二比值R2不属于同一比值区间,则根据预设的比值区间与屏幕显示字号的对应关系确定所述第二比值R2所属的比值区间所对应的屏幕显示字号,根据对应的屏幕显示字号调整所述终端的屏幕文字显示。
方式二、根据所述第二人脸区域的横向分辨率为Y1及所述第二人脸区域的横向分辨率为Y2,调整所述终端的屏幕文字显示:
根据所述第一人脸区域的横向分辨率Y1以及所述终端的屏幕横向分辨率Yc,确定第三比值
Figure PCTCN2014092173-appb-000003
以及根据所述第二人脸区域的横向分辨率Y2以及所述终端的屏幕横向分辨率Yc,确定第四比值
Figure PCTCN2014092173-appb-000004
预设比值区间与屏幕显示字号的对应关系;
若所述第三比值R3与所述第四比值R4属于同一比值区间,则不对所述终端的屏幕文字显示进行调整;
若所述第三比值R3与所述第四比值R4不属于同一比值区间,则根据预设的比值区间与屏幕显示字号的对应关系确定所述第四比值R4所属的比值区间所对应的屏幕显示字号,根据对应的屏幕显示字号调整所述终端的屏幕文字显示。
这里,可以根据实际需求从区间0~1预设多个比值区间,例如,预设五个比值区间(0~0.2]、(0.2~0.33]、(0.33~0.5]、(0.5~0.75]、(0.75~1],并为比值区间分别设置对应的屏幕显示字号;由于,比值区间中的数值越小说明人脸区域越小,即人脸离终端的前置摄像头越远,因此,为方便用户使用需要按照上述规律为数值较小的比值区间设置对应相对较大的屏幕字体,为数值较大的比值区间设置对应相对较小的屏幕显示字号,例如,设置比值区间(0~0.2]对应的屏幕显示字号为16sp,其中,sp为Android 默认字号单位;设置比值区间(0.2~0.33]对应的屏幕显示字号为15sp;设置比值区间(0.33~0.5]对应的屏幕显示字号为14sp;设置比值区间(0.5~0.75]对应的屏幕显示字号为13sp;设置比值区间(0.75~1]对应的屏幕显示字号为12sp;预设的比值区间与屏幕显示字号的对应关系如表1所示。
比值区间 屏幕字号(单位:sp)
(0~0.2] 16sp
(0.2~0.33] 15sp
(0.33~0.5] 14sp
(0.5~0.75] 13sp
(0.75~1] 12sp
表1
本发明实施例中,终端接收到屏幕文字显示调整指令时,通过所述终端的摄像头采集当前用户的第一帧人脸图像及第二帧人脸图像;检测所述第一帧人脸图像中第一人脸区域及所述第二帧人脸图像中第二人脸区域;根据所述第一人脸区域的分辨率、所述第二人脸区域的分辨率以及所述终端的屏幕分辨率,调整所述终端的屏幕文字显示。如此,本发明实施例能根据所述第一人脸区域的分辨率、所述第二人脸区域的分辨率以及所述终端的屏幕分辨率,实时且动态地调整所述终端的屏幕文字显示,从而增强用户体验。
为了更清楚地对本发明实施例进行说明,下面以实施例一为例,对本发明实施例中的动态调整终端屏幕文字显示的流程进行详细描述:
该实施例一中,根据实际需求预设的比值区间与屏幕文字显示的对应关系如表1所示。
若终端的屏幕纵向分辨率为300像素,检测出的当前帧人脸图像中人脸区域的纵向分辨率为100像素,根据纵向分辨率100像素以及所述终端的屏幕纵向分辨率300像素,确定第一比值
Figure PCTCN2014092173-appb-000005
在时间间隔0.5S之后,检测出的当前帧的下一帧人脸图像中人脸区域的纵向分辨率为140 像素,根据纵向分辨率140像素以及所述终端的屏幕纵向分辨率300像素,确定第二比值
Figure PCTCN2014092173-appb-000006
由于0.333与0.47属于同一比值区间(0.33~0.5],因此,不对所述终端的屏幕文字显示进行调整,依然根据0.333对应的屏幕显示字号14号调整所述终端的屏幕文字显示;
将下一帧人脸图像作为当前帧人脸图像,则
Figure PCTCN2014092173-appb-000007
在时间间隔0.5S之后,检测出下下一帧人脸图像中人脸区域的纵向分辨率为160像素,根据纵向分辨率160像素以及所述终端的屏幕横向分辨率300像素,确定第二比值
Figure PCTCN2014092173-appb-000008
由于0.47与0.533不属于同一比值区间,分属于两个比值区间(0.33~0.5]及(0.5~0.75],因此,根据0.533所属比值区间对应的屏幕显示字号13号,调整所述终端的屏幕文字显示,即:将屏幕显示字号14号调整为13号,如此,实时且动态地调整终端屏幕文字显示,从而增强用户体验。
为实现上述方法,本发明实施例提供了一种终端,由于该终端解决问题的原理与方法相似,因此,终端的实施过程及实施原理均可以参见前述方法的实施过程及实施原理描述,重复之处不再赘述。
如图2所示,本发明实施例提供的终端,包括:图像采集单元200、区域检测单元201、显示调整单元202;其中,
所述图像采集单元200,配置为接收到屏幕文字显示调整指令时,通过所述终端的摄像头采集当前用户的第一帧人脸图像及第二帧人脸图像;
所述区域检测单元201,配置为检测所述第一帧人脸图像中第一人脸区域及所述第二帧人脸图像中第二人脸区域;
所述字体调整单元202,配置为向所述图像采集单元200发送屏幕文字显示调整指令;并根据所述第一人脸区域的分辨率、所述第二人脸区域的分辨率以及所述终端的屏幕分辨率,调整所述终端的屏幕文字显示。
以上功能单元或模块的划分方式仅为本发明实施例给出的一种优选实现方式,功能单元或模块的划分方式不构成对本发明的限制。
具体实施中,所述图像采集单元200具体配置为:
按照设定时间间隔方式,通过所述终端的摄像头采集当前用户的第一帧人脸图像及第二帧人脸图像。
具体实施中,所述区域检测单元201具体配置为:
对所述第一帧人脸图像及所述第二帧人脸图像分别进行预处理;
根据人脸检测算法以及人脸追踪算法,检测预处理后的第一帧人脸图像中的第一人脸区域及预处理后的第二帧人脸图像中的第二人脸区域。
具体实施中,所述显示调整单元202具体配置为:
所述第一人脸区域的分辨率预设为X1*Y1、所述第二人脸区域的分辨率预设为X2*Y2
根据所述第一人脸区域的纵向分辨率X1以及所述终端的屏幕纵向分辨率Xc,确定第一比值
Figure PCTCN2014092173-appb-000009
以及根据所述第二人脸区域的纵向分辨率X2以及所述终端的屏幕纵向分辨率Xc,确定第二比值
Figure PCTCN2014092173-appb-000010
若所述第一比值R1与所述第二比值R2属于同一比值区间,则不对所述终端的屏幕文字显示进行调整;
若所述第一比值R1与所述第二比值R2不属于同一比值区间,则根据预设的比值区间与屏幕显示字号的对应关系确定所述第二比值R2所属的比值区间所对应的屏幕显示字号,根据对应的屏幕显示字号调整所述终端的屏幕文字显示。
具体实施中,所述显示调整单元202具体配置为:
所述第一人脸区域的分辨率预设为X1*Y1、所述第二人脸区域的分辨率预设为X2*Y2
根据所述第一人脸区域的横向分辨率Y1以及所述终端的屏幕横向分辨率Yc,确定第三比值
Figure PCTCN2014092173-appb-000011
以及根据所述第二人脸区域的横向分辨率Y2以及所述终端的屏幕横向分辨率Yc,确定第四比值
Figure PCTCN2014092173-appb-000012
若所述第三比值R3与所述第四比值R4属于同一比值区间,则不对所述终端的屏幕文字显示进行调整;
若所述第三比值R3与所述第四比值R4不属于同一比值区间,则根据预设的比值区间与屏幕显示字号的对应关系确定所述第四比值R4所属的比值区间所对应的屏幕显示字号,根据对应的屏幕显示字号调整所述终端的屏幕文字显示。
在实际应用中,所述图像采集单元200、区域检测单元201、显示调整单元202可由位于所述终端的中央处理器(CPU)、微处理器(MPU)、数字信号处理器(DSP)、或现场可编程门阵列(FPGA)实现。
本发明所述的方法并不限于具体实施方式中所述的实施例,本领域技术人员根据本发明的技术方案得出其它的实施方式,同样属于本发明的技术创新范围。
显然,本领域的技术人员可以对本发明进行各种改动和变型而不脱离本发明的精神和范围。这样,倘若本发明的这些修改和变型属于本发明权利要求及其等同技术的范围之内,则本发明也意图包含这些改动和变型在内。
工业实用性
综合上述本发明的实施例,能够根据第一人脸区域的分辨率、第二人脸区域的分辨率以及终端的屏幕分辨率,在不增加成本和携带复杂度的同时,实时且动态地调整所述终端的屏幕文字显示,增强了用户体验。

Claims (10)

  1. 一种动态调整终端屏幕文字显示的方法,所述方法包括:
    终端接收到屏幕文字显示调整指令时,通过所述终端的摄像头采集当前用户的第一帧人脸图像及第二帧人脸图像;
    检测所述第一帧人脸图像中第一人脸区域及所述第二帧人脸图像中第二人脸区域;
    根据所述第一人脸区域的分辨率、所述第二人脸区域的分辨率以及所述终端的屏幕分辨率,调整所述终端的屏幕文字显示。
  2. 根据权利要求1所述的方法,其中,所述通过所述终端的摄像头采集当前用户的第一帧人脸图像及第二帧人脸图像,包括:
    按照设定时间间隔方式,通过所述终端的摄像头采集当前用户的第一帧人脸图像及第二帧人脸图像。
  3. 根据权利要求1所述的方法,其中,所述检测所述第一帧人脸图像中第一人脸区域及所述第二帧人脸图像中第二人脸区域,包括:
    对所述第一帧人脸图像及所述第二帧人脸图像分别进行预处理;
    根据人脸检测算法以及人脸追踪算法,检测预处理后的第一帧人脸图像中的第一人脸区域及预处理后的第二帧人脸图像中的第二人脸区域。
  4. 根据权利要求1至3任一项所述的方法,其中,所述根据所述第一人脸区域的分辨率、所述第二人脸区域的分辨率以及所述终端的屏幕分辨率,调整所述终端的屏幕文字显示,包括:
    所述第一人脸区域的分辨率预设为X1*Y1、所述第二人脸区域的分辨率预设为X2*Y2
    根据所述第一人脸区域的纵向分辨率X1以及所述终端的屏幕纵向分辨率Xc,确定第一比值
    Figure PCTCN2014092173-appb-100001
    以及根据所述第二人脸区域的纵向分辨率X2 以及所述终端的屏幕纵向分辨率Xc,确定第二比值
    Figure PCTCN2014092173-appb-100002
    若所述第一比值R1与所述第二比值R2属于同一比值区间,则不对所述终端的屏幕文字显示进行调整;
    若所述第一比值R1与所述第二比值R2不属于同一比值区间,则根据预设的比值区间与屏幕显示字号的对应关系确定所述第二比值R2所属的比值区间所对应的屏幕显示字号,根据对应的屏幕显示字号调整所述终端的屏幕文字显示。
  5. 根据权利要求1至3任一项所述的方法,其中,所述根据所述第一人脸区域的分辨率、所述第二人脸区域的分辨率以及所述终端的屏幕分辨率,调整所述终端的屏幕文字显示,包括:
    所述第一人脸区域的分辨率预设为X1*Y1、所述第二人脸区域的分辨率预设为X2*Y2
    根据所述第一人脸区域的横向分辨率Y1以及所述终端的屏幕横向分辨率Yc,确定第三比值
    Figure PCTCN2014092173-appb-100003
    以及根据所述第二人脸区域的横向分辨率Y2以及所述终端的屏幕横向分辨率Yc,确定第四比值
    Figure PCTCN2014092173-appb-100004
    若所述第三比值R3与所述第四比值R4属于同一比值区间,则不对所述终端的屏幕文字显示进行调整;
    若所述第三比值R3与所述第四比值R4不属于同一比值区间,则根据预设的比值区间与屏幕显示字号的对应关系确定所述第四比值R4所属的比值区间所对应的屏幕显示字号,根据对应的屏幕显示字号调整所述终端的屏幕文字显示。
  6. 一种终端,所述终端包括:图像采集单元、区域检测单元、显示调整单元;其中,
    所述图像采集单元,配置为接收到屏幕字体调整指令时,通过所述终 端的摄像头采集当前用户的第一帧人脸图像及第二帧人脸图像;
    所述区域检测单元,配置为检测所述第一帧人脸图像中第一人脸区域及所述第二帧人脸图像中第二人脸区域;
    所述显示调整单元,配置为向所述图像采集单元发送屏幕字体调整指令;并根据所述第一人脸区域的分辨率、所述第二人脸区域的分辨率以及所述终端的屏幕分辨率,调整所述终端的屏幕文字显示。
  7. 根据权利要求6所述的终端,其中,所述图像采集单元配置为:
    按照设定时间间隔方式,通过所述终端的摄像头采集当前用户的第一帧人脸图像及第二帧人脸图像。
  8. 根据权利要求6所述的终端,其中,所述区域检测单元配置为:
    对所述第一帧人脸图像及所述第二帧人脸图像分别进行预处理;
    根据人脸检测算法以及人脸追踪算法,检测预处理后的第一帧人脸图像中的第一人脸区域及预处理后的第二帧人脸图像中的第二人脸区域。
  9. 根据权利要求6至8任一项所述的终端,其中,所述显示调整单元配置为:
    所述第一人脸区域的分辨率预设为X1*Y1、所述第二人脸区域的分辨率预设为X2*Y2
    根据所述第一人脸区域的纵向分辨率X1以及所述终端的屏幕纵向分辨率Xc,确定第一比值
    Figure PCTCN2014092173-appb-100005
    以及根据所述第二人脸区域的纵向分辨率X2以及所述终端的屏幕纵向分辨率Xc,确定第二比值
    Figure PCTCN2014092173-appb-100006
    若所述第一比值R1与所述第二比值R2属于同一比值区间,则不对所述终端的屏幕文字显示进行调整;
    若所述第一比值R1与所述第二比值R2不属于同一比值区间,则根据预设的比值区间与屏幕显示字号的对应关系确定所述第二比值R2所属的比值 区间所对应的屏幕显示字号,根据对应的屏幕显示字号调整所述终端的屏幕文字显示。
  10. 根据权利要求6至8任一项所述的终端,其中,所述显示调整单元配置为:
    所述第一人脸区域的分辨率预设为X1*Y1、所述第二人脸区域的分辨率预设为X2*Y2
    根据所述第一人脸区域的横向分辨率Y1以及所述终端的屏幕横向分辨率Yc,确定第三比值
    Figure PCTCN2014092173-appb-100007
    以及根据所述第二人脸区域的横向分辨率Y2以及所述终端的屏幕横向分辨率Yc,确定第四比值
    Figure PCTCN2014092173-appb-100008
    若所述第三比值R3与所述第四比值R4属于同一比值区间,则不对所述终端的屏幕文字显示进行调整;
    若所述第三比值R3与所述第四比值R4不属于同一比值区间,则根据预设的比值区间与屏幕显示字号的对应关系确定所述第四比值R4所属的比值区间所对应的屏幕显示字号,根据对应的屏幕显示字号调整所述终端的屏幕文字显示。
PCT/CN2014/092173 2014-09-05 2014-11-25 一种动态调整终端屏幕文字显示的方法及终端 WO2016033877A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201410453841.8 2014-09-05
CN201410453841.8A CN104298441A (zh) 2014-09-05 2014-09-05 一种动态调整终端屏幕文字显示的方法及终端

Publications (1)

Publication Number Publication Date
WO2016033877A1 true WO2016033877A1 (zh) 2016-03-10

Family

ID=52318191

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2014/092173 WO2016033877A1 (zh) 2014-09-05 2014-11-25 一种动态调整终端屏幕文字显示的方法及终端

Country Status (2)

Country Link
CN (1) CN104298441A (zh)
WO (1) WO2016033877A1 (zh)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106155279A (zh) * 2015-03-27 2016-11-23 中兴通讯股份有限公司 一种动态调整终端屏幕显示的方法及终端
CN111767098A (zh) * 2019-04-24 2020-10-13 北京京东尚科信息技术有限公司 用于调整字体大小的方法和装置

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090167900A1 (en) * 2007-12-26 2009-07-02 Altek Corporation Image processing method for adjusting a scale of a face
CN101751209A (zh) * 2008-11-28 2010-06-23 联想(北京)有限公司 一种调整屏幕呈现元素的方法及计算机
CN101788876A (zh) * 2009-01-23 2010-07-28 英华达(上海)电子有限公司 自动缩放调整的方法及其***
CN102591550A (zh) * 2011-01-04 2012-07-18 ***通信集团公司 终端界面内容的缩放控制方法及装置
CN103377643A (zh) * 2012-04-26 2013-10-30 富泰华工业(深圳)有限公司 字体调整***及方法

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6933979B2 (en) * 2000-12-13 2005-08-23 International Business Machines Corporation Method and system for range sensing of objects in proximity to a display
CN101539989A (zh) * 2008-03-20 2009-09-23 中国科学院研究生院 基于人脸检测的错误阅读姿势检测方法
CN102914286B (zh) * 2012-09-12 2014-09-10 福建网龙计算机网络信息技术有限公司 基于手持设备对使用者坐姿进行自动检测方法
CN103903595A (zh) * 2012-12-29 2014-07-02 深圳富泰宏精密工业有限公司 字体调整方法及***
CN103491307B (zh) * 2013-10-07 2018-12-11 厦门美图网科技有限公司 一种后置摄像头的智能自拍方法

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090167900A1 (en) * 2007-12-26 2009-07-02 Altek Corporation Image processing method for adjusting a scale of a face
CN101751209A (zh) * 2008-11-28 2010-06-23 联想(北京)有限公司 一种调整屏幕呈现元素的方法及计算机
CN101788876A (zh) * 2009-01-23 2010-07-28 英华达(上海)电子有限公司 自动缩放调整的方法及其***
CN102591550A (zh) * 2011-01-04 2012-07-18 ***通信集团公司 终端界面内容的缩放控制方法及装置
CN103377643A (zh) * 2012-04-26 2013-10-30 富泰华工业(深圳)有限公司 字体调整***及方法

Also Published As

Publication number Publication date
CN104298441A (zh) 2015-01-21

Similar Documents

Publication Publication Date Title
WO2019137038A1 (zh) 注视点确定方法、对比度调节方法及对比度调节装置、虚拟现实设备及存储介质
CN106652972B (zh) 显示屏的处理电路、显示方法及显示器件
WO2023071884A1 (zh) 注视检测方法、电子设备的控制方法及相关设备
US9424769B2 (en) Display and brightness adjusting method thereof
US9892336B2 (en) Detection devices and methods for detecting regions of interest
CN106781327B (zh) 坐姿矫正方法及移动终端
CN104850228B (zh) 基于移动终端的锁定眼球的注视区域的方法
CN104182114A (zh) 用于调整移动设备的画面显示方向的方法和***
CN103279260A (zh) 方向自适应显示***及其调整方法
TWI671712B (zh) 自動調整顯示畫面比例的方法及其顯示裝置
CN104581127B (zh) 一种自动调节屏幕亮度的方法、***和头戴显示设备
CN110930329A (zh) 星空图像处理方法及装置
GB2553926A (en) Automatic detection of panoramic gestures
CN107133008B (zh) 移动终端自动调整输出的方法
WO2020108010A1 (zh) 视频处理方法、装置、电子设备以及存储介质
TW201516967A (zh) 顏色取樣方法及觸控控制裝置
WO2018149322A1 (zh) 图像识别方法、装置、设备及存储介质
WO2016011787A1 (zh) 一种自动调整电子文档页面的方法及其装置
WO2016033877A1 (zh) 一种动态调整终端屏幕文字显示的方法及终端
CN105718033A (zh) 疲劳检测***及方法
KR20130081439A (ko) 휴대 단말기에서 카메라 뷰 영역을 표시하는 장치 및 방법
WO2016155435A1 (zh) 动态调整终端屏幕显示的方法、终端及存储介质
CN103576862A (zh) 一种手势控制拍摄的方法和装置
TW201931305A (zh) 行動裝置及影像處理方法
JP2014121079A5 (zh)

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 14901056

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 14901056

Country of ref document: EP

Kind code of ref document: A1