TW202011377A - Electronic system and electronic device for performing viewing-angle enhancement regarding display panel - Google Patents

Electronic system and electronic device for performing viewing-angle enhancement regarding display panel Download PDF

Info

Publication number
TW202011377A
TW202011377A TW107131962A TW107131962A TW202011377A TW 202011377 A TW202011377 A TW 202011377A TW 107131962 A TW107131962 A TW 107131962A TW 107131962 A TW107131962 A TW 107131962A TW 202011377 A TW202011377 A TW 202011377A
Authority
TW
Taiwan
Prior art keywords
user
processing circuit
display
display panel
image
Prior art date
Application number
TW107131962A
Other languages
Chinese (zh)
Other versions
TWI683302B (en
Inventor
陳瑞麟
Original Assignee
宏碁股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 宏碁股份有限公司 filed Critical 宏碁股份有限公司
Priority to TW107131962A priority Critical patent/TWI683302B/en
Application granted granted Critical
Publication of TWI683302B publication Critical patent/TWI683302B/en
Publication of TW202011377A publication Critical patent/TW202011377A/en

Links

Images

Landscapes

  • Controls And Circuits For Display Device (AREA)
  • Control Of Indicators Other Than Cathode Ray Tubes (AREA)

Abstract

An electronic system for performing display image viewing-angle enhancement regarding a display panel includes a depth camera, an eye-tracking device, and an electronic device. The depth camera may capture at least one image of a user and obtain depth information of the user. At least one processing circuit of the electronic device may control operations of the electronic device and perform image processing, for example, determine whether the user is positioned outside a viewing angle range of the display panel according to the aforementioned at least one image and the depth information; when the user is positioned outside the viewing angle range, utilize the eye-tracking device to perform eye tracking to determine a target region within a display region of the display panel; and perform partial image adjustment regarding the target region to generate display data, for being displayed by the display panel. An associated electronic device is also provided.

Description

用來針對一顯示面板進行可視角增強之電子系統以及電子裝置Electronic system and electronic device for enhancing viewing angle of a display panel

本發明係有關於顯示控制，尤指一種用來針對一顯示面板進行可視角增強（viewing-angle enhancement）之電子系統以及相關的電子裝置。The present invention relates to display control, in particular to an electronic system and related electronic device for viewing-angle enhancement of a display panel.

目前市面上的電競顯示器大多採用扭曲向列（Twisted Nematic，可簡稱「TN」）液晶面板，其液晶分子轉動速度比其它類型面板更快。隨著技術進步，採用TN液晶面板的TN顯示器的反應時間增快許多，例如灰階反應時間可為2毫秒以下，但其最大的缺點是可視角問題。當使用者並非正對著TN液晶面板並處於可視角範圍以外時，使用者所見影像的特性諸如亮度、對比、色彩等通常會失真。相關技術中提出了某些方案（例如在玻璃基板上加上補償膜、改進玻璃基板中液晶分子排列方式等），以嘗試解決這個問題。然而，可視角在某些狀況下可能仍然不足。假設水平可視角可達到160，甚至170度。當使用者改成使用較大尺寸的顯示器時，使用者的位置可能沒有往後移。此狀況下，使用者和顯示器之間的距離並沒有變得更遠，所以使用者觀看顯示器所顯示之整個畫面中之某些局部區域時的角度可能很大，這表示上述問題仍然存在。因此，需要一種新穎的架構，以改善使用者經驗。At present, most of the e-sports displays on the market use Twisted Nematic (TN) liquid crystal panels, and the liquid crystal molecules rotate faster than other types of panels. With the advancement of technology, the response time of TN displays using TN liquid crystal panels is much faster. For example, the gray-scale response time can be less than 2 milliseconds, but the biggest disadvantage is the angle of view. When the user is not directly facing the TN liquid crystal panel and is outside the viewing angle range, the characteristics of the image seen by the user such as brightness, contrast, color, etc. are usually distorted. Some solutions have been proposed in the related art (such as adding a compensation film on the glass substrate, improving the arrangement of liquid crystal molecules in the glass substrate, etc.) to try to solve this problem. However, the viewing angle may still be insufficient in certain situations. Assume that the horizontal viewing angle can reach 160, or even 170 degrees. When the user changes to use a larger-sized display, the user's position may not move backward. In this situation, the distance between the user and the monitor has not become farther, so the angle of the user when viewing some local areas in the entire screen displayed by the monitor may be very large, which means that the above problem still exists. Therefore, a novel architecture is needed to improve user experience.

本發明之一目的在於提供一種用來針對一顯示面板進行可視角增強之電子系統以及相關的電子裝置，以解決上述問題。An object of the present invention is to provide an electronic system and related electronic device for enhancing the viewing angle of a display panel to solve the above problems.

本發明之另一目的在於提供一種用來針對一顯示面板進行可視角增強之電子系統以及相關的電子裝置，以改善使用者體驗。Another object of the present invention is to provide an electronic system and related electronic device for enhancing the viewing angle of a display panel to improve the user experience.

本發明之至少一實施例提供一種用來針對一顯示面板進行可視角增強之電子系統。該電子系統可包含一深度攝像頭（Depth Camera）、一眼動追踪裝置（Eye-tracking Device）以及一電子裝置，其中該電子裝置可耦接至該深度攝像頭與該眼動追踪裝置，且可包含至少一處理電路。該深度攝像頭可用來拍攝一使用者之至少一影像且取得該使用者之深度資訊，並且該眼動追踪裝置可用來對該使用者進行眼動追踪（Eye Tracking）。另外，上述至少一處理電路可用來控制該電子裝置之操作以及進行影像處理。例如，上述至少一處理電路可依據上述至少一影像與該深度資訊來判斷該使用者是否位於該顯示面板之可視角範圍以外。當該使用者位於該可視角範圍以外時，上述至少一處理電路可利用該眼動追踪裝置對該使用者進行眼動追踪以決定該顯示面板之一顯示區中之一目標區，以及針對該目標區進行局部影像調整以產生顯示資料，以供該顯示面板顯示。At least one embodiment of the present invention provides an electronic system for enhancing the viewing angle of a display panel. The electronic system may include a depth camera (Depth Camera), an eye-tracking device (Eye-tracking Device) and an electronic device, wherein the electronic device may be coupled to the depth camera and the eye-tracking device, and may include at least One processing circuit. The depth camera can be used to capture at least one image of a user and obtain depth information of the user, and the eye tracking device can be used to perform eye tracking (Eye Tracking) on the user. In addition, the at least one processing circuit can be used to control the operation of the electronic device and perform image processing. For example, the at least one processing circuit may determine whether the user is outside the viewing angle range of the display panel based on the at least one image and the depth information. When the user is outside the viewable range, the at least one processing circuit may use the eye tracking device to perform eye tracking on the user to determine a target area in a display area of the display panel, and The target area is adjusted locally to generate display data for display on the display panel.

本發明之至少一實施例提供一種電子裝置。該電子裝置可包含一深度攝像頭、一眼動追踪裝置以及至少一處理電路，其中上述至少一處理電路可耦接至該深度攝像頭與該眼動追踪裝置。該深度攝像頭可用來拍攝一使用者之至少一影像且取得該使用者之深度資訊，並且該眼動追踪裝置可用來對該使用者進行眼動追踪。另外，上述至少一處理電路可用來控制該電子裝置之操作以及進行影像處理。例如，上述至少一處理電路可依據上述至少一影像與該深度資訊來判斷該使用者是否位於該顯示面板之可視角範圍以外。當該使用者位於該可視角範圍以外時，上述至少一處理電路可利用該眼動追踪裝置對該使用者進行眼動追踪以決定該顯示面板之一顯示區中之一目標區，以及針對該目標區進行局部影像調整以產生顯示資料，以供該顯示面板顯示。At least one embodiment of the present invention provides an electronic device. The electronic device may include a depth camera, an eye tracking device, and at least one processing circuit, wherein the at least one processing circuit may be coupled to the depth camera and the eye tracking device. The depth camera can be used to capture at least one image of a user and obtain depth information of the user, and the eye tracking device can be used to track the user's eye movements. In addition, the at least one processing circuit can be used to control the operation of the electronic device and perform image processing. For example, the at least one processing circuit may determine whether the user is outside the viewing angle range of the display panel based on the at least one image and the depth information. When the user is outside the viewable range, the at least one processing circuit may use the eye tracking device to perform eye tracking on the user to determine a target area in a display area of the display panel, and The target area is adjusted locally to generate display data for display on the display panel.

本發明的好處之一是，本發明之電子系統以及相關的電子裝置能進行可視角增強，尤其，可動態地決定該目標區的位置以進行局部影像調整。例如，當使用者改成使用較大尺寸的顯示器時，使用者的位置可能沒有往後移。雖然使用者觀看顯示器所顯示之整個畫面中之某些局部區域時的角度很大，但本發明之電子系統以及相關的電子裝置能進行局部影像調整以增強可視角。相較於相關技術，本發明之電子系統以及相關的電子裝置能改善使用者體驗。One of the advantages of the present invention is that the electronic system and related electronic devices of the present invention can enhance the viewing angle. In particular, the position of the target area can be dynamically determined for local image adjustment. For example, when the user changes to use a larger size display, the user's position may not move backward. Although the user has a large angle when viewing some local areas in the entire screen displayed on the display, the electronic system and related electronic devices of the present invention can perform local image adjustment to enhance the viewing angle. Compared with the related art, the electronic system and related electronic device of the present invention can improve the user experience.

第1圖為依據本發明一實施例之一種用來針對一顯示面板進行可視角增強之電子系統100的示意圖。電子系統100可包含一電子裝置101、一顯示裝置110、一深度攝像頭120以及一眼動追踪裝置130。電子裝置101可包含至少一處理電路（例如一或多個處理電路），諸如處理電路102（其可執行程式碼104）以及影像處理電路106，且可包含至少一介面電路（例如一或多個介面電路），其可通稱為介面電路108，其中處理電路102可包含至少一處理器諸如中央處理器（Central Processing Unit, CPU）以及相關電路諸如記憶體等，而影像處理電路106可實施成獨立顯示卡，其可包含用於影像處理之至少一處理器，諸如圖形處理器（Graphics Processing Unit, GPU），且介面電路108可包含符合通用序列匯流排（Universal Serial Bus, USB）標準之介面電路，但本發明不限於此。電子裝置101的例子可包含（但不限於）：個人電腦（Personal Computer, PC）諸如桌上型個人電腦（Desktop Computer）。FIG. 1 is a schematic diagram of an electronic system 100 for enhancing viewing angle of a display panel according to an embodiment of the invention. The electronic system 100 may include an electronic device 101, a display device 110, a depth camera 120, and an eye tracking device 130. The electronic device 101 may include at least one processing circuit (for example, one or more processing circuits), such as the processing circuit 102 (its executable code 104) and the image processing circuit 106, and may include at least one interface circuit (for example, one or more (Interface circuit), which may be commonly referred to as interface circuit 108, wherein the processing circuit 102 may include at least one processor such as a Central Processing Unit (CPU) and related circuits such as memory, etc., and the image processing circuit 106 may be implemented as an independent The graphics card may include at least one processor for image processing, such as a graphics processing unit (Graphics Processing Unit, GPU), and the interface circuit 108 may include an interface circuit conforming to the Universal Serial Bus (USB) standard , But the invention is not limited to this. Examples of the electronic device 101 may include (but not limited to): a personal computer (Personal Computer, PC) such as a desktop personal computer (Desktop Computer).

另外，顯示裝置110可包含用來控制顯示裝置110之一控制電路112、用來將顯示裝置110耦接至電子裝置101（尤其，影像處理電路106）之一介面電路116、一數位-類比轉換電路118以及一顯示面板119（例如：液晶顯示面板），其中控制電路112可包含一時序控制器（Timing Controller）114，而介面電路116可包含多個子電路，諸如符合顯示埠（Display-Port，簡稱「DP」）標準之DP電路、符合高畫質多媒體介面（High Definition Multimedia Interface，簡稱「HDMI」）標準之HDMI電路、符合數位視訊介面（Digital Visual Interface，簡稱「DVI」）標準之DVI電路以及符合視訊圖形陣列（Video Graphics Array，簡稱「VGA」）標準之VGA電路。例如，顯示裝置110可為液晶顯示器諸如扭曲向列（Twisted Nematic，簡稱「TN」）液晶顯示器，而顯示面板119可為TN液晶面板。In addition, the display device 110 may include a control circuit 112 for controlling the display device 110, an interface circuit 116 for coupling the display device 110 to the electronic device 101 (especially, the image processing circuit 106), and a digital-analog conversion The circuit 118 and a display panel 119 (for example: a liquid crystal display panel), wherein the control circuit 112 may include a timing controller 114, and the interface circuit 116 may include a plurality of sub-circuits, such as a display port (Display-Port, ("DP" for short) standard DP circuit, HDMI circuit for high definition multimedia interface (High Definition Multimedia Interface, "HDMI") standard, and DVI circuit for digital visual interface ("DVI") standard And a VGA circuit that conforms to the Video Graphics Array ("VGA") standard. For example, the display device 110 may be a liquid crystal display such as a twisted nematic (Twisted Nematic, "TN" for short) liquid crystal display, and the display panel 119 may be a TN liquid crystal panel.

此外，深度攝像頭120可包含深度偵測模組（未顯示），而眼動追踪裝置130可包含一控制電路132（其可包含特殊應用積體電路（Application-Specific Integrated Circuit, ASIC）等），且包含至少一攝像頭（例如一或多個攝像頭），其可通稱為攝像頭134，尤其，深度攝像頭120可為具備輸出深度資訊的功能之攝像頭，而眼動追踪裝置130可為具備眼動追踪的功能之人機互動偵測裝置，其中深度攝像頭120與眼動追踪裝置130可採用市場上既有的產品來實施，但本發明不限於此。In addition, the depth camera 120 may include a depth detection module (not shown), and the eye tracking device 130 may include a control circuit 132 (which may include an application-specific integrated circuit (ASIC), etc.), And includes at least one camera (for example, one or more cameras), which may be commonly referred to as a camera 134. In particular, the depth camera 120 may be a camera with a function of outputting depth information, and the eye tracking device 130 may be a camera with eye tracking The functional human-machine interactive detection device, in which the depth camera 120 and the eye tracking device 130 can be implemented using existing products on the market, but the invention is not limited thereto.

依據本實施例，深度攝像頭120可用來拍攝使用者之至少一影像（例如：一或多個影像，其可包含使用者的臉部影像）且取得該使用者之深度資訊，並且眼動追踪裝置130可用來對該使用者進行眼動追踪。基於本發明之一種用來針對一顯示面板（諸如顯示面板119）進行可視角增強之方法，上述至少一處理電路（例如：處理電路102、及／或影像處理電路106）可控制電子裝置101之操作以及進行影像處理，尤其，可進行下列運作：依據上述至少一影像與該深度資訊來判斷該使用者是否位於顯示面板119之可視角範圍以外；當該使用者位於該可視角範圍以外時，利用眼動追踪裝置130對該使用者進行眼動追踪以決定顯示面板119之一顯示區中之一目標區；以及針對該目標區進行局部影像調整以產生顯示資料，以供顯示面板119顯示。舉例來說，為了減輕處理電路102的負荷，這些運作的大部分（甚至全部）可仰賴影像處理電路106來進行，其中處理電路102可進行其它控制（例如遊戲軟體的操作），但本發明不限於此。於某些實施例中，處理電路102與影像處理電路106可共同分攤這些運作的負荷。於某些實施例中，在沒有實施影像處理電路106的狀況下，這些運作可仰賴處理電路102來進行。According to this embodiment, the depth camera 120 can be used to capture at least one image of the user (eg, one or more images, which can include the user's facial image) and obtain depth information of the user, and the eye tracking device 130 can be used for eye tracking of the user. Based on a method for enhancing the viewing angle of a display panel (such as the display panel 119) of the present invention, the at least one processing circuit (eg, the processing circuit 102, and/or the image processing circuit 106) can control the electronic device 101 Operation and image processing, in particular, the following operations can be performed: based on the at least one image and the depth information to determine whether the user is outside the viewing angle range of the display panel 119; when the user is outside the viewing angle range, The eye tracking device 130 is used to perform eye tracking on the user to determine a target area in a display area of the display panel 119; and local image adjustment is performed on the target area to generate display data for the display panel 119 to display. For example, in order to reduce the load on the processing circuit 102, most (or all) of these operations can be performed by the image processing circuit 106, where the processing circuit 102 can perform other controls (such as the operation of game software), but the present invention does not Limited to this. In some embodiments, the processing circuit 102 and the image processing circuit 106 can share the load of these operations. In some embodiments, when the image processing circuit 106 is not implemented, these operations can be performed by the processing circuit 102.

為了便於理解，該深度資訊可包含該使用者的臉部與顯示面板119之間的距離Depth，而上述至少一處理電路（例如：處理電路102、及／或影像處理電路106）可依據上述至少一影像進行人臉偵測（face detection）以決定至少一參數（例如一或多個參數），且依據上述至少一參數與距離Depth來判斷該使用者是否位於顯示面板119之可視角範圍以外，並且，當該使用者位於該可視角範圍以外時，對該目標區中之多個像素分別進行亮度調整、對比度調整以及飽和度調整中之至少一者（例如：亮度調整、對比度調整、及／或飽和度調整），以進行可視角增強，但本發明不限於此。舉例來說，上述至少一處理電路（例如：處理電路102、及／或影像處理電路106）可利用眼動追踪裝置130對該使用者進行眼動追踪以判斷該使用者的雙眼分別注視於該顯示區中之一組參考點，且依據該組參考點的座標值來決定該目標區對該顯示區之相對位置，其中該組參考點位於該目標區中。For ease of understanding, the depth information may include the distance Depth between the user's face and the display panel 119, and the at least one processing circuit (eg, the processing circuit 102, and/or the image processing circuit 106) may be based on the above An image undergoes face detection to determine at least one parameter (such as one or more parameters), and determines whether the user is outside the viewing angle range of the display panel 119 according to the at least one parameter and the distance Depth. Moreover, when the user is outside the viewing angle range, at least one of brightness adjustment, contrast adjustment, and saturation adjustment is performed on the plurality of pixels in the target area (for example: brightness adjustment, contrast adjustment, and/or Or saturation adjustment) to enhance the viewing angle, but the invention is not limited to this. For example, the at least one processing circuit (for example, the processing circuit 102 and/or the image processing circuit 106) may use the eye tracking device 130 to perform eye tracking on the user to determine whether the user's eyes are focused on A group of reference points in the display area, and the relative position of the target area to the display area is determined according to the coordinate values of the group of reference points, wherein the group of reference points is located in the target area.

第2圖為依據本發明一實施例之上述用來針對一顯示面板進行可視角增強之方法的控制方案中所採用之參考點IPD_CenterStandard ，其中電子系統200、顯示裝置210、深度攝像頭220與眼動追踪裝置230可分別作為電子系統100、顯示裝置110、深度攝像頭120與眼動追踪裝置130的例子，而顯示裝置210的顯示面板（諸如TN液晶面板）的顯示區210D可作為顯示面板119之該顯示區的例子。顯示裝置210、深度攝像頭220與眼動追踪裝置230可被設置在一起，以容許該使用者同時面向顯示裝置210、深度攝像頭220與眼動追踪裝置230。例如深度攝像頭220與眼動追踪裝置230可分別位於顯示區210D的正上方與正下方，但本發明不限於此。於某些實施例中，深度攝像頭220與眼動追踪裝置230可分別位於顯示區210D的正下方與正上方。FIG. 2 is the reference point IPD_Center Standard used in the control scheme for the method for enhancing the viewing angle of a display panel according to an embodiment of the present invention, in which the electronic system 200, the display device 210, the depth camera 220 and the eye The motion tracking device 230 can be used as an example of the electronic system 100, the display device 110, the depth camera 120, and the eye tracking device 130, respectively, and the display area 210D of the display panel of the display device 210 (such as a TN liquid crystal panel) can be used as the display panel 119. An example of this display area. The display device 210, the depth camera 220 and the eye-tracking device 230 may be provided together to allow the user to face the display device 210, the depth camera 220 and the eye-tracking device 230 at the same time. For example, the depth camera 220 and the eye tracking device 230 may be located directly above and below the display area 210D, but the invention is not limited thereto. In some embodiments, the depth camera 220 and the eye tracking device 230 may be located directly below and directly above the display area 210D.

為了便於理解，第2圖繪示了眼睛圖案以代表使用者的雙眼。假設使用者位於顯示區210D的正前方位置、且正在觀看顯示區210D。參考點IPD_CenterStandard 可代表此狀況下使用者的雙眼之間的中心點，（例如：雙眼的瞳孔之連線的中心點，其可視為瞳距（Interpupillary distance, IPD）的中心點）。由於參考點IPD_CenterStandard 位於可視角範圍以內，故上述至少一參數對應地指出此狀況。於是，上述至少一處理電路（例如：處理電路102、及／或影像處理電路106）可依據上述至少一影像進行人臉偵測以決定上述至少一參數，且據以判斷該使用者並非位於可視角範圍以外，且因此不需要觸發針對該目標區之局部影像調整，但本發明不限於此。For ease of understanding, Figure 2 shows an eye pattern to represent the user's eyes. Assume that the user is located directly in front of the display area 210D and is watching the display area 210D. The reference point IPD_Center Standard can represent the center point between the eyes of the user in this situation (for example: the center point of the connection between the pupils of the two eyes, which can be regarded as the center point of the interpupillary distance (IPD)). Since the reference point IPD_Center Standard is within the viewing angle range, at least one of the above parameters correspondingly indicates this situation. Therefore, the at least one processing circuit (for example, the processing circuit 102 and/or the image processing circuit 106) may perform face detection based on the at least one image to determine the at least one parameter, and determine that the user is not located Outside the viewing angle range, and therefore no need to trigger local image adjustments for the target area, but the invention is not limited to this.

第3圖繪示該控制方案中所採用之一第一組參考點{IPD_CenterStandard , IPD_Center}以及相關參數，諸如距離{LengthHorizontal , Depth}與角度θ，其中上述至少一參數可包含距離LengthHorizontal 與角度θ。使用者位於顯示區210D的前方、且正在觀看顯示區210D，但並非位於顯示區210D的正前方位置。參考點IPD_Center可代表此狀況下使用者的雙眼之間的中心點（例如：雙眼的瞳孔之連線的上述中心點）。上述至少一處理電路（例如：處理電路102、及／或影像處理電路106）可依據上述至少一影像進行人臉偵測以決定上述至少一參數，且據以判斷該使用者是否位於可視角範圍以外，且可在判斷該使用者位於可視角範圍以外的狀況下觸發針對該目標區之局部影像調整。依據本實施例，上述至少一處理電路可進行人臉偵測，尤其依據上述至少一影像決定參考點{IPD_CenterStandard , IPD_Center}的位置以取得參考點{IPD_CenterStandard , IPD_Center}之間的距離LengthHorizontal ，且依據距離Depth與LengthHorizontal 計算人臉的目前位置（諸如參考點IPD_Center）偏離該正前方位置（諸如參考點{IPD_CenterStandard ）的角度θ，如以下所示：

Figure 02_image001
其中上述至少一處理電路可透過上列方程式中之至少一者（例如方程式(1)、及／或(2)）來進行關於角度θ之計算，以判斷人臉是否偏離該顯示面板（諸如TN液晶面板）之水平可視角（例如：170°；中心位置之左、右側各85°）的範圍之外。舉例來說，當θ ＞ 85°，上述至少一處理電路可判斷該使用者位於該顯示面板（諸如TN液晶面板）之可視角範圍以外；否則，上述至少一處理電路可判斷該使用者位於該顯示面板（諸如TN液晶面板）之可視角範圍中。Figure 3 shows a first set of reference points {IPD_Center Standard , IPD_Center} and related parameters used in the control scheme, such as distance {Length Horizontal , Depth} and angle θ, where at least one of the above parameters may include the distance Length Horizontal With angle θ. The user is located in front of the display area 210D and is looking at the display area 210D, but not directly in front of the display area 210D. The reference point IPD_Center can represent the center point between the user's eyes in this situation (for example: the above-mentioned center point of the connection between the pupils of the two eyes). The at least one processing circuit (for example, the processing circuit 102 and/or the image processing circuit 106) may perform face detection based on the at least one image to determine the at least one parameter, and determine whether the user is within a viewable range In addition, the local image adjustment for the target area can be triggered under the condition that the user is judged to be outside the viewing angle range. According to this embodiment, the at least one processing circuit may perform face detection, in particular at least one image based on the position of the reference point determined {IPD_Center Standard, IPD_Center} to obtain the reference point {IPD_Center Standard, IPD_Center} Length Horizontal distance between , And calculate the angle θ of the current position of the face (such as the reference point IPD_Center) from the front position (such as the reference point {IPD_Center Standard ) according to the distance Depth and Length Horizontal , as shown below:
Figure 02_image001
The at least one processing circuit can calculate the angle θ through at least one of the above equations (for example, equations (1) and/or (2)) to determine whether the human face deviates from the display panel (such as TN The horizontal viewing angle of the LCD panel (for example: 170°; 85° on the left and right of the center position) is outside the range. For example, when θ> 85°, the at least one processing circuit may determine that the user is outside the viewing angle range of the display panel (such as a TN liquid crystal panel); otherwise, the at least one processing circuit may determine that the user is located at the The viewing angle range of the display panel (such as TN liquid crystal panel).

於本實施例中，可假設使用者於看影片或玩遊戲的過程中幾乎不會將其頭部朝上或朝下移動。於是，上述至少一處理電路可僅針對水平方向的偏移進行可視角增強，但本發明不限於此。於某些實施例中，上述至少一處理電路可針對垂直方向、及／或水平方向的偏移進行可視角增強。In this embodiment, it can be assumed that the user hardly moves his head up or down during watching a movie or playing a game. Therefore, the above-mentioned at least one processing circuit can only enhance the viewing angle for the horizontal offset, but the invention is not limited thereto. In some embodiments, the at least one processing circuit may enhance the viewing angle for the vertical and/or horizontal offsets.

第4圖繪示該控制方案中所採用之一第二組參考點{310, 320}以及目標區300，其中目標區300以及該第二組參考點{310, 320}可分別作為上述目標區以及該組參考點的例子。參考點310與320可分別代表使用者的左眼與右眼注視於顯示區210D中的位置，諸如座標(xL , yL )與(xR , yR )的位置，其中xL 與yL 分別代表參考點310的座標(xL , yL )中之x座標值與y座標值，而xR 與yR 分別代表參考點320的座標(xR , yR )中之x座標值與y座標值。如第4圖所示，目標區300可包含參考點310與320以及其附近的像素。舉例來說，為了不影響到使用者所注視的局部影像以外的影像品質，目標區300可包含分別從參考點310與320起向周圍延伸PR個像素所佔的區域，諸如(xL - PR, yL + PR)、(xL - PR, yL - PR)、(xR + PR, yR + PR)以及(xR + PR, yR - PR)所圍起來的矩形，但本發明不限於此。FIG. 4 illustrates a second set of reference points {310, 320} and a target area 300 used in the control scheme, wherein the target area 300 and the second set of reference points {310, 320} can be used as the target areas, respectively And examples of reference points for the group. The reference points 310 and 320 may represent the positions where the left and right eyes of the user are looking at the display area 210D, such as the positions of the coordinates (x L , y L ) and (x R , y R ), where x L and y L represents the x coordinate value and y coordinate value in the coordinates (x L , y L ) of the reference point 310 respectively, and x R and y R represent the x coordinate value in the coordinates (x R , y R ) of the reference point 320 respectively With y coordinate value. As shown in FIG. 4, the target area 300 may include reference points 310 and 320 and pixels near them. For example, in order not to affect the image quality other than the local image that the user is looking at, the target area 300 may include areas occupied by PR pixels extending from the reference points 310 and 320 respectively, such as (x L -PR , y L + PR), (x L -PR, y L -PR), (x R + PR, y R + PR), and (x R + PR, y R -PR) The invention is not limited to this.

第5圖繪示目標區300之相關參數，諸如分別對應於其四個角的四組座標值(xL - 15, yL + 15)、(xL - 15, yL - 15)、(xR + 15, yR + 15)以及(xR + 15, yR - 15)，其中第4圖所示顯示區210D的左下角可被定義為原點，但本發明不限於此。於本實施例中，PR = 15，這表示所要增強的像素範圍可包含分別從參考點310與320起向周圍延伸15個像素所佔的區域，諸如(xL - 15, yL + 15)、(xL - 15, yL - 15)、(xR + 15, yR + 15)以及(xR + 15, yR - 15)所圍起來的矩形，但本發明不限於此。於某些實施例中，PR可取代為其它數值，且目標區300的大小可對應地調整。Figure 5 shows the relevant parameters of the target area 300, such as four sets of coordinate values (x L -15, y L + 15), (x L -15, y L -15), ( x R + 15, y R + 15) and (x R + 15, y R -15), wherein the lower left corner of the display area 210D shown in FIG. 4 may be defined as the origin, but the present invention is not limited thereto. In this embodiment, PR = 15, which means that the range of pixels to be enhanced may include the area occupied by 15 pixels extending from the reference points 310 and 320 respectively, such as (x L -15, y L + 15) , (X L -15, y L -15), (x R + 15, y R + 15), and (x R + 15, y R -15), but the invention is not limited thereto. In some embodiments, PR can be replaced with other values, and the size of the target area 300 can be adjusted accordingly.

第6圖繪示該方法於一實施例中之一工作流程600。工作流程600可應用於第1圖所示電子系統100，諸如第2圖至第4圖所示電子系統200，但本發明不限於此。FIG. 6 illustrates a workflow 600 of the method in an embodiment. The workflow 600 can be applied to the electronic system 100 shown in FIG. 1, such as the electronic system 200 shown in FIGS. 2 to 4, but the invention is not limited thereto.

於步驟S61中，上述至少一處理電路（例如：處理電路102、及／或影像處理電路106）可利用深度攝像頭120（例如深度攝像頭220）進行人臉偵測以決定人臉偏離參數諸如上述至少一參數（例如距離LengthHorizontal 與角度θ）。In step S61, the at least one processing circuit (for example: the processing circuit 102, and/or the image processing circuit 106) may use the depth camera 120 (for example, the depth camera 220) to perform face detection to determine the face deviation parameters such as the above A parameter (for example, distance horizontal and angle θ).

於步驟S62中，依據上述至少一參數諸如角度θ，上述至少一處理電路（例如：處理電路102、及／或影像處理電路106）可判斷使用者觀看顯示面板119（例如：顯示裝置210的顯示面板，諸如TN液晶面板）的角度θ是否超過對應的可視角範圍（諸如85°）。依據本實施例，上述至少一處理電路可依據角度θ是否超過對應的可視角範圍（諸如85°）來判斷該使用者是否位於可視角範圍以外。當θ ＞ 85°（這表示該使用者位於顯示面板119之可視角範圍以外），進入步驟S63；否則（這表示該使用者位於顯示面板119之可視角範圍中），步驟S67。In step S62, based on the at least one parameter such as the angle θ, the at least one processing circuit (for example: the processing circuit 102, and/or the image processing circuit 106) can determine that the user views the display panel 119 (for example: the display of the display device 210 Whether the angle θ of a panel, such as a TN liquid crystal panel, exceeds the corresponding viewing angle range (such as 85°). According to this embodiment, the at least one processing circuit may determine whether the user is outside the viewing angle range according to whether the angle θ exceeds the corresponding viewing angle range (such as 85°). When θ>85° (this indicates that the user is outside the viewing angle range of the display panel 119), step S63 is entered; otherwise (this indicates that the user is within the viewing angle range of the display panel 119), step S67.

於步驟S63中，上述至少一處理電路（例如：處理電路102、及／或影像處理電路106）可利用眼動追踪裝置130（例如：眼動追踪裝置230）進行眼球位置偵測以決定該顯示區中之該目標區（諸如顯示區210D中之目標區300），以供進行局部影像調整。例如，該眼球位置偵測之偵測結果指出該使用者左眼與右眼正分別注視著參考點310與320。於是，上述至少一處理電路可依據參考點310與320各自的座標(xL , yL )與(xR , yR )來決定目標區300的位置，諸如第5圖所示相關參數所指出之位置。In step S63, the at least one processing circuit (for example: the processing circuit 102 and/or the image processing circuit 106) may use the eye tracking device 130 (for example: the eye tracking device 230) to detect the eyeball position to determine the display The target area in the area (such as the target area 300 in the display area 210D) for local image adjustment. For example, the detection result of the eyeball position detection indicates that the user's left and right eyes are looking at reference points 310 and 320, respectively. Therefore, the above-mentioned at least one processing circuit can determine the position of the target area 300 according to the coordinates (x L , y L ) and (x R , y R ) of the reference points 310 and 320 respectively, as indicated by the relevant parameters shown in FIG. 5 The location.

於步驟S64中，上述至少一處理電路（例如：處理電路102、及／或影像處理電路106）可檢查該目標區（諸如目標區300）的位置是否改變，尤其，可透過檢查參考點310與320各自的座標(xL , yL )與(xR , yR )是否改變來判斷目標區300的位置是否改變。當目標區300的位置改變（例如，使用者注視的位置有變動，以致座標(xL , yL )與(xR , yR )中之至少一者（諸如座標(xL , yL )、及／或(xR , yR )）於步驟S63中剛剛被改變了），進入步驟S65；否則（例如，使用者注視的位置完全沒有變動，沒有造成座標(xL , yL )與(xR , yR )於步驟S63中被改變），進入步驟S66。In step S64, the at least one processing circuit (for example: the processing circuit 102, and/or the image processing circuit 106) can check whether the position of the target area (such as the target area 300) has changed, in particular, by checking the reference point 310 and Whether the respective coordinates (x L , y L ) and (x R , y R ) of 320 change to determine whether the position of the target area 300 has changed. When the position of the target zone 300 changes (for example, the position of the user's gaze changes, so that at least one of the coordinates (x L , y L ) and (x R , y R ) (such as the coordinates (x L , y L ) , And/or (x R , y R )) has just been changed in step S63), proceed to step S65; otherwise (for example, the position of the user's gaze has not changed at all, and the coordinates (x L , y L ) and (x R , y R ) is changed in step S63), proceed to step S66.

於步驟S65中，上述至少一處理電路（例如：處理電路102、及／或影像處理電路106）可取消局部影像調整，尤其，將施加於該目標區（諸如目標區300）的先前位置之局部影像調整設定復原為正常狀態，以避免局部影像調整被錯誤地施加在使用者最新注視的範圍以外。In step S65, the at least one processing circuit (for example: the processing circuit 102, and/or the image processing circuit 106) can cancel the local image adjustment, in particular, apply the local part of the previous position of the target area (such as the target area 300) The image adjustment setting is restored to a normal state to avoid partial image adjustment being erroneously applied outside the range of the user's latest gaze.

於步驟S66中，上述至少一處理電路（例如：處理電路102、及／或影像處理電路106）可對該目標區（諸如目標區300）進行局部影像調整。依據本實施例，上述至少一處理電路可計算目標區300的平均亮度AVG以決定該局部影像調整之影像調整參數，尤其，可依據下列方程式來進行該局部影像調整：

Figure 02_image003
其中Total_Pixel代表目標區300的總像素數，Pixeli,j -Brightness 代表目標區300中之像素Pixeli,j 的亮度，Pixel_start與Pixel_end分別代表在加總運算Σ中之開始像素與結束像素（諸如目標區300中之第一個像素與最後一個像素），Pixeli,j -Saturation 代表像素Pixeli,j 的飽和度，1.1、1.08與1.2可作為該些影像調整參數的例子，而運算子「*=」代表對前面的像素資料（例如Pixeli,j -Brightness 或Pixeli,j -Saturation ）的原數值乘以後面的影像調整參數（諸如1.1或1.2）以產生一調整結果作為此像素資料之最新的數值，並且運算子「/=」代表對前面的像素資料（例如Pixeli,j -Brightness ）的原數值除以後面的影像調整參數（諸如1.08）以產生一調整結果作為此像素資料之最新的數值，但本發明不限於此。In step S66, the at least one processing circuit (for example, the processing circuit 102 and/or the image processing circuit 106) can perform local image adjustment on the target area (such as the target area 300). According to this embodiment, the at least one processing circuit may calculate the average brightness AVG of the target area 300 to determine the image adjustment parameters of the local image adjustment. In particular, the local image adjustment may be performed according to the following equation:
Figure 02_image003
Where Total_Pixel represents the total number of pixels in the target area 300, Pixel i, j- Brightness represents the brightness of the pixels Pixel i, j in the target area 300, and Pixel_start and Pixel_end represent the starting pixel and ending pixel (such as The first pixel and the last pixel in the target area 300), Pixel i,j -Saturation represents the saturation of the pixel Pixel i,j , 1.1, 1.08 and 1.2 can be used as examples of these image adjustment parameters, and the operator " *=” represents the original value of the previous pixel data (such as Pixel i, j -Brightness or Pixel i, j -Saturation ) multiplied by the subsequent image adjustment parameters (such as 1.1 or 1.2) to produce an adjustment result as this pixel data The latest value, and the operator "/=" represents the original value of the previous pixel data (such as Pixel i, j- Brightness ) divided by the subsequent image adjustment parameters (such as 1.08) to produce an adjustment result as this pixel data The latest value, but the invention is not limited to this.

依據本實施例，上述至少一處理電路可於步驟S66中對目標區300進行亮度調整、對比度調整以及飽和度調整，以進行可視角增強，尤其，可依據平均亮度AVG選擇性地進行亮度調整與對比度調整。如方程式(3)所示，上述至少一處理電路可對標區300中之全部的像素{Pixeli,j }的亮度{Pixeli,j -Brightness }進行加總運算Σ、且將加總運算Σ的總和除以總像素數Total_Pixel以產生平均亮度AVG。另外，方程式(4)至(7)代表對像素Pixeli,j 的像素資料（例如Pixeli,j -Brightness 與Pixeli,j -Saturation ）進行調整之虛擬程式碼（以C語言為例，以便於理解）。方程式(4)至(7)指出：若亮度Pixeli,j -Brightness 大於平均亮度AVG，則將亮度Pixeli,j -Brightness 調整為其原數值的1.1倍；若亮度Pixeli,j -Brightness 小於平均亮度AVG，則將亮度Pixeli,j -Brightness 調整為其原數值的(1 / 1.08)倍；若亮度Pixeli,j -Brightness 等於平均亮度AVG，則將亮度Pixeli,j -Brightness 維持不變；以及將飽和度Pixeli,j -Saturation 調整為其原數值的1.2倍。此外，當使用者的雙眼所注視的位置改變時，上述至少一處理電路可於步驟S65中預先將該些影像調整參數（諸如1.1、1.08與1.2）還原成正常的數值（諸如1.00），以於步驟S66中針對目標區300的最新位置進行亮度調整、對比度調整以及飽和度調整。According to this embodiment, the at least one processing circuit can perform brightness adjustment, contrast adjustment, and saturation adjustment on the target area 300 in step S66 to enhance the viewing angle. In particular, the brightness adjustment and the brightness can be selectively adjusted according to the average brightness AVG Contrast adjustment. As shown in equation (3), the at least one processing circuit may be the luminance of all the pixels in the header area 300 {Pixel i, j} of {Pixel i, j -Brightness} summation [Sigma performed, and the summation The sum of Σ is divided by the total number of pixels Total_Pixel to produce the average brightness AVG. In addition, equations (4) to (7) represent virtual code for adjusting pixel data of pixels Pixel i, j (such as Pixel i, j -Brightness and Pixel i, j- Saturation ) (taking C language as an example, in order to For understanding). Equations (4) to (7) indicate that if the brightness Pixel i,j -Brightness is greater than the average brightness AVG, then adjust the brightness Pixel i,j -Brightness to 1.1 times its original value; if the brightness Pixel i,j -Brightness is less than Average brightness AVG, adjust brightness Pixel i,j -Brightness to (1/1.08) times of its original value; if brightness Pixel i,j -Brightness is equal to average brightness AVG, then maintain brightness Pixel i,j -Brightness not Change; and adjust the saturation Pixel i, j -Saturation to 1.2 times its original value. In addition, when the position of the user's eyes changes, the at least one processing circuit may previously restore the image adjustment parameters (such as 1.1, 1.08, and 1.2) to normal values (such as 1.00) in step S65, In step S66, brightness adjustment, contrast adjustment, and saturation adjustment are performed for the latest position of the target area 300.

於步驟S67中，上述至少一處理電路（例如：處理電路102、及／或影像處理電路106）可檢查局部影像調整是否已取消，尤其，檢查該些影像調整參數（諸如1.1、1.08與1.2）是否已被還原成正常的數值（諸如1.00）。當局部影像調整已取消，進入步驟S61；否則，步驟S68。In step S67, the at least one processing circuit (for example: the processing circuit 102 and/or the image processing circuit 106) can check whether the local image adjustment has been cancelled, in particular, check the image adjustment parameters (such as 1.1, 1.08 and 1.2) Whether it has been restored to a normal value (such as 1.00). When the partial image adjustment has been cancelled, step S61 is entered; otherwise, step S68.

於步驟S68中，上述至少一處理電路（例如：處理電路102、及／或影像處理電路106）可取消局部影像調整，尤其，將該些影像調整參數（諸如1.1、1.08與1.2）還原成正常的數值（諸如1.00）。In step S68, the at least one processing circuit (for example: the processing circuit 102, and/or the image processing circuit 106) can cancel local image adjustment, in particular, restore the image adjustment parameters (such as 1.1, 1.08, and 1.2) to normal Value (such as 1.00).

基於該方法，電子系統100（諸如電子系統200）能提升該目標區（諸如目標區300）的亮度、對比度及飽和度，讓使用者在各種角度觀看顯示面板119（例如：顯示裝置210的顯示面板，諸如TN液晶面板）時影像品質得以保持良好，以確保很好的使用者體驗。Based on this method, the electronic system 100 (such as the electronic system 200) can enhance the brightness, contrast, and saturation of the target area (such as the target area 300), allowing the user to view the display panel 119 (eg, the display of the display device 210) at various angles Panel, such as TN LCD panel), the image quality can be maintained to ensure a good user experience.

第7圖為依據本發明一實施例之一種電子裝置700的示意圖，其中電子裝置700中之處理電路702、程式碼704、影像處理電路706、介面電路708、顯示裝置710、控制電路712、時序控制器714、介面電路716、顯示面板719、深度攝像頭720、眼動追踪裝置730、控制電路732與攝像頭734可分別類似於電子系統100中之處理電路102、程式碼104、影像處理電路106、介面電路108、顯示裝置110、控制電路112、時序控制器114、介面電路116、顯示面板119、深度攝像頭120、眼動追踪裝置130、控制電路132與攝像頭134，但本發明不限於此。相較於第1圖所示架構，第7圖中之顯示裝置710、深度攝像頭720與眼動追踪裝置730已被整合至電子裝置700中。電子裝置700的例子可包含（但不限於）：個人電腦（Personal Computer, PC）諸如膝上型個人電腦（laptop computer）。本實施例與前述實施例相仿的內容在此不重複贅述。 以上所述僅為本發明之較佳實施例，凡依本發明申請專利範圍所做之均等變化與修飾，皆應屬本發明之涵蓋範圍。FIG. 7 is a schematic diagram of an electronic device 700 according to an embodiment of the present invention, in which the processing circuit 702, program code 704, image processing circuit 706, interface circuit 708, display device 710, control circuit 712, timing in the electronic device 700 The controller 714, the interface circuit 716, the display panel 719, the depth camera 720, the eye tracking device 730, the control circuit 732 and the camera 734 may be similar to the processing circuit 102, the program code 104, the image processing circuit 106 in the electronic system 100, The interface circuit 108, the display device 110, the control circuit 112, the timing controller 114, the interface circuit 116, the display panel 119, the depth camera 120, the eye tracking device 130, the control circuit 132 and the camera 134, but the invention is not limited thereto. Compared with the architecture shown in FIG. 1, the display device 710, the depth camera 720 and the eye tracking device 730 in FIG. 7 have been integrated into the electronic device 700. Examples of the electronic device 700 may include (but are not limited to): a personal computer (Personal Computer, PC) such as a laptop personal computer (laptop computer). The content of this embodiment that is similar to the foregoing embodiment will not be repeated here. The above are only the preferred embodiments of the present invention, and all changes and modifications made in accordance with the scope of the patent application of the present invention shall fall within the scope of the present invention.

100, 200:電子系統101, 700:電子裝置102, 702:處理電路104, 704:程式碼106, 706:影像處理電路108, 116, 708, 716:介面電路110, 210, 710:顯示裝置112, 132, 712, 732:控制電路114, 714:時序控制器118:數位-類比轉換電路119, 719:顯示面板120, 220, 720:深度攝像頭130, 230, 730:眼動追踪裝置134, 734:攝像頭210D:顯示區300:目標區310, 320:參考點600:工作流程S61, S62, S63, S64, S65, S66, S67, S68:步驟IPD_CenterStandard, IPD_Center:參考點LengthHorizontal, Depth:距離θ:角度100, 200: Electronic system 101, 700: Electronic device 102, 702: Processing circuit 104, 704: Program code 106, 706: Image processing circuit 108, 116, 708, 716: Interface circuit 110, 210, 710: Display device 112 , 132, 712, 732: control circuit 114, 714: timing controller 118: digital-to-analog conversion circuit 119, 719: display panel 120, 220, 720: depth camera 130, 230, 730: eye tracking device 134, 734 : Camera 210D: display area 300: target area 310, 320: reference point 600: workflow S61, S62, S63, S64, S65, S66, S67, S68: steps IPD_Center Standard , IPD_Center: reference point Length Horizontal , Depth: distance θ: angle

第1圖為依據本發明一實施例之一種用來針對一顯示面板進行可視角增強之電子系統的示意圖。 第2圖為依據本發明一實施例之一種用來針對一顯示面板進行可視角增強之方法的控制方案中所採用之一參考點。 第3圖繪示該控制方案中所採用之一第一組參考點以及相關參數。 第4圖繪示該控制方案中所採用之一第二組參考點以及目標區。 第5圖繪示該目標區之相關參數。 第6圖繪示該方法於一實施例中之一工作流程。 第7圖為依據本發明一實施例之一種電子裝置的示意圖。FIG. 1 is a schematic diagram of an electronic system for enhancing the viewing angle of a display panel according to an embodiment of the invention. FIG. 2 is a reference point used in a control scheme for a method for enhancing the viewing angle of a display panel according to an embodiment of the invention. Figure 3 shows a first set of reference points and related parameters used in the control scheme. Figure 4 illustrates a second set of reference points and target areas used in the control scheme. Figure 5 shows the relevant parameters of the target zone. FIG. 6 illustrates a workflow of the method in an embodiment. FIG. 7 is a schematic diagram of an electronic device according to an embodiment of the invention.

100:電子系統 100: Electronic system

101:電子裝置 101: Electronic device

102:處理電路 102: Processing circuit

104:程式碼 104: code

106:影像處理電路 106: Image processing circuit

108,116:介面電路 108,116: Interface circuit

110:顯示裝置 110: display device

112,132:控制電路 112,132: control circuit

114:時序控制器 114: Timing controller

118:數位-類比轉換電路 118: Digital-to-analog conversion circuit

119:顯示面板 119: Display panel

120:深度攝像頭 120: depth camera

130:眼動追踪裝置 130: Eye tracking device

134:攝像頭 134: camera

Claims (10)

一種用來針對一顯示面板進行可視角增強（viewing-angle enhancement）之電子系統，包含： 一深度攝像頭（Depth Camera），用來拍攝一使用者之至少一影像且取得該使用者之深度資訊； 一眼動追踪裝置（Eye-tracking Device），用來對該使用者進行眼動追踪（Eye Tracking）；以及 一電子裝置，耦接至該深度攝像頭與該眼動追踪裝置，其中該電子裝置包含： 至少一處理電路，用來控制該電子裝置之操作以及進行影像處理，其中該至少一處理電路依據該至少一影像與該深度資訊來判斷該使用者是否位於該顯示面板之可視角範圍以外，以及當該使用者位於該可視角範圍以外時，該至少一處理電路利用該眼動追踪裝置對該使用者進行眼動追踪以決定該顯示面板之一顯示區中之一目標區，以及針對該目標區進行局部影像調整以產生顯示資料，以供該顯示面板顯示。An electronic system for viewing-angle enhancement of a display panel includes: a depth camera, which is used to capture at least one image of a user and obtain depth information of the user; An Eye-tracking Device is used to perform Eye Tracking on the user; and an electronic device is coupled to the depth camera and the Eye Tracking Device, wherein the electronic device includes: At least one processing circuit for controlling the operation of the electronic device and performing image processing, wherein the at least one processing circuit determines whether the user is outside the viewing angle range of the display panel according to the at least one image and the depth information, and When the user is outside the viewable range, the at least one processing circuit uses the eye tracking device to perform eye tracking on the user to determine a target area in a display area of the display panel and for the target The area performs local image adjustment to generate display data for display on the display panel. 如申請專利範圍第1項所述之電子系統，其中該深度資訊包含該使用者的臉部與該顯示面板之間的距離；以及該至少一處理電路依據該至少一影像進行人臉偵測（face detection）以決定至少一參數，且依據該至少一參數與該距離來判斷該使用者是否位於該顯示面板之可視角範圍以外。The electronic system as described in item 1 of the patent scope, wherein the depth information includes the distance between the user's face and the display panel; and the at least one processing circuit performs face detection based on the at least one image ( face detection) to determine at least one parameter and determine whether the user is outside the viewing angle range of the display panel according to the at least one parameter and the distance. 如申請專利範圍第1項所述之電子系統，其中該至少一處理電路利用該眼動追踪裝置對該使用者進行眼動追踪以判斷該使用者的雙眼分別注視於該顯示區中之一組參考點，且依據該組參考點的座標值來決定該目標區對該顯示區之相對位置，其中該組參考點位於該目標區中。The electronic system as described in item 1 of the patent application range, wherein the at least one processing circuit uses the eye-tracking device to perform eye-tracking on the user to determine that the user's eyes are respectively focusing on one of the display areas A group of reference points, and the relative position of the target area to the display area is determined according to the coordinate value of the group of reference points, wherein the group of reference points is located in the target area. 如申請專利範圍第1項所述之電子系統，其中該至少一處理電路對該目標區中之多個像素分別進行亮度調整、對比度調整以及飽和度調整中之至少一者，以進行可視角增強。The electronic system as described in item 1 of the patent scope, wherein the at least one processing circuit performs at least one of brightness adjustment, contrast adjustment, and saturation adjustment on the plurality of pixels in the target area, respectively, to enhance the viewing angle . 如申請專利範圍第1項所述之電子系統，另包含： 一顯示裝置，耦接至該電子裝置，其中該顯示裝置包含該顯示面板，且該顯示裝置、該深度攝像頭與該眼動追踪裝置被設置在一起，以容許該使用者同時面向該顯示裝置、該深度攝像頭與該眼動追踪裝置。The electronic system described in item 1 of the patent application scope further includes: a display device coupled to the electronic device, wherein the display device includes the display panel, and the display device, the depth camera, and the eye tracking device It is set together to allow the user to face the display device, the depth camera, and the eye tracking device at the same time. 一種電子裝置，包含： 一深度攝像頭（Depth Camera），用來拍攝一使用者之至少一影像且取得該使用者之深度資訊； 一眼動追踪裝置（Eye-tracking Device），用來對該使用者進行眼動追踪（Eye Tracking）；以及 至少一處理電路，耦接至該深度攝像頭與該眼動追踪裝置，用來控制該電子裝置之操作以及進行影像處理，其中該至少一處理電路依據該至少一影像與該深度資訊來判斷該使用者是否位於該顯示面板之可視角範圍以外，以及當該使用者位於該可視角範圍以外時，該至少一處理電路利用該眼動追踪裝置對該使用者進行眼動追踪以決定該顯示面板之一顯示區中之一目標區，以及針對該目標區進行局部影像調整以產生顯示資料，以供該顯示面板顯示。An electronic device, including: a depth camera to capture at least one image of a user and obtain depth information of the user; an eye-tracking device to the user Eye tracking; and at least one processing circuit, coupled to the depth camera and the eye tracking device, for controlling the operation of the electronic device and performing image processing, wherein the at least one processing circuit is based on the at least one An image and the depth information to determine whether the user is outside the viewing angle range of the display panel, and when the user is outside the viewing angle range, the at least one processing circuit uses the eye tracking device to target the user Perform eye tracking to determine a target area in a display area of the display panel, and perform local image adjustments on the target area to generate display data for display by the display panel. 如申請專利範圍第6項所述之電子裝置，其中該深度資訊包含該使用者的臉部與該顯示面板之間的距離；以及該至少一處理電路依據該至少一影像進行人臉偵測（face detection）以決定至少一參數，且依據該至少一參數與該距離來判斷該使用者是否位於該顯示面板之可視角範圍以外。The electronic device as described in item 6 of the patent scope, wherein the depth information includes the distance between the user's face and the display panel; and the at least one processing circuit performs face detection based on the at least one image ( face detection) to determine at least one parameter and determine whether the user is outside the viewing angle range of the display panel according to the at least one parameter and the distance. 如申請專利範圍第6項所述之電子裝置，其中該至少一處理電路利用該眼動追踪裝置對該使用者進行眼動追踪以判斷該使用者的雙眼分別注視於該顯示區中之一組參考點，且依據該組參考點的座標值來決定該目標區對該顯示區之相對位置，其中該組參考點位於該目標區中。The electronic device as described in item 6 of the patent application range, wherein the at least one processing circuit uses the eye tracking device to perform eye tracking on the user to determine that the user's eyes are respectively focusing on one of the display areas A group of reference points, and the relative position of the target area to the display area is determined according to the coordinate value of the group of reference points, wherein the group of reference points is located in the target area. 如申請專利範圍第6項所述之電子裝置，其中該至少一處理電路對該目標區中之多個像素分別進行亮度調整、對比度調整以及飽和度調整中之至少一者，以進行可視角增強。The electronic device as described in item 6 of the patent application range, wherein the at least one processing circuit performs at least one of brightness adjustment, contrast adjustment, and saturation adjustment on the plurality of pixels in the target area, respectively, to enhance the viewing angle . 如申請專利範圍第6項所述之電子裝置，另包含： 一顯示裝置，耦接至該至少一處理電路，其中該顯示裝置包含該顯示面板，且該顯示裝置、該深度攝像頭與該眼動追踪裝置被設置在一起，以容許該使用者同時面向該顯示裝置、該深度攝像頭與該眼動追踪裝置。The electronic device described in item 6 of the patent application scope further includes: a display device coupled to the at least one processing circuit, wherein the display device includes the display panel, and the display device, the depth camera, and the eye movement The tracking devices are arranged together to allow the user to face the display device, the depth camera and the eye tracking device at the same time.
TW107131962A 2018-09-12 2018-09-12 Electronic system and electronic device for performing viewing-angle enhancement regarding display panel TWI683302B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
TW107131962A TWI683302B (en) 2018-09-12 2018-09-12 Electronic system and electronic device for performing viewing-angle enhancement regarding display panel

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
TW107131962A TWI683302B (en) 2018-09-12 2018-09-12 Electronic system and electronic device for performing viewing-angle enhancement regarding display panel

Publications (2)

Publication Number Publication Date
TWI683302B TWI683302B (en) 2020-01-21
TW202011377A true TW202011377A (en) 2020-03-16

Family

ID=69942592

Family Applications (1)

Application Number Title Priority Date Filing Date
TW107131962A TWI683302B (en) 2018-09-12 2018-09-12 Electronic system and electronic device for performing viewing-angle enhancement regarding display panel

Country Status (1)

Country Link
TW (1) TWI683302B (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI757736B (en) * 2020-05-06 2022-03-11 天擎積體電路股份有限公司 Conversion device for converting black-white or gray-level frame to color display, and electronic device and color display device using the same
TWI757880B (en) * 2020-05-06 2022-03-11 天擎積體電路股份有限公司 Data conversion circuit for converting black-white or gray-level frame to color display panel/ module, and electronic device and color display device using the same

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112967696A (en) * 2021-03-22 2021-06-15 北海惠科光电技术有限公司 Liquid crystal panel display parameter adjusting method and system, liquid crystal panel and storage medium

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4934974B2 (en) * 2005-03-17 2012-05-23 エプソンイメージングデバイス株式会社 Image display device
TWI449421B (en) * 2010-12-31 2014-08-11 Altek Corp Method for displaying multiple views by using multi-lens apparatus
US20130194394A1 (en) * 2012-02-01 2013-08-01 Peter Rae Shintani Energy Conserving Display
TWI635317B (en) * 2016-12-20 2018-09-11 宏星技術股份有限公司 Wide view angle head mounted display

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI757736B (en) * 2020-05-06 2022-03-11 天擎積體電路股份有限公司 Conversion device for converting black-white or gray-level frame to color display, and electronic device and color display device using the same
TWI757880B (en) * 2020-05-06 2022-03-11 天擎積體電路股份有限公司 Data conversion circuit for converting black-white or gray-level frame to color display panel/ module, and electronic device and color display device using the same

Also Published As

Publication number Publication date
TWI683302B (en) 2020-01-21

Similar Documents

Publication Publication Date Title
US10078367B2 (en) Stabilization plane determination based on gaze location
TWI704501B (en) Electronic apparatus operated by head movement and operation method thereof
TWI317227B (en) Image adjustment apparatus and method for head-mounted display
US10082867B2 (en) Display control method and display control apparatus
TWI683302B (en) Electronic system and electronic device for performing viewing-angle enhancement regarding display panel
WO2020140758A1 (en) Image display method, image processing method, and related devices
WO2018155233A1 (en) Image processing device, image processing method, and image system
US10650507B2 (en) Image display method and apparatus in VR device, and VR device
EP3862981A1 (en) Information processing device, information processing method, and recording medium
US10762691B2 (en) Techniques for compensating variable display device latency in image display
KR102521557B1 (en) Electronic device controlling image display based on scroll input and method thereof
WO2023000598A1 (en) Frame rate adjustment method and system for augmented reality device, and device and storage medium
US9536133B2 (en) Display apparatus and control method for adjusting the eyes of a photographed user
TWI745955B (en) Augmented reality system and anchor display method thereof
US10522110B1 (en) Apparatuses, systems, and methods for measuring and adjusting the luminance of a head-mounted display
TW201913622A (en) Variable DPI across a display and control thereof
JP2023058464A (en) Device and method for foveated rendering
US20230177879A1 (en) Videoconference iris position adjustments
TW202213994A (en) Augmented reality system and display brightness adjusting method thereof
TW201830217A (en) Display adjustment method and electronic device
JP6849826B2 (en) Image processing device and display image generation method
US10540930B1 (en) Apparatus, systems, and methods for temperature-sensitive illumination of liquid crystal displays
JP6965374B2 (en) Image processing device and display image generation method
TWI806031B (en) Display system capable of providing multiple display areas and method thereof
US12058301B2 (en) Electronic device that displays virtual objects