[go: up one dir, main page]

TWI683302B - Electronic system and electronic device for performing viewing-angle enhancement regarding display panel - Google Patents

Electronic system and electronic device for performing viewing-angle enhancement regarding display panel Download PDF

Info

Publication number
TWI683302B
TWI683302B TW107131962A TW107131962A TWI683302B TW I683302 B TWI683302 B TW I683302B TW 107131962 A TW107131962 A TW 107131962A TW 107131962 A TW107131962 A TW 107131962A TW I683302 B TWI683302 B TW I683302B
Authority
TW
Taiwan
Prior art keywords
user
processing circuit
display
display panel
image
Prior art date
Application number
TW107131962A
Other languages
Chinese (zh)
Other versions
TW202011377A (en
Inventor
陳瑞麟
Original Assignee
宏碁股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 宏碁股份有限公司 filed Critical 宏碁股份有限公司
Priority to TW107131962A priority Critical patent/TWI683302B/en
Application granted granted Critical
Publication of TWI683302B publication Critical patent/TWI683302B/en
Publication of TW202011377A publication Critical patent/TW202011377A/en

Links

Images

Landscapes

  • Controls And Circuits For Display Device (AREA)
  • Control Of Indicators Other Than Cathode Ray Tubes (AREA)

Abstract

An electronic system for performing viewing-angle enhancement regarding a display panel includes a depth camera, an eye-tracking device, and an electronic device. The depth camera may capture at least one image of a user and obtain depth information of the user. At least one processing circuit of the electronic device may control operations of the electronic device and perform image processing, for example, determine whether the user is positioned outside a viewing angle range of the display panel according to the aforementioned at least one image and the depth information; when the user is positioned outside the viewing angle range, utilize the eye-tracking device to perform eye tracking to determine a target region within a display region of the display panel; and perform partial image adjustment regarding the target region to generate display data, for being displayed by the display panel. An associated electronic device is also provided.

Description

用來針對顯示面板進行可視角增強之電子系統與電子裝置 Electronic system and electronic device for enhancing viewing angle of display panel

本發明係有關於顯示控制,尤指一種用來針對一顯示面板進行可視角增強(viewing-angle enhancement)之電子系統以及相關的電子裝置。 The present invention relates to display control, in particular to an electronic system and related electronic device for viewing-angle enhancement of a display panel.

目前市面上的電競顯示器大多採用扭曲向列(Twisted Nematic,可簡稱「TN」)液晶面板,其液晶分子轉動速度比其它類型面板更快。隨著技術進步,採用TN液晶面板的TN顯示器的反應時間增快許多,例如灰階反應時間可為2毫秒以下,但其最大的缺點是可視角問題。當使用者並非正對著TN液晶面板並處於可視角範圍以外時,使用者所見影像的特性諸如亮度、對比、色彩等通常會失真。相關技術中提出了某些方案(例如在玻璃基板上加上補償膜、改進玻璃基板中液晶分子排列方式等),以嘗試解決這個問題。然而,可視角在某些狀況下可能仍然不足。假設水平可視角可達到160,甚至170度。當使用者改成使用較大尺寸的顯示器時,使用者的位置可能沒有往後移。此狀況下,使用者和顯示器之間的距離並沒有變得更遠,所以使用者觀看顯示器所顯示之整個畫面中之某些局部區域時的角度可能很大,這表示上述問題仍然存在。因此,需要一種新穎的架構,以改善使用者經驗。 At present, most of the e-sports displays on the market use twisted nematic (Tnisted Nematic, "TN" for short) liquid crystal panels, whose liquid crystal molecules rotate faster than other types of panels. With the advancement of technology, the response time of TN displays using TN liquid crystal panels is much faster. For example, the gray-scale response time can be less than 2 milliseconds, but the biggest disadvantage is the angle of view. When the user is not directly facing the TN liquid crystal panel and is outside the viewing angle range, the characteristics of the image seen by the user such as brightness, contrast, color, etc. are usually distorted. Some solutions have been proposed in the related art (such as adding a compensation film on a glass substrate, improving the arrangement of liquid crystal molecules in the glass substrate, etc.) to try to solve this problem. However, the viewing angle may still be insufficient in certain situations. Assume that the horizontal viewing angle can reach 160, or even 170 degrees. When the user changes to use a larger-sized display, the user's position may not move backward. In this situation, the distance between the user and the monitor has not become farther, so the angle of the user when viewing some local areas in the entire screen displayed by the monitor may be very large, which means that the above problem still exists. Therefore, a novel architecture is needed to improve user experience.

本發明之一目的在於提供一種用來針對一顯示面板進行可視角增強 之電子系統以及相關的電子裝置,以解決上述問題。 An object of the present invention is to provide a viewing angle enhancement for a display panel Electronic system and related electronic devices to solve the above problems.

本發明之另一目的在於提供一種用來針對一顯示面板進行可視角增強之電子系統以及相關的電子裝置,以改善使用者體驗。 Another object of the present invention is to provide an electronic system and related electronic device for enhancing the viewing angle of a display panel to improve the user experience.

本發明之至少一實施例提供一種用來針對一顯示面板進行可視角增強之電子系統。該電子系統可包含一深度攝像頭(Depth Camera)、一眼動追踪裝置(Eye-tracking Device)以及一電子裝置,其中該電子裝置可耦接至該深度攝像頭與該眼動追踪裝置,且可包含至少一處理電路。該深度攝像頭可用來拍攝一使用者之至少一影像且取得該使用者之深度資訊,並且該眼動追踪裝置可用來對該使用者進行眼動追踪(Eye Tracking)。另外,上述至少一處理電路可用來控制該電子裝置之操作以及進行影像處理。例如,上述至少一處理電路可依據上述至少一影像與該深度資訊來判斷該使用者是否位於該顯示面板之可視角範圍以外。當該使用者位於該可視角範圍以外時,上述至少一處理電路可利用該眼動追踪裝置對該使用者進行眼動追踪以決定該顯示面板之一顯示區中之一目標區,以及針對該目標區進行局部影像調整以產生顯示資料,以供該顯示面板顯示。 At least one embodiment of the present invention provides an electronic system for enhancing the viewing angle of a display panel. The electronic system may include a depth camera (Depth Camera), an eye-tracking device (Eye-tracking Device) and an electronic device, wherein the electronic device may be coupled to the depth camera and the eye-tracking device, and may include at least One processing circuit. The depth camera can be used to capture at least one image of a user and obtain depth information of the user, and the eye tracking device can be used to perform eye tracking (Eye Tracking) on the user. In addition, the at least one processing circuit can be used to control the operation of the electronic device and perform image processing. For example, the at least one processing circuit may determine whether the user is outside the viewing angle range of the display panel based on the at least one image and the depth information. When the user is outside the viewable range, the at least one processing circuit may use the eye tracking device to perform eye tracking on the user to determine a target area in a display area of the display panel, and The target area is adjusted locally to generate display data for display on the display panel.

本發明之至少一實施例提供一種電子裝置。該電子裝置可包含一深度攝像頭、一眼動追踪裝置以及至少一處理電路,其中上述至少一處理電路可耦接至該深度攝像頭與該眼動追踪裝置。該深度攝像頭可用來拍攝一使用者之至少一影像且取得該使用者之深度資訊,並且該眼動追踪裝置可用來對該使用者進行眼動追踪。另外,上述至少一處理電路可用來控制該電子裝置之操作以及進行影像處理。例如,上述至少一處理電路可依據上述至少一影像與該深度資訊來判斷該使用者是否位於該顯示面板之可視角範圍以外。當該使用者位於該可視角範圍以外時,上述至少一處理電路可利用該眼動追踪裝置對該使用者進行眼動追踪以決定該顯示面板之一顯示區中之一目標區,以及針對該目標區 進行局部影像調整以產生顯示資料,以供該顯示面板顯示。 At least one embodiment of the present invention provides an electronic device. The electronic device may include a depth camera, an eye tracking device, and at least one processing circuit, wherein the at least one processing circuit may be coupled to the depth camera and the eye tracking device. The depth camera can be used to capture at least one image of a user and obtain depth information of the user, and the eye tracking device can be used to track the user's eye movements. In addition, the at least one processing circuit can be used to control the operation of the electronic device and perform image processing. For example, the at least one processing circuit may determine whether the user is outside the viewing angle range of the display panel based on the at least one image and the depth information. When the user is outside the viewable range, the at least one processing circuit may use the eye tracking device to perform eye tracking on the user to determine a target area in a display area of the display panel, and Target zone Perform local image adjustment to generate display data for display on the display panel.

本發明的好處之一是,本發明之電子系統以及相關的電子裝置能進行可視角增強,尤其,可動態地決定該目標區的位置以進行局部影像調整。例如,當使用者改成使用較大尺寸的顯示器時,使用者的位置可能沒有往後移。雖然使用者觀看顯示器所顯示之整個畫面中之某些局部區域時的角度很大,但本發明之電子系統以及相關的電子裝置能進行局部影像調整以增強可視角。相較於相關技術,本發明之電子系統以及相關的電子裝置能改善使用者體驗。 One of the advantages of the present invention is that the electronic system and related electronic devices of the present invention can enhance the viewing angle. In particular, the position of the target area can be dynamically determined for local image adjustment. For example, when the user changes to use a larger size display, the user's position may not move backward. Although the user has a large angle when viewing some local areas in the entire screen displayed on the display, the electronic system and related electronic devices of the present invention can perform local image adjustment to enhance the viewing angle. Compared with the related art, the electronic system and related electronic device of the present invention can improve the user experience.

100,200‧‧‧電子系統 100,200‧‧‧Electronic system

101,700‧‧‧電子裝置 101,700‧‧‧Electronic device

102,702‧‧‧處理電路 102,702‧‧‧ processing circuit

104,704‧‧‧程式碼 104,704‧‧‧Code

106,706‧‧‧影像處理電路 106,706‧‧‧Image processing circuit

108,116,708,716‧‧‧介面電路 108,116,708,716‧‧‧Interface circuit

110,210,710‧‧‧顯示裝置 110,210,710‧‧‧Display device

112,132,712,732‧‧‧控制電路 112,132,712,732 ‧‧‧ control circuit

114,714‧‧‧時序控制器 114,714‧‧‧sequence controller

118‧‧‧數位-類比轉換電路 118‧‧‧Digital-to-analog conversion circuit

119,719‧‧‧顯示面板 119,719‧‧‧Display panel

120,220,720‧‧‧深度攝像頭 120,220,720‧‧‧Depth camera

130,230,730‧‧‧眼動追踪裝置 130,230,730‧‧‧eye tracking device

134,734‧‧‧攝像頭 134,734‧‧‧camera

210D‧‧‧顯示區 210D‧‧‧Display area

300‧‧‧目標區 300‧‧‧Target area

310,320‧‧‧參考點 310,320‧‧‧reference point

600‧‧‧工作流程 600‧‧‧Working process

S61,S62,S63,S64,S65,S66,S67,S68‧‧‧步驟 S61, S62, S63, S64, S65, S66, S67, S68

IPD_CenterStandard,IPD_Center‧‧‧參考點 IPD_Center Standard , IPD_Center‧‧‧Reference point

LengthHorizontal,Depth‧‧‧距離 Length Horizontal , Depth‧‧‧Distance

θ‧‧‧角度 θ‧‧‧angle

第1圖為依據本發明一實施例之一種用來針對一顯示面板進行可視角增強之電子系統的示意圖。 FIG. 1 is a schematic diagram of an electronic system for enhancing the viewing angle of a display panel according to an embodiment of the invention.

第2圖為依據本發明一實施例之一種用來針對一顯示面板進行可視角增強之方法的控制方案中所採用之一參考點。 FIG. 2 is a reference point used in a control scheme for a method for enhancing the viewing angle of a display panel according to an embodiment of the invention.

第3圖繪示該控制方案中所採用之一第一組參考點以及相關參數。 Figure 3 shows a first set of reference points and related parameters used in the control scheme.

第4圖繪示該控制方案中所採用之一第二組參考點以及目標區。 Figure 4 illustrates a second set of reference points and target areas used in the control scheme.

第5圖繪示該目標區之相關參數。 Figure 5 shows the relevant parameters of the target zone.

第6圖繪示該方法於一實施例中之一工作流程。 FIG. 6 illustrates a workflow of the method in an embodiment.

第7圖為依據本發明一實施例之一種電子裝置的示意圖。 FIG. 7 is a schematic diagram of an electronic device according to an embodiment of the invention.

第1圖為依據本發明一實施例之一種用來針對一顯示面板進行可視角增強之電子系統100的示意圖。電子系統100可包含一電子裝置101、一顯示裝置110、一深度攝像頭120以及一眼動追踪裝置130。電子裝置101可包含至少一 處理電路(例如一或多個處理電路),諸如處理電路102(其可執行程式碼104)以及影像處理電路106,且可包含至少一介面電路(例如一或多個介面電路),其可通稱為介面電路108,其中處理電路102可包含至少一處理器諸如中央處理器(Central Processing Unit,CPU)以及相關電路諸如記憶體等,而影像處理電路106可實施成獨立顯示卡,其可包含用於影像處理之至少一處理器,諸如圖形處理器(Graphics Processing Unit,GPU),且介面電路108可包含符合通用序列匯流排(Universal Serial Bus,USB)標準之介面電路,但本發明不限於此。電子裝置101的例子可包含(但不限於):個人電腦(Personal Computer,PC)諸如桌上型個人電腦(Desktop Computer)。 FIG. 1 is a schematic diagram of an electronic system 100 for enhancing viewing angle of a display panel according to an embodiment of the invention. The electronic system 100 may include an electronic device 101, a display device 110, a depth camera 120, and an eye tracking device 130. The electronic device 101 may include at least one Processing circuits (such as one or more processing circuits), such as the processing circuit 102 (which can execute the program code 104) and the image processing circuit 106, and may include at least one interface circuit (such as one or more interface circuits), which may be called It is an interface circuit 108, in which the processing circuit 102 may include at least one processor such as a central processing unit (CPU) and related circuits such as memory, etc., and the image processing circuit 106 may be implemented as an independent display card, which may include At least one processor for image processing, such as a graphics processing unit (GPU), and the interface circuit 108 may include an interface circuit conforming to the Universal Serial Bus (USB) standard, but the invention is not limited to this . Examples of the electronic device 101 may include (but are not limited to): a personal computer (Personal Computer, PC) such as a desktop personal computer (Desktop Computer).

另外,顯示裝置110可包含用來控制顯示裝置110之一控制電路112、用來將顯示裝置110耦接至電子裝置101(尤其,影像處理電路106)之一介面電路116、一數位-類比轉換電路118以及一顯示面板119(例如:液晶顯示面板),其中控制電路112可包含一時序控制器(Timing Controller)114,而介面電路116可包含多個子電路,諸如符合顯示埠(Display-Port,簡稱「DP」)標準之DP電路、符合高畫質多媒體介面(High Definition Multimedia Interface,簡稱「HDMI」)標準之HDMI電路、符合數位視訊介面(Digital Visual Interface,簡稱「DVI」)標準之DVI電路以及符合視訊圖形陣列(Video Graphics Array,簡稱「VGA」)標準之VGA電路。例如,顯示裝置110可為液晶顯示器諸如扭曲向列(Twisted Nematic,簡稱「TN」)液晶顯示器,而顯示面板119可為TN液晶面板。 In addition, the display device 110 may include a control circuit 112 for controlling the display device 110, an interface circuit 116 for coupling the display device 110 to the electronic device 101 (especially, the image processing circuit 106), and a digital-analog conversion The circuit 118 and a display panel 119 (for example: a liquid crystal display panel), wherein the control circuit 112 may include a timing controller 114, and the interface circuit 116 may include a plurality of sub-circuits, such as a display port (Display-Port, ("DP" for short) standard DP circuit, HDMI circuit for high definition multimedia interface (High Definition Multimedia Interface, "HDMI") standard, and DVI circuit for digital video interface ("DVI") standard And a VGA circuit conforming to the Video Graphics Array ("VGA") standard. For example, the display device 110 may be a liquid crystal display such as a twisted nematic (Twisted Nematic, "TN") liquid crystal display, and the display panel 119 may be a TN liquid crystal panel.

此外,深度攝像頭120可包含深度偵測模組(未顯示),而眼動追踪裝置130可包含一控制電路132(其可包含特殊應用積體電路(Application-Specific Integrated Circuit,ASIC)等),且包含至少一攝像頭(例如一或多個攝像頭),其可通稱為攝像頭134,尤其,深度攝像頭120可為具備輸出深度資訊的功能之攝像頭,而眼動追踪裝置130可為具備眼動追踪的功能之人機互動偵測裝置,其中 深度攝像頭120與眼動追踪裝置130可採用市場上既有的產品來實施,但本發明不限於此。 In addition, the depth camera 120 may include a depth detection module (not shown), and the eye tracking device 130 may include a control circuit 132 (which may include an application-specific integrated circuit (ASIC), etc.), And includes at least one camera (for example, one or more cameras), which may be commonly referred to as a camera 134. In particular, the depth camera 120 may be a camera with a function of outputting depth information, and the eye tracking device 130 may be an eye tracking device. Functional human-machine interactive detection device, in which The depth camera 120 and the eye-tracking device 130 can be implemented using existing products on the market, but the invention is not limited thereto.

依據本實施例,深度攝像頭120可用來拍攝使用者之至少一影像(例如:一或多個影像,其可包含使用者的臉部影像)且取得該使用者之深度資訊,並且眼動追踪裝置130可用來對該使用者進行眼動追踪。基於本發明之一種用來針對一顯示面板(諸如顯示面板119)進行可視角增強之方法,上述至少一處理電路(例如:處理電路102、及/或影像處理電路106)可控制電子裝置101之操作以及進行影像處理,尤其,可進行下列運作:依據上述至少一影像與該深度資訊來判斷該使用者是否位於顯示面板119之可視角範圍以外;當該使用者位於該可視角範圍以外時,利用眼動追踪裝置130對該使用者進行眼動追踪以決定顯示面板119之一顯示區中之一目標區;以及針對該目標區進行局部影像調整以產生顯示資料,以供顯示面板119顯示。舉例來說,為了減輕處理電路102的負荷,這些運作的大部分(甚至全部)可仰賴影像處理電路106來進行,其中處理電路102可進行其它控制(例如遊戲軟體的操作),但本發明不限於此。於某些實施例中,處理電路102與影像處理電路106可共同分攤這些運作的負荷。於某些實施例中,在沒有實施影像處理電路106的狀況下,這些運作可仰賴處理電路102來進行。 According to this embodiment, the depth camera 120 can be used to capture at least one image of the user (for example, one or more images, which can include the user's facial image) and obtain depth information of the user, and the eye tracking device 130 can be used for eye tracking of the user. Based on a method for enhancing the viewing angle of a display panel (such as the display panel 119) of the present invention, the at least one processing circuit (eg, the processing circuit 102, and/or the image processing circuit 106) can control the electronic device 101 Operation and image processing, in particular, the following operations can be performed: based on the at least one image and the depth information to determine whether the user is outside the viewing angle range of the display panel 119; when the user is outside the viewing angle range, The eye tracking device 130 is used to perform eye tracking on the user to determine a target area in a display area of the display panel 119; and local image adjustment is performed on the target area to generate display data for the display panel 119 to display. For example, in order to reduce the load on the processing circuit 102, most (or even all) of these operations can be performed by the image processing circuit 106, where the processing circuit 102 can perform other controls (such as the operation of game software), but the present invention does not Limited to this. In some embodiments, the processing circuit 102 and the image processing circuit 106 can share the load of these operations. In some embodiments, when the image processing circuit 106 is not implemented, these operations can be performed by the processing circuit 102.

為了便於理解,該深度資訊可包含該使用者的臉部與顯示面板119之間的距離Depth,而上述至少一處理電路(例如:處理電路102、及/或影像處理電路106)可依據上述至少一影像進行人臉偵測(face detectioh)以決定至少一參數(例如一或多個參數),且依據上述至少一參數與距離Depth來判斷該使用者是否位於顯示面板119之可視角範圍以外,並且,當該使用者位於該可視角範圍以外時,對該目標區中之多個像素分別進行亮度調整、對比度調整以及飽和度調整中之至少一者(例如:亮度調整、對比度調整、及/或飽和度調整), 以進行可視角增強,但本發明不限於此。舉例來說,上述至少一處理電路(例如:處理電路102、及/或影像處理電路106)可利用眼動追踪裝置130對該使用者進行眼動追踪以判斷該使用者的雙眼分別注視於該顯示區中之一組參考點,且依據該組參考點的座標值來決定該目標區對該顯示區之相對位置,其中該組參考點位於該目標區中。 For ease of understanding, the depth information may include the distance Depth between the user's face and the display panel 119, and the at least one processing circuit (eg, the processing circuit 102, and/or the image processing circuit 106) may be based on the above An image undergoes face detection (face detectioh) to determine at least one parameter (for example, one or more parameters), and determines whether the user is outside the viewing angle range of the display panel 119 according to the at least one parameter and the distance Depth. Moreover, when the user is outside the viewing angle range, at least one of brightness adjustment, contrast adjustment, and saturation adjustment is performed on the plurality of pixels in the target area (for example: brightness adjustment, contrast adjustment, and/or Or saturation adjustment), To enhance the viewing angle, the invention is not limited to this. For example, the at least one processing circuit (for example, the processing circuit 102 and/or the image processing circuit 106) may use the eye tracking device 130 to perform eye tracking on the user to determine whether the user's eyes are focused on A group of reference points in the display area, and the relative position of the target area to the display area is determined according to the coordinate values of the group of reference points, wherein the group of reference points is located in the target area.

第2圖為依據本發明一實施例之上述用來針對一顯示面板進行可視角增強之方法的控制方案中所採用之參考點IPD_CenterStandard,其中電子系統200、顯示裝置210、深度攝像頭220與眼動追踪裝置230可分別作為電子系統100、顯示裝置110、深度攝像頭120與眼動追踪裝置130的例子,而顯示裝置210的顯示面板(諸如TN液晶面板)的顯示區210D可作為顯示面板119之該顯示區的例子。顯示裝置210、深度攝像頭220與眼動追踪裝置230可被設置在一起,以容許該使用者同時面向顯示裝置210、深度攝像頭220與眼動追踪裝置230。例如深度攝像頭220與眼動追踪裝置230可分別位於顯示區210D的正上方與正下方,但本發明不限於此。於某些實施例中,深度攝像頭220與眼動追踪裝置230可分別位於顯示區210D的正下方與正上方。 FIG. 2 is the reference point IPD_Center Standard used in the control scheme for the method for enhancing the viewing angle of a display panel according to an embodiment of the present invention, in which the electronic system 200, the display device 210, the depth camera 220 and the eye The motion tracking device 230 can be used as an example of the electronic system 100, the display device 110, the depth camera 120, and the eye tracking device 130, respectively, and the display area 210D of the display panel of the display device 210 (such as a TN liquid crystal panel) can be used as the display panel 119. An example of this display area. The display device 210, the depth camera 220 and the eye-tracking device 230 may be provided together to allow the user to face the display device 210, the depth camera 220 and the eye-tracking device 230 at the same time. For example, the depth camera 220 and the eye tracking device 230 may be located directly above and below the display area 210D, but the invention is not limited thereto. In some embodiments, the depth camera 220 and the eye tracking device 230 may be located directly below and directly above the display area 210D.

為了便於理解,第2圖繪示了眼睛圖案以代表使用者的雙眼。假設使用者位於顯示區210D的正前方位置、且正在觀看顯示區210D。參考點IPD_CenterStandard可代表此狀況下使用者的雙眼之間的中心點,(例如:雙眼的瞳孔之連線的中心點,其可視為瞳距(Interpupillary distance,IPD)的中心點)。由於參考點IPD_CenterStandard位於可視角範圍以內,故上述至少一參數對應地指出此狀況。於是,上述至少一處理電路(例如:處理電路102、及/或影像處理電路106)可依據上述至少一影像進行人臉偵測以決定上述至少一參數,且據以判斷該使用者並非位於可視角範圍以外,且因此不需要觸發針對該目標區之局部影像調整,但本發明不限於此。 For ease of understanding, Figure 2 shows an eye pattern to represent the user's eyes. Assume that the user is located directly in front of the display area 210D and is watching the display area 210D. The reference point IPD_Center Standard can represent the center point between the two eyes of the user in this situation (for example: the center point of the pupil connection of the two eyes, which can be regarded as the center point of the interpupillary distance (IPD)). Since the reference point IPD_Center Standard is within the viewing angle range, at least one of the above parameters correspondingly indicates this situation. Therefore, the at least one processing circuit (for example, the processing circuit 102, and/or the image processing circuit 106) may perform face detection based on the at least one image to determine the at least one parameter, and determine that the user is not located Outside the viewing angle range, and therefore it is not necessary to trigger local image adjustment for the target area, but the invention is not limited to this.

第3圖繪示該控制方案中所採用之一第一組參考點{IPD_CenterStandard,IPD_Center}以及相關參數,諸如距離{LengthHorizontal,Depth}與角度θ,其中上述至少一參數可包含距離LengthHorizontal與角度θ。使用者位於顯示區210D的前方、且正在觀看顯示區210D,但並非位於顯示區210D的正前方位置。參考點IPD_Center可代表此狀況下使用者的雙眼之間的中心點(例如:雙眼的瞳孔之連線的上述中心點)。上述至少一處理電路(例如:處理電路102、及/或影像處理電路106)可依據上述至少一影像進行人臉偵測以決定上述至少一參數,且據以判斷該使用者是否位於可視角範圍以外,且可在判斷該使用者位於可視角範圍以外的狀況下觸發針對該目標區之局部影像調整。依據本實施例,上述至少一處理電路可進行人臉偵測,尤其依據上述至少一影像決定參考點{IPD_CenterStandard,IPD_Center}的位置以取得參考點{IPD_CenterStandard,IPD_Center}之間的距離LengthHorizontal,且依據距離Depth與LengthHorizontal計算人臉的目前位置(諸如參考點IPD_Center)偏離該正前方位置(諸如參考點{IPD_CenterStandard)的角度θ,如以下所示:

Figure 107131962-A0305-02-0010-1
其中上述至少一處理電路可透過上列方程式中之至少一者(例如方程式(1)、及/或(2))來進行關於角度θ之計算,以判斷人臉是否偏離該顯示面板(諸如TN液晶面板)之水平可視角(例如:170°;中心位置之左、右側各85°)的範圍之外。舉例來說,當θ>85°,上述至少一處理電路可判斷該使用者位於該顯示面板(諸如TN液晶面板)之可視角範圍以外;否則,上述至少一處理電路可判斷該使用者位於該顯示面板(諸如TN液晶面板)之可視角範圍中。 Figure 3 shows a first set of reference points {IPD_Center Standard , IPD_Center} and related parameters used in the control scheme, such as distance {Length Horizontal ,Depth} and angle θ, where at least one of the above parameters may include the distance Length Horizontal With angle θ. The user is located in front of the display area 210D and is looking at the display area 210D, but not directly in front of the display area 210D. The reference point IPD_Center can represent the center point between the eyes of the user in this situation (for example: the above-mentioned center point of the connection between the pupils of the two eyes). The at least one processing circuit (for example, the processing circuit 102 and/or the image processing circuit 106) may perform face detection based on the at least one image to determine the at least one parameter, and accordingly determine whether the user is within a viewable range In addition, the local image adjustment for the target area can be triggered under the condition that the user is judged to be outside the viewing angle range. According to this embodiment, the at least one processing circuit can perform face detection, and in particular determine the position of the reference point {IPD_Center Standard ,IPD_Center} based on the at least one image to obtain the distance between the reference points {IPD_Center Standard ,IPD_Center} Length Horizontal , And calculate the angle θ of the current position of the face (such as the reference point IPD_Center) from the front position (such as the reference point {IPD_Center Standard ) according to the distance Depth and Length Horizontal , as shown below:
Figure 107131962-A0305-02-0010-1
The at least one processing circuit can calculate the angle θ through at least one of the above equations (eg, equation (1), and/or (2)) to determine whether the human face deviates from the display panel (such as TN The horizontal viewing angle of the LCD panel (for example: 170°; 85° on the left and right of the center position) is outside the range. For example, when θ>85°, the at least one processing circuit may determine that the user is outside the viewing angle range of the display panel (such as a TN liquid crystal panel); otherwise, the at least one processing circuit may determine that the user is located at the The viewing angle range of the display panel (such as a TN liquid crystal panel).

於本實施例中,可假設使用者於看影片或玩遊戲的過程中幾乎不會 將其頭部朝上或朝下移動。於是,上述至少一處理電路可僅針對水平方向的偏移進行可視角增強,但本發明不限於此。於某些實施例中,上述至少一處理電路可針對垂直方向、及/或水平方向的偏移進行可視角增強。 In this embodiment, it can be assumed that the user hardly Move its head up or down. Therefore, the above-mentioned at least one processing circuit can only enhance the viewing angle for the horizontal offset, but the invention is not limited thereto. In some embodiments, the at least one processing circuit may enhance the viewing angle for the vertical and/or horizontal offsets.

第4圖繪示該控制方案中所採用之一第二組參考點{310,320}以及目標區300,其中目標區300以及該第二組參考點{310,320}可分別作為上述目標區以及該組參考點的例子。參考點310與320可分別代表使用者的左眼與右眼注視於顯示區210D中的位置,諸如座標(xL,yL)與(xR,yR)的位置,其中xL與yL分別代表參考點310的座標(xL,yL)中之x座標值與y座標值,而xR與yR分別代表參考點320的座標(xR,yR)中之x座標值與y座標值。如第4圖所示,目標區300可包含參考點310與320以及其附近的像素。舉例來說,為了不影響到使用者所注視的局部影像以外的影像品質,目標區300可包含分別從參考點310與320起向周圍延伸PR個像素所佔的區域,諸如(xL-PR,yL+PR)、(xL-PR,yL-PR)、(xR+PR,yR+PR)以及(xR+PR,yR-PR)所圍起來的矩形,但本發明不限於此。 Figure 4 shows a second set of reference points {310, 320} and a target zone 300 used in the control scheme, wherein the target zone 300 and the second set of reference points {310, 320} can be used as the target zone and the set of references, respectively Point example. The reference points 310 and 320 may represent the positions of the user's left and right eyes looking at the display area 210D, such as the positions of the coordinates (x L , y L ) and (x R , y R ), where x L and y L represents the x coordinate value and y coordinate value in the coordinates (x L , y L ) of the reference point 310 respectively, and x R and y R represent the x coordinate value in the coordinates (x R , y R ) of the reference point 320 respectively With y coordinate value. As shown in FIG. 4, the target area 300 may include reference points 310 and 320 and pixels near them. For example, in order not to affect the image quality other than the local image that the user is looking at, the target area 300 may include areas occupied by PR pixels extending from the reference points 310 and 320 respectively, such as (x L -PR , y L +PR), (x L -PR, y L -PR), (x R +PR, y R +PR), and (x R +PR, y R -PR) The invention is not limited to this.

第5圖繪示目標區300之相關參數,諸如分別對應於其四個角的四組座標值(xL-15,yL+15)、(xL-15,yL-15)、(xR+15,yR+15)以及(xR+15,yR-15),其中第4圖所示顯示區210D的左下角可被定義為原點,但本發明不限於此。於本實施例中,PR=15,這表示所要增強的像素範圍可包含分別從參考點310與320起向周圍延伸15個像素所佔的區域,諸如(xL-15,yL+15)、(xL-15,yL-15)、(xR+15,yR+15)以及(xR+15,yR-15)所圍起來的矩形,但本發明不限於此。於某些實施例中,PR可取代為其它數值,且目標區300的大小可對應地調整。 Figure 5 shows the relevant parameters of the target area 300, such as four sets of coordinate values (x L -15, y L +15), (x L -15, y L -15), ( x R + 15, y R +15 ) and (x R + 15, y R -15), wherein the lower left corner of the display region shown in FIG. 4 210D may be defined as the origin, but the present invention is not limited thereto. In this embodiment, PR=15, which means that the range of pixels to be enhanced may include the area occupied by 15 pixels extending from the reference points 310 and 320 respectively, such as (x L -15, y L +15) , (X L -15, y L -15), (x R +15, y R +15), and (x R +15, y R -15), but the invention is not limited thereto. In some embodiments, PR can be replaced with other values, and the size of the target area 300 can be adjusted accordingly.

第6圖繪示該方法於一實施例中之一工作流程600。工作流程600可應用於第1圖所示電子系統100,諸如第2圖至第4圖所示電子系統200,但本發明不限於此。 FIG. 6 illustrates a workflow 600 of the method in an embodiment. The workflow 600 can be applied to the electronic system 100 shown in FIG. 1, such as the electronic system 200 shown in FIGS. 2 to 4, but the invention is not limited thereto.

於步驟S61中,上述至少一處理電路(例如:處理電路102、及/或 影像處理電路106)可利用深度攝像頭120(例如深度攝像頭220)進行人臉偵測以決定人臉偏離參數諸如上述至少一參數(例如距離LengthHorizontal與角度θ)。 In step S61, the at least one processing circuit (for example: the processing circuit 102, and/or the image processing circuit 106) may utilize the depth camera 120 (for example, the depth camera 220) to perform face detection to determine the face deviation parameters such as the above A parameter (for example, distance horizontal and angle θ).

於步驟S62中,依據上述至少一參數諸如角度θ,上述至少一處理電路(例如:處理電路102、及/或影像處理電路106)可判斷使用者觀看顯示面板119(例如:顯示裝置210的顯示面板,諸如TN液晶面板)的角度θ是否超過對應的可視角範圍(諸如85°)。依據本實施例,上述至少一處理電路可依據角度θ是否超過對應的可視角範圍(諸如85°)來判斷該使用者是否位於可視角範圍以外。當θ>85°(這表示該使用者位於顯示面板119之可視角範圍以外),進入步驟S63;否則(這表示該使用者位於顯示面板119之可視角範圍中),步驟S67。 In step S62, based on the at least one parameter such as the angle θ, the at least one processing circuit (for example: the processing circuit 102, and/or the image processing circuit 106) can determine that the user views the display panel 119 (for example: the display of the display device 210 Whether the angle θ of a panel, such as a TN liquid crystal panel, exceeds the corresponding viewing angle range (such as 85°). According to this embodiment, the at least one processing circuit may determine whether the user is outside the viewing angle range according to whether the angle θ exceeds the corresponding viewing angle range (such as 85°). When θ>85° (this indicates that the user is outside the viewing angle range of the display panel 119), step S63 is entered; otherwise (this indicates that the user is within the viewing angle range of the display panel 119), step S67.

於步驟S63中,上述至少一處理電路(例如:處理電路102、及/或影像處理電路106)可利用眼動追踪裝置130(例如:眼動追踪裝置230)進行眼球位置偵測以決定該顯示區中之該目標區(諸如顯示區210D中之目標區300),以供進行局部影像調整。例如,該眼球位置偵測之偵測結果指出該使用者左眼與右眼正分別注視著參考點310與320。於是,上述至少一處理電路可依據參考點310與320各自的座標(xL,yL)與(xR,yR)來決定目標區300的位置,諸如第5圖所示相關參數所指出之位置。 In step S63, the at least one processing circuit (for example: the processing circuit 102, and/or the image processing circuit 106) may use the eye tracking device 130 (for example: the eye tracking device 230) to detect the eyeball position to determine the display The target area in the area (such as the target area 300 in the display area 210D) for local image adjustment. For example, the detection result of the eyeball position detection indicates that the user's left and right eyes are looking at reference points 310 and 320, respectively. Therefore, the at least one processing circuit may determine the position of the target area 300 according to the coordinates (x L , y L ) and (x R , y R ) of the reference points 310 and 320, such as indicated by the relevant parameters shown in FIG. 5 The location.

於步驟S64中,上述至少一處理電路(例如:處理電路102、及/或影像處理電路106)可檢查該目標區(諸如目標區300)的位置是否改變,尤其,可透過檢查參考點310與320各自的座標(xL,yL)與(xR,yR)是否改變來判斷目標區300的位置是否改變。當目標區300的位置改變(例如,使用者注視的位置有變動,以致座標(xL,yL)與(xR,yR)中之至少一者(諸如座標(xL,yL)、及/或(xR,yR))於步驟S63中剛剛被改變了),進入步驟S65;否則(例如,使用者注視的位置完全沒有變動,沒有造成座標(xL,yL)與(xR,yR)於步驟S63中被改變),進入步驟S66。 In step S64, the at least one processing circuit (for example: the processing circuit 102, and/or the image processing circuit 106) can check whether the position of the target area (such as the target area 300) has changed, in particular, by checking the reference point 310 and Whether the respective coordinates (x L , y L ) and (x R , y R ) of 320 change to determine whether the position of the target area 300 changes. When the position of the target zone 300 changes (for example, the position of the user's gaze changes, so that at least one of the coordinates (x L , y L ) and (x R , y R ) (such as the coordinates (x L , y L ) , And/or (x R , y R )) has just been changed in step S63), go to step S65; otherwise (for example, the position of the user's gaze has not changed at all, and the coordinates (x L , y L ) and (x R , y R ) is changed in step S63), proceed to step S66.

於步驟S65中,上述至少一處理電路(例如:處理電路102、及/或 影像處理電路106)可取消局部影像調整,尤其,將施加於該目標區(諸如目標區300)的先前位置之局部影像調整設定復原為正常狀態,以避免局部影像調整被錯誤地施加在使用者最新注視的範圍以外。 In step S65, the at least one processing circuit (for example: the processing circuit 102, and/or The image processing circuit 106) can cancel the local image adjustment, in particular, restore the local image adjustment setting applied to the previous position of the target area (such as the target area 300) to a normal state, so as to prevent the partial image adjustment from being erroneously applied to the user The latest gaze is out of range.

於步驟S66中,上述至少一處理電路(例如:處理電路102、及/或影像處理電路106)可對該目標區(諸如目標區300)進行局部影像調整。依據本實施例,上述至少一處理電路可計算目標區300的平均亮度AVG以決定該局部影像調整之影像調整參數,尤其,可依據下列方程式來進行該局部影像調整:

Figure 107131962-A0305-02-0013-2
其中Total_Pixel代表目標區300的總像素數,Pixeli,j-Brightness代表目標區300中之像素Pixeli,j的亮度,Pixel_start與Pixel_end分別代表在加總運算Σ中之開始像素與結束像素(諸如目標區300中之第一個像素與最後一個像素),Pixeli,j-Saturation代表像素Pixeli,j的飽和度,1.1、1.08與1.2可作為該些影像調整參數的例子,而運算子「*=」代表對前面的像素資料(例如Pixeli,j-Brightness或Pixeli,j-Saturation)的原數值乘以後面的影像調整參數(諸如1.1或1.2)以產生一調整結果作為此像素資料之最新的數值,並且運算子「/=」代表對前面的像素資料(例如Pixeli,j-Brightness)的原數值除以後面的影像調整參數(諸如1.08)以產生一調整結果作為此像素資料之最新的數值,但本發明不限於此。 In step S66, the at least one processing circuit (for example, the processing circuit 102 and/or the image processing circuit 106) can perform local image adjustment on the target area (such as the target area 300). According to this embodiment, the at least one processing circuit may calculate the average brightness AVG of the target area 300 to determine the image adjustment parameters of the local image adjustment. In particular, the local image adjustment may be performed according to the following equation:
Figure 107131962-A0305-02-0013-2
Where Total_Pixel represents the total number of pixels in the target area 300, Pixel i, j-Brightness represents the brightness of the pixels Pixel i, j in the target area 300, Pixel_start and Pixel_end represent the start pixel and end pixel (such as The first pixel and the last pixel in the target area 300), Pixel i, j-Saturation represents the saturation of the pixel Pixel i, j , 1.1, 1.08 and 1.2 can be used as examples of these image adjustment parameters, and the operator "*='' represents the original value of the previous pixel data (such as Pixel i, j-Brightness or Pixel i, j-Saturation ) multiplied by the subsequent image adjustment parameters (such as 1.1 or 1.2) to generate an adjustment result as this pixel data The latest value, and the operator "/=" represents the original value of the previous pixel data (such as Pixel i, j-Brightness ) divided by the subsequent image adjustment parameters (such as 1.08) to generate an adjustment result as this pixel data The latest value, but the invention is not limited to this.

依據本實施例,上述至少一處理電路可於步驟S66中對目標區300進行亮度調整、對比度調整以及飽和度調整,以進行可視角增強,尤其,可依據平均亮度AVG選擇性地進行亮度調整與對比度調整。如方程式(3)所示,上述至 少一處理電路可對標區300中之全部的像素{Pixeli,j}的亮度{Pixeli,j-Brightness}進行加總運算Σ、且將加總運算Σ的總和除以總像素數Total_Pixel以產生平均亮度AVG。另外,方程式(4)至(7)代表對像素Pixeli,j的像素資料(例如Pixeli,j-Brightness與Pixeli,j-Saturation)進行調整之虛擬程式碼(以C語言為例,以便於理解)。方程式(4)至(7)指出:若亮度Pixeli,j-Brightness大於平均亮度AVG,則將亮度Pixeli,j-Brightness調整為其原數值的1.1倍;若亮度Pixeli,j-Brightness小於平均亮度AVG,則將亮度Pixeli,j-Brightness調整為其原數值的(1/1.08)倍;若亮度Pixeli,j-Brightness等於平均亮度AVG,則將亮度Pixeli,j-Brightness維持不變;以及將飽和度Pixeli,j-Saturation調整為其原數值的1.2倍。此外,當使用者的雙眼所注視的位置改變時,上述至少一處理電路可於步驟S65中預先將該些影像調整參數(諸如1.1、1.08與1.2)還原成正常的數值(諸如1.00),以於步驟S66中針對目標區300的最新位置進行亮度調整、對比度調整以及飽和度調整。 According to this embodiment, the at least one processing circuit can perform brightness adjustment, contrast adjustment, and saturation adjustment on the target area 300 in step S66 to enhance the viewing angle. In particular, the brightness adjustment and the brightness can be selectively adjusted according to the average brightness AVG Contrast adjustment. As shown in equation (3), the above-mentioned at least one processing circuit can perform a summation operation Σ on all the pixels {Pixel i, j } brightness {Pixel i, j-Brightness } in the target area 300, and the summation operation The sum of Σ is divided by the total number of pixels Total_Pixel to produce the average brightness AVG. In addition, equations (4) to (7) represent the virtual code (using the C language as an example) to adjust the pixel data of the pixel Pixel i, j (such as Pixel i, j-Brightness and Pixel i, j-Saturation ). For understanding). Equations (4) to (7) indicate that if the brightness Pixel i, j-Brightness is greater than the average brightness AVG, the brightness Pixel i, j-Brightness is adjusted to 1.1 times its original value; if the brightness Pixel i, j-Brightness is less than Average brightness AVG, adjust brightness Pixel i,j-Brightness to (1/1.08) times of its original value; if brightness Pixel i,j-Brightness is equal to average brightness AVG, then maintain brightness Pixel i,j-Brightness not Change; and adjust the saturation Pixel i, j-Saturation to 1.2 times its original value. In addition, when the position of the eyes of the user changes, the at least one processing circuit may previously restore the image adjustment parameters (such as 1.1, 1.08, and 1.2) to normal values (such as 1.00) in step S65, In step S66, brightness adjustment, contrast adjustment, and saturation adjustment are performed for the latest position of the target area 300.

於步驟S67中,上述至少一處理電路(例如:處理電路102、及/或影像處理電路106)可檢查局部影像調整是否已取消,尤其,檢查該些影像調整參數(諸如1.1、1.08與1.2)是否已被還原成正常的數值(諸如1.00)。當局部影像調整已取消,進入步驟S61;否則,步驟S68。 In step S67, the at least one processing circuit (for example: the processing circuit 102, and/or the image processing circuit 106) can check whether the local image adjustment has been canceled, and in particular, check the image adjustment parameters (such as 1.1, 1.08, and 1.2) Whether it has been restored to a normal value (such as 1.00). When the partial image adjustment has been cancelled, step S61 is entered; otherwise, step S68.

於步驟S68中,上述至少一處理電路(例如:處理電路102、及/或影像處理電路106)可取消局部影像調整,尤其,將該些影像調整參數(諸如1.1、1.08與1.2)還原成正常的數值(諸如1.00)。 In step S68, the at least one processing circuit (for example: the processing circuit 102, and/or the image processing circuit 106) can cancel the local image adjustment, and in particular, restore the image adjustment parameters (such as 1.1, 1.08, and 1.2) to normal Value (such as 1.00).

基於該方法,電子系統100(諸如電子系統200)能提升該目標區(諸如目標區300)的亮度、對比度及飽和度,讓使用者在各種角度觀看顯示面板119(例如:顯示裝置210的顯示面板,諸如TN液晶面板)時影像品質得以保持良好,以確保很好的使用者體驗。 Based on this method, the electronic system 100 (such as the electronic system 200) can increase the brightness, contrast, and saturation of the target area (such as the target area 300), allowing the user to view the display panel 119 (eg, the display of the display device 210) at various angles Panel, such as TN LCD panel), the image quality can be maintained to ensure a good user experience.

第7圖為依據本發明一實施例之一種電子裝置700的示意圖,其中電 子裝置700中之處理電路702、程式碼704、影像處理電路706、介面電路708、顯示裝置710、控制電路712、時序控制器714、介面電路716、顯示面板719、深度攝像頭720、眼動追踪裝置730、控制電路732與攝像頭734可分別類似於電子系統100中之處理電路102、程式碼104、影像處理電路106、介面電路108、顯示裝置110、控制電路112、時序控制器114、介面電路116、顯示面板119、深度攝像頭120、眼動追踪裝置130、控制電路132與攝像頭134,但本發明不限於此。相較於第1圖所示架構,第7圖中之顯示裝置710、深度攝像頭720與眼動追踪裝置730已被整合至電子裝置700中。電子裝置700的例子可包含(但不限於):個人電腦(Personal Computer,PC)諸如膝上型個人電腦(laptop computer)。本實施例與前述實施例相仿的內容在此不重複贅述。以上所述僅為本發明之較佳實施例,凡依本發明申請專利範圍所做之均等變化與修飾,皆應屬本發明之涵蓋範圍。 FIG. 7 is a schematic diagram of an electronic device 700 according to an embodiment of the present invention, in which Processing circuit 702, program code 704, image processing circuit 706, interface circuit 708, display device 710, control circuit 712, timing controller 714, interface circuit 716, display panel 719, depth camera 720, eye tracking in the sub-device 700 The device 730, the control circuit 732 and the camera 734 may be similar to the processing circuit 102, the code 104, the image processing circuit 106, the interface circuit 108, the display device 110, the control circuit 112, the timing controller 114, the interface circuit in the electronic system 100, respectively 116. The display panel 119, the depth camera 120, the eye tracking device 130, the control circuit 132, and the camera 134, but the invention is not limited thereto. Compared with the architecture shown in FIG. 1, the display device 710, the depth camera 720 and the eye tracking device 730 in FIG. 7 have been integrated into the electronic device 700. Examples of the electronic device 700 may include (but are not limited to): a personal computer (Personal Computer, PC) such as a laptop personal computer (laptop computer). The content of this embodiment that is similar to the foregoing embodiment will not be repeated here. The above are only the preferred embodiments of the present invention, and all changes and modifications made in accordance with the scope of the patent application of the present invention shall fall within the scope of the present invention.

100‧‧‧電子系統 100‧‧‧Electronic system

101‧‧‧電子裝置 101‧‧‧Electronic device

102‧‧‧處理電路 102‧‧‧ processing circuit

104‧‧‧程式碼 104‧‧‧Code

106‧‧‧影像處理電路 106‧‧‧Image processing circuit

108,116‧‧‧介面電路 108,116‧‧‧Interface circuit

110‧‧‧顯示裝置 110‧‧‧Display device

112,132‧‧‧控制電路 112,132‧‧‧Control circuit

114‧‧‧時序控制器 114‧‧‧ Timing controller

118‧‧‧數位-類比轉換電路 118‧‧‧Digital-to-analog conversion circuit

119‧‧‧顯示面板 119‧‧‧Display panel

120‧‧‧深度攝像頭 120‧‧‧Depth camera

130‧‧‧眼動追踪裝置 130‧‧‧Eye tracking device

134‧‧‧攝像頭 134‧‧‧camera

Claims (10)

一種用來針對一顯示面板進行可視角增強(viewing-angle enhancement)之電子系統,包含:一深度攝像頭(Depth Camera),用來拍攝一使用者之至少一影像且取得該使用者之深度資訊;一眼動追踪裝置(Eye-tracking Device),用來對該使用者進行眼動追踪(Eye Tracking);以及一電子裝置,耦接至該深度攝像頭與該眼動追踪裝置,其中該電子裝置包含:至少一處理電路,用來控制該電子裝置之操作以及進行影像處理,其中該至少一處理電路依據該至少一影像與該深度資訊來判斷該使用者是否位於該顯示面板之可視角範圍以外,以及當該使用者位於該可視角範圍以外時,該至少一處理電路利用該眼動追踪裝置對該使用者進行眼動追踪以決定該顯示面板之一顯示區中之一目標區,以及針對該目標區進行局部影像調整以產生顯示資料,以供該顯示面板顯示。 An electronic system for viewing-angle enhancement of a display panel includes: a depth camera for capturing at least one image of a user and obtaining depth information of the user; An Eye-tracking Device is used to perform Eye Tracking on the user; and an electronic device is coupled to the depth camera and the Eye Tracking Device, wherein the electronic device includes: At least one processing circuit for controlling the operation of the electronic device and performing image processing, wherein the at least one processing circuit determines whether the user is outside the viewing angle range of the display panel according to the at least one image and the depth information, and When the user is outside the viewable range, the at least one processing circuit uses the eye tracking device to perform eye tracking on the user to determine a target area in a display area of the display panel and for the target The area performs local image adjustment to generate display data for display on the display panel. 如申請專利範圍第1項所述之電子系統,其中該深度資訊包含該使用者的臉部與該顯示面板之間的距離;以及該至少一處理電路依據該至少一影像進行人臉偵測(face detection)以決定至少一參數,且依據該至少一參數與該距離來判斷該使用者是否位於該顯示面板之可視角範圍以外。 The electronic system as described in item 1 of the patent application, wherein the depth information includes the distance between the user's face and the display panel; and the at least one processing circuit performs face detection based on the at least one image ( face detection) to determine at least one parameter and determine whether the user is outside the viewing angle range of the display panel according to the at least one parameter and the distance. 如申請專利範圍第1項所述之電子系統,其中該至少一處理電路利用該眼動追踪裝置對該使用者進行眼動追踪以判斷該使用者的雙眼分別注 視於該顯示區中之一組參考點,且依據該組參考點的座標值來決定該目標區對該顯示區之相對位置,其中該組參考點位於該目標區中。 The electronic system as described in item 1 of the patent application scope, wherein the at least one processing circuit uses the eye-tracking device to perform eye-tracking on the user to determine the eyes of the user It is regarded as a group of reference points in the display area, and the relative position of the target area to the display area is determined according to the coordinate value of the group of reference points, wherein the group of reference points is located in the target area. 如申請專利範圍第1項所述之電子系統,其中該至少一處理電路對該目標區中之多個像素分別進行亮度調整、對比度調整以及飽和度調整中之至少一者,以進行可視角增強。 The electronic system as described in item 1 of the patent scope, wherein the at least one processing circuit performs at least one of brightness adjustment, contrast adjustment, and saturation adjustment on the plurality of pixels in the target area, respectively, to enhance the viewing angle . 如申請專利範圍第1項所述之電子系統,另包含:一顯示裝置,耦接至該電子裝置,其中該顯示裝置包含該顯示面板,且該顯示裝置、該深度攝像頭與該眼動追踪裝置被設置在一起,以容許該使用者同時面向該顯示裝置、該深度攝像頭與該眼動追踪裝置。 The electronic system as described in item 1 of the patent application scope further includes: a display device coupled to the electronic device, wherein the display device includes the display panel, and the display device, the depth camera and the eye tracking device It is set together to allow the user to face the display device, the depth camera, and the eye tracking device at the same time. 一種用來針對一顯示面板進行可視角增強(viewing-angle enhancement)之電子裝置,包含:一深度攝像頭(Depth Camera),用來拍攝一使用者之至少一影像且取得該使用者之深度資訊;一眼動追踪裝置(Eye-tracking Device),用來對該使用者進行眼動追踪(Eye Tracking);以及至少一處理電路,耦接至該深度攝像頭與該眼動追踪裝置,用來控制該電子裝置之操作以及進行影像處理,其中該至少一處理電路依據該至少一影像與該深度資訊來判斷該使用者是否位於該顯示面板之可視角範圍以外,以及當該使用者位於該可視角範圍以外時,該至少一處理電路利用該眼動追踪裝置對該使用者進行眼動追踪以決定該顯示面板之一顯示區中之一目標區,以及針對該目標區進行局部影像 調整以產生顯示資料,以供該顯示面板顯示。 An electronic device for viewing-angle enhancement of a display panel includes: a depth camera, which is used to capture at least one image of a user and obtain depth information of the user; An Eye-tracking Device is used to perform Eye Tracking on the user; and at least one processing circuit is coupled to the depth camera and the Eye-tracking device to control the electronic Device operation and image processing, wherein the at least one processing circuit determines whether the user is outside the viewing angle range of the display panel based on the at least one image and the depth information, and when the user is outside the viewing angle range At this time, the at least one processing circuit uses the eye tracking device to perform eye tracking on the user to determine a target area in a display area of the display panel, and to perform a partial image on the target area Adjust to generate display data for the display panel to display. 如申請專利範圍第6項所述之電子裝置,其中該深度資訊包含該使用者的臉部與該顯示面板之間的距離;以及該至少一處理電路依據該至少一影像進行人臉偵測(face detection)以決定至少一參數,且依據該至少一參數與該距離來判斷該使用者是否位於該顯示面板之可視角範圍以外。 The electronic device as described in item 6 of the patent application, wherein the depth information includes the distance between the user's face and the display panel; and the at least one processing circuit performs face detection based on the at least one image ( face detection) to determine at least one parameter and determine whether the user is outside the viewing angle range of the display panel according to the at least one parameter and the distance. 如申請專利範圍第6項所述之電子裝置,其中該至少一處理電路利用該眼動追踪裝置對該使用者進行眼動追踪以判斷該使用者的雙眼分別注視於該顯示區中之一組參考點,且依據該組參考點的座標值來決定該目標區對該顯示區之相對位置,其中該組參考點位於該目標區中。 The electronic device as described in item 6 of the patent application range, wherein the at least one processing circuit uses the eye tracking device to perform eye tracking on the user to determine that the user's eyes are respectively focusing on one of the display areas A group of reference points, and the relative position of the target area to the display area is determined according to the coordinate value of the group of reference points, wherein the group of reference points is located in the target area. 如申請專利範圍第6項所述之電子裝置,其中該至少一處理電路對該目標區中之多個像素分別進行亮度調整、對比度調整以及飽和度調整中之至少一者,以進行可視角增強。 The electronic device as described in item 6 of the patent application range, wherein the at least one processing circuit performs at least one of brightness adjustment, contrast adjustment, and saturation adjustment on the plurality of pixels in the target area, respectively, to enhance the viewing angle . 如申請專利範圍第6項所述之電子裝置,另包含:一顯示裝置,耦接至該至少一處理電路,其中該顯示裝置包含該顯示面板,且該顯示裝置、該深度攝像頭與該眼動追踪裝置被設置在一起,以容許該使用者同時面向該顯示裝置、該深度攝像頭與該眼動追踪裝置。 The electronic device as described in item 6 of the patent application scope further includes: a display device coupled to the at least one processing circuit, wherein the display device includes the display panel, and the display device, the depth camera and the eye movement The tracking devices are arranged together to allow the user to face the display device, the depth camera and the eye tracking device at the same time.
TW107131962A 2018-09-12 2018-09-12 Electronic system and electronic device for performing viewing-angle enhancement regarding display panel TWI683302B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
TW107131962A TWI683302B (en) 2018-09-12 2018-09-12 Electronic system and electronic device for performing viewing-angle enhancement regarding display panel

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
TW107131962A TWI683302B (en) 2018-09-12 2018-09-12 Electronic system and electronic device for performing viewing-angle enhancement regarding display panel

Publications (2)

Publication Number Publication Date
TWI683302B true TWI683302B (en) 2020-01-21
TW202011377A TW202011377A (en) 2020-03-16

Family

ID=69942592

Family Applications (1)

Application Number Title Priority Date Filing Date
TW107131962A TWI683302B (en) 2018-09-12 2018-09-12 Electronic system and electronic device for performing viewing-angle enhancement regarding display panel

Country Status (1)

Country Link
TW (1) TWI683302B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112967696A (en) * 2021-03-22 2021-06-15 北海惠科光电技术有限公司 Liquid crystal panel display parameter adjusting method and system, liquid crystal panel and storage medium

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI757736B (en) * 2020-05-06 2022-03-11 天擎積體電路股份有限公司 Conversion device for converting black-white or gray-level frame to color display, and electronic device and color display device using the same
TWI757880B (en) * 2020-05-06 2022-03-11 天擎積體電路股份有限公司 Data conversion circuit for converting black-white or gray-level frame to color display panel/ module, and electronic device and color display device using the same

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI279585B (en) * 2005-03-17 2007-04-21 Epson Imaging Devices Corp Image display
TW201347513A (en) * 2012-02-01 2013-11-16 Sony Corp Method of adjusting pixel height in display panel having sub-pixelized pixels capable of operating in at least tall mode and short mode and television display device
TWI449421B (en) * 2010-12-31 2014-08-11 Altek Corp Method for displaying multiple views by using multi-lens apparatus
TW201823804A (en) * 2016-12-20 2018-07-01 宏碁股份有限公司 Wide view angle head mounted display

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI279585B (en) * 2005-03-17 2007-04-21 Epson Imaging Devices Corp Image display
TWI449421B (en) * 2010-12-31 2014-08-11 Altek Corp Method for displaying multiple views by using multi-lens apparatus
TW201347513A (en) * 2012-02-01 2013-11-16 Sony Corp Method of adjusting pixel height in display panel having sub-pixelized pixels capable of operating in at least tall mode and short mode and television display device
TW201823804A (en) * 2016-12-20 2018-07-01 宏碁股份有限公司 Wide view angle head mounted display

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112967696A (en) * 2021-03-22 2021-06-15 北海惠科光电技术有限公司 Liquid crystal panel display parameter adjusting method and system, liquid crystal panel and storage medium

Also Published As

Publication number Publication date
TW202011377A (en) 2020-03-16

Similar Documents

Publication Publication Date Title
TWI704501B (en) Electronic apparatus operated by head movement and operation method thereof
TWI413979B (en) Method for adjusting displayed frame, electronic device, and computer program product thereof
CN101499253B (en) Output screen adjustment method and device
CN106531073B (en) Processing circuit, display methods and the display device of display screen
EP2075761B1 (en) Method and device for adjusting output frame
WO2015149554A1 (en) Display control method and display control apparatus
TWI683302B (en) Electronic system and electronic device for performing viewing-angle enhancement regarding display panel
TWI745955B (en) Augmented reality system and anchor display method thereof
CN110850958B (en) System and device for dimple simulation and computer readable storage device
CN110300994A (en) Image processing device, image processing method, and image system
US10762691B2 (en) Techniques for compensating variable display device latency in image display
US20250254281A1 (en) Electronic Device that Displays Virtual Objects
CN105988556A (en) Electronic device and display adjustment method for electronic device
US20230111826A1 (en) Device and method for foveated rendering
CN106293417A (en) Screen-picture display packing and device
CN115985209A (en) Wearable display device, control method, device, electronic device and storage medium
JP6849826B2 (en) Image processing device and display image generation method
WO2023000598A1 (en) Frame rate adjustment method and system for augmented reality device, and device and storage medium
CN110858095A (en) Electronic device that can be controlled by head and its operation method
CN117170556A (en) Image processing equipment, image processing method and storage medium
US9536133B2 (en) Display apparatus and control method for adjusting the eyes of a photographed user
US20230177879A1 (en) Videoconference iris position adjustments
TW201717177A (en) Display device and display method
TW201913622A (en) Variable DPI across a display and control thereof
CN106775527A (en) Adjust method, device and the display device of the display parameters of display panel

Legal Events

Date Code Title Description
MM4A Annulment or lapse of patent due to non-payment of fees