[go: up one dir, main page]

TWI772108B - Computational display and operating method thereof - Google Patents

Computational display and operating method thereof Download PDF

Info

Publication number
TWI772108B
TWI772108B TW110126142A TW110126142A TWI772108B TW I772108 B TWI772108 B TW I772108B TW 110126142 A TW110126142 A TW 110126142A TW 110126142 A TW110126142 A TW 110126142A TW I772108 B TWI772108 B TW I772108B
Authority
TW
Taiwan
Prior art keywords
block
target blocks
target
display
decomposition
Prior art date
Application number
TW110126142A
Other languages
Chinese (zh)
Other versions
TW202305776A (en
Inventor
黃朝宗
陳立得
Original Assignee
瑞鼎科技股份有限公司
國立清華大學
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 瑞鼎科技股份有限公司, 國立清華大學 filed Critical 瑞鼎科技股份有限公司
Priority to TW110126142A priority Critical patent/TWI772108B/en
Priority to CN202111319314.4A priority patent/CN115701100B/en
Application granted granted Critical
Publication of TWI772108B publication Critical patent/TWI772108B/en
Publication of TW202305776A publication Critical patent/TW202305776A/en

Links

Images

Landscapes

  • Control Of Indicators Other Than Cathode Ray Tubes (AREA)
  • Indication In Cameras, And Counting Of Exposures (AREA)
  • Image Processing (AREA)
  • Liquid Crystal Display Device Control (AREA)

Abstract

A computational display and an operating method thereof are disclosed. The computational display includes an image dividing module, a decomposition calculating module, a block combining module and a display module. The image dividing module is used to divide an initial light-field image into a plurality of target blocks. The decomposition calculating module is coupled to the image dividing module and used to independently apply a decomposition algorithm to each of the plurality of target blocks. The block combining module is coupled to the decomposition calculating module and used to combine the plurality of target blocks into a result light-field image. The display module including multi-layer display units is coupled to the block combining module and used to display result light-field image.

Description

計算型顯示器及其運作方法Computational display and method of operation

本發明係與顯示器有關,尤其是關於一種計算型顯示器及其運作方法。The present invention relates to displays, and more particularly, to a computing display and a method of operation thereof.

近年來,隨著顯示器技術之演進,計算式顯示器例如多層液晶分解式顯示器(Multi-layer LCD Factorized Display)能夠擴展例如更廣的動態範圍以及更廣的色域等應用,尤其是分解式光場顯示器,因其在空間、視角解析度、顯示亮度、組成體積等各方面均明顯優於傳統的光場顯示器,受到廣泛的矚目。In recent years, with the evolution of display technology, computational displays such as Multi-layer LCD Factorized Displays can expand applications such as wider dynamic range and wider color gamut, especially factorized light fields Displays have attracted widespread attention because they are significantly superior to traditional light field displays in terms of space, viewing angle resolution, display brightness, and composition volume.

與傳統的光場顯示器不同的是,當多層液晶分解式光場顯示器顯示光場影像之前,需先將該光場影像分解為多層液晶分解式光場顯示器之每一層液晶上播放之內容。Different from the traditional light field display, before the multi-layer liquid crystal decomposed light field display displays the light field image, the light field image needs to be decomposed into the content played on each layer of liquid crystal of the multi-layer liquid crystal decomposed light field display.

然而,由於可攜式電子產品已廣泛應用於大眾的日常生活當中,若欲將多層液晶分解式光場顯示器應用於可攜式電子產品時,將會面臨到由於可攜式電子產品的記憶體限制(例如內建記憶體(On-chip memory)容量有限不敷需求,而外部記憶體(Off-chip memory)受限於存取頻寬)而導致光場影像分解之效率不佳,嚴重影響多層液晶分解式光場顯示器的顯示效能,故亟待克服。However, since portable electronic products have been widely used in the daily life of the public, if the multi-layer liquid crystal decomposed light field display is to be applied to portable electronic products, it will be faced with the problem of the memory of the portable electronic products. Limitations (such as the limited capacity of the built-in memory (On-chip memory) cannot meet the demand, and the external memory (Off-chip memory) is limited by the access bandwidth), resulting in poor efficiency of light field image decomposition, which seriously affects The display performance of the multi-layer liquid crystal split light field display needs to be overcome urgently.

有鑑於此,本發明提出一種計算型顯示器及其運作方法,以有效解決先前技術所遭遇到之上述問題。In view of this, the present invention provides a computing display and an operation method thereof to effectively solve the above-mentioned problems encountered in the prior art.

依據本發明之一具體實施例為一種計算型顯示器。於此實施例中,計算型顯示器包括影像分割模組、分解演算模組、區塊結合模組及顯示模組。影像分割模組用以將初始光場影像分割為多個目標區塊。分解演算模組耦接影像分割模組,用以將分解演算法獨立應用於該多個目標區塊中之每一個目標區塊上。區塊結合模組耦接分解演算模組,用以結合該多個目標區塊為結果光場影像。顯示模組包括多層顯示單元且耦接區塊結合模組,用以顯示結果光場影像。One embodiment according to the present invention is a computing display. In this embodiment, the computing display includes an image segmentation module, a decomposition calculation module, a block combination module and a display module. The image segmentation module is used for segmenting the initial light field image into a plurality of target blocks. The decomposition algorithm module is coupled to the image segmentation module, and is used for independently applying the decomposition algorithm to each target block of the plurality of target blocks. The block combination module is coupled to the decomposition calculation module, and is used for combining the plurality of target blocks into a resultant light field image. The display module includes a multi-layer display unit and is coupled to the block combining module for displaying the resulting light field image.

於一實施例中,計算型顯示器為多層液晶分解式顯示器(Multi-layer LCD Factorized Display)且該多層顯示單元中之至少一層顯示單元為液晶層。In one embodiment, the computing display is a multi-layer LCD factorized display and at least one display unit of the multi-layer display units is a liquid crystal layer.

於一實施例中,分解演算模組採用的分解演算法為區塊式分解演算法,分解演算模組包括:非對稱更新單元,用以限縮該多個目標區塊中的更新範圍,以非對稱更新方式來執行區塊式分解演算法,致使多個目標區塊的分解結果無分解瑕疵。In one embodiment, the decomposition algorithm adopted by the decomposition calculation module is a block decomposition algorithm, and the decomposition calculation module includes: an asymmetric update unit, used to limit the update range in the plurality of target blocks to The block-based decomposition algorithm is implemented in an asymmetric update method, so that the decomposition results of multiple target blocks are free of decomposition defects.

於一實施例中,非對稱更新單元係將該多個目標區塊中之一目標區塊分為更新區域(Update Region)及參考區域(Reference Region),並在對目標區塊執行區塊式分解演算法時僅更新更新區域而不更新參考區域。In one embodiment, the asymmetric update unit divides one target block of the plurality of target blocks into an update region (Update Region) and a reference region (Reference Region), and executes the block-based method on the target block. When decomposing the algorithm, only the update region is updated and not the reference region.

於一實施例中,該多個目標區塊中之任兩相鄰目標區塊的更新區域彼此不重疊且其參考區域彼此重疊。In one embodiment, the update regions of any two adjacent target blocks in the plurality of target blocks do not overlap with each other and the reference regions thereof overlap with each other.

於一實施例中,分解演算模組採用的分解演算法為區塊式分解演算法,分解演算模組包括:外部迭代(Inter-Block Iteration)單元,用以對該多個目標區塊進行外部迭代,致使該多個目標區塊中之任兩相鄰目標區塊在經過多次迭代後仍能維持邊界一致。In one embodiment, the decomposition algorithm adopted by the decomposition calculation module is a block decomposition algorithm, and the decomposition calculation module includes: an external iterative (Inter-Block Iteration) unit for performing external processing on the plurality of target blocks. Iterating, so that any two adjacent target blocks in the plurality of target blocks can still maintain the same boundary after multiple iterations.

於一實施例中,外部迭代單元係重複巡迴每一個目標區塊進行外部迭代,且外部迭代包括每一個目標區塊各自的內部迭代(Intra-Block Iteration),致使先被更新的目標區塊能夠參考到已更新完畢的相鄰目標區塊而維持兩者的邊界一致。In one embodiment, the external iterative unit repeatedly tours each target block to perform external iteration, and the external iteration includes the respective internal iteration (Intra-Block Iteration) of each target block, so that the target block updated first can be The boundaries of the two are kept consistent with reference to the updated adjacent target blocks.

於一實施例中,外部迭代單元係透過外部記憶體(Outer Memory)與區塊記憶體(Block memory)之間的加載(Load)及儲存(Store)來實現對該多個目標區塊進行外部迭代。In one embodiment, the external iterative unit implements external execution of the plurality of target blocks by loading and storing between the outer memory and the block memory. iterate.

於一實施例中,外部記憶體的容量大於區塊記憶體的容量,影像分割模組所分割出的該多個目標區塊係儲存於外部記憶體,分解演算模組將該多個目標區塊從外部記憶體加載至區塊記憶體以進行分解演算。In one embodiment, the capacity of the external memory is greater than the capacity of the block memory, the target blocks divided by the image segmentation module are stored in the external memory, and the decomposition calculation module is used to store the target blocks. Blocks are loaded from external memory into block memory for decomposition calculations.

於一實施例中,分解演算模組適用於記憶體容量受限制的嵌入式系統(Embedded System)。In one embodiment, the decomposition algorithm module is suitable for an embedded system with limited memory capacity.

依據本發明之另一具體實施例為一種計算型顯示器運作方法。於此實施例中,計算型顯示器運作方法用以運作計算型顯示器。計算型顯示器運作方法包括下列步驟:(a)將初始光場影像分割為多個目標區塊;(b)將分解演算法獨立應用於該多個目標區塊之每一個目標區塊上;(c)結合該多個目標區塊為結果光場影像;以及(d)顯示結果光場影像。Another embodiment according to the present invention is a method for operating a computing display. In this embodiment, the computing display operation method is used to operate the computing display. The operation method of the computational display comprises the following steps: (a) dividing an initial light field image into a plurality of target blocks; (b) applying a decomposition algorithm to each target block of the plurality of target blocks independently; ( c) combining the plurality of target blocks into a resulting light field image; and (d) displaying the resulting light field image.

於一實施例中,計算型顯示器為多層液晶分解式顯示器且該多層顯示單元中之至少一層顯示單元為液晶層。In one embodiment, the computing display is a multi-layer liquid crystal decomposition display and at least one display unit of the multi-layer display units is a liquid crystal layer.

於一實施例中,分解演算法為區塊式分解演算法,計算型顯示器運作方法還包括:限縮該多個目標區塊中的更新範圍,以非對稱更新方式來執行區塊式分解演算法,致使該多個目標區塊的分解結果無分解瑕疵。In one embodiment, the decomposition algorithm is a block decomposition algorithm, and the operation method of the computational display further includes: narrowing the update range of the plurality of target blocks, and executing the block decomposition algorithm in an asymmetric update manner method, so that the decomposition results of the multiple target blocks are free of decomposition defects.

於一實施例中,計算型顯示器運作方法還包括:將該多個目標區塊中之一目標區塊分為更新區域及參考區域;以及在對目標區塊執行區塊式分解演算法時僅更新更新區域而不更新參考區域。In one embodiment, the computing display operation method further includes: dividing one target block of the plurality of target blocks into an update area and a reference area; and performing a block-based decomposition algorithm on the target block only Update the update area without updating the reference area.

於一實施例中,該多個目標區塊中之任兩相鄰目標區塊的更新區域彼此不重疊且其參考區域彼此重疊。In one embodiment, the update regions of any two adjacent target blocks in the plurality of target blocks do not overlap with each other and the reference regions thereof overlap with each other.

於一實施例中,分解演算法為區塊式分解演算法,計算型顯示器運作方法包括:對該多個目標區塊進行外部迭代,致使該多個目標區塊中之任兩相鄰目標區塊在經過多次迭代後仍能維持邊界一致。In one embodiment, the decomposition algorithm is a block decomposition algorithm, and the operation method of the computational display includes: performing external iteration on the plurality of target blocks, so that any two adjacent target areas in the plurality of target blocks are formed. Blocks remain bounded consistent across multiple iterations.

於一實施例中,計算型顯示器運作方法係重複巡迴每一個目標區塊進行外部迭代,且外部迭代包括每一個目標區塊各自的內部迭代,致使先被更新的目標區塊能夠參考到已更新完畢的相鄰目標區塊而維持兩者的邊界一致。In one embodiment, the computational display operation method repeats iterating through each target block for external iteration, and the external iteration includes the respective internal iteration of each target block, so that the target block updated first can refer to the updated target block. The completed adjacent target blocks maintain the same boundary between the two.

於一實施例中,計算型顯示器運作方法係透過外部記憶體與區塊記憶體之間的加載及儲存來實現對該多個目標區塊進行外部迭代。In one embodiment, the computing display operating method implements external iteration on the plurality of target blocks through loading and storing between external memory and block memory.

於一實施例中,外部記憶體的容量大於區塊記憶體的容量,步驟(a)所分割出的該多個目標區塊係儲存於外部記憶體,在步驟(b)之前先將該多個目標區塊從外部記憶體加載至區塊記憶體以進行分解演算。In one embodiment, the capacity of the external memory is greater than the capacity of the block memory, the target blocks divided in step (a) are stored in the external memory, and the target blocks are stored in the external memory before step (b). A target block is loaded from external memory to block memory for decomposition calculation.

於一實施例中,分解演算法適用於記憶體容量受限制的嵌入式系統。In one embodiment, the decomposition algorithm is suitable for embedded systems with limited memory capacity.

相較於先前技術,本發明的計算型顯示器及其運作方法採用區塊式分解演算法來處理光場影像以有效解決因為可攜式電子產品的記憶體限制所導致光場影像分解效率不佳的問題,故可提升多層液晶分解式光場顯示器的顯示效能且可適用於記憶體容量受限制的嵌入式系統。此外,為了避免區塊式分解演算法產生,本發明的計算型顯示器及其運作方法還分別提出區塊定義方法及區塊式分解的更新方法來避免區塊式分解演算法在邊界處產生邊界分解瑕疵與邊界不一致的區塊效應(Blocky effect)。Compared with the prior art, the computing display and its operation method of the present invention use a block-based decomposition algorithm to process the light field image, so as to effectively solve the problem of poor light field image decomposition efficiency due to the memory limitation of portable electronic products Therefore, the display performance of the multi-layer liquid crystal split light field display can be improved and it can be applied to embedded systems with limited memory capacity. In addition, in order to avoid the generation of the block-based decomposition algorithm, the computing display and the operation method thereof of the present invention further propose a block definition method and a block-based decomposition update method to avoid the block-based decomposition algorithm from generating boundaries at the boundaries Decomposes the Blocky effect of flaws and boundary inconsistencies.

關於本發明之優點與精神可以藉由以下的發明詳述及所附圖式得到進一步的瞭解。The advantages and spirit of the present invention can be further understood from the following detailed description of the invention and the accompanying drawings.

現在將詳細參考本發明的示範性實施例,並在附圖中說明所述示範性實施例的實例。在圖式及實施方式中所使用相同或類似標號的元件/構件是用來代表相同或類似部分。Reference will now be made in detail to the exemplary embodiments of the present invention, examples of which are illustrated in the accompanying drawings. Elements/components using the same or similar numbers in the drawings and the embodiments are intended to represent the same or similar parts.

依據本發明之一具體實施例為一種計算型顯示器。於此實施例中,計算型顯示器可以是任何一種分解式顯示器,例如多層液晶分解式顯示器(Multi-layer LCD Factorized Display),並且其多層顯示單元可包括至少一液晶層且可包括一背光層,但不以此為限。One embodiment according to the present invention is a computing display. In this embodiment, the computing display may be any kind of factorized display, such as a multi-layer LCD factorized display, and the multi-layer display unit may include at least one liquid crystal layer and may include a backlight layer, But not limited to this.

請參照圖1,圖1繪示此實施例中之計算型顯示器的功能方塊圖。如圖1所示,計算型顯示器1包括影像分割模組10、區塊加載模組12、分解演算模組14、區塊儲存模組16、區塊結合模組18及顯示模組19。影像分割模組10耦接區塊加載模組12。區塊加載模組12耦接分解演算模組14。分解演算模組14耦接區塊儲存模組16。區塊儲存模組16耦接區塊結合模組18。區塊結合模組18耦接顯示模組19。Please refer to FIG. 1 , which is a functional block diagram of the computing display in this embodiment. As shown in FIG. 1 , the computing display 1 includes an image segmentation module 10 , a block loading module 12 , a decomposition calculation module 14 , a block storage module 16 , a block combination module 18 and a display module 19 . The image splitting module 10 is coupled to the block loading module 12 . The block loading module 12 is coupled to the decomposition calculation module 14 . The decomposition calculation module 14 is coupled to the block storage module 16 . The block storage module 16 is coupled to the block combination module 18 . The block combining module 18 is coupled to the display module 19 .

當影像分割模組10接收到光場資料LFD及初始多幀多層分解影像M0時,影像分割模組10用以根據光場資料LFD將初始多幀多層分解影像M0分割為多個目標區塊並可將其儲存於記憶體中。詳細而言,初始多幀多層分解影像M0中之每一層分解影像分別被分割為多個分解影像區塊,而每一層分解影像中之相對應的分解影像區塊共同形成一光場影像區塊。When the image segmentation module 10 receives the light field data LFD and the initial multi-frame multi-layer decomposed image M0, the image segmentation module 10 is used for dividing the initial multi-frame multi-layer decomposed image M0 into a plurality of target blocks according to the light field data LFD. It can be stored in memory. In detail, each layer of decomposed images in the initial multi-frame multi-layer decomposed images M0 is divided into a plurality of decomposed image blocks, and the corresponding decomposed image blocks in each layer of decomposed images together form a light field image block .

接著,區塊加載模組12再將儲存於記憶體中的該多個目標區塊加載至分解演算模組14,並由分解演算模組14將區塊式分解演算法獨立應用於該多個目標區塊中之每一個目標區塊上,待完成分解演算後將該多個目標區塊的分解結果儲存於區塊儲存模組16。區塊結合模組18用以將該多個目標區塊的分解結果結合為結果多幀多層分解影像M1。顯示模組19包括多層顯示單元(其中至少一層顯示單元為液晶層),用以顯示結果多幀多層分解影像M1。Next, the block loading module 12 loads the plurality of target blocks stored in the memory into the decomposition calculation module 14, and the decomposition calculation module 14 applies the block decomposition algorithm to the plurality of independent calculation modules. On each of the target blocks, after the decomposition calculation is completed, the decomposition results of the plurality of target blocks are stored in the block storage module 16 . The block combining module 18 is used for combining the decomposition results of the target blocks into a multi-frame multi-layer decomposition image M1. The display module 19 includes multi-layer display units (at least one layer of the display units is a liquid crystal layer) for displaying the resultant multi-frame multi-layer decomposed images M1.

如圖2及圖3所示,本發明採用的運算平台CP包括區塊記憶體BM及處理器PR。處理器PR與區塊記憶體BM彼此耦接。運算平台CP透過匯流排BUS與外部記憶體BUS耦接。於此實施例中,外部記憶體BUS可用以儲存多個幀的幀內容且運算平台CP的區塊記憶體BM可用以儲存該多個目標區塊的區塊內容,並由處理器PR對該多個目標區塊進行迭代乘法更新。As shown in FIG. 2 and FIG. 3 , the computing platform CP used in the present invention includes a block memory BM and a processor PR. The processor PR and the block memory BM are coupled to each other. The computing platform CP is coupled to the external memory BUS through the bus bar BUS. In this embodiment, the external memory BUS can be used to store the frame contents of a plurality of frames and the block memory BM of the computing platform CP can be used to store the block contents of the plurality of target blocks, which is processed by the processor PR. Multiple target blocks are iteratively multiplied to update.

實際上,本發明採用的運算平台CPF可包括現場可程式化邏輯閘陣列(Field Programmable Gate Array, FPGA)電路或特殊應用積體電路(Application Specific Integrated Circuit, ASIC),用以實現加速運算的效果,但不以此為限。In fact, the computing platform CPF used in the present invention may include a Field Programmable Gate Array (FPGA) circuit or an Application Specific Integrated Circuit (ASIC) to achieve the effect of accelerating computing , but not limited to this.

需說明的是,本發明所採用的區塊式分解演算法與傳統的分解演算法之差異處在於:先將初始多幀多層光場影像切割為多個目標區塊後,再將區塊式分解演算法獨立應用於該多個目標區塊上,最後再將每個目標區塊的分解結果結合為結果多幀多層光場影像。It should be noted that the difference between the block-based decomposition algorithm used in the present invention and the traditional decomposition algorithm is that the initial multi-frame multi-layer light field image is cut into a plurality of target blocks, and then the block-based decomposition algorithm is divided into multiple target blocks. The decomposition algorithm is independently applied to the plurality of target blocks, and finally the decomposition results of each target block are combined into a resultant multi-frame multi-layer light field image.

於實際應用中,當每一個目標區塊開始運算前,其可從外部記憶體OM被加載至運算平台CP的區塊記憶體BM。外部記憶體OM與區塊記憶體BM的實例依據不同的運算平台CP而異。在記憶體階層上,通常外部記憶體OM的容量較大,可以儲存完整的光場影像與分解影像(亦即幀內容),但存取時頻寬較低。區塊記憶體BM的容量較小,僅可儲存一個目標區塊的內容(亦即區塊內容),但其能較快速地被執行運算的處理器PR存取,故可有效提升區塊式分解演算法的執行效率。In practical applications, before each target block starts to operate, it can be loaded from the external memory OM to the block memory BM of the computing platform CP. Examples of the external memory OM and the block memory BM vary according to different computing platforms CP. On the memory level, the external memory OM usually has a larger capacity and can store complete light field images and decomposed images (ie, frame contents), but has a low access bandwidth. The block memory BM has a small capacity and can only store the content of one target block (that is, the block content), but it can be accessed by the processor PR that performs the operation more quickly, so it can effectively improve the block type. The execution efficiency of the decomposition algorithm.

在運算平台CP上進行多次迭代乘法更新運算後,區塊記憶體BM中的目標區塊被更新的內容會經由匯流排BUS被寫回至外部記憶體OM中,接著,再加載下一個目標區塊並執行對應的運算,其餘可依此類推。於此運算架構下,迭代過程中不需重複讀取外部記憶體OM中的資料,從而有效降低區塊式分解演算法對於整體記憶體存取之需求,同時亦可降低等待記憶體存取之時間以及頻繁存取外部記憶體OM造成的額外功耗。After multiple iterative multiplication update operations are performed on the computing platform CP, the updated content of the target block in the block memory BM will be written back to the external memory OM via the bus BUS, and then the next target will be loaded. block and perform the corresponding operation, and the rest can be deduced by analogy. Under this computing architecture, it is not necessary to repeatedly read the data in the external memory OM during the iterative process, thereby effectively reducing the block-based decomposition algorithm's requirement for overall memory access, and also reducing the waiting time for memory access. time and additional power consumption caused by frequent access to external memory OM.

需說明的是,由於直接應用區塊式分解演算法可能會導致例如目標區塊的分解瑕疵與相鄰目標區塊的邊界不一致等區塊效應,在視覺上呈現為不連續之影像瑕疵,因此,本發明提出下列作法來解決此一問題。It should be noted that, since the direct application of the block-based decomposition algorithm may cause block effects such as the inconsistency between the decomposition defect of the target block and the boundary of the adjacent target blocks, it will appear as discontinuous image defects visually. , the present invention proposes the following methods to solve this problem.

首先,圖1中之計算型顯示器1的分解演算模組14可包括非對稱更新單元(圖未示),其可用以限縮該多個目標區塊中的更新範圍,以非對稱更新方式來執行區塊式分解演算法,致使多個目標區塊的分解結果無分解瑕疵。First, the decomposition calculation module 14 of the computing display 1 in FIG. 1 may include an asymmetric update unit (not shown in the figure), which can be used to limit the update range in the plurality of target blocks, in an asymmetric update manner. Execute the block-based decomposition algorithm, so that the decomposition results of multiple target blocks are free of decomposition defects.

舉例而言,如圖4所示,顯示影像DM中的目標區塊B0可被定義出更新區域UR與參考區域RR,並可透過非對稱更新(例如僅更新更新區域UR而不更新參考區域RR)的方式來執行區塊式分解演算法,藉以有效解決目標區塊B0之邊界處因為與傳統的分解演算法定義不符而導致的分解瑕疵。For example, as shown in FIG. 4 , the target block B0 in the display image DM can be defined as an update area UR and a reference area RR, and can be updated through asymmetrical updating (for example, only the update area UR is updated without updating the reference area RR) ) to execute the block-based decomposition algorithm, so as to effectively solve the decomposition defects at the boundary of the target block B0 due to the inconsistency with the definition of the traditional decomposition algorithm.

需說明的是,於此實施例中,在顯示影像DM中,兩相鄰的目標區塊B0及B1中的更新區域UR彼此並不重疊,但兩者的參考區域RR彼此有所重疊,但不以此為限。於另一實施例中,兩相鄰的目標區塊B0及B1中的更新區域UR亦可彼此重疊。It should be noted that, in this embodiment, in the display image DM, the update regions UR in the two adjacent target blocks B0 and B1 do not overlap each other, but the reference regions RR of the two overlap each other, but Not limited to this. In another embodiment, the update regions UR in the two adjacent target blocks B0 and B1 may also overlap with each other.

亦請參照圖5,圖5繪示進行非對稱更新時外部記憶體OM與區塊記憶體BM之間的加載(Load)及儲存(Store)的示意圖。如圖5所示,對於顯示影像DM之每一個目標區塊進行非對稱更新的流程可包括下列步驟(a)至(d):Please also refer to FIG. 5 . FIG. 5 is a schematic diagram of Load and Store between the external memory OM and the block memory BM when an asymmetric update is performed. As shown in FIG. 5 , the process of performing asymmetric update for each target block of the display image DM may include the following steps (a) to (d):

(a)將顯示影像DM之目標區塊(例如B0)加載至區塊記憶體BM,其中目標區塊包含更新區域UR及參考區域RR;(a) loading the target block (eg B0) of the display image DM into the block memory BM, wherein the target block includes the update area UR and the reference area RR;

(b)依照預設的迭代更新次數對該目標區塊執行區塊式分解演算法,其中在運算過程中,該目標區塊僅有更新區域UR的內容會被更新,至於其參考區域RR內的內容由於加載的部分不足以代表完整的定義,故不會被更新而僅作為運算參考之用;(b) performing a block-based decomposition algorithm on the target block according to a preset number of iterative updates, wherein in the operation process, only the content of the update region UR of the target block will be updated, as for the reference region RR in the target block The content of the loaded part is not enough to represent the complete definition, so it will not be updated but only used as a reference for the operation;

(c)將該目標區塊的更新區域UR被更新的內容儲存至外部記憶體OM;以及(c) storing the updated content of the update area UR of the target block to the external memory OM; and

(d)將下一個目標區塊(例如B1)加載至區塊記憶體BM,並重複上述步驟(a)至(c)。(d) Load the next target block (eg B1 ) into the block memory BM, and repeat the above steps (a) to (c).

需說明的是,上述實施例可採用完全加載(Full load)與部分儲存(Partial store)的方式來有效降低區塊式分解演算法對於整體記憶體存取之需求。至於該多個目標區塊的更新順序可如同圖6所示為B0、B1、…,但不以此為限。It should be noted that, in the above-mentioned embodiments, a full load and a partial store can be adopted to effectively reduce the requirement of the block-based decomposition algorithm for overall memory access. The update sequence of the plurality of target blocks may be B0, B1, . . . as shown in FIG. 6, but not limited thereto.

上述實施例可實現於記憶體受限的嵌入式系統上。假設實現一個對7x7x1920x1080大小光場的區塊式分解加速器並設定迭代次數為100次。相較於傳統的分解演算法,本實施例可降低100倍的DRAM頻寬需求,並可使用頻寬僅69千位元組(Kbytes)的晶片內建記憶體(On-chip-memory),使得本發明的區塊式分解演算法能夠運行在記憶體容量受限制的嵌入式系統上。The above-described embodiments can be implemented on memory-constrained embedded systems. Suppose a block-based decomposition accelerator for a 7x7x1920x1080 light field is implemented and the number of iterations is set to 100. Compared with the traditional decomposition algorithm, this embodiment can reduce the DRAM bandwidth requirement by 100 times, and can use the on-chip memory (On-chip-memory) with a bandwidth of only 69 kilobytes (Kbytes). This enables the block-based decomposition algorithm of the present invention to run on an embedded system with limited memory capacity.

此外,本實施例採用上述非對稱更新方式執行區塊式分解演算法可有效消除目標區塊之邊界處的影像瑕疵,在測試影像上,相較於採用傳統的對稱更新方式,其影像品質的峰值訊雜比(Peak Signal-to-Noise Ratio, PSNR)平均可提升約10分貝(dB)。In addition, the implementation of the block-based decomposition algorithm using the asymmetric update method in this embodiment can effectively eliminate image defects at the boundary of the target block. Compared with the traditional symmetrical update method, the image quality of the test image is improved. Peak Signal-to-Noise Ratio (PSNR) can be improved by about 10 decibels (dB) on average.

基於上述實施例,由於當原始影像被切割為多個目標區塊後,無論以何種順序進行更新,後更新的目標區塊均會參考已更新的目標區塊。舉例而言,在圖6所示的區塊更新順序中,後更新的區塊B1會參考區塊B0已更新的部分。反之,先更新的目標區塊則會參考未被更新過的隨機起始內容。因此,區塊式分解演算法仍可能會在邊界處遭遇不一致的情形,導致視覺上之區塊效應。Based on the above-mentioned embodiment, after the original image is divided into a plurality of target blocks, no matter in which order the update is performed, the target block updated later will refer to the target block that has been updated. For example, in the block update sequence shown in FIG. 6 , the later updated block B1 refers to the updated part of the block B0 . On the contrary, the target block updated first will refer to the random starting content that has not been updated. Therefore, the block decomposition algorithm may still encounter inconsistencies at the boundaries, resulting in visual block effects.

為了避免上述問題,本發明提出外部迭代更新的方式來使得目標區塊的邊界處能夠保持一致。舉例而言,圖1中之計算型顯示器1的分解演算模組14還可包括外部迭代(Inter-Block Iteration)單元(圖未示),用以對該多個目標區塊進行外部迭代,致使該多個目標區塊中之任兩相鄰目標區塊在經過多次迭代後仍能維持邊界一致。In order to avoid the above problems, the present invention proposes an external iterative update method to keep the boundaries of the target blocks consistent. For example, the decomposition calculation module 14 of the computational display 1 in FIG. 1 may further include an external iterative (Inter-Block Iteration) unit (not shown) for performing external iteration on the plurality of target blocks, resulting in Any two adjacent target blocks in the plurality of target blocks can still maintain the same boundary after multiple iterations.

請參照圖7,圖7繪示重複巡迴每一個目標區塊進行外部迭代的示意圖。如圖7所示,本發明可將整體運算的迭代更新分為內部迭代(Intra-block iteration)及外部迭代,其中「內部迭代」係代表在運算平台CP上之處理器PR對被加載至區塊記憶體BM的單一目標區塊執行區塊式分解演算法的迭代更新,而「外部迭代」則代表重複巡迴該多個目標區塊中之每一個目標區塊。換言之,一個外部迭代包括每一個目標區塊各自的內部迭代,其亦係透過外部記憶體OM與區塊記憶體BM之間的加載及儲存來實現之。於此運算模式下,在後續的外部迭代中,先被更新的目標區塊將會有機會參考到已更新完畢的相鄰目標區塊,從而達到較理想的更新結果,使得任兩相鄰目標區塊的邊界能保持一致。Please refer to FIG. 7 . FIG. 7 is a schematic diagram of repeatedly iterating through each target block to perform external iteration. As shown in FIG. 7 , the present invention can divide the iterative update of the overall operation into an inner iteration (Intra-block iteration) and an outer iteration, where “intra-block iteration” means that the processor PR pair on the computing platform CP is loaded into the region A single target block of the block memory BM performs the iterative update of the block-based decomposition algorithm, and "outer iteration" means to repeatedly tour each of the plurality of target blocks. In other words, an external iteration includes the respective internal iteration of each target block, which is also implemented through loads and stores between the external memory OM and the block memory BM. In this operation mode, in subsequent external iterations, the target block that is updated first will have the opportunity to refer to the adjacent target block that has been updated, so as to achieve an ideal update result, so that any two adjacent target blocks can be Block boundaries can remain consistent.

舉例而言,本發明可先依照光場影像重建品質需求預設內部迭代次數與外部迭代次數,並以隨機值初始化分解影像。接著,本發明可執行下列步驟(e)至(h),直至達到外部迭代次數為止:For example, the present invention can first preset the number of internal iterations and the number of external iterations according to the light field image reconstruction quality requirements, and initialize the decomposed image with random values. Next, the present invention can perform the following steps (e) to (h) until the number of external iterations is reached:

(e)依照更新順序從外部記憶體OM加載一個目標區塊至運算平台CP上之區塊記憶體BM;(e) load a target block from the external memory OM to the block memory BM on the computing platform CP according to the update sequence;

(f)針對該目標區塊執行區塊式分解演算法的迭代更新,直至內部迭代結束為止;(f) performing the iterative update of the block decomposition algorithm for the target block until the end of the internal iteration;

(g)將該目標區塊被更新的內容儲存至外部記憶體OM;以及(g) storing the updated content of the target block in the external memory OM; and

(h)加載下一個目標區塊並重複上述步驟(e)至(g),直至最後一個目標區塊的內部迭代結束為止。(h) Load the next target block and repeat steps (e) to (g) above until the end of the inner iteration of the last target block.

上述實施例可實現於記憶體受限的嵌入式系統上。假設實現一個對7x7x1920x1080大小光場的區塊式分解加速器並設定迭代次數為2次外部迭代與50次內部迭代。The above-described embodiments can be implemented on memory-constrained embedded systems. Suppose to implement a block-based decomposition accelerator for a 7x7x1920x1080 light field and set the number of iterations to 2 outer iterations and 50 inner iterations.

相較於傳統的分解演算法,本實施例可降低50倍的DRAM頻寬需求,並可使用頻寬僅69千位元組(Kbytes)的晶片內建記憶體(On-chip-memory),使得本發明的區塊式分解演算法能夠運行在記憶體容量受限制的嵌入式系統上。Compared with the traditional decomposition algorithm, the present embodiment can reduce the DRAM bandwidth requirement by 50 times, and can use the on-chip memory (On-chip-memory) with a bandwidth of only 69 kilobytes (Kbytes). This enables the block-based decomposition algorithm of the present invention to run on an embedded system with limited memory capacity.

在相同運算量下,雖然此實施例由於設定的外部迭代次數導致其可節省的DRAM頻寬低於上述採用非對稱更新方式的實施例,但此實施例進一步採用外部迭代的作法能夠有效消除相鄰目標區塊的邊界不一致問題。在測試影像上,相較於同樣計算量的採用非對稱更新方式的實施例,此實施例進一步採用外部迭代所獲得的影像品質的峰值訊雜比(PSNR)平均可提升約2分貝(dB)。Under the same calculation amount, although the DRAM bandwidth that can be saved in this embodiment is lower than that of the above-mentioned embodiment using the asymmetric update method due to the set number of external iterations, this embodiment further adopts the external iteration method to effectively eliminate the phase difference. The boundary inconsistency of adjacent target blocks. On the test image, compared with the embodiment using the asymmetric update method with the same amount of calculation, the image quality obtained by this embodiment further adopts the external iteration, and the peak signal-to-noise ratio (PSNR) of the image quality can be improved by about 2 decibels (dB) on average. .

依據本發明之另一具體實施例為一種計算型顯示器運作方法。於此實施例中,計算型顯示器運作方法可適用於任何一種分解式顯示器,例如多層液晶分解式顯示器,並且其多層顯示單元中之至少一層顯示單元為液晶層,但不以此為限。Another embodiment according to the present invention is a method for operating a computing display. In this embodiment, the operation method of the computing display can be applied to any decomposition type display, such as a multi-layer liquid crystal decomposition type display, and at least one display unit of the multi-layer display units is a liquid crystal layer, but not limited thereto.

請參照圖8,圖8繪示此實施例中之計算型顯示器運作方法的流程圖。如圖8所示,計算型顯示器運作方法可包括下列步驟:Please refer to FIG. 8 . FIG. 8 is a flowchart illustrating an operation method of the computing display in this embodiment. As shown in FIG. 8, the operation method of the computing display may include the following steps:

步驟S10:將初始光場影像分割為多個目標區塊;Step S10: dividing the initial light field image into multiple target blocks;

步驟S12:將分解演算法獨立應用於該多個目標區塊之每一個目標區塊上;Step S12: independently applying the decomposition algorithm to each target block of the plurality of target blocks;

步驟S14:結合該多個目標區塊為結果光場影像;以及Step S14: combining the plurality of target blocks into a resulting light field image; and

步驟S16:顯示結果光場影像。Step S16: Display the resulting light field image.

於實際應用中,步驟S12所採用的分解演算法為區塊式分解演算法,其可適用於記憶體容量受限制的嵌入式系統,並且本發明的計算型顯示器運作方法還可限縮該多個目標區塊中的更新範圍,以非對稱更新方式來執行區塊式分解演算法,致使該多個目標區塊的分解結果無分解瑕疵的區塊效應,但不以此為限。In practical applications, the decomposition algorithm used in step S12 is a block decomposition algorithm, which can be applied to embedded systems with limited memory capacity, and the computing display operation method of the present invention can also limit the number of partitions. For the update range in each target block, the block-based decomposition algorithm is performed in an asymmetric update manner, so that the decomposition results of the plurality of target blocks have no block effect of decomposition defects, but not limited thereto.

需說明的是,為了避免區塊式分解演算法在邊界處產生邊界不一致的區塊效應,本發明的計算型顯示器運作方法可將該多個目標區塊中之一目標區塊分為更新區域及參考區域,並且在對該目標區塊執行區塊式分解演算法時僅更新更新區域而不更新參考區域,但不以此為限。It should be noted that, in order to avoid the block effect with inconsistent borders caused by the block decomposition algorithm, the computing display operation method of the present invention can divide one target block of the plurality of target blocks into an update area. and the reference area, and when the block-based decomposition algorithm is performed on the target block, only the update area is updated without updating the reference area, but not limited to this.

於一實施例中,該多個目標區塊中之任兩相鄰目標區塊的更新區域彼此不重疊且其參考區域彼此重疊。於另一實施例中,任兩相鄰目標區塊的更新區域亦可彼此重疊,故並無特定之限制。In one embodiment, the update regions of any two adjacent target blocks in the plurality of target blocks do not overlap with each other and the reference regions thereof overlap with each other. In another embodiment, the update regions of any two adjacent target blocks can also overlap each other, so there is no specific limitation.

此外,本發明的計算型顯示器運作方法還可對該多個目標區塊進行外部迭代,致使該多個目標區塊中之任兩相鄰目標區塊在經過多次迭代後仍能維持邊界一致,以避免邊界不一致的區塊效應。In addition, the computing display operation method of the present invention can also perform external iteration on the plurality of target blocks, so that any two adjacent target blocks in the plurality of target blocks can still maintain the same boundary after multiple iterations , to avoid the block effect of inconsistent boundaries.

舉例而言,本發明的計算型顯示器運作方法可重複巡迴每一個目標區塊進行外部迭代,並且外部迭代包括每一個目標區塊各自的內部迭代,致使先被更新的目標區塊能夠參考到已更新完畢的相鄰目標區塊而維持兩者的邊界一致。For example, the computing display operation method of the present invention can repeatedly traverse each target block to perform external iteration, and the external iteration includes the respective internal iteration of each target block, so that the target block updated first can refer to the previously updated target block. The updated adjacent target blocks maintain the same boundary between the two.

於一實施例中,本發明的計算型顯示器運作方法可透過外部記憶體與運算平台的區塊記憶體之間的加載及儲存來實現對該多個目標區塊進行外部迭代。由於外部記憶體的容量大於區塊記憶體的容量,因此,本發明的計算型顯示器運作方法執行步驟S10所分割出的該多個目標區塊可儲存於外部記憶體,在執行步驟S12之前,先將該多個目標區塊從外部記憶體加載至運算平台的區塊記憶體以透過區塊式分解演算法進行分解演算。In one embodiment, the computing display operation method of the present invention can perform external iteration on the plurality of target blocks through loading and storing between the external memory and the block memory of the computing platform. Since the capacity of the external memory is greater than the capacity of the block memory, the target blocks segmented by performing step S10 in the computing display operating method of the present invention can be stored in the external memory. Before performing step S12, First, load the plurality of target blocks from the external memory to the block memory of the computing platform to perform decomposition calculation through a block decomposition algorithm.

相較於先前技術,本發明的計算型顯示器及其運作方法採用區塊式分解演算法來處理光場影像以有效解決因為可攜式電子產品的記憶體限制所導致光場影像分解效率不佳的問題,故可提升多層液晶分解式光場顯示器的顯示效能且可適用於記憶體容量受限制的嵌入式系統。此外,為了避免區塊式分解演算法產生,本發明的計算型顯示器及其運作方法還分別提出區塊定義方法及區塊式分解的更新方法來避免區塊式分解演算法在邊界處產生邊界分解瑕疵與邊界不一致的區塊效應。Compared with the prior art, the computing display and its operation method of the present invention use a block-based decomposition algorithm to process the light field image, so as to effectively solve the problem of poor light field image decomposition efficiency due to the memory limitation of portable electronic products Therefore, the display performance of the multi-layer liquid crystal split light field display can be improved and it can be applied to embedded systems with limited memory capacity. In addition, in order to avoid the generation of the block-based decomposition algorithm, the computing display and the operation method thereof of the present invention further propose a block definition method and a block-based decomposition update method to avoid the block-based decomposition algorithm from generating boundaries at the boundaries Decomposes the blocking effect of imperfections and inconsistent boundaries.

1:計算型顯示器 10:影像分割模組 12:區塊加載模組 14:分解演算模組 16:區塊儲存模組 18:區塊結合模組 19:顯示模組 LFD:光場資料 M0:初始多幀多層分解影像 M1:結果多幀多層分解影像 OM:外部記憶體 CP:運算平台 BM:區塊記憶體 BUS:匯流排 PR:處理器 DM:顯示影像 LFM:光場影像 UR:更新區域 RR:參考區域 B0:區塊 B1:區塊 S10~S16:步驟 1: Computing Display 10: Image segmentation module 12: Chunk Loading Module 14: Decomposition calculation module 16:Block storage module 18: Block combination module 19: Display module LFD: Light Field Data M0: Initial multi-frame multi-layer decomposed image M1: Resulting multi-frame multi-layer decomposed image OM: External memory CP: Computing Platform BM: block memory BUS: bus bar PR: Processor DM: Display image LFM: Light Field Image UR: update area RR: Reference area B0: block B1: Block S10~S16: Steps

本發明所附圖式說明如下: 圖1繪示根據本發明之一較佳具體實施例中之計算型顯示器的功能方塊圖。 圖2繪示外部記憶體與運算平台之間透過匯流排耦接的示意圖。 圖3繪示外部記憶體儲存幀內容且運算平台之區塊記憶體儲存區塊內容並由處理器進行迭代乘法更新的示意圖。 圖4繪示執行區塊式分解演算法時僅更新更新區域而不更新參考區域的示意圖。 圖5繪示進行非對稱更新時外部記憶體與區塊記憶體之間的加載及儲存的示意圖。 圖6繪示區塊的更新順序的示意圖。 圖7繪示重複巡迴每一個目標區塊進行外部迭代的示意圖。 圖8繪示根據本發明之另一較佳具體實施例中之計算型顯示器運作方法的流程圖。 The accompanying drawings of the present invention are described as follows: FIG. 1 is a functional block diagram of a computing display according to a preferred embodiment of the present invention. FIG. 2 is a schematic diagram illustrating the coupling between an external memory and a computing platform through a bus. FIG. 3 is a schematic diagram illustrating that the external memory stores the frame content and the block memory of the computing platform stores the block content and is iteratively multiplied and updated by the processor. FIG. 4 is a schematic diagram illustrating that only the update area is updated without updating the reference area when the block-based decomposition algorithm is executed. FIG. 5 is a schematic diagram of loading and storing between external memory and block memory during asymmetric update. FIG. 6 is a schematic diagram illustrating an update sequence of blocks. FIG. 7 is a schematic diagram of repeatedly iterating through each target block for external iteration. FIG. 8 is a flowchart illustrating an operation method of a computing display according to another preferred embodiment of the present invention.

1:計算型顯示器 1: Computing Display

10:影像分割模組 10: Image segmentation module

12:區塊加載模組 12: Chunk Loading Module

14:分解演算模組 14: Decomposition calculation module

16:區塊儲存模組 16:Block storage module

18:區塊結合模組 18: Block combination module

19:顯示模組 19: Display module

LFD:光場資料 LFD: Light Field Data

M0:初始多幀多層分解影像 M0: Initial multi-frame multi-layer decomposed image

M1:結果多幀多層分解影像 M1: Resulting multi-frame multi-layer decomposed image

Claims (20)

一種計算型顯示器,包括:一影像分割模組,用以將一初始光場影像分割為多個目標區塊;一分解演算模組,耦接該影像分割模組,用以將一區塊式分解演算法獨立應用於該多個目標區塊中之每一個目標區塊上;一區塊組合模組,耦接該分解演算模組,用以結合該多個目標區塊為一結果光場影像;以及一顯示模組,包括多層顯示單元且耦接該區塊組合模組,用以顯示該結果光場影像。 A computing display includes: an image dividing module for dividing an initial light field image into a plurality of target blocks; a decomposing arithmetic module, coupled to the image dividing module, for dividing a block-type image The decomposition algorithm is independently applied to each target block of the plurality of target blocks; a block combination module is coupled to the decomposition calculation module for combining the plurality of target blocks into a resultant light field an image; and a display module including a multi-layer display unit and coupled to the block combination module for displaying the resultant light field image. 如請求項1所述的計算型顯示器,其中該計算型顯示器為多層液晶分解式顯示器(Multi-layer LCD Factorized Display)且該多層顯示單元中之至少一層顯示單元為液晶層。 The computing display of claim 1, wherein the computing display is a multi-layer LCD factorized display and at least one display unit in the multi-layer display unit is a liquid crystal layer. 如請求項1所述的計算型顯示器,其中該分解演算模組包括:一非對稱更新單元,用以限縮該多個目標區塊中的更新範圍,以非對稱更新方式來執行該區塊式分解演算法,致使該多個目標區塊的分解結果無分解瑕疵。 The computing display as claimed in claim 1, wherein the decomposition calculation module comprises: an asymmetric update unit, used to limit the update range of the plurality of target blocks, and execute the block in an asymmetric update manner A decomposition algorithm is adopted, so that the decomposition results of the plurality of target blocks are free of decomposition defects. 如請求項3所述的計算型顯示器,其中該非對稱更新單元係將該多個目標區塊中之一目標區塊分為一更新區域(Update Region)及一參考區域(Reference Region),並在對該目標區塊執行該區塊式分解演算法時僅更新該更新區域而不更新該參考區域。 The computing display of claim 3, wherein the asymmetric update unit divides one target block of the plurality of target blocks into an update region (Update Region) and a reference region (Reference Region), and When executing the block-based decomposition algorithm on the target block, only the update area is updated without updating the reference area. 如請求項4所述的計算型顯示器,其中該多個目標區塊中之任兩相鄰目標區塊的該更新區域彼此不重疊且其該參考區域彼此重疊。 The computing display of claim 4, wherein the update areas of any two adjacent target blocks in the plurality of target blocks do not overlap each other and the reference areas thereof overlap each other. 如請求項1所述的計算型顯示器,其中該分解演算模組包括:一外部迭代(Inter-Block Iteration)單元,用以對該多個目標區塊進行外部迭代,致使該多個目標區塊中之任兩相鄰目標區塊在經過多次迭代後仍能維持邊界一致。 The computing display of claim 1, wherein the decomposition calculation module comprises: an external iterative (Inter-Block Iteration) unit for performing external iteration on the plurality of target blocks, resulting in the plurality of target blocks Any two adjacent target blocks can still maintain the same boundary after many iterations. 如請求項6所述的計算型顯示器,其中該外部迭代單元係重複巡迴該每一個目標區塊進行該外部迭代,且該外部迭代包括該每一個目標區塊各自的內部迭代(Intra-Block Iteration),致使先被更新的目標區塊能夠參考到已更新完畢的相鄰目標區塊而維持兩者的邊界一致。 The computing display of claim 6, wherein the external iteration unit repeatedly loops each target block to perform the external iteration, and the external iteration includes a respective inner iteration (Intra-Block Iteration) of each target block. ), so that the target block updated first can refer to the adjacent target block that has been updated to maintain the same boundary between the two. 如請求項6所述的計算型顯示器,其中該外部迭代單元係透過一外部記憶體(Outer Memory)與一區塊記憶體(Block memory)之間的加載(Load)及儲存(Store)來實現對該多個目標區塊進行該外部迭代。 The computing display of claim 6, wherein the external iteration unit is implemented by loading and storing between an external memory (Outer Memory) and a block memory (Block memory) The outer iteration is performed on the plurality of target blocks. 如請求項8所述的計算型顯示器,其中該外部記憶體的容量大於該區塊記憶體的容量,該影像分割模組所分割出的該多個目標區塊係儲存於該外部記憶體,該分解演算模組將該多個目標區塊從該外部記憶體加載至該區塊記憶體以進行分解演算。 The computing display of claim 8, wherein the capacity of the external memory is greater than the capacity of the block memory, and the target blocks divided by the image dividing module are stored in the external memory, The decomposition calculation module loads the plurality of target blocks from the external memory to the block memory to perform decomposition calculation. 如請求項1所述的計算型顯示器,其中該分解演算模組適用於記憶體容量受限制的嵌入式系統(Embedded System)。 The computing display of claim 1, wherein the decomposition algorithm module is suitable for an embedded system (Embedded System) with limited memory capacity. 一種計算型顯示器運作方法,用以運作一計算型顯示器,包 括下列步驟:(a)將一初始光場影像分割為多個目標區塊;(b)將一區塊式分解演算法獨立應用於該多個目標區塊之每一個目標區塊上;(c)結合該多個目標區塊為一結果光場影像;以及(d)顯示該結果光場影像。 A computing display operation method for operating a computing display, including Including the following steps: (a) dividing an initial light field image into a plurality of target blocks; (b) independently applying a block decomposition algorithm to each target block of the plurality of target blocks; ( c) combining the plurality of target blocks into a resultant light field image; and (d) displaying the resultant light field image. 如請求項11所述的計算型顯示器運作方法,其中該計算型顯示器為多層液晶分解式顯示器且該多層顯示單元中之至少一層顯示單元為液晶層。 The method for operating a computing display as claimed in claim 11, wherein the computing display is a multi-layer liquid crystal decomposition display and at least one display unit in the multi-layer display unit is a liquid crystal layer. 如請求項11所述的計算型顯示器運作方法,其中該計算型顯示器運作方法還包括:限縮該多個目標區塊中的更新範圍,以非對稱更新方式來執行該區塊式分解演算法,致使該多個目標區塊的分解結果無分解瑕疵。 The computing display operation method of claim 11, wherein the computing display operation method further comprises: narrowing the update range of the target blocks, and executing the block-based decomposition algorithm in an asymmetric update manner , so that the decomposition results of the multiple target blocks have no decomposition defects. 如請求項13所述的計算型顯示器運作方法,還包括:將該多個目標區塊中之一目標區塊分為一更新區域及一參考區域;以及在對該目標區塊執行該區塊式分解演算法時僅更新該更新區域而不更新該參考區域。 The computing display operation method of claim 13, further comprising: dividing one of the target blocks into an update area and a reference area; and executing the block on the target block When using the formula decomposition algorithm, only the update region is updated without updating the reference region. 如請求項14所述的計算型顯示器運作方法,其中該多個目標區塊中之任兩相鄰目標區塊的該更新區域彼此不重疊且其該參考區域彼此重疊。 The computing display operation method of claim 14, wherein the update areas of any two adjacent target blocks in the plurality of target blocks do not overlap each other and the reference areas thereof overlap each other. 如請求項11所述的計算型顯示器運作方法,其中該計算型顯示器運作方法包括:對該多個目標區塊進行外部迭代,致使該多個目標區塊中之任兩相鄰目標區塊在經過多次迭代後仍能維持邊界一致。 The computing display operation method of claim 11, wherein the computing display operation method comprises: performing external iteration on the plurality of target blocks, so that any two adjacent target blocks in the plurality of target blocks are The bounds are still consistent after many iterations. 如請求項16所述的計算型顯示器運作方法,其中該計算型顯示器運作方法係重複巡迴該每一個目標區塊進行該外部迭代,且該外部迭代包括該每一個目標區塊各自的內部迭代,致使先被更新的目標區塊能夠參考到已更新完畢的相鄰目標區塊而維持兩者的邊界一致。 The computational display operation method of claim 16, wherein the computational display operation method repeatedly iterates through each target block for the outer iteration, and the outer iteration includes the respective inner iteration of each target block, The target block that is updated first can refer to the adjacent target block that has been updated so that the boundaries of the two are consistent. 如請求項16所述的計算型顯示器運作方法,其中該計算型顯示器運作方法係透過一外部記憶體與一區塊記憶體之間的加載及儲存來實現對該多個目標區塊進行該外部迭代。 The computing display operation method of claim 16, wherein the computing display operation method realizes the external execution of the plurality of target blocks through loading and storing between an external memory and a block memory iterate. 如請求項18所述的計算型顯示器運作方法,其中該外部記憶體的容量大於該區塊記憶體的容量,步驟(a)所分割出的該多個目標區塊係儲存於該外部記憶體,在步驟(b)之前先將該多個目標區塊從該外部記憶體加載至該區塊記憶體以進行分解演算。 The computing display operation method of claim 18, wherein the capacity of the external memory is greater than the capacity of the block memory, and the target blocks divided in step (a) are stored in the external memory , before step (b), load the plurality of target blocks from the external memory to the block memory for decomposition calculation. 如請求項11所述的計算型顯示器運作方法,其中該區塊式分解演算法適用於記憶體容量受限制的嵌入式系統。 The computing display operation method of claim 11, wherein the block-based decomposition algorithm is suitable for an embedded system with limited memory capacity.
TW110126142A 2021-07-15 2021-07-15 Computational display and operating method thereof TWI772108B (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
TW110126142A TWI772108B (en) 2021-07-15 2021-07-15 Computational display and operating method thereof
CN202111319314.4A CN115701100B (en) 2021-07-15 2021-11-09 Computational display and method of operating the same

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
TW110126142A TWI772108B (en) 2021-07-15 2021-07-15 Computational display and operating method thereof

Publications (2)

Publication Number Publication Date
TWI772108B true TWI772108B (en) 2022-07-21
TW202305776A TW202305776A (en) 2023-02-01

Family

ID=83439764

Family Applications (1)

Application Number Title Priority Date Filing Date
TW110126142A TWI772108B (en) 2021-07-15 2021-07-15 Computational display and operating method thereof

Country Status (2)

Country Link
CN (1) CN115701100B (en)
TW (1) TWI772108B (en)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TW201901241A (en) * 2017-05-16 2019-01-01 宏達國際電子股份有限公司 Head mounted display device
TW202006422A (en) * 2014-01-10 2020-02-01 美商傲思丹度科技公司 Methods for full parallax compressed light field 3D imaging systems
US20200363636A1 (en) * 2019-05-13 2020-11-19 Light Field Lab, Inc. Light field display system for performance events
US20210158626A1 (en) * 2018-10-18 2021-05-27 Samsung Display Co., Ltd. Electronic device including display unit and method of operating the same
TW202123173A (en) * 2019-12-04 2021-06-16 美商美國未來科技公司 Dynamic light field system and use method thereof capable of improving the overall production and convenience of use

Family Cites Families (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6057814A (en) * 1993-05-24 2000-05-02 Display Science, Inc. Electrostatic video display drive circuitry and displays incorporating same
JP3335998B2 (en) * 1998-02-20 2002-10-21 ディープ ヴィデオ イメージング リミテッド Multi-layer display device
CN100508607C (en) * 2004-08-16 2009-07-01 瑞昱半导体股份有限公司 block matching method and device
JP4648073B2 (en) * 2005-04-28 2011-03-09 パナソニック株式会社 Image processing apparatus, image reading apparatus including the same, and image processing method
TWI356239B (en) * 2007-02-27 2012-01-11 Chimei Innolux Corp Liquid crystal display apparatus and image control
CN101630487B (en) * 2008-07-17 2013-10-23 群创光电股份有限公司 Liquid crystal display and driving method
US8941691B2 (en) * 2008-08-26 2015-01-27 Pure Depth Limited Multi-layered displays
KR101543277B1 (en) * 2009-02-20 2015-08-11 삼성디스플레이 주식회사 Method of driving light source
US8970448B2 (en) * 2009-06-18 2015-03-03 Hiperwall, Inc. Systems, methods, and devices for manipulation of images on tiled displays
JP5743691B2 (en) * 2011-04-28 2015-07-01 キヤノン株式会社 Liquid crystal display device, control method therefor, and image display system
US8848006B2 (en) * 2012-01-25 2014-09-30 Massachusetts Institute Of Technology Tensor displays
US10453371B2 (en) * 2014-02-07 2019-10-22 Samsung Electronics Co., Ltd. Multi-layer display with color and contrast enhancement
US9519154B2 (en) * 2014-05-09 2016-12-13 Pure Depth Limited Diffraction grating for use with a multi-layered display system
US20180137809A1 (en) * 2016-11-11 2018-05-17 Raydium Semiconductor Corporation Driving circuit and operating method thereof
CN113660539B (en) * 2017-04-11 2023-09-01 杜比实验室特许公司 Method and device for rendering visual object
CN109905690B (en) * 2017-12-11 2021-06-22 瑞昱半导体股份有限公司 Image adjusting device and method
KR102590142B1 (en) * 2018-12-17 2023-10-18 삼성전자주식회사 Display device and its control method

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TW202006422A (en) * 2014-01-10 2020-02-01 美商傲思丹度科技公司 Methods for full parallax compressed light field 3D imaging systems
TW201901241A (en) * 2017-05-16 2019-01-01 宏達國際電子股份有限公司 Head mounted display device
US20210158626A1 (en) * 2018-10-18 2021-05-27 Samsung Display Co., Ltd. Electronic device including display unit and method of operating the same
US20200363636A1 (en) * 2019-05-13 2020-11-19 Light Field Lab, Inc. Light field display system for performance events
TW202123173A (en) * 2019-12-04 2021-06-16 美商美國未來科技公司 Dynamic light field system and use method thereof capable of improving the overall production and convenience of use

Also Published As

Publication number Publication date
CN115701100A (en) 2023-02-07
CN115701100B (en) 2025-09-26
TW202305776A (en) 2023-02-01

Similar Documents

Publication Publication Date Title
US7215823B2 (en) Deblocking and deringing apparatus, program and method
US8941655B2 (en) Memory copy engine for graphics processing
WO2018040463A1 (en) Data compression and decompression methods for demura table, and mura compensation method
US20120050303A1 (en) Lossless frame buffer color compression
CN109920013B (en) Image reconstruction method and device based on progressive convolutional measurement network
US12301828B2 (en) Image compression method, apparatus, and computer-readable storage medium
US20050093893A1 (en) Aspect ratio conversion of video content
TWI772108B (en) Computational display and operating method thereof
CN117272911A (en) Integrated circuit layout rendering method, system, storage medium and electronic equipment
US8594445B2 (en) Fast bilateral filtering using rectangular regions
CN114546206B (en) Special-shaped screen display method and device, computer equipment and storage medium
CN119993049A (en) Data processing method, device, computer equipment and storage medium
CN117395383B (en) Tone mapping method, tone mapping apparatus, computer device, and storage medium
CN113838368A (en) Peep-proof display method, peep-proof display device and storage medium
CN117689553A (en) Image contrast enhancement method, system, equipment and storage medium
CN110084759B (en) An image filling method, terminal device and storage medium
CN115547253B (en) Display screen optical compensation data processing method, device and computer-readable storage medium
Micchelli et al. Proximity algorithms for image models II: L1/TV denosing
US6314136B1 (en) Method for performing wavelet-based image compaction losslessly and low bit precision requirements
CN116343714A (en) Screen rotation adaptive method, device, computer equipment and storage medium
CN116033167A (en) Code rate control method, device, equipment and storage medium
CN114996491A (en) Method and system for optimizing display performance of all-liquid-crystal instrument
US11494869B2 (en) Image processor having a compressing engine performing operations on each row of M*N data block
CN119011849B (en) Code rate control method, device, computer equipment, storage medium and computer program product
CN119417944B (en) Soil spatial distribution map generation method and system based on soil attributes