[go: up one dir, main page]

CN1949885A - Multi-color data processing method and display pixel layout for the method - Google Patents

Multi-color data processing method and display pixel layout for the method Download PDF

Info

Publication number
CN1949885A
CN1949885A CNA2005101090237A CN200510109023A CN1949885A CN 1949885 A CN1949885 A CN 1949885A CN A2005101090237 A CNA2005101090237 A CN A2005101090237A CN 200510109023 A CN200510109023 A CN 200510109023A CN 1949885 A CN1949885 A CN 1949885A
Authority
CN
China
Prior art keywords
sub
pixel
color
pixels
value
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CNA2005101090237A
Other languages
Chinese (zh)
Inventor
罗新台
翁瑞兴
陈奕帆
吴法震
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Wintek Corp
Original Assignee
Wintek Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Wintek Corp filed Critical Wintek Corp
Priority to CNA2005101090237A priority Critical patent/CN1949885A/en
Publication of CN1949885A publication Critical patent/CN1949885A/en
Pending legal-status Critical Current

Links

Images

Landscapes

  • Control Of Indicators Other Than Cathode Ray Tubes (AREA)
  • Image Processing (AREA)

Abstract

The invention provides a multicolor data processing method and a display pixel layout used for the method. The multicolor data is a display pixel layout formed by arranging three basic hue sub-pixels and a brightening sub-pixel, and any three sub-pixels in four sub-pixels form a selected pixel unit of the pixel layout, and the method comprises the following steps: converting the three basic hue sub-pixel image data of the original three-color system corresponding to the selected pixel unit into four-color numerical values, wherein the four-color numerical values comprise a first numerical value of the sub-pixel color belonging to the selected pixel unit and a second numerical value of the sub-pixel color not belonging to the selected pixel unit; inputting a third value of the sub-pixel color belonging to the selected pixel unit into a plurality of adjacent pixel units adjacent to the selected pixel unit; and performing correlation coefficient operation on the first numerical value and the third numerical value to determine the actual numerical value of each sub-pixel color of the selected pixel unit.

Description

多色数据处理方法及用于该方法的显示器像素布局Multi-color data processing method and display pixel layout for the method

技术领域technical field

本发明涉及一种多色数据处理方法及用于该多色数据处理方法的显示器像素布局,尤其涉及一种兼顾分辨率及亮度要求的多色数据处理方法及显示器像素布局The present invention relates to a multi-color data processing method and a display pixel layout used in the multi-color data processing method, in particular to a multi-color data processing method and a display pixel layout that take into account resolution and brightness requirements

背景技术Background technique

图1显示传统的红(R)、绿(G)、蓝(B)三色像素布局安排。图2A及图2B为示意图,显示两种韩国三星电子公司提出的红(R)、绿(G)、蓝(B)、白(W)四色像素布局安排。Figure 1 shows a traditional red (R), green (G), blue (B) three-color pixel layout arrangement. FIG. 2A and FIG. 2B are schematic diagrams showing two pixel layout arrangements of red (R), green (G), blue (B) and white (W) proposed by Samsung Electronics Corporation of Korea.

于显示器像素布局中加入白色子像素(white sub-pixel)的显示色彩技术,可带来提高液晶显示器的光使用效率以增加亮度或降低背光的消耗功率的效果,这对例如液晶电视或手持式液晶装置的应用有明显的效能增益。The display color technology of adding white sub-pixel (white sub-pixel) in the pixel layout of the display can bring about the effect of improving the light use efficiency of the liquid crystal display to increase the brightness or reduce the power consumption of the backlight, which is for example LCD TV or handheld The application of the liquid crystal device has obvious performance gain.

如图2A所示,其所显示的R、G、B、及W子像素采用条纹式排列。比较图1及图2A可知,在相同的像素分配区域下,当另加入W子像素时,会导致RGB三色子像素个别面积缩小为原来的四分之三,造成开口率下降。再者,加入W子像素的显示面板设计须增加大量的数据线配合,如此会造成数据IC数量增加为原有的三分之四,大幅度增加成本。As shown in FIG. 2A , the displayed R, G, B, and W sub-pixels are arranged in stripes. Comparing FIG. 1 and FIG. 2A, it can be seen that under the same pixel allocation area, when W sub-pixels are added, the individual areas of the RGB three-color sub-pixels will be reduced to three quarters of the original area, resulting in a decrease in the aperture ratio. Furthermore, the design of the display panel incorporating W sub-pixels requires a large number of data lines for coordination, which will cause the number of data ICs to increase to four-thirds of the original, greatly increasing the cost.

图2B显示另一种RGBW子像素采用棋盘式(checkerboard)排列的布局。比较图1及图2B可知,在相同的像素分配区域下,此一设计同样会有加入W子像素导致RGB三色子像素个别面积缩小为原先四分之三的问题。再者,因一组RGBW排列为四块区域构成的方形,所以数据IC数量虽可减为原有的三分的二,但扫描线反而增加为原来的两倍,使扫描IC数量增加而大幅增加成本。FIG. 2B shows another layout in which RGBW sub-pixels are arranged in a checkerboard arrangement. Comparing FIG. 1 and FIG. 2B, it can be seen that under the same pixel allocation area, this design also has the problem of adding W sub-pixels, resulting in the reduction of the individual areas of the RGB three-color sub-pixels to three quarters of the original. Furthermore, because a group of RGBW is arranged in a square consisting of four areas, although the number of data ICs can be reduced to two-thirds of the original, the number of scanning lines is doubled instead, which greatly increases the number of scanning ICs. increase cost.

有鉴于此,柯达公司还提出一种不变动个别子像素面积的RGBW像素布局设计。图3A显示传统RGB三色像素布局,图3B则显示柯达公司设计的RGBW像素布局。比较图3A及图3B可知,因该设计是在原有RGB三色像素布局下,在不变动个别子像素面积大小的条件下再加入W子像素,因此RGB三色子像素的面积仍维持相同,且W子像素的面积也设计为与其它三色的子像素面积相同。In view of this, Kodak also proposes an RGBW pixel layout design that does not change the area of individual sub-pixels. Figure 3A shows the traditional RGB three-color pixel layout, and Figure 3B shows the RGBW pixel layout designed by Kodak. Comparing Fig. 3A and Fig. 3B, it can be seen that because this design is based on the original RGB three-color pixel layout, W sub-pixels are added without changing the size of individual sub-pixels, so the area of the RGB three-color sub-pixels remains the same. Moreover, the area of the W sub-pixel is also designed to be the same as that of the other three-color sub-pixels.

然而,此一设计虽可维持原先子像素面积大小,但却会产生分辨率下降的明显缺点。However, although this design can maintain the size of the original sub-pixel area, it has the obvious disadvantage of resolution degradation.

因RGB三色系统的一像素单元定义为RGB三个子像素的集合,而RGBW四色系统的一像素单元定义为RGBW四个子像素的集合,比较图3A及图3B可知,柯达公司的设计的一像素单元的水平距离Px’为一般RGB像素布局其一像素单元的水平距离Px的三分之四倍,故其分辨率会降至原先的四分之三。举例而言,依该设计当原RGB三色系统的显示面板分辨率为176×RGB×220,加入额外的W子像素以形成RGBW四色系统显示面板,则分辨率会减少成132×RGBW×220(176×3/4=132)。Because a pixel unit of the RGB three-color system is defined as a set of three sub-pixels of RGB, and a pixel unit of the RGBW four-color system is defined as a set of four sub-pixels of RGBW, a comparison of Fig. 3A and Fig. 3B shows that Kodak's design The horizontal distance Px' of the pixel unit is 4/3 times of the horizontal distance Px of a pixel unit in the general RGB pixel layout, so its resolution will be reduced to 3/4 of the original one. For example, according to this design, when the resolution of the original RGB three-color system display panel is 176×RGB×220, adding additional W sub-pixels to form an RGBW four-color system display panel, the resolution will be reduced to 132×RGBW× 220 (176*3/4=132).

发明内容Contents of the invention

因此,本发明的目的在于提供一种显示器像素布局及多色数据处理方法,能够避免上述现有技术的缺点,在维持原三色像素布局的分辨率前提下,达到加入白色子像素以提高亮度的最佳化设计。Therefore, the object of the present invention is to provide a display pixel layout and multi-color data processing method, which can avoid the above-mentioned shortcomings of the prior art, and achieve the addition of white sub-pixels to improve brightness under the premise of maintaining the resolution of the original three-color pixel layout. optimized design.

本发明提供一种多色数据处理方法,该多色数据为以三个基础色相子像素及一增亮子像素排列形成的显示器像素布局,且四个子像素中任选三个子像素构成所述像素布局的一选取像素单元,该方法包括如下步骤:The present invention provides a method for processing multi-color data. The multi-color data is a display pixel layout formed by arranging three basic hue sub-pixels and a brightening sub-pixel, and three sub-pixels are selected among the four sub-pixels to form the pixel layout. A selected pixel unit, the method includes the following steps:

将对应所述选取像素单元的原三色系统的三个基础色相子像素图像数据转换为四色数值,该四色数值包含属于所述选取像素单元的子像素色彩的第一数值及不属于所述选取像素单元的子像素色彩的第二数值;Converting the three basic hue sub-pixel image data of the original three-color system corresponding to the selected pixel unit into four-color values, the four-color values include the first value of the sub-pixel color belonging to the selected pixel unit and the values not belonging to all sub-pixel colors The second value of the sub-pixel color of the selected pixel unit;

令与所述选取像素单元相邻的多个邻接像素单元输入属于所述选取像素单元的子像素色彩的第三数值;及causing a plurality of adjacent pixel units adjacent to the selected pixel unit to input a third value of a sub-pixel color belonging to the selected pixel unit; and

对所述第一数值及第三数值进行相关系数运算,以决定所述选取像素单元各子像素色彩的实际数值。A correlation coefficient operation is performed on the first value and the third value to determine the actual value of each sub-pixel color of the selected pixel unit.

所述第二数值输出至所有所述邻接像素单元。The second value is output to all the adjacent pixel units.

所述选取像素单元相较所述四色数值所欠缺的子像素色彩,存在于所述邻接像素单元中最邻近所述选取像素单元的子像素位置。The sub-pixel color lacking in the selected pixel unit compared with the four-color values exists in the sub-pixel position closest to the selected pixel unit among the adjacent pixel units.

所述数值为色彩的灰阶值。The value is the grayscale value of the color.

所述增亮子像素的色彩为红、绿及蓝三原色中至少两种混合所形成的混色;所述基础色相子像素为红、绿及蓝色或青绿、紫红及黄色两组子像素其中之一。The color of the brightening sub-pixel is a mixed color formed by mixing at least two primary colors of red, green and blue; the basic hue sub-pixel is one of two groups of sub-pixels of red, green and blue or cyan, purple and yellow .

本发明还提供一种多色数据处理方法,该多色数据为以三个基础色相子像素及一增亮子像素排列形成的显示器像素布局,且四个子像素中任选三个子像素构成所述像素布局的一选取像素单元,其中位于同一横列的两相邻子像素色彩相异,且分别位于两相邻横列中的两同一色彩子像素彼此沿排列方向形成两个子像素位置的错位,该方法包括如下步骤:The present invention also provides a multi-color data processing method, the multi-color data is a display pixel layout formed by the arrangement of three basic hue sub-pixels and a brightening sub-pixel, and three sub-pixels are selected among the four sub-pixels to form the pixel A selected pixel unit of the layout, wherein two adjacent sub-pixels located in the same row have different colors, and two sub-pixels of the same color respectively located in two adjacent rows form a dislocation of two sub-pixel positions along the arrangement direction, the method includes Follow the steps below:

将对应所述选取像素单元的原三色系统的三个基础色相子像素图像数据转换为四色数值,该四色数值包含属于所述选取像素单元的子像素色彩的第一数值及不属于所述选取像素单元的子像素色彩的第二数值;Converting the three basic hue sub-pixel image data of the original three-color system corresponding to the selected pixel unit into four-color values, the four-color values include the first value of the sub-pixel color belonging to the selected pixel unit and the values not belonging to all sub-pixel colors The second value of the sub-pixel color of the selected pixel unit;

令与所述选取像素单元相邻的多个邻接像素单元输入属于所述选取像素单元的子像素色彩的第三数值;及causing a plurality of adjacent pixel units adjacent to the selected pixel unit to input a third value of a sub-pixel color belonging to the selected pixel unit; and

对所述第一数值及第三数值进行相关系数运算,以决定所述选取像素单元各子像素色彩的实际数值。A correlation coefficient operation is performed on the first value and the third value to determine the actual value of each sub-pixel color of the selected pixel unit.

所述第二数值输出至所有所述邻接像素单元,且各所述邻接像素单元均具有所述选取像素单元相较所述四色数值所欠缺的子像素色彩。The second value is output to all the adjacent pixel units, and each of the adjacent pixel units has a sub-pixel color that the selected pixel unit lacks compared with the four-color values.

所述数值为色彩的灰阶值。The value is the grayscale value of the color.

所述增亮子像素的色彩为红、绿及蓝三原色中至少两种混合所形成的混色;所述基础色相子像素为红、绿及蓝色或青绿、紫红及黄色两组子像素其中之一。The color of the brightening sub-pixel is a mixed color formed by mixing at least two primary colors of red, green and blue; the basic hue sub-pixel is one of two groups of sub-pixels of red, green and blue or cyan, purple and yellow .

本发明提供一种显示器像素布局,包括:The present invention provides a display pixel layout, comprising:

多道各由三个基础色相子像素及一增亮子像素构成的横列,其中位于同一横列的两相邻子像素色彩相异,且分别位于两相邻横列中的两同一色彩子像素彼此沿排列方向形成两个子像素位置的错位。A plurality of rows each consisting of three basic hue sub-pixels and one brightening sub-pixel, wherein two adjacent sub-pixels in the same row have different colors, and two sub-pixels of the same color in two adjacent rows are arranged along each other The direction forms a dislocation of two sub-pixel positions.

各个子像素的面积相同。Each sub-pixel has the same area.

所述增亮子像素的色彩为红、绿及蓝三原色中至少两种混合所形成的混色;所述基础色相子像素为红、绿及蓝色或青绿、紫红及黄色两组子像素其中之一。The color of the brightening sub-pixel is a mixed color formed by mixing at least two primary colors of red, green and blue; the basic hue sub-pixel is one of two groups of sub-pixels of red, green and blue or cyan, purple and yellow .

通过本发明可使由三个子像素所定义的一像素单元,成为RGBW四色系统下的一个有效显示像素单元。因此,本发明在加入白色子像素以提高亮度的情况下,仍能维持原RGB三色系统的分辨率,且RGB三色子像素的面积仍能保持不变,而白色子像素的面积也可同于其它三色的子像素面积,获得一兼顾分辨率与亮度的最佳化设计。Through the present invention, a pixel unit defined by three sub-pixels can become an effective display pixel unit under the RGBW four-color system. Therefore, the present invention can still maintain the resolution of the original RGB three-color system when adding white sub-pixels to increase the brightness, and the area of the RGB three-color sub-pixels can still remain unchanged, and the area of the white sub-pixels can also be changed. Similar to the sub-pixel area of other three colors, an optimal design with both resolution and brightness is obtained.

附图说明Description of drawings

图1显示传统的红(R)、绿(G)、蓝(B)三色像素布局安排;Figure 1 shows the traditional red (R), green (G), blue (B) three-color pixel layout arrangement;

图2A及图2B为示意图,显示两种韩国三星电子公司提出的红(R)、绿(G)、蓝(B)、白(W)四色像素布局安排;FIG. 2A and FIG. 2B are schematic diagrams showing four-color pixel layout arrangements of red (R), green (G), blue (B) and white (W) proposed by Samsung Electronics Corporation of Korea;

图3A显示传统RGB三色像素布局;Figure 3A shows a traditional RGB three-color pixel layout;

图3B显示柯达公司设计的RGBW像素布局;Figure 3B shows the RGBW pixel layout designed by Kodak;

图4A至图4D为示意图,显示本发明的一显示器像素布局;4A to 4D are schematic diagrams showing a display pixel layout of the present invention;

图5A及图5B为示意图,说明一定义RGB像素单元搭配本发明的多色数据处理方法设计;5A and FIG. 5B are schematic diagrams illustrating the design of a defined RGB pixel unit with the multi-color data processing method of the present invention;

图6A及图6B为示意图,说明一定义WRG像素单元搭配本发明的多色数据处理方法的设计;FIG. 6A and FIG. 6B are schematic diagrams illustrating the design of a defined WRG pixel unit with the multi-color data processing method of the present invention;

图7为说明本发明多色数据处理方法的流程图;Fig. 7 is a flowchart illustrating the multicolor data processing method of the present invention;

图8显示一现有加白演算处理的方块图;FIG. 8 shows a block diagram of an existing whitening algorithm;

图9显示本发明显示器像素布局的另一实施例;Fig. 9 shows another embodiment of the pixel layout of the display of the present invention;

图10显示本发明显示器像素布局的另一实施例;Fig. 10 shows another embodiment of the pixel layout of the display of the present invention;

图11显示本发明多色数据处理方法的另一实施例。FIG. 11 shows another embodiment of the multicolor data processing method of the present invention.

【主要元件符号说明】[Description of main component symbols]

10、12、14、16  像素单元               22、40  四色转换元件10, 12, 14, 16 pixel units 22, 40 four-color conversion elements

24、26、28、30  像素相关器             42  γ转换元件24, 26, 28, 30 pixel correlators 42 gamma conversion elements

44  再映像元件                         46  数据设定元件44 Remapping Components 46 Data Setting Components

48  白抽取元件                         50  反γ转换元件48 White extraction element 50 Inverse gamma conversion element

60、62、64、66、70、72、74、76  像素单元60, 62, 64, 66, 70, 72, 74, 76 pixel units

S0-S12  步骤S0-S12 steps

具体实施方式Detailed ways

图4A至图4D为示意图,显示本发明的一红(R)绿(G)蓝(B)白(W)四色系统显示器像素布局,及搭配后述多色数据处理方法所定义的一像素单元构成。4A to 4D are schematic diagrams showing the pixel layout of a red (R) green (G) blue (B) white (W) four-color system display of the present invention, and a pixel defined by the multi-color data processing method described later. unit composition.

以图4A所示为例,本发明的RGBW四色像素布局由多道各由红(R)、绿(G)、蓝(B)、白(W)子像素构成的横列,且所述像素布局的子像素以如下规则排列:Taking Fig. 4A as an example, the RGBW four-color pixel layout of the present invention consists of a plurality of rows each composed of red (R), green (G), blue (B), and white (W) sub-pixels, and the pixels The sub-pixels of the layout are arranged according to the following rules:

1.位于同一横列的两相邻子像素色彩相异,即R、G、B、W子像素在沿同一水平横列排列时不连续重复出现;及1. Two adjacent sub-pixels located in the same row have different colors, that is, R, G, B, and W sub-pixels appear discontinuously and repeatedly when arranged along the same horizontal row; and

2.分别位于两相邻横列中的两同一色彩子像素,彼此沿排列方向形成两个子像素位置的错位。以图4A为例,当第一横列的R子像素出现在最左端的第一个排列位置,则第二横列左端第一个R子像素出现在第三个排列位置,即两者彼此错移两个子像素排列位置,其余的子像素排列也同。2. The two sub-pixels of the same color respectively located in two adjacent rows form two sub-pixel position dislocations along the arrangement direction. Taking Figure 4A as an example, when the R sub-pixel in the first row appears at the first arrangement position at the far left, the first R sub-pixel at the left end of the second row appears at the third arrangement position, that is, the two are shifted from each other The two sub-pixels are arranged in the same position, and the rest of the sub-pixels are also arranged in the same way.

当于RGB三色系统加入W子像素以提高显示亮度时,为了维持原RGB三色系统的分辨率,本发明搭配后述的多色数据处理方法,重新定义加入W子像素后RGBW四色系统的一像素单元构成。在维持原有分辨率的条件下,必须由三个子像素组成一像素单元,因此,依本发明的设计,一像素单元为如下四种子像素组合其中之一所构成:When W sub-pixels are added to the RGB three-color system to increase display brightness, in order to maintain the resolution of the original RGB three-color system, the present invention uses the multi-color data processing method described later to redefine the RGBW four-color system after adding W sub-pixels of a pixel unit. Under the condition of maintaining the original resolution, a pixel unit must be composed of three sub-pixels. Therefore, according to the design of the present invention, a pixel unit is composed of one of the following four sub-pixel combinations:

1.RGB(图4A加粗黑线所示的像素单元10)1.RGB (the pixel unit 10 shown in the bold black line in Fig. 4A)

2.WRG(图4B加粗黑线所示的像素单元12)2. WRG (pixel unit 12 shown in bold black line in FIG. 4B )

3.BWR(图4C加粗黑线所示的像素单元14)3. BWR (pixel unit 14 shown in bold black line in Figure 4C)

4.GBW(图4D加粗黑线所示的像素单元16)4.GBW (pixel unit 16 shown in bold black line in Figure 4D)

依本发明的像素单元定义方式,虽然各个像素单元的组成相较RGBW四色均缺少一种颜色,但通过本发明的像素布局设计,所述像素单元所缺少的色彩会出现在所述像素单元的上下左右最邻近的位置处以作为色彩补偿之用。以图4A的像素单元10为RGB子像素组成为例,该像素单元10所缺少的W子像素会出现R子像素左邻、B子像素右邻及G子像素的上方及下方,即所有邻接像素单元12、14及16最邻近像素单元10的子像素位置处均具有W子像素,而获得最佳的色彩补偿效果。其它像素单元12、14及16相较RGBW四色所缺少的色彩,也以相同方式出现。According to the pixel unit definition method of the present invention, although the composition of each pixel unit lacks one color compared with the RGBW four colors, through the pixel layout design of the present invention, the missing color of the pixel unit will appear in the pixel unit The most adjacent positions of top, bottom, left and right are used for color compensation. Taking the pixel unit 10 in FIG. 4A as an example composed of RGB sub-pixels, the W sub-pixel lacking in the pixel unit 10 will appear on the left side of the R sub-pixel, the right side of the B sub-pixel and the top and bottom of the G sub-pixel, that is, all adjacent The pixel units 12 , 14 and 16 all have W sub-pixels at the sub-pixel positions closest to the pixel unit 10 , so as to obtain the best color compensation effect. The missing colors of the other pixel units 12 , 14 and 16 compared with the RGBW four colors also appear in the same way.

图5A、5B、6A及6B为示意图,用以说明上述的特殊像素单元定义搭配本发明的多色数据处理方法的设计。5A, 5B, 6A and 6B are schematic diagrams for illustrating the design of the above-mentioned special pixel unit definition in conjunction with the multi-color data processing method of the present invention.

进行本发明的多色数据处理方法,首先选择一个原三色系统的像素Pixel(I)作为起始运算单元,如图5A所示,Pixel(I)包含RI、GI、及BI子像素。依本发明的设计,首先将原RI、GI、BI三色图像数据的灰阶值输入一四色转换元件22,利用任一种加白算法转换成RIGIBIWI四色数据格式,决定出子像素WI的灰阶值后,进行接续的色彩补偿处理。Carry out the multi-color data processing method of the present invention, at first select the pixel Pixel (I) of an original three-color system as initial operation unit, as shown in Figure 5A, Pixel (I) comprises R I , G I and B I subunits pixels. According to the design of the present invention, at first the grayscale value of the original R I , G I , B I three-color image data is input into a four-color conversion element 22, and any whitening algorithm is used to convert it into R I G I B I W I In the four-color data format, after the grayscale value of the sub-pixel W I is determined, subsequent color compensation processing is performed.

图5B为示意图,显示当原三色系统的像素Pixel(I)转换为依本发明定义的第一类像素单元(包含RGB子像素)进行的色彩补偿过程。如图5B所示,本发明的四色系统所定义的第一类像素单元10包含RIGIBI子像素,相对RGBW四色而言缺少白色,但通过本发明的像素布局安排,所缺少的白色会出现在像素单元10的上下左右最邻近的位置作为色彩补偿之用(WL、WT、WR、及WD)。在进行色彩补偿处理时,原三色系统的像素经四色转换后,相较像素单元10所包含的RIGIBI子像素为多余的WI灰阶值,可输出给周围像素单元的W子像素区域,包含像素单元12的WR子像素、像素单元14的WT、WD子像素、及像素单元16的WL子像素。另一方面,对应像素单元12的三色像素以相同方式转换为四色数据格式后多余的子像素BR,其灰阶值输入至像素单元10的BI区域;对应像素单元14的三色像素以相同方式转换为四色数据格式后多余的子像素GT及GD,其灰阶值输入至像素单元10的GI区域;对应像素单元16的三色像素以相同方式转换为四色格式后多余的子像素RL,其灰阶值输入至像素单元10的RI区域。最后,再如图5A所示,由相邻像素单元输入的RGB三色补偿值、与原三色像素Pixel(I)经转换成四色格式中的RGB三色灰阶值,可分别输入至R、G及B像素相关器24、26及28,依一预设权重进行相关运算,所得出的数值即为第一类像素单元10的RIGIBI子像素实际输出的灰阶值。所述预设权重可依显示出的视觉效果加以调整。5B is a schematic diagram showing the color compensation process performed when the pixel Pixel (I) of the original three-color system is converted into the first type of pixel unit (including RGB sub-pixels) defined according to the present invention. As shown in Figure 5B, the first type of pixel unit 10 defined by the four-color system of the present invention includes R I G I B I sub-pixels, which lack white relative to the RGBW four colors, but through the pixel layout arrangement of the present invention, the The lack of white will appear in the nearest up, down, left, and right positions of the pixel unit 10 for color compensation (W L , W T , W R , and W D ). When performing color compensation processing, after the pixels of the original three-color system are converted by four colors, compared with the R I G I B I sub-pixels contained in the pixel unit 10, the redundant W I grayscale values can be output to the surrounding pixel units. The W sub-pixel area includes the W R sub-pixel of the pixel unit 12, the W T and W D sub-pixels of the pixel unit 14, and the W L sub-pixel of the pixel unit 16. On the other hand, after the three-color pixels corresponding to the pixel unit 12 are converted into the four-color data format in the same way, the grayscale value of the redundant sub-pixel B R is input to the B I area of the pixel unit 10; the three-color pixels corresponding to the pixel unit 14 After the pixel is converted into the four-color data format in the same way, the grayscale value of the redundant sub-pixels G T and G D is input to the G I area of the pixel unit 10; the three-color pixel corresponding to the pixel unit 16 is converted into the four-color pixel in the same way The grayscale value of the redundant sub-pixel R L after formatting is input to the R I region of the pixel unit 10 . Finally, as shown in Figure 5A, the RGB three-color compensation value input by the adjacent pixel unit and the original three-color pixel Pixel (I) are converted into the RGB three-color grayscale value in the four-color format, which can be respectively input to R, G, and B pixel correlators 24, 26, and 28 perform correlation operations according to a preset weight, and the obtained value is the gray scale value actually output by the R I G I B I sub-pixels of the first type of pixel unit 10 . The preset weights can be adjusted according to the displayed visual effects.

接着再由原三色系统像素中,选取下一个像素Pixel(I+1)进行运算处理,如图6A所示,Pixel(I+1)包含RI+1、GI+1、BI+1子像素。同样将Pixel(I+1)的RI+1、GI+1、及BI+1子像素灰阶值输入一四色转换元件22,利用任一种加白算法转换成RI+1GI+1BI+1WI+1四色数据格式,决定出子像素WI+1的灰阶值后,进行接续的色彩补偿处理。Then, from the original three-color system pixels, select the next pixel Pixel (I+1) for calculation and processing, as shown in Figure 6A, Pixel (I+1) includes R I+1 , G I+1 , B I+ 1 sub-pixel. Similarly, R I+1 , G I+1 , and B I+1 sub-pixel grayscale values of Pixel (I+1) are input into a four-color conversion element 22, and converted into R I+1 by using any whitening algorithm G I+1 B I+1 W I+1 four-color data format, after determining the grayscale value of the sub-pixel W I+1 , subsequent color compensation processing is performed.

图6B为示意图,显示当原三色系统的像素Pixel(I+1)转换为依本发明定义的第二类像素单元(包含WRG子像素)进行的色彩补偿过程。如图6B所示,本发明的四色系统所定义的第二类像素单元12包含WI+1RI+1GI+1子像素,通过本发明的像素布局安排,所缺少的蓝色会出现在像素单元12上下左右最邻近的位置(BL、BT、BR、及BD分属像素单元12周围的像素单元)以获得良好的色彩补偿效果。在进行色彩补偿处理时,原三色系统的像素经四色转换后,相较像素单元12所包含的WI+1RI+1GI+1子像素为多余的BI+1灰阶值可输出至周围像素单元的B子像素区域,包含像素单元10的BL子像素、像素单元14的BR子像素、及像素单元16的BT、BD子像素。另一方面,对应像素单元10的三色像素以相同方式转换为四色格式后多余的子像素WL,其灰阶值可输入至像素单元12的WI+1区域;对应像素单元14的三色像素以相同方式转换为四色格式后多余的子像素GR,其灰阶值可输入至像素单元12的GI+1区域;对应像素单元16的三色像素以相同方式转换为四色格式后多余的子像素RT及RD,其灰阶值可输入至像素单元12的RI+1区域。最后,再如图6A所示,由相邻像素单元输入的WRG三色补偿值、与原三色像素Pixel(I+1)经转换成四色格式中的WRG三色灰阶值,可分别输入至W、R及G像素相关器30、24及26,依一预设权重进行相关运算,所得出的数值即为第二类像素单元12的WI+1RI+1GI+1三色子像素实际输出的灰阶值。6B is a schematic diagram showing the color compensation process performed when the pixel Pixel (I+1) of the original three-color system is converted into the second type of pixel unit (including WRG sub-pixels) defined according to the present invention. As shown in FIG. 6B, the second type of pixel unit 12 defined by the four-color system of the present invention includes W I+1 R I+1 G I+1 sub-pixels, and through the pixel layout arrangement of the present invention, the missing blue It will appear at the most adjacent positions of the pixel unit 12 ( BL , BT , BR , and BD belong to the pixel units around the pixel unit 12) to obtain a good color compensation effect. When performing color compensation processing, after the pixels of the original three-color system are converted by four colors, compared with the W I+1 R I+1 G I+1 sub-pixels contained in the pixel unit 12, the redundant B I+1 gray scale The value can be output to the B sub-pixel area of the surrounding pixel unit, including the BL sub -pixel of the pixel unit 10, the BR sub -pixel of the pixel unit 14, and the BT , B D sub-pixels of the pixel unit 16. On the other hand, after the three-color pixels corresponding to the pixel unit 10 are converted to the four-color format in the same way, the grayscale value of the redundant sub-pixel W L can be input to the W I+1 area of the pixel unit 12; After the three-color pixel is converted into the four-color format in the same way, the grayscale value of the redundant sub-pixel G R can be input to the G I+1 area of the pixel unit 12; the three-color pixel corresponding to the pixel unit 16 is converted into the four-color format in the same way. The grayscale values of the redundant sub-pixels R T and R D after the color format can be input to the area R I+1 of the pixel unit 12 . Finally, as shown in Figure 6A, the WRG three-color compensation value input by the adjacent pixel unit and the original three-color pixel Pixel (I+1) are converted into the WRG three-color grayscale value in the four-color format, which can be respectively Input to the W, R, and G pixel correlators 30, 24, and 26, and perform a correlation operation according to a preset weight, and the obtained value is W I+1 R I+1 G I+1 of the second type of pixel unit 12 The grayscale value actually output by the three-color sub-pixel.

同样再由原三色系统中选取像素,依序转换为第三类像素单元14(BWR子像素构成)及第四类像素单元16(GBW子像素构成),直至所有三色像素均转换为本发明所定义的如图4A至4D所示的四类四色系统像素单元为止。Similarly, the selected pixels from the original three-color system are sequentially converted into the third type of pixel unit 14 (composed of BWR sub-pixels) and the fourth type of pixel unit 16 (composed of GBW sub-pixels), until all the three-color pixels are converted into original The invention defines four types of four-color system pixel units as shown in FIGS. 4A to 4D .

图7为一流程图,说明本发明多色数据处理方法的步骤。Fig. 7 is a flowchart illustrating the steps of the multicolor data processing method of the present invention.

步骤S0:开始。Step S0: start.

步骤S2:撷取原三色系统的一像素单元的R、G、B子像素图像数据进行四色转换处理,以将所述图像数据转换为RGBW四色灰阶值。Step S2: Capture the R, G, and B sub-pixel image data of a pixel unit in the original three-color system to perform four-color conversion processing, so as to convert the image data into RGBW four-color grayscale values.

步骤S4:选择依本发明定义的四类像素单元其中之一作为一选取像素单元,并比较所述选取像素单元子像素色彩与所述RGBW四色灰阶值。所述四色灰阶值同时包含属于所述选取像素单元的子像素色彩的灰阶值及其余不属于所述选取像素单元的子像素色彩的灰阶值。Step S4: Select one of the four types of pixel units defined in the present invention as a selected pixel unit, and compare the sub-pixel color of the selected pixel unit with the RGBW four-color gray scale value. The four-color gray scale values include the gray scale values of the sub-pixel colors belonging to the selected pixel unit and the gray scale values of other sub-pixel colors not belonging to the selected pixel unit.

步骤S6:将所述四色灰阶值中不属于选取像素单元的子像素色彩灰阶值输出至邻接像素单元,且同时令选取像素单元接收邻接像素单元输入的子像素灰阶值。Step S6: Output the sub-pixel color gray-scale values of the four-color gray-scale values that do not belong to the selected pixel unit to adjacent pixel units, and at the same time make the selected pixel unit receive the sub-pixel gray-scale values input from the adjacent pixel units.

步骤S8:对邻接像素单元输入的灰阶值与所述四色灰阶值中属于选取像素单元的子像素色彩的灰阶值进行相关系数运算,以决定选取像素单元各子像素实际输出的灰阶值。Step S8: Carry out a correlation coefficient calculation between the grayscale value input by the adjacent pixel unit and the grayscale value of the sub-pixel color belonging to the selected pixel unit among the four-color grayscale values, so as to determine the grayscale actually output by each sub-pixel of the selected pixel unit order value.

步骤S10:将三色系统的像素单元依序转换为本发明定义的四色系统像素单元,并判断原三色系统的所有像素单元是否均已转换完毕,若是,进行下一步骤;若否,跳回步骤S2。Step S10: Convert the pixel units of the three-color system into the pixel units of the four-color system defined in the present invention in sequence, and judge whether all the pixel units of the original three-color system have been converted, if so, go to the next step; if not, Jump back to step S2.

步骤S12:结束。Step S12: end.

通过本发明于四色数据格式转换同时搭配色彩补偿运算的数据处理方法,可使由三个子像素所定义的一像素单元,成为RGBW四色系统下的一个有效显示像素单元。因此,本发明在加入白色子像素以提高亮度的情况下,仍能维持原RGB三色系统的分辨率,且RGB三色子像素的面积仍能保持不变,而白色子像素的面积也可同于其它三色的子像素面积,获得一兼顾分辨率与亮度的最佳化设计。Through the data processing method of the present invention in which four-color data format conversion is combined with color compensation calculation, a pixel unit defined by three sub-pixels can become an effective display pixel unit under the RGBW four-color system. Therefore, the present invention can still maintain the resolution of the original RGB three-color system when adding white sub-pixels to increase the brightness, and the area of the RGB three-color sub-pixels can still remain unchanged, and the area of the white sub-pixels can also be changed. Similar to the sub-pixel area of other three colors, an optimal design with both resolution and brightness is obtained.

再者,本发明利用四色转换元件40进行的加白演算处理方式并不限定。举例而言,可如图8所示的台湾专利公开公报200424952号所揭露方法,利用一γ转换元件42、一再映像元件44、一数据设定元件46、一白抽取元件48及一反γ转换元件50,有效将RGB三色灰阶数据转换为R’G’B’W’四色灰阶数据。Furthermore, the method of whitening calculation processing performed by the four-color conversion element 40 in the present invention is not limited. For example, the method disclosed in Taiwan Patent Publication No. 200424952 as shown in FIG. The element 50 effectively converts RGB three-color grayscale data into R'G'B'W' four-color grayscale data.

本发明的像素布局仅需满足位于同一横列的两相邻子像素色彩相异,且分别位于两相邻横列中的两同一色彩子像素,彼此沿排列方向形成两个子像素位置的错位即可,至于RGBW排列位置则可做任意变化。如图9显示另一排列方式,其中依本发明定义的像素单元分别为GBR像素单元60、BRW像素单元62、RWG像素单元64及WGB像素单元66。The pixel layout of the present invention only needs to meet the requirement that two adjacent sub-pixels located in the same row have different colors, and two sub-pixels of the same color respectively located in two adjacent rows form dislocations of two sub-pixel positions along the arrangement direction. As for the arrangement position of RGBW, it can be changed arbitrarily. FIG. 9 shows another arrangement, wherein the pixel units defined according to the present invention are GBR pixel unit 60 , BRW pixel unit 62 , RWG pixel unit 64 and WGB pixel unit 66 .

另外,本发明的像素排列布局并不限定为使用RGB三原色子像素,而可为任何能够提供各种混色的三个基础色相子像素。举例而言,也可利用于减色混合场合使用的滤光片,形成青绿色(C)、紫红色(M)及黄色(Y)的子像素排列。如图10显示的CMYW像素布局排列,其中依本发明定义的像素单元分别为CMY像素单元70、MYW像素单元72、YWC像素单元74、WCM像素单元76。又,本发明的W子像素其色彩并不限定为白色,仅需为红(R)、绿(G)及蓝(B)三原色中至少两种混合所形成的混色,达到有效提高亮度的效果即可。In addition, the pixel arrangement of the present invention is not limited to using RGB three primary color sub-pixels, but can be any three basic hue sub-pixels that can provide various mixed colors. For example, the color filters used in subtractive color mixing can also be used to form cyan (C), magenta (M) and yellow (Y) sub-pixel arrangements. As shown in FIG. 10 , the CMYW pixel layout is arranged, wherein the pixel units defined according to the present invention are CMY pixel unit 70 , MYW pixel unit 72 , YWC pixel unit 74 , and WCM pixel unit 76 . Moreover, the color of the W sub-pixel of the present invention is not limited to white, but only needs to be a mixed color formed by mixing at least two of the three primary colors of red (R), green (G) and blue (B), so as to effectively improve the brightness That's it.

另外,虽然本发明的多色处理方法,搭配本发明同时提出的像素布局其色彩补偿效果最佳,因一定义的像素单元所欠缺的颜色可同时出现在所述像素单元的上下左右四个方向,但本发明的数据处理方法也可视实际需求搭配其它像素布局。举例而言,如图11所示,若采用图2A的现有RGBW布局,搭配本发明的像素定义及数据处理方法,也可获得一个维度(左方及右方)的色彩补偿效果。In addition, although the multi-color processing method of the present invention is combined with the pixel layout proposed by the present invention, its color compensation effect is the best, because the color lacking in a defined pixel unit can appear in the four directions of the pixel unit at the same time: up, down, left, and right , but the data processing method of the present invention can also be matched with other pixel layouts according to actual needs. For example, as shown in FIG. 11 , if the existing RGBW layout in FIG. 2A is adopted, and the pixel definition and data processing method of the present invention are used, a color compensation effect of one dimension (left and right) can also be obtained.

上述具体实施例仅由于说明本发明,但并非用于限制本发明。The above specific embodiments are only for illustrating the present invention, but not for limiting the present invention.

Claims (12)

1. polychrome data processing method, it is characterized in that, these polychrome data are the display pixel layout that forms with three basic form and aspect sub-pixels and a blast arrangement of subpixels, and choose the selected pixels unit that three sub-pixels constitute described pixel layout wantonly in four sub-pixels, this method comprises the steps:
Three basic form and aspect sub-pixel view data of the former trichromatic system of the described selected pixels of correspondence unit are converted to four chromatic number values, and this four chromatic numbers value comprises first numerical value of the subpixel colors that belongs to described selected pixels unit and does not belong to the second value of the subpixel colors of described selected pixels unit;
Make a plurality of adjacent pixels unit input adjacent belong to the third value of the subpixel colors of described selected pixels unit with described selected pixels unit; And
Described first numerical value and third value are carried out the coefficient correlation computing, to determine the actual numerical value of each subpixel colors of described selected pixels unit.
2. polychrome data processing method according to claim 1 is characterized in that, described second value exports all described adjacent pixels unit to.
3. polychrome data processing method according to claim 1, it is characterized in that, the subpixel colors that described four chromatic number values are short of is compared in described selected pixels unit, is present in the sub-pixel position of the most contiguous described selected pixels unit in the described adjacent pixels unit.
4. polychrome data processing method according to claim 1 is characterized in that, described numerical value is the GTG value of color.
5. polychrome data processing method according to claim 1 is characterized in that, the color of described blast sub-pixel is at least two kinds of formed colour mixtures of mixing in red, green and the primary colors; Described basic form and aspect sub-pixel be red, green and blue or dark green, purplish red and yellow two groups of sub-pixels one of them.
6. polychrome data processing method, it is characterized in that, these polychrome data are the display pixel layout that forms with three basic form and aspect sub-pixels and a blast arrangement of subpixels, and choose the selected pixels unit that three sub-pixels constitute described pixel layout wantonly in four sub-pixels, the two adjacent subpixel colors that wherein are positioned at same line are different, and lay respectively at two same color sub-pixels in the two adjacent lines form two sub-pixel position each other along orientation dislocation, this method comprises the steps:
Three basic form and aspect sub-pixel view data of the former trichromatic system of the described selected pixels of correspondence unit are converted to four chromatic number values, and this four chromatic numbers value comprises first numerical value of the subpixel colors that belongs to described selected pixels unit and does not belong to the second value of the subpixel colors of described selected pixels unit;
Make a plurality of adjacent pixels unit input adjacent belong to the third value of the subpixel colors of described selected pixels unit with described selected pixels unit; And
Described first numerical value and third value are carried out the coefficient correlation computing, to determine the actual numerical value of each subpixel colors of described selected pixels unit.
7. polychrome data processing method according to claim 6, it is characterized in that, described second value exports all described adjacent pixels unit to, and each described adjacent pixels unit all has described selected pixels unit and compares the subpixel colors that described four chromatic number values are short of.
8. polychrome data processing method according to claim 6 is characterized in that, described numerical value is the GTG value of color.
9. polychrome data processing method according to claim 6 is characterized in that, the color of described blast sub-pixel is at least two kinds of formed colour mixtures of mixing in red, green and the primary colors; Described basic form and aspect sub-pixel be red, green and blue or dark green, purplish red and yellow two groups of sub-pixels one of them.
10. a display pixel layout is characterized in that, comprising:
Each line that constitutes by three basic form and aspect sub-pixels and a blast sub-pixel of multiple tracks, the two adjacent subpixel colors that wherein are positioned at same line are different, and lay respectively at two same color sub-pixels in the two adjacent lines form two sub-pixel position each other along orientation dislocation.
11. display pixel layout according to claim 10 is characterized in that, the area of each sub-pixel is identical.
12. display pixel layout according to claim 10 is characterized in that, the color of described blast sub-pixel is at least two kinds of formed colour mixtures of mixing in red, green and the primary colors; Described basic form and aspect sub-pixel be red, green and blue or dark green, purplish red and yellow two groups of sub-pixels one of them.
CNA2005101090237A 2005-10-13 2005-10-13 Multi-color data processing method and display pixel layout for the method Pending CN1949885A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CNA2005101090237A CN1949885A (en) 2005-10-13 2005-10-13 Multi-color data processing method and display pixel layout for the method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CNA2005101090237A CN1949885A (en) 2005-10-13 2005-10-13 Multi-color data processing method and display pixel layout for the method

Publications (1)

Publication Number Publication Date
CN1949885A true CN1949885A (en) 2007-04-18

Family

ID=38019234

Family Applications (1)

Application Number Title Priority Date Filing Date
CNA2005101090237A Pending CN1949885A (en) 2005-10-13 2005-10-13 Multi-color data processing method and display pixel layout for the method

Country Status (1)

Country Link
CN (1) CN1949885A (en)

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101489143B (en) * 2008-01-14 2010-12-08 胜华科技股份有限公司 Image processing method, image data conversion method and device
TWI385638B (en) * 2007-12-21 2013-02-11 Wintek Corp Method for processing image, method and device for converting data of image
CN103680399A (en) * 2012-09-19 2014-03-26 三星显示有限公司 Display device and method of driving the same
CN104795052A (en) * 2015-05-14 2015-07-22 京东方科技集团股份有限公司 RGBW (Red, Green, Blue and White) signal conversion method and system
CN104977748A (en) * 2015-07-17 2015-10-14 京东方科技集团股份有限公司 Color film substrate, manufacturing method thereof, display device and manufacturing method thereof
CN107872722A (en) * 2016-07-22 2018-04-03 Lg电子株式会社 Image display
WO2018113614A1 (en) * 2016-12-20 2018-06-28 惠科股份有限公司 Liquid crystal display device and driving method therefor
WO2020093461A1 (en) * 2018-11-07 2020-05-14 惠科股份有限公司 Pixel signal conversion method and device, and computer device
CN114067721A (en) * 2021-12-15 2022-02-18 南京国兆光电科技有限公司 Subpixel rendering method for RGBW-Pentile arrangement
CN115223486A (en) * 2022-08-12 2022-10-21 京东方数字科技有限公司 Display control method, display device, and readable storage medium

Cited By (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI385638B (en) * 2007-12-21 2013-02-11 Wintek Corp Method for processing image, method and device for converting data of image
CN101489143B (en) * 2008-01-14 2010-12-08 胜华科技股份有限公司 Image processing method, image data conversion method and device
CN103680399A (en) * 2012-09-19 2014-03-26 三星显示有限公司 Display device and method of driving the same
CN104795052A (en) * 2015-05-14 2015-07-22 京东方科技集团股份有限公司 RGBW (Red, Green, Blue and White) signal conversion method and system
CN104977748A (en) * 2015-07-17 2015-10-14 京东方科技集团股份有限公司 Color film substrate, manufacturing method thereof, display device and manufacturing method thereof
CN107872722A (en) * 2016-07-22 2018-04-03 Lg电子株式会社 Image display
WO2018113614A1 (en) * 2016-12-20 2018-06-28 惠科股份有限公司 Liquid crystal display device and driving method therefor
WO2020093461A1 (en) * 2018-11-07 2020-05-14 惠科股份有限公司 Pixel signal conversion method and device, and computer device
US11403986B2 (en) 2018-11-07 2022-08-02 HKC Corporation Limited Pixel signal conversion method and device, and computer device
CN114067721A (en) * 2021-12-15 2022-02-18 南京国兆光电科技有限公司 Subpixel rendering method for RGBW-Pentile arrangement
CN115223486A (en) * 2022-08-12 2022-10-21 京东方数字科技有限公司 Display control method, display device, and readable storage medium

Similar Documents

Publication Publication Date Title
CN1266951C (en) Method and apparatus for reproducing picture signal
US20070159492A1 (en) Image processing method and pixel arrangement used in the same
CN102622981B (en) Method and driver for displaying sub-pixels for color display with triangular structure
CN1809936A (en) Stacked organic light-emitting diode displays with enhanced efficiency
CN1656529A (en) pixel glitch masking
CN104299599B (en) Conversion system and conversion method from RGB data to WRGB data
CN1875396A (en) Method for converting a three-color input signal into a more color signal
JP2008538615A5 (en)
WO2017045286A1 (en) Pixel rendering method, pixel rendering device and display
WO2016150041A1 (en) Pixel arrangement method, pixel rendering method and image display apparatus
CN1661664A (en) Method for displaying an image, image display apparatus, method for driving an image display apparatus and apparatus for driving an image display panel
CN101489143B (en) Image processing method, image data conversion method and device
CN101076848A (en) Method and equipment for converting into target color space from source color space
CN1708097A (en) Color gamut mapping device and method using vector stretching
CN102714000A (en) Display device
CN105182639B (en) Dot structure, display methods and display panel
CN107331341A (en) The rendering intent and system of one sub-pixel
CN104778929B (en) A kind of conversion method and converting system of the driving data of display panel
CN1949885A (en) Multi-color data processing method and display pixel layout for the method
CN1837908A (en) Image display device and electronic apparatus
WO2017101191A1 (en) Pixel rendering method, pixel rendering device, and display device
CN106875923A (en) A kind of pixel rendering method and pixel rendering device
CN101076844A (en) Pixel layout for displays
CN1928642A (en) Electro-optical device and electronic apparatus
TWI571857B (en) Display device and driving method thereof

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C02 Deemed withdrawal of patent application after publication (patent law 2001)
WD01 Invention patent application deemed withdrawn after publication