WO2015100732A1 - A padding method for intra block copying - Google Patents
A padding method for intra block copying Download PDFInfo
- Publication number
- WO2015100732A1 WO2015100732A1 PCT/CN2014/070085 CN2014070085W WO2015100732A1 WO 2015100732 A1 WO2015100732 A1 WO 2015100732A1 CN 2014070085 W CN2014070085 W CN 2014070085W WO 2015100732 A1 WO2015100732 A1 WO 2015100732A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- padding
- value
- overlapped area
- true
- sample
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/593—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving spatial prediction techniques
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/103—Selection of coding mode or of prediction mode
- H04N19/105—Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/157—Assigned coding mode, i.e. the coding mode being predefined or preselected to be further used for selection of another element or parameter
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/182—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a pixel
Definitions
- the invention relates generally to video processing.
- the presented invention relates to intra block copying.
- Intra block copying (Intra BC) was adopted to take advantage of reduplicated content in a picture.
- a reference block in the current picture is copied to the current block as the prediction if Intra BC is applied.
- the samples in the reference block must have been reconstructed already before the current block is coded or decoded. Thus the reference block cannot be overlapped with the current block as demonstrated in Fig.2.
- JCTVC-O0122 and JCTVC-O0157 proposed to extend Intra BC mode when the reference block is overlapped with the current block at Geneva meeting. Unreconstructed samples are proposed to be padded horizontally or vertically.
- Fig. 3 shows an example of samples in the reference block and in the current block when they are overlapped. It is assumed that the quantization distortion is zero for simplification.
- sample A is estimated to be equal to sample B, which is white. But since A is in the overlapped area, it is also estimated to be equal to sample D which is black in the horizontal padding process as shown in Fig. 4. So the estimation for sample A is contrary in the prediction and padding process.
- Fig. 1 is a diagram illustrating Intra block copying
- Fig. 2 is a diagram illustrating the case in which the reference block and the current block are overlapped
- Fig. 3 is a diagram illustrating an example of samples when the reference block and the current block are overlapped;
- Fig. 4 is a diagram illustrating horizontal padding;
- Fig. 5 is a diagram illustrating true padding in a cascading way.
- a true padding method is proposed to pad the unreconstructed samples in the overlapped area as its prediction samples directly to overcome the contradiction.
- a sample in the overlapped area is in the reference block as well as in the current block. As a sample in the current block, it should be predicted to a prediction value in the prediction process. As a sample in the reference block, it should be padded to a padding value in the padding process on the other hand. In the true padding method, the prediction value in the prediction process is treated as the padding value directly.
- sample A is estimated to be equal to sample B which is white in the Intra BC prediction process.
- A is estimated to be equal to its predicted value, i.e. B, in the true padding process.
- the estimation for sample A is the same in the prediction and padding process.
- samples drawn in the overlapped area can just be considered as the padding values.
- A is predicted as white, thus its padding value is also white.
- C is predicted by ⁇ 4, it will be predicted as ⁇ 4's padding value, white.
- the padding values after the true padding process are filtered before they are used to predict corresponding samples in the current block.
- A's padding values is filtered, before it is used to predict C.
- the filter could involve padding values or reconstructed values of sample A and its neighboring samples.
- true-padding could be conducted in a cascading way.
- a sample X in the overlapped area can be padded as its prediction P.
- This padding value can be used as the prediction for anther sample Y in the overlapped area, which is also the padding value for Y.
- another sample Z can be predicted by Y.
- Fig. 5 demonstrated the cascading padding rule.
- an embodiment of the present invention can be a circuit integrated into a video compression chip or program codes integrated into video compression software to perform the processing described herein.
- An embodiment of the present invention may also be program codes to be executed on a Digital Signal Processor (DSP) to perform the processing described herein.
- DSP Digital Signal Processor
- the invention may also involve a number of functions to be performed by a computer processor, a digital signal processor, a microprocessor, or field programmable gate array (FPGA).
- processors can be configured to perform particular tasks according to the invention, by executing machine-readable software code or firmware code that defines the particular methods embodied by the invention.
- the software code or firmware codes may be developed in different programming languages and different format or style.
- the software code may also be compiled for different target platform.
- different code formats, styles and languages of software codes and other means of configuring code to perform the tasks in accordance with the invention will not depart from the spirit and scope of the invention.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
- Compression, Expansion, Code Conversion, And Decoders (AREA)
Abstract
In the current HEVC range extensions draft specification, Intra block copying (Intra BC) was adopted to take advantage of reduplicated content in a picture. In Intra BC mode, the samples in the reference block must have been reconstructed already. Thus the reference block cannot be overlapped with the current block. A true-padding method is proposed to remove such a constrain. An unreconstructed sample in the reference block is estimated by its prediction.
Description
A PADDING METHOD FOR INTRA BLOCK COPYING
TECHNICAL FIELD
[0001] The invention relates generally to video processing. In particular, the presented invention relates to intra block copying. BACKGROUND
[0002] In the current HEVC range extensions draft specification [1], Intra block copying (Intra BC) was adopted to take advantage of reduplicated content in a picture. As depicted in Fig. l, a reference block in the current picture is copied to the current block as the prediction if Intra BC is applied. The samples in the reference block must have been reconstructed already before the current block is coded or decoded. Thus the reference block cannot be overlapped with the current block as demonstrated in Fig.2.
[0003] JCTVC-O0122 and JCTVC-O0157 proposed to extend Intra BC mode when the reference block is overlapped with the current block at Geneva meeting. Unreconstructed samples are proposed to be padded horizontally or vertically.
[0004] There is an intrinsic contradiction in the horizontal or vertical padding method. Fig. 3 shows an example of samples in the reference block and in the current block when they are overlapped. It is assumed that the quantization distortion is zero for simplification. In the Intra BC prediction process, sample A is estimated to be equal to sample B, which is white. But since A is in the overlapped area, it is also estimated to be equal to sample D which is black in the horizontal padding process as shown in Fig. 4. So the estimation for sample A is contrary in the prediction and padding process.
SUMMARY [0005] In light of the previously described problems, A true-padding method is proposed to estimate an unreconstructed sample in the reference block by its prediction.
[0006] Other aspects and features of the invention will become apparent to those with ordinary skill in the art upon review of the following descriptions of specific embodiments.
BRIEF DESCRIPTION OF DRAWINGS
The invention can be more fully understood by reading the subsequent detailed description and examples with references made to the accompanying drawings, wherein:
[0007] Fig. 1 is a diagram illustrating Intra block copying; [0008] Fig. 2 is a diagram illustrating the case in which the reference block and the current block are overlapped;
[0009] Fig. 3 is a diagram illustrating an example of samples when the reference block and the current block are overlapped; [0010] Fig. 4 is a diagram illustrating horizontal padding; [0011] Fig. 5 is a diagram illustrating true padding in a cascading way.
DETAILED DESCRIPTION
[0012] The following description is of the best-contemplated mode of carrying out the invention. This description is made for the purpose of illustrating the general principles of the invention and should not be taken in a limiting sense. The scope of the invention is best determined by reference to the appended claims.
[0013] A true padding method is proposed to pad the unreconstructed samples in the overlapped area as its prediction samples directly to overcome the contradiction.
[0014] A sample in the overlapped area is in the reference block as well as in the current block. As a sample in the current block, it should be predicted to a prediction value in the prediction process. As a sample in the reference block, it should be padded to a padding value in the padding process on the other hand. In the true
padding method, the prediction value in the prediction process is treated as the padding value directly.
[0015] Still taking Fig. 2 as an example, sample A is estimated to be equal to sample B which is white in the Intra BC prediction process. And A is estimated to be equal to its predicted value, i.e. B, in the true padding process. As a result, the estimation for sample A is the same in the prediction and padding process. In the example in Fig.2, samples drawn in the overlapped area can just be considered as the padding values. For example, A is predicted as white, thus its padding value is also white. When C is predicted by ^4, it will be predicted as ^4's padding value, white.
[0016] In another embodiment, the padding values after the true padding process are filtered before they are used to predict corresponding samples in the current block. In the example, A's padding values is filtered, before it is used to predict C. The filter could involve padding values or reconstructed values of sample A and its neighboring samples.
[0017] In still another embodiment, true-padding could be conducted in a cascading way. A sample X in the overlapped area can be padded as its prediction P. This padding value can be used as the prediction for anther sample Y in the overlapped area, which is also the padding value for Y. Then another sample Z can be predicted by Y. Fig. 5 demonstrated the cascading padding rule.
[0018] The methods described above can be used in a video encoder as well as in a video decoder. Embodiments of disparity vector derivation methods according to the present invention as described above may be implemented in various hardware, software codes, or a combination of both. For example, an embodiment of the present invention can be a circuit integrated into a video compression chip or program codes integrated into video compression software to perform the processing described herein. An embodiment of the present invention may also be program codes to be executed on a Digital Signal Processor (DSP) to perform the processing described herein. The invention may also involve a number of functions to be performed by a computer processor, a digital signal processor, a microprocessor, or field programmable gate array (FPGA). These processors can be configured to perform particular tasks according to the invention, by executing machine-readable software code or firmware code that defines the particular methods embodied by the invention. The software code or firmware codes may be developed in different programming languages and different format or style. The software code may also be compiled for different target
platform. However, different code formats, styles and languages of software codes and other means of configuring code to perform the tasks in accordance with the invention will not depart from the spirit and scope of the invention.
[0019] The invention may be embodied in other specific forms without departing from its spirit or essential characteristics. The described examples are to be considered in all respects only as illustrative and not restrictive. To the contrary, it is intended to cover various modifications and similar arrangements (as would be apparent to those skilled in the art). Therefore, the scope of the appended claims should be accorded the broadest interpretation so as to encompass all such modifications and similar arrangements.
Claims
1. A method of padding samples in intra block copying process, wherein the samples are padded when a reference block is overlapped with a current block.
2. The method as claimed in claim 1, wherein a prediction value in a prediction process is treated as a padding value for a sample in an overlapped area, and the method is named as true padding.
3. The method as claimed in claim 2, wherein the padding value for the sample in the overlapped area is used to predict other samples in the current block.
4. The method as claimed in claim 3, wherein the prediction and padding process are conducted in a cascading way; the prediction value in the prediction process is treated as the padding value for a sample A in the overlapped area; the padding value is used to predict a sample B in the current block; and if B is also in the overlapped area, its prediction value is again treated as the padding value for B.
5. The method as claimed in claim 3, wherein the padding value is filtered before it is used to predict other samples in the current block.
6. The method as claimed in claim 5, wherein the filtering process for a sample involves the padding value for the sample and the padding or reconstructed values of its neighboring samples.
7. The method as claimed in claim 3, wherein the true padding method is used or not used conditionally.
8. The method as claimed in claim 7, wherein an encoder informs a decoder explicitly whether true-padding is used or not.
9. The method as claimed in claim 8, wherein information is on a video level, sequence level, picture level, slice level, or block level.
10. The method as claimed in claim 1, wherein there are several padding methods, and the padding methods are switched conditionally.
11. The method as claimed in claim 10, wherein the true padding method is combined with other padding method; and the true padding method is switched to conditionally.
12. The method as claimed in claim 11, wherein the true padding method is switched to under conditions such as but not limited to: the overlapped area is larger than a first size; the overlapped area is smaller than a second size; a width or height of the overlapped are is larger than a third value; the width or height of the overlapped area is smaller than a fourth value; the width of the overlapped area is equal to or not equal to that of the current block; the height of the overlapped area is equal or not equal to that of the current block; or any combination thereof.
13. The method as claimed in claim 3, wherein the true padding method is applied to all color components.
14. The method as claimed in claim 3, wherein the true padding method is applied to the whole overlapped area, or only a part of the overlapped area.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| PCT/CN2014/070085 WO2015100732A1 (en) | 2014-01-03 | 2014-01-03 | A padding method for intra block copying |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| PCT/CN2014/070085 WO2015100732A1 (en) | 2014-01-03 | 2014-01-03 | A padding method for intra block copying |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2015100732A1 true WO2015100732A1 (en) | 2015-07-09 |
Family
ID=53493039
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/CN2014/070085 Ceased WO2015100732A1 (en) | 2014-01-03 | 2014-01-03 | A padding method for intra block copying |
Country Status (1)
| Country | Link |
|---|---|
| WO (1) | WO2015100732A1 (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2020125629A1 (en) * | 2018-12-17 | 2020-06-25 | Beijing Bytedance Network Technology Co., Ltd. | Reference pixels padding for motion compensation |
| EP4492794A3 (en) * | 2016-10-04 | 2025-04-02 | B1 Institute of Image Technology, Inc. | Image data encoding/decoding method and apparatus |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101969562A (en) * | 2010-10-27 | 2011-02-09 | 北京中星微电子有限公司 | Method for coding video frame with non 16 integral multiple height or width and coder |
| CN102595118A (en) * | 2011-01-14 | 2012-07-18 | 华为技术有限公司 | A prediction method and predictor in encoding and decoding |
| US20120263241A1 (en) * | 2011-04-15 | 2012-10-18 | Skyfire Labs, Inc. | Real-Time Audio or Video Transcoding |
| US20130128986A1 (en) * | 2011-11-23 | 2013-05-23 | Mediatek Inc. | Method and Apparatus of Slice Boundary Padding for Loop Filtering |
-
2014
- 2014-01-03 WO PCT/CN2014/070085 patent/WO2015100732A1/en not_active Ceased
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101969562A (en) * | 2010-10-27 | 2011-02-09 | 北京中星微电子有限公司 | Method for coding video frame with non 16 integral multiple height or width and coder |
| CN102595118A (en) * | 2011-01-14 | 2012-07-18 | 华为技术有限公司 | A prediction method and predictor in encoding and decoding |
| US20120263241A1 (en) * | 2011-04-15 | 2012-10-18 | Skyfire Labs, Inc. | Real-Time Audio or Video Transcoding |
| US20130128986A1 (en) * | 2011-11-23 | 2013-05-23 | Mediatek Inc. | Method and Apparatus of Slice Boundary Padding for Loop Filtering |
Cited By (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US12483794B2 (en) | 2016-10-04 | 2025-11-25 | B1 Institute Of Image Technology, Inc. | Image data encoding/decoding method and apparatus |
| EP4492794A3 (en) * | 2016-10-04 | 2025-04-02 | B1 Institute of Image Technology, Inc. | Image data encoding/decoding method and apparatus |
| US12389123B2 (en) | 2016-10-04 | 2025-08-12 | B1 Institute Of Image Technology, Inc. | Image data encoding/decoding method and apparatus |
| US12464244B2 (en) | 2016-10-04 | 2025-11-04 | B1 Institute Of Image Technology, Inc. | Image data encoding/decoding method and apparatus |
| US12489979B2 (en) | 2016-10-04 | 2025-12-02 | B1 Institute Of Image Technology, Inc. | Image data encoding/decoding method and apparatus |
| US12501167B2 (en) | 2016-10-04 | 2025-12-16 | B1 Institute Of Image Technology, Inc. | Image data encoding/decoding method and apparatus |
| US12506968B2 (en) | 2016-10-04 | 2025-12-23 | B1 Institute Of Image Technology, Inc. | Image data encoding/decoding method and apparatus |
| US12506969B2 (en) | 2016-10-04 | 2025-12-23 | B1 Institute Of Image Technology, Inc. | Image data encoding/decoding method and apparatus |
| US12513405B2 (en) | 2016-10-04 | 2025-12-30 | B1 Institute Of Image Technology, Inc. | Image data encoding/decoding method and apparatus |
| US12520046B2 (en) | 2016-10-04 | 2026-01-06 | B1 Institute Of Image Technology, Inc. | Image data encoding/decoding method and apparatus |
| CN113196777A (en) * | 2018-12-17 | 2021-07-30 | 北京字节跳动网络技术有限公司 | Reference pixel filling for motion compensation |
| CN113196777B (en) * | 2018-12-17 | 2024-04-19 | 北京字节跳动网络技术有限公司 | Reference pixel padding for motion compensation |
| WO2020125629A1 (en) * | 2018-12-17 | 2020-06-25 | Beijing Bytedance Network Technology Co., Ltd. | Reference pixels padding for motion compensation |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2017173593A1 (en) | Separate coding secondary transform syntax elements for different color components | |
| WO2015180014A1 (en) | An improved merge candidate list construction method for intra block copy | |
| WO2017035831A1 (en) | Adaptive inter prediction | |
| US10334281B2 (en) | Method of conditional binary tree block partitioning structure for video and image coding | |
| WO2017143467A1 (en) | Localized luma mode prediction inheritance for chroma coding | |
| US10924746B2 (en) | Method and apparatus for adaptive motion vector precision | |
| WO2017139937A1 (en) | Advanced linear model prediction for chroma coding | |
| WO2016090568A1 (en) | Binary tree block partitioning structure | |
| WO2017016468A1 (en) | Method of system for video coding using intra block copy mode | |
| WO2016008157A1 (en) | Methods for motion compensation using high order motion model | |
| WO2015085575A1 (en) | Methods for background residual prediction | |
| EP4022914A1 (en) | Method and apparatus for adaptive loop filtering at picture and sub-picture boundary in video coding | |
| WO2017219342A1 (en) | Methods of signaling quantization parameter for quad-tree plus binary tree structure | |
| US10412402B2 (en) | Method and apparatus of intra prediction in video coding | |
| TWI839923B (en) | Method and apparatus for prediction based on cross component linear model in video coding system | |
| WO2015135175A1 (en) | Simplified depth based block partitioning method | |
| WO2015192372A1 (en) | A simplified method for illumination compensation in multi-view and 3d video coding | |
| WO2015180166A1 (en) | Improved intra prediction mode coding | |
| WO2016065538A1 (en) | Guided cross-component prediction | |
| WO2013102299A1 (en) | Residue quad tree depth for chroma components | |
| WO2015100732A1 (en) | A padding method for intra block copying | |
| WO2016123749A1 (en) | Deblocking filtering with adaptive motion vector resolution | |
| WO2016115736A1 (en) | Additional intra prediction modes using cross-chroma-component prediction | |
| WO2016205999A1 (en) | Adaptive coding group for image/video coding | |
| WO2015131404A1 (en) | Methods for depth map coding |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 14876750 Country of ref document: EP Kind code of ref document: A1 |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 14876750 Country of ref document: EP Kind code of ref document: A1 |