[go: up one dir, main page]

WO2012155553A1 - Apparatus and method of sample adaptive offset for luma and chroma components - Google Patents

Apparatus and method of sample adaptive offset for luma and chroma components Download PDF

Info

Publication number
WO2012155553A1
WO2012155553A1 PCT/CN2012/071147 CN2012071147W WO2012155553A1 WO 2012155553 A1 WO2012155553 A1 WO 2012155553A1 CN 2012071147 W CN2012071147 W CN 2012071147W WO 2012155553 A1 WO2012155553 A1 WO 2012155553A1
Authority
WO
WIPO (PCT)
Prior art keywords
loop filter
chroma
block
information
blocks
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2012/071147
Other languages
French (fr)
Inventor
Chih-Ming Fu
Ching-Yeh Chen
Chia-Yang Tsai
Yu-Wen Huang
Shaw-Min Lei
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
MediaTek Inc
Original Assignee
MediaTek Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US13/158,427 external-priority patent/US9055305B2/en
Priority claimed from US13/311,953 external-priority patent/US20120294353A1/en
Application filed by MediaTek Inc filed Critical MediaTek Inc
Priority to CN201280022870.8A priority Critical patent/CN103535035B/en
Priority to DE112012002125.8T priority patent/DE112012002125T5/en
Priority to GB1311592.8A priority patent/GB2500347B/en
Publication of WO2012155553A1 publication Critical patent/WO2012155553A1/en
Priority to ZA2013/05528A priority patent/ZA201305528B/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/80Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation
    • H04N19/82Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation involving filtering within a prediction loop
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/85Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression
    • H04N19/86Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression involving reduction of coding artifacts, e.g. of blockiness
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/117Filters, e.g. for pre-processing or post-processing
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/146Data rate or code amount at the encoder output
    • H04N19/147Data rate or code amount at the encoder output according to rate distortion criteria
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/156Availability of hardware or computational resources, e.g. encoding based on power-saving criteria
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/157Assigned coding mode, i.e. the coding mode being predefined or preselected to be further used for selection of another element or parameter
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/176Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/182Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a pixel
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/186Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a colour or a chrominance component
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/189Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the adaptation method, adaptation tool or adaptation type used for the adaptive coding
    • H04N19/196Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the adaptation method, adaptation tool or adaptation type used for the adaptive coding being specially adapted for the computation of encoding parameters, e.g. by averaging previously computed encoding parameters
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/46Embedding additional information in the video signal during the compression process
    • H04N19/463Embedding additional information in the video signal during the compression process by compressing encoding parameters before transmission
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/60Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
    • H04N19/61Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding in combination with predictive coding
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/70Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/85Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/90Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using coding techniques not provided for in groups H04N19/10-H04N19/85, e.g. fractals
    • H04N19/96Tree coding, e.g. quad-tree coding

Definitions

  • the present invention relates to video processing.
  • the present invention relates to apparatus and method for adaptive in-loop filtering including sample adaptive offset compensation and adaptive loop filter.
  • the video data are subject to various processing such as prediction, transform, quantization, deblocking, and adaptive loop filtering.
  • certain characteristics of the processed video data may be altered from the original video data due to the operations applied to video data.
  • the mean value of the processed video may be shifted. Intensity shift may cause visual impairment or artifacts, which is especially more noticeable when the intensity shift varies from frame to frame. Therefore, the pixel intensity shift has to be carefully compensated or restored to reduce the artifacts.
  • Some intensity offset schemes have been used in the field.
  • an intensity offset scheme termed as sample adaptive offset (SAO) classifies each pixel in the processed video data into one of multiple categories according to a context selected.
  • SAO sample adaptive offset
  • the conventional SAO scheme is only applied to the luma component. It is desirable to extend SAO processing to the chroma components as well.
  • the SAO scheme usually requires incorporating SAO information in the video bitstream, such as partition information to divide a picture or slice into blocks and the SAO offset values for each block so that a decoder can operate properly.
  • the SAO information may take up a noticeable portion of the bitrate of compressed video and it is desirable to develop efficient coding to incorporate the SAO information.
  • ALF adaptive loop filter
  • ALF adaptive loop filter
  • ALF a component that has to be incorporated in the video bitstream so that a decoder can operate properly. Therefore, it is also desirable to develop efficient coding to incorporate the ALF information in the video bitstream.
  • a method and apparatus for processing reconstructed video using in-loop filter in a video decoder comprises deriving reconstructed video data from a video bitstream, wherein the reconstructed video data comprises luma component and chroma components; receiving chroma in-loop filter indication from the video bitstream if luma in-loop filter indication in the video bitstream indicates that in-loop filter processing is applied to the luma component; determining chroma in-loop filter information if the chroma in-loop filter indication indicates that the in-loop filter processing is applied to the chroma components; and applying the in-loop filter processing to the chroma components according to the chroma in-loop filter information if the chroma in-loop filter indication indicates that the in-loop filter processing is applied to the chroma components.
  • the chroma components may use a single chroma in-loop filter flag or each of the chroma components may use its own chroma in-loop filter flag to control whether the in-loop filter processing is applied.
  • An entire picture may share the in-loop filter information. Alternatively, the picture may be divided into blocks and each block uses its own in-loop filter information.
  • the in-loop filter information for a current block may be derived from neighboring blocks in order to increase coding efficiency.
  • in-loop filter information are taken into consideration for efficient coding such as the property of quadtree-based partition, boundary conditions of a block, in-loop filter information sharing between luma and chroma components, indexing to a set of in-loop filter information, and prediction of in-loop filter information.
  • a method and apparatus for processing reconstructed video using in-loop filter in a video decoder, wherein a picture area of the reconstructed video is partitioned into blocks and the in- loop filter is applied to the blocks are disclosed.
  • the method and apparatus comprise deriving reconstructed block from a video bitstream; receiving in-loop filter information from the video bitstream if a current reconstructed block is a new partition; deriving the in-loop filter information from a target block if the current reconstructed block is not said new partition, wherein the current reconstructed block is merged with the target block selected from one or more candidate blocks corresponding to one or more neighboring blocks of the current reconstructed block; and applying in-loop filter processing to the current reconstructed block using the in-loop filter information.
  • a merge flag in the video bitstream may be used for the current block to indicate the in-loop filter information sharing with one of neighboring blocks if more than one neighboring block exists. If only one neighboring block exists, the in-loop filter information sharing is inferred without the need for the merge flag.
  • a candidate block may be eliminated from merging with the current reconstructed block so as to increase coding efficiency.
  • a method and apparatus for processing reconstructed video using in-loop filter in a corresponding video encoder are disclosed. Furthermore, a method and apparatus for processing reconstructed video using in-loop filter in a corresponding video encoder, wherein a picture area of the reconstructed video is partitioned into blocks and the in-loop filter is applied to the blocks, are also disclosed.
  • Fig. 1 illustrates a system block diagram of an exemplary video encoder incorporating a reconstruction loop, where the in-loop filter processing includes deblocking filter (DF), sample adaptive offset (SAO) and adaptive loop filter (ALF).
  • DF deblocking filter
  • SAO sample adaptive offset
  • ALF adaptive loop filter
  • FIG. 2 illustrates a system block diagram of an exemplary video decoder incorporating a reconstruction loop, where the in-loop filter processing includes deblocking filter (DF), sample adaptive offset (SAO) and adaptive loop filter (ALF).
  • DF deblocking filter
  • SAO sample adaptive offset
  • ALF adaptive loop filter
  • Fig. 3 illustrates an example of sample adaptive offset (SAO) coding for current block C using information from neighboring blocks A, D, B and E.
  • SAO sample adaptive offset
  • Fig. 4A illustrates an example of quadtree-based picture partition for sample adaptive offset (SAO) processing.
  • Fig. 4B illustrates an example of LCU-based picture partition for sample adaptive offset (SAO) processing.
  • Fig. 5 A illustrates an example of allowable quadtree partition for block C, where blocks A and D are in the same partition and block B is in a different partition.
  • Fig. 5B illustrates another example of allowable quadtree partition for block C, where blocks A and D are in the same partition and block B is in a different partition.
  • Fig. 5C illustrates an example of unallowable quadtree partition for block C, where blocks A and D are in the same partition and block B is in a different partition.
  • Fig. 6A illustrates an example of allowable quadtree partition for block C, where blocks
  • Fig. 6B illustrates another example of allowable quadtree partition for block C, where blocks B and D are in the same partition and block A is in a different partition.
  • Fig. 6C illustrates an example of unallowable quadtree partition for block C, where blocks B and D are in the same partition and block A is in a different partition.
  • Fig. 7 illustrates an exemplary syntax design to incorporate a flag in SPS to indicate whether SAO is enable or disabled for the sequence.
  • Fig. 8 illustrates an exemplary syntax design for sao _param ⁇ ), where separate SAO information is allowed for the chroma components.
  • Fig. 9 illustrates an exemplary syntax design for sao_split _param(), where syntax sao_split _param() includes "component” parameter and "component” indicates either the luma component or one of the chroma components.
  • Fig. 10 illustrates an exemplary syntax design for sao_offset _param(), where syntax sao_offset _param() includes "component” as a parameter and "component” indicates either the luma component or one of the chroma components.
  • Fig. 11 illustrates an example of quadtree -based picture partition for sample adaptive offset (SAO) type determination.
  • Fig. 12A illustrates an example of picture-based sample adaptive offset (SAO), where the entire picture uses same SAO parameters.
  • Fig. 12B illustrates an example of LCU-based sample adaptive offset (SAO), where each LCU uses its own SAO parameters.
  • Fig. 13 illustrates an example of using a run equal to two for SAO information sharing of the first three LCUs.
  • Fig. 14 illustrates an example of using run signals and merge-above flags to encode SAO information sharing.
  • Fig. 15 illustrates an example of using run signals, run prediction and merge-above flags to encode SAO information sharing.
  • Adaptive Offset In High Efficiency Video Coding (HEVC), a technique named Adaptive Offset (AO) is introduced to compensate the offset of reconstructed video and AO is applied inside the reconstruction loop.
  • AO Adaptive Offset
  • a method and system for offset compensation is disclosed in US Non- Provisional Patent Application, Serial No. 13/158,427, entitled “Apparatus and Method of Sample Adaptive Offset for Video Coding". The method and system classify each pixel into a category and apply intensity shift compensation or restoration to processed video data based on the category of each pixel.
  • Adaptive Loop Filter ALF has also been introduced in HEVC to improve video quality.
  • ALF applies spatial filter to reconstructed video inside the reconstruction loop. Both AO and ALF are considered as a type of in-loop filter in this disclosure.
  • Intra-prediction 110 is responsible to provide prediction data based on video data in the same picture.
  • motion estimation (ME) and motion compensation (MC) 112 is used to provide prediction data based on video data from other picture or pictures.
  • Switch 114 selects intra-prediction or inter-prediction data and the selected prediction data are supplied to adder 116 to form prediction errors, also called residues.
  • the prediction error is then processed by transformation (T) 118 followed by quantization (Q) 120.
  • the transformed and quantized residues are then coded by entropy coding 122 to form a bitstream corresponding to the compressed video data.
  • the bitstream associated with the transform coefficients is then packed with side information such as motion, mode, and other information associated with the image area.
  • the side information may also be subject to entropy coding to reduce required bandwidth. Accordingly the data associated with the side information are provided to entropy coding 122 as shown in Fig. 1.
  • entropy coding 122 As shown in Fig. 1.
  • IQ inverse quantization
  • IT inverse transformation
  • the residues are then added back to prediction data 136 at reconstruction (REC) 128 to reconstruct video data.
  • the reconstructed video data may be stored in reference picture buffer 134 and used for prediction of other frames.
  • incoming video data undergo a series of processing in the encoding system.
  • the reconstructed video data from REC 128 may be subject to intensity shift and other noises due to the series of processing.
  • deblocking filter 130, sample adaptive offset (SAO) 131 and adaptive loop filter (ALF) 132 are applied to the reconstructed video data before the reconstructed video data are stored in the reference picture buffer 134 in order to improve video quality.
  • the adaptive offset information and adaptive loop filter information may have to be transmitted in the bitstream so that a decoder can properly recover the required information in order to apply the adaptive offset and adaptive loop filter.
  • adaptive offset information from AO 131 and adaptive loop filter information from ALF 132 are provided to entropy coding 122 for incorporation into the bitstream.
  • the encoder may need to access to the original video data in order to derive AO information and ALF information.
  • the paths from the input to AO 131 and ALF 132 are not explicitly shown in Fig. 1.
  • Fig. 2 illustrates a system block diagram of an exemplary video decoder including deblocking filter and adaptive loop filter. Since the encoder also contains a local decoder for reconstructing the video data, some decoder components are already used in the encoder except for the entropy decoder 222. Furthermore, only motion compensation 212 is required for the decoder side.
  • the switch 214 selects intra-prediction or inter-prediction and the selected prediction data are supplied to reconstruction (REC) 128 to be combined with recovered residues.
  • entropy decoding 222 is also responsible for entropy decoding of side information and provides the side information to respective blocks.
  • intra mode information is provided to intra- prediction 110
  • inter mode information is provided to motion compensation 212
  • adaptive offset information is provided to SAO 131
  • adaptive loop filter information is provided to ALF 132
  • residues are provided to inverse quantization 124.
  • the residues are processed by IQ 124, IT 126 and subsequent reconstruction process to reconstruct the video data.
  • reconstructed video data from REC 128 undergo a series of processing including IQ 124 and IT 126 as shown in Fig. 2 and are subject to intensity shift.
  • the reconstructed video data are further processed by deblocking filter 130, sample adaptive offset 131 and adaptive loop filter 132.
  • the in-loop filtering is only applied to the luma component of reconstructed video according to the current HEVC standard. It is beneficial to apply in-loop filtering to chroma components of reconstructed video as well.
  • the information associated with in-loop filtering for the chroma components may be sizeable.
  • a chroma component typically results in much smaller compressed data than the luma component. Therefore, it is desirable to develop a method and apparatus for applying in-loop filtering to the chroma components efficiently. Accordingly, an efficient method and apparatus of SAO for chroma component are disclosed.
  • an indication is provided for signaling whether in-loop filtering is turned ON or not for chroma components when SAO for the luma component is turned ON. If SAO for the luma component is not turned
  • a flag is signaled to indicate whether SAO for chroma is turned ON or not.
  • the flag is signaled.
  • chroma in-loop filter indication The flag to indicate if SAO for chroma is turned ON is called chroma in-loop filter indication since it can be used for SAO as well as ALF.
  • SAO is one example of in-loop filter processing, where the in-loop filter processing may be ALF.
  • individual indications are provided for signaling whether in-loop filtering is turned ON or not for chroma components Cb and Cr when SAO for the luma component is turned ON. If SAO for the luma component is not turned ON, the SAO for the two chroma components is also not turned ON. Therefore, there is no need to provide the individual indications for signaling whether in-loop filtering is turned ON or not for the two chroma components in this case.
  • a example of pseudo codes for the embodiment mentioned above is shown below:
  • a first flag is signaled to indicate whether SAO for Cb is turned ON or not;
  • a second flag is signaled to indicate whether SAO for Cr is turned ON or not.
  • Fig. 3 illustrates an example of utilizing neighboring block to reduce SAO information.
  • Block C is the current block being processed by SAO.
  • Blocks B, D, E and A are previously processed neighboring blocks around C, as shown in Fig. 3.
  • the block-based syntax represents the parameters of current processing block.
  • a block can be a coding unit (CU), a largest coding unit (LCU), or multiple LCUs.
  • a flag can be used to indicate that the current block shares the SAO parameters with neighboring blocks to reduce the rate. If the processing order of blocks is raster scan, the parameters of blocks D, B, E, and A are available when the parameters of block C are encoded. When the block parameters are available from neighboring blocks, these block parameters can be used to encode the current block. The amount of data required to send the flag to indicate SAO parameter sharing is usually much less than that for SAO parameters. Therefore, efficient SAO is achieved. While SAO is used as an example of in-loop filter to illustrate parameter sharing based on neighboring blocks, the technique can also be applied to other in-loop filter such as ALF.
  • the quadtree-based algorithm can be used to adaptively divide a picture region into four sub-regions to achieve better performance.
  • the encoding algorithm for the quadtree-based SAO partition has to be efficiently designed.
  • the SAO parameters (SAOP) include SAO type index and offset values of the selected type.
  • An exemplary quadtree-based SAO partition is shown in Figs. 4A and 4B.
  • Fig. 4A represents a picture being partitioned using quadtree partition, where each small square corresponds to an LCU.
  • the first partition (depth 0 partition) is indicated by split_0( ).
  • a value 0 implies no split and a value 1 indicates a split applied.
  • the picture consists of twelve LCUs as labeled by PI, P2, ... , P12 in Fig. 4B.
  • the depth-0 quadtree partition, split _0 ⁇ ) splits the picture into four regions: upper left, upper right, lower left and lower right regions. Since the lower left and lower right regions have only one row of blocks, no further quadtree partition is applied. Therefore, depth- 1 quadtree partition is only considered for the upper left and upper right regions.
  • the example in Fig. 4A shows that the upper left region is not split as indicated by split _i(0) and the upper right region is further split into four regions as indicated by split_l ⁇ ). Accordingly, the quadtree partition results in seven partitions labeled as P'O, P'6 in Fig. 4A, where:
  • SAOP of PI is the same as SAOP for P2, P5, and P6;
  • SAOP of P9 is the same as SAOP for PI 0;
  • SAOP of PI 1 is the same as SAOP for PI 2.
  • each LCU can be a new partition or merged with other LCUs. If the current LCU is merged, several merge candidates can be selected.
  • To illustrate an exemplary syntax design to allow information sharing only two merge candidates are allowed for quad- tree partitioning of Fig. 3. While two candidates are illustrated in the example, more candidates from the neighboring blocks may be used to practice the present invention.
  • the syntax design is illustrated as follows:
  • Use one flag to indicate block C is a new partition.
  • Block C is inferred as a new partition.
  • block C is merged with block B .
  • block C is merged with block A.
  • block C is merged with block B.
  • the relation with neighboring blocks (LCUs) and the properties of quadtree partition are used to reduce the amount of data required to transmit SAO related information.
  • the boundary condition of a picture region such as a slice may introduce some redundancy in dependency among neighboring blocks and the boundary condition can be used to reduce the amount of data required to transmit SAO related information.
  • the relation among neighboring blocks may also introduce redundancy in dependency among neighboring blocks and the relation among neighboring blocks may be used to reduce the amount of data required to transmit SAO related information.
  • FIG. 5A-C An example of redundancy in dependency among neighboring blocks is illustrated in Figs. 5A-C.
  • blocks D and A are in the same partition and block B is in another partition, blocks A and C will be in different partitions as shown in Fig.5A and Fig. 5B.
  • the case shown in Fig. 5C is not allowed in quadtree partition. Therefore, the merge-candidate in Fig. 5C is redundant and there is no need to assign a code to represent the merge flag corresponding to Fig. 5C.
  • Exemplary pseudo codes to implement the merge algorithm are shown as follows:
  • Send newPartitionFlag to indicate that block C is a new partition.
  • Block C is a new partition as shown in Fig.5A.
  • Block C is merged with block B without signaling as shown in Fig.5B.
  • Send newPartitionFlag to indicate that block C is a new partition.
  • Block C is a new partition as shown in Fig.6A.
  • Block C is merged with block A without signaling as shown in Fig. 6B.
  • Figs. 5A-C and Fig. 6A-C illustrate two examples of utilizing redundancy in dependency among neighboring blocks to further reduce transmitted data associated with SAO information for the current block.
  • the system can take advantage of the redundancy in dependency among neighboring blocks. For example, if blocks A, B and D are in the same partition, then block C cannot be in another partition. Therefore, block C must be in the same partition as A, B, and D and there is no need to transmit an indication of SAO information sharing.
  • the LCU block in the slice boundary can be taken into consideration to reduce the transmitted data associated with SAO information for the current block. For example, if block A does not exist, only one direction can be merged.
  • block B does not exist, only one direction can be merged as well. If both blocks A and B do not exist, there is no need to transmit a flag to indicate block C as a new partition.
  • a flag can be used to indicate that current slice uses only one SAO type without any LCU-based signaling. When the slice is a single partition, the number of transmitted syntax elements can also be reduced. While LCU is used as a unit of block in the above examples, other block configurations (such as block size and shape) may also be used. While slice is mentioned here as an example of picture area that the blocks are grouped to share common information, other picture areas such as group of slices and a picture may also be used.
  • chroma and luma components may share the same SAO information for color video data.
  • the SAO information may also be shared between chroma components.
  • chroma components Cb and Cr
  • Cb and Cr may use the partition information of luma so that there is no need to signal the partition information for the chroma components.
  • Cb and Cr may share the same SAO parameters (SAOP) and therefore only one set of SAOP needs to be transmitted for Cb and Cr to share.
  • SAO syntax for luma can be used for chroma components where the SAO syntax may include quadtree syntax and LCU-based syntax.
  • the examples of utilizing redundancy in dependency among neighboring blocks as shown in Figs. 5A-C and Fig. 6A-C to reduce transmitted data associated with SAO information can also be applied to the chroma components.
  • the SAOP including SAO type and SAO offset values of the selected type can be coded before partitioning information, and therefore an SAO parameter set (SAOPS) can be formed. Accordingly, indexing can be used to identify SAO parameters from the SAOPS for the current block where the data transmitted for the index is typically less than the data transmitted for the SAO parameters.
  • partition information is encoded, the selection among SAOPS can be encoded at the same time. The number of SAOPS can be increased dynamically.
  • the number of SAOP in SAOPS will be increased by one.
  • the number of bits can be dynamically adjusted to match the data range. For example, three bits are required to represent SAOPS having five to eight members.
  • the number of SAOPS will grow to nine and four bits will be needed to represent the SAOPS having nine members.
  • SAO parameters can be transmitted in a predicted form, such as the difference between SAO parameters for a current block and the SAO parameters for a neighboring block or neighboring blocks.
  • Another embodiment according to the present invention is to reduce SAO parameters for chroma.
  • Edge-based Offset (EO) classification classifies each pixel into four categories for the luma component.
  • the number of EO categories for the chroma components can be reduced to two to reduce the transmitted data associated with SAO information for the current block.
  • the number of bands for band offset (BO) classification is usually sixteen for the luma component.
  • the number of bands for band offset (BO) classification may be reduced to eight for the chroma components.
  • the example in Fig. 3 illustrates a case that current block C has four merge candidates, i.e., blocks A, B, D and E.
  • the number of merge candidates can be reduced if the merge candidates are in the same partition. Accordingly, the number of bits to indicate which merge candidate is selected can be reduced or saved. If the processing of SAO refers to the data located in the other slice, SAO will avoid fetching data from any other slice and skip the current processing pixel to avoid data from other slices. In addition, a flag may be used to control whether the SAO processing avoids fetching data from any other slice.
  • the control flag regarding whether the SAO processing avoids fetching data from any other slice can be incorporated in a sequence level or a picture level.
  • the control flag regarding whether the SAO processing avoids fetching data from any other slice can also be shared with the non-crossing slice boundary flag of adaptive loop filter (ALF) or deblocking filter (DF).
  • ALF adaptive loop filter
  • DF deblocking filter
  • the ON/OFF control of chroma SAO depend on luma SAO ON/OFF information.
  • the category of chroma SAO can be a subset of luma SAO for a specific SAO type.
  • Fig. 7 illustrates an example of incorporating sao_used_flag in the sequence level data, such as Sequence Parameter Set (SPS).
  • SPS Sequence Parameter Set
  • sao_used_flag has a value 0
  • SAO is disabled for the sequence.
  • sao_used_flag has a value 1
  • SAO is enabled for the sequence.
  • An exemplary syntax for SAO parameters is shown in Fig. 8, where the sao _param( ) syntax can be incorporated in Adaptation Parameter Set (APS), Picture Parameter
  • the syntax will include split parameter sao_split _param( 0, 0, 0, 0 ) and offset parameter sao_offset _param( 0, 0, 0, 0 ) for the luma component. Furthermore, the syntax also includes SAO flag sao_flag_cb for the Cb component and SAO flag sao_flag_cr for the Cr component.
  • the syntax will include split parameter sao_split _param( 0, 0, 0, 1 ) and offset parameter sao_offset _param( 0, 0, 0, 1 ) for chroma component Cb. If sao_ flag_cr indicates that the SAO for the Cr component is enabled, the syntax will include split parameter sao_split _param( 0, 0, 0, 2 ) and offset parameter sao_offset _param( 0, 0, 0, 2 ) for chroma component Cr. Fig.
  • FIG. 9 illustrates an exemplary syntax for sao_split _param( rx, ry, Depth, component ), where the syntax is similar to a conventional sao_split jparam ( ) except that an additional parameter "component” is added, where "component” is used to indicate the luma or one of the chroma components.
  • Fig. 10 illustrates an exemplary syntax for sao_offset _param( rx, ry, Depth, component ), where the syntax is similar to a conventional sao_offset jparam ( ) except that an additional parameter "component" is added.
  • the syntax includes sao_type_idx [ component ] [ Depth ][ ry ][ rx ] if the split flag sao_sp ⁇ it_flag[component][Depth][ry][rx] indicates the region is not further split.
  • Syntax sao_type_idx [ component ] [ Depth ][ ry ][ rx ] specification is shown in Table 1.
  • the sample adaptive offset (SAO) adopted in HM-3.0 uses a quadtree-based syntax, which divides a picture region into four sub-regions using a split flag recursively, as shown in Fig. 11.
  • Each leaf region has its own SAO parameters (SAOP), where the SAOP includes the information of SAO type and the offset values to be applied for the region.
  • SAOP SAO parameters
  • Fig. 11 illustrates an example where the picture is divided into seven leaf regions, 1110 through 1170, where band offset (BO) type SAO is applied to leaf regions 1110 and 1150, edge offset (EO) type SAO is applied to leaf regions 1130, 1140 and 1160, and SAO is turned off for leaf regions 1120 and 1170.
  • BO band offset
  • EO edge offset
  • a syntax design incorporating an embodiment according to the present invention uses a picture-level flag to switch between picture-based SAO and block-based SAO, where the block may be an LCU or other block sizes.
  • Figs. 12A illustrates an example of picture-based SAO
  • Fig. 12B illustrates a block -based SAO, where each region is one LCU and there are fifteen LCUs in the picture.
  • picture-based SAO the entire picture shares one SAOP.
  • slice-based SAO so that the entire slice or multiple slices share one SAOP.
  • each LCU has its own SAOP and SAOP1 through SAOP15 are used by the fifteen LCUs (LCUl through LCU 15) respectively.
  • SAOP for each LCU may be shared by following LCUs.
  • the number of consecutive subsequent LCUs sharing the same SAOP may be indicated by a run signal.
  • Fig. 13 illustrates an example where SAOP1, SAOP2 and SAOP3 are the same.
  • the SAOP of the first LCU is SAOP1
  • SAOP1 is used for the subsequent two LCUs.
  • the LCU in a following row according to the raster scan order may share the SAOP of a current LCU.
  • a merge-above flag may be used to indicate the case that the current LCU shares the SAOP of the LCU above if the above LCU is available. If the merge-above flag is set to "1", the current LCU will use the SAOP of the LCU above.
  • the merge-above syntax has a value 0 for blocks associated SAOP1, SAOP3 and SAOP4.
  • the run signal of the above LCU can be used as a predictor for the run signal of the current LCU.
  • the difference of the two run signals is encoded, where the difference is denoted as d_run as shown in Fig. 15.
  • the run prediction value can be the run of the above LCU group subtracted by the number of LCUs that are prior to the above LCU in the same LCU group.
  • the first LCU sharing SAOP3 has a run value of 2 and the first LCU above also has a run value of 2 (sharing SAOP1).
  • d_run for the LCU sharing SAOP3 has a value of 0.
  • the first LCU sharing SAOP4 has a run value of 4 and the first LCU above also has a run value of 2 (sharing SAOP3). Accordingly, d run for the LCU sharing SAOP4 has a value of 2.
  • the predictor of a run is not available, the run may be encoded by using an unsigned variable length code (U_VLC).
  • U_VLC unsigned variable length code
  • S_VLC signed variable length code
  • the U_VLC and S_VLC can be £-th order exp-Golomb coding
  • Golomb-Rice coding or a binarization process of CABAC coding.
  • a flag may be used to indicate that all SAOPs in the current LCU row are the same as those in the above LCU row.
  • a flag, RepeatedRow for each LCU row can be used to indicate that all SAOPs in this LCU row are the same as those in the above LCU row. If RepeatedRow flag is equal to 1, no more information needs to be coded.
  • the related SAOP is copied from the LCU in the above LCU row. If RepeatedRow flag is equal to 0, the SAOPs of this LCU row are coded.
  • a flag may be used to signal whether RepeatedRow flag is used or not.
  • the EnableRepeatedRow flag can be used to indicate whether RepeatedRow flag is used or not.
  • the EnableRepeatedRow flag can be signaled at a slice or picture level. If EnableRepeatedRow is equal to 0, the RepeatedRow flag is not coded for each LCU row. If EnableRepeatedRow is equal to 1, the RepeatedRow flag is coded for each LCU row.
  • the RepeatedRow flag at the first LCU row of a picture or a slice can be saved.
  • the RepeatedRow flag of the first LCU row can be saved.
  • the RepeatedRow flag of the first LCU row in a slice can be saved; otherwise, the RepeatedRow flag will be signaled.
  • the method of saving RepeatedRow flag at the first LCU row of one picture or one slice can also be applied to the case where the EnableRepeatedRow flag is used.
  • an embodiment according to the present invention uses a run signal to indicate that all of SAOPs in the following LCU rows are the same as those in the above LCU row. For example, for N consecutive LCU rows containing the same SAOP, the SAOP and a run signal equal to N-l are signaled at the first LCU row of the N consecutive repeated LCU rows.
  • the maximum and minimum runs of the repeated LCU rows in one picture or slice can be derived and signaled at slice or picture level. Based on the maximum and minimum values, the run number can be coded using a fixed-length code word. The word length of the fixed-length code can be determined according to the maximum and minimum run values and thus can be adaptively changed at slice or picture level.
  • the run number in the first LCU row of a picture or a slice is coded.
  • a run is coded to indicate the number of LCUs sharing the SAOP. If the predictor of a run is not available, the run can be encoded by using unsigned variable length code (U_VLC) or fixed-length code word.
  • U_VLC unsigned variable length code
  • the word length can be coded adaptively based on the image width, the coded runs, or the remaining LCU, or the word length can be fixed based on the image width or be signaled to the decoder.
  • the maximum number of run is N-l-k.
  • the word length of the to-be-coded run is floor(log2(N-l-&) +1).
  • the maximum and minimum number of run in a slice or picture can be calculated first. Based on the maximum and minimum value, the word length of the fixed-length code can be derived and coded.
  • the information for the number of runs and delta-runs can be incorporated at slice level.
  • the number of runs, delta-runs or the number of LCUs, NumSaoRun is signaled at slice level.
  • the number of LCUs for the current coding SAOP can be specified using the NumSaoRun flag.
  • the number of runs and delta-runs or the number of LCUs can be predicted using the number of LCUs in one coding picture.
  • NumTBsInPicture is the number of LCUs in one picture and sao_num_run_info is the predicted residual value.
  • sao_num_run_info can be coded using a signed or unsigned variable-length.
  • sao_num_run_info may also be coded using a signed or unsigned fixed-length code word.
  • Embodiment of in-loop filter according to the present invention as described above may be implemented in various hardware, software codes, or a combination of both.
  • an embodiment of the present invention can be a circuit integrated into a video compression chip or program codes integrated into video compression software to perform the processing described herein.
  • An embodiment of the present invention may also be program codes to be executed on a Digital Signal Processor (DSP) to perform the processing described herein.
  • DSP Digital Signal Processor
  • the invention may also involve a number of functions to be performed by a computer processor, a digital signal processor, a microprocessor, or field programmable gate array (FPGA). These processors can be configured to perform particular tasks according to the invention, by executing machine- readable software code or firmware code that defines the particular methods embodied by the invention.
  • the software code or firmware codes may be developed in different programming languages and different format or style.
  • the software code may also be compiled for different target platform.
  • different code formats, styles and languages of software codes and other means of configuring code to perform the tasks in accordance with the invention will not depart from the spirit and scope of the invention.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computing Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)

Abstract

A method and apparatus for processing reconstructed video using in-loop filter in a video coding system are disclosed. The method uses chroma in-loop filter indication to indicate whether chroma components are processed by in-loop filter when the luma in-loop filter indication indicates that in-loop filter processing is applied to the luma component. An additional flag may be used to indicate whether the in-loop filter processing is applied to an entire picture using same in-loop filter information or each block of the picture using individual in-loop filter information. Various embodiments according to the present invention to increase efficiency are disclosed, wherein various aspects of in-loop filter information are taken into consideration for efficient coding such as the property of quadtree -based partition, boundary conditions of a block, in-loop filter information sharing between luma and chroma components, indexing to a set of in-loop filter information, and prediction of in-loop filter information..

Description

APPARATUS AND METHOD OF SAMPLE ADAPTIVE OFFSET FOR LUMAAND CHROMA COMPONENTS
BACKGROUND OF THE INVENTION
Cross Reference To Related Applications
[0001] The present invention claims priority to U.S. Provisional Patent Application, No. 61/486,504, filed May 16, 2011, entitled "Sample Adaptive Offset for Luma and Chroma Components", U.S. Provisional Patent Application, No. 61/498,949, filed June 20, 2011, entitled "LCU-based Syntax for Sample Adaptive Offset", and U.S. Provisional Patent Application, No. 61/503,870, filed July 1, 2011, entitled "LCU-based Syntax for Sample Adaptive Offset". The present invention is also related to US Non-Provisional Patent Application, Serial No. 13/158,427, entitled "Apparatus and Method of Sample Adaptive Offset for Video Coding", filed on June 12, 2011 , and US Non-Provisional Patent Application, Serial No. 13/311,953, entitled "Apparatus and Method of Sample Adaptive Offset for Luma and Chroma Components", filed on December 6, 2011. The U.S. Provisional Patent Applications and U.S. Non-Provisional Patent Application are hereby incorporated by reference in their entireties.
Field of the Invention
[0002] The present invention relates to video processing. In particular, the present invention relates to apparatus and method for adaptive in-loop filtering including sample adaptive offset compensation and adaptive loop filter.
Description of the Related Art
[0003] In a video coding system, the video data are subject to various processing such as prediction, transform, quantization, deblocking, and adaptive loop filtering. Along the processing path in the video coding system, certain characteristics of the processed video data may be altered from the original video data due to the operations applied to video data. For example, the mean value of the processed video may be shifted. Intensity shift may cause visual impairment or artifacts, which is especially more noticeable when the intensity shift varies from frame to frame. Therefore, the pixel intensity shift has to be carefully compensated or restored to reduce the artifacts. Some intensity offset schemes have been used in the field. For example, an intensity offset scheme, termed as sample adaptive offset (SAO), classifies each pixel in the processed video data into one of multiple categories according to a context selected. The conventional SAO scheme is only applied to the luma component. It is desirable to extend SAO processing to the chroma components as well. The SAO scheme usually requires incorporating SAO information in the video bitstream, such as partition information to divide a picture or slice into blocks and the SAO offset values for each block so that a decoder can operate properly. The SAO information may take up a noticeable portion of the bitrate of compressed video and it is desirable to develop efficient coding to incorporate the SAO information. Besides SAO, adaptive loop filter (ALF) is another type of in-loop filter often applied to the reconstructed video to improve video quality. Similarly, it is desirable to apply ALF to the chroma component as well to improve video quality. Again, ALF information such as partition information and filter parameters has to be incorporated in the video bitstream so that a decoder can operate properly. Therefore, it is also desirable to develop efficient coding to incorporate the ALF information in the video bitstream.
BRIEF SUMMARY OF THE INVENTION
[0004] A method and apparatus for processing reconstructed video using in-loop filter in a video decoder are disclosed. The method and apparatus incorporating an embodiment according to the present invention comprises deriving reconstructed video data from a video bitstream, wherein the reconstructed video data comprises luma component and chroma components; receiving chroma in-loop filter indication from the video bitstream if luma in-loop filter indication in the video bitstream indicates that in-loop filter processing is applied to the luma component; determining chroma in-loop filter information if the chroma in-loop filter indication indicates that the in-loop filter processing is applied to the chroma components; and applying the in-loop filter processing to the chroma components according to the chroma in-loop filter information if the chroma in-loop filter indication indicates that the in-loop filter processing is applied to the chroma components. The chroma components may use a single chroma in-loop filter flag or each of the chroma components may use its own chroma in-loop filter flag to control whether the in-loop filter processing is applied. An entire picture may share the in-loop filter information. Alternatively, the picture may be divided into blocks and each block uses its own in-loop filter information. When in-loop filter processing is applied to blocks, the in-loop filter information for a current block may be derived from neighboring blocks in order to increase coding efficiency. Various embodiments according to the present invention to increase coding efficiency are disclosed, wherein various aspects of in-loop filter information are taken into consideration for efficient coding such as the property of quadtree-based partition, boundary conditions of a block, in-loop filter information sharing between luma and chroma components, indexing to a set of in-loop filter information, and prediction of in-loop filter information.
[0005] A method and apparatus for processing reconstructed video using in-loop filter in a video decoder, wherein a picture area of the reconstructed video is partitioned into blocks and the in- loop filter is applied to the blocks, are disclosed. The method and apparatus comprise deriving reconstructed block from a video bitstream; receiving in-loop filter information from the video bitstream if a current reconstructed block is a new partition; deriving the in-loop filter information from a target block if the current reconstructed block is not said new partition, wherein the current reconstructed block is merged with the target block selected from one or more candidate blocks corresponding to one or more neighboring blocks of the current reconstructed block; and applying in-loop filter processing to the current reconstructed block using the in-loop filter information. In order to increase coding efficiency, a merge flag in the video bitstream may be used for the current block to indicate the in-loop filter information sharing with one of neighboring blocks if more than one neighboring block exists. If only one neighboring block exists, the in-loop filter information sharing is inferred without the need for the merge flag. According to the quadtree-partition property and merge information of said one or more candidate blocks, a candidate block may be eliminated from merging with the current reconstructed block so as to increase coding efficiency.
[0006] A method and apparatus for processing reconstructed video using in-loop filter in a corresponding video encoder are disclosed. Furthermore, a method and apparatus for processing reconstructed video using in-loop filter in a corresponding video encoder, wherein a picture area of the reconstructed video is partitioned into blocks and the in-loop filter is applied to the blocks, are also disclosed. BRIEF DESCRIPTION OF DRAWINGS
[0007] Fig. 1 illustrates a system block diagram of an exemplary video encoder incorporating a reconstruction loop, where the in-loop filter processing includes deblocking filter (DF), sample adaptive offset (SAO) and adaptive loop filter (ALF).
[0008] Fig. 2 illustrates a system block diagram of an exemplary video decoder incorporating a reconstruction loop, where the in-loop filter processing includes deblocking filter (DF), sample adaptive offset (SAO) and adaptive loop filter (ALF).
[0009] Fig. 3 illustrates an example of sample adaptive offset (SAO) coding for current block C using information from neighboring blocks A, D, B and E.
[0010] Fig. 4A illustrates an example of quadtree-based picture partition for sample adaptive offset (SAO) processing.
[0011] Fig. 4B illustrates an example of LCU-based picture partition for sample adaptive offset (SAO) processing.
[0012] Fig. 5 A illustrates an example of allowable quadtree partition for block C, where blocks A and D are in the same partition and block B is in a different partition.
[0013] Fig. 5B illustrates another example of allowable quadtree partition for block C, where blocks A and D are in the same partition and block B is in a different partition.
[0014] Fig. 5C illustrates an example of unallowable quadtree partition for block C, where blocks A and D are in the same partition and block B is in a different partition.
[0015] Fig. 6A illustrates an example of allowable quadtree partition for block C, where blocks
B and D are in the same partition and block A is in a different partition.
[0016] Fig. 6B illustrates another example of allowable quadtree partition for block C, where blocks B and D are in the same partition and block A is in a different partition.
[0017] Fig. 6C illustrates an example of unallowable quadtree partition for block C, where blocks B and D are in the same partition and block A is in a different partition.
[0018] Fig. 7 illustrates an exemplary syntax design to incorporate a flag in SPS to indicate whether SAO is enable or disabled for the sequence.
[0019] Fig. 8 illustrates an exemplary syntax design for sao _param{), where separate SAO information is allowed for the chroma components.
[0020] Fig. 9 illustrates an exemplary syntax design for sao_split _param(), where syntax sao_split _param() includes "component" parameter and "component" indicates either the luma component or one of the chroma components.
[0021] Fig. 10 illustrates an exemplary syntax design for sao_offset _param(), where syntax sao_offset _param() includes "component" as a parameter and "component" indicates either the luma component or one of the chroma components.
[0022] Fig. 11 illustrates an example of quadtree -based picture partition for sample adaptive offset (SAO) type determination.
[0023] Fig. 12A illustrates an example of picture-based sample adaptive offset (SAO), where the entire picture uses same SAO parameters.
[0024] Fig. 12B illustrates an example of LCU-based sample adaptive offset (SAO), where each LCU uses its own SAO parameters.
[0025] Fig. 13 illustrates an example of using a run equal to two for SAO information sharing of the first three LCUs.
[0026] Fig. 14 illustrates an example of using run signals and merge-above flags to encode SAO information sharing.
[0027] Fig. 15 illustrates an example of using run signals, run prediction and merge-above flags to encode SAO information sharing.
DETAILED DESCRIPTION OF THE INVENTION
[0028] In High Efficiency Video Coding (HEVC), a technique named Adaptive Offset (AO) is introduced to compensate the offset of reconstructed video and AO is applied inside the reconstruction loop. A method and system for offset compensation is disclosed in US Non- Provisional Patent Application, Serial No. 13/158,427, entitled "Apparatus and Method of Sample Adaptive Offset for Video Coding". The method and system classify each pixel into a category and apply intensity shift compensation or restoration to processed video data based on the category of each pixel. Besides adaptive offset, Adaptive Loop Filter (ALF) has also been introduced in HEVC to improve video quality. ALF applies spatial filter to reconstructed video inside the reconstruction loop. Both AO and ALF are considered as a type of in-loop filter in this disclosure.
[0029] The exemplary encoder shown in Fig. 1 represents a system using intra/inter-prediction. Intra-prediction 110 is responsible to provide prediction data based on video data in the same picture. For inter-prediction, motion estimation (ME) and motion compensation (MC) 112 is used to provide prediction data based on video data from other picture or pictures. Switch 114 selects intra-prediction or inter-prediction data and the selected prediction data are supplied to adder 116 to form prediction errors, also called residues. The prediction error is then processed by transformation (T) 118 followed by quantization (Q) 120. The transformed and quantized residues are then coded by entropy coding 122 to form a bitstream corresponding to the compressed video data. The bitstream associated with the transform coefficients is then packed with side information such as motion, mode, and other information associated with the image area. The side information may also be subject to entropy coding to reduce required bandwidth. Accordingly the data associated with the side information are provided to entropy coding 122 as shown in Fig. 1. When an inter-prediction mode is used, a reference picture or reference pictures have to be reconstructed at the encoder end. Consequently, the transformed and quantized residues are processed by inverse quantization (IQ) 124 and inverse transformation (IT) 126 to recover the residues. The residues are then added back to prediction data 136 at reconstruction (REC) 128 to reconstruct video data. The reconstructed video data may be stored in reference picture buffer 134 and used for prediction of other frames. As it is shown in Fig. 1, incoming video data undergo a series of processing in the encoding system. The reconstructed video data from REC 128 may be subject to intensity shift and other noises due to the series of processing. Accordingly, deblocking filter 130, sample adaptive offset (SAO) 131 and adaptive loop filter (ALF) 132 are applied to the reconstructed video data before the reconstructed video data are stored in the reference picture buffer 134 in order to improve video quality. The adaptive offset information and adaptive loop filter information may have to be transmitted in the bitstream so that a decoder can properly recover the required information in order to apply the adaptive offset and adaptive loop filter. Therefore, adaptive offset information from AO 131 and adaptive loop filter information from ALF 132 are provided to entropy coding 122 for incorporation into the bitstream. The encoder may need to access to the original video data in order to derive AO information and ALF information. The paths from the input to AO 131 and ALF 132 are not explicitly shown in Fig. 1.
[0030] Fig. 2 illustrates a system block diagram of an exemplary video decoder including deblocking filter and adaptive loop filter. Since the encoder also contains a local decoder for reconstructing the video data, some decoder components are already used in the encoder except for the entropy decoder 222. Furthermore, only motion compensation 212 is required for the decoder side. The switch 214 selects intra-prediction or inter-prediction and the selected prediction data are supplied to reconstruction (REC) 128 to be combined with recovered residues. Besides performing entropy decoding on compressed video data, entropy decoding 222 is also responsible for entropy decoding of side information and provides the side information to respective blocks. For example, intra mode information is provided to intra- prediction 110, inter mode information is provided to motion compensation 212, adaptive offset information is provided to SAO 131, adaptive loop filter information is provided to ALF 132 and residues are provided to inverse quantization 124. The residues are processed by IQ 124, IT 126 and subsequent reconstruction process to reconstruct the video data. Again, reconstructed video data from REC 128 undergo a series of processing including IQ 124 and IT 126 as shown in Fig. 2 and are subject to intensity shift. The reconstructed video data are further processed by deblocking filter 130, sample adaptive offset 131 and adaptive loop filter 132.
[0031] The in-loop filtering is only applied to the luma component of reconstructed video according to the current HEVC standard. It is beneficial to apply in-loop filtering to chroma components of reconstructed video as well. The information associated with in-loop filtering for the chroma components may be sizeable. However, a chroma component typically results in much smaller compressed data than the luma component. Therefore, it is desirable to develop a method and apparatus for applying in-loop filtering to the chroma components efficiently. Accordingly, an efficient method and apparatus of SAO for chroma component are disclosed.
[0032] In one example incorporating an embodiment of the present invention, an indication is provided for signaling whether in-loop filtering is turned ON or not for chroma components when SAO for the luma component is turned ON. If SAO for the luma component is not turned
ON, the SAO for the chroma components is also not turned ON. Therefore, there is no need to provide the indication for signaling whether in-loop filtering is turned ON or not for the chroma components in this case. A example of pseudo codes for the embodiment mentioned above is shown below:
If SAO for luma is turned ON;
A flag is signaled to indicate whether SAO for chroma is turned ON or not.
Else;
The flag is signaled.
[0033] The flag to indicate if SAO for chroma is turned ON is called chroma in-loop filter indication since it can be used for SAO as well as ALF. SAO is one example of in-loop filter processing, where the in-loop filter processing may be ALF. In another example incorporating an embodiment of the present invention, individual indications are provided for signaling whether in-loop filtering is turned ON or not for chroma components Cb and Cr when SAO for the luma component is turned ON. If SAO for the luma component is not turned ON, the SAO for the two chroma components is also not turned ON. Therefore, there is no need to provide the individual indications for signaling whether in-loop filtering is turned ON or not for the two chroma components in this case. A example of pseudo codes for the embodiment mentioned above is shown below:
If SAO for luma is turned ON;
A first flag is signaled to indicate whether SAO for Cb is turned ON or not; A second flag is signaled to indicate whether SAO for Cr is turned ON or not.
Else;
Neither the first flag nor the second flag is signaled.
[0034] As mentioned before, it is desirable to develop efficient in-loop filtering method. For example, it is desired to reduce information required to provide indication regarding whether SAO is turned ON and SAO parameters if SAO is turned ON. Since neighboring blocks often have similar characteristics, neighboring blocks may be useful in reducing requiring SAO information. Fig. 3 illustrates an example of utilizing neighboring block to reduce SAO information. Block C is the current block being processed by SAO. Blocks B, D, E and A are previously processed neighboring blocks around C, as shown in Fig. 3. The block-based syntax represents the parameters of current processing block. A block can be a coding unit (CU), a largest coding unit (LCU), or multiple LCUs. A flag can be used to indicate that the current block shares the SAO parameters with neighboring blocks to reduce the rate. If the processing order of blocks is raster scan, the parameters of blocks D, B, E, and A are available when the parameters of block C are encoded. When the block parameters are available from neighboring blocks, these block parameters can be used to encode the current block. The amount of data required to send the flag to indicate SAO parameter sharing is usually much less than that for SAO parameters. Therefore, efficient SAO is achieved. While SAO is used as an example of in-loop filter to illustrate parameter sharing based on neighboring blocks, the technique can also be applied to other in-loop filter such as ALF.
[0035] In the current HEVC standard, the quadtree-based algorithm can be used to adaptively divide a picture region into four sub-regions to achieve better performance. In order to maintain the coding gain of SAO, the encoding algorithm for the quadtree-based SAO partition has to be efficiently designed. The SAO parameters (SAOP) include SAO type index and offset values of the selected type. An exemplary quadtree-based SAO partition is shown in Figs. 4A and 4B. Fig. 4A represents a picture being partitioned using quadtree partition, where each small square corresponds to an LCU. The first partition (depth 0 partition) is indicated by split_0( ). A value 0 implies no split and a value 1 indicates a split applied. The picture consists of twelve LCUs as labeled by PI, P2, ... , P12 in Fig. 4B. The depth-0 quadtree partition, split _0{\) splits the picture into four regions: upper left, upper right, lower left and lower right regions. Since the lower left and lower right regions have only one row of blocks, no further quadtree partition is applied. Therefore, depth- 1 quadtree partition is only considered for the upper left and upper right regions. The example in Fig. 4A shows that the upper left region is not split as indicated by split _i(0) and the upper right region is further split into four regions as indicated by split_l{\). Accordingly, the quadtree partition results in seven partitions labeled as P'O, P'6 in Fig. 4A, where:
• SAOP of PI is the same as SAOP for P2, P5, and P6;
• SAOP of P9 is the same as SAOP for PI 0; and
• SAOP of PI 1 is the same as SAOP for PI 2.
[0036] According to the partition information of SAO, each LCU can be a new partition or merged with other LCUs. If the current LCU is merged, several merge candidates can be selected. To illustrate an exemplary syntax design to allow information sharing, only two merge candidates are allowed for quad- tree partitioning of Fig. 3. While two candidates are illustrated in the example, more candidates from the neighboring blocks may be used to practice the present invention. The syntax design is illustrated as follows:
If block C is not the first block of the picture,
Use one flag to indicate block C is a new partition.
Else,
Block C is inferred as a new partition.
If block C is a new partition,
Encode SAO parameters.
Otherwise,
If a left neighbor and a top neighbor exist,
Send a inergeLeftFlag.
If mergeLeftFlag is true, then block C is merged with block A.
Otherwise, block C is merged with block B .
Else,
If a left neighbor exists, then block C is merged with block A.
Otherwise, block C is merged with block B.
[0037] In another embodiment according to the present invention, the relation with neighboring blocks (LCUs) and the properties of quadtree partition are used to reduce the amount of data required to transmit SAO related information. Furthermore, the boundary condition of a picture region such as a slice may introduce some redundancy in dependency among neighboring blocks and the boundary condition can be used to reduce the amount of data required to transmit SAO related information. The relation among neighboring blocks may also introduce redundancy in dependency among neighboring blocks and the relation among neighboring blocks may be used to reduce the amount of data required to transmit SAO related information.
[0038] An example of redundancy in dependency among neighboring blocks is illustrated in Figs. 5A-C. According to the property of quadtree partition, if blocks D and A are in the same partition and block B is in another partition, blocks A and C will be in different partitions as shown in Fig.5A and Fig. 5B. On the other hand, the case shown in Fig. 5C is not allowed in quadtree partition. Therefore, the merge-candidate in Fig. 5C is redundant and there is no need to assign a code to represent the merge flag corresponding to Fig. 5C. Exemplary pseudo codes to implement the merge algorithm are shown as follows:
If blocks A and D are in the same partition and blocks B and D are in different partitions, Send newPartitionFlag to indicate that block C is a new partition.
If newPartitionFlag is true,
Block C is a new partition as shown in Fig.5A.
Otherwise,
Block C is merged with block B without signaling as shown in Fig.5B.
[0039] As shown in the above example, there are only two allowed cases, i.e. block C is a new partition or block C is merged with block B. Therefore, a single bit for newPartitionFlag is adequate to identify the two cases. In another example, blocks D and B are in the same partition and block A is in another partition, blocks B and C will be in different partitions as shown in Fig. 6 A and Fig. 6B. On the other hand, the case shown in Fig. 6C is not allowed according to quadtree partition. Therefore, the merge-candidate associated with the case in Fig. 6C is redundant and there is no need to assign a code to represent the merge flag corresponding to Fig. 6C. Exemplary pseudo codes to implement the merge algorithm are shown as follows:
If blocks B and D are in the same partition and blocks A and D are in different partitions, Send newPartitionFlag to indicate that block C is a new partition.
If newPartitionFlag is true,
Block C is a new partition as shown in Fig.6A.
Otherwise,
Block C is merged with block A without signaling as shown in Fig. 6B.
[0040] Figs. 5A-C and Fig. 6A-C illustrate two examples of utilizing redundancy in dependency among neighboring blocks to further reduce transmitted data associated with SAO information for the current block. There are many other conditions that the system can take advantage of the redundancy in dependency among neighboring blocks. For example, if blocks A, B and D are in the same partition, then block C cannot be in another partition. Therefore, block C must be in the same partition as A, B, and D and there is no need to transmit an indication of SAO information sharing. The LCU block in the slice boundary can be taken into consideration to reduce the transmitted data associated with SAO information for the current block. For example, if block A does not exist, only one direction can be merged. If block B does not exist, only one direction can be merged as well. If both blocks A and B do not exist, there is no need to transmit a flag to indicate block C as a new partition. To further reduce the number of transmitted syntax elements, a flag can be used to indicate that current slice uses only one SAO type without any LCU-based signaling. When the slice is a single partition, the number of transmitted syntax elements can also be reduced. While LCU is used as a unit of block in the above examples, other block configurations (such as block size and shape) may also be used. While slice is mentioned here as an example of picture area that the blocks are grouped to share common information, other picture areas such as group of slices and a picture may also be used.
[0041] In addition, chroma and luma components may share the same SAO information for color video data. The SAO information may also be shared between chroma components. For example, chroma components (Cb and Cr) may use the partition information of luma so that there is no need to signal the partition information for the chroma components. In another example, Cb and Cr may share the same SAO parameters (SAOP) and therefore only one set of SAOP needs to be transmitted for Cb and Cr to share. SAO syntax for luma can be used for chroma components where the SAO syntax may include quadtree syntax and LCU-based syntax.
[0042] The examples of utilizing redundancy in dependency among neighboring blocks as shown in Figs. 5A-C and Fig. 6A-C to reduce transmitted data associated with SAO information can also be applied to the chroma components. The SAOP including SAO type and SAO offset values of the selected type can be coded before partitioning information, and therefore an SAO parameter set (SAOPS) can be formed. Accordingly, indexing can be used to identify SAO parameters from the SAOPS for the current block where the data transmitted for the index is typically less than the data transmitted for the SAO parameters. When partition information is encoded, the selection among SAOPS can be encoded at the same time. The number of SAOPS can be increased dynamically. For example, after a new SAOP is signaled, the number of SAOP in SAOPS will be increased by one. To represent the number of SAOPS, the number of bits can be dynamically adjusted to match the data range. For example, three bits are required to represent SAOPS having five to eight members. When a new SAOP is signaled, the number of SAOPS will grow to nine and four bits will be needed to represent the SAOPS having nine members.
[0043] If the processing of SAO refers to the data located in the other slice, SAO will avoid fetching data from any other slice by use a padding technique or change pattern to replace data from other slices. To reduce data required for SAO information, SAO parameters can be transmitted in a predicted form, such as the difference between SAO parameters for a current block and the SAO parameters for a neighboring block or neighboring blocks. Another embodiment according to the present invention is to reduce SAO parameters for chroma. For example, Edge-based Offset (EO) classification classifies each pixel into four categories for the luma component. The number of EO categories for the chroma components can be reduced to two to reduce the transmitted data associated with SAO information for the current block. The number of bands for band offset (BO) classification is usually sixteen for the luma component.
In yet another example, the number of bands for band offset (BO) classification may be reduced to eight for the chroma components. [0044] The example in Fig. 3 illustrates a case that current block C has four merge candidates, i.e., blocks A, B, D and E. The number of merge candidates can be reduced if the merge candidates are in the same partition. Accordingly, the number of bits to indicate which merge candidate is selected can be reduced or saved. If the processing of SAO refers to the data located in the other slice, SAO will avoid fetching data from any other slice and skip the current processing pixel to avoid data from other slices. In addition, a flag may be used to control whether the SAO processing avoids fetching data from any other slice. The control flag regarding whether the SAO processing avoids fetching data from any other slice can be incorporated in a sequence level or a picture level. The control flag regarding whether the SAO processing avoids fetching data from any other slice can also be shared with the non-crossing slice boundary flag of adaptive loop filter (ALF) or deblocking filter (DF). In order to further reduce the transmitted data associated with SAO information, the ON/OFF control of chroma SAO depend on luma SAO ON/OFF information. The category of chroma SAO can be a subset of luma SAO for a specific SAO type.
[0045] Exemplary syntax design incorporating various embodiments according to the present invention is illustrated below. Fig. 7 illustrates an example of incorporating sao_used_flag in the sequence level data, such as Sequence Parameter Set (SPS). When sao_used_flag has a value 0, SAO is disabled for the sequence. When sao_used_flag has a value 1, SAO is enabled for the sequence. An exemplary syntax for SAO parameters is shown in Fig. 8, where the sao _param( ) syntax can be incorporated in Adaptation Parameter Set (APS), Picture Parameter
Set (PPS) or slice header. The APS is another picture-level header in addition to the PPS to accommodate parameters that are likely to change from picture to picture. If sao_ flag indicates that the SAO is enabled, the syntax will include split parameter sao_split _param( 0, 0, 0, 0 ) and offset parameter sao_offset _param( 0, 0, 0, 0 ) for the luma component. Furthermore, the syntax also includes SAO flag sao_flag_cb for the Cb component and SAO flag sao_flag_cr for the Cr component. If sao_ flag_cb indicates that the SAO for the Cb component is enabled, the syntax will include split parameter sao_split _param( 0, 0, 0, 1 ) and offset parameter sao_offset _param( 0, 0, 0, 1 ) for chroma component Cb. If sao_ flag_cr indicates that the SAO for the Cr component is enabled, the syntax will include split parameter sao_split _param( 0, 0, 0, 2 ) and offset parameter sao_offset _param( 0, 0, 0, 2 ) for chroma component Cr. Fig. 9 illustrates an exemplary syntax for sao_split _param( rx, ry, Depth, component ), where the syntax is similar to a conventional sao_split jparam ( ) except that an additional parameter "component" is added, where "component" is used to indicate the luma or one of the chroma components. Fig. 10 illustrates an exemplary syntax for sao_offset _param( rx, ry, Depth, component ), where the syntax is similar to a conventional sao_offset jparam ( ) except that an additional parameter "component" is added. In sao_offset _param{ rx, ry, Depth, component ), the syntax includes sao_type_idx [ component ] [ Depth ][ ry ][ rx ] if the split flag sao_sp\it_flag[component][Depth][ry][rx] indicates the region is not further split. Syntax sao_type_idx [ component ] [ Depth ][ ry ][ rx ] specification is shown in Table 1.
Table 1.
Figure imgf000014_0001
[0046] The sample adaptive offset (SAO) adopted in HM-3.0 uses a quadtree-based syntax, which divides a picture region into four sub-regions using a split flag recursively, as shown in Fig. 11. Each leaf region has its own SAO parameters (SAOP), where the SAOP includes the information of SAO type and the offset values to be applied for the region. Fig. 11 illustrates an example where the picture is divided into seven leaf regions, 1110 through 1170, where band offset (BO) type SAO is applied to leaf regions 1110 and 1150, edge offset (EO) type SAO is applied to leaf regions 1130, 1140 and 1160, and SAO is turned off for leaf regions 1120 and 1170. In order to improve the coding gain, a syntax design incorporating an embodiment according to the present invention uses a picture-level flag to switch between picture-based SAO and block-based SAO, where the block may be an LCU or other block sizes. Figs. 12A illustrates an example of picture-based SAO and Fig. 12B illustrates a block -based SAO, where each region is one LCU and there are fifteen LCUs in the picture. In picture-based SAO, the entire picture shares one SAOP. It is also possible to use slice-based SAO so that the entire slice or multiple slices share one SAOP. In LCU-based SAO, each LCU has its own SAOP and SAOP1 through SAOP15 are used by the fifteen LCUs (LCUl through LCU 15) respectively.
[0047] In another embodiment according to the present invention, SAOP for each LCU may be shared by following LCUs. The number of consecutive subsequent LCUs sharing the same SAOP may be indicated by a run signal. Fig. 13 illustrates an example where SAOP1, SAOP2 and SAOP3 are the same. In other words, the SAOP of the first LCU is SAOP1, and SAOP1 is used for the subsequent two LCUs. In this case, a syntax "ru = 2" will be encoded to signal the number of consecutive subsequent LCUs sharing the same SAOP. Since the SAOP for the next two LCUs is not transmitted, the rate of encoding their SAOPs can be saved. In yet another embodiment according to the present invention, in addition to use a run signal, the LCU in a following row according to the raster scan order may share the SAOP of a current LCU. A merge-above flag may be used to indicate the case that the current LCU shares the SAOP of the LCU above if the above LCU is available. If the merge-above flag is set to "1", the current LCU will use the SAOP of the LCU above. As shown in Fig. 14, SAOP2 is shared by four LCUs, 1410 through 1440, where "ru«=l" and "no merge-above" are used to indicate LCUs
1410 and 1420 share SAOP2 and they do not share SAOP with LCUs above. Furthermore, "rw«=l" and "merge-above-1" are used to indicate LCUs 1430 and 1440 share SAOP2 and they also share SAOP with LCUs above. On the other hand, both SAOP1 and SAOP3 are shared by two subsequent LCUs and SAOP4 is shared by four subsequent LCUs. Accordingly, the run signal for SAOP1, SAOP3 and SAOP4 are 2, 2 and 4 respectively. Since none of them shares
SAOP with LCUs above, the merge-above syntax has a value 0 for blocks associated SAOP1, SAOP3 and SAOP4.
[0048] In order to reduce the bitrate for the run signal, the run signal of the above LCU can be used as a predictor for the run signal of the current LCU. Instead of encoding the run signal directly, the difference of the two run signals is encoded, where the difference is denoted as d_run as shown in Fig. 15. When the above LCU is not the first LCU of an LCU group with a run value, the run prediction value can be the run of the above LCU group subtracted by the number of LCUs that are prior to the above LCU in the same LCU group. The first LCU sharing SAOP3 has a run value of 2 and the first LCU above also has a run value of 2 (sharing SAOP1). Accordingly, d_run for the LCU sharing SAOP3 has a value of 0. The first LCU sharing SAOP4 has a run value of 4 and the first LCU above also has a run value of 2 (sharing SAOP3). Accordingly, d run for the LCU sharing SAOP4 has a value of 2. If the predictor of a run is not available, the run may be encoded by using an unsigned variable length code (U_VLC). If the predictor exists, the delta run, djrun may be encoded by using a signed variable length code (S_VLC). The U_VLC and S_VLC can be £-th order exp-Golomb coding,
Golomb-Rice coding, or a binarization process of CABAC coding.
[0049] In one embodiment according to the present invention, a flag may be used to indicate that all SAOPs in the current LCU row are the same as those in the above LCU row. For example, a flag, RepeatedRow, for each LCU row can be used to indicate that all SAOPs in this LCU row are the same as those in the above LCU row. If RepeatedRow flag is equal to 1, no more information needs to be coded. For each LCU in the current LCU row, the related SAOP is copied from the LCU in the above LCU row. If RepeatedRow flag is equal to 0, the SAOPs of this LCU row are coded.
[0050] In another embodiment according to the present invention, a flag may be used to signal whether RepeatedRow flag is used or not. For example, the EnableRepeatedRow flag can be used to indicate whether RepeatedRow flag is used or not. The EnableRepeatedRow flag can be signaled at a slice or picture level. If EnableRepeatedRow is equal to 0, the RepeatedRow flag is not coded for each LCU row. If EnableRepeatedRow is equal to 1, the RepeatedRow flag is coded for each LCU row.
[0051] In yet another embodiment according to the present invention, the RepeatedRow flag at the first LCU row of a picture or a slice can be saved. For the case of a picture having only one slice, the RepeatedRow flag of the first LCU row can be saved. For the case of one picture with multiple slices, if the SAO process is slice-independent operation, the RepeatedRow flag of the first LCU row in a slice can be saved; otherwise, the RepeatedRow flag will be signaled. The method of saving RepeatedRow flag at the first LCU row of one picture or one slice can also be applied to the case where the EnableRepeatedRow flag is used.
[0052] To reduce transmitted data associated with SAOP, an embodiment according to the present invention uses a run signal to indicate that all of SAOPs in the following LCU rows are the same as those in the above LCU row. For example, for N consecutive LCU rows containing the same SAOP, the SAOP and a run signal equal to N-l are signaled at the first LCU row of the N consecutive repeated LCU rows. The maximum and minimum runs of the repeated LCU rows in one picture or slice can be derived and signaled at slice or picture level. Based on the maximum and minimum values, the run number can be coded using a fixed-length code word. The word length of the fixed-length code can be determined according to the maximum and minimum run values and thus can be adaptively changed at slice or picture level.
[0053] In another embodiment according to the present invention, the run number in the first LCU row of a picture or a slice is coded. In the method of entropy coding of runs and delta-runs mentioned earlier for the first LCU row of one picture or one slice, if the SAOP is repeated for consecutive LCUs, a run is coded to indicate the number of LCUs sharing the SAOP. If the predictor of a run is not available, the run can be encoded by using unsigned variable length code (U_VLC) or fixed-length code word. If the fixed-length code is used, the word length can be coded adaptively based on the image width, the coded runs, or the remaining LCU, or the word length can be fixed based on the image width or be signaled to the decoder. For example, an LCU row in a picture has N LCUs and the LCU being SAO processed is the fc-th LCU in the LCU row, where k= 0...N-1. If a run needs to be coded, the maximum number of run is N-l-k. The word length of the to-be-coded run is floor(log2(N-l-&) +1). In another example, the maximum and minimum number of run in a slice or picture can be calculated first. Based on the maximum and minimum value, the word length of the fixed-length code can be derived and coded.
[0054] In yet another embodiment according to the present invention, the information for the number of runs and delta-runs can be incorporated at slice level. The number of runs, delta-runs or the number of LCUs, NumSaoRun, is signaled at slice level. The number of LCUs for the current coding SAOP can be specified using the NumSaoRun flag. Furthermore, the number of runs and delta-runs or the number of LCUs can be predicted using the number of LCUs in one coding picture. The prediction equation is given by: NumSaoRun = sao_num_run_info + NumTBsInPicture,
where NumTBsInPicture is the number of LCUs in one picture and sao_num_run_info is the predicted residual value. Syntax sao_num_run_info can be coded using a signed or unsigned variable-length. Syntax sao_num_run_info may also be coded using a signed or unsigned fixed-length code word.
[0055] Embodiment of in-loop filter according to the present invention as described above may be implemented in various hardware, software codes, or a combination of both. For example, an embodiment of the present invention can be a circuit integrated into a video compression chip or program codes integrated into video compression software to perform the processing described herein. An embodiment of the present invention may also be program codes to be executed on a Digital Signal Processor (DSP) to perform the processing described herein. The invention may also involve a number of functions to be performed by a computer processor, a digital signal processor, a microprocessor, or field programmable gate array (FPGA). These processors can be configured to perform particular tasks according to the invention, by executing machine- readable software code or firmware code that defines the particular methods embodied by the invention. The software code or firmware codes may be developed in different programming languages and different format or style. The software code may also be compiled for different target platform. However, different code formats, styles and languages of software codes and other means of configuring code to perform the tasks in accordance with the invention will not depart from the spirit and scope of the invention.
[0056] The invention may be embodied in other specific forms without departing from its spirit or essential characteristics. The described examples are to be considered in all respects only as illustrative and not restrictive. The scope of the invention is, therefore, indicated by the appended claims rather than by the foregoing description. All changes which come within the meaning and range of equivalency of the claims are to be embraced within their scope.

Claims

1. A method for processing reconstructed video using in-loop filter in a video decoder, the method comprising:
deriving reconstructed video data from a video bitstream, wherein the reconstructed video data comprises luma component and chroma components;
receiving chroma in-loop filter indication from the video bitstream if luma in-loop filter indication in the video bitstream indicates that in-loop filter processing is applied to the luma component;
determining chroma in-loop filter information if the chroma in-loop filter indication indicates that the in-loop filter processing is applied to the chroma components; and
applying the in-loop filter processing to the chroma components according to the chroma in-loop filter information if the chroma in-loop filter indication indicates that the in-loop filter processing is applied to the chroma components.
2. The method of Claim 1, wherein the chroma in-loop filter indication uses a single chroma in-loop filter flag for the chroma components to share.
3. The method of Claim 1, wherein the chroma in-loop filter indication uses individual chroma in-loop filter flags for the chroma components respectively.
4. The method of Claim 1, wherein a chroma picture area of the reconstructed video is partitioned into chroma blocks and the chroma in-loop filter is applied to the chroma blocks; wherein the chroma in-loop filter information is received from the video bitstream if a current reconstructed chroma block corresponding to one of the chroma components is a new partition; the chroma in-loop filter information is derived from a target chroma block if the current reconstructed chroma block is not said new partition; and wherein the current reconstructed chroma block is merged with the target chroma block selected from one or more candidate chroma blocks corresponding to one or more neighboring chroma blocks of the current reconstructed chroma block.
5. The method of Claim 4, wherein the chroma in-loop filter information is determined based on a merge flag in the video bitstream if said one or more neighboring chroma blocks contain more than one neighboring chroma block; and wherein the chroma in-loop filter information is inferred if said one or more neighboring chroma blocks contain one neighboring chroma block.
6. The method of Claim 5, wherein at least one of said one or more candidate chroma blocks is eliminated from merging with the current reconstructed chroma block according to quadtree-partition property and merge information of said one or more candidate chroma blocks.
7. The method of Claim 1, wherein a picture area of the reconstructed video is partitioned into blocks; wherein luma in-loop filter and the chroma in-loop filter are applied to luma blocks and chroma blocks respectively; and wherein partition information for the chroma components are derived from the partition information for the luma component.
8. The method of Claim 7, wherein the chroma components share the chroma in-loop filter information.
9. The method of Claim 7, wherein the picture area of the reconstructed video is partitioned into the blocks using quadtree partition; and wherein quadtree-based syntax for the chroma components is derived from the quadtree-based syntax for the luma component.
10. The method of Claim 1, wherein a picture area of the reconstructed video is partitioned into blocks; wherein luma in-loop filter and the chroma in-loop filter are applied to luma blocks and chroma blocks using luma in-loop information and the chroma in-loop information respectively; and wherein the luma in-loop information associated with each luma block or the chroma in-loop information associated with each chroma block is encoded using an index pointing to a first set of luma in-loop information or a second set of chroma in-loop information.
11. The method of Claim 10, wherein a first set size corresponding to a number of luma in- loop filter information in the first set is updated when new luma in-loop filter information is signaled or a second set size corresponding to the number of the chroma in-loop filter information in the second set is updated when new chroma in-loop filter information is signaled.
12. The method of Claim 11, wherein a first bit length to represent the first set size or a second bit length to represent the second set size is dynamically adjusted to accommodate the first set size or the second set size.
13. The method of Claim 1, wherein the in-loop filter processing applied to the chroma components replaces exterior data from one or more other chroma picture areas with known data or current chroma picture area data or the in-loop filter processing is skipped if the in-loop filter processing for the current chroma picture area refers to the exterior data.
14. The method of Claim 13, wherein a control flag is used to indicate whether the in-loop filter processing replaces exterior data or whether to skip the in-loop filter processing if the in- loop filter processing for the current chroma picture area refers to the exterior data.
15. The method of Claim 14, wherein the control flag is a sequence level flag or a picture level flag.
16. The method of Claim 14, wherein the control flag is shared by multiple in-loop filters.
17. The method of Claim 1, wherein a picture area of the reconstructed video is partitioned into blocks; wherein luma in-loop filter and the chroma in-loop filter are applied to luma blocks and chroma blocks using luma in-loop information and the chroma in-loop information respectively; and wherein the luma in-loop information or the chroma in-loop information for a current block is respectively predicted by the luma in-loop information or the chroma in-loop information for one or more other blocks.
18. The method of Claim 17, wherein the luma in-loop information or the chroma in-loop information for the current block is respectively predicted by the luma in-loop information or the chroma in-loop information corresponding to one or more neighboring blocks of the current block.
19. The method of Claim 1, wherein the in-loop filter is selected from a group consisting of sample adaptive offset (SAO), adaptive loop filter (ALF) or a combination of SAO and ALF.
20. A method for processing reconstructed video using in-loop filter in a video decoder, wherein a picture area of the reconstructed video is partitioned into blocks and the in-loop filter is applied to the blocks, the method comprising:
deriving reconstructed video data comprising reconstructed block from a video bitstream; receiving in-loop filter information from the video bitstream if a current reconstructed block is a new partition;
deriving the in-loop filter information from a target block if the current reconstructed block is not said new partition, wherein the current reconstructed block is merged with the target block selected from one or more candidate blocks corresponding to one or more neighboring blocks of the current reconstructed block; and
applying in-loop filter processing to the current reconstructed block using the in-loop filter information.
21. The method of Claim 20, wherein said deriving the in-loop filter information is based on a merge flag in the video bitstream if said one or more neighboring blocks contain more than one neighboring block; and wherein said deriving the in-loop filter information is inferred if said one or more neighboring blocks contain one neighboring block.
22. The method of Claim 20, wherein at least one of said one or more candidate blocks is eliminated from merging with the current reconstructed block according to quadtree-partition property and merge information of said one or more candidate blocks.
23. A method for processing reconstructed video using in-loop filter in a video encoder, the method comprising:
deriving reconstructed video data comprising luma component and chroma components; incorporating chroma in-loop filter indication in a video bitstream if luma in-loop filter indication indicates that in-loop filter processing is applied to the luma component;
incorporating chroma in-loop filter information in the video bitstream if the chroma in-loop filter indication indicates that the in-loop filter processing is applied to the chroma components; and
applying the in-loop filter processing to the chroma components according to the chroma in-loop filter information if the chroma in-loop filter indication indicates that the in-loop filter processing is applied to the chroma components.
24. The method of Claim 23, wherein a chroma picture area of the reconstructed video is partitioned into chroma blocks and the chroma in-loop filter is applied to the chroma blocks; wherein the chroma in-loop filter information is incorporated in the video bitstream if a current reconstructed chroma block corresponding to one of the chroma components is a new partition; the chroma in-loop filter information is derived from a target chroma block if the current reconstructed chroma block is not said new partition; and wherein the current reconstructed chroma block is merged with the target chroma block selected from one or more candidate chroma blocks corresponding to one or more neighboring chroma blocks of the current reconstructed chroma block.
25. The method of Claim 23, wherein a picture area of the reconstructed video is partitioned into blocks; wherein luma in-loop filter and the chroma in-loop filter are applied to luma blocks and chroma blocks respectively; and wherein partition information for the chroma components are derived from the partition information for the luma component.
26. The method of Claim 23, wherein a picture area of the reconstructed video is partitioned into blocks; wherein luma in-loop filter and the chroma in-loop filter are applied to luma blocks and chroma blocks using luma in-loop information and the chroma in-loop information respectively; and wherein the luma in-loop information associated with each luma block or the chroma in-loop information associated with each chroma block is encoded using an index pointing to a first set of luma in-loop information or a second set of chroma in-loop information.
27. The method of Claim 23, wherein a picture area of the reconstructed video is partitioned into blocks; wherein luma in-loop filter and the chroma in-loop filter are applied to luma blocks and chroma blocks using luma in-loop information and the chroma in-loop information respectively; and wherein the luma in-loop information or the chroma in-loop information for a current block is provided using prediction based on the luma in-loop information or the chroma in-loop information for one or more other blocks.
28. The method of Claim 23, wherein the in-loop filter is selected from a group consisting of sample adaptive offset (SAO), adaptive loop filter (ALF) or a combination of SAO and ALF.
29. A method for processing reconstructed video using in-loop filter in a video encoder, wherein a picture area of the reconstructed video is partitioned into blocks and the in-loop filter is applied to the blocks, the method comprising:
deriving reconstructed video data;
incorporating in-loop filter information in a video bitstream if a current reconstructed block is a new partition;
incorporating the in-loop filter information in the video bitstream based on a target block if the current reconstructed block is not said new partition, wherein the current reconstructed block is merged with the target block selected from one or more candidate blocks corresponding to one or more neighboring blocks of the current reconstructed block; and
applying in-loop filter processing to the current reconstructed block using the in-loop filter information.
30. An apparatus for processing reconstructed video using in-loop filter in a video decoder, the apparatus comprising:
means for deriving reconstructed video data from a video bitstream, wherein the reconstructed video data comprises luma component and chroma components;
means for receiving chroma in-loop filter indication from the video bitstream if luma in- loop filter indication in the video bitstream indicates that in-loop filter processing is applied to the luma component;
means for determining chroma in-loop filter information if the chroma in-loop filter indication indicates that the in-loop filter processing is applied to the chroma components; and means for applying the in-loop filter processing to the chroma components according to the chroma in-loop filter information if the chroma in-loop filter indication indicates that the in-loop filter processing is applied to the chroma components.
31. The apparatus of Claim 30, wherein a chroma picture area of the reconstructed video is partitioned into chroma blocks and the chroma in-loop filter is applied to the chroma blocks; wherein the chroma in-loop filter information is received from the video bitstream if a current reconstructed chroma block corresponding to one of the chroma components is a new partition; the chroma in-loop filter information is derived from a target chroma block if the current reconstructed chroma block is not said new partition; and wherein the current reconstructed chroma block is merged with the target chroma block selected from one or more candidate chroma blocks corresponding to one or more neighboring chroma blocks of the current reconstructed chroma block.
32. The apparatus of Claim 30, wherein the in-loop filter is selected from a group consisting of sample adaptive offset (SAO), adaptive loop filter (ALF) or a combination of SAO and ALF.
33. An apparatus for processing reconstructed video using in-loop filter in a video decoder, wherein a picture area of the reconstructed video is partitioned into blocks and the in-loop filter is applied to the blocks, the apparatus comprising:
means for deriving reconstructed video data comprising reconstructed block from a video bitstream;
means for receiving in-loop filter information from the video bitstream if a current reconstructed block is a new partition;
means for deriving the in-loop filter information from a target block if the current reconstructed block is not said new partition, wherein the current reconstructed block is merged with the target block selected from one or more candidate blocks corresponding to one or more neighboring blocks of the current reconstructed block; and
means for applying in-loop filter processing to the current reconstructed block using the in- loop filter information.
34. The apparatus of Claim 33, wherein said deriving the in-loop filter information is based on a merge flag in the video bitstream if said one or more neighboring blocks contain more than one neighboring block; and wherein said deriving the in-loop filter information is inferred if said one or more neighboring blocks contain one neighboring block.
35. The apparatus of Claim 33, wherein at least one of said one or more candidate blocks is eliminated from merging with the current reconstructed block according to quadtree-partition property and merge information of said one or more candidate blocks.
36. An apparatus for processing reconstructed video using in-loop filter in a video encoder, the apparatus comprising:
means for deriving reconstructed video data comprising luma component and chroma components;
means for incorporating chroma in-loop filter indication in a video bitstream if luma in-loop filter indication indicates that in-loop filter processing is applied to the luma component;
means for incorporating chroma in-loop filter information in the video bitstream if the chroma in-loop filter indication indicates that the in-loop filter processing is applied to the chroma components; and
means for applying the in-loop filter processing to the chroma components according to the chroma in-loop filter information if the chroma in-loop filter indication indicates that the in-loop filter processing is applied to the chroma components.
37. The apparatus of Claim 36, wherein the in-loop filter is selected from a group consisting of sample adaptive offset (SAO), adaptive loop filter (ALF) or a combination of SAO and ALF.
38. An apparatus for processing reconstructed video using in-loop filter in a video encoder, wherein a picture area of the reconstructed video is partitioned into blocks and the in-loop filter is applied to the blocks, the apparatus comprising:
means for deriving reconstructed video data;
means for incorporating in-loop filter information in a video bitstream if a current reconstructed block is a new partition;
means for incorporating the in-loop filter information in the video bitstream based on a target block if the current reconstructed block is not said new partition, wherein the current reconstructed block is merged with the target block selected from one or more candidate blocks corresponding to one or more neighboring blocks of the current reconstructed block; and
means for applying in-loop filter processing to the current reconstructed block using the in- loop filter information.
39. A method for processing reconstructed video using in-loop filter in a video decoder, the method comprising:
deriving reconstructed video data from a video bitstream;
receiving an in-loop filter flag in a picture level or a slice level;
applying picture -based or slice-based in-loop filter processing to an entire picture or slice of the reconstructed video data using same in-loop filter information respectively if the in-loop filter flag indicates the picture-based or slice-based in-loop filter processing; and
applying block-based in-loop filter processing to a block of the reconstructed video data if the in-loop filter flag indicates the block-based in-loop filter processing, wherein the picture is divided into a plurality of blocks, and wherein each block may use in-loop information associated with each block.
40. The method of Claim 39, wherein the in-loop information associated with a current block is shared by one or more following blocks as indicated by a run signal.
41. The method of Claim 40, wherein the run signal is incorporated in the slice level.
42. The method of Claim 39, wherein the in-loop information associated with a current block is shared by an above-block as indicated by a merge-above flag.
43. The method of Claim 39, wherein the in-loop information associated with a current block is shared by one or more following blocks as indicated by a run-difference signal; wherein the run-difference signal is determined based on a difference between a current run and a prediction run; wherein the current run is associated with a first number of blocks following the current block to share the -loop information with the current block; and wherein the prediction run is associated with a second number of blocks following an above-block to share the in-loop information with the above block.
44. The method of Claim 43, wherein the run-difference signal is set to the current run if the prediction run is not available.
45. The method of Claim 44, wherein the current run is encoded using an unsigned variable length code if the prediction run is not available; and wherein the run-difference signal is encoded using a signed variable length code if the prediction run is available.
46. The method of Claim 45, wherein the unsigned variable length code or the signed variable length code is selected from a group consisting of k-th order exp-Golomb code, Golomb-Rice code, and CABAC code.
47. The method of Claim 39, wherein each block is a largest coding unit (LCU).
48. The method of Claim 39, wherein all the blocks in a current row share the in-loop filter information with all the blocks in an above-row if a repeated-row flag indicates a repeated row; and wherein the in-loop filter information is incorporated in the video bitstream if the repeated- row flag indicates a non-repeated row.
49. The method of Claim 48, wherein an enable- repeated-row flag is incorporated in the video bitstream to indicate whether the repeated-row flag is incorporated in the video bitstream for each row of blocks.
50. The method of Claim 48, wherein the repeated-row flag is omitted in the video bitstream for the picture consisting of one slice or for a first slice of a multi- slice picture using slice-independent in-loop filter processing.
51. The method of Claim 39, wherein the in-loop information associated with a current row of blocks is shared by one or more following rows of blocks as indicated by a row-run signal associated with a number of said one of more following rows.
52. The method of Claim 51 wherein the row-run signal is represented by a fixed length code; and wherein bit length of the fixed length code is derived based on minimum row run and maximum row run.
53. A method for processing reconstructed video using in-loop filter in a video encoder, the method comprising:
deriving reconstructed video data;
incorporating an in-loop filter flag in a picture level or a slice level;
applying picture -based or slice-based in-loop filter processing to an entire picture or slice of the reconstructed video data using same in-loop filter information respectively if the in-loop filter flag indicates the picture-based or slice-based in-loop filter processing; and
applying block-based in-loop filter processing to a block of the reconstructed video data if the in-loop filter flag indicates the block-based in-loop filter processing, wherein the picture is divided into a plurality of blocks, and wherein each block may use in-loop information associated with each block.
54. The method of Claim 53, further comprising incorporating a run signal in a video bitstream to indicate a number of one or more following blocks to share the in-loop information associated with a current block.
55. The method of Claim 54, wherein the run signal is incorporated in the slice level.
56. The method of Claim 54, further comprising incorporating a merge-above flag in a video bitstream to indicate that the in-loop information associated with a current block is shared by an above-block.
57. The method of Claim 53, further comprising incorporating a run-difference signal to indicate that the in-loop information associated with a current block is shared by one or more following blocks as indicated by the run-difference signal; wherein the run-difference signal is determined based on a difference between a current run and a prediction run; wherein the current run is associated with a first number of blocks following the current block to share the in-loop information with the current block; and wherein the prediction run is associated with a second number of blocks following an above-block to share the in-loop information with the above block.
58. An apparatus for processing reconstructed video using in-loop filter in a video decoder, the apparatus comprising:
means for deriving reconstructed video data from a video bitstream;
means for receiving an in-loop filter flag in a picture level or a slice level;
means for applying picture-based or slice-based in-loop filter processing to an entire picture or slice of the reconstructed video data using same in-loop filter information respectively if the in-loop filter flag indicates the picture-based or slice-based in-loop filter processing; and
means for applying block-based in-loop filter processing to a block of the reconstructed video data if the in-loop filter flag indicates the block-based in-loop filter processing, wherein the picture is divided into a plurality of blocks, and wherein each block may use in-loop information associated with each block.
59. An apparatus for processing reconstructed video using in-loop filter in a video encoder, the apparatus comprising:
means for deriving reconstructed video data;
incorporating an in-loop filter flag in a picture level or a slice level;
means for applying picture-based or slice-based in-loop filter processing to an entire picture or slice of the reconstructed video data using same in-loop filter information respectively if the in-loop filter flag indicates the picture-based or slice-based in-loop filter processing; and
means for applying block-based in-loop filter processing to a block of the reconstructed video data if the in-loop filter flag indicates the block-based in-loop filter processing, wherein the picture is divided into a plurality of blocks, and wherein each block may use in-loop information associated with each block.
PCT/CN2012/071147 2011-05-16 2012-02-15 Apparatus and method of sample adaptive offset for luma and chroma components Ceased WO2012155553A1 (en)

Priority Applications (4)

Application Number Priority Date Filing Date Title
CN201280022870.8A CN103535035B (en) 2011-05-16 2012-02-15 Method and apparatus for sample adaptive offset of luma and chroma components
DE112012002125.8T DE112012002125T5 (en) 2011-05-16 2012-02-15 Apparatus and method for a scan adaptive offset for luminance and chrominance components
GB1311592.8A GB2500347B (en) 2011-05-16 2012-02-15 Apparatus and method of sample adaptive offset for luma and chroma components
ZA2013/05528A ZA201305528B (en) 2011-05-16 2013-07-22 Apparatus and method of sample adaptive offset for luma and chroma components

Applications Claiming Priority (10)

Application Number Priority Date Filing Date Title
US201161486504P 2011-05-16 2011-05-16
US61/486,504 2011-05-16
US13/158,427 US9055305B2 (en) 2011-01-09 2011-06-12 Apparatus and method of sample adaptive offset for video coding
US13/158,427 2011-06-12
US201161498949P 2011-06-20 2011-06-20
US61/498,949 2011-06-20
US201161503870P 2011-07-01 2011-07-01
US61/503,870 2011-07-01
US13/311,953 2011-12-06
US13/311,953 US20120294353A1 (en) 2011-05-16 2011-12-06 Apparatus and Method of Sample Adaptive Offset for Luma and Chroma Components

Publications (1)

Publication Number Publication Date
WO2012155553A1 true WO2012155553A1 (en) 2012-11-22

Family

ID=47176199

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2012/071147 Ceased WO2012155553A1 (en) 2011-05-16 2012-02-15 Apparatus and method of sample adaptive offset for luma and chroma components

Country Status (5)

Country Link
CN (3) CN103535035B (en)
DE (1) DE112012002125T5 (en)
GB (1) GB2500347B (en)
WO (1) WO2012155553A1 (en)
ZA (1) ZA201305528B (en)

Cited By (23)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2013012845A (en) * 2011-06-28 2013-01-17 Sony Corp Image processing device and method
JP2013255252A (en) * 2011-06-27 2013-12-19 Panasonic Corp Image decoding method and image decoder
JP2014523183A (en) * 2011-06-28 2014-09-08 サムスン エレクトロニクス カンパニー リミテッド Video encoding method and apparatus using offset adjustment by pixel classification, and video decoding method and apparatus
EP2723073A4 (en) * 2011-06-14 2014-11-26 Lg Electronics Inc METHOD FOR ENCODING AND DECODING IMAGE INFORMATION
EP2725790A4 (en) * 2011-06-24 2014-12-10 Lg Electronics Inc METHOD FOR ENCODING AND DECODING IMAGE INFORMATION
US9106931B2 (en) 2011-11-07 2015-08-11 Canon Kabushiki Kaisha Method and device for providing compensation offsets for a set of reconstructed samples of an image
JP2016015753A (en) * 2015-08-31 2016-01-28 ソニー株式会社 Image processing apparatus and method, program, and recording medium
TWI554082B (en) * 2013-04-12 2016-10-11 高通公司 Rice parameter update for coefficient level coding in video coding process
JP2017112637A (en) * 2017-02-14 2017-06-22 ソニー株式会社 Image processing apparatus, method, program, and recording medium
EP3206400A4 (en) * 2014-10-06 2018-05-16 Sony Corporation Image processing device and method
US10021419B2 (en) 2013-07-12 2018-07-10 Qualcomm Incorported Rice parameter initialization for coefficient level coding in video coding process
CN109565594A (en) * 2016-08-02 2019-04-02 高通股份有限公司 Adaptive loop filter based on geometric transformation
CN110651473A (en) * 2017-05-09 2020-01-03 华为技术有限公司 Coded Chroma Samples in Video Compression
US10623738B2 (en) 2017-04-06 2020-04-14 Futurewei Technologies, Inc. Noise suppression filter
WO2021141714A1 (en) * 2020-01-08 2021-07-15 Tencent America LLC Method and apparatus for video coding
CN114391255A (en) * 2019-09-11 2022-04-22 夏普株式会社 System and method for reducing reconstruction errors in video coding based on cross-component correlation
TWI768414B (en) * 2019-07-26 2022-06-21 寰發股份有限公司 Method and apparatus of cross-component adaptive loop filtering for video coding
EP3991435A4 (en) * 2019-08-07 2022-08-31 Huawei Technologies Co., Ltd. Method and apparatus of sample adaptive offset in-loop filter with application region size constraint
CN115104302A (en) * 2019-12-11 2022-09-23 抖音视界有限公司 Sample filling across component adaptive loop filtering
RU2782516C1 (en) * 2020-01-08 2022-10-28 Тенсент Америка Ллс Method and apparatus for video encoding
CN116320392A (en) * 2013-01-04 2023-06-23 Ge视频压缩有限责任公司 Efficient Scalable Coding Concept
US11991353B2 (en) 2019-03-08 2024-05-21 Canon Kabushiki Kaisha Adaptive loop filter
US12452415B2 (en) 2019-09-23 2025-10-21 Interdigital Vc Holdings, Inc. Joint component video frame filtering

Families Citing this family (22)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107710760A (en) * 2015-10-15 2018-02-16 富士通株式会社 Image coding method, device and image processing equipment
WO2018054286A1 (en) * 2016-09-20 2018-03-29 Mediatek Inc. Methods and apparatuses of sample adaptive offset processing for video coding
US20180359486A1 (en) * 2017-06-07 2018-12-13 Mediatek Inc. Non-local adaptive loop filter processing
US20200007872A1 (en) * 2018-06-29 2020-01-02 Industrial Technology Research Institute Video decoding method, video decoder, video encoding method and video encoder
EP4192016A1 (en) 2018-10-23 2023-06-07 HFI Innovation Inc. Method and apparatus for reduction of in-loop filter buffer
CN112997504B (en) * 2018-11-09 2023-04-18 北京字节跳动网络技术有限公司 Component-based loop filter
KR102630411B1 (en) 2019-04-20 2024-01-29 베이징 바이트댄스 네트워크 테크놀로지 컴퍼니, 리미티드 Signaling of syntactic elements for chroma residual joint coding
CN113785574B (en) * 2019-05-30 2022-10-11 北京字节跳动网络技术有限公司 Adaptive loop filtering of chrominance components
WO2020259538A1 (en) * 2019-06-27 2020-12-30 Mediatek Inc. Method and apparatus of cross-component adaptive loop filtering for video coding
KR102889120B1 (en) 2019-07-08 2025-11-19 엘지전자 주식회사 Video or image coding using adaptive loop filters
KR102848127B1 (en) 2019-08-29 2025-08-19 엘지전자 주식회사 Adaptive loop filtering-based image coding device and method
ES2994118T3 (en) * 2019-08-29 2025-01-17 Lg Electronics Inc Apparatus and method for coding image
PL4024858T3 (en) * 2019-08-29 2025-10-06 Lg Electronics Inc. Cross-component adaptive loop filtering-based image coding apparatus and method
CN119767042A (en) * 2019-08-29 2025-04-04 Lg电子株式会社 Image encoding/decoding method, data transmission method and storage medium
CN120321388A (en) * 2019-08-29 2025-07-15 Lg 电子株式会社 Device and method for image coding based on filtering
EP4014485B1 (en) * 2019-09-18 2025-05-07 Beijing Bytedance Network Technology Co., Ltd. Two-part signaling of adaptive loop filters in video coding
JP7389252B2 (en) * 2019-10-29 2023-11-29 北京字節跳動網絡技術有限公司 Cross-component adaptive loop filter
CN119484816A (en) * 2019-11-22 2025-02-18 韩国电子通信研究院 Image encoding/decoding method and bit stream transmission method using adaptive loop filter
KR102777600B1 (en) * 2020-03-30 2025-03-06 바이트댄스 아이엔씨 Conformity window parameters in video coding
CN114007067B (en) * 2020-07-28 2023-05-23 北京达佳互联信息技术有限公司 Method, apparatus and medium for decoding video signal
US11849117B2 (en) 2021-03-14 2023-12-19 Alibaba (China) Co., Ltd. Methods, apparatus, and non-transitory computer readable medium for cross-component sample adaptive offset
CN116433783A (en) * 2021-12-31 2023-07-14 中兴通讯股份有限公司 Method and device for video processing, storage medium and electronic device

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060227883A1 (en) * 2005-04-11 2006-10-12 Intel Corporation Generating edge masks for a deblocking filter
EP1944974A1 (en) * 2007-01-09 2008-07-16 Matsushita Electric Industrial Co., Ltd. Position dependent post-filter hints
CN101517909A (en) * 2006-09-15 2009-08-26 飞思卡尔半导体公司 Video information processing system with selective chroma deblock filtering

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8938009B2 (en) * 2007-10-12 2015-01-20 Qualcomm Incorporated Layered encoded bitstream structure
DK2663076T3 (en) * 2009-04-20 2016-12-05 Dolby Laboratories Licensing Corp Filter Selection for video preprocessing of video applications
JP5763210B2 (en) * 2011-04-21 2015-08-12 メディアテック インコーポレイテッド Method and apparatus for improved loop-type filtering process
US9008170B2 (en) * 2011-05-10 2015-04-14 Qualcomm Incorporated Offset type and coefficients signaling method for sample adaptive offset
SI2725797T1 (en) * 2011-06-23 2018-12-31 Huawei Technologies Co., Ltd. Offset decoding device, offset encoding device, image filter device, and data structure

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060227883A1 (en) * 2005-04-11 2006-10-12 Intel Corporation Generating edge masks for a deblocking filter
CN101517909A (en) * 2006-09-15 2009-08-26 飞思卡尔半导体公司 Video information processing system with selective chroma deblock filtering
EP1944974A1 (en) * 2007-01-09 2008-07-16 Matsushita Electric Industrial Co., Ltd. Position dependent post-filter hints

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
MADHUKAR BUDAGAVI ET AL.: "Chroma ALF with reduced vertical filter size", JOINT COLLABORATIVE TEAM ON VIDEO CODING (JCT-VC) OF ITU-T SG16 WP3 AND ISO/IEC JTC1/SC29/WG11, 5TH MEETING, JCTVC-E287, 16 March 2011 (2011-03-16) - 23 March 2011 (2011-03-23), GENEVA, CH, pages 1 - 6 *

Cited By (69)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10924767B2 (en) 2011-06-14 2021-02-16 Lg Electronics Inc. Method for encoding and decoding image information
US9992515B2 (en) 2011-06-14 2018-06-05 Lg Electronics Inc. Method for encoding and decoding image information
EP2723073A4 (en) * 2011-06-14 2014-11-26 Lg Electronics Inc METHOD FOR ENCODING AND DECODING IMAGE INFORMATION
US9300982B2 (en) 2011-06-14 2016-03-29 Lg Electronics Inc. Method for encoding and decoding image information
US9565453B2 (en) 2011-06-14 2017-02-07 Lg Electronics Inc. Method for encoding and decoding image information
US11671630B2 (en) 2011-06-14 2023-06-06 Lg Electronics Inc. Method for encoding and decoding image information
US11418815B2 (en) 2011-06-14 2022-08-16 Lg Electronics Inc. Method for encoding and decoding image information
US10531126B2 (en) 2011-06-14 2020-01-07 Lg Electronics Inc. Method for encoding and decoding image information
US10798421B2 (en) 2011-06-14 2020-10-06 Lg Electronics Inc. Method for encoding and decoding image information
US11700369B2 (en) 2011-06-24 2023-07-11 Lg Electronics Inc. Image information encoding and decoding method
US10944968B2 (en) 2011-06-24 2021-03-09 Lg Electronics Inc. Image information encoding and decoding method
US10547837B2 (en) 2011-06-24 2020-01-28 Lg Electronics Inc. Image information encoding and decoding method
US11303893B2 (en) 2011-06-24 2022-04-12 Lg Electronics Inc. Image information encoding and decoding method
US9294770B2 (en) 2011-06-24 2016-03-22 Lg Electronics Inc. Image information encoding and decoding method
US9253489B2 (en) 2011-06-24 2016-02-02 Lg Electronics Inc. Image information encoding and decoding method
US10091505B2 (en) 2011-06-24 2018-10-02 Lg Electronics Inc. Image information encoding and decoding method
EP2725790A4 (en) * 2011-06-24 2014-12-10 Lg Electronics Inc METHOD FOR ENCODING AND DECODING IMAGE INFORMATION
US9743083B2 (en) 2011-06-24 2017-08-22 Lg Electronics Inc. Image information encoding and decoding method
JP2013255252A (en) * 2011-06-27 2013-12-19 Panasonic Corp Image decoding method and image decoder
US10187664B2 (en) 2011-06-28 2019-01-22 Sony Corporation Image processing device and method
JP2015128332A (en) * 2011-06-28 2015-07-09 サムスン エレクトロニクス カンパニー リミテッド Video encoding method using offset adjustments according to pixel classification and apparatus therefor, and video decoding method and apparatus therefor
JP2016197890A (en) * 2011-06-28 2016-11-24 サムスン エレクトロニクス カンパニー リミテッド Video encoding method and apparatus using offset adjustment by pixel classification, and video decoding method and apparatus
US9462288B2 (en) 2011-06-28 2016-10-04 Samsung Electronics Co., Ltd. Video encoding method using offset adjustments according to pixel classification and apparatus therefor, video decoding method and apparatus therefor
US10542273B2 (en) 2011-06-28 2020-01-21 Samsung Electronics Co., Ltd. Video encoding method using offset adjustments according to pixel classification and apparatus therefor, video decoding method and apparatus therefor
JP2013012845A (en) * 2011-06-28 2013-01-17 Sony Corp Image processing device and method
JP2014523183A (en) * 2011-06-28 2014-09-08 サムスン エレクトロニクス カンパニー リミテッド Video encoding method and apparatus using offset adjustment by pixel classification, and video decoding method and apparatus
US9438922B2 (en) 2011-06-28 2016-09-06 Samsung Electronics Co., Ltd. Video encoding method using offset adjustments according to pixel classification and apparatus therefor, video decoding method and apparatus therefor
EP2727360A4 (en) * 2011-06-28 2015-03-11 Sony Corp IMAGE PROCESSING DEVICE AND METHOD
JP2015164331A (en) * 2011-06-28 2015-09-10 サムスン エレクトロニクス カンパニー リミテッド Video encoding method using offset adjustments according to pixel classification and apparatus therefor, video decoding method and apparatus therefor
US9438921B2 (en) 2011-06-28 2016-09-06 Samsung Electronics Co., Ltd. Video encoding method using offset adjustments according to pixel classification and apparatus therefor, video decoding method and apparatus therefor
JP2015128333A (en) * 2011-06-28 2015-07-09 サムスン エレクトロニクス カンパニー リミテッド Video encoding method and apparatus using offset adjustment by pixel classification, and video decoding method and apparatus
US10038911B2 (en) 2011-06-28 2018-07-31 Samsung Electronics Co., Ltd. Video encoding method using offset adjustments according to pixel classification and apparatus therefor, video decoding method and apparatus therefor
JP2015128334A (en) * 2011-06-28 2015-07-09 サムスン エレクトロニクス カンパニー リミテッド Video encoding method using offset adjustments according to pixel classification and apparatus therefor, and video decoding method and apparatus therefor
US9426483B2 (en) 2011-06-28 2016-08-23 Samsung Electronics Co., Ltd. Video encoding method using offset adjustments according to pixel classification and apparatus therefor, video decoding method and apparatus therefor
US9426482B2 (en) 2011-06-28 2016-08-23 Samsung Electronics Co., Ltd. Video encoding method using offset adjustments according to pixel classification and apparatus therefor, video decoding method and apparatus therefor
US10085042B2 (en) 2011-11-07 2018-09-25 Canon Kabushiki Kaisha Method, device and program for encoding and decoding a sequence of images using area-by-area loop filtering
US9106931B2 (en) 2011-11-07 2015-08-11 Canon Kabushiki Kaisha Method and device for providing compensation offsets for a set of reconstructed samples of an image
US9118931B2 (en) 2011-11-07 2015-08-25 Canon Kabushiki Kaisha Method and device for optimizing encoding/decoding of compensation offsets for a set of reconstructed samples of an image
EP2777255B1 (en) * 2011-11-07 2017-03-29 Canon Kabushiki Kaisha Method and device for optimizing encoding/decoding of compensation offsets for a set of reconstructed samples of an image
CN116320392A (en) * 2013-01-04 2023-06-23 Ge视频压缩有限责任公司 Efficient Scalable Coding Concept
TWI554082B (en) * 2013-04-12 2016-10-11 高通公司 Rice parameter update for coefficient level coding in video coding process
US9936200B2 (en) 2013-04-12 2018-04-03 Qualcomm Incorporated Rice parameter update for coefficient level coding in video coding process
US10021419B2 (en) 2013-07-12 2018-07-10 Qualcomm Incorported Rice parameter initialization for coefficient level coding in video coding process
EP3206400A4 (en) * 2014-10-06 2018-05-16 Sony Corporation Image processing device and method
JP2016015753A (en) * 2015-08-31 2016-01-28 ソニー株式会社 Image processing apparatus and method, program, and recording medium
CN109565594A (en) * 2016-08-02 2019-04-02 高通股份有限公司 Adaptive loop filter based on geometric transformation
JP2017112637A (en) * 2017-02-14 2017-06-22 ソニー株式会社 Image processing apparatus, method, program, and recording medium
US10623738B2 (en) 2017-04-06 2020-04-14 Futurewei Technologies, Inc. Noise suppression filter
CN110651473A (en) * 2017-05-09 2020-01-03 华为技术有限公司 Coded Chroma Samples in Video Compression
CN110651473B (en) * 2017-05-09 2022-04-22 华为技术有限公司 Encoding chroma samples in video compression
RU2805997C2 (en) * 2019-03-07 2023-10-24 ЭлДжи ЭЛЕКТРОНИКС ИНК. Coding of video or images based on brightness signal conversion with colour signal scale
US11991353B2 (en) 2019-03-08 2024-05-21 Canon Kabushiki Kaisha Adaptive loop filter
TWI768414B (en) * 2019-07-26 2022-06-21 寰發股份有限公司 Method and apparatus of cross-component adaptive loop filtering for video coding
US11997266B2 (en) 2019-07-26 2024-05-28 Hfi Innovation Inc. Method and apparatus of cross-component adaptive loop filtering for video coding
US12041229B2 (en) 2019-08-07 2024-07-16 Huawei Technologies Co., Ltd. Method and apparatus of sample adaptive offset in-loop filter with application region size constraint
EP3991435A4 (en) * 2019-08-07 2022-08-31 Huawei Technologies Co., Ltd. Method and apparatus of sample adaptive offset in-loop filter with application region size constraint
CN114391255B (en) * 2019-09-11 2024-05-17 夏普株式会社 System and method for reducing reconstruction errors in video coding based on cross-component correlation
CN114391255A (en) * 2019-09-11 2022-04-22 夏普株式会社 System and method for reducing reconstruction errors in video coding based on cross-component correlation
US20220345698A1 (en) * 2019-09-11 2022-10-27 Sharp Kabushiki Kaisha Systems and methods for reducing a reconstruction error in video coding based on a cross-component correlation
US12081747B2 (en) 2019-09-11 2024-09-03 Sharp Kabushiki Kaisha Systems and methods for reducing a reconstruction error in video coding based on a cross-component correlation
US20240397044A1 (en) * 2019-09-11 2024-11-28 Sharp Kabushiki Kaisha Systems and methods for reducing a reconstruction error in video coding based on a cross-component correlation
US12506865B2 (en) * 2019-09-11 2025-12-23 Sharp Kabushiki Kaisha Systems and methods for reducing a reconstruction error in video coding based on a cross-component correlation
US12452415B2 (en) 2019-09-23 2025-10-21 Interdigital Vc Holdings, Inc. Joint component video frame filtering
CN115104302A (en) * 2019-12-11 2022-09-23 抖音视界有限公司 Sample filling across component adaptive loop filtering
US11736710B2 (en) 2020-01-08 2023-08-22 Tencent America LLC Method and apparatus for video coding
US11303914B2 (en) 2020-01-08 2022-04-12 Tencent America LLC Method and apparatus for video coding
WO2021141714A1 (en) * 2020-01-08 2021-07-15 Tencent America LLC Method and apparatus for video coding
RU2782516C1 (en) * 2020-01-08 2022-10-28 Тенсент Америка Ллс Method and apparatus for video encoding
US12382074B2 (en) 2020-01-08 2025-08-05 Tencent America LLC Signaling presence of chroma component in video bitstream

Also Published As

Publication number Publication date
CN105120270B (en) 2018-09-04
DE112012002125T5 (en) 2014-02-20
GB2500347A (en) 2013-09-18
CN103535035A (en) 2014-01-22
GB201311592D0 (en) 2013-08-14
CN105120270A (en) 2015-12-02
ZA201305528B (en) 2014-10-29
CN106028050B (en) 2019-04-26
CN106028050A (en) 2016-10-12
CN103535035B (en) 2017-03-15
GB2500347B (en) 2018-05-16

Similar Documents

Publication Publication Date Title
US10405004B2 (en) Apparatus and method of sample adaptive offset for luma and chroma components
WO2012155553A1 (en) Apparatus and method of sample adaptive offset for luma and chroma components
US10116967B2 (en) Method and apparatus for coding of sample adaptive offset information
US9872015B2 (en) Method and apparatus for improved in-loop filtering
AU2013248857B2 (en) Method and apparatus for loop filtering across slice or tile boundaries
AU2012327672B2 (en) Method and apparatus for non-cross-tile loop filtering
KR101752612B1 (en) Method of sample adaptive offset processing for video coding
CN113612998A (en) Method and apparatus for sample adaptive offset processing for video coding and decoding

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 12786530

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 1311592

Country of ref document: GB

Kind code of ref document: A

Free format text: PCT FILING DATE = 20120215

WWE Wipo information: entry into national phase

Ref document number: 1311592.8

Country of ref document: GB

WWE Wipo information: entry into national phase

Ref document number: 112012002125

Country of ref document: DE

Ref document number: 1120120021258

Country of ref document: DE

122 Ep: pct application non-entry in european phase

Ref document number: 12786530

Country of ref document: EP

Kind code of ref document: A1