[go: up one dir, main page]

WO2017000222A1 - Grouping bypass bins and improved sign data hiding for residual coding - Google Patents

Grouping bypass bins and improved sign data hiding for residual coding Download PDF

Info

Publication number
WO2017000222A1
WO2017000222A1 PCT/CN2015/082833 CN2015082833W WO2017000222A1 WO 2017000222 A1 WO2017000222 A1 WO 2017000222A1 CN 2015082833 W CN2015082833 W CN 2015082833W WO 2017000222 A1 WO2017000222 A1 WO 2017000222A1
Authority
WO
WIPO (PCT)
Prior art keywords
pass
coeff
flag
scan
size
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2015/082833
Other languages
French (fr)
Inventor
Han HUANG
Jicheng An
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
MediaTek Singapore Pte Ltd
Original Assignee
MediaTek Singapore Pte Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by MediaTek Singapore Pte Ltd filed Critical MediaTek Singapore Pte Ltd
Priority to PCT/CN2015/082833 priority Critical patent/WO2017000222A1/en
Priority to CN202011088607.1A priority patent/CN112272298B/en
Priority to EP16813706.5A priority patent/EP3292690B1/en
Priority to CN201680036906.6A priority patent/CN107710759B/en
Priority to US15/737,406 priority patent/US10382768B2/en
Priority to CA2988451A priority patent/CA2988451C/en
Priority to EP18215487.2A priority patent/EP3484149B1/en
Priority to PCT/CN2016/086808 priority patent/WO2016206590A1/en
Publication of WO2017000222A1 publication Critical patent/WO2017000222A1/en
Anticipated expiration legal-status Critical
Priority to US16/171,475 priority patent/US10582203B2/en
Ceased legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/48Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using compressed domain processing techniques other than decoding, e.g. modification of transform coefficients, variable length coding [VLC] data or run-length data
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/46Embedding additional information in the video signal during the compression process
    • H04N19/467Embedding additional information in the video signal during the compression process characterised by the embedded information being invisible, e.g. watermarking
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/90Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using coding techniques not provided for in groups H04N19/10-H04N19/85, e.g. fractals
    • H04N19/91Entropy coding, e.g. variable length coding [VLC] or arithmetic coding

Definitions

  • the invention relates generally to image and video coding.
  • Transform coding is widely used in typical image/video coder.
  • An image block either original signal or prediction residual, is first transformed, scaled and quantized, and then the quantized transform coefficients are entropy coded.
  • a Coding Group is defined as a set of 16 consecutive coefficients in scan order. Given the scan order, a CG corresponds to a 4x4 subblock, an example of 8x8 TU consisting 4 CGs is shown in Fig. 1.
  • a syntax element coded_sub_block_flag is signaled to indicate whether a subblock contains non-zero coefficients. If significant, then the coefficient significant flag, sign flag, and absolute level of the subblock are further coded by up to five scan passes. Each scan pass codes a syntax element within a CG, when necessary, as follows:
  • coeff_abs_level_greater1_flag flag indicating whether the absolute value of a coefficient level is greater than 1.
  • coeff_abs_level_greater2_flag flag indicating whether the absolute value of a coefficient level is greater than 2.
  • the bins in the first 3 passes are coded in regular mode (use context)
  • the bins in scan pass 4 and 5 are coded in bypass mode.
  • Grouping bypass bins can increase the throughput of the entropy coder.
  • coding the sign of the last non-zero coefficient is omitted when sign data hiding is applied.
  • the sign value is derived by the parity of the sum of the levels of the CG, even corresponds to positive and odd corresponds to negative.
  • the criterion is the distance in scan order between the first and last non-zero coefficients. If the distance is larger than a threshold, 4 in HEVC, then sign data hiding is applied.
  • Fig. 1 is a diagram illustrating an example of coding groups for 8x8 TU.
  • 3 coefficient scan passes are performed within each CG to code the syntax elements significant_coeff_flag, coeff_abs_level_greater1_flag, and coeff_abs_level_greater2_flag in the first pass of CG scan, 2 coefficient scan passes are performed within each CG to code the syntax coeff_sign_flag and coeff_abs_level_remaining elements in the second pass of CG scan.
  • the CG size in the second pass can be different from the CG size in the first pass.
  • the CG in the first pass corresponds to a 4x4 block size
  • the CG in the second pass corresponds to a 4x2 or 2x4 block size. In this way, the sub-block size for significant flag coding and sign data hiding can be optimized separately.
  • the CG in the first pass corresponds to a 4x4, 4x2 or 2x4 block size depending on TU size, but the CG in the second pass corresponds to a fixed block size, 4x4 for example.
  • the CG in the second pass corresponds to N consecutive coefficients in a predefined scan order (the scan order used in the first pass) .
  • the number N can be 4, 6, 8, 10, 12, 16, 24, 32, 64 et al.
  • the criterion for sign date hiding depends on the CG size in the second pass. For example, if the CG size in the second pass is 24, then the criterion is: when distance between the first and last non-zero coefficients in a CG is larger than 6 (or 8 et al) .
  • the CG sizes in the two passes are explicitly signaled independently.
  • an embodiment of the present invention can be a circuit integrated into a video compression chip or program codes integrated into video compression software to perform the processing described herein.
  • An embodiment of the present invention may also be program codes to be executed on a Digital Signal Processor (DSP) to perform the processing described herein.
  • DSP Digital Signal Processor
  • the invention may also involve a number of functions to be performed by a computer processor, a digital signal processor, a microprocessor, or field programmable gate array (FPGA) .
  • processors can be configured to perform particular tasks according to the invention, by executing machine-readable software code or firmware code that defines the particular methods embodied by the invention.
  • the software code or firmware codes may be developed in different programming languages and different format or style.
  • the software code may also be compiled for different target platform.
  • different code formats, styles and languages of software codes and other means of configuring code to perform the tasks in accordance with the invention will not depart from the spirit and scope of the invention.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)

Abstract

Method for grouping bypass bins and improved sign data hiding is proposed.

Description

GROUPING BYPASS BINS AND IMPROVED SIGN DATA HIDING FOR RESIDUAL CODING TECHNICAL FIELD
The invention relates generally to image and video coding.
BACKGROUND
Transform coding is widely used in typical image/video coder. An image block, either original signal or prediction residual, is first transformed, scaled and quantized, and then the quantized transform coefficients are entropy coded.
In the High Efficiency Video Coding (HEVC) standard, the basic unit for transform coding is square size Transform Unit (TU) . A Coding Group (CG) is defined as a set of 16 consecutive coefficients in scan order. Given the scan order, a CG corresponds to a 4x4 subblock, an example of 8x8 TU consisting 4 CGs is shown in Fig. 1. A syntax element coded_sub_block_flag is signaled to indicate whether a subblock contains non-zero coefficients. If significant, then the coefficient significant flag, sign flag, and absolute level of the subblock are further coded by up to five scan passes. Each scan pass codes a syntax element within a CG, when necessary, as follows:
1) significant_coeff_flag: significance of a coefficient (zero/non-zero) .
2) coeff_abs_level_greater1_flag: flag indicating whether the absolute value of a coefficient level is greater than 1.
3) coeff_abs_level_greater2_flag: flag indicating whether the absolute value of a coefficient level is greater than 2.
4) coeff_sign_flag: sign of a significant coefficient (0: positive, 1: negative) .
5) coeff_abs_level_remaining: remaining value for absolute value of a coefficient level (if value is larger than that coded in previous passes) .
The bins in the first 3 passes are coded in regular mode (use context) , the bins in scan pass 4 and 5 are coded in bypass mode. Grouping bypass bins can increase the throughput of the entropy coder.
In current HEVC, residuals in a TU is coded in CG basis, the CGs are coded one by one. Therefore, although the bypass bins within a CG are grouped together, the regular mode bins and bypass bins in a TU are interleaved.
For each CG, depending on a criterion, coding the sign of the last non-zero coefficient is omitted when sign data hiding is applied. The sign value is derived by the parity of the sum of the levels of the CG, even corresponds to positive and odd corresponds to negative. The criterion is the distance in scan order between the first and last non-zero coefficients. If the distance is larger than a threshold, 4 in HEVC, then sign data hiding is applied.
SUMMARY
Methods of grouping bypass bins and improved sign data hiding are proposed. In which, the coeff_sign_flag and coeff_abs_level_remaining are coded in a separate (2nd) CG scan pass, the CG size in the 2nd CG scan pass can be independent of that in 1st CG scan pass.
Other aspects and features of the invention will become apparent to those with ordinary skill in the art upon review of the following descriptions of specific embodiments.
BRIEF DESCRIPTION OF DRAWINGS
The invention can be more fully understood by reading the subsequent detailed description and examples with references made to the accompanying drawings, wherein:
Fig. 1 is a diagram illustrating an example of coding groups for 8x8 TU.
DETAILED DESCRIPTION
The following description is of the best-contemplated mode of carrying out the invention. This description is made for the purpose of illustrating the general  principles of the invention and should not be taken in a limiting sense. The scope of the invention is best determined by reference to the appended claims.
In the proposed methods, coding of syntax elements coeff_sign_flag and coeff_abs_level_remaining are in a separate (2nd) CG scan pass.
In one embodiment, 3 coefficient scan passes are performed within each CG to code the syntax elements significant_coeff_flag, coeff_abs_level_greater1_flag, and coeff_abs_level_greater2_flag in the first pass of CG scan, 2 coefficient scan passes are performed within each CG to code the syntax coeff_sign_flag and coeff_abs_level_remaining elements in the second pass of CG scan.
In another embodiment, the CG size in the second pass can be different from the CG size in the first pass. For example, the CG in the first pass corresponds to a 4x4 block size, but the CG in the second pass corresponds to a 4x2 or 2x4 block size. In this way, the sub-block size for significant flag coding and sign data hiding can be optimized separately.
In still another embodiment, the CG in the first pass corresponds to a 4x4, 4x2 or 2x4 block size depending on TU size, but the CG in the second pass corresponds to a fixed block size, 4x4 for example.
In still another embodiment, the CG in the second pass corresponds to N consecutive coefficients in a predefined scan order (the scan order used in the first pass) . The number N can be 4, 6, 8, 10, 12, 16, 24, 32, 64 et al.
In still another embodiment, the criterion for sign date hiding depends on the CG size in the second pass. For example, if the CG size in the second pass is 24, then the criterion is: when distance between the first and last non-zero coefficients in a CG is larger than 6 (or 8 et al) .
In still another embodiment, the CG sizes in the two passes are explicitly signaled independently.
The methods described above can be used in a video encoder as well as in a video decoder. Embodiments of grouping bypass bins and improved sign data hiding according to the present invention as described above may be implemented in various hardware, software codes, or a combination of both. For example, an embodiment of the present invention can be a circuit integrated into a video compression chip or program codes integrated into video compression software to perform the processing described herein. An embodiment of the present invention may also be program codes to be executed on a Digital Signal Processor (DSP) to perform the processing  described herein. The invention may also involve a number of functions to be performed by a computer processor, a digital signal processor, a microprocessor, or field programmable gate array (FPGA) . These processors can be configured to perform particular tasks according to the invention, by executing machine-readable software code or firmware code that defines the particular methods embodied by the invention. The software code or firmware codes may be developed in different programming languages and different format or style. The software code may also be compiled for different target platform. However, different code formats, styles and languages of software codes and other means of configuring code to perform the tasks in accordance with the invention will not depart from the spirit and scope of the invention.
The invention may be embodied in other specific forms without departing from its spirit or essential characteristics. The described examples are to be considered in all respects only as illustrative and not restrictive. To the contrary, it is intended to cover various modifications and similar arrangements (as would be apparent to those skilled in the art) . Therefore, the scope of the appended claims should be accorded the broadest interpretation so as to encompass all such modifications and similar arrangements.

Claims (7)

  1. Method of grouping bypass bins and improved sign data hiding, containing:
    coding of syntax elements coeff_sign_flag and coeff_abs_level_remaining are in a separate (2nd) CG scan pass; and
    the size of CG in the separate (2nd) CG scan pass can be different from that in the (1st) CG scan pass coding syntax elements significant_coeff_flag, coeff_abs_level_greater1_flag and coeff_abs_level_greater2_flag.
  2. The method as claimed in claim 1, 3 coefficient scan passes are performed within each CG to code the syntax elements significant_coeff_flag, coeff_abs_level_greater1_flag, and coeff_abs_level_greater2_flag in the first pass of CG scan, 2 coefficient scan passes are performed within each CG to code the syntax coeff_sign_flag and coeff_abs_level_remaining elements in the second pass of CG scan.
  3. The method as claimed in claim 2, the CG size in the second pass can be different from the CG size in the first pass, the CG in the first pass corresponds to a 4x4 block size, but the CG in the second pass corresponds to a 4x2 or 2x4 block size.
  4. The method as claimed in claim 2, the CG in the first pass corresponds to a 4x4, 4x2 or 2x4 block size depending on TU size, but the CG in the second pass corresponds to a fixed block size, 4x4 for example.
  5. The method as claimed in claim 2, the CG in the second pass corresponds to N consecutive coefficients in a predefined scan order (the scan order used in the first pass) , the number N can be 4, 6, 8, 10, 12, 16, 24, 32, 64.
  6. The method as claimed in claim 2, the criterion for sign date hiding depends on the CG size in the second pass, if the CG size in the second pass is 24, then the criterion is: when distance between the first and last non-zero coefficients in a CG is larger than 6 or 8.
  7. The method as claimed in claim 1, the CG sizes in the two passes are explicitly signaled independently.
PCT/CN2015/082833 2015-06-23 2015-06-30 Grouping bypass bins and improved sign data hiding for residual coding Ceased WO2017000222A1 (en)

Priority Applications (9)

Application Number Priority Date Filing Date Title
PCT/CN2015/082833 WO2017000222A1 (en) 2015-06-30 2015-06-30 Grouping bypass bins and improved sign data hiding for residual coding
CA2988451A CA2988451C (en) 2015-06-23 2016-06-23 Method and apparatus for transform coefficient coding of non-square blocks
EP16813706.5A EP3292690B1 (en) 2015-06-23 2016-06-23 Method and apparatus for transform coefficient coding of non-square blocks
CN201680036906.6A CN107710759B (en) 2015-06-23 2016-06-23 Method and device for encoding and decoding transform coefficients
US15/737,406 US10382768B2 (en) 2015-06-23 2016-06-23 Method and apparatus for transform coefficient coding of non-square blocks
CN202011088607.1A CN112272298B (en) 2015-06-23 2016-06-23 Method and device for coding and decoding conversion coefficient
EP18215487.2A EP3484149B1 (en) 2015-06-23 2016-06-23 Method and apparatus for transform coefficient coding of non-square blocks
PCT/CN2016/086808 WO2016206590A1 (en) 2015-06-23 2016-06-23 Method and apparatus for transform coefficient coding of non-square blocks
US16/171,475 US10582203B2 (en) 2015-06-23 2018-10-26 Method and apparatus for transform coefficient coding of non-square blocks

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2015/082833 WO2017000222A1 (en) 2015-06-30 2015-06-30 Grouping bypass bins and improved sign data hiding for residual coding

Publications (1)

Publication Number Publication Date
WO2017000222A1 true WO2017000222A1 (en) 2017-01-05

Family

ID=57607487

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2015/082833 Ceased WO2017000222A1 (en) 2015-06-23 2015-06-30 Grouping bypass bins and improved sign data hiding for residual coding

Country Status (1)

Country Link
WO (1) WO2017000222A1 (en)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130272424A1 (en) * 2012-04-16 2013-10-17 Qualcomm Incorporated Sign hiding techniques for quantized transform coefficients in video coding
US20140307800A1 (en) * 2013-04-12 2014-10-16 Qualcomm Incorporated Rice parameter update for coefficient level coding in video coding process
CN104221288A (en) * 2012-04-13 2014-12-17 佳能株式会社 Method, apparatus and system for encoding and decoding a subset of transform units of encoded video data

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104221288A (en) * 2012-04-13 2014-12-17 佳能株式会社 Method, apparatus and system for encoding and decoding a subset of transform units of encoded video data
US20130272424A1 (en) * 2012-04-16 2013-10-17 Qualcomm Incorporated Sign hiding techniques for quantized transform coefficients in video coding
US20140307800A1 (en) * 2013-04-12 2014-10-16 Qualcomm Incorporated Rice parameter update for coefficient level coding in video coding process

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
JOEL SOLE ET AL.: "Transform Coefficient Coding in HEVC", IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, vol. 22, no. 12, 31 December 2012 (2012-12-31), pages 1767, 1772, XP011487805 *
VIVIENNE SZE ET AL.: "Parallel Context Processing of Coefficient Level", JOINT COLLABORATIVE TEAM ON VIDEO CODING (JCT-VC) OF ITU-T SG 16 WP3 AND ISO/IEC JTC1 SC29/WG11 6TH MEETING, 22 July 2011 (2011-07-22), Torino, XP030009153 *

Similar Documents

Publication Publication Date Title
WO2017041271A1 (en) Efficient context modeling for coding a block of data
US8068043B2 (en) Method and apparatus for video processing in context-adaptive binary arithmetic coding
CN107302363B (en) Apparatus for decoding multiple transform coefficients having transform coefficient levels from a data stream
CN110691244B (en) Method and apparatus for binarization of syntax and context adaptive coding in video coding
JP5944510B2 (en) Context-Adaptive Binary Arithmetic Coding Method and Apparatus for Syntax Element Context-Adaptive Binary Arithmetic Coding
KR20170135940A (en) Method for palette-mode context coding and binarization in video coding
AU2016200045B2 (en) Method for coding video quantization parameter and method for decoding video quantization parameter
US10085025B2 (en) Image quantization parameter encoding method and image quantization parameter decoding method
WO2016205999A1 (en) Adaptive coding group for image/video coding
WO2017000222A1 (en) Grouping bypass bins and improved sign data hiding for residual coding
AU2015252148B2 (en) Image quantization parameter encoding method and image quantization parameter decoding method
WO2013155663A1 (en) Methods and apparatuses of context reduction for significance flag coding
HK1194886A (en) Method for coding video quantization parameter and method for decoding video quantization parameter

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 15896753

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 15896753

Country of ref document: EP

Kind code of ref document: A1