[go: up one dir, main page]

WO2014048378A1 - Method and device for image processing, coder and decoder - Google Patents

Method and device for image processing, coder and decoder Download PDF

Info

Publication number
WO2014048378A1
WO2014048378A1 PCT/CN2013/084538 CN2013084538W WO2014048378A1 WO 2014048378 A1 WO2014048378 A1 WO 2014048378A1 CN 2013084538 W CN2013084538 W CN 2013084538W WO 2014048378 A1 WO2014048378 A1 WO 2014048378A1
Authority
WO
WIPO (PCT)
Prior art keywords
motion information
block
target image
sub
image sub
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2013/084538
Other languages
French (fr)
Chinese (zh)
Inventor
杨海涛
李礼
李斌
李厚强
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huawei Technologies Co Ltd
University of Science and Technology of China USTC
Original Assignee
Huawei Technologies Co Ltd
University of Science and Technology of China USTC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Technologies Co Ltd, University of Science and Technology of China USTC filed Critical Huawei Technologies Co Ltd
Publication of WO2014048378A1 publication Critical patent/WO2014048378A1/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/30Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51Motion estimation or motion compensation
    • H04N19/513Processing of motion vectors
    • H04N19/517Processing of motion vectors by encoding
    • H04N19/52Processing of motion vectors by encoding by predictive encoding

Definitions

  • the present invention relates to the field of video processing and, more particularly, to a method, apparatus, encoder and decoder for image processing. Background technique
  • MERGE fusion
  • AMVP advanced motion vector prediction
  • the spatially adjacent image block is an image block that is within the same image as the currently processed image block; the temporal image block is an adjacent image block within the time domain reference image of the currently processed image block.
  • SVC scalable video coding
  • Embodiments of the present invention provide a method, an apparatus, an encoder, and a decoder for image processing, which are capable of determining motion information of a currently processed image block while using motion information of a neighboring image block, thereby making use of a base layer image.
  • the motion information makes it possible to determine the motion information of the currently processed image block, improving the processing efficiency.
  • a method for image processing comprising: determining first motion information of a target image block according to motion information of a base layer image block, wherein the base layer image block is located in a base layer image And the target image block is located in the enhancement layer image, the base layer image corresponding to the enhancement layer image, and the spatial position of the basic image block in the base layer image and the target image block in the enhancement layer image Corresponding to the spatial position; determining second motion information of the target image block according to motion information of the adjacent image block adjacent to the target image block in the enhancement layer image; generating according to the first motion information and the second motion information a motion information list; determining, according to a predetermined rule, optimal motion information of the target image block from the motion information list; encoding, according to the optimal motion information, the target image block to generate a target code stream, where the target code stream includes First index information indicating a location of the optimal motion information in the motion information list.
  • the determining, according to the motion information of the base layer image block, the first motion information of the target image block comprises: corresponding to the target image sub-block included in the target image block according to the base layer image block
  • the motion information of the base layer image sub-block determines the motion information of the target image sub-block, wherein the target image block sub-block has a preset size; determining the first motion according to the motion information of the target image sub-block information.
  • the target image block includes at least two target image sub-blocks, and the target image included according to the base layer image block Determining motion information of the base layer image sub-block corresponding to the target image sub-block included in the block, determining motion information of the target image sub-block, comprising: when compared with the first target image sub-block in the at least two target image sub-blocks Corresponding first base When the motion information of the image sub-block of the layer is empty, according to the size of the target image block, the size of the target image sub-block, and a second index indicating the position of the first target image sub-block in the target image block.
  • determining a second target image sub-block in the at least two target image sub-blocks determining motion information of the first target image sub-block according to motion information of the second target image sub-block; corresponding, according to the target Determining the motion information of the image sub-block, determining the first motion information, including: determining, according to the motion information of the first target image sub-block, the first motion information; or determining, according to the motion information of the second target image sub-block First motion information; or determining the first motion information according to the motion information of the first target image sub-block and the motion information of the second target image sub-block.
  • the size of the target image block, the size of the target image sub-block, and the Determining the second index information of the position of the first target image sub-block in the target image block, determining the second target image sub-block in the at least two target image sub-blocks comprising: determining the method according to any one of the following formulas Second target image sub-block,
  • Idx 2 ((l - ldx x %N/(N/2))x2 + (l- ldx x %N / (N / 4) %2)) xN/4; where, the representation is used to indicate the second target image sub
  • the third index information of the position of the block in the target image block, / represents the second index information, and N is determined according to the size of the target image block and the size of the target image sub-block.
  • the motion information of the target image sub-block includes: determining the first motion information according to the motion information of the third target image sub-block, where the third target image sub-block is in the target image block The target image sub-block located at the preset position, or the motion information of the third target image sub-block has the highest frequency of occurrence in the motion information of the target image sub-block.
  • determining the first motion information according to the motion information of the target image sub-block includes: a reference image according to motion information of the third target image sub-block, the target image, and a reference of the target image block The time domain distance relationship of the image is subjected to a scaling process on the motion information of the third target image sub-block; and the first motion information is determined according to the motion information of the third target image sub-block after the scaling process.
  • the target image block includes at least two target image sub-blocks, and when the optimal information is the first motion information, according to the optimal motion information,
  • the encoding of the target image block includes: performing deblocking filtering processing on pixels located near a boundary between the target image sub-blocks.
  • the second motion information includes time motion information and spatial motion information, and the first motion information and the second motion information, Determining the motion information list, including: determining, according to the first motion information and the second motion information, the motion information list, so that the first motion information is located in a first position of the motion information list; or according to the first motion information and the second a motion information, determining a motion information list such that the first motion information is located at a last position of the motion information list; or determining a motion information list according to the first motion information and the second motion information, so that the first motion information is located
  • the spatial motion information in the motion information list is between the time motion information.
  • the first index information includes: used to indicate whether the optimal motion information is the first motion information a first symbol and a second symbol indicating a position of the optimal motion information in the motion list, and the encoding the target image block according to the optimal motion information, comprising: according to the first context model, Performing an arithmetic coding process on the first symbol; performing an arithmetic coding process on the second symbol according to the second context model, wherein the first context model and the The second context model is different.
  • a method for image processing comprising: determining first motion information of a target image block according to motion information of a base layer image block, wherein the base layer image block is located in a base layer image And the target image block is located in the enhancement layer image, the base layer image corresponding to the enhancement layer image, and the spatial position of the basic image block in the base layer image and the target image block in the enhancement layer image Corresponding to the spatial position; determining second motion information of the target image block according to motion information of the adjacent image block adjacent to the target image block in the enhancement layer image; generating, according to the first motion information and the second motion information a motion information list; acquiring, according to the target code stream, first index information indicating a location of the optimal motion information in the motion information list; determining, according to the first index information, optimal motion information from the motion information list And decoding the target code stream according to the optimal motion information to obtain the target image block.
  • the determining, according to the motion information of the base layer image block, the first motion information of the target image block comprises: corresponding to the target image sub-block included in the target image block according to the base layer image block
  • the motion information of the base layer image sub-block determines the motion information of the target image sub-block, wherein the target image block sub-block has a preset size; determining the first motion according to the motion information of the target image sub-block information.
  • the target image block includes at least two target image sub-blocks, and the target image included according to the base layer image block Determining motion information of the base layer image sub-block corresponding to the target image sub-block included in the block, determining motion information of the target image sub-block, comprising: when compared with the first target image sub-block in the at least two target image sub-blocks When the motion information of the corresponding first base layer image sub-block is empty, according to the size of the target image block, the size of the target image sub-block, and the position indicating the first target image sub-block in the target image block.
  • the target image sub-block is large Determining, according to the second index information indicating the position of the first target image sub-block in the target image block, determining the second target image sub-block in the at least two target image sub-blocks, including: a formula that determines the second target image sub-block,
  • Idx 2 / 2) ⁇ 2 + (1 - Idx l %N /(N/4) %2)) xN/4; Idx 2 (N/2))x2 + (ldx x %N / (N / 4) %2)) xN/4;
  • W3 ⁇ 4 / ⁇ /NxN + ((l-/ x 1 N/(N/2))x2 + (l-/ ⁇ N/(N/4) 2))xN/4; where The third index information of the position of the second target image sub-block in the target image block, / represents the second index information, and N is determined according to the size of the target image block and the size of the target image sub-block.
  • Determining the first motion information, the motion information of the sub-block includes: determining, according to motion information of the third target image sub-block, the first motion information sub-block is located in the target image block The positional sub-block, or the motion information of the third target image sub-block, has the highest frequency of occurrence in the motion information of the sub-block.
  • determining the first motion information according to the motion information of the third target image sub-block includes: a reference image according to motion information of the third target image sub-block, the target image, and the target image block And scaling the motion information of the third target image sub-block according to the time domain distance relationship of the reference image; determining the first motion information according to the motion information of the third target image sub-block after the scaling processing
  • the target image block includes at least two Target image sub-blocks, and when the optimal information is the first motion information, decoding the target code stream according to the optimal motion information, including: being located near a boundary between the target image sub-blocks The pixels are subjected to deblocking filtering processing.
  • the second motion information includes time motion information and spatial motion information, and the first motion information and the second motion information, Determining the motion information list, including: determining, according to the first motion information and the second motion information, the motion information list, so that the first motion information is located in a first position of the motion information list; or according to the first motion information and the second a motion information, determining a motion information list such that the first motion information is located at a last position of the motion information list; or determining a motion information list according to the first motion information and the second motion information, so that the first motion information is located
  • the spatial motion information in the motion information list is between the time motion information.
  • the first index information includes: used to indicate whether the optimal motion information is the first motion information a first symbol and a second symbol indicating a position of the optimal motion information in the motion list, and determining the optimal motion information from the motion information list according to the first index information, including: a context model, performing arithmetic decoding processing on the first symbol, and performing arithmetic decoding processing on the second symbol according to the second context model, according to the first index information after the arithmetic decoding processing, from the motion information list Determining optimal motion information, wherein the first context model is different from the second context model.
  • an apparatus for image processing comprising: an acquiring unit, configured to determine first motion information of a target image block according to motion information of a base layer image block, where the base layer image block Located in the base layer image, the target image block is located in the enhancement layer image, the base layer image corresponding to the enhancement layer image, and the spatial position of the basic image block in the base layer image and the target image block are in the Corresponding to a spatial position in the enhancement layer image; configured to determine second motion information of the target image block according to motion information of the adjacent image block adjacent to the target image block in the enhancement layer image, and transmit the second motion information to the generating unit a motion information and the second motion information; a generating unit, configured to acquire the first motion information and the second motion information from the acquiring unit, And generating, according to the first motion information and the second motion information, a motion information list, and transmitting the motion information list to the selecting unit; the selecting unit, configured to acquire the motion information list from the generating unit, and according to a
  • the acquiring unit is specifically configured to determine the target image according to motion information of a base layer image sub-block corresponding to the target image sub-block included in the target image block included in the base layer image block.
  • the target image block includes at least two target image sub-blocks
  • the acquiring unit is specifically configured to be used with the at least two targets
  • the motion information of the first base layer image sub-block corresponding to the first target image sub-block in the image sub-block is empty, according to the size of the target image block, the size of the target image sub-block, and the first Determining, by the second index information of the position of the target image sub-block in the target image block, a second target image sub-block of the at least two target image sub-blocks; for using motion information of the second target image sub-block, Determining the motion information of the first target image sub-block; determining the first motion information according to the motion information of the first target image sub-block; or determining, according to the motion information of the second target image sub-block, determining the The first motion information is used to determine the first motion information according to the motion information of the first target image sub-block and the motion information of the second
  • the acquiring unit is specifically configured to determine the second target image according to any one of the following formulas. Piece,
  • W3 ⁇ 4 / ⁇ /NxN + ((l-/ x 1 N/(N/2))x2 + (l-/ ⁇ N/(N/4) 2))xN/4; where The third index information of the position of the second target image sub-block in the target image block, / represents the second index information, and N is determined according to the size of the target image block and the size of the target image sub-block.
  • the acquiring unit is specifically configured to determine that the motion information of the sub-block is zero motion information if the motion information of the second target image sub-block is empty.
  • the obtaining unit Specifically, the first motion information is determined according to the motion information of the third target image sub-block, where the third target image sub-block is a sub-block located at a preset position in the target image block, or the third target image.
  • the motion information of the sub-block has the highest frequency of occurrence in the motion information of the sub-block.
  • the acquiring unit is specifically configured to: according to a reference image of motion information of the third target image sub-block, a time domain distance relationship between the target image and a reference image of the target image block, to the third target image
  • the motion information of the block is subjected to a scaling process; and is configured to determine the first motion information according to the motion information of the third target image sub-block after the scaling process.
  • the target image block includes at least two target image sub-blocks, and when the optimal information is the first motion information, the coding unit is further configured to be located at the target The pixels near the boundary between the image sub-blocks perform deblocking filtering processing.
  • the second motion information includes time motion information and spatial motion information
  • the generating unit is specifically configured to use the first motion information and the a second motion information, determining a motion information list such that the first motion information is located at a first position of the motion information list; or for determining a motion information list according to the first motion information and the second motion information, so that the first The motion information is located at the last position of the motion information list; or for determining the motion information list according to the first motion information and the second motion information, so that the first motion information is located in the motion information list and the motion information is Time between motion information.
  • the first index information includes, to indicate whether the optimal motion information is the first a first symbol of motion information and a second symbol indicating a position of the optimal motion information in the motion list, and the encoding unit is specifically configured to perform arithmetic coding processing on the first symbol according to the first context model And performing arithmetic coding processing on the second symbol according to the second context model, where the first context model is different from the second context model.
  • an apparatus for image processing comprising: an acquiring unit, configured to determine first motion information of a target image block according to motion information of a base layer image block, where the base layer image block Located in the base layer image, the target image block is located in the enhancement layer image, the base layer image corresponding to the enhancement layer image, and the spatial position of the basic image block in the base layer image and the target image block are in the Corresponding to a spatial position in the enhancement layer image; configured to determine second motion information of the target image block according to motion information of the adjacent image block adjacent to the target image block in the enhancement layer image, and transmit the second motion information to the generating unit a motion information and the second motion information; a generating unit, configured to acquire the first motion information and the second motion information from the acquiring unit, and generate a motion information list according to the first motion information and the second motion information And transmitting the motion information list to the selection unit; determining a unit, configured to determine, according to the target code stream, a first index information indicating
  • the acquiring unit is specifically configured to determine the target image according to motion information of a base layer image sub-block corresponding to the target image sub-block included in the target image block included in the base layer image block.
  • the target image block includes at least two target image sub-blocks
  • the acquiring unit is specifically configured to be used with the at least two targets
  • the motion information of the first base layer image sub-block corresponding to the first target image sub-block in the image sub-block is empty, according to the size of the target image block, the size of the target image sub-block, and the first Determining, by the second index information of the position of the target image sub-block in the target image block, a second target image sub-block of the at least two target image sub-blocks; for using motion information of the second target image sub-block, Determining motion information of the first target image sub-block; for using the first
  • the motion information of the target image sub-block determines the first motion information; or is used to determine the first motion information according to the motion information of the second target image sub-block; or for the motion according to the first target image sub-block
  • the information and the motion information of the second target image sub-block determine the first
  • the acquiring unit is specifically configured to determine the second target image according to any one of the following formulas Piece,
  • Idx 2 %N / (N / 2)) ⁇ 2 + (1 - Idx, %N /(N/4) ⁇ 3 ⁇ 42)) xN/4; Idx 2 Dx x %N/(N/2))x2 + (ldx x %N / (N / 4) %2)) xN/4; W3 ⁇ 4 / ⁇ /NxN + ((l-/ x 1 N/(N /2))x2 + (l-/ ⁇ N/(N/4) 2))xN/4; where represents a third index indicating the position of the second target image sub-block in the target image block Information, / represents the second index information, N is determined according to the size of the target image block and the size of the target image sub-block.
  • the acquiring unit is specifically used if the second target If the motion information of the image sub-block is empty, it is determined that the motion information of the sub-block is zero motion information.
  • the obtaining unit Specifically, the first motion information is determined according to the motion information of the third target image sub-block, where the third target image sub-block is a sub-block located at a preset position in the target image block, or the third target image.
  • the motion information of the sub-block has the highest frequency of occurrence in the motion information of the sub-block.
  • the acquiring unit is specifically configured to: according to a reference image of motion information of the third target image sub-block, a time domain distance relationship between the target image and a reference image of the target image block, to the third target image
  • the motion information of the block is subjected to a scaling process; and is configured to determine the first motion information according to the motion information of the third target image sub-block after the scaling process.
  • the target image block includes at least two target image sub-blocks
  • the decoding code unit further A deblocking filtering process is performed on pixels located near a boundary between the target image sub-blocks.
  • the second motion information includes time motion information and spatial motion information
  • the generating unit is specifically configured to use the first motion information and the a second motion information, determining a motion information list such that the first motion information is located at a first position of the motion information list; or for determining a motion information list according to the first motion information and the second motion information, so that the first The motion information is located at the last position of the motion information list; or for determining the motion information list according to the first motion information and the second motion information, so that the first motion information is located in the motion information list and the motion information is Time between motion information.
  • the first index information includes: used to indicate whether the optimal motion information is the first motion information a first symbol and a second symbol indicating a position of the optimal motion information in the motion list, and the decoding unit is specifically configured to perform an arithmetic decoding process on the first symbol according to the first context model, and according to a second context model, performing an arithmetic decoding process on the second symbol to determine optimal motion information from the motion information list according to the first index information after the arithmetic decoding process, where the first context model and the first context model The two context models are different.
  • an encoder for image processing comprising: a bus; a processor connected to the bus; a memory connected to the bus; wherein the processor passes the bus Retrieving a program stored in the memory for determining first motion information of the target image block according to motion information of the base layer image block, wherein the base layer image block is located in the base layer image, and the target image block is located in the enhanced In the layer image, the base layer image corresponds to the enhancement layer image, and a spatial position of the basic image block in the base layer image corresponds to a spatial position of the target image block in the enhancement layer image; Determining, according to the motion information of the adjacent image block adjacent to the target image block in the enhancement layer image, second motion information of the target image block; and configured to generate a motion information list according to the first motion information and the second motion information And determining, according to a predetermined rule, optimal motion information of the target image block from the motion information list; Optimal motion information, encoding the target image block to generate a
  • the processor is specifically configured to determine the target image according to motion information of a base layer image sub-block corresponding to the target image sub-block included in the target image block included in the base layer image block.
  • the target image block includes at least two target image sub-blocks
  • the processor is specifically configured to be used with the at least two targets
  • the motion information of the first base layer image sub-block corresponding to the first target image sub-block in the image sub-block is empty, according to the size of the target image block, the size of the target image sub-block, and the first Determining, by the second index information of the position of the target image sub-block in the target image block, a second target image sub-block of the at least two target image sub-blocks; for using motion information of the second target image sub-block, Determining the motion information of the first target image sub-block; determining the first motion information according to the motion information of the first target image sub-block; or determining, according to the motion information of the second target image sub-block, determining the The first motion information is used to determine the first motion information according to the motion information of the first target image sub-block and the motion information of the second target image
  • the processor is specifically configured to determine the second target image according to any one of the following formulas Piece,
  • W3 ⁇ 4 / ⁇ /NxN + ((l-/ x 1 N/(N/2))x2 + (l-/ ⁇ N/(N/4) 2))xN/4; where The third index information of the position of the second target image sub-block in the target image block, / represents the second index information, and N is determined according to the size of the target image block and the size of the target image sub-block.
  • the processor is specifically used if the second target If the motion information of the image sub-block is empty, it is determined that the motion information of the sub-block is zero motion information.
  • the processor Specifically, the first motion signal is determined according to the motion information of the third target image sub-block.
  • the third target image sub-block is a sub-block located at a preset position in the target image block, or the motion information of the third target image sub-block has the highest frequency of occurrence in the motion information of the sub-block.
  • the processor is specifically configured to: according to a reference image of motion information of the third target image sub-block, a time domain distance relationship between the target image and a reference image of the target image block, to the third target image
  • the motion information of the block is subjected to a scaling process; and is configured to determine the first motion information according to the motion information of the third target image sub-block after the scaling process.
  • the target image block includes at least two target image sub-blocks
  • the processor is further configured to be located at the target The pixels near the boundary between the image sub-blocks perform deblocking filtering processing.
  • the second motion information includes time motion information and spatial motion information
  • the processor is specifically configured to use the first motion information and the a second motion information, determining a motion information list, such that the first motion information is located at a first position of the motion information list; or for determining, according to the first motion information and the second motion information, a motion information list, so that the first The motion information is located at the last position of the motion information list; or for determining the motion information list according to the first motion information and the second motion information, so that the first motion information is located in the motion information list and the motion information is Time between motion information.
  • the first index information includes: used to indicate whether the optimal motion information is the first motion information a first symbol and a second symbol indicating a position of the optimal motion information in the motion list, and the processor is specifically configured to perform an arithmetic coding process on the first symbol according to the first context model; And performing, according to the second context model, an arithmetic coding process on the second symbol, wherein the first context model is different from the second context model.
  • a decoder for image processing comprising: a bus; a processor connected to the bus; a memory connected to the bus; wherein the processor passes the bus Retrieving a program stored in the memory for determining first motion information of the target image block according to motion information of the base layer image block, wherein the base layer image block is located in the base layer image, and the target image block is located in the enhanced In the layer image, the base layer image corresponds to the enhancement layer image, and a spatial position of the basic image block in the base layer image corresponds to a spatial position of the target image block in the enhancement layer image; Determining, according to the motion information of the adjacent image block adjacent to the target image block in the enhancement layer image, second motion information of the target image block; and configured to generate a motion information list according to the first motion information and the second motion information For obtaining a first line indicating the location of the optimal motion information in the motion information list according to the target code stream The information is used to determine the optimal motion information from the motion
  • the processor is specifically configured to determine the target image according to motion information of a base layer image sub-block corresponding to the target image sub-block included in the target image block included in the base layer image block.
  • the target image block includes at least two target image sub-blocks
  • the processor is specifically configured to be used with the at least two targets
  • the motion information of the first base layer image sub-block corresponding to the first target image sub-block in the image sub-block is empty, according to the size of the target image block, the size of the target image sub-block, and the first Determining, by the second index information of the position of the target image sub-block in the target image block, a second target image sub-block of the at least two target image sub-blocks; for using motion information of the second target image sub-block, Determining the motion information of the first target image sub-block; determining the first motion information according to the motion information of the first target image sub-block; or determining, according to the motion information of the second target image sub-block, determining the The first motion information is used to determine the first motion information according to the motion information of the first target image sub-block and the motion information of the second target image
  • the processor is specifically configured to determine the second target image according to any one of the following formulas Piece,
  • W3 ⁇ 4 / ⁇ /NxN + ((l-/ 1 %N/(N/2))x2 + (l-/ ⁇ %N/(N/4)%2))xN/4;
  • the third index information indicating the position of the second target image sub-block in the target image block, / indicates the second index information, and N is determined according to the size of the target image block and the size of the target image sub-block.
  • the processor is specifically used if the second target If the motion information of the image sub-block is empty, it is determined that the motion information of the sub-block is zero motion information.
  • the processor Specifically, the first motion information is determined according to the motion information of the third target image sub-block, where the third target image sub-block is a sub-block located at a preset position in the target image block, or the third target image.
  • the motion information of the sub-block has the highest frequency of occurrence in the motion information of the sub-block.
  • the processor is specifically configured to: according to a reference image of motion information of the third target image sub-block, a time domain distance relationship between the target image and a reference image of the target image block, to the third target image
  • the motion information of the block is subjected to a scaling process; and is configured to determine the first motion information according to the motion information of the third target image sub-block after the scaling process.
  • the target image block includes at least two target image sub-blocks
  • the processor is further configured to be located at the target The pixels near the boundary between the image sub-blocks perform deblocking filtering processing.
  • the second motion information includes time motion information and spatial motion information
  • the processor is specifically configured to use the first motion information and the a second motion information, determining a motion information list, such that the first motion information is located at a first position of the motion information list; or for determining, according to the first motion information and the second motion information, a motion information list, so that the first The motion information is located at the last position of the motion information list; Or for determining the motion information list according to the first motion information and the second motion information, so that the first motion information is located between the spatial motion information in the motion information list and the time motion information.
  • the first index information includes: used to indicate whether the optimal motion information is the first motion information a first symbol and a second symbol indicating a position of the optimal motion information in the motion list, and the processor is specifically configured to perform an arithmetic decoding process on the first symbol according to the first context model, and according to a second context model, performing an arithmetic decoding process on the second symbol to determine optimal motion information from the motion information list according to the first index information after the arithmetic decoding process, where the first context model and the first context model The two context models are different.
  • a method, an apparatus encoder, and a decoder for image processing according to an embodiment of the present invention in a technique of determining motion information of a currently processed image block using motion information of a neighboring image block, such as MERGE or AMVP, by using motion information in motion information
  • the first motion information determined according to the base layer image motion information is added to the list, and the motion information of the currently processed image block can be determined by using the motion information of the neighboring image block, and the motion information of the base layer image is used to determine the current processing.
  • the motion information of the image block improves the processing efficiency.
  • 1 is a schematic flow chart of a method for image processing according to an embodiment of the present invention.
  • 2 is a schematic diagram of a source location indicating a spatial motion signal, in accordance with an embodiment of the present invention.
  • 3 is a schematic diagram of a source location indicating a time motion signal, in accordance with an embodiment of the present invention.
  • 4 is a schematic diagram of sub-block partitioning and sub-block indexing according to an embodiment of the invention.
  • Figure 5 is another schematic flow diagram of a method for image processing in accordance with an embodiment of the present invention.
  • Figure 6 is a schematic block diagram of an apparatus for image processing in accordance with an embodiment of the present invention.
  • Figure ⁇ is a schematic block diagram of an apparatus for image processing according to another embodiment of the present invention.
  • Figure 8 is a schematic block diagram of an encoder for image processing in accordance with an embodiment of the present invention.
  • 9 is a schematic block diagram of a decoder for image processing in accordance with another embodiment of the present invention.
  • a method, apparatus, and system for image processing according to embodiments of the present invention can be adapted to include
  • a technique of determining motion information of a currently processed image block using motion information of a neighboring image block such as MERGE or AMVP.
  • Fig. 1 shows a schematic flow chart of a method 100 for image processing according to an embodiment of the present invention, which is described from the perspective of an encoding end. As shown in FIG. 1, the method 100 includes:
  • S110 Determine first motion information of the target image block according to motion information of the base layer image block, where the base layer image block is located in the base layer image, where the target image block is located in the enhancement layer image, and the base layer image is
  • the enhancement layer image corresponds to, and a spatial position of the basic image block in the base layer image corresponds to a spatial position of the target image block in the enhancement layer image;
  • S120 Determine, according to motion information of a neighboring image block adjacent to the target image block in the enhancement layer image, second motion information of the target image block.
  • S140 Determine optimal motion information of the target image block from the motion information list according to a predetermined rule.
  • the image when the image is hierarchically encoded, for example, in spatial scalable coding, the image may be subjected to resolution processing to obtain a low-resolution image, and the original image is referred to as a high-resolution image as a contrast, respectively.
  • the low resolution image and the high resolution image are encoded.
  • a high quality image to be encoded is referred to herein as an enhancement layer image
  • a corresponding low quality image to be encoded eg, the low resolution image
  • the target image is an image processed by a layered coding technique
  • the basic layer refers to a quality in layered coding (including frame rate, spatial resolution, temporal resolution, signal to noise ratio intensity or quality level).
  • the enhancement layer refers to the layer with higher quality (including frame rate, spatial resolution, temporal resolution, signal-to-noise ratio intensity or quality level) in the layered coding.
  • the corresponding base layer may be any layer lower in quality than the enhancement layer, for example, if currently There are five layers, and the coding quality is sequentially improved (that is, the first layer has the lowest quality and the fifth layer has the highest quality).
  • the enhancement layer is the fourth layer
  • the base layer may be the first layer or the second layer. It is the third layer or the fourth layer.
  • the corresponding enhancement layer can be any layer of lower quality than the base layer.
  • the enhancement layer image is the image in the currently processed enhancement layer
  • the base layer image is the image in the base layer at the same time as the enhancement layer image.
  • the quality of the base layer image is lower than the quality of the enhancement layer image.
  • the target image block is the image block being processed in the enhancement layer image.
  • the base layer image block is an image block in the base layer image that has a corresponding relationship with the target image block in spatial position.
  • the correspondence between the base layer image block and the target image block may be calculated according to the resolution proportional relationship between the base layer image and the enhancement layer image. For example, in a system including the X direction and the y direction, if the resolution of the enhancement layer image in the X direction and the y direction is twice that of the base layer image, respectively, the pixel coordinates of the upper left corner in the enhancement layer are (2x, 2y). And an image block of size (2m) X ( 2n ), the corresponding block in the base layer image may be an image block whose pixel coordinates are (X , y ) and whose size is mxn in the upper left corner.
  • a sub-block described later refers to a sub-block of the target image block (an image block in the enhancement layer), and a corresponding sub-block described later refers to a base layer image block in the base layer of the sub-block (belonging to The corresponding block above).
  • the motion information may include one or more of a prediction direction, a reference image index, or a motion vector, where the prediction direction may be divided into one-way and two-way prediction, and the one-way prediction may be further divided into forward prediction.
  • forward prediction refers to the use of a forward reference picture list, ie, a reference picture in list 0 to generate a prediction signal
  • backward prediction refers to using a backward reference picture list, ie, a reference picture in list 1 to generate a prediction.
  • bidirectional prediction means using both list 0 and list 1
  • the reference image produces a prediction signal; for unidirectional prediction, a reference image index is required to indicate the reference image selected in list 0 or list l, and for bidirectional prediction, two reference image indices are required, respectively indicated in list 0 and list 1
  • the reference image selected in each; each motion vector includes a horizontal direction component X and a vertical direction component y, which can be recorded as (X, y).
  • a motion vector is required to indicate the prediction signal in the selected list 0.
  • the displacement in the list 1 reference image for bidirectional prediction, two motion vectors are needed to indicate the displacement of the forward prediction signal and the backward prediction signal in the selected list O reference image and the list 1 reference image, respectively.
  • the second motion information refers to motion information acquired from a neighboring image block (an image block of the enhancement layer image) of the target image block.
  • the second motion information may include spatial motion information, which is motion information acquired from spatial neighboring blocks in the enhancement layer image, and time motion information refers to images from the enhancement layer.
  • the method for obtaining the second motion information in S120 may be enumerated by the following method, that is,
  • the encoding end and the decoding end can set a preset value (for example, 2) indicating the number of second motion information (for example, two).
  • Fig. 2 shows the source position (acquisition position) of the spatial motion information
  • Fig. 3 shows the source position (acquisition position) of the temporal motion information.
  • the second motion information when determining the second motion information, first, one motion information is respectively obtained from the three types of positions A, B, and C, wherein the class A position includes two positions of AO and A1, and the class B position includes B0. , Bl, B2 three positions, C class position includes RB (bottom right) and Cer (center) two positions. Obtaining motion information from the class C position in Fig.
  • the repeated motion information is removed from the acquired motion information. If there are still three motion information after removing the repeated candidate motion information, the first two motion information is selected as the candidate motion information; if the number of motion information after the repeated candidate motion information is removed is less than two, the zero motion information is added, for example, In the predictive coded picture frame (P frame), the prediction direction of the zero motion information is unidirectional prediction, and the reference picture index is 0, the motion vector (0, 0). In the bidirectionally predictive coded image frame (B frame), the prediction direction of the zero motion information is bidirectional prediction, both reference image indexes are 0, and both motion vectors are (0, 0) to ensure the final candidate motion information. The number is two.
  • the encoding end and the decoding end can set a preset value (for example, 5), and the preset value indicates the second transport
  • the amount of information for example, five
  • Fig. 2 shows the source position (acquisition position) of the spatial motion information
  • Fig. 3 shows the source position (acquisition position) of the time motion information.
  • Acquiring motion information from the class C position in FIG. 3 means acquiring motion information from a position corresponding to the class C position in the reference image of the target image block. As shown in FIG. 2 or FIG. 3, among the five pieces of motion information, up to four pieces of spatial motion information and one time motion information are included.
  • the bidirectional prediction motion information or zero motion information is constructed according to a certain method to ensure the number of candidate motion information. For five. Descriptions of the same or similar cases are omitted below.
  • the first motion information of the target image block obtained by the encoding end device in S110 is mainly described.
  • the encoding end device may acquire motion information included in the base layer image block of the target image block, and determine the first motion information according to the motion information included in the base layer image block.
  • determining the first motion information of the target image block according to the motion information of the base layer image block includes:
  • the first motion information is determined according to motion information of the target image sub-block.
  • the target image block may be configured by at least two sub-blocks (ie, target image sub-blocks), wherein the size of the sub-block may be determined according to a preset value, for convenience of description.
  • the sub-block size is 4 x 4 as an example.
  • the target image block includes 16 sub-blocks (size 4 x 4). Therefore, in the embodiment of the present invention, a corresponding sub-block in the basic layer (belonging to the base layer image block) of each sub-block in the target image block may be determined, and motion information of the corresponding sub-block is determined.
  • determining the motion information of the target image sub-block according to the motion information of the base layer image sub-block corresponding to the target image sub-block included in the target image block that is included in the base layer image block including:
  • the motion information of the first base layer image sub-block corresponding to the first target image sub-block is used as the motion information of the first target image sub-block .
  • the pixel may be determined in the base layer image according to the coordinates of a certain pixel point in the selected sub-block (the first target image sub-block) (referred to as: "(E x , E y )")
  • the coordinates of the corresponding position (denoted as "() and the base layer image block containing the corresponding position coordinates is taken as the corresponding sub-block (the first base layer image sub-block).
  • the following formula 1 can be used.
  • formula 2 can be used.
  • R x can be calculated according to the following formula 3
  • R y is calculated according to the following formula 4
  • S is an accuracy control factor (for example, in the embodiment of the present invention, it can be set to 16), and D r can be calculated according to the following formula 5, and D y is calculated according to the following formula 6
  • ScaledBaseHeight where ⁇ represents the width of the base layer image, BiweH gfe represents the height of the base layer image, ScaledBaseWidth represents the width of the enhancement layer image, and ScaledBaseHeight represents the height of the enhancement layer image.
  • the corresponding sub-block can be determined, and in the case where the corresponding sub-block includes motion information, the prediction direction and the reference image index in the motion information can be directly used as the sub-block (first target image sub-block) Prediction direction and reference image index.
  • the motion vector ( ⁇ ⁇ , ⁇ of the corresponding sub-block may be scaled according to the following Equations 7 to 10, and the scaled motion vector is used as the motion vector (EMV) of the sub-block (the first target image sub-block). x , EMV ⁇ .
  • EMV x (BMV x x ScaledBaseWidth + R BW ) / BaseWidth ( 7 )
  • EMV y (BMV y x ScaledBaseHeight + R BH ) I BaseHeight ( 8 )
  • R BH sgn(BMV y ) * BaseHeight 12 ( 10) Where sgn(x) is a symbolic function and the sign of x can be obtained.
  • the motion information of the corresponding sub-block can be directly used as the motion information of the sub-block.
  • the sub-block may also be indeterminate, and the motion information of the target image block is directly obtained by using the above method. That is, it can be considered that the target image block includes only one sub-block (the sub-block size is the same as the target image block). At this time, the motion information of the target image block can be acquired in the same manner as described above. And, if the target image block (or the only sub-block included in the target image block) does not have motion information, zero motion information is used as the motion information of the sub-block. In the embodiment of the present invention, zero motion information can be constructed in the following manner.
  • the prediction direction of the zero motion information is unidirectional prediction, and the reference picture index is 0, motion vector (0, 0).
  • the prediction direction of the zero motion information is bidirectional prediction, both reference picture indices are 0, and both motion vectors are (0, 0).
  • the method further includes:
  • the first base layer image sub-block corresponding to the first target image sub-block includes motion information.
  • whether the corresponding sub-block contains motion information may be determined according to an encoding mode of the base layer image (or the basic layer image block). For example, if the base layer image uses the intra prediction coding mode, it may be determined that the corresponding sub-block does not contain motion information (i.e., the motion information of the first base layer image sub-block is empty).
  • the corresponding sub-block when the corresponding sub-block includes motion information, the corresponding sub-block may be determined according to the process as described above and its motion information may be acquired. When the corresponding sub-block does not include motion information, the above process may be skipped.
  • the corresponding sub-block does not include motion information.
  • the motion information of the sub-block may be determined based on motion information of neighboring blocks of the corresponding sub-block. That is, optionally, the target image block includes at least two target image sub-blocks, and
  • Determining motion information of the target image sub-block according to the motion information of the base layer image sub-block corresponding to the target image sub-block included in the target image block including: at least two And when the motion information of the first base layer image sub-block corresponding to the first target image sub-block in the target image sub-block is empty, according to the size of the target image block, the size of the target image sub-block, and the indication a second position of a target image sub-block in the target image block Index information, determining a second target image sub-block in the at least two target image sub-blocks;
  • determining the first motion information according to the motion information of the target image sub-block comprising: determining the first motion information according to the motion information of the first target image sub-block; or according to the second target image sub-block The motion information determines the first motion information; or determines the first motion information according to the motion information of the first target image sub-block and the motion information of the second target image sub-block.
  • the index allocation method of the sub-block may be the same as the prior art.
  • the description thereof is omitted, and the division and indexing of the sub-blocks are shown in FIG.
  • the processing level may be determined according to the size of the target image block and the size of the sub-block, and the processing layer is recursively layer by layer according to the processing level.
  • each processing unit (referred to as the first processing unit) in the lowest level hierarchy (referred to as the first layer) may be defined to include four sub-blocks, the previous layer of the first layer.
  • Each processing unit (referred to as the second layer) (denoted as the second layer) includes four first processing units, and so on, in order to avoid redundancy, the recursive description is omitted.
  • two levels may be included.
  • sub-block 0 ⁇ sub-block 3 constitute the first processing unit 0
  • the block 7 constitutes the first processing unit 1
  • the sub-block 8 ⁇ sub-block 11 constitutes the first processing unit 2
  • the sub-block 12 ⁇ sub-block 15 constitutes the first processing unit 3.
  • the first processing unit 0 to the first processing unit 3 constitute the second processing unit 0. It should be understood that the above-described hierarchical division method is merely illustrative, and the present invention is not limited thereto.
  • the motion information of each sub-block is empty according to the index number of the sub-block (for example, from small to large) may be determined, if the motion information of the sub-block is empty. Then, motion information of the sub-block (an example of the second target image sub-block) adjacent to the first processing unit may be determined based on the motion information. For example, if the motion information of the sub-block with index 0 (ie, sub-block 0, belonging to the first processing unit 0) is empty, motion information of other sub-blocks belonging to the same processing unit (first processing unit 0) may be acquired. And use the motion information as the motion information of the sub-block 0.
  • the obtaining order may be, for example, first obtaining motion information of a sub-block with an index of 1 (sub-block 1, that is, an example of a second target image sub-block, adjacent to sub-block 0 in the horizontal direction), if sub-block 1 If the motion information is empty, then the index can be obtained again as 2 (subblock 2, ie, For another example of the second target image sub-block, the motion information of the sub-block adjacent to the sub-block 0 in the vertical direction, if the motion information of the sub-block 2 is empty, the index may be further obtained as 3 (sub-block 3, That is, the motion information of the sub-block of the second target image sub-block, which is adjacent to the sub-block 0 in the diagonal direction.
  • sub-block 3 That is, the motion information of the sub-block of the second target image sub-block, which is adjacent to the sub-block 0 in the diagonal direction.
  • the motion information can be filled by the above method.
  • the method for filling the motion information of the sub-blocks whose motion information is empty is only an exemplary description, and the present invention is not limited thereto.
  • the vertical direction may also be obtained first.
  • the motion information of the sub-block (here, the adjacent sub-block), and the motion information of the specified sub-block (here, the adjacent sub-block) in the horizontal direction is acquired, and the specified sub-block in the diagonal direction is acquired (here , for adjacent sub-blocks) motion information. That is, the order of acquisition can be arbitrarily changed.
  • determining the first motion information according to the motion information of the target image sub-block includes:
  • Determining the first motion information according to the motion information of the first target image sub-block; or determining the first motion information according to the motion information of the second target image sub-block; or according to the motion of the first target image sub-block Determining the first motion information according to the motion information of the first target image sub-block; or determining the first motion information according to the motion information of the second target image sub-block; or according to the motion of the first target image sub-block.
  • the first processing unit may be in the same processing unit as the sub-block 0 from the first layer (for example, the first processing unit 0)
  • Other sub-blocks eg, sub-block 1 - sub-block 3 acquire motion information.
  • the sub-block for example, sub-block 0
  • the specified sub-block in the first layer for example, sub-block 1 ⁇ sub-block 3
  • the predetermined sub-block in the predetermined first processing unit for example, the first processing unit 1 to the first processing unit 3 in the second processing unit may be acquired (another example of the second target image sub-block)
  • the motion information is used as the motion information of the sub-block (for example, sub-block 0).
  • first processing unit 0 if the corresponding sub-blocks of all the sub-blocks in one first processing unit (for example, the first processing unit 0) are all empty, other first processing units in the second processing unit may be acquired (for example, the first processing).
  • the motion information of the predetermined sub-block in the first to third processing units 3 for convenience of explanation, the sub-block in the upper left corner of each first processing unit is described as an example, and the motion information is used as the first Motion information of each sub-block within a processing unit (first processing unit 0).
  • the order of obtaining may be, for example, first obtaining a sub-block of the upper left corner of the first processing unit (the first processing unit 1 adjacent to the first processing unit 0 in the horizontal direction) having an index of 1 (sub-block 4, ie
  • the motion information of the second target image sub-block is empty. If the motion information of the sub-block 4 is empty, the motion information of the other sub-blocks in the first processing unit 1 is also considered to be empty, so that the index can be re-acquired.
  • a sub-block of the upper left corner of the first processing unit (first processing unit 2 adjacent to the first processing unit 0 in the vertical direction) of 2 (subblock 8, that is, another example of the second target image sub-block)
  • the motion information of the sub-block 8 is considered to be empty if the motion information of the sub-block 8 is empty, so that the motion information of the other sub-blocks in the first processing unit 2 is also empty, so that the first processing unit with the index of 3 can be reacquired (first The processing unit 3, which is adjacent to the first processing unit 0 in the diagonal direction, has motion information of the sub-block in the upper left corner (sub-block 12, that is, another example of the second target image sub-block).
  • the motion information can be filled by the above method.
  • the method for filling the motion information of the sub-blocks whose motion information is empty is only an exemplary description, and the present invention is not limited thereto.
  • the vertical direction may also be obtained first. Obtaining motion information of a predetermined sub-block of the first processing unit (here, adjacent to the first processing unit), and acquiring a predetermined sub-block of a predetermined first processing unit (here, an adjacent first processing unit) in the horizontal direction The motion information further acquires motion information of a prescribed sub-block of the first processing unit (here, the adjacent first processing unit) in the diagonal direction.
  • predetermined sub-block is not limited to the sub-block in the upper left corner of the first processing unit, and may be a sub-block at an arbitrary position in the same first processing unit.
  • the target image block enumerated above is 16 x 16 and the size of the sub-block is 4 x 4, the target image block includes only two layers, and the above recursion process ends.
  • the size of the target image block is larger, for example, 32 x 32, and the size of the sub-block is 4 x 4, then the target image block includes three layers, and the recursive operation can be continued in the same manner as described above. All sub-blocks of the image block acquire motion information.
  • the second target image sub-block in the target image sub-block includes:
  • Idx 2 + idx, %N/(N/2))x2 + (l- Idx l %N /(N / 4)%2)) ⁇ N /4 ; Idx 2 + ((l - ldx x %N/(N/2))x2 + (ldx x %N / (N / 4) %2)) xN/4; W3 ⁇ 4 / ⁇ /NxN + ((l-/ x 1 N/(N/2))x2 + (l-/ ⁇ N/(N/4) 2))xN/4; wherein, the representation is used to indicate that the second target image sub-block is in the target image block
  • the third index information of the location, / ⁇ indicates the second index information, % indicates a modulo operation or a remainder operation, and N indicates the number of sub-blocks included in the target image block.
  • the second target image sub-block within the currently processed hierarchy may be determined according to the index of the sub-block currently being processed, where ⁇ corresponds to the layer currently being processed, and ⁇ is according to the target
  • the size of the image block and the size of the sub-block are determined (where the size of the sub-block is determined according to a preset value), for example, if the size of the target image block is 16 ⁇ 16, and the size of the sub-block is 4 ⁇ 4,
  • the target image block includes two layers.
  • is the number of sub-blocks included in each processing unit (first processing unit) in the layer, here is 4.
  • is the number of sub-blocks included in each processing unit (second processing unit) in the layer, here 16.
  • the determining, according to the motion information of the base layer image sub-block corresponding to the target image sub-block included in the target image block, the motion information of the target image sub-block further comprising:
  • zero motion information is used as the motion information of the sub-block.
  • zero motion information can be constructed in the following manner.
  • the prediction direction of zero motion information is unidirectional prediction, and the reference picture index is 0, motion vector (0, 0).
  • the prediction direction of the zero motion information is bidirectional prediction, both reference picture indices are 0, and both motion vectors are (0, 0).
  • the above uses zero motion information.
  • the method of the motion information of the sub-block may be performed after the last layer is processed, or may be performed after processing at any other level, and the present invention is not particularly limited. It should be understood that the method for obtaining the motion information of the sub-blocks listed above is only an exemplary description of the present invention, and the present invention is not limited thereto.
  • the coding mode of the layer image determines whether the corresponding sub-block contains motion information.
  • the base layer image uses the intra prediction coding mode, it may be determined that the corresponding sub-block does not contain motion information (ie, the motion information of the first base layer image sub-block is empty). If it is determined that only one of the sub-blocks of the target image block (specifically, its corresponding sub-block) has motion information, the motion information of the sub-block may be used as motion information of the other sub-blocks.
  • the acquisition processing of the first motion information of the target image block is completed, and thus, at S130, the first motion information and the second motion information can be added to the motion information list.
  • the motion information of all the sub-blocks in the current image block is taken as a whole (that is, the motion information is unified index (the first index).
  • the information) indication is added to the motion information list, and some or all of the motion information in the motion information of each sub-block may also be added to the motion information list (ie, each motion information is indicated by a different index (first index information)).
  • the first motion information is determined according to the motion information of the sub-block, and the method includes:
  • the motion information of the third target image sub-block has the highest frequency of occurrence in the motion information of the sub-block.
  • the one or more motion information may be obtained from different locations of the base layer image blocks in the base layer.
  • the embodiment of the present invention can provide three methods for acquiring the motion information (first motion information).
  • the foregoing sub-block is divided into a first target image sub-block, a second target image sub-block, and a third target image sub-block, but the third target image sub-block is also It may be the same sub-block as the first target image sub-block or the second target image sub-block, and the present invention is not particularly limited.
  • the description of the same or similar cases will be omitted.
  • Method a selecting motion information of the sub-block in the upper left corner of the target image block (specifically, motion information of its corresponding sub-block).
  • Method b selecting motion information of the sub-block in the middle of the target image block (specifically, motion information of its corresponding sub-block).
  • the method c selects the motion information of the highest frequency of the motion information of the sub-block of the target image block (specifically, the motion information of the corresponding sub-block).
  • one or more motions may be selected from the motion information of each sub-block according to a preset value (for indicating the number of motion information included in the motion information list). information.
  • determining the first motion information according to the motion information of the sub-block includes: determining, according to motion information of the third target image sub-block, the third target image sub-block is a sub-block located in a preset position in the target image block, or
  • the motion information of the third target image sub-block has the highest frequency of occurrence in the motion information of the sub-block.
  • the one or more motion information may be obtained from different locations of the base layer image blocks in the base layer.
  • the embodiment of the present invention can acquire the motion information (first motion information) by the above three methods (method a, method b, method c).
  • determining the first motion information according to the motion information of the third target image sub-block includes:
  • the first motion information is determined based on the motion information of the third target image sub-block after the scaling process.
  • the selected motion information may be appropriately scaled according to the distance relationship between the reference image of the selected motion information, the enhancement layer image, and the reference image of the target image block in time. Processing, adding the motion information after the scaling process to the motion information list as the first motion information.
  • the second motion information includes time motion information and spatial motion information
  • Determining the motion information list according to the first motion information and the second motion information comprising: determining, according to the first motion information and the second motion information, the motion information list, so that the first motion information is located in the motion information list. First place; or Determining, according to the first motion information and the second motion information, a motion information list, so that the first motion information is located at a last position of the motion information list; or
  • the motion information list is determined such that the first motion information is located between the spatial motion information in the motion information list and the temporal motion information.
  • the first motion information may be located at the last position of the motion information list, or the first motion information may be located after all the spatial motion information in the motion information list, and before the time motion information. .
  • the optimal motion information of the target image block may be determined from the motion information list, and the pre-predetermined rule may be, for example, calculating a rate distortion cost of each motion information in the motion information list, and selecting a rate distortion cost. The smallest motion information is used as the optimal motion information.
  • the method further includes:
  • An optimal coding mode is determined to perform a motion compensation coding operation on the target image block.
  • the rate distortion cost of each mode can be calculated, and the coding mode with the lowest rate distortion selectivity can be selected as the optimal coding mode.
  • the target image block is subjected to a motion compensation coding operation using the optimal motion information.
  • the method further includes:
  • Filtering is performed on pixels located near the boundary between each sub-block.
  • the above-described optimal encoding mode is the MERGE mode
  • the first motion information is selected as the optimal motion information
  • an index (first index information) for indicating a position of the above-described optimal motion information in the motion information list is subjected to entropy encoding processing.
  • the entropy encoding process may include binarization encoding processing, context model selection processing, binary arithmetic encoding processing, and context update processing.
  • TU Truncated Unary
  • the first index information includes a first symbol for indicating whether the optimal motion information is the first motion information, and a second symbol for indicating a location of the optimal motion information in the motion list, as well as
  • the encoding according to the optimal motion information includes:
  • the first index information of the embodiment of the present invention may include two symbols, that is, a first symbol for indicating whether the optimal motion information is the first motion information, and for indicating the optimal motion information.
  • the first index information may include only one symbol bit or a plurality of symbol bits.
  • the selected optimal motion information is the first motion information
  • only one symbol bit may be included.
  • the first symbol is the same as the second symbol, and both are located. The only sign bit.
  • the first symbol may be carried by one symbol bit, for example, 0 indicates that the optimal motion information is the first motion information, and 1 indicates the optimal motion information. Not for the first motion information.
  • the second symbol can be carried with other symbol bits.
  • the binary symbol string obtained after binarizing the first index information may be used.
  • the context model used by the first symbol is as shown in Table 2 below, and may include three context models of 0, 1, and 2.
  • the selection index is 0.
  • Context model if the image block on the left and top of the target image block has a first motion information, then select the context model with index 1 and if the image block on the left and the top of the target image block uses the first motion information, then select The context of the index is 2.
  • the second context model may be an equal probability model.
  • the coding method using the equal probability model coding is also a by-pass coding mode, that is, the coding mode in which the second symbol is directly written into the code stream. If you use the by-pass encoding, no context updates are required. Table 2
  • the first symbol and the second symbol may also use the same context model, or adopt a by-pass mode (ie, The binary symbol is directly written to the code stream without using the context model.
  • the first index information is encoded.
  • the first index information can be binary arithmetically coded according to the context model selected as described above, and the used context model is updated.
  • the process may be the same as the prior art, and the description thereof is omitted here to avoid redundancy.
  • the motion compensation process may be performed on the target image block according to the selected optimal motion information, and the information of the target image block generated by the motion compensation process and the first index after the entropy coding process may be performed.
  • Information is added to the code stream (target stream).
  • the encoded target image (including the base layer image and the enhancement layer image) may be included, and the processing may be related to the prior art.
  • the description thereof is omitted.
  • the target image information may be acquired from the code stream, and the target image (specifically, the target image block) is determined, and the first motion information and the second motion information are acquired and generated using the same method as the encoding end.
  • a list of sports information may be acquired from the code stream, and the target image (specifically, the target image block) is determined, and the first motion information and the second motion information are acquired and generated using the same method as the encoding end.
  • Entropy decoding processing is performed on the acquired first index information (information after entropy encoding processing), and the processing procedure may include: context model selection processing, binary arithmetic decoding processing, binarization decoding processing, and context update processing. Or similar, the description thereof is omitted here.
  • a binary symbol string (bin string) representing the first index information can be parsed from the code stream according to the selected context model.
  • the binary arithmetic decoding process corresponds to the binary arithmetic coding process at the encoding end.
  • the first index information may be determined according to the parsed binary symbol string, wherein the correspondence between the used binary symbol string and each first index information (value) is the same as the encoding end, such as Table 1 above.
  • the optimal motion information may be selected from the motion information list as the motion information of the target image block according to the decoded first index information, to perform motion compensation processing on the target image block using the motion information.
  • the embodiment of the present invention is applied to the MERGE mode, it is necessary to perform a motion compensation operation on each sub-block of the target image block. After the prediction signal of the current block is obtained by motion compensation, the residual signal obtained by the additional decoding may also be superimposed to obtain the reconstructed signal.
  • the encoding mode is the MERGE mode
  • the optimal motion information is the first motion information
  • the pixels near the boundary between the sub-blocks of the target image block may be subjected to filtering processing.
  • the motion information of the target image block can be derived according to the optimal motion information, combined with the prediction direction, the reference image index, and the motion vector difference obtained by the additional entropy decoding.
  • the motion information is used to perform motion compensation on the current block. After acquiring the prediction signal of the current block by motion compensation, the residual signal obtained by the additional decoding may also be superimposed to obtain the reconstructed signal.
  • Method for image processing in MERGE or AMVP
  • the motion information using the adjacent image block can be utilized While determining the motion information of the currently processed image block, the motion information of the currently processed image block is determined by using the motion information of the base layer image, thereby improving the processing efficiency.
  • Fig. 5 shows a schematic flow chart of a method 200 for image processing according to an embodiment of the present invention, which is described from the perspective of a decoding end. As shown in FIG. 5, the method 200 includes:
  • S210 Determine, according to motion information of the base layer image block, the first motion information of the target image block, where the base layer image block is located in the base layer image, where the target image block is located in the enhancement layer image, and the base layer image is
  • the enhancement layer image corresponds to, and a spatial position of the basic image block in the base layer image corresponds to a spatial position of the target image block in the enhancement layer image;
  • S220 Determine, according to motion information of a neighboring image block adjacent to the target image block in the enhancement layer image, second motion information of the target image block.
  • S230 generating a motion information list according to the first motion information and the second motion information
  • S240 acquiring first index information for indicating a location of the optimal motion information in the motion information list according to the target code stream;
  • S250 Determine, according to the first index information, optimal motion information from the motion information list, and decode the target code stream according to the optimal motion information to obtain the target image block.
  • the image when the image is hierarchically encoded, for example, in spatial scalable coding, the image may be subjected to resolution processing to obtain a low-resolution image, and the original image is referred to as a high-resolution image as a contrast, respectively.
  • the low resolution image and the high resolution image are encoded.
  • a high quality image to be encoded is referred to herein as an enhancement layer image
  • a corresponding low quality image to be encoded e.g., the low resolution image
  • a base layer image a corresponding low quality image to be encoded
  • the target image is an image processed by a layered coding technique
  • the basic layer refers to a quality in layered coding (including frame rate, spatial resolution, temporal resolution, signal to noise ratio intensity or quality level).
  • the enhancement layer refers to the layer with higher quality (including frame rate, spatial resolution, temporal resolution, signal-to-noise ratio intensity or quality level) in the layered coding.
  • the corresponding base layer may be any layer lower in quality than the enhancement layer, for example, if currently There are five layers, and the coding quality is sequentially improved (that is, the first layer has the lowest quality and the fifth layer has the highest quality).
  • the enhancement layer is the fourth layer
  • the base layer may be the first layer or the second layer. It can also be the third layer or the fourth layer.
  • the corresponding enhancement layer can be any layer of lower quality than the base layer.
  • the enhancement layer image is the image in the currently processed enhancement layer
  • the base layer image is the image in the base layer at the same time as the enhancement layer image.
  • the quality of the base layer image is lower than the quality of the enhancement layer image.
  • the target image block is the image block being processed in the enhancement layer image.
  • the base layer image block is an image block in the base layer image that has a corresponding relationship with the target image block in spatial position.
  • the correspondence between the base layer image block and the target image block may be calculated according to the resolution proportional relationship between the base layer image and the enhancement layer image. For example, in a system including the X direction and the y direction, if the resolution of the enhancement layer image in the X direction and the y direction is twice that of the base layer image, respectively, the pixel coordinates of the upper left corner in the enhancement layer are (2x, 2y). And an image block of size (2m) X ( 2n ), the corresponding block in the base layer image may be an image block whose pixel coordinates are (X , y ) and whose size is mxn in the upper left corner.
  • a sub-block described later refers to a sub-block of the target image block (an image block in the enhancement layer), and a corresponding sub-block described later refers to a base layer image block in the base layer of the sub-block (belonging to The corresponding block above).
  • the motion information may include one or more of a prediction direction, a reference image index, or a motion vector, where the prediction direction may be divided into one-way and two-way prediction, and the one-way prediction may be further divided into forward prediction.
  • forward prediction refers to the use of a forward reference picture list, ie, a reference picture in list 0 to generate a prediction signal
  • backward prediction refers to using a backward reference picture list, ie, a reference picture in list 1 to generate a prediction.
  • Bidirectional prediction refers to the use of reference pictures in list 0 and list 1 to generate prediction signals; for unidirectional prediction, a reference picture index is required to indicate the reference picture selected in list 0 or list l.
  • each motion vector includes a horizontal direction component X and a vertical direction component y, which can be written as (X, y), for one-way prediction, Requires a motion vector to indicate the displacement of the predicted signal in the selected list 0 or list 1 reference image, for bidirectional prediction
  • Two motion vectors are required to indicate the displacement of the forward prediction signal and the backward prediction signal in the selected list O reference image and the list 1 reference image, respectively.
  • the second motion information refers to a neighboring image block from the target image block.
  • the second motion information may include spatial motion information, which is motion information acquired from spatial neighboring blocks in the enhancement layer image, and time motion information refers to images from the enhancement layer. The motion information acquired by the temporal neighboring block in the reference image.
  • the decoding end device may acquire motion information included in the base layer image block of the target image block, and determine the first motion information according to the motion information included in the base layer image block.
  • determining the first motion information of the target image block according to the motion information of the base layer image block includes:
  • the first motion information is determined according to motion information of the target image sub-block.
  • the target image block may be regarded as being composed of one or more sub-blocks, wherein the size of the sub-block may be determined according to a preset value.
  • a sub-block size For example, 4 x 4 is explained.
  • the target image block includes 16 sub-blocks (size 4 x 4). Therefore, in the embodiment of the present invention, a corresponding sub-block of each sub-block in the target image block (belonging to the base layer image block) may be determined, and motion information of the corresponding sub-block is determined.
  • determining the motion information of the sub-block according to the motion information of the corresponding sub-block corresponding to the sub-block included in the base layer image block including:
  • the motion information of the first base layer image sub-block corresponding to the first target image sub-block is non-empty
  • the motion information of the first base layer image sub-block is used as the motion information of the first target image sub-block .
  • the pixel may be determined in the base layer image according to the coordinates of a certain pixel point in the selected sub-block (the first target image sub-block) (referred to as: “(E x , E y ) " )
  • the coordinate of the corresponding position in the middle (referred to as: " (and the base layer image block containing the corresponding position coordinates is taken as the corresponding sub-block.
  • it can be calculated according to the above formula 1 to formula 10 (3) x , B y ).
  • the motion information of the corresponding sub-block may be directly used as the motion information of the sub-block.
  • the sub-block may also be indeterminate, and the motion information of the target image block is directly obtained by using the above method. That is, it can be considered that the target image block includes only one sub-block (the sub-block size is the same as the target image block). At this time, the motion information of the target image block can be acquired in the same manner as described above.
  • zero motion information is used as the motion information of the sub-block.
  • zero motion information can be constructed in the following manner. For example, in a predictive coded picture frame (P frame), the prediction direction of the zero motion information is unidirectional prediction, and the reference picture index is 0, motion vector (0, 0). In the bidirectionally predictive coded picture frame (B frame), the prediction direction of the zero motion information is bidirectional prediction, both reference picture indexes are 0, and both motion vectors are (0, 0).
  • the method further includes:
  • the first base layer image sub-block corresponding to the first target image sub-block includes motion information.
  • whether the corresponding sub-block contains motion information may be determined according to an encoding mode of the base layer image (base layer image block). For example, if the base layer image uses the intra prediction coding mode, it may be determined that the corresponding sub-block does not contain motion information (i.e., the motion information of the first base layer image sub-block is empty).
  • the corresponding sub-block when the corresponding sub-block includes motion information, the corresponding sub-block may be determined according to the process as described above and its motion information may be acquired. When the corresponding sub-block does not include motion information, the above process may be skipped.
  • the corresponding sub-block does not include motion information.
  • the motion information of the sub-block may be determined based on motion information of neighboring blocks of the corresponding sub-block. That is, optionally, the target image block includes at least two target image sub-blocks, and
  • Determining motion information of the target image sub-block according to the motion information of the base layer image sub-block corresponding to the target image sub-block included in the target image block including: at least two And when the motion information of the first base layer image sub-block corresponding to the first target image sub-block in the target image sub-block is empty, according to the size of the target image block, the size of the target image sub-block, and the indication Determining, by the second index information of a position of the target image sub-block in the target image block, a second target image sub-block in the at least two target image sub-blocks;
  • determining the first motion information according to the motion information of the target image sub-block includes: Determining the first motion information according to the motion information of the first target image sub-block; or determining the first motion information according to the motion information of the second target image sub-block; or according to the motion of the first target image sub-block The information and the motion information of the second target image sub-block determine the first motion information.
  • the index allocation method of the sub-block may be the same as the prior art.
  • the description thereof is omitted, and the division and indexing of the sub-blocks are shown in FIG.
  • the processing level may be determined according to the size of the target image block and the size of the sub-block, and the processing layer is recursively layer by layer according to the processing level.
  • each processing unit (referred to as the first processing unit) in the lowest level hierarchy (referred to as the first layer) may be defined to include four sub-blocks, the previous layer of the first layer.
  • Each processing unit (referred to as the second layer) (denoted as the second layer) includes four first processing units, and so on, in order to avoid redundancy, the recursive description is omitted.
  • two levels may be included.
  • sub-block 0 ⁇ sub-block 3 constitute the first processing unit 0
  • the block 7 constitutes the first processing unit 1
  • the sub-block 8 ⁇ sub-block 11 constitutes the first processing unit 2
  • the sub-block 12 ⁇ sub-block 15 constitutes the first processing unit 3.
  • the first processing unit 0 to the first processing unit 3 constitute the second processing unit 0. It should be understood that the above-described hierarchical division method is merely illustrative, and the present invention is not limited thereto.
  • the motion information of each sub-block is empty according to the index number of the sub-block (for example, from small to large) may be determined, if the motion information of the sub-block is empty. Then, motion information of the sub-block (an example of the second target image sub-block) adjacent to the first processing unit may be determined based on the motion information. For example, if the motion information of the sub-block with index 0 (ie, sub-block 0, belonging to the first processing unit 0) is empty, motion information of other sub-blocks belonging to the same processing unit (first processing unit 0) may be acquired. And use the motion information as the motion information of the sub-block 0.
  • the obtaining order may be, for example, first obtaining motion information of a sub-block with an index of 1 (sub-block 1, that is, an example of a second target image sub-block, adjacent to sub-block 0 in the horizontal direction), if sub-block 1 If the motion information is empty, the motion information of the sub-block whose index is 2 (sub-block 2, that is, another example of the second target image sub-block, adjacent to the sub-block 0 in the vertical direction) may be acquired again. If the motion information of the sub-block 2 is empty, then the sub-block with the index of 3 (sub-block 3, that is, another example of the second target image sub-block, adjacent to the sub-block 0 in the diagonal direction) may be acquired. Sports information.
  • the motion information can be performed by the above method. Fill.
  • the method for filling the motion information of the sub-blocks whose motion information is empty is only an exemplary description, and the present invention is not limited thereto.
  • the vertical direction may also be obtained first.
  • the motion information of the sub-block (here, the adjacent sub-block), and the motion information of the specified sub-block (here, the adjacent sub-block) in the horizontal direction is acquired, and the specified sub-block in the diagonal direction is acquired (here , for adjacent sub-blocks) motion information. That is, the order of acquisition can be arbitrarily changed.
  • determining the first motion information according to the motion information of the target image sub-block includes:
  • Determining the first motion information according to the motion information of the first target image sub-block; or determining the first motion information according to the motion information of the second target image sub-block; or according to the motion of the first target image sub-block Determining the first motion information according to the motion information of the first target image sub-block; or determining the first motion information according to the motion information of the second target image sub-block; or according to the motion of the first target image sub-block.
  • the first processing unit may be in the same processing unit as the sub-block 0 from the first layer (for example, the first processing unit 0)
  • Other sub-blocks eg, sub-block 1 - sub-block 3 acquire motion information.
  • the sub-block for example, sub-block 0
  • the specified sub-block in the first layer for example, sub-block 1 ⁇ sub-block 3
  • the predetermined sub-block in the predetermined first processing unit for example, the first processing unit 1 to the first processing unit 3 in the second processing unit may be acquired (another example of the second target image sub-block)
  • the motion information is used as the motion information of the sub-block (for example, sub-block 0).
  • first processing unit 0 if the corresponding sub-blocks of all the sub-blocks in one first processing unit (for example, the first processing unit 0) are all empty, other first processing units in the second processing unit may be acquired (for example, the first processing Motion information of a predetermined sub-block in the unit 1 to the first processing unit 3 (for convenience of explanation, the sub-block in the upper left corner of each first processing unit is described as an example), and the motion information is The information is the motion information of each sub-block in the first processing unit (first processing unit 0).
  • the order of obtaining may be, for example, first obtaining a sub-block of the upper left corner of the first processing unit (the first processing unit 1 adjacent to the first processing unit 0 in the horizontal direction) having an index of 1 (sub-block 4, ie
  • the motion information of the second target image sub-block is empty. If the motion information of the sub-block 4 is empty, the motion information of the other sub-blocks in the first processing unit 1 is also considered to be empty, so that the index can be re-acquired.
  • a sub-block of the upper left corner of the first processing unit (first processing unit 2 adjacent to the first processing unit 0 in the vertical direction) of 2 (subblock 8, that is, another example of the second target image sub-block)
  • the motion information of the sub-block 8 is considered to be empty if the motion information of the sub-block 8 is empty, so that the motion information of the other sub-blocks in the first processing unit 2 is also empty, so that the first processing unit with the index of 3 can be reacquired (first The processing unit 3, which is adjacent to the first processing unit 0 in the diagonal direction, has motion information of the sub-block in the upper left corner (sub-block 12, that is, another example of the second target image sub-block).
  • the motion information can be filled by the above method.
  • the method for filling the motion information of the sub-blocks whose motion information is empty is only an exemplary description, and the present invention is not limited thereto.
  • the vertical direction may also be obtained first. Obtaining motion information of a predetermined sub-block of the first processing unit (here, adjacent to the first processing unit), and acquiring a predetermined sub-block of a predetermined first processing unit (here, an adjacent first processing unit) in the horizontal direction The motion information further acquires motion information of a prescribed sub-block of the first processing unit (here, the adjacent first processing unit) in the diagonal direction.
  • predetermined sub-block is not limited to the sub-block in the upper left corner of the first processing unit, and may be a sub-block at an arbitrary position in the same first processing unit.
  • the target image block since the size of the target image block enumerated above is 16x 16, and the size of the sub-block is 4x 4, the target image block includes only two layers, and the above recursion process ends. However, the size of the target image block is larger, for example, 32x 32, and the size of the sub-block is 4x4, then the target image block includes three layers, and the recursive operation can be continued in the same manner as described above, as the target image block All sub-blocks get motion information.
  • the second target image sub-block in the middle includes:
  • W3 ⁇ 4 / ⁇ /NxN + ((l-/ 1 %N/(N/2))x2 + (l-/ ⁇ %N/(N/4)%2))xN/4;
  • the third index information indicating the position of the second target image sub-block in the target image block, / indicates the second index information, and N is determined according to the size of the target image block and the size of the target image sub-block.
  • the second target image sub-block within the currently processed hierarchy may be determined according to the index of the sub-block currently being processed, where ⁇ corresponds to the layer currently being processed, and ⁇ is according to the target
  • the size of the image block and the preset value are determined, for example, if the size of the target image block is 16 x 16 and the size of the sub-block is 4x 4, the target image block includes two layers as described above, when processing the first layer , ⁇ is the number of sub-blocks included in each processing unit (first processing unit) in the layer, here is 4.
  • is the number of sub-blocks included in each processing unit (second processing unit) in the layer, here 16.
  • the determining, according to the motion information of the base layer image sub-block corresponding to the target image sub-block included in the target image block, the motion information of the target image sub-block further comprising:
  • zero motion information is used as the motion information of the sub-block.
  • zero motion information can be constructed in the following manner.
  • the prediction direction of zero motion information is unidirectional prediction, and the reference picture index is 0, motion vector (0, 0).
  • the prediction direction of the zero motion information is bidirectional prediction, both reference picture indices are 0, and both motion vectors are (0, 0).
  • the foregoing method of using the zero motion information as the motion information of the sub-block may be performed after processing the last layer, or may be performed on any other layer.
  • the treatment is carried out, and the present invention is not particularly limited.
  • the method for obtaining the motion information of the sub-blocks listed above is only an exemplary description of the present invention, and the present invention is not limited thereto.
  • the coding mode of the layer image determines whether the corresponding sub-block contains motion information.
  • the base layer image uses the intra prediction coding mode, it may be determined that the corresponding sub-block does not contain motion information (ie, the motion information of the first base layer image sub-block is empty). If it is determined that only one of the sub-blocks of the target image block (specifically, its corresponding sub-block) has motion information, the motion information of the sub-block may be used as motion information of the other sub-blocks.
  • the acquisition processing of the first motion information of the target image block is completed, and thus, at S120, the first motion information and the second motion information can be added to the motion information list.
  • the motion information of all the sub-blocks in the current image block is taken as a whole (that is, the motion information is unified index (the first index).
  • the information) indication is added to the motion information list, and some or all of the motion information in the motion information of each sub-block may also be added to the motion information list (ie, each motion information is indicated by a different index (first index information)).
  • the first motion information is determined according to the motion information of the sub-block, and the method includes:
  • the motion information of the third target image sub-block has the highest frequency of occurrence in the motion information of the sub-block.
  • the one or more motion information may be obtained from different locations of the base layer image blocks in the base layer.
  • the embodiment of the present invention can provide the foregoing methods a, b, and c to obtain the motion information (first motion information).
  • one or more pieces of motion information of each sub-block may be selected according to a preset value (for indicating the number of pieces of motion information included in the motion information list). Sports information.
  • determining the first motion information according to the motion information of the sub-block includes: determining, according to motion information of the third target image sub-block, the third target image sub-block is a sub-block located in a preset position in the target image block, or
  • the motion information of the third target image sub-block has the highest frequency of occurrence in the motion information of the sub-block.
  • the one or more motion information may be obtained from different locations of the base layer image block in the base layer.
  • Embodiments of the present invention may provide three methods for obtaining the motion information (first motion information) in the foregoing method a, method b, and method c.
  • determining the first motion information according to the motion information of the third target image sub-block includes:
  • the first motion information is determined based on the motion information of the third target image sub-block after the scaling process.
  • the selected motion information may be appropriately scaled according to the distance relationship between the reference image of the selected motion information, the enhancement layer image, and the reference image of the target image block in time. Processing, adding the motion information after the scaling process to the motion information list as the first motion information.
  • the target image may be acquired from the code stream, the first motion information and the second motion information of the currently processed target image block are acquired, and a motion information list is generated.
  • the method for obtaining the second motion information may be the above method 1 and method 2.
  • the list of motion information can be determined.
  • the second motion information includes time motion information and spatial motion information
  • Determining the motion information list according to the first motion information and the second motion information comprising: determining, according to the first motion information and the second motion information, the motion information list, so that the first motion information is located in the motion information list. First place; or
  • the motion information list is determined such that the first motion information is located between the spatial motion information in the motion information list and the temporal motion information.
  • the first motion information may be located at the last position of the motion information list, or the first motion information may be located after all the spatial motion information in the motion information list, and before the time motion information. .
  • the first index information may be obtained from the code stream, and the obtained first index information (the information after the entropy coding process) is subjected to entropy decoding processing, where the processing may include: context model selection processing, binary arithmetic decoding Processing, binarization decoding processing, context update processing.
  • TU Truncated Unary
  • Binarization In the case where the number of pieces of motion information included in the motion information list is 5 (the preset value is 5), the TU code binarization is as shown in Table 1 above.
  • the first index information includes a first symbol for indicating whether the optimal motion information is the first motion information, and a second symbol for indicating a location of the optimal motion information in the motion list, as well as
  • the coding unit is specifically configured to perform arithmetic coding processing on the first symbol according to the first context model
  • the first index information of the embodiment of the present invention may include two symbols, that is, a first symbol for indicating whether the optimal motion information is the first motion information, and for indicating the optimal motion information.
  • the first index information may include only one symbol bit or a plurality of symbol bits.
  • the selected optimal motion information is the first motion information
  • only one symbol bit may be included.
  • the first symbol is the same as the second symbol, and both are located. The only sign bit.
  • the first symbol may be carried by one symbol bit, for example, 0 indicates that the optimal motion information is the first motion information, and 1 indicates the optimal motion information. Not for the first motion information.
  • the second symbol can be carried with other symbol bits.
  • the binary symbol string obtained after binarizing the first index information may be used.
  • the context model used by the first symbol may include three context models of 0, 1, and 2 as shown in Table 2 above.
  • which context model is used may be determined according to whether the image blocks on the left and the top of the target image block use their respective first motion information, for example, if the image blocks on the left and the top of the target image block are If the first motion information is not used, then the context model with index 0 is selected. If the image block on the left and the top of the target image block has a first motion information, then the context model with index 1 is selected, if the target image The image blocks on the left and top of the block use the first motion information, then the context with index 2 is selected.
  • the second context model may be an equal probability model.
  • the coding method using the equal probability model coding is also a by-pass coding mode, that is, the coding mode in which the second symbol is directly written into the code stream. If you use the by-pass encoding, no context update processing is required.
  • the first symbol and the second symbol may also use the same context model, or adopt a by-pass mode (ie, The binary symbol is directly written to the code stream without using the context model.
  • the first index information is encoded.
  • the first index information can be subjected to binary arithmetic decoding according to the context model selected as described above, and the used context model is updated.
  • the process may be the same as the prior art, and the description thereof is omitted here to avoid redundancy.
  • the motion compensation process may be performed on the target image block according to the selected optimal motion information, and the information of the target image block generated by the motion compensation process and the entropy coding process are processed.
  • the first index information is added to the code stream.
  • the embodiment of the present invention is applied to the MERGE mode, it is necessary to perform a motion compensation operation on each sub-block of the target image block. After the prediction signal of the current block is obtained by motion compensation, the residual signal obtained by the additional decoding may also be superimposed to obtain the reconstructed signal.
  • the encoding mode is the MERGE mode
  • the optimal motion information is the first motion information
  • the pixels near the boundary between the sub-blocks of the target image block may be subjected to filtering processing.
  • the motion information of the target image block can be derived according to the optimal motion information, combined with the prediction direction, the reference image index, and the motion vector difference obtained by the additional entropy decoding.
  • the motion information is used to perform motion compensation on the current block. After acquiring the prediction signal of the current block by motion compensation, the residual signal obtained by the additional decoding may also be superimposed to obtain the reconstructed signal.
  • a method for image processing in a technique of determining motion information of a currently processed image block using motion information of a neighboring image block, such as MERGE or AMVP, by adding a base layer image to the motion information list
  • the first motion information determined by the motion information can determine the motion information of the currently processed image block by using motion information of the adjacent image block.
  • the motion information of the currently processed image block is determined by using the motion information of the base layer image, thereby improving the processing efficiency.
  • FIGS. 1 to 5 a method for image processing according to an embodiment of the present invention is described in detail with reference to FIGS. 1 to 5.
  • a device for image processing according to an embodiment of the present invention will be described in detail with reference to FIGS. 6 to 7. .
  • FIG. 6 shows a schematic block diagram of an apparatus 300 for image processing in accordance with an embodiment of the present invention.
  • the apparatus 300 includes:
  • the acquiring unit 310 is configured to determine first motion information of the target image block according to the motion information of the base layer image block, where the base layer image block is located in the base layer image, where the target image block is located in the enhancement layer image, where a base layer image corresponding to the enhancement layer image, and a spatial position of the base image block in the base layer image corresponds to a spatial position of the target image block in the enhancement layer image;
  • a generating unit 320 configured to acquire the first motion information and the second motion information from the acquiring unit, generate a motion information list according to the first motion information and the second motion information, and transmit the motion to the selecting unit Information List;
  • the selecting unit 330 is configured to acquire the motion information list from the generating unit 320, and determine optimal motion information of the target image block from the motion information list according to a predetermined rule, and transmit the optimal motion information to the encoding unit 340;
  • the encoding unit 340 is configured to obtain the optimal motion information from the selecting unit 330, and encode the target image block according to the optimal motion information to generate a target code stream, where the target code stream includes The first index information of the position of the motion information in the motion information list.
  • the acquiring unit 310 is specifically configured to determine motion of the target image sub-block according to motion information of the base layer image sub-block corresponding to the target image sub-block included in the target image block included in the base layer image block.
  • the quality of the base layer image is lower than the quality of the enhancement layer image.
  • the acquiring unit 310 is specifically configured to: when the motion information of the first base layer image sub-block corresponding to the first target image sub-block in the at least two target image sub-blocks is empty, according to the Determining a size of the target image block, a size of the target image sub-block, and second index information indicating a position of the first target image sub-block in the target image block, determining a number of the at least two target image sub-blocks Two target image sub-blocks;
  • the motion information of the target image sub-block and the motion information of the second target image sub-block determine the first motion information.
  • the obtaining unit 310 is specifically configured to determine the second target image sub-block according to any one of the following formulas.
  • W3 ⁇ 4 / ⁇ /NxN + ((l-/ x 1 N/(N/2))x2 + (l-/ ⁇ N/(N/4) 2))xN/4; where The third index information of the position of the second target image sub-block in the target image block, / represents the second index information, and N is determined according to the size of the target image block and the size of the target image sub-block.
  • the acquiring unit 310 is specifically configured to determine that the motion information of the first target image sub-block is zero motion information if the motion information of the second target image sub-block is empty.
  • the acquiring unit 310 is specifically configured to determine the first motion information according to the motion information of the third target image sub-block, where the third target image sub-block is a target located in the target location in the target image block.
  • the motion information of the third target image sub-block has the highest frequency of occurrence in the motion information of the target image sub-block.
  • the acquiring unit 310 is specifically configured to: according to a reference image of the motion information of the third target image sub-block, a time domain distance relationship between the target image and a reference image of the target image block, the third target image The motion information of the block is scaled;
  • the target image block includes at least two sub-blocks, and when the optimal information is the first motion information, the encoding unit 340 is further configured to enter a pixel located near a boundary between the sub-blocks. Line deblocking filtering.
  • the second motion information includes time motion information and spatial motion information
  • the generating unit 320 is specifically configured to determine, according to the first motion information and the second motion information, a motion information list, so that the first motion Information is at the top of the list of sports information; or
  • the first index information includes a first symbol for indicating whether the optimal motion information is the first motion information, and a second symbol for indicating a location of the optimal motion information in the motion list, as well as
  • the encoding unit 340 is specifically configured to perform arithmetic coding processing on the first symbol according to the first context model;
  • the apparatus 300 for image processing according to an embodiment of the present invention may correspond to an encoding end in the method of the embodiment of the present invention, and each unit in the image processing apparatus 300, that is, a module and the above other operations and/or functions respectively In order to implement the corresponding process of the method 100 in FIG. 1, for the sake of cleaning, no further details are provided herein.
  • An apparatus for image processing in a technique of determining motion information of a currently processed image block using motion information of a neighboring image block, such as MERGE or AMVP, by adding a base layer image to the motion information list
  • the first motion information determined by the motion information can determine the motion information of the currently processed image block by using the motion information of the base layer image while determining the motion information of the currently processed image block by using the motion information of the adjacent image block. Processing efficiency.
  • FIG. 7 shows a schematic block diagram of an apparatus 400 for image processing in accordance with an embodiment of the present invention.
  • the apparatus 400 includes:
  • the acquiring unit 410 is configured to determine first motion information of the target image block according to the motion information of the base layer image block, where the base layer image block is located in the base layer image, where the target image block is located in the enhancement layer image, where The base layer image corresponds to the enhancement layer image, and the basic image block a spatial position in the base layer image corresponding to a spatial position of the target image block in the enhancement layer image;
  • the generating unit 420 is configured to acquire the first motion information and the second motion information from the acquiring unit 410, generate a motion information list according to the first motion information and the second motion information, and transmit the motion information list to the determining unit 430.
  • a determining unit 430 configured to determine, according to the target code stream, first index information used to indicate a location of the optimal motion information in the motion information list;
  • the decoding unit 440 is configured to obtain the motion information list from the generating unit 420, and determine optimal motion information from the motion information list according to the first index information determined by the determining unit 430, according to the optimal motion information, Decoding the target code stream to obtain the target image block to decode the target code stream to obtain the target image block.
  • the quality of the base layer image is lower than the quality of the enhancement layer image.
  • the acquiring unit 410 is specifically configured to determine motion of the target image sub-block according to motion information of the base layer image sub-block corresponding to the target image sub-block included in the target image block included in the base layer image block.
  • the target image block includes at least two target image sub-blocks, and
  • the acquiring unit 410 is specifically configured to: when the motion information of the first base layer image sub-block corresponding to the first target image sub-block in the at least two target image sub-blocks is empty, according to the size of the target image block, Determining a size of the target image sub-block and second index information indicating a position of the first target image sub-block in the target image block, and determining a second target image sub-block in the at least two target image sub-blocks;
  • the acquiring unit 410 is specifically configured to determine the second target image sub-block according to any one of the following formulas.
  • the acquiring unit 410 is specifically configured to determine that the motion information of the first target image sub-block is zero motion information if the motion information of the second target image sub-block is empty.
  • the acquiring unit 410 is specifically configured to determine the first motion information according to the motion information of the third target image sub-block, where the third target image sub-block is a sub-block located in the target image block. Block, or
  • the motion information of the third target image sub-block has the highest frequency of occurrence in the motion information of the sub-block.
  • the acquiring unit 410 is specifically configured to: according to a reference image of the motion information of the third target image sub-block, a time domain distance relationship between the target image and a reference image of the target image block, the third target image The motion information of the block is scaled;
  • the target image block includes at least two sub-blocks
  • the decoding unit 430 is further configured to perform deblocking on pixels located near a boundary between the sub-blocks. Filter processing.
  • the second motion information includes time motion information and spatial motion information
  • the generating unit 420 is specifically configured to determine, according to the first motion information and the second motion information, a motion information list, so that the first motion Information is at the top of the list of sports information; or
  • the first index information includes a first symbol for indicating whether the optimal motion information is the first motion information, and a second symbol for indicating a location of the optimal motion information in the motion list, as well as
  • the decoding unit 430 is specifically configured to perform arithmetic decoding processing on the first symbol according to the first context model, and perform arithmetic decoding processing on the second symbol according to the second context model, to perform the first processing according to the arithmetic decoding process.
  • the index information determines the optimal motion information from the motion information list, wherein the first context model is different from the second context model.
  • the apparatus 400 for image processing may correspond to a decoding end in the method of the embodiment of the present invention, and the units in the apparatus 400 for image processing, that is, modules and other operations and/or functions described above In order to implement the corresponding processes of the method 200 in FIG. 5, respectively, for the sake of cleaning, no further details are provided herein.
  • An apparatus for image processing in a technique of determining motion information of a currently processed image block using motion information of a neighboring image block, such as MERGE or AMVP, by adding a base layer image to the motion information list
  • the first motion information determined by the motion information can determine the motion information of the currently processed image block by using the motion information of the base layer image while determining the motion information of the currently processed image block by using the motion information of the adjacent image block. Processing efficiency.
  • Fig. 8 shows a schematic block diagram of an encoder 500 for image processing in accordance with an embodiment of the present invention.
  • the encoder 500 can include:
  • processor 520 connected to the bus
  • the processor 520 through the bus 510, invokes a program stored in the memory 530, for determining first motion information of the target image block according to motion information of the base layer image block, where the base layer image block is located In the base layer image, the target image block is located in the enhancement layer image, the base layer image corresponding to the enhancement layer image, and the spatial position of the basic image block in the base layer image and the target image block are in the enhancement The spatial position in the layer image corresponds;
  • a motion signal for a neighboring image block adjacent to the target image block in the enhancement layer image Determining second motion information of the target image block
  • a motion information list configured to determine, according to a predetermined rule, optimal motion information of the target image block from the motion information list
  • the target code stream includes first index information for indicating a position of the optimal motion information in the motion information list.
  • the quality of the base layer image is lower than the quality of the enhancement layer image.
  • the processor 520 is configured to determine motion of the target image sub-block according to motion information of the base layer image sub-block corresponding to the target image sub-block included in the target image block included in the base layer image block. Information, wherein the target image block sub-block has a preset size;
  • the first motion information is determined according to motion information of the target image sub-block.
  • the target image block includes at least two target image sub-blocks, and
  • the processor 520 is specifically configured to: when the motion information of the first base layer image sub-block corresponding to the first target image sub-block of the at least two target image sub-blocks is empty, according to the size of the target image block, Determining a size of the target image sub-block and second index information indicating a position of the first target image sub-block in the target image block, and determining a second target image sub-block in the at least two target image sub-blocks;
  • the motion information of the target image sub-block and the motion information of the second target image sub-block determine the first motion information.
  • the processor 520 is specifically configured to determine the second target image sub-block according to any one of the following formulas.
  • Idx 2 + idx, %N/(N/2))x2 + (l- Idx l %N /(N / 4)%2)) ⁇ N /4 ; Idx 2 + ((l - ldx x %N/(N/2))x2 + (ldx x %N / (N / 4) %2)) xN/4; W3 ⁇ 4 / ⁇ /NxN + ((l-/ x 1 N/(N/2))x2 + (l-/ ⁇ N/(N/4) 2))xN/4; wherein, the representation is used to indicate that the second target image sub-block is in the target image block
  • the third index information of the location, / represents the second index information, and N is based on the size of the target image block And the size of the target image sub-block is determined.
  • the processor 520 is specifically configured to determine that the motion information of the first target image sub-block is zero motion information if the motion information of the second target image sub-block is empty.
  • the processor 520 is specifically configured to determine the first motion information according to the motion information of the third target image sub-block, where the third target image sub-block is a target located in the target location in the target image block.
  • the motion information of the third target image sub-block has the highest frequency of occurrence in the motion information of the target image sub-block.
  • the processor 520 is specifically configured to: according to a reference image of the motion information of the third target image sub-block, a time domain distance relationship between the target image and a reference image of the target image block, to the third target image The motion information of the block is scaled;
  • the target image block includes at least two target image sub-blocks, and
  • the processor 520 is further configured to perform a deblocking filtering process on pixels located near a boundary between the target image sub-blocks.
  • the second motion information includes time motion information and spatial motion information
  • the processor 520 is specifically configured to determine, according to the first motion information and the second motion information, a motion information list, so that the first motion Information is at the top of the list of sports information; or
  • the first index information includes a first symbol for indicating whether the optimal motion information is the first motion information, and a second symbol for indicating a location of the optimal motion information in the motion list, as well as
  • the processor 520 is specifically configured to perform arithmetic coding processing on the first symbol according to the first context model
  • the encoder 500 for image processing may correspond to an encoding end in the method of the embodiment of the present invention, and each unit in the encoder 500 for image processing, that is, a module and the above-described other operations and/or For the purpose of implementing the corresponding process of the method 100 in FIG. 1 , the functions are not described here.
  • An encoder for image processing in a technique of determining motion information of a currently processed image block using motion information of a neighboring image block, such as MERGE or AMVP, by adding a base layer according to the motion information list
  • the first motion information determined by the image motion information can determine the motion information of the currently processed image block by using the motion information of the base layer image while determining the motion information of the currently processed image block by using the motion information of the adjacent image block.
  • FIG. 9 shows a schematic block diagram of a decoder 600 for image processing in accordance with an embodiment of the present invention.
  • the decoder 600 can include:
  • processor 620 connected to the bus
  • the processor 620 calls, by using the bus 610, a program stored in the memory 630, for determining first motion information of the target image block according to motion information of the base layer image block, where the base layer image block is located.
  • the target image block is located in the enhancement layer image
  • the spatial position of the basic image block in the base layer image and the target image block are in the enhancement
  • the spatial position in the layer image corresponds;
  • a motion information list configured to acquire, according to the target code stream, first index information used to indicate a location of the optimal motion information in the motion information list
  • the quality of the base layer image is lower than the quality of the enhancement layer image.
  • the processor 620 is configured to determine motion of the target image sub-block according to motion information of the base layer image sub-block corresponding to the target image sub-block included in the target image block included in the base layer image block. Information, wherein the target image block sub-block has a preset size; The first motion information is determined according to motion information of the target image sub-block.
  • the target image block includes at least two target image sub-blocks, and
  • the processor 620 is specifically configured to: when the motion information of the first base layer image sub-block corresponding to the first target image sub-block of the at least two target image sub-blocks is empty, according to the size of the target image block, Determining a size of the target image sub-block and second index information indicating a position of the first target image sub-block in the target image block, and determining a second target image sub-block in the at least two target image sub-blocks;
  • the motion information of the target image sub-block and the motion information of the second target image sub-block determine the first motion information.
  • the processor 620 is specifically configured to determine the second target image sub-block according to any one of the following formulas.
  • W3 ⁇ 4 / ⁇ /NxN + ((l-/ x 1 N/(N/2))x2 + (l-/ ⁇ N/(N/4) 2))xN/4; where The third index information of the position of the second target image sub-block in the target image block, / represents the second index information, and N is determined according to the size of the target image block and the size of the target image sub-block.
  • the processor 620 is specifically configured to determine that the motion information of the first target image sub-block is zero motion information if the motion information of the second target image sub-block is empty.
  • the processor 620 is specifically configured to determine the first motion information according to the motion information of the third target image sub-block, where the third target image sub-block is a target located in the target location in the target image block.
  • the motion information of the third target image sub-block has the highest frequency of occurrence in the motion information of the target image sub-block.
  • the processor 620 is specifically configured to: according to a reference image of the motion information of the third target image sub-block, a time domain distance relationship between the target image and a reference image of the target image block, the third target image The motion information of the block is scaled; And determining the first motion information according to the motion information of the third target image sub-block after the scaling process.
  • the target image block includes at least two target image sub-blocks, and
  • the processor 620 is further configured to perform deblocking filtering processing on pixels located near a boundary between the target image sub-blocks.
  • the second motion information includes time motion information and spatial motion information
  • the processor 620 is specifically configured to determine, according to the first motion information and the second motion information, a motion information list, so that the first motion Information is at the top of the list of sports information; or
  • the first index information includes a first symbol for indicating whether the optimal motion information is the first motion information, and a second symbol for indicating a location of the optimal motion information in the motion list, as well as
  • the processor 620 is specifically configured to perform arithmetic decoding processing on the first symbol according to the first context model, and perform arithmetic decoding processing on the second symbol according to the second context model, to perform the first processing according to the arithmetic decoding process.
  • Index information determining optimal motion information from the motion information list, wherein the first context model is different from the second context model.
  • the decoder 600 for image processing may correspond to a decoding end in the method of the embodiment of the present invention, and each unit in the decoder 600 for image processing, that is, a module and the other operations described above and/or For the purpose of implementing the corresponding process of the method 200 in FIG. 5, the functions are not described here.
  • a decoder for image processing in a technique of determining motion information of a currently processed image block using motion information of a neighboring image block, such as MERGE or AMVP, by adding a base layer in the motion information list
  • the first motion information determined by the image motion information can determine the motion information of the currently processed image block by using the motion information of the base layer image while determining the motion information of the currently processed image block by using the motion information of the adjacent image block.
  • the first target image sub-block may be one or more The present invention is not particularly limited.
  • the third target image sub-block may be one or plural, and the present invention is not particularly limited.
  • the processing of the encoding end corresponds to the process of acquiring the first motion information and generating the motion information list in the processing of the decoding end, so as to ensure that the encoding end is consistent with the motion information list finally determined by the decoding end, thereby
  • the motion information indicated in the motion information list determined at the encoding end and the decoding end by the first index information is the same.
  • Other encoding operations and decoding operations of the encoding end and the decoding end may correspond.
  • the decoding end processing method corresponding to the described encoding end processing method may be determined, or the encoding end processing method corresponding to the described decoding end processing method may be determined.
  • the size of the sequence numbers of the above processes does not mean the order of execution, and the order of execution of each process should be determined by its function and internal logic, and should not be taken to the embodiments of the present invention.
  • the implementation process constitutes any limitation.
  • the disclosed systems, devices, and methods may be implemented in other ways.
  • the device embodiments described above are merely illustrative.
  • the division of the unit is only a logical function division.
  • there may be another division manner for example, multiple units or components may be combined or Can be integrated into another system, or some features can be ignored, or not executed.
  • the mutual coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection through some interface, device or unit, and may be in an electrical, mechanical or other form.
  • the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of the embodiment.
  • each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.
  • the functions, if implemented in the form of software functional units and sold or used as separate products, may be stored in a computer readable storage medium.
  • the technical solution of the present invention which is essential to the prior art or part of the technical solution, may be embodied in the form of a software product stored in a storage medium, including
  • the instructions are used to cause a computer device (which may be a personal computer, server, or network device, etc.) to perform all or part of the steps of the methods described in various embodiments of the present invention.
  • the foregoing storage medium includes: a U disk, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, and the like, which can store program codes. .

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
  • Processing Or Creating Images (AREA)

Abstract

A method and device for image processing, a coder and a decoder. The method comprises: determining first motion information about a target image block according to motion information about a base layer image block, wherein the base layer image block is located in a base layer image, the target image block is located in an enhancement layer image, the base layer image corresponds to the enhancement layer image, and the spatial position of the base layer image block in the base layer image corresponds to the spatial position of the target image block in the enhancement layer image; according to the motion information about an image block adjacent to the target image block in the enhancement layer image, determining second motion information about the target image block; according to the first motion information and the second motion information, generating a motion information list; according to a predetermined rule, determining the optimal motion information about the target image block from the motion information list; and according to the optimal motion information, coding the target image block. The processing efficiency can be improved.

Description

用于图像处理的方法、 装置、 编码器和解码器 本申请要求于 2012 年 9 月 29 日提交中国专利局、 申请号为 201210375082.9、发明名称为"用于图像处理的方法、装置、编码器和解码器" 的中国专利申请的优先权, 其全部内容通过引用结合在本申请中。 技术领域  METHOD, APPARATUS, ENCODER AND DECODER FOR IMAGE PROCESSING This application claims to be filed on September 29, 2012, the Chinese Patent Office, Application No. 201210375082.9, entitled "Methods, Apparatus, Encoders for Image Processing, and The priority of the Chinese Patent Application, the entire disclosure of which is incorporated herein by reference. Technical field

本发明涉及视频处理领域, 并且更具体地, 涉及一种用于图像处理的方 法、 装置、 编码器和解码器。 背景技术  The present invention relates to the field of video processing and, more particularly, to a method, apparatus, encoder and decoder for image processing. Background technique

随着互联网的迅猛发展以及人们物质精神文化的日益丰富,在互联网中 针对视频的应用需求尤其是针对高清视频的应用需求越来越多, 而高清视频 的数据量非常大, 要想高清视频能在带宽有限的互联网中传输, 必须首先解 决的问题就是高清视频压缩编码问题。  With the rapid development of the Internet and the increasing material and spiritual culture of people, the demand for video applications in the Internet, especially for high-definition video applications, is increasing, and the amount of high-definition video is very large. The problem that must be solved first in the transmission of limited bandwidth Internet is the high-definition video compression coding problem.

目前, 已知有融合(MERGE )技术以及先进的运动矢量预测 (AMVP, Advanced Motion Vector Prediction )技术。 这两项技术能够有效地利用邻近 图像块的运动信息来确定当前处理的图像块的运动信息。所述 MERGE技术 指直接使用从邻近图像块获取的运动信息作为当前处理图像块运动信息的 技术。 所述 AMVP技术指使用从邻近图像块获取的运动信息对当前处理图 像块的运动信息进行预测的技术。这两项技术都会从邻近图像块中获取多个 运动信息, 并从所获取多个运动信息中选择一个使用。 所述邻近图像块可以 是时间邻近图像块, 也可以是空间邻近图像块。 所述空间邻近图像块是与当 前处理图像块在同一图像内的图像块; 所述时间图像块是在当前处理图像块 的时域参考图像内的相邻图像块。这两项技术能够有效地利用邻近图像块的 运动信息来确定当前处理的图像块的运动信息。  Currently, fusion (MERGE) technology and advanced motion vector prediction (AMVP) technology are known. These two techniques can effectively utilize the motion information of adjacent image blocks to determine the motion information of the currently processed image block. The MERGE technique refers to a technique of directly using motion information acquired from neighboring image blocks as current motion image block motion information. The AMVP technique refers to a technique of predicting motion information of a currently processed image block using motion information acquired from neighboring image blocks. Both of these techniques acquire multiple motion information from neighboring image blocks and select one of the multiple motion information acquired. The neighboring image blocks may be temporally adjacent image blocks or spatially adjacent image blocks. The spatially adjacent image block is an image block that is within the same image as the currently processed image block; the temporal image block is an adjacent image block within the time domain reference image of the currently processed image block. These two techniques can effectively utilize the motion information of neighboring image blocks to determine the motion information of the currently processed image block.

另外, 在网络环境里 (比如互联网), 由于网络带宽是有限的, 终端设 备以及用户的需求都是不同的, 所以为了某种特定的应用而一次压缩的码流 并不是令人满意和有效的, 对一些特定的用户或设备而言, 甚至是没有意义 的。解决这个问题的一个有效的方法就是利用可伸缩视频编码( SVC, scalable video coding )技术。 在该 SVC技术中, 根据包括空间分辨率、 时间分辨率 或者信噪比强度等在内的质量参数,将一个图像分为多个图像层。 SVC的目 标就是让质量高的图像层尽量充分的利用质量低的图像层的信息,提高层间 预测的效率, 使得编码质量高的图像的时候能够效率更高。 In addition, in a network environment (such as the Internet), since the network bandwidth is limited, the requirements of the terminal device and the user are different, so the code stream compressed once for a specific application is not satisfactory and effective. For even a specific user or device, it doesn't even make sense. An effective way to solve this problem is to use scalable video coding (SVC) technology. In the SVC technology, based on spatial resolution and temporal resolution Or a quality parameter such as signal-to-noise ratio intensity, which divides an image into multiple image layers. The goal of SVC is to make the image layer with high quality make full use of the information of the image layer with low quality, and improve the efficiency of inter-layer prediction, so that the image with high quality can be more efficient.

因此,希望能够在 MERGE或 AMVP等技术中,也能够利用 SVC技术, 即, 利用质量低的图像的运动信息来确定当前处理的质量高的图像的运动信 息。 发明内容  Therefore, it is desirable to be able to determine the motion information of the currently processed high quality image using the SVC technique, i.e., using the motion information of the low quality image, in techniques such as MERGE or AMVP. Summary of the invention

本发明实施例提供一种用于图像处理的方法、 装置、 编码器和解码器, 能够在利用邻近图像块的运动信息来确定当前处理的图像块的运动信息的 同时,使利用基本层图像的运动信息来确定当前处理的图像块的运动信息成 为可能, 提高处理效率。  Embodiments of the present invention provide a method, an apparatus, an encoder, and a decoder for image processing, which are capable of determining motion information of a currently processed image block while using motion information of a neighboring image block, thereby making use of a base layer image. The motion information makes it possible to determine the motion information of the currently processed image block, improving the processing efficiency.

第一方面, 提供了一种用于图像处理的方法, 该方法包括: 根据基本层 图像块的运动信息确定目标图像块的第一运动信息, 其中, 该的基本层图像 块位于基本层图像中, 该目标图像块位于增强层图像中, 该的基本层图像与 该增强层图像相对应,且该基本图像块在该基本层图像中的空间位置与该目 标图像块在该增强层图像中的空间位置相对应; 根据该增强层图像中与该目 标图像块相邻的邻近图像块的运动信息确定该目标图像块的第二运动信息; 根据该第一运动信息和该第二运动信息, 生成运动信息列表; 根据预定规则 从该运动信息列表中确定该目标图像块的最优运动信息; 根据该最优运动信 息, 对该目标图像块进行编码, 以生成目标码流, 该目标码流包括用于指示 该最优运动信息在该运动信息列表中的位置的第一索引信息。  In a first aspect, a method for image processing is provided, the method comprising: determining first motion information of a target image block according to motion information of a base layer image block, wherein the base layer image block is located in a base layer image And the target image block is located in the enhancement layer image, the base layer image corresponding to the enhancement layer image, and the spatial position of the basic image block in the base layer image and the target image block in the enhancement layer image Corresponding to the spatial position; determining second motion information of the target image block according to motion information of the adjacent image block adjacent to the target image block in the enhancement layer image; generating according to the first motion information and the second motion information a motion information list; determining, according to a predetermined rule, optimal motion information of the target image block from the motion information list; encoding, according to the optimal motion information, the target image block to generate a target code stream, where the target code stream includes First index information indicating a location of the optimal motion information in the motion information list.

在一种可能的实施方式中, 该根据基本层图像块的运动信息确定目标图 像块的第一运动信息包括: 根据该基本层图像块包括的与该目标图像块中包 含的目标图像子块对应的基本层图像子块的运动信息,确定该目标图像子块 的运动信息, 其中, 该目标图像块子块具有预先设定的大小; 根据该目标图 像子块的运动信息, 确定该第一运动信息。 结合第一方面和第一种可能的实 施方式, 在第二种可能的实施方式中, 该目标图像块包括至少两个目标图像 子块, 以及该根据该基本层图像块包括的与该目标图像块中包含的目标图像 子块对应的基本层图像子块的运动信息, 确定该目标图像子块的运动信息, 包括: 当与该至少两个目标图像子块中的第一目标图像子块相对应的第一基 本层图像子块的运动信息为空时, 根据该目标图像块的大小、 该目标图像子 块的大小和用于指示该第一目标图像子块在该目标图像块中的位置的第二 索引信息, 确定该至少两个目标图像子块中的第二目标图像子块; 根据该第 二目标图像子块的运动信息, 确定该第一目标图像子块的运动信息; 对应, 该根据该目标图像子块的运动信息, 确定该第一运动信息, 包括: 根据该第 一目标图像子块的运动信息, 确定该第一运动信息; 或根据该第二目标图像 子块的运动信息, 确定该第一运动信息; 或根据该第一目标图像子块的运动 信息以及第二目标图像子块的运动信息, 确定该第一运动信息。 In a possible implementation, the determining, according to the motion information of the base layer image block, the first motion information of the target image block comprises: corresponding to the target image sub-block included in the target image block according to the base layer image block The motion information of the base layer image sub-block determines the motion information of the target image sub-block, wherein the target image block sub-block has a preset size; determining the first motion according to the motion information of the target image sub-block information. With reference to the first aspect and the first possible implementation manner, in a second possible implementation manner, the target image block includes at least two target image sub-blocks, and the target image included according to the base layer image block Determining motion information of the base layer image sub-block corresponding to the target image sub-block included in the block, determining motion information of the target image sub-block, comprising: when compared with the first target image sub-block in the at least two target image sub-blocks Corresponding first base When the motion information of the image sub-block of the layer is empty, according to the size of the target image block, the size of the target image sub-block, and a second index indicating the position of the first target image sub-block in the target image block. Information, determining a second target image sub-block in the at least two target image sub-blocks; determining motion information of the first target image sub-block according to motion information of the second target image sub-block; corresponding, according to the target Determining the motion information of the image sub-block, determining the first motion information, including: determining, according to the motion information of the first target image sub-block, the first motion information; or determining, according to the motion information of the second target image sub-block First motion information; or determining the first motion information according to the motion information of the first target image sub-block and the motion information of the second target image sub-block.

结合第一方面、 第一种可能的实施方式和第二种可能的实施方式, 在第 三种可能的实施方式中, 该根据该目标图像块的大小、 该目标图像子块的大 小和用于指示该第一目标图像子块在该目标图像块中的位置的第二索引信 息, 确定该至少两个目标图像子块中的第二目标图像子块, 包括: 根据以下 任一公式, 确定该第二目标图像子块,  With reference to the first aspect, the first possible implementation manner, and the second possible implementation manner, in a third possible implementation manner, the size of the target image block, the size of the target image sub-block, and the Determining the second index information of the position of the first target image sub-block in the target image block, determining the second target image sub-block in the at least two target image sub-blocks, comprising: determining the method according to any one of the following formulas Second target image sub-block,

Idx2 + idx, %N/(N/2))x2 + (l- Idxl %N /(N / 4)%2))χ N /4 ; Idx2 + ((l - ldxx %N/(N/2))x2 + (ldxx %N / (N / 4) %2)) xN/4;Idx 2 + idx, %N/(N/2))x2 + (l- Idx l %N /(N / 4)%2))χ N /4 ; Idx 2 + ((l - ldx x %N/ (N/2))x2 + (ldx x %N / (N / 4) %2)) xN/4;

Idx2

Figure imgf000005_0001
((l - ldxx %N/(N/2))x2 + (l- ldxx %N / (N / 4) %2)) xN/4; 其中, 表示用于指示该第二目标图像子块在该目标图像块中的位置 的第三索引信息, / 表示该第二索引信息, N是根据该目标图像块的大小 和该目标图像子块的大小确定的。 Idx 2
Figure imgf000005_0001
((l - ldx x %N/(N/2))x2 + (l- ldx x %N / (N / 4) %2)) xN/4; where, the representation is used to indicate the second target image sub The third index information of the position of the block in the target image block, / represents the second index information, and N is determined according to the size of the target image block and the size of the target image sub-block.

结合第一方面、 第一种可能的实施方式、 第二种可能的实施方式和第三 种可能的实施方式, 在第四种可能的实施方式中, 该根据该基本层图像块包 括的与该目标图像块中包含的目标图像子块对应的基本层图像子块的运动 信息, 确定该目标图像子块的运动信息, 进一步包括: 如果该第二目标图像 子块的运动信息为空, 则确定该第一目标图像子块的运动信息为零运动信 息。  With reference to the first aspect, the first possible implementation manner, the second possible implementation manner, and the third possible implementation manner, in a fourth possible implementation manner, the Determining motion information of the base layer image sub-block corresponding to the target image sub-block included in the target image block, determining motion information of the target image sub-block, further comprising: determining, if the motion information of the second target image sub-block is empty, determining The motion information of the first target image sub-block is zero motion information.

结合第一方面、 第一种可能的实施方式、 第二种可能的实施方式、 第三 种可能的实施方式和第四种可能的实施方式, 在第五种可能的实施方式中, 该根据该目标图像子块的运动信息, 确定该第一运动信息, 包括: 根据第三 目标图像子块的运动信息, 确定该第一运动信息, 其中, 该第三目标图像子 块为该目标图像块中位于预设位置的目标图像子块, 或该第三目标图像子块 的运动信息在该目标图像子块的运动信息中的出现频率最高。 结合第一方面、 第一种可能的实施方式、 第二种可能的实施方式、 第三 种可能的实施方式、 第四种可能的实施方式和第五种可能的实施方式, 在第 六种可能的实施方式中, 该根据该目标图像子块的运动信息, 确定该第一运 动信息, 包括: 根据该第三目标图像子块的运动信息的参考图像、 该目标图 像和该目标图像块的参考图像的时域距离关系,对该第三目标图像子块的运 动信息进行缩放处理; 根据该缩放处理后的第三目标图像子块的运动信息, 确定该第一运动信息。 With reference to the first aspect, the first possible implementation manner, the second possible implementation manner, the third possible implementation manner, and the fourth possible implementation manner, in the fifth possible implementation manner, The motion information of the target image sub-block, determining the first motion information, includes: determining the first motion information according to the motion information of the third target image sub-block, where the third target image sub-block is in the target image block The target image sub-block located at the preset position, or the motion information of the third target image sub-block has the highest frequency of occurrence in the motion information of the target image sub-block. Combining the first aspect, the first possible implementation manner, the second possible implementation manner, the third possible implementation manner, the fourth possible implementation manner, and the fifth possible implementation manner, in the sixth possibility In the embodiment, determining the first motion information according to the motion information of the target image sub-block includes: a reference image according to motion information of the third target image sub-block, the target image, and a reference of the target image block The time domain distance relationship of the image is subjected to a scaling process on the motion information of the third target image sub-block; and the first motion information is determined according to the motion information of the third target image sub-block after the scaling process.

结合第一方面、 第一种可能的实施方式、 第二种可能的实施方式、 第三 种可能的实施方式、 第四种可能的实施方式、 第五种可能的实施方式和第六 种可能的实施方式, 在第七种可能的实施方式中, 该目标图像块包括至少两 个目标图像子块, 以及当该最优信息为该第一运动信息时, 该根据该最优运 动信息, 对该目标图像块进行编码, 包括: 对位于该目标图像子块之间的边 界附近的像素进行去块效应滤波处理。  Combining the first aspect, the first possible implementation manner, the second possible implementation manner, the third possible implementation manner, the fourth possible implementation manner, the fifth possible implementation manner, and the sixth possible In a seventh possible implementation manner, the target image block includes at least two target image sub-blocks, and when the optimal information is the first motion information, according to the optimal motion information, The encoding of the target image block includes: performing deblocking filtering processing on pixels located near a boundary between the target image sub-blocks.

结合第一方面、 第一种可能的实施方式、 第二种可能的实施方式、 第三 种可能的实施方式、 第四种可能的实施方式、 第五种可能的实施方式、 第六 种可能的实施方式和第七种可能的实施方式, 在第八种可能的实施方式中, 该第二运动信息包括时间运动信息和空间运动信息, 以及该根据该第一运动 信息和该第二运动信息, 确定运动信息列表, 包括: 根据该第一运动信息和 该第二运动信息, 确定运动信息列表, 以使该第一运动信息位于运动信息列 表的首位; 或根据该第一运动信息和该第二运动信息, 确定运动信息列表, 以使该第一运动信息位于运动信息列表的末位; 或根据该第一运动信息和该 第二运动信息, 确定运动信息列表, 以使该第一运动信息位于该运动信息列 表中的空间运动信息与该时间运动信息之间。  Combining the first aspect, the first possible implementation manner, the second possible implementation manner, the third possible implementation manner, the fourth possible implementation manner, the fifth possible implementation manner, and the sixth possible Embodiments and a seventh possible implementation manner, in the eighth possible implementation manner, the second motion information includes time motion information and spatial motion information, and the first motion information and the second motion information, Determining the motion information list, including: determining, according to the first motion information and the second motion information, the motion information list, so that the first motion information is located in a first position of the motion information list; or according to the first motion information and the second a motion information, determining a motion information list such that the first motion information is located at a last position of the motion information list; or determining a motion information list according to the first motion information and the second motion information, so that the first motion information is located The spatial motion information in the motion information list is between the time motion information.

结合第一方面、 第一种可能的实施方式、 第二种可能的实施方式、 第三 种可能的实施方式、 第四种可能的实施方式、 第五种可能的实施方式、 第六 种可能的实施方式、 第七种可能的实施方式和第八种可能的实施方式, 在第 九种可能的实施方式中,该第一索引信息包括用于指示该最优运动信息是否 为该第一运动信息的第一符号和用于指示该最优运动信息在该运动列表中 的位置的第二符号,以及该根据该最优运动信息,对该目标图像块进行编码, 包括: 根据第一上下文模型, 对该第一符号进行算术编码处理; 根据第二上 下文模型, 对该第二符号进行算术编码处理, 其中, 该第一上下文模型与该 第二上下文模型相异。 Combining the first aspect, the first possible implementation manner, the second possible implementation manner, the third possible implementation manner, the fourth possible implementation manner, the fifth possible implementation manner, and the sixth possible Embodiments, a seventh possible implementation manner, and an eighth possible implementation manner. In the ninth possible implementation manner, the first index information includes: used to indicate whether the optimal motion information is the first motion information a first symbol and a second symbol indicating a position of the optimal motion information in the motion list, and the encoding the target image block according to the optimal motion information, comprising: according to the first context model, Performing an arithmetic coding process on the first symbol; performing an arithmetic coding process on the second symbol according to the second context model, wherein the first context model and the The second context model is different.

第二方面, 提供了一种用于图像处理的方法, 该方法包括: 根据基本层 图像块的运动信息确定目标图像块的第一运动信息, 其中, 该的基本层图像 块位于基本层图像中, 该目标图像块位于增强层图像中, 该的基本层图像与 该增强层图像相对应,且该基本图像块在该基本层图像中的空间位置与该目 标图像块在该增强层图像中的空间位置相对应; 根据该增强层图像中与该目 标图像块相邻的邻近图像块的运动信息确定该目标图像块的第二运动信息; 根据该第一运动信息和该第二运动信息,生成运动信息列表;根据目标码流, 获取用于指示该最优运动信息在该运动信息列表中的位置的第一索引信息; 根据该第一索引信息, 从该运动信息列表中确定最优运动信息, 根据该最优 运动信息, 对该目标码流进行解码, 以获取该目标图像块。  In a second aspect, a method for image processing is provided, the method comprising: determining first motion information of a target image block according to motion information of a base layer image block, wherein the base layer image block is located in a base layer image And the target image block is located in the enhancement layer image, the base layer image corresponding to the enhancement layer image, and the spatial position of the basic image block in the base layer image and the target image block in the enhancement layer image Corresponding to the spatial position; determining second motion information of the target image block according to motion information of the adjacent image block adjacent to the target image block in the enhancement layer image; generating, according to the first motion information and the second motion information a motion information list; acquiring, according to the target code stream, first index information indicating a location of the optimal motion information in the motion information list; determining, according to the first index information, optimal motion information from the motion information list And decoding the target code stream according to the optimal motion information to obtain the target image block.

在一种可能的实施方式中, 该根据基本层图像块的运动信息确定目标图 像块的第一运动信息包括: 根据该基本层图像块包括的与该目标图像块中包 含的目标图像子块对应的基本层图像子块的运动信息,确定该目标图像子块 的运动信息, 其中, 该目标图像块子块具有预先设定的大小; 根据该目标图 像子块的运动信息, 确定该第一运动信息。  In a possible implementation, the determining, according to the motion information of the base layer image block, the first motion information of the target image block comprises: corresponding to the target image sub-block included in the target image block according to the base layer image block The motion information of the base layer image sub-block determines the motion information of the target image sub-block, wherein the target image block sub-block has a preset size; determining the first motion according to the motion information of the target image sub-block information.

结合第二方面和第一种可能的实施方式, 在第二种可能的实施方式中, 该目标图像块包括至少两个目标图像子块, 以及该根据该基本层图像块包括 的与该目标图像块中包含的目标图像子块对应的基本层图像子块的运动信 息, 确定该目标图像子块的运动信息, 包括: 当与该至少两个目标图像子块 中的第一目标图像子块相对应的第一基本层图像子块的运动信息为空时,根 据该目标图像块的大小、该目标图像子块的大小和用于指示该第一目标图像 子块在该目标图像块中的位置的第二索引信息,确定该至少两个目标图像子 块中的第二目标图像子块; 根据该第二目标图像子块的运动信息, 确定该第 一目标图像子块的运动信息; 对应, 该根据该目标图像子块的运动信息, 确 定该第一运动信息, 包括: 根据该第一目标图像子块的运动信息, 确定该第 一运动信息;或根据该第二目标图像子块的运动信息,确定该第一运动信息; 或根据该第一目标图像子块的运动信息以及第二目标图像子块的运动信息, 确定该第一运动信息。  With reference to the second aspect and the first possible implementation manner, in a second possible implementation manner, the target image block includes at least two target image sub-blocks, and the target image included according to the base layer image block Determining motion information of the base layer image sub-block corresponding to the target image sub-block included in the block, determining motion information of the target image sub-block, comprising: when compared with the first target image sub-block in the at least two target image sub-blocks When the motion information of the corresponding first base layer image sub-block is empty, according to the size of the target image block, the size of the target image sub-block, and the position indicating the first target image sub-block in the target image block. Determining, by the second index information, a second target image sub-block in the at least two target image sub-blocks; determining motion information of the first target image sub-block according to the motion information of the second target image sub-block; Determining the first motion information according to the motion information of the target image sub-block, including: determining, according to motion information of the first target image sub-block Determining the first motion information according to the motion information of the second target image sub-block; or determining the motion information according to the motion information of the first target image sub-block and the motion information of the second target image sub-block; First motion information.

结合第二方面、 第一种可能的实施方式和第二种可能的实施方式, 在第 三种可能的实施方式中, 该根据该目标图像块的大小、 该目标图像子块的大 小和用于指示该第一目标图像子块在该目标图像块中的位置的第二索引信 息, 确定该至少两个目标图像子块中的第二目标图像子块, 包括: 根据以下 任一公式, 确定该第二目标图像子块, With reference to the second aspect, the first possible implementation manner, and the second possible implementation manner, in a third possible implementation manner, according to the size of the target image block, the target image sub-block is large Determining, according to the second index information indicating the position of the first target image sub-block in the target image block, determining the second target image sub-block in the at least two target image sub-blocks, including: a formula that determines the second target image sub-block,

Idx2 / 2)) χ 2 + (1 - Idxl %N /(N/4) %2)) xN/4; Idx2

Figure imgf000008_0001
(N/2))x2 + (ldxx %N / (N / 4) %2)) xN/4;Idx 2 / 2)) χ 2 + (1 - Idx l %N /(N/4) %2)) xN/4; Idx 2
Figure imgf000008_0001
(N/2))x2 + (ldx x %N / (N / 4) %2)) xN/4;

W¾ =/^/NxN + ((l-/ x1 N/(N/2))x2 + (l-/^ N/(N/4) 2))xN/4; 其中, 表示用于指示该第二目标图像子块在该目标图像块中的位置 的第三索引信息, / 表示该第二索引信息, N是根据该目标图像块的大小 和该目标图像子块的大小确定的。 W3⁄4 = /^/NxN + ((l-/ x 1 N/(N/2))x2 + (l-/^ N/(N/4) 2))xN/4; where The third index information of the position of the second target image sub-block in the target image block, / represents the second index information, and N is determined according to the size of the target image block and the size of the target image sub-block.

结合第二方面、 第一种可能的实施方式、 第二种可能的实施方式和第三 种可能的实施方式, 在第四种可能的实施方式中, 该根据该基本层图像块包 括的与该目标图像块中包含的目标图像子块对应的基本层图像子块的运动 信息, 确定该目标图像子块的运动信息, 进一步包括: 如果该第二目标图像 子块的运动信息为空, 则确定该第一目标图像子块的运动信息为零运动信 息。  With reference to the second aspect, the first possible implementation manner, the second possible implementation manner, and the third possible implementation manner, in a fourth possible implementation manner, the Determining motion information of the base layer image sub-block corresponding to the target image sub-block included in the target image block, determining motion information of the target image sub-block, further comprising: determining, if the motion information of the second target image sub-block is empty, determining The motion information of the first target image sub-block is zero motion information.

结合第二方面、 第一种可能的实施方式、 第二种可能的实施方式、 第三 种可能的实施方式和第四种可能的实施方式, 在第五种可能的实施方式中, 该根据该子块的运动信息, 确定该第一运动信息, 包括: 根据第三目标图像 子块的运动信息, 确定该第一运动信息, 其中, 该第三目标图像子块为该目 标图像块中位于预设位置的子块, 或该第三目标图像子块的运动信息在该子 块的运动信息中的出现频率最高。  With reference to the second aspect, the first possible implementation manner, the second possible implementation manner, the third possible implementation manner, and the fourth possible implementation manner, in the fifth possible implementation manner, Determining the first motion information, the motion information of the sub-block includes: determining, according to motion information of the third target image sub-block, the first motion information sub-block is located in the target image block The positional sub-block, or the motion information of the third target image sub-block, has the highest frequency of occurrence in the motion information of the sub-block.

结合第二方面、 第一种可能的实施方式、 第二种可能的实施方式、 第三 种可能的实施方式、 第四种可能的实施方式和第五种可能的实施方式, 在第 六种可能的实施方式中, 该根据第三目标图像子块的运动信息, 确定该第一 运动信息, 包括: 根据该第三目标图像子块的运动信息的参考图像、 该目标 图像和该目标图像块的参考图像的时域距离关系,对该第三目标图像子块的 运动信息进行缩放处理; 根据该缩放处理后的第三目标图像子块的运动信 息, 确定该第一运动信息  Combining the second aspect, the first possible implementation manner, the second possible implementation manner, the third possible implementation manner, the fourth possible implementation manner, and the fifth possible implementation manner, in the sixth possibility In the embodiment, determining the first motion information according to the motion information of the third target image sub-block includes: a reference image according to motion information of the third target image sub-block, the target image, and the target image block And scaling the motion information of the third target image sub-block according to the time domain distance relationship of the reference image; determining the first motion information according to the motion information of the third target image sub-block after the scaling processing

结合第二方面、 第一种可能的实施方式、 第二种可能的实施方式、 第三 种可能的实施方式、 第四种可能的实施方式、 第五种可能的实施方式和第六 种可能的实施方式, 在第七种可能的实施方式中, 该目标图像块包括至少两 个目标图像子块, 以及当该最优信息为该第一运动信息时, 该根据该最优运 动信息, 对该目标码流进行解码, 包括: 对位于该目标图像子块之间的边界 附近的像素进行去块效应滤波处理。 Combining the second aspect, the first possible implementation manner, the second possible implementation manner, the third possible implementation manner, the fourth possible implementation manner, the fifth possible implementation manner, and the sixth possible Embodiment, in a seventh possible implementation, the target image block includes at least two Target image sub-blocks, and when the optimal information is the first motion information, decoding the target code stream according to the optimal motion information, including: being located near a boundary between the target image sub-blocks The pixels are subjected to deblocking filtering processing.

结合第二方面、 第一种可能的实施方式、 第二种可能的实施方式、 第三 种可能的实施方式、 第四种可能的实施方式、 第五种可能的实施方式、 第六 种可能的实施方式和第七种可能的实施方式, 在第八种可能的实施方式中, 该第二运动信息包括时间运动信息和空间运动信息, 以及该根据该第一运动 信息和该第二运动信息, 确定运动信息列表, 包括: 根据该第一运动信息和 该第二运动信息, 确定运动信息列表, 以使该第一运动信息位于运动信息列 表的首位; 或根据该第一运动信息和该第二运动信息, 确定运动信息列表, 以使该第一运动信息位于运动信息列表的末位; 或根据该第一运动信息和该 第二运动信息, 确定运动信息列表, 以使该第一运动信息位于该运动信息列 表中的空间运动信息与该时间运动信息之间。  With reference to the second aspect, the first possible implementation manner, the second possible implementation manner, the third possible implementation manner, the fourth possible implementation manner, the fifth possible implementation manner, the sixth possible Embodiments and a seventh possible implementation manner, in the eighth possible implementation manner, the second motion information includes time motion information and spatial motion information, and the first motion information and the second motion information, Determining the motion information list, including: determining, according to the first motion information and the second motion information, the motion information list, so that the first motion information is located in a first position of the motion information list; or according to the first motion information and the second a motion information, determining a motion information list such that the first motion information is located at a last position of the motion information list; or determining a motion information list according to the first motion information and the second motion information, so that the first motion information is located The spatial motion information in the motion information list is between the time motion information.

结合第二方面、 第一种可能的实施方式、 第二种可能的实施方式、 第三 种可能的实施方式、 第四种可能的实施方式、 第五种可能的实施方式、 第六 种可能的实施方式、 第七种可能的实施方式和第八种可能的实施方式, 在第 九种可能的实施方式中, 该第一索引信息包括用于指示该最优运动信息是否 为该第一运动信息的第一符号和用于指示该最优运动信息在该运动列表中 的位置的第二符号, 以及该根据该第一索引信息, 从该运动信息列表中确定 最优运动信息, 包括: 根据第一上下文模型, 对该第一符号进行算术解码处 理, 并根据第二上下文模型, 对该第二符号进行算术解码处理, 以根据该算 术解码处理后的第一索引信息, 从该运动信息列表中确定最优运动信息, 其 中, 该第一上下文模型与该第二上下文模型相异。  With reference to the second aspect, the first possible implementation manner, the second possible implementation manner, the third possible implementation manner, the fourth possible implementation manner, the fifth possible implementation manner, the sixth possible Embodiments, a seventh possible implementation manner, and an eighth possible implementation manner. In the ninth possible implementation manner, the first index information includes: used to indicate whether the optimal motion information is the first motion information a first symbol and a second symbol indicating a position of the optimal motion information in the motion list, and determining the optimal motion information from the motion information list according to the first index information, including: a context model, performing arithmetic decoding processing on the first symbol, and performing arithmetic decoding processing on the second symbol according to the second context model, according to the first index information after the arithmetic decoding processing, from the motion information list Determining optimal motion information, wherein the first context model is different from the second context model.

第三方面, 提供了一种用于图像处理的装置, 该装置包括: 获取单元, 用于根据基本层图像块的运动信息确定目标图像块的第一运动信息, 其中, 该的基本层图像块位于基本层图像中, 该目标图像块位于增强层图像中, 该 的基本层图像与该增强层图像相对应,且该基本图像块在该基本层图像中的 空间位置与该目标图像块在该增强层图像中的空间位置相对应; 用于根据该 增强层图像中与该目标图像块相邻的邻近图像块的运动信息确定该目标图 像块的第二运动信息, 并向生成单元传输该第一运动信息和该第二运动信 息; 生成单元, 用于从该获取单元获取该第一运动信息和该第二运动信息, 并根据该第一运动信息和该第二运动信息, 生成运动信息列表, 以及, 向选 择单元传输该运动信息列表; 选择单元, 用于从该生成单元获取该运动信息 列表, 并根据预定规则从该运动信息列表中确定该目标图像块的最优运动信 息, 并向编码单元传输该最优运动信息; 编码单元, 用于从选择单元获取该 最优运动信息, 并根据该最优运动信息, 对该目标图像块进行编码, 以生成 目标码流, 该目标码流包括用于指示该最优运动信息在该运动信息列表中的 位置的第一索引信息。 In a third aspect, an apparatus for image processing is provided, the apparatus comprising: an acquiring unit, configured to determine first motion information of a target image block according to motion information of a base layer image block, where the base layer image block Located in the base layer image, the target image block is located in the enhancement layer image, the base layer image corresponding to the enhancement layer image, and the spatial position of the basic image block in the base layer image and the target image block are in the Corresponding to a spatial position in the enhancement layer image; configured to determine second motion information of the target image block according to motion information of the adjacent image block adjacent to the target image block in the enhancement layer image, and transmit the second motion information to the generating unit a motion information and the second motion information; a generating unit, configured to acquire the first motion information and the second motion information from the acquiring unit, And generating, according to the first motion information and the second motion information, a motion information list, and transmitting the motion information list to the selecting unit; the selecting unit, configured to acquire the motion information list from the generating unit, and according to a predetermined rule Determining the optimal motion information of the target image block in the motion information list, and transmitting the optimal motion information to the coding unit; the coding unit, configured to acquire the optimal motion information from the selection unit, and according to the optimal motion information, The target image block is encoded to generate a target code stream, the target code stream including first index information indicating a location of the optimal motion information in the motion information list.

在一种可能的实施方式中, 该获取单元具体用于根据该基本层图像块包 括的与该目标图像块中包含的目标图像子块对应的基本层图像子块的运动 信息, 确定该目标图像子块的运动信息, 其中, 该目标图像块子块具有预先 设定的大小; 用于根据该目标图像子块的运动信息, 确定该第一运动信息。  In a possible implementation, the acquiring unit is specifically configured to determine the target image according to motion information of a base layer image sub-block corresponding to the target image sub-block included in the target image block included in the base layer image block. The motion information of the sub-block, wherein the target image block sub-block has a preset size; and is configured to determine the first motion information according to the motion information of the target image sub-block.

结合第三方面和第一种可能的实施方式, 在第二种可能的实施方式中, 该目标图像块包括至少两个目标图像子块, 以及该获取单元具体用于当与该 至少两个目标图像子块中的第一目标图像子块相对应的第一基本层图像子 块的运动信息为空时, 根据该目标图像块的大小、 该目标图像子块的大小和 用于指示该第一目标图像子块在该目标图像块中的位置的第二索引信息,确 定该至少两个目标图像子块中的第二目标图像子块; 用于根据该第二目标图 像子块的运动信息, 确定该第一目标图像子块的运动信息; 用于根据该第一 目标图像子块的运动信息, 确定该第一运动信息; 或用于根据该第二目标图 像子块的运动信息, 确定该第一运动信息; 或用于根据该第一目标图像子块 的运动信息以及第二目标图像子块的运动信息, 确定该第一运动信息。  With reference to the third aspect and the first possible implementation manner, in a second possible implementation manner, the target image block includes at least two target image sub-blocks, and the acquiring unit is specifically configured to be used with the at least two targets And when the motion information of the first base layer image sub-block corresponding to the first target image sub-block in the image sub-block is empty, according to the size of the target image block, the size of the target image sub-block, and the first Determining, by the second index information of the position of the target image sub-block in the target image block, a second target image sub-block of the at least two target image sub-blocks; for using motion information of the second target image sub-block, Determining the motion information of the first target image sub-block; determining the first motion information according to the motion information of the first target image sub-block; or determining, according to the motion information of the second target image sub-block, determining the The first motion information is used to determine the first motion information according to the motion information of the first target image sub-block and the motion information of the second target image sub-block.

结合第三方面、 第一种可能的实施方式和第二种可能的实施方式, 在第 三种可能的实施方式中, 该获取单元具体用于根据以下任一公式, 确定该第 二目标图像子块,  With reference to the third aspect, the first possible implementation, and the second possible implementation, in a third possible implementation, the acquiring unit is specifically configured to determine the second target image according to any one of the following formulas. Piece,

Idx2 %N / (N / 2)) χ 2 + (l - Idx, %N / (N / 4) %2)) x N / 4;Idx 2 %N / (N / 2)) χ 2 + (l - Idx, %N / (N / 4) %2)) x N / 4;

Idx2

Figure imgf000010_0001
dxx %N/(N/2))x2 + (ldxx %N / (N / 4) %2)) xN/4;Idx 2
Figure imgf000010_0001
Dx x %N/(N/2))x2 + (ldx x %N / (N / 4) %2)) xN/4;

W¾ =/^/NxN + ((l-/ x1 N/(N/2))x2 + (l-/^ N/(N/4) 2))xN/4; 其中, 表示用于指示该第二目标图像子块在该目标图像块中的位置 的第三索引信息, / 表示该第二索引信息, N是根据该目标图像块的大小 和该目标图像子块的大小确定的。 W3⁄4 = /^/NxN + ((l-/ x 1 N/(N/2))x2 + (l-/^ N/(N/4) 2))xN/4; where The third index information of the position of the second target image sub-block in the target image block, / represents the second index information, and N is determined according to the size of the target image block and the size of the target image sub-block.

结合第三方面、 第一种可能的实施方式、 第二种可能的实施方式和第三 种可能的实施方式, 在第四种可能的实施方式中, 该获取单元具体用于如果 该第二目标图像子块的运动信息为空, 则确定该子块的运动信息为零运动信 息。 Combining the third aspect, the first possible implementation manner, the second possible implementation manner, and the third In a fourth possible implementation, the acquiring unit is specifically configured to determine that the motion information of the sub-block is zero motion information if the motion information of the second target image sub-block is empty.

结合第三方面、 第一种可能的实施方式、 第二种可能的实施方式、 第三 种可能的实施方式和第四种可能的实施方式, 在第五种可能的实施方式中, 该获取单元具体用于根据第三目标图像子块的运动信息,确定该第一运动信 息, 其中, 该第三目标图像子块为该目标图像块中位于预设位置的子块, 或 该第三目标图像子块的运动信息在该子块的运动信息中的出现频率最高。  With reference to the third aspect, the first possible implementation manner, the second possible implementation manner, the third possible implementation manner, and the fourth possible implementation manner, in the fifth possible implementation manner, the obtaining unit Specifically, the first motion information is determined according to the motion information of the third target image sub-block, where the third target image sub-block is a sub-block located at a preset position in the target image block, or the third target image. The motion information of the sub-block has the highest frequency of occurrence in the motion information of the sub-block.

结合第三方面、 第一种可能的实施方式、 第二种可能的实施方式、 第三 种可能的实施方式、 第四种可能的实施方式和第五种可能的实施方式, 在第 六种可能的实施方式中, 该获取单元具体用于根据该第三目标图像子块的运 动信息的参考图像、 该目标图像和该目标图像块的参考图像的时域距离关 系, 对该第三目标图像子块的运动信息进行缩放处理; 用于根据该缩放处理 后的第三目标图像子块的运动信息, 确定该第一运动信息。  Combining the third aspect, the first possible implementation manner, the second possible implementation manner, the third possible implementation manner, the fourth possible implementation manner, and the fifth possible implementation manner, in the sixth possibility In an implementation manner, the acquiring unit is specifically configured to: according to a reference image of motion information of the third target image sub-block, a time domain distance relationship between the target image and a reference image of the target image block, to the third target image The motion information of the block is subjected to a scaling process; and is configured to determine the first motion information according to the motion information of the third target image sub-block after the scaling process.

结合第三方面、 第一种可能的实施方式、 第二种可能的实施方式、 第三 种可能的实施方式、 第四种可能的实施方式、 第五种可能的实施方式和第六 种可能的实施方式, 在第七种可能的实施方式中, 该目标图像块包括至少两 个目标图像子块, 以及当该最优信息为该第一运动信息时, 该编码单元还用 于对位于该目标图像子块之间的边界附近的像素进行去块效应滤波处理。  Combining the third aspect, the first possible implementation manner, the second possible implementation manner, the third possible implementation manner, the fourth possible implementation manner, the fifth possible implementation manner, and the sixth possible Embodiments, in a seventh possible implementation manner, the target image block includes at least two target image sub-blocks, and when the optimal information is the first motion information, the coding unit is further configured to be located at the target The pixels near the boundary between the image sub-blocks perform deblocking filtering processing.

结合第三方面、 第一种可能的实施方式、 第二种可能的实施方式、 第三 种可能的实施方式、 第四种可能的实施方式、 第五种可能的实施方式、 第六 种可能的实施方式和第七种可能的实施方式, 在第八种可能的实施方式中, 该第二运动信息包括时间运动信息和空间运动信息, 以及该生成单元具体用 于根据该第一运动信息和该第二运动信息, 确定运动信息列表, 以使该第一 运动信息位于运动信息列表的首位; 或用于根据该第一运动信息和该第二运 动信息,确定运动信息列表,以使该第一运动信息位于运动信息列表的末位; 或用于根据该第一运动信息和该第二运动信息, 确定运动信息列表, 以使该 第一运动信息位于该运动信息列表中的空间运动信息与该时间运动信息之 间。  Combining the third aspect, the first possible implementation manner, the second possible implementation manner, the third possible implementation manner, the fourth possible implementation manner, the fifth possible implementation manner, and the sixth possible Embodiments and a seventh possible implementation manner, in the eighth possible implementation manner, the second motion information includes time motion information and spatial motion information, and the generating unit is specifically configured to use the first motion information and the a second motion information, determining a motion information list such that the first motion information is located at a first position of the motion information list; or for determining a motion information list according to the first motion information and the second motion information, so that the first The motion information is located at the last position of the motion information list; or for determining the motion information list according to the first motion information and the second motion information, so that the first motion information is located in the motion information list and the motion information is Time between motion information.

结合第三方面、 第一种可能的实施方式、 第二种可能的实施方式、 第三 种可能的实施方式、 第四种可能的实施方式、 第五种可能的实施方式、 第六 种可能的实施方式、 第七种可能的实施方式和第八种可能的实施方式, 在第 九种可能的实施方式中, 该第一索引信息包括用于指示该最优运动信息是否 为该第一运动信息的第一符号和用于指示该最优运动信息在该运动列表中 的位置的第二符号, 以及该编码单元具体用于根据第一上下文模型, 对该第 一符号进行算术编码处理; 用于根据第二上下文模型, 对该第二符号进行算 术编码处理, 其中, 该第一上下文模型与该第二上下文模型相异。 With reference to the third aspect, the first possible implementation manner, the second possible implementation manner, the third possible implementation manner, the fourth possible implementation manner, the fifth possible implementation manner, the sixth a possible implementation manner, a seventh possible implementation manner, and an eighth possible implementation manner. In the ninth possible implementation manner, the first index information includes, to indicate whether the optimal motion information is the first a first symbol of motion information and a second symbol indicating a position of the optimal motion information in the motion list, and the encoding unit is specifically configured to perform arithmetic coding processing on the first symbol according to the first context model And performing arithmetic coding processing on the second symbol according to the second context model, where the first context model is different from the second context model.

第四方面, 提供了一种用于图像处理的装置, 该装置包括: 获取单元, 用于根据基本层图像块的运动信息确定目标图像块的第一运动信息, 其中, 该的基本层图像块位于基本层图像中, 该目标图像块位于增强层图像中, 该 的基本层图像与该增强层图像相对应,且该基本图像块在该基本层图像中的 空间位置与该目标图像块在该增强层图像中的空间位置相对应; 用于根据该 增强层图像中与该目标图像块相邻的邻近图像块的运动信息确定该目标图 像块的第二运动信息, 并向生成单元传输该第一运动信息和该第二运动信 息; 生成单元, 用于从该获取单元获取该第一运动信息和该第二运动信息, 并根据该第一运动信息和该第二运动信息, 生成运动信息列表, 以及, 向选 择单元传输该运动信息列表; 确定单元, 用于根据目标码流, 确定用于指示 该最优运动信息在该运动信息列表中的位置的第一索引信息; 解码单元, 用 于从该生成单元获取该运动信息列表, 并根据该确定单元确定的该第一索引 信息, 从该运动信息列表中确定最优运动信息, 根据该最优运动信息, 对该 目标码流进行解码, 以获取该目标图像块。  According to a fourth aspect, an apparatus for image processing is provided, the apparatus comprising: an acquiring unit, configured to determine first motion information of a target image block according to motion information of a base layer image block, where the base layer image block Located in the base layer image, the target image block is located in the enhancement layer image, the base layer image corresponding to the enhancement layer image, and the spatial position of the basic image block in the base layer image and the target image block are in the Corresponding to a spatial position in the enhancement layer image; configured to determine second motion information of the target image block according to motion information of the adjacent image block adjacent to the target image block in the enhancement layer image, and transmit the second motion information to the generating unit a motion information and the second motion information; a generating unit, configured to acquire the first motion information and the second motion information from the acquiring unit, and generate a motion information list according to the first motion information and the second motion information And transmitting the motion information list to the selection unit; determining a unit, configured to determine, according to the target code stream, a first index information indicating a position of the optimal motion information in the motion information list; a decoding unit, configured to acquire the motion information list from the generating unit, and according to the first index information determined by the determining unit, The optimal motion information is determined in the motion information list, and the target code stream is decoded according to the optimal motion information to obtain the target image block.

在一种可能的实施方式中, 该获取单元具体用于根据该基本层图像块包 括的与该目标图像块中包含的目标图像子块对应的基本层图像子块的运动 信息, 确定该目标图像子块的运动信息, 其中, 该目标图像块子块具有预先 设定的大小; 用于根据该目标图像子块的运动信息, 确定该第一运动信息。  In a possible implementation, the acquiring unit is specifically configured to determine the target image according to motion information of a base layer image sub-block corresponding to the target image sub-block included in the target image block included in the base layer image block. The motion information of the sub-block, wherein the target image block sub-block has a preset size; and is configured to determine the first motion information according to the motion information of the target image sub-block.

结合第四方面和第一种可能的实施方式, 在第二种可能的实施方式中, 该目标图像块包括至少两个目标图像子块, 以及该获取单元具体用于当与该 至少两个目标图像子块中的第一目标图像子块相对应的第一基本层图像子 块的运动信息为空时, 根据该目标图像块的大小、 该目标图像子块的大小和 用于指示该第一目标图像子块在该目标图像块中的位置的第二索引信息,确 定该至少两个目标图像子块中的第二目标图像子块; 用于根据该第二目标图 像子块的运动信息, 确定该第一目标图像子块的运动信息; 用于根据该第一 目标图像子块的运动信息, 确定该第一运动信息; 或用于根据该第二目标图 像子块的运动信息, 确定该第一运动信息; 或用于根据该第一目标图像子块 的运动信息以及第二目标图像子块的运动信息, 确定该第一运动信息。 With reference to the fourth aspect and the first possible implementation manner, in a second possible implementation manner, the target image block includes at least two target image sub-blocks, and the acquiring unit is specifically configured to be used with the at least two targets And when the motion information of the first base layer image sub-block corresponding to the first target image sub-block in the image sub-block is empty, according to the size of the target image block, the size of the target image sub-block, and the first Determining, by the second index information of the position of the target image sub-block in the target image block, a second target image sub-block of the at least two target image sub-blocks; for using motion information of the second target image sub-block, Determining motion information of the first target image sub-block; for using the first The motion information of the target image sub-block determines the first motion information; or is used to determine the first motion information according to the motion information of the second target image sub-block; or for the motion according to the first target image sub-block The information and the motion information of the second target image sub-block determine the first motion information.

结合第四方面、 第一种可能的实施方式和第二种可能的实施方式, 在第 三种可能的实施方式中, 该获取单元具体用于根据以下任一公式, 确定该第 二目标图像子块,  With reference to the fourth aspect, the first possible implementation, and the second possible implementation, in a third possible implementation, the acquiring unit is specifically configured to determine the second target image according to any one of the following formulas Piece,

Idx2 %N / (N / 2)) χ 2 + (1 - Idx, %N /(N/4) <¾2)) xN/4; Idx2

Figure imgf000013_0001
dxx %N/(N/2))x2 + (ldxx %N / (N / 4) %2)) xN/4; W¾ =/^/NxN + ((l-/ x1 N/(N/2))x2 + (l-/^ N/(N/4) 2))xN/4; 其中, 表示用于指示该第二目标图像子块在该目标图像块中的位置 的第三索引信息, / 表示该第二索引信息, N是根据该目标图像块的大小 和该目标图像子块的大小确定的。 Idx 2 %N / (N / 2)) χ 2 + (1 - Idx, %N /(N/4) <3⁄42)) xN/4; Idx 2
Figure imgf000013_0001
Dx x %N/(N/2))x2 + (ldx x %N / (N / 4) %2)) xN/4; W3⁄4 =/^/NxN + ((l-/ x 1 N/(N /2))x2 + (l-/^ N/(N/4) 2))xN/4; where represents a third index indicating the position of the second target image sub-block in the target image block Information, / represents the second index information, N is determined according to the size of the target image block and the size of the target image sub-block.

结合第四方面、 第一种可能的实施方式、 第二种可能的实施方式和第三 种可能的实施方式, 在第四种可能的实施方式中, 该获取单元具体用于如果 该第二目标图像子块的运动信息为空, 则确定该子块的运动信息为零运动信 息。  With reference to the fourth aspect, the first possible implementation manner, the second possible implementation manner, and the third possible implementation manner, in a fourth possible implementation manner, the acquiring unit is specifically used if the second target If the motion information of the image sub-block is empty, it is determined that the motion information of the sub-block is zero motion information.

结合第四方面、 第一种可能的实施方式、 第二种可能的实施方式、 第三 种可能的实施方式和第四种可能的实施方式, 在第五种可能的实施方式中, 该获取单元具体用于根据第三目标图像子块的运动信息,确定该第一运动信 息, 其中, 该第三目标图像子块为该目标图像块中位于预设位置的子块, 或 该第三目标图像子块的运动信息在该子块的运动信息中的出现频率最高。  With reference to the fourth aspect, the first possible implementation manner, the second possible implementation manner, the third possible implementation manner, and the fourth possible implementation manner, in the fifth possible implementation manner, the obtaining unit Specifically, the first motion information is determined according to the motion information of the third target image sub-block, where the third target image sub-block is a sub-block located at a preset position in the target image block, or the third target image. The motion information of the sub-block has the highest frequency of occurrence in the motion information of the sub-block.

结合第四方面、 第一种可能的实施方式、 第二种可能的实施方式、 第三 种可能的实施方式、 第四种可能的实施方式和第五种可能的实施方式, 在第 六种可能的实施方式中, 该获取单元具体用于根据该第三目标图像子块的运 动信息的参考图像、 该目标图像和该目标图像块的参考图像的时域距离关 系, 对该第三目标图像子块的运动信息进行缩放处理; 用于根据该缩放处理 后的第三目标图像子块的运动信息, 确定该第一运动信息。  Combining the fourth aspect, the first possible implementation manner, the second possible implementation manner, the third possible implementation manner, the fourth possible implementation manner, and the fifth possible implementation manner, in the sixth possibility In an implementation manner, the acquiring unit is specifically configured to: according to a reference image of motion information of the third target image sub-block, a time domain distance relationship between the target image and a reference image of the target image block, to the third target image The motion information of the block is subjected to a scaling process; and is configured to determine the first motion information according to the motion information of the third target image sub-block after the scaling process.

结合第四方面、 第一种可能的实施方式、 第二种可能的实施方式、 第三 种可能的实施方式、 第四种可能的实施方式、 第五种可能的实施方式和第六 种可能的实施方式, 在第七种可能的实施方式中, 该目标图像块包括至少两 个目标图像子块, 以及当该最优信息为该第一运动信息时, 该解码码单元还 用于对位于该目标图像子块之间的边界附近的像素进行去块效应滤波处理。 结合第四方面、 第一种可能的实施方式、 第二种可能的实施方式、 第三 种可能的实施方式、 第四种可能的实施方式、 第五种可能的实施方式、 第六 种可能的实施方式和第七种可能的实施方式, 在第八种可能的实施方式中, 该第二运动信息包括时间运动信息和空间运动信息, 以及该生成单元具体用 于根据该第一运动信息和该第二运动信息, 确定运动信息列表, 以使该第一 运动信息位于运动信息列表的首位; 或用于根据该第一运动信息和该第二运 动信息,确定运动信息列表,以使该第一运动信息位于运动信息列表的末位; 或用于根据该第一运动信息和该第二运动信息, 确定运动信息列表, 以使该 第一运动信息位于该运动信息列表中的空间运动信息与该时间运动信息之 间。 With reference to the fourth aspect, the first possible implementation manner, the second possible implementation manner, the third possible implementation manner, the fourth possible implementation manner, the fifth possible implementation manner, and the sixth possible In a seventh possible implementation manner, the target image block includes at least two target image sub-blocks, and when the optimal information is the first motion information, the decoding code unit further A deblocking filtering process is performed on pixels located near a boundary between the target image sub-blocks. With reference to the fourth aspect, the first possible implementation manner, the second possible implementation manner, the third possible implementation manner, the fourth possible implementation manner, the fifth possible implementation manner, and the sixth possible Embodiments and a seventh possible implementation manner, in the eighth possible implementation manner, the second motion information includes time motion information and spatial motion information, and the generating unit is specifically configured to use the first motion information and the a second motion information, determining a motion information list such that the first motion information is located at a first position of the motion information list; or for determining a motion information list according to the first motion information and the second motion information, so that the first The motion information is located at the last position of the motion information list; or for determining the motion information list according to the first motion information and the second motion information, so that the first motion information is located in the motion information list and the motion information is Time between motion information.

结合第四方面、 第一种可能的实施方式、 第二种可能的实施方式、 第三 种可能的实施方式、 第四种可能的实施方式、 第五种可能的实施方式、 第六 种可能的实施方式、 第七种可能的实施方式和第八种可能的实施方式, 在第 九种可能的实施方式中,该第一索引信息包括用于指示该最优运动信息是否 为该第一运动信息的第一符号和用于指示该最优运动信息在该运动列表中 的位置的第二符号, 以及该解码单元具体用于根据第一上下文模型, 对该第 一符号进行算术解码处理, 并根据第二上下文模型, 对该第二符号进行算术 解码处理, 以根据该算术解码处理后的第一索引信息, 从该运动信息列表中 确定最优运动信息, 其中, 该第一上下文模型与该第二上下文模型相异。  With reference to the fourth aspect, the first possible implementation manner, the second possible implementation manner, the third possible implementation manner, the fourth possible implementation manner, the fifth possible implementation manner, and the sixth possible Embodiments, a seventh possible implementation manner, and an eighth possible implementation manner. In the ninth possible implementation manner, the first index information includes: used to indicate whether the optimal motion information is the first motion information a first symbol and a second symbol indicating a position of the optimal motion information in the motion list, and the decoding unit is specifically configured to perform an arithmetic decoding process on the first symbol according to the first context model, and according to a second context model, performing an arithmetic decoding process on the second symbol to determine optimal motion information from the motion information list according to the first index information after the arithmetic decoding process, where the first context model and the first context model The two context models are different.

第五方面, 提供了一种用于图像处理的编码器, 其特征在于, 该编码器 包括: 总线; 与该总线相连的处理器; 与该总线相连的存储器; 其中, 该处 理器通过该总线, 调用该存储器中存储的程序, 以用于根据基本层图像块的 运动信息确定目标图像块的第一运动信息, 其中, 该的基本层图像块位于基 本层图像中, 该目标图像块位于增强层图像中, 该的基本层图像与该增强层 图像相对应,且该基本图像块在该基本层图像中的空间位置与该目标图像块 在该增强层图像中的空间位置相对应; 用于根据该增强层图像中与该目标图 像块相邻的邻近图像块的运动信息确定该目标图像块的第二运动信息; 用于 根据该第一运动信息和该第二运动信息, 生成运动信息列表; 用于根据预定 规则从该运动信息列表中确定该目标图像块的最优运动信息; 用于根据该最 优运动信息, 对该目标图像块进行编码, 以生成目标码流, 该目标码流包括 用于指示该最优运动信息在该运动信息列表中的位置的第一索引信息。 在一种可能的实施方式中, 该处理器具体用于根据该基本层图像块包括 的与该目标图像块中包含的目标图像子块对应的基本层图像子块的运动信 息, 确定该目标图像子块的运动信息, 其中, 该目标图像块子块具有预先设 定的大小; 用于根据该目标图像子块的运动信息, 确定该第一运动信息。 According to a fifth aspect, an encoder for image processing is provided, the encoder comprising: a bus; a processor connected to the bus; a memory connected to the bus; wherein the processor passes the bus Retrieving a program stored in the memory for determining first motion information of the target image block according to motion information of the base layer image block, wherein the base layer image block is located in the base layer image, and the target image block is located in the enhanced In the layer image, the base layer image corresponds to the enhancement layer image, and a spatial position of the basic image block in the base layer image corresponds to a spatial position of the target image block in the enhancement layer image; Determining, according to the motion information of the adjacent image block adjacent to the target image block in the enhancement layer image, second motion information of the target image block; and configured to generate a motion information list according to the first motion information and the second motion information And determining, according to a predetermined rule, optimal motion information of the target image block from the motion information list; Optimal motion information, encoding the target image block to generate a target code stream, the target code stream including First index information indicating a location of the optimal motion information in the motion information list. In a possible implementation, the processor is specifically configured to determine the target image according to motion information of a base layer image sub-block corresponding to the target image sub-block included in the target image block included in the base layer image block. The motion information of the sub-block, wherein the target image block sub-block has a preset size; and is configured to determine the first motion information according to the motion information of the target image sub-block.

结合第五方面和第一种可能的实施方式, 在第二种可能的实施方式中, 该目标图像块包括至少两个目标图像子块, 以及该处理器具体用于当与该至 少两个目标图像子块中的第一目标图像子块相对应的第一基本层图像子块 的运动信息为空时, 根据该目标图像块的大小、 该目标图像子块的大小和用 于指示该第一目标图像子块在该目标图像块中的位置的第二索引信息,确定 该至少两个目标图像子块中的第二目标图像子块; 用于根据该第二目标图像 子块的运动信息, 确定该第一目标图像子块的运动信息; 用于根据该第一目 标图像子块的运动信息, 确定该第一运动信息; 或用于根据该第二目标图像 子块的运动信息, 确定该第一运动信息; 或用于根据该第一目标图像子块的 运动信息以及第二目标图像子块的运动信息, 确定该第一运动信息。  With reference to the fifth aspect and the first possible implementation manner, in a second possible implementation manner, the target image block includes at least two target image sub-blocks, and the processor is specifically configured to be used with the at least two targets And when the motion information of the first base layer image sub-block corresponding to the first target image sub-block in the image sub-block is empty, according to the size of the target image block, the size of the target image sub-block, and the first Determining, by the second index information of the position of the target image sub-block in the target image block, a second target image sub-block of the at least two target image sub-blocks; for using motion information of the second target image sub-block, Determining the motion information of the first target image sub-block; determining the first motion information according to the motion information of the first target image sub-block; or determining, according to the motion information of the second target image sub-block, determining the The first motion information is used to determine the first motion information according to the motion information of the first target image sub-block and the motion information of the second target image sub-block.

结合第五方面、 第一种可能的实施方式和第二种可能的实施方式, 在第 三种可能的实施方式中, 该处理器具体用于根据以下任一公式, 确定该第二 目标图像子块,  With reference to the fifth aspect, the first possible implementation, and the second possible implementation, in a third possible implementation, the processor is specifically configured to determine the second target image according to any one of the following formulas Piece,

Idx2 %N / (N / 2)) χ 2 + (1 - Idx, %N /(N/4) <¾2)) xN/4; Idx2

Figure imgf000015_0001
dxx %N/(N/2))x2 + (ldxx %N / (N / 4) %2)) xN/4;Idx 2 %N / (N / 2)) χ 2 + (1 - Idx, %N /(N/4) <3⁄42)) xN/4; Idx 2
Figure imgf000015_0001
Dx x %N/(N/2))x2 + (ldx x %N / (N / 4) %2)) xN/4;

W¾ =/^/NxN + ((l-/ x1 N/(N/2))x2 + (l-/^ N/(N/4) 2))xN/4; 其中, 表示用于指示该第二目标图像子块在该目标图像块中的位置 的第三索引信息, / 表示该第二索引信息, N是根据该目标图像块的大小 和该目标图像子块的大小确定的。 W3⁄4 = /^/NxN + ((l-/ x 1 N/(N/2))x2 + (l-/^ N/(N/4) 2))xN/4; where The third index information of the position of the second target image sub-block in the target image block, / represents the second index information, and N is determined according to the size of the target image block and the size of the target image sub-block.

结合第五方面、 第一种可能的实施方式、 第二种可能的实施方式和第三 种可能的实施方式, 在第四种可能的实施方式中, 该处理器具体用于如果该 第二目标图像子块的运动信息为空, 则确定该子块的运动信息为零运动信 息。  With reference to the fifth aspect, the first possible implementation manner, the second possible implementation manner, and the third possible implementation manner, in a fourth possible implementation manner, the processor is specifically used if the second target If the motion information of the image sub-block is empty, it is determined that the motion information of the sub-block is zero motion information.

结合第五方面、 第一种可能的实施方式、 第二种可能的实施方式、 第三 种可能的实施方式和第四种可能的实施方式, 在第五种可能的实施方式中, 该处理器具体用于根据第三目标图像子块的运动信息, 确定该第一运动信 息, 其中, 该第三目标图像子块为该目标图像块中位于预设位置的子块, 或 该第三目标图像子块的运动信息在该子块的运动信息中的出现频率最高。 With reference to the fifth aspect, the first possible implementation manner, the second possible implementation manner, the third possible implementation manner, and the fourth possible implementation manner, in a fifth possible implementation manner, the processor Specifically, the first motion signal is determined according to the motion information of the third target image sub-block. The third target image sub-block is a sub-block located at a preset position in the target image block, or the motion information of the third target image sub-block has the highest frequency of occurrence in the motion information of the sub-block.

结合第五方面、 第一种可能的实施方式、 第二种可能的实施方式、 第三 种可能的实施方式、 第四种可能的实施方式和第五种可能的实施方式, 在第 六种可能的实施方式中, 该处理器具体用于根据该第三目标图像子块的运动 信息的参考图像、 该目标图像和该目标图像块的参考图像的时域距离关系, 对该第三目标图像子块的运动信息进行缩放处理; 用于根据该缩放处理后的 第三目标图像子块的运动信息, 确定该第一运动信息。  In combination with the fifth aspect, the first possible implementation manner, the second possible implementation manner, the third possible implementation manner, the fourth possible implementation manner, and the fifth possible implementation manner, in the sixth possibility In an embodiment, the processor is specifically configured to: according to a reference image of motion information of the third target image sub-block, a time domain distance relationship between the target image and a reference image of the target image block, to the third target image The motion information of the block is subjected to a scaling process; and is configured to determine the first motion information according to the motion information of the third target image sub-block after the scaling process.

结合第五方面、 第一种可能的实施方式、 第二种可能的实施方式、 第三 种可能的实施方式、 第四种可能的实施方式、 第五种可能的实施方式和第六 种可能的实施方式, 在第七种可能的实施方式中, 该目标图像块包括至少两 个目标图像子块, 以及当该最优信息为该第一运动信息时, 该处理器还用于 对位于该目标图像子块之间的边界附近的像素进行去块效应滤波处理。  Combining the fifth aspect, the first possible implementation manner, the second possible implementation manner, the third possible implementation manner, the fourth possible implementation manner, the fifth possible implementation manner, and the sixth possible Embodiments, in a seventh possible implementation manner, the target image block includes at least two target image sub-blocks, and when the optimal information is the first motion information, the processor is further configured to be located at the target The pixels near the boundary between the image sub-blocks perform deblocking filtering processing.

结合第五方面、 第一种可能的实施方式、 第二种可能的实施方式、 第三 种可能的实施方式、 第四种可能的实施方式、 第五种可能的实施方式、 第六 种可能的实施方式和第七种可能的实施方式, 在第八种可能的实施方式中, 该第二运动信息包括时间运动信息和空间运动信息, 以及该处理器具体用于 根据该第一运动信息和该第二运动信息, 确定运动信息列表, 以使该第一运 动信息位于运动信息列表的首位; 或用于根据该第一运动信息和该第二运动 信息, 确定运动信息列表, 以使该第一运动信息位于运动信息列表的末位; 或用于根据该第一运动信息和该第二运动信息, 确定运动信息列表, 以使该 第一运动信息位于该运动信息列表中的空间运动信息与该时间运动信息之 间。  With reference to the fifth aspect, the first possible implementation manner, the second possible implementation manner, the third possible implementation manner, the fourth possible implementation manner, the fifth possible implementation manner, and the sixth possible Embodiments and a seventh possible implementation manner, in the eighth possible implementation manner, the second motion information includes time motion information and spatial motion information, and the processor is specifically configured to use the first motion information and the a second motion information, determining a motion information list, such that the first motion information is located at a first position of the motion information list; or for determining, according to the first motion information and the second motion information, a motion information list, so that the first The motion information is located at the last position of the motion information list; or for determining the motion information list according to the first motion information and the second motion information, so that the first motion information is located in the motion information list and the motion information is Time between motion information.

结合第五方面、 第一种可能的实施方式、 第二种可能的实施方式、 第三 种可能的实施方式、 第四种可能的实施方式、 第五种可能的实施方式、 第六 种可能的实施方式、 第七种可能的实施方式和第八种可能的实施方式, 在第 九种可能的实施方式中, 该第一索引信息包括用于指示该最优运动信息是否 为该第一运动信息的第一符号和用于指示该最优运动信息在该运动列表中 的位置的第二符号, 以及该处理器具体用于根据第一上下文模型, 对该第一 符号进行算术编码处理; 用于根据第二上下文模型, 对该第二符号进行算术 编码处理, 其中, 该第一上下文模型与该第二上下文模型相异。 第六方面, 提供了一种用于图像处理的解码器, 其特征在于, 该解码器 包括: 总线; 与该总线相连的处理器; 与该总线相连的存储器; 其中, 该处 理器通过该总线, 调用该存储器中存储的程序, 以用于根据基本层图像块的 运动信息确定目标图像块的第一运动信息, 其中, 该的基本层图像块位于基 本层图像中, 该目标图像块位于增强层图像中, 该的基本层图像与该增强层 图像相对应,且该基本图像块在该基本层图像中的空间位置与该目标图像块 在该增强层图像中的空间位置相对应; 用于根据该增强层图像中与该目标图 像块相邻的邻近图像块的运动信息确定该目标图像块的第二运动信息; 用于 根据该第一运动信息和该第二运动信息, 生成运动信息列表; 用于根据目标 码流, 获取用于指示该最优运动信息在该运动信息列表中的位置的第一索引 信息; 用于根据该第一索引信息, 从该运动信息列表中确定最优运动信息, 根据该最优运动信息, 对该目标码流进行解码, 以获取该目标图像块。 With reference to the fifth aspect, the first possible implementation manner, the second possible implementation manner, the third possible implementation manner, the fourth possible implementation manner, the fifth possible implementation manner, and the sixth possible Embodiments, a seventh possible implementation manner, and an eighth possible implementation manner. In the ninth possible implementation manner, the first index information includes: used to indicate whether the optimal motion information is the first motion information a first symbol and a second symbol indicating a position of the optimal motion information in the motion list, and the processor is specifically configured to perform an arithmetic coding process on the first symbol according to the first context model; And performing, according to the second context model, an arithmetic coding process on the second symbol, wherein the first context model is different from the second context model. According to a sixth aspect, a decoder for image processing is provided, the decoder comprising: a bus; a processor connected to the bus; a memory connected to the bus; wherein the processor passes the bus Retrieving a program stored in the memory for determining first motion information of the target image block according to motion information of the base layer image block, wherein the base layer image block is located in the base layer image, and the target image block is located in the enhanced In the layer image, the base layer image corresponds to the enhancement layer image, and a spatial position of the basic image block in the base layer image corresponds to a spatial position of the target image block in the enhancement layer image; Determining, according to the motion information of the adjacent image block adjacent to the target image block in the enhancement layer image, second motion information of the target image block; and configured to generate a motion information list according to the first motion information and the second motion information For obtaining a first line indicating the location of the optimal motion information in the motion information list according to the target code stream The information is used to determine the optimal motion information from the motion information list according to the first index information, and decode the target code stream according to the optimal motion information to obtain the target image block.

在一种可能的实施方式中, 该处理器具体用于根据该基本层图像块包括 的与该目标图像块中包含的目标图像子块对应的基本层图像子块的运动信 息, 确定该目标图像子块的运动信息, 其中, 该目标图像块子块具有预先设 定的大小; 用于根据该目标图像子块的运动信息, 确定该第一运动信息。  In a possible implementation, the processor is specifically configured to determine the target image according to motion information of a base layer image sub-block corresponding to the target image sub-block included in the target image block included in the base layer image block. The motion information of the sub-block, wherein the target image block sub-block has a preset size; and is configured to determine the first motion information according to the motion information of the target image sub-block.

结合第六方面和第一种可能的实施方式, 在第二种可能的实施方式中, 该目标图像块包括至少两个目标图像子块, 以及该处理器具体用于当与该至 少两个目标图像子块中的第一目标图像子块相对应的第一基本层图像子块 的运动信息为空时, 根据该目标图像块的大小、 该目标图像子块的大小和用 于指示该第一目标图像子块在该目标图像块中的位置的第二索引信息,确定 该至少两个目标图像子块中的第二目标图像子块; 用于根据该第二目标图像 子块的运动信息, 确定该第一目标图像子块的运动信息; 用于根据该第一目 标图像子块的运动信息, 确定该第一运动信息; 或用于根据该第二目标图像 子块的运动信息, 确定该第一运动信息; 或用于根据该第一目标图像子块的 运动信息以及第二目标图像子块的运动信息, 确定该第一运动信息。  With reference to the sixth aspect and the first possible implementation manner, in a second possible implementation manner, the target image block includes at least two target image sub-blocks, and the processor is specifically configured to be used with the at least two targets And when the motion information of the first base layer image sub-block corresponding to the first target image sub-block in the image sub-block is empty, according to the size of the target image block, the size of the target image sub-block, and the first Determining, by the second index information of the position of the target image sub-block in the target image block, a second target image sub-block of the at least two target image sub-blocks; for using motion information of the second target image sub-block, Determining the motion information of the first target image sub-block; determining the first motion information according to the motion information of the first target image sub-block; or determining, according to the motion information of the second target image sub-block, determining the The first motion information is used to determine the first motion information according to the motion information of the first target image sub-block and the motion information of the second target image sub-block.

结合第六方面、 第一种可能的实施方式和第二种可能的实施方式, 在第 三种可能的实施方式中, 该处理器具体用于根据以下任一公式, 确定该第二 目标图像子块,  With reference to the sixth aspect, the first possible implementation, and the second possible implementation, in a third possible implementation, the processor is specifically configured to determine the second target image according to any one of the following formulas Piece,

Idx2 + {idx, %N / (N / 2)) x 2 + (l - Idx, %N / (N / 4) %2)) χ N / 4 ;Idx 2 + {idx, %N / (N / 2)) x 2 + (l - Idx, %N / (N / 4) %2)) χ N / 4 ;

Idx2

Figure imgf000017_0001
+ ((l - ldxx %N / (N / 2)) x 2 + {ldxx %N / (N / 4) %2)) x N / 4 ; W¾ =/^/NxN + ((l-/ 1%N/(N/2))x2 + (l-/^%N/(N/4)%2))xN/4; 其中, 表示用于指示该第二目标图像子块在该目标图像块中的位置 的第三索引信息, / 表示该第二索引信息, N是根据该目标图像块的大小 和该目标图像子块的大小确定的。 Idx 2
Figure imgf000017_0001
+ ((l - ldx x %N / (N / 2)) x 2 + {ldx x %N / (N / 4) %2)) x N / 4 ; W3⁄4 = /^/NxN + ((l-/ 1 %N/(N/2))x2 + (l-/^%N/(N/4)%2))xN/4; where The third index information indicating the position of the second target image sub-block in the target image block, / indicates the second index information, and N is determined according to the size of the target image block and the size of the target image sub-block.

结合第六方面、 第一种可能的实施方式、 第二种可能的实施方式和第三 种可能的实施方式, 在第四种可能的实施方式中, 该处理器具体用于如果该 第二目标图像子块的运动信息为空, 则确定该子块的运动信息为零运动信 息。  With reference to the sixth aspect, the first possible implementation manner, the second possible implementation manner, and the third possible implementation manner, in a fourth possible implementation manner, the processor is specifically used if the second target If the motion information of the image sub-block is empty, it is determined that the motion information of the sub-block is zero motion information.

结合第六方面、 第一种可能的实施方式、 第二种可能的实施方式、 第三 种可能的实施方式和第四种可能的实施方式, 在第五种可能的实施方式中, 该处理器具体用于根据第三目标图像子块的运动信息, 确定该第一运动信 息, 其中, 该第三目标图像子块为该目标图像块中位于预设位置的子块, 或 该第三目标图像子块的运动信息在该子块的运动信息中的出现频率最高。  With reference to the sixth aspect, the first possible implementation manner, the second possible implementation manner, the third possible implementation manner, and the fourth possible implementation manner, in a fifth possible implementation manner, the processor Specifically, the first motion information is determined according to the motion information of the third target image sub-block, where the third target image sub-block is a sub-block located at a preset position in the target image block, or the third target image. The motion information of the sub-block has the highest frequency of occurrence in the motion information of the sub-block.

结合第六方面、 第一种可能的实施方式、 第二种可能的实施方式、 第三 种可能的实施方式、 第四种可能的实施方式和第五种可能的实施方式, 在第 六种可能的实施方式中, 该处理器具体用于根据该第三目标图像子块的运动 信息的参考图像、 该目标图像和该目标图像块的参考图像的时域距离关系, 对该第三目标图像子块的运动信息进行缩放处理; 用于根据该缩放处理后的 第三目标图像子块的运动信息, 确定该第一运动信息。  Combining the sixth aspect, the first possible implementation manner, the second possible implementation manner, the third possible implementation manner, the fourth possible implementation manner, and the fifth possible implementation manner, in the sixth possibility In an embodiment, the processor is specifically configured to: according to a reference image of motion information of the third target image sub-block, a time domain distance relationship between the target image and a reference image of the target image block, to the third target image The motion information of the block is subjected to a scaling process; and is configured to determine the first motion information according to the motion information of the third target image sub-block after the scaling process.

结合第六方面、 第一种可能的实施方式、 第二种可能的实施方式、 第三 种可能的实施方式、 第四种可能的实施方式、 第五种可能的实施方式和第六 种可能的实施方式, 在第七种可能的实施方式中, 该目标图像块包括至少两 个目标图像子块, 以及当该最优信息为该第一运动信息时, 该处理器还用于 对位于该目标图像子块之间的边界附近的像素进行去块效应滤波处理。  Combining the sixth aspect, the first possible implementation manner, the second possible implementation manner, the third possible implementation manner, the fourth possible implementation manner, the fifth possible implementation manner, and the sixth possible Embodiments, in a seventh possible implementation manner, the target image block includes at least two target image sub-blocks, and when the optimal information is the first motion information, the processor is further configured to be located at the target The pixels near the boundary between the image sub-blocks perform deblocking filtering processing.

结合第六方面、 第一种可能的实施方式、 第二种可能的实施方式、 第三 种可能的实施方式、 第四种可能的实施方式、 第五种可能的实施方式、 第六 种可能的实施方式和第七种可能的实施方式, 在第八种可能的实施方式中, 该第二运动信息包括时间运动信息和空间运动信息, 以及该处理器具体用于 根据该第一运动信息和该第二运动信息, 确定运动信息列表, 以使该第一运 动信息位于运动信息列表的首位; 或用于根据该第一运动信息和该第二运动 信息, 确定运动信息列表, 以使该第一运动信息位于运动信息列表的末位; 或用于根据该第一运动信息和该第二运动信息, 确定运动信息列表, 以使该 第一运动信息位于该运动信息列表中的空间运动信息与该时间运动信息之 间。 Combining the sixth aspect, the first possible implementation manner, the second possible implementation manner, the third possible implementation manner, the fourth possible implementation manner, the fifth possible implementation manner, and the sixth possible Embodiments and a seventh possible implementation manner, in the eighth possible implementation manner, the second motion information includes time motion information and spatial motion information, and the processor is specifically configured to use the first motion information and the a second motion information, determining a motion information list, such that the first motion information is located at a first position of the motion information list; or for determining, according to the first motion information and the second motion information, a motion information list, so that the first The motion information is located at the last position of the motion information list; Or for determining the motion information list according to the first motion information and the second motion information, so that the first motion information is located between the spatial motion information in the motion information list and the time motion information.

结合第六方面、 第一种可能的实施方式、 第二种可能的实施方式、 第三 种可能的实施方式、 第四种可能的实施方式、 第五种可能的实施方式、 第六 种可能的实施方式、 第七种可能的实施方式和第八种可能的实施方式, 在第 九种可能的实施方式中, 该第一索引信息包括用于指示该最优运动信息是否 为该第一运动信息的第一符号和用于指示该最优运动信息在该运动列表中 的位置的第二符号, 以及该处理器具体用于根据第一上下文模型, 对该第一 符号进行算术解码处理, 并根据第二上下文模型, 对该第二符号进行算术解 码处理, 以根据该算术解码处理后的第一索引信息, 从该运动信息列表中确 定最优运动信息, 其中, 该第一上下文模型与该第二上下文模型相异。  Combining the sixth aspect, the first possible implementation manner, the second possible implementation manner, the third possible implementation manner, the fourth possible implementation manner, the fifth possible implementation manner, and the sixth possible Embodiments, a seventh possible implementation manner, and an eighth possible implementation manner. In the ninth possible implementation manner, the first index information includes: used to indicate whether the optimal motion information is the first motion information a first symbol and a second symbol indicating a position of the optimal motion information in the motion list, and the processor is specifically configured to perform an arithmetic decoding process on the first symbol according to the first context model, and according to a second context model, performing an arithmetic decoding process on the second symbol to determine optimal motion information from the motion information list according to the first index information after the arithmetic decoding process, where the first context model and the first context model The two context models are different.

根据本发明实施例的用于图像处理的方法、 装置编码器和解码器, 在 MERGE或 AMVP等利用邻近图像块的运动信息来确定当前处理的图像块的 运动信息的技术中,通过在运动信息列表中增加根据基本层图像运动信息确 定的第一运动信息, 能够在利用邻近图像块的运动信息来确定当前处理的图 像块的运动信息的同时, 利用基本层图像的运动信息来确定当前处理的图像 块的运动信息, 提高处理效率。 附图说明  A method, an apparatus encoder, and a decoder for image processing according to an embodiment of the present invention, in a technique of determining motion information of a currently processed image block using motion information of a neighboring image block, such as MERGE or AMVP, by using motion information in motion information The first motion information determined according to the base layer image motion information is added to the list, and the motion information of the currently processed image block can be determined by using the motion information of the neighboring image block, and the motion information of the base layer image is used to determine the current processing. The motion information of the image block improves the processing efficiency. DRAWINGS

为了更清楚地说明本发明实施例的技术方案, 下面将对本发明实施例中 所需要使用的附图作筒单地介绍, 显而易见地, 下面所描述的附图仅仅是本 发明的一些实施例, 对于本领域普通技术人员来讲, 在不付出创造性劳动的 前提下, 还可以根据这些附图获得其他的附图。  In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings to be used in the embodiments of the present invention will be briefly described below. Obviously, the drawings described below are only some embodiments of the present invention. Other drawings may also be obtained from those of ordinary skill in the art in view of the drawings.

图 1是根据本发明一实施例的用于图像处理的方法的示意性流程图。 图 2是根据本发明一实施例的指示空间运动信, 的源位置的示意图。 图 3是根据本发明一实施例的指示时间运动信, 的源位置的示意图。 图 4是根据本发明一实施例的子块划分与子块索引的示意图。  1 is a schematic flow chart of a method for image processing according to an embodiment of the present invention. 2 is a schematic diagram of a source location indicating a spatial motion signal, in accordance with an embodiment of the present invention. 3 is a schematic diagram of a source location indicating a time motion signal, in accordance with an embodiment of the present invention. 4 is a schematic diagram of sub-block partitioning and sub-block indexing according to an embodiment of the invention.

图 5 是根据本发明一实施例的用于图像处理的方法的另一示意性流程 图。  Figure 5 is another schematic flow diagram of a method for image processing in accordance with an embodiment of the present invention.

图 6是根据本发明一实施例的用于图像处理的装置的示意性框图。 图 Ί是根据本发明另一实施例的用于图像处理的装置的示意性框图。 图 8是根据本发明一实施例的用于图像处理的编码器的示意性框图。 图 9是根据本发明另一实施例的用于图像处理的解码器的示意性框图。 具体实施方式 Figure 6 is a schematic block diagram of an apparatus for image processing in accordance with an embodiment of the present invention. Figure Ί is a schematic block diagram of an apparatus for image processing according to another embodiment of the present invention. Figure 8 is a schematic block diagram of an encoder for image processing in accordance with an embodiment of the present invention. 9 is a schematic block diagram of a decoder for image processing in accordance with another embodiment of the present invention. detailed description

下面将结合本发明实施例中的附图,对本发明实施例中的技术方案进行 清楚、 完整地描述, 显然, 所描述的实施例是本发明一部分实施例, 而不是 全部的实施例。 基于本发明中的实施例, 本领域普通技术人员在没有作出创 造性劳动前提下所获得的所有其他实施例, 都属于本发明保护的范围。  The technical solutions in the embodiments of the present invention are clearly and completely described in the following with reference to the accompanying drawings in the embodiments of the present invention. It is obvious that the described embodiments are a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments of the present invention without making creative labor are within the scope of the present invention.

根据本发明实施例的用于图像处理的方法、装置和系统能够适用于包括 A method, apparatus, and system for image processing according to embodiments of the present invention can be adapted to include

MERGE或 AMVP等利用邻近图像块的运动信息来确定当前处理的图像块的 运动信息的技术。 A technique of determining motion information of a currently processed image block using motion information of a neighboring image block, such as MERGE or AMVP.

图 1示出了从编码端角度描述的根据本发明实施例的用于图像处理的方 法 100的示意性流程图。 如图 1所示, 该方法 100包括:  Fig. 1 shows a schematic flow chart of a method 100 for image processing according to an embodiment of the present invention, which is described from the perspective of an encoding end. As shown in FIG. 1, the method 100 includes:

S110, 根据基本层图像块的运动信息确定目标图像块的第一运动信息, 其中, 该的基本层图像块位于基本层图像中, 该目标图像块位于增强层图像 中, 该的基本层图像与该增强层图像相对应, 且该基本图像块在该基本层图 像中的空间位置与该目标图像块在该增强层图像中的空间位置相对应; S110. Determine first motion information of the target image block according to motion information of the base layer image block, where the base layer image block is located in the base layer image, where the target image block is located in the enhancement layer image, and the base layer image is The enhancement layer image corresponds to, and a spatial position of the basic image block in the base layer image corresponds to a spatial position of the target image block in the enhancement layer image;

S120,根据该增强层图像中与该目标图像块相邻的邻近图像块的运动信 息确定该目标图像块的第二运动信息; S120. Determine, according to motion information of a neighboring image block adjacent to the target image block in the enhancement layer image, second motion information of the target image block.

S130, 根据该第一运动信息和该第二运动信息, 生成运动信息列表; S130. Generate a motion information list according to the first motion information and the second motion information.

S140,根据预定规则从该运动信息列表中确定该目标图像块的最优运动 信息。 S140. Determine optimal motion information of the target image block from the motion information list according to a predetermined rule.

S150, 根据该最优运动信息, 对该目标图像块进行编码, 以生成目标码 流, 该目标码流包括用于指示该最优运动信息在该运动信息列表中的位置的 第一索引信息  S150. Encode the target image block according to the optimal motion information to generate a target code stream, where the target code stream includes first index information indicating a location of the optimal motion information in the motion information list.

具体地说, 在对图像进行分层编码, 例如, 在空间可伸缩编码时, 可以 将图像进行将分辨率处理得到低分辨率图像,作为对比将原图像称作高分辨 率图像, 编码器分别对该低分辨率图像以及该高分辨率图像进行编码。 为方 便描述, 本文中将质量高的待编码图像称作增强层图像, 将对应的质量低的 待编码图像(例如所述低分辨率图像)称作基本层图像。 在本发明实施例中, 目标图像是使用分层编码技术进行处理的图像, 基 本层是指分层编码中的质量(包括帧速率、 空间分辨率、 时间分辨率、 信噪 比强度或质量等级等参数)较低的层, 增强层是指分层编码中的质量(包括 帧速率、 空间分辨率、 时间分辨率、 信噪比强度或质量等级等参数)较高的 层。 需要说明的是, 在本发明实施例中, 在本发明实施例中, 对于一个给定 的增强层, 与其相对应的基本层可以为质量低于该增强层的任一层, 例如, 如果当前存在五层, 编码质量依次提高 (即, 第一层质量最低, 第五层质量 最高), 如果增强层为第四层, 则基本层可以是第一层, 也可以是第二层、 也可以是第三层、 也可以是第四层。 同理, 对于一个给定的基本层, 与其相 对应的增强层可以为质量低于该基本层的任一层。 Specifically, when the image is hierarchically encoded, for example, in spatial scalable coding, the image may be subjected to resolution processing to obtain a low-resolution image, and the original image is referred to as a high-resolution image as a contrast, respectively. The low resolution image and the high resolution image are encoded. For convenience of description, a high quality image to be encoded is referred to herein as an enhancement layer image, and a corresponding low quality image to be encoded (eg, the low resolution image) is referred to as a base layer image. In the embodiment of the present invention, the target image is an image processed by a layered coding technique, and the basic layer refers to a quality in layered coding (including frame rate, spatial resolution, temporal resolution, signal to noise ratio intensity or quality level). The lower layer, the enhancement layer refers to the layer with higher quality (including frame rate, spatial resolution, temporal resolution, signal-to-noise ratio intensity or quality level) in the layered coding. It should be noted that, in the embodiment of the present invention, in the embodiment of the present invention, for a given enhancement layer, the corresponding base layer may be any layer lower in quality than the enhancement layer, for example, if currently There are five layers, and the coding quality is sequentially improved (that is, the first layer has the lowest quality and the fifth layer has the highest quality). If the enhancement layer is the fourth layer, the base layer may be the first layer or the second layer. It is the third layer or the fourth layer. Similarly, for a given base layer, the corresponding enhancement layer can be any layer of lower quality than the base layer.

增强层图像为当前处理的增强层中的图像,基本层图像为基本层中与增 强层图像在同一时刻的图像。  The enhancement layer image is the image in the currently processed enhancement layer, and the base layer image is the image in the base layer at the same time as the enhancement layer image.

综上所述, 在本发明实施例中, 该基本层图像的质量低于该增强层图像 的质量。  In summary, in the embodiment of the present invention, the quality of the base layer image is lower than the quality of the enhancement layer image.

目标图像块为该增强层图像中正在处理的图像块。  The target image block is the image block being processed in the enhancement layer image.

基本层图像块为基本层图像中与该目标图像块在空间位置上存在对应 关系的图像块。  The base layer image block is an image block in the base layer image that has a corresponding relationship with the target image block in spatial position.

在本发明实施例中,基本层图像块与目标图像块的对应关系可以根据基 本层图像与增强层图像之间的分辨率比例关系计算得到。 例如, 在包括 X方 向和 y方向的系统内,如果增强层图像在 X方向与 y方向的分辨率分别是基 本层图像的 2倍, 则对于增强层中左上角的像素坐标为 (2x, 2y )且大小为 ( 2m ) X ( 2n )的图像块, 其基本层图像中的对应块可以是左上角的像素坐 标为 (X , y )且大小为 m x n的图像块。  In the embodiment of the present invention, the correspondence between the base layer image block and the target image block may be calculated according to the resolution proportional relationship between the base layer image and the enhancement layer image. For example, in a system including the X direction and the y direction, if the resolution of the enhancement layer image in the X direction and the y direction is twice that of the base layer image, respectively, the pixel coordinates of the upper left corner in the enhancement layer are (2x, 2y). And an image block of size (2m) X ( 2n ), the corresponding block in the base layer image may be an image block whose pixel coordinates are (X , y ) and whose size is mxn in the upper left corner.

在本发明实施例中, 后述子块是指目标图像块的子块(增强层内的图像 块), 后述对应子块是指该子块的在基本层中的基本层图像块(属于上述对 应块)。  In the embodiment of the present invention, a sub-block described later refers to a sub-block of the target image block (an image block in the enhancement layer), and a corresponding sub-block described later refers to a base layer image block in the base layer of the sub-block (belonging to The corresponding block above).

在本发明实施例中, 运动信息可以包括预测方向、 参考图像索引或运动 矢量中的一个或多个, 其中, 预测方向可分为单向和双向预测, 单向预测又 可以分为前向预测与后向预测, 前向预测指使用前向参考图像列表, 即列表 ( list ) 0中的参考图像产生预测信号, 后向预测指使用后向参考图像列表, 即 list 1中的参考图像产生预测信号, 双向预测指同时使用 list 0和 list 1中 的参考图像产生预测信号;对于单向预测,需要一个参考图像索引指示在 list 0或 list l中所选择的参考图像, 对于双向预测, 需要两个参考图像索引, 分 别指示在 list 0与 list 1中所选择的参考图像; 每一个运动矢量包括水平方向 分量 X和竖直方向分量 y , 可记作(X , y ) , 对于单向预测, 需要一个运动矢 量指示预测信号在所选择的 list 0或 list 1参考图像中的位移,对于双向预测, 需要两个运动矢量,分别指示前向预测信号与后向预测信号在所选择的 list O 参考图像与 list 1参考图像中的位移。 In the embodiment of the present invention, the motion information may include one or more of a prediction direction, a reference image index, or a motion vector, where the prediction direction may be divided into one-way and two-way prediction, and the one-way prediction may be further divided into forward prediction. With backward prediction, forward prediction refers to the use of a forward reference picture list, ie, a reference picture in list 0 to generate a prediction signal, and backward prediction refers to using a backward reference picture list, ie, a reference picture in list 1 to generate a prediction. Signal, bidirectional prediction means using both list 0 and list 1 The reference image produces a prediction signal; for unidirectional prediction, a reference image index is required to indicate the reference image selected in list 0 or list l, and for bidirectional prediction, two reference image indices are required, respectively indicated in list 0 and list 1 The reference image selected in each; each motion vector includes a horizontal direction component X and a vertical direction component y, which can be recorded as (X, y). For unidirectional prediction, a motion vector is required to indicate the prediction signal in the selected list 0. Or the displacement in the list 1 reference image, for bidirectional prediction, two motion vectors are needed to indicate the displacement of the forward prediction signal and the backward prediction signal in the selected list O reference image and the list 1 reference image, respectively.

在本发明实施例中, 第二运动信息是指从该目标图像块的邻近图像块 (增强层图像的图像块) 中获取的运动信息。 在本发明实施例中, 该第二运 动信息可以包括空间运动信息和时间运动信息, 空间运动信息是从增强层图 像中的空间邻近块获取的运动信息, 时间运动信息是指从增强层图像的参考 图像中的时间邻近块获取的运动信息。 在本发明实施例中, 在 S120中获取 该第二运动信息的方法可以列举, 以下方法, 即  In the embodiment of the present invention, the second motion information refers to motion information acquired from a neighboring image block (an image block of the enhancement layer image) of the target image block. In the embodiment of the present invention, the second motion information may include spatial motion information, which is motion information acquired from spatial neighboring blocks in the enhancement layer image, and time motion information refers to images from the enhancement layer. The motion information acquired by the temporal neighboring block in the reference image. In the embodiment of the present invention, the method for obtaining the second motion information in S120 may be enumerated by the following method, that is,

方法 1  method 1

编码端和解码端可以设定一个预设值(例如, 2 ), 该预设值表示第二运 动信息的数量(例如, 两个)。 图 2示出了空间运动信息的源位置 (获取位 置), 图 3示出了时间运动信息的源位置(获取位置)。 如图 2或图 3所示, 在确定第二运动信息时, 首先从 A、 B、 C三类位置分别获取一个运动信息, 其中 A类位置包括 AO和 A1两个位置, B类位置包括 B0、 Bl、 B2三个位 置, C类位置包括 RB (右下)和 Cer (中心) 两个位置。 从图 3中的 C类 位置获取运动信息指从目标图像块的参考图像中与 C 类位置对应的位置获 取运动信息。 然后, 从已获取的运动信息中去除重复的运动信息。 如果去除 重复的候选运动信息之后仍然有三个运动信息, 则选择前两个运动信息作为 候选运动信息; 如果去除重复的候选运动信息之后的运动信息数量不足两 个, 则增加零运动信息, 例如, 在预测编码图像帧 (P帧) 中, 零运动信息 的预测方向为单向预测, 参考图像索引为 0, 运动矢量(0, 0 )。 在双向预测 编码图像帧 (B帧) 中, 零运动信息的预测方向为双向预测, 两个参考图像 索引均为 0, 两个运动矢量均为(0, 0 ), 以保证最终候选运动信息的数量为 两个。  The encoding end and the decoding end can set a preset value (for example, 2) indicating the number of second motion information (for example, two). Fig. 2 shows the source position (acquisition position) of the spatial motion information, and Fig. 3 shows the source position (acquisition position) of the temporal motion information. As shown in FIG. 2 or FIG. 3, when determining the second motion information, first, one motion information is respectively obtained from the three types of positions A, B, and C, wherein the class A position includes two positions of AO and A1, and the class B position includes B0. , Bl, B2 three positions, C class position includes RB (bottom right) and Cer (center) two positions. Obtaining motion information from the class C position in Fig. 3 means obtaining motion information from a position corresponding to the class C position in the reference image of the target image block. Then, the repeated motion information is removed from the acquired motion information. If there are still three motion information after removing the repeated candidate motion information, the first two motion information is selected as the candidate motion information; if the number of motion information after the repeated candidate motion information is removed is less than two, the zero motion information is added, for example, In the predictive coded picture frame (P frame), the prediction direction of the zero motion information is unidirectional prediction, and the reference picture index is 0, the motion vector (0, 0). In the bidirectionally predictive coded image frame (B frame), the prediction direction of the zero motion information is bidirectional prediction, both reference image indexes are 0, and both motion vectors are (0, 0) to ensure the final candidate motion information. The number is two.

方法 2  Method 2

编码端和解码端可以设定一个预设值(例如, 5 ), 该预设值表示第二运 动信息的数量(例如, 五个)。 图 2示出了空间运动信息的源位置 (获取位 置), 图 3示出了时间运动信息的源位置(获取位置)。 从图 3中的 C类位置 获取运动信息指从目标图像块的参考图像中与 C 类位置对应的位置获取运 动信息。 如图 2或图 3所示, 在五个运动信息中, 包含最多四个空间运动信 息和一个时间运动信息。 在确定 MERGE候选运动信息的过程中, 如果从所 有源位置获取的不重复的运动信息数量不足五个, 则会按一定方法构造得到 的双向预测运动信息或零运动信息, 以保证候选运动信息数量为五个。 以下 省略相同或相似情况的说明。 The encoding end and the decoding end can set a preset value (for example, 5), and the preset value indicates the second transport The amount of information (for example, five). Fig. 2 shows the source position (acquisition position) of the spatial motion information, and Fig. 3 shows the source position (acquisition position) of the time motion information. Acquiring motion information from the class C position in FIG. 3 means acquiring motion information from a position corresponding to the class C position in the reference image of the target image block. As shown in FIG. 2 or FIG. 3, among the five pieces of motion information, up to four pieces of spatial motion information and one time motion information are included. In the process of determining the MERGE candidate motion information, if the number of non-repetitive motion information acquired from all source locations is less than five, the bidirectional prediction motion information or zero motion information is constructed according to a certain method to ensure the number of candidate motion information. For five. Descriptions of the same or similar cases are omitted below.

下面, 主要对在 S110 中编码端设备获取目标图像块的第一运动信息进 行描述。  In the following, the first motion information of the target image block obtained by the encoding end device in S110 is mainly described.

在 S110 中, 编码端设备可以获取该目标图像块的基本层图像块包括的 运动信息, 并根据该基本层图像块包括的运动信息, 确定第一运动信息。  In S110, the encoding end device may acquire motion information included in the base layer image block of the target image block, and determine the first motion information according to the motion information included in the base layer image block.

可选地, 在本发明实施例中, 该根据基本层图像块的运动信息确定目标 图像块的第一运动信息包括:  Optionally, in the embodiment of the present invention, determining the first motion information of the target image block according to the motion information of the base layer image block includes:

根据该基本层图像块包括的与该目标图像块中包含的目标图像子块对 应的基本层图像子块的运动信息, 确定该目标图像子块的运动信息, 其中, 该目标图像块子块具有预先设定的大小;  Determining motion information of the target image sub-block according to motion information of the base layer image sub-block corresponding to the target image sub-block included in the target image block, wherein the target image block sub-block has Pre-set size;

根据该目标图像子块的运动信息, 确定该第一运动信息。  The first motion information is determined according to motion information of the target image sub-block.

具体地说, 在本发明实施例中, 目标图像块可以看作由至少两个子块 (即, 目标图像子块)构成的, 其中, 该子块的大小可以根据预设值确定, 为了便于说明, 以下, 以子块大小为 4 x 4为例进行说明。 例如, 如果目标 图像块的大小为 16 x 16, 则可以确定该目标图像块包括 16个子块(大小为 4 x 4 )。 从而, 在本发明实施例中, 可以确定该目标图像块中的每一个子块 在基本层中的对应子块(属于该基本层图像块), 并确定该对应子块的运动 信息。  Specifically, in the embodiment of the present invention, the target image block may be configured by at least two sub-blocks (ie, target image sub-blocks), wherein the size of the sub-block may be determined according to a preset value, for convenience of description. In the following, the sub-block size is 4 x 4 as an example. For example, if the size of the target image block is 16 x 16, it can be determined that the target image block includes 16 sub-blocks (size 4 x 4). Therefore, in the embodiment of the present invention, a corresponding sub-block in the basic layer (belonging to the base layer image block) of each sub-block in the target image block may be determined, and motion information of the corresponding sub-block is determined.

可选地, 该根据该基本层图像块包括的与该目标图像块中包含的目标图 像子块对应的基本层图像子块的运动信息, 确定该目标图像子块的运动信 息, 包括:  Optionally, determining the motion information of the target image sub-block according to the motion information of the base layer image sub-block corresponding to the target image sub-block included in the target image block that is included in the base layer image block, including:

当与第一目标图像子块相对应的第一基本层图像子块的运动信息为非 空时, 将该第一基本层图像子块的运动信息, 作为该第一目标图像子块的运 动信息。 具体地说, 可以根据所择的子块(第一目标图像子块) 中的某一像素点 的坐标(记作: "(Ex,Ey)" ), 确定该像素点在基本层图像中对应位置的坐标 (记作: "( 并将包含所属对应的位置坐标的基本层图像块作为对 应子块(第一基本层图像子块)。 在本发明实施例中, 可以按照以下式 1和 式 2

Figure imgf000024_0001
When the motion information of the first base layer image sub-block corresponding to the first target image sub-block is non-empty, the motion information of the first base layer image sub-block is used as the motion information of the first target image sub-block . Specifically, the pixel may be determined in the base layer image according to the coordinates of a certain pixel point in the selected sub-block (the first target image sub-block) (referred to as: "(E x , E y )") The coordinates of the corresponding position (denoted as "() and the base layer image block containing the corresponding position coordinates is taken as the corresponding sub-block (the first base layer image sub-block). In the embodiment of the present invention, the following formula 1 can be used. And formula 2
Figure imgf000024_0001

E xD +R  E xD +R

B = Round (2)  B = Round (2)

2s— 其中, Ro O表示截断小数部分的操作, 和 表示偏移量, 可以按 照以下式 3计算得到 Rx , 按照以下式 4计算得到 Ry 2 s — where Ro O represents the operation of truncating the fractional part, and represents the offset, R x can be calculated according to the following formula 3, and R y is calculated according to the following formula 4

RX =T 5 (3) R X =T 5 (3)

Ry = 2s- 5 ( 4 ) R y = 2 s - 5 ( 4 )

其中, S是精度控制因子(例如, 在本发明实施例, 可以设置为 16), 可以按照以下式 5计算得到 Dr , 按照以下式 6计算得到 Dy Wherein, S is an accuracy control factor (for example, in the embodiment of the present invention, it can be set to 16), and D r can be calculated according to the following formula 5, and D y is calculated according to the following formula 6

T^BaseWidth  T^BaseWidth

Dv = Round (5) D v = Round (5)

ScaledBaseWidth  ScaledBaseWidth

T * BaseHeight T * BaseHeight

D = Round (6)  D = Round (6)

ScaledBaseHeight 其中, ^表示基本层图像的宽, BiweH gfe表示基本层图像的高, ScaledBaseWidth表示增强层图像的宽, 以及 ScaledBaseHeight表示增强层图像的 高。  ScaledBaseHeight where ^ represents the width of the base layer image, BiweH gfe represents the height of the base layer image, ScaledBaseWidth represents the width of the enhancement layer image, and ScaledBaseHeight represents the height of the enhancement layer image.

从而, 可以确定该对应子块, 并且, 在该对应子块包括运动信息的情况 下, 可以直接使用该运动信息中的预测方向和参考图像索引作为该子块(第 一目标图像子块) 的预测方向与参考图象索引。 可以根据以下式 7至式 10, 对该对应子块的运动矢量 ( Μνχ,βΜ^进行缩放, 并将缩放后的运动矢量作 为该子块(第一目标图像子块) 的运动矢量 (EMVx,EMV^。 Thereby, the corresponding sub-block can be determined, and in the case where the corresponding sub-block includes motion information, the prediction direction and the reference image index in the motion information can be directly used as the sub-block (first target image sub-block) Prediction direction and reference image index. The motion vector ( Μν χ , βΜ^ of the corresponding sub-block may be scaled according to the following Equations 7 to 10, and the scaled motion vector is used as the motion vector (EMV) of the sub-block (the first target image sub-block). x , EMV^.

EMVx = (BMVx x ScaledBaseWidth + RBW)/ BaseWidth ( 7 ) EMV x = (BMV x x ScaledBaseWidth + R BW ) / BaseWidth ( 7 )

EMVy = (BMVy x ScaledBaseHeight + RBH ) I BaseHeight ( 8 ) EMV y = (BMV y x ScaledBaseHeight + R BH ) I BaseHeight ( 8 )

RBW = sgn(BMVx ) * BaseWidth 12 ( 9 ) R BW = sgn(BMV x ) * BaseWidth 12 ( 9 )

RBH = sgn(BMVy ) * BaseHeight 12 ( 10) 其中, sgn(x)是符号函数, 可以获取 x的符号。 R BH = sgn(BMV y ) * BaseHeight 12 ( 10) Where sgn(x) is a symbolic function and the sign of x can be obtained.

这里, 需要说明的是, 如果基本层图像与增强层图像的分辨率相同, 则 无需进行上述的缩放操作, 而可以直接使用对应子块的运动信息作为子块的 运动信息。  Here, it should be noted that if the resolution of the base layer image and the enhancement layer image are the same, the above-described scaling operation is not required, and the motion information of the corresponding sub-block can be directly used as the motion information of the sub-block.

应理解, 在本发明实施例中, 也可以不确定子块, 而直接采用以上方法 获取目标图像块的运动信息。 即, 可以认为目标图像块仅包括一个子块(该 子块大小与目标图像块相同)。 此时, 可以采用与上述同样的方法获取目标 图像块的运动信息。 并且, 如果目标图像块(或者说, 目标图像块包括的唯 一的子块)不存在运动信息, 则使用零运动信息作为该子块的运动信息。 在 本发明实施例中, 可以按照以下方法构造零运动信息。 例如, 在预测编码图 像帧 (P帧) 中, 零运动信息的预测方向为单向预测, 参考图像索引为 0, 运动矢量(0, 0 )。 在双向预测编码图像帧 (B 帧) 中, 零运动信息的预测 方向为双向预测, 两个参考图像索引均为 0, 两个运动矢量均为 (0, 0 )。  It should be understood that, in the embodiment of the present invention, the sub-block may also be indeterminate, and the motion information of the target image block is directly obtained by using the above method. That is, it can be considered that the target image block includes only one sub-block (the sub-block size is the same as the target image block). At this time, the motion information of the target image block can be acquired in the same manner as described above. And, if the target image block (or the only sub-block included in the target image block) does not have motion information, zero motion information is used as the motion information of the sub-block. In the embodiment of the present invention, zero motion information can be constructed in the following manner. For example, in a predictive coded picture frame (P frame), the prediction direction of the zero motion information is unidirectional prediction, and the reference picture index is 0, motion vector (0, 0). In the bidirectionally predictive coded picture frame (B frame), the prediction direction of the zero motion information is bidirectional prediction, both reference picture indices are 0, and both motion vectors are (0, 0).

可选地, 在本发明实施例中, 该方法还包括:  Optionally, in the embodiment of the present invention, the method further includes:

根据所述基本层图像的编码模式,确定与第一目标图像子块相对应的第 一基本层图像子块是否包括运动信息。  Based on the encoding mode of the base layer image, it is determined whether the first base layer image sub-block corresponding to the first target image sub-block includes motion information.

具体地说, 在本发明实施例中, 可以根据所述基本层图像(或者说, 基 本层图像块)的编码模式确定该对应子块是否包含有运动信息。 例如, 如果 基本层图像使用帧内预测编码模式, 则可以确定该对应子块不包含运动信息 (即, 第一基本层图像子块的运动信息为空)。  Specifically, in the embodiment of the present invention, whether the corresponding sub-block contains motion information may be determined according to an encoding mode of the base layer image (or the basic layer image block). For example, if the base layer image uses the intra prediction coding mode, it may be determined that the corresponding sub-block does not contain motion information (i.e., the motion information of the first base layer image sub-block is empty).

从而, 在该对应子块包括运动信息时, 可以按如上所述过程确定该对应 子块并获取其运动信息, 在该对应子块不包括运动信息时, 可以跳过以上流 程。  Therefore, when the corresponding sub-block includes motion information, the corresponding sub-block may be determined according to the process as described above and its motion information may be acquired. When the corresponding sub-block does not include motion information, the above process may be skipped.

在对应子块不包括运动信息的情况下。可以基于该对应子块的相邻块的 运动信息来确定所述子块的运动信息。 即, 可选地, 该目标图像块包括至少 两个目标图像子块, 以及  In the case where the corresponding sub-block does not include motion information. The motion information of the sub-block may be determined based on motion information of neighboring blocks of the corresponding sub-block. That is, optionally, the target image block includes at least two target image sub-blocks, and

该根据该基本层图像块包括的与该目标图像块中包含的目标图像子块 对应的基本层图像子块的运动信息,确定该目标图像子块的运动信息,包括: 当与该至少两个目标图像子块中的第一目标图像子块相对应的第一基 本层图像子块的运动信息为空时, 根据该目标图像块的大小、 该目标图像子 块的大小和用于指示该第一目标图像子块在该目标图像块中的位置的第二 索引信息, 确定该至少两个目标图像子块中的第二目标图像子块; Determining motion information of the target image sub-block according to the motion information of the base layer image sub-block corresponding to the target image sub-block included in the target image block, including: at least two And when the motion information of the first base layer image sub-block corresponding to the first target image sub-block in the target image sub-block is empty, according to the size of the target image block, the size of the target image sub-block, and the indication a second position of a target image sub-block in the target image block Index information, determining a second target image sub-block in the at least two target image sub-blocks;

根据该第二目标图像子块的运动信息,确定该第一目标图像子块的运动 信息;  Determining motion information of the first target image sub-block according to the motion information of the second target image sub-block;

对应,该根据该目标图像子块的运动信息,确定该第一运动信息, 包括: 根据该第一目标图像子块的运动信息, 确定该第一运动信息; 或 根据该第二目标图像子块的运动信息, 确定该第一运动信息; 或 根据该第一目标图像子块的运动信息以及第二目标图像子块的运动信 息, 确定该第一运动信息。  Corresponding, determining the first motion information according to the motion information of the target image sub-block, comprising: determining the first motion information according to the motion information of the first target image sub-block; or according to the second target image sub-block The motion information determines the first motion information; or determines the first motion information according to the motion information of the first target image sub-block and the motion information of the second target image sub-block.

具体地说, 不失一般性, 例如, 如果目标图像块的大小为 16 x 16 , 子块 的大小为 4 x 4 ,在本发明实施例中,子块的索引分配方法可以与现有技术相 同, 这里, 省略其说明, 图 4所示了子块的划分与索引。  Specifically, without loss of generality, for example, if the size of the target image block is 16 x 16 and the size of the sub-block is 4 x 4, in the embodiment of the present invention, the index allocation method of the sub-block may be the same as the prior art. Here, the description thereof is omitted, and the division and indexing of the sub-blocks are shown in FIG.

在本发明实施例中, 可以根据目标图像块的大小和子块的大小, 确定处 理层次, 并按处理层次逐层递推处理。 例如, 在本发明实施例中, 可以规定 最底层的层次(记作, 第一层) 中的每个处理单元(记作, 第一处理单元) 包括四个子块, 第一层的上一层次(记作第二层) 的每个处理单元(记作, 第二处理单元) 包括四个第一处理单元, 以此类推, 为了避免赘述, 省略递 推说明。 从而, 作为示例而非限定, 在图 4所示的目标图像块中, 可以包括 两个层次, 第一层中, 子块 0~子块 3构成了第一处理单元 0 , 子块 4~子块 7 构成了第一处理单元 1 , 子块 8~子块 11构成了第一处理单元 2 , 子块 12~子 块 15构成了第一处理单元 3。 第二层中, 第一处理单元 0~第一处理单元 3 构成了第二处理单元 0。应理解, 以上列举的层次划分方法仅为示例性说明, 本发明并不限定于此。  In the embodiment of the present invention, the processing level may be determined according to the size of the target image block and the size of the sub-block, and the processing layer is recursively layer by layer according to the processing level. For example, in the embodiment of the present invention, each processing unit (referred to as the first processing unit) in the lowest level hierarchy (referred to as the first layer) may be defined to include four sub-blocks, the previous layer of the first layer. Each processing unit (referred to as the second layer) (denoted as the second layer) includes four first processing units, and so on, in order to avoid redundancy, the recursive description is omitted. Thus, by way of example and not limitation, in the target image block shown in FIG. 4, two levels may be included. In the first layer, sub-block 0~sub-block 3 constitute the first processing unit 0, and the sub-block 4~sub The block 7 constitutes the first processing unit 1, the sub-block 8~sub-block 11 constitutes the first processing unit 2, and the sub-block 12~sub-block 15 constitutes the first processing unit 3. In the second layer, the first processing unit 0 to the first processing unit 3 constitute the second processing unit 0. It should be understood that the above-described hierarchical division method is merely illustrative, and the present invention is not limited thereto.

在本发明实施例中, 对于每一个第一处理单元, 可以按照子块的索引号 (例如, 从小到大)依次判定各子块的运动信息是否为空, 如果该子块的运 动信息为空, 则可以基于该第一处理单元内与其相邻的子块(第二目标图像 子块的一例)的运动信息确定其运动信息。 例如, 如果索引为 0的子块(即, 子块 0 , 属于第一处理单元 0 ) 的运动信息为空, 可以获取属于同一个处理 单元(第一处理单元 0 ) 内其他子块的运动信息, 并将该运动信息作为该子 块 0的运动信息。 获取顺序可以为, 例如, 首先获取索引为 1的子块(子块 1 , 即, 第二目标图像子块的一例, 在水平方向上与子块 0相邻) 的运动信 息, 如果子块 1的运动信息为空, 则可以再获取索引为 2 (子块 2 , 即, 第 二目标图像子块的另一例,在竖直方向上与子块 0相邻)的子块的运动信息, 如果子块 2的运动信息为空, 则可以再获取索引为 3 (子块 3 , 即, 第二目 标图像子块的再一例, 在对角线方向上与子块 0相邻) 的子块的运动信息。 同理, 对于各运动信息为空的子块, 均可以通过以上方法对其运动信息进行 填充。 应理解, 以上列举的对运动信息为空的子块的运动信息填充方法仅为 示例性说明, 本发明并不限定于此, 例如, 对于上述获取顺序, 也可以先获 取竖直方向上的规定子块(这里, 为相邻子块)的运动信息, 再获取水平方 向上的规定子块(这里, 为相邻子块)的运动信息, 再获取对角线方向上的 规定子块(这里, 为相邻子块)的运动信息。 即, 该获取顺序可以任意变更。 In the embodiment of the present invention, for each first processing unit, whether the motion information of each sub-block is empty according to the index number of the sub-block (for example, from small to large) may be determined, if the motion information of the sub-block is empty. Then, motion information of the sub-block (an example of the second target image sub-block) adjacent to the first processing unit may be determined based on the motion information. For example, if the motion information of the sub-block with index 0 (ie, sub-block 0, belonging to the first processing unit 0) is empty, motion information of other sub-blocks belonging to the same processing unit (first processing unit 0) may be acquired. And use the motion information as the motion information of the sub-block 0. The obtaining order may be, for example, first obtaining motion information of a sub-block with an index of 1 (sub-block 1, that is, an example of a second target image sub-block, adjacent to sub-block 0 in the horizontal direction), if sub-block 1 If the motion information is empty, then the index can be obtained again as 2 (subblock 2, ie, For another example of the second target image sub-block, the motion information of the sub-block adjacent to the sub-block 0 in the vertical direction, if the motion information of the sub-block 2 is empty, the index may be further obtained as 3 (sub-block 3, That is, the motion information of the sub-block of the second target image sub-block, which is adjacent to the sub-block 0 in the diagonal direction. Similarly, for each sub-block whose motion information is empty, the motion information can be filled by the above method. It should be understood that the method for filling the motion information of the sub-blocks whose motion information is empty is only an exemplary description, and the present invention is not limited thereto. For example, for the above-mentioned acquisition order, the vertical direction may also be obtained first. The motion information of the sub-block (here, the adjacent sub-block), and the motion information of the specified sub-block (here, the adjacent sub-block) in the horizontal direction is acquired, and the specified sub-block in the diagonal direction is acquired (here , for adjacent sub-blocks) motion information. That is, the order of acquisition can be arbitrarily changed.

从而, 经上述在第一层内进行的处理, 对各第一处理单元内的各子块进 行上述处理后, 只要该第一处理单元内的四个子块中有至少一个子块的运动 信息不为空, 就可以为该第一处理单元内所有运动信息为空的子块填充(或 者说, 获得)运动信息。  Therefore, after the above processing is performed on each sub-block in each first processing unit by the processing performed in the first layer, as long as the motion information of at least one of the four sub-blocks in the first processing unit is not If it is empty, it can fill (or obtain) motion information for all sub-blocks in the first processing unit that are empty.

需要说明的是,对于已根据上述方法从基本层图像获取了运动信息的子 块或者根据上述方法填充了运动信息的子块,在后续处理中需要使用该子块 的运动信息时, 可以直接使用为该子块填充的运动信息。 即, 第二目标图像 子块的运动信息可以是指该第二目标图像子块的基本层对应子块的运动信 息, 也可以是为其填充的其他增强层子块的运动信息。 即, 该根据该目标图 像子块的运动信息, 确定该第一运动信息, 包括:  It should be noted that, for a sub-block that has acquired motion information from a base layer image according to the above method or a sub-block that is filled with motion information according to the above method, when motion information of the sub-block needs to be used in subsequent processing, it can be directly used. The motion information that is populated for this sub-block. That is, the motion information of the second target image sub-block may refer to the motion information of the base layer corresponding sub-block of the second target image sub-block, or may be the motion information of other enhancement layer sub-blocks filled for it. That is, determining the first motion information according to the motion information of the target image sub-block includes:

根据该第一目标图像子块的运动信息, 确定该第一运动信息; 或 根据该第二目标图像子块的运动信息, 确定该第一运动信息; 或 根据该第一目标图像子块的运动信息以及第二目标图像子块的运动信 息, 确定该第一运动信息。  Determining the first motion information according to the motion information of the first target image sub-block; or determining the first motion information according to the motion information of the second target image sub-block; or according to the motion of the first target image sub-block The information and the motion information of the second target image sub-block determine the first motion information.

因此, 当确定某一个子块(例如, 子块 0 ) 的对应子块不包括运动信息 时, 可以从第一层中与该子块 0处于同一第一处理单元(例如, 第一处理单 元 0 ) 的其他子块(例如, 子块 1~子块 3 )获取运动信息。 当与该子块(例 如, 子块 0 )处于同一第一处理单元(例如, 第一处理单元 0 ) 的其他子块 (第一层内的规定子块, 例如, 子块 1~子块 3 )的运动信息为空, 则可以获 取第二处理单元内的规定第一处理单元(例如,第一处理单元 1~第一处理单 元 3 ) 中规定子块(第二目标图像子块的另一例) 的运动信息, 并将该运动 信息作为该子块(例如, 子块 0 ) 的运动信息。 即, 如果一个第一处理单元(例如, 第一处理单元 0 ) 内的所有子块的 对应子块均为空, 则可以获取第二处理单元内的其他第一处理单元(例如, 第一处理单元 1~第一处理单元 3 ) 内的规定子块(为了便于说明, 在本发明 以各第一处理单元左上角的子块为例进行说明)的运动信息, 并将该运动信 息作为该第一处理单元(第一处理单元 0 ) 内各子块的运动信息。 获取顺序 可以为, 例如, 首先获取索引为 1的第一处理单元(第一处理单元 1 , 其在 水平方向上与第一处理单元 0相邻) 的左上角的子块(子块 4 , 即, 第二目 标图像子块的一例)的运动信息, 如果子块 4的运动信息为空, 则可以认为 该第一处理单元 1内其他子块的运动信息也为空, 从而可以再获取索引为 2 的第一处理单元(第一处理单元 2 ,其在竖直方向上与第一处理单元 0相邻) 的左上角的子块(子块 8 , 即, 第二目标图像子块的另一例) 的运动信息, 如果子块 8的运动信息为空, 则可以认为该第一处理单元 2内其他子块的运 动信息也为空,从而可以再获取索引为 3的第一处理单元(第一处理单元 3 , 其在对角线方向上与第一处理单元 0相邻) 的左上角的子块(子块 12 , 即, 第二目标图像子块的再一例)的运动信息。 同理, 对于各运动信息为空的第 一处理单元, 均可以通过以上方法对其运动信息进行填充。 应理解, 以上列 举的对运动信息为空的子块的运动信息填充方法仅为示例性说明, 本发明并 不限定于此, 例如, 对于上述获取顺序, 也可以先获取竖直方向上的规定第 一处理单元(这里, 为相邻第一处理单元)的规定子块的运动信息, 再获取 水平方向上的规定第一处理单元(这里, 为相邻第一处理单元)的规定子块 的运动信息, 再获取对角线方向上的规定第一处理单元(这里, 为相邻第一 处理单元) 的规定子块的运动信息。 即, 该获取顺序可以任意变更。 并且, 作为上述 "规定子块" 并不限定于第一处理单元左上角的子块, 也可以是同 一第一处理单元内任意位置的子块。 Therefore, when it is determined that the corresponding sub-block of a certain sub-block (for example, sub-block 0) does not include motion information, the first processing unit may be in the same processing unit as the sub-block 0 from the first layer (for example, the first processing unit 0) Other sub-blocks (eg, sub-block 1 - sub-block 3) acquire motion information. When the sub-block (for example, sub-block 0) is in the same other sub-block of the first processing unit (for example, the first processing unit 0) (the specified sub-block in the first layer, for example, sub-block 1~ sub-block 3 If the motion information is empty, the predetermined sub-block in the predetermined first processing unit (for example, the first processing unit 1 to the first processing unit 3) in the second processing unit may be acquired (another example of the second target image sub-block) The motion information is used as the motion information of the sub-block (for example, sub-block 0). That is, if the corresponding sub-blocks of all the sub-blocks in one first processing unit (for example, the first processing unit 0) are all empty, other first processing units in the second processing unit may be acquired (for example, the first processing The motion information of the predetermined sub-block in the first to third processing units 3 (for convenience of explanation, the sub-block in the upper left corner of each first processing unit is described as an example), and the motion information is used as the first Motion information of each sub-block within a processing unit (first processing unit 0). The order of obtaining may be, for example, first obtaining a sub-block of the upper left corner of the first processing unit (the first processing unit 1 adjacent to the first processing unit 0 in the horizontal direction) having an index of 1 (sub-block 4, ie The motion information of the second target image sub-block is empty. If the motion information of the sub-block 4 is empty, the motion information of the other sub-blocks in the first processing unit 1 is also considered to be empty, so that the index can be re-acquired. a sub-block of the upper left corner of the first processing unit (first processing unit 2 adjacent to the first processing unit 0 in the vertical direction) of 2 (subblock 8, that is, another example of the second target image sub-block) The motion information of the sub-block 8 is considered to be empty if the motion information of the sub-block 8 is empty, so that the motion information of the other sub-blocks in the first processing unit 2 is also empty, so that the first processing unit with the index of 3 can be reacquired (first The processing unit 3, which is adjacent to the first processing unit 0 in the diagonal direction, has motion information of the sub-block in the upper left corner (sub-block 12, that is, another example of the second target image sub-block). Similarly, for the first processing unit whose motion information is empty, the motion information can be filled by the above method. It should be understood that the method for filling the motion information of the sub-blocks whose motion information is empty is only an exemplary description, and the present invention is not limited thereto. For example, for the above-mentioned acquisition order, the vertical direction may also be obtained first. Obtaining motion information of a predetermined sub-block of the first processing unit (here, adjacent to the first processing unit), and acquiring a predetermined sub-block of a predetermined first processing unit (here, an adjacent first processing unit) in the horizontal direction The motion information further acquires motion information of a prescribed sub-block of the first processing unit (here, the adjacent first processing unit) in the diagonal direction. That is, the order of acquisition can be arbitrarily changed. Further, the above-mentioned "predetermined sub-block" is not limited to the sub-block in the upper left corner of the first processing unit, and may be a sub-block at an arbitrary position in the same first processing unit.

需要说明的是, 由于上述列举的目标图像块的大小为 16 x 16 ,子块的大 小为 4 x 4 , 因此该目标图像块仅包括两层, 上述递归过程结束。但是目标图 像块的大小为更大, 例如, 32 x 32 , 而子块的大小为 4 x 4 , 则该目标图像块 包括三层, 可以按照与上述相同的方法继续进行递归操作, 为当目标图像块 的所有子块获取运动信息。  It should be noted that since the size of the target image block enumerated above is 16 x 16 and the size of the sub-block is 4 x 4, the target image block includes only two layers, and the above recursion process ends. However, the size of the target image block is larger, for example, 32 x 32, and the size of the sub-block is 4 x 4, then the target image block includes three layers, and the recursive operation can be continued in the same manner as described above. All sub-blocks of the image block acquire motion information.

该根据该目标图像块的大小、该目标图像子块的大小和用于指示该第一 目标图像子块在该目标图像块中的位置的第二索引信息,确定该至少两个目 标图像子块中的第二目标图像子块, 包括: Determining the at least two items according to the size of the target image block, the size of the target image sub-block, and second index information indicating a position of the first target image sub-block in the target image block. The second target image sub-block in the target image sub-block includes:

根据以下任一公式, 确定该第二目标图像子块,  Determining the second target image sub-block according to any of the following formulas,

Idx2 + idx, %N/(N/2))x2 + (l- Idxl %N /(N / 4)%2))χ N /4 ; Idx2

Figure imgf000029_0001
+ ((l - ldxx %N/(N/2))x2 + (ldxx %N / (N / 4) %2)) xN/4; W¾ =/^/NxN + ((l-/ x1 N/(N/2))x2 + (l-/^ N/(N/4) 2))xN/4; 其中, 表示用于指示该第二目标图像子块在该目标图像块中的位置 的第三索引信息, /^表示该第二索引信息, %表示模运算或取余操作, N表 示该目标图像块包括的子块的数量。 Idx 2 + idx, %N/(N/2))x2 + (l- Idx l %N /(N / 4)%2))χ N /4 ; Idx 2
Figure imgf000029_0001
+ ((l - ldx x %N/(N/2))x2 + (ldx x %N / (N / 4) %2)) xN/4; W3⁄4 =/^/NxN + ((l-/ x 1 N/(N/2))x2 + (l-/^ N/(N/4) 2))xN/4; wherein, the representation is used to indicate that the second target image sub-block is in the target image block The third index information of the location, /^ indicates the second index information, % indicates a modulo operation or a remainder operation, and N indicates the number of sub-blocks included in the target image block.

具体地说, 根据上述各公式可以根据当前正在处理的子块的索引, 确定 当前处理的层次内的第二目标图像子块,其中 Ν与当前正在处理的层次相对 应, 并且, Ν是根据目标图像块的大小和子块的大小确定的(其中, 该子块 的大小根据预设值确定的), 例如, 如果目标图像块的大小为 16χ 16, 子块 的大小为 4x4, 则如上所述该目标图像块包括两层, 在处理第一层时, Ν为 该层中各处理单元(第一处理单元) 包括的子块数量, 这里为 4。 在处理第 二层时, Ν为该层中各处理单元(第二处理单元) 包括的子块数量, 这里为 16。  Specifically, according to the above formulas, the second target image sub-block within the currently processed hierarchy may be determined according to the index of the sub-block currently being processed, where Ν corresponds to the layer currently being processed, and Ν is according to the target The size of the image block and the size of the sub-block are determined (where the size of the sub-block is determined according to a preset value), for example, if the size of the target image block is 16χ 16, and the size of the sub-block is 4×4, The target image block includes two layers. When processing the first layer, Ν is the number of sub-blocks included in each processing unit (first processing unit) in the layer, here is 4. When processing the second layer, Ν is the number of sub-blocks included in each processing unit (second processing unit) in the layer, here 16.

以上, 列举了当上述 "规定子块" 为所述处理单元的左上角子块时, 所 使用的公式。 但本发明并不限定与此, 还可以根据 "规定子块" 所述处理单 元中的位置, 对上述公式进行变更。  In the above, the formula used when the above-mentioned "prescribed sub-block" is the upper-left sub-block of the processing unit is listed. However, the present invention is not limited thereto, and the above formula may be changed in accordance with the position in the processing unit of the "predetermined sub-block".

可选地, 该根据该基本层图像块包括的与该目标图像块中包含的目标图 像子块对应的基本层图像子块的运动信息, 确定该目标图像子块的运动信 息, 进一步包括:  Optionally, the determining, according to the motion information of the base layer image sub-block corresponding to the target image sub-block included in the target image block, the motion information of the target image sub-block, further comprising:

如果该第二目标图像子块的运动信息为空, 则确定该第一目标图像子块 的运动信息为零运动信息。  If the motion information of the second target image sub-block is empty, determining that the motion information of the first target image sub-block is zero motion information.

具体地说, 如果经上述处理后, 不能为该子块填充运动信息, 则使用零 运动信息作为该子块的运动信息。 在本发明实施例中, 可以按照以下方法构 造零运动信息。 例如, 在预测编码图像帧 (P帧) 中, 零运动信息的预测方 向为单向预测, 参考图像索引为 0, 运动矢量(0, 0)。 在双向预测编码图像 帧 (B帧) 中, 零运动信息的预测方向为双向预测, 两个参考图像索引均为 0, 两个运动矢量均为 (0, 0)。  Specifically, if the sub-block cannot be filled with motion information after the above processing, zero motion information is used as the motion information of the sub-block. In the embodiment of the present invention, zero motion information can be constructed in the following manner. For example, in predictive coded picture frames (P frames), the prediction direction of zero motion information is unidirectional prediction, and the reference picture index is 0, motion vector (0, 0). In the bidirectionally predictive coded picture frame (B frame), the prediction direction of the zero motion information is bidirectional prediction, both reference picture indices are 0, and both motion vectors are (0, 0).

需要说明的是, 当目标图像块包括多个处理层次, 上述使用零运动信息 作为该子块的运动信息的方法, 可以在对最后一个层次进行处理后进行, 也 可以在对其他任一层次进行处理后进行, 本发明并未特别限定。 应理解, 以 上列举的获取子块的运动信息的方法仅为本发明的示例性说明,本发明并不 限定于此, 例如, 在本发明是示例中, 还可以如上所述, 根据所述基本层图 像(基本层图像块)的编码模式确定该对应子块是否包含有运动信息。例如, 如果基本层图像使用帧内预测编码模式, 则可以确定该对应子块不包含运动 信息 (即, 第一基本层图像子块的运动信息为空)。 如果确定目标图像块的 所有子块中只有一个子块(具体地说, 是其对应子块)具有运动信息, 则可 以将该子块的运动信息作为其他子块的运动信息。 It should be noted that when the target image block includes multiple processing levels, the above uses zero motion information. The method of the motion information of the sub-block may be performed after the last layer is processed, or may be performed after processing at any other level, and the present invention is not particularly limited. It should be understood that the method for obtaining the motion information of the sub-blocks listed above is only an exemplary description of the present invention, and the present invention is not limited thereto. For example, in the example of the present invention, as described above, according to the basic The coding mode of the layer image (base layer image block) determines whether the corresponding sub-block contains motion information. For example, if the base layer image uses the intra prediction coding mode, it may be determined that the corresponding sub-block does not contain motion information (ie, the motion information of the first base layer image sub-block is empty). If it is determined that only one of the sub-blocks of the target image block (specifically, its corresponding sub-block) has motion information, the motion information of the sub-block may be used as motion information of the other sub-blocks.

由此,完成了对目标图像块的第一运动信息的获取处理,从而,在 S130, 可以将该第一运动信息和第二运动信息加入运动信息列表。  Thereby, the acquisition processing of the first motion information of the target image block is completed, and thus, at S130, the first motion information and the second motion information can be added to the motion information list.

这里,需要说明的是,在将本发明实施例应用于 MERGE技术的情况下, 除了将目前图像块中所有子块的运动信息作为一个整体(即, 各运动信息由 统一的索引 (第一索引信息)指示)加入运动信息列表, 还可以将各子块的 运动信息中的部分或全部运动信息加入运动信息列表(即, 各运动信息由不 同的索引 (第一索引信息)指示)。  Here, it should be noted that, in the case where the embodiment of the present invention is applied to the MERGE technique, the motion information of all the sub-blocks in the current image block is taken as a whole (that is, the motion information is unified index (the first index). The information) indication) is added to the motion information list, and some or all of the motion information in the motion information of each sub-block may also be added to the motion information list (ie, each motion information is indicated by a different index (first index information)).

在将各子块的运动信息中的部分或全部加入运动信息列表时, 可选地, 该根据该子块的运动信息, 确定该第一运动信息, 包括:  When the part of the motion information of each sub-block is added to the motion information list, the first motion information is determined according to the motion information of the sub-block, and the method includes:

根据第三目标图像子块的运动信息, 确定该第一运动信息, 其中, 该第 三目标图像子块为该目标图像块中位于预设位置的子块, 或  Determining the first motion information according to motion information of the third target image sub-block, where the third target image sub-block is a sub-block located at a preset position in the target image block, or

该第三目标图像子块的运动信息在该子块的运动信息中的出现频率最 高。  The motion information of the third target image sub-block has the highest frequency of occurrence in the motion information of the sub-block.

具体地说, 在本发明实施例中, 该一个或多个运动信息可以从基本层中 的基本层图像块的不同位置获取。本发明实施例可以提供三种获取该运动信 息 (第一运动信息) 的方法。  Specifically, in an embodiment of the invention, the one or more motion information may be obtained from different locations of the base layer image blocks in the base layer. The embodiment of the present invention can provide three methods for acquiring the motion information (first motion information).

应理解, 在本发明实施例中, 为了便于理解, 将上述子块区分为第一目 标图像子块、 第二目标图像子块和第三目标图像子块, 但是, 第三目标图像 子块也可以是与第一目标图像子块或第二目标图像子块相同的子块, 本发明 并未特别限定。 以下, 省略对相同或相似情况的说明。  It should be understood that, in the embodiment of the present invention, in order to facilitate understanding, the foregoing sub-block is divided into a first target image sub-block, a second target image sub-block, and a third target image sub-block, but the third target image sub-block is also It may be the same sub-block as the first target image sub-block or the second target image sub-block, and the present invention is not particularly limited. Hereinafter, the description of the same or similar cases will be omitted.

方法 a, 选择目标图像块的最左上角的子块的运动信息 (具体地说, 是 其对应子块的运动信息)。 方法 b, 选择目标图像块的正中间的子块的运动信息 (具体地说, 是其 对应子块的运动信息)。 Method a, selecting motion information of the sub-block in the upper left corner of the target image block (specifically, motion information of its corresponding sub-block). Method b, selecting motion information of the sub-block in the middle of the target image block (specifically, motion information of its corresponding sub-block).

方法 c, 选择目标图像块的的子块的运动信息 (具体地说, 是其对应子 块的运动信息) 中出现频率最高的运动信息。  The method c selects the motion information of the highest frequency of the motion information of the sub-block of the target image block (specifically, the motion information of the corresponding sub-block).

在将本发明实施例应用于 AMVP技术的情况下, 可以根据预设值(用 于指示运动信息列表中包括的运动信息的个数), 从各子块的运动信息中选 择一个或多个运动信息。  In the case where the embodiment of the present invention is applied to the AMVP technology, one or more motions may be selected from the motion information of each sub-block according to a preset value (for indicating the number of motion information included in the motion information list). information.

可选地, 该根据该子块的运动信息, 确定该第一运动信息, 包括: 根据第三目标图像子块的运动信息, 确定该第一运动信息, 其中, 该第 三目标图像子块为该目标图像块中位于预设位置的子块, 或  Optionally, determining the first motion information according to the motion information of the sub-block includes: determining, according to motion information of the third target image sub-block, the third target image sub-block is a sub-block located in a preset position in the target image block, or

该第三目标图像子块的运动信息在该子块的运动信息中的出现频率最 高。  The motion information of the third target image sub-block has the highest frequency of occurrence in the motion information of the sub-block.

具体地说, 在本发明实施例中, 该一个或多个运动信息可以从基本层中 的基本层图像块的不同位置获取。本发明实施例可以以上三种获取该运动信 息 (第一运动信息) 的方法(方法 a、 方法 b、 方法 c )。  Specifically, in an embodiment of the invention, the one or more motion information may be obtained from different locations of the base layer image blocks in the base layer. The embodiment of the present invention can acquire the motion information (first motion information) by the above three methods (method a, method b, method c).

可选地, 该根据第三目标图像子块的运动信息, 确定该第一运动信息, 包括:  Optionally, determining the first motion information according to the motion information of the third target image sub-block includes:

根据该第三目标图像子块的运动信息的参考图像、该目标图像和该目标 图像块的参考图像的时域距离关系,对该第三目标图像子块的运动信息进行 缩放处理;  And scaling the motion information of the third target image sub-block according to a reference image of the motion information of the third target image sub-block, a time domain distance relationship between the target image and the reference image of the target image block;

根据该缩放处理后的第三目标图像子块的运动信息,确定该第一运动信 息。  The first motion information is determined based on the motion information of the third target image sub-block after the scaling process.

具体地说,在本发明实施例中,可以根据所选择的运动信息的参考图像、 该增强层图像以及目标图像块的参考图像三者在时间上的距离关系,对选择 的运动信息进行适当缩放处理,将该放缩处理后的运动信息作为第一运动信 息加入运动信息列表。  Specifically, in the embodiment of the present invention, the selected motion information may be appropriately scaled according to the distance relationship between the reference image of the selected motion information, the enhancement layer image, and the reference image of the target image block in time. Processing, adding the motion information after the scaling process to the motion information list as the first motion information.

在 S130, 可选地, 在本发明实施例中, 该第二运动信息包括时间运动 信息和空间运动信息, 以及  In S130, optionally, in the embodiment of the present invention, the second motion information includes time motion information and spatial motion information, and

该根据该第一运动信息和该第二运动信息, 确定运动信息列表, 包括: 根据该第一运动信息和该第二运动信息, 确定运动信息列表, 以使该第 一运动信息位于运动信息列表的首位; 或 根据该第一运动信息和该第二运动信息, 确定运动信息列表, 以使该第 一运动信息位于运动信息列表的末位; 或 Determining the motion information list according to the first motion information and the second motion information, comprising: determining, according to the first motion information and the second motion information, the motion information list, so that the first motion information is located in the motion information list. First place; or Determining, according to the first motion information and the second motion information, a motion information list, so that the first motion information is located at a last position of the motion information list; or

根据该第一运动信息和该第二运动信息, 确定运动信息列表, 以使该第 一运动信息位于该运动信息列表中的空间运动信息与该时间运动信息之间。  Based on the first motion information and the second motion information, the motion information list is determined such that the first motion information is located between the spatial motion information in the motion information list and the temporal motion information.

具体地说, 在本发明实施例中, 第一运动信息可以位于运动信息列表的 首位末位, 或者, 在运动信息列表中第一运动信息可以位于所有空间运动信 息之后, 且位于时间运动信息之前。  Specifically, in the embodiment of the present invention, the first motion information may be located at the last position of the motion information list, or the first motion information may be located after all the spatial motion information in the motion information list, and before the time motion information. .

在 S140中, 可以从该运动信息列表中确定该目标图像块的最优运动信 息, 该预预定规则, 例如, 可以为: 计算运动信息列表中每一个运动信息的 率失真代价, 选择率失真代价最小的运动信息作为最优运动信息。  In S140, the optimal motion information of the target image block may be determined from the motion information list, and the pre-predetermined rule may be, for example, calculating a rate distortion cost of each motion information in the motion information list, and selecting a rate distortion cost. The smallest motion information is used as the optimal motion information.

并且, 在本发明实施例中, 该方法还包括:  Moreover, in the embodiment of the present invention, the method further includes:

确定最优编码模式, 以对该目标图像块进行运动补偿编码操作。  An optimal coding mode is determined to perform a motion compensation coding operation on the target image block.

具体地说, 可以计算每一种模式的率失真代价, 选择率失真代价最小的 编码模式作为最优编码模式。  Specifically, the rate distortion cost of each mode can be calculated, and the coding mode with the lowest rate distortion selectivity can be selected as the optimal coding mode.

如果所选择的最优编码模式包括该最优运动信息, 则使用该最优运动信 息对该目标图像块进行运动补偿编码操作。  If the selected optimal coding mode includes the optimal motion information, the target image block is subjected to a motion compensation coding operation using the optimal motion information.

可选地, 在该目标图像块包括多于一个子块的情况下, 当该最优信息为 该第一运动信息时, 该方法还包括:  Optionally, when the target image block includes more than one sub-block, when the optimal information is the first motion information, the method further includes:

对位于各子块之间的边界附近的像素进行滤波处理。  Filtering is performed on pixels located near the boundary between each sub-block.

具体地说, 在本发明实施例中, 在上述最优编码模式为 MERGE模式的 情况下,还可以对在目标图像块与其邻近块之间的边界附近像素滤波。并且, 在选择该第一运动信息作为最优运动信息的情况下,还可以对目标图像块的 各子块间的边界附近像素进行滤波处理。  Specifically, in the embodiment of the present invention, in the case where the above-described optimal encoding mode is the MERGE mode, it is also possible to filter pixels near the boundary between the target image block and its neighboring blocks. Further, in the case where the first motion information is selected as the optimal motion information, it is also possible to perform filtering processing on pixels in the vicinity of the boundary between the sub-blocks of the target image block.

在 S150中, 对用于指示上述最优运动信息在上述运动信息列表中的位 置的索引 (第一索引信息)进行熵编码处理。  In S150, an index (first index information) for indicating a position of the above-described optimal motion information in the motion information list is subjected to entropy encoding processing.

在本发明实施例中, 该熵编码处理可以包含二值化编码处理, 上下文模 型选择处理, 二进制算术编码处理, 上下文更新处理。  In the embodiment of the present invention, the entropy encoding process may include binarization encoding processing, context model selection processing, binary arithmetic encoding processing, and context update processing.

在二值化处理中, 可以采用, 例如截断一元(TU, Truncated Unary )码 二值化。 在运动信息列表包括的运动信息的数目为 5 (预设值为 5 ) 的情况 下, TU码二值化如以下表 1所示,  In the binarization process, for example, truncated unary (TU, Truncated Unary) code binarization can be employed. In the case where the number of motion information included in the motion information list is 5 (the preset value is 5), the TU code binarization is as shown in Table 1 below.

表 1 第一索引 二进制符号字串 Table 1 First index binary symbol string

0 0  0 0

1 10  1 10

2 110  2 110

3 1110  3 1110

4 1111  4 1111

可选地, 该第一索引信息包括用于指示该最优运动信息是否为该第一运 动信息的第一符号和用于指示该最优运动信息在该运动列表中的位置的第 二符号, 以及  Optionally, the first index information includes a first symbol for indicating whether the optimal motion information is the first motion information, and a second symbol for indicating a location of the optimal motion information in the motion list, as well as

该根据该最优运动信息, 进行编码, 包括:  The encoding according to the optimal motion information includes:

根据第一上下文模型, 对该第一符号进行算术编码处理;  Performing an arithmetic coding process on the first symbol according to the first context model;

根据第二上下文模型, 对该第二符号进行算术编码处理, 其中, 该第一 上下文模型与该第二上下文模型相异。  And performing, according to the second context model, an arithmetic coding process on the second symbol, wherein the first context model is different from the second context model.

具体地说, 本发明实施例的第一索引信息可以包括两种符号, 即, 用于 指示该最优运动信息是否为该第一运动信息的第一符号和用于指示该最优 运动信息在该运动列表中的位置的第二符号。 并且, 该第一索引信息可以只 包括一个符号位也可以包括多个符号位。  Specifically, the first index information of the embodiment of the present invention may include two symbols, that is, a first symbol for indicating whether the optimal motion information is the first motion information, and for indicating the optimal motion information. The second symbol of the position in the list of sports. And, the first index information may include only one symbol bit or a plurality of symbol bits.

例如, 当第一运动信息位于运动信息列表的首位, 且选择的最优运动信 息为该第一运动信息时, 可以仅包括一个符号位, 此时, 第一符号与第二符 号相同, 均位于该唯一的符号位。  For example, when the first motion information is located in the first position of the motion information list, and the selected optimal motion information is the first motion information, only one symbol bit may be included. At this time, the first symbol is the same as the second symbol, and both are located. The only sign bit.

当第一运动信息不位于运动信息列表的首位时, 例如, 第一符号可以用 一个符号位来承载, 例如, 0表示该最优运动信息为该第一运动信息, 1表 示该最优运动信息不为该第一运动信息。 并且, 第二符号可以用其他符号位 来承载。  When the first motion information is not located in the first position of the motion information list, for example, the first symbol may be carried by one symbol bit, for example, 0 indicates that the optimal motion information is the first motion information, and 1 indicates the optimal motion information. Not for the first motion information. Also, the second symbol can be carried with other symbol bits.

在本发明实施例中, 对上述两种符号使用不同的上下文模型 (或者说, 上下文)。  In the embodiment of the present invention, different context models (or contexts) are used for the above two symbols.

在上下文模型选择处理中,如果第一运动信息放置在运动信息列表的首 位, 且, 该第一运动信息为最优运动信息, 则可以将第一索引信息二值化之 后得到的二进制符号字串中的第一个二进制符号作为第一符号。  In the context model selection process, if the first motion information is placed in the first position of the motion information list, and the first motion information is the optimal motion information, the binary symbol string obtained after binarizing the first index information may be used. The first binary symbol in the first symbol.

并且, 在本实施例中, 第一符号使用的上下文模型如以下表 2所示, 可 以包含 0、 1、 2三种上下文模型。 在本实施例中, 例如, 可以根据目标图像 块左边和上方的图像块是否使用其各自的第一运动信息,确定使用哪一种上 下文模型, 例如, 如果目标图像块左边和上方的图像块都不使用第一运动信 息, 那么选择索引为 0的上下文模型, 如果目标图像块左边和上方的图像块 有一个使用第一运动信息, 那么选择索引为 1的上下文模型, 如果目标图像 块左边和上方的图像块都使用第一运动信息, 那么选择索引为 2的上下文。 Moreover, in this embodiment, the context model used by the first symbol is as shown in Table 2 below, and may include three context models of 0, 1, and 2. In this embodiment, for example, according to the target image Whether the image blocks on the left and above the block use their respective first motion information to determine which context model to use, for example, if the image block on the left and the top of the target image block does not use the first motion information, then the selection index is 0. Context model, if the image block on the left and top of the target image block has a first motion information, then select the context model with index 1 and if the image block on the left and the top of the target image block uses the first motion information, then select The context of the index is 2.

在本实施例中, 所述第二上下文模型可以是等概率模型。 而使用等概率 模型编码的编码方式也就是旁路(by-pass )编码方式, 即直接将所述第二符 号写入码流的编码方式。 如果使用 by-pass编码方式, 则无需进行上下文更 新处理。 表 2  In this embodiment, the second context model may be an equal probability model. The coding method using the equal probability model coding is also a by-pass coding mode, that is, the coding mode in which the second symbol is directly written into the code stream. If you use the by-pass encoding, no context updates are required. Table 2

Figure imgf000034_0001
Figure imgf000034_0001

应理解, 以上列举的选择上下文模型的方法仅为示例性说明, 本发明并 不限定于此, 例如, 第一符号和第二符号也可以使用相同的上下文模型, 或 者采用 by-pass模式(即不使用上下文模型而将该二进制符号直接写入码流) 编码该第一索引信息。  It should be understood that the above enumerated methods for selecting a context model are merely exemplary, and the present invention is not limited thereto. For example, the first symbol and the second symbol may also use the same context model, or adopt a by-pass mode (ie, The binary symbol is directly written to the code stream without using the context model. The first index information is encoded.

其后, 可以根据如上所述选择的上下文模型对该第一索引信息进行二进 制算术编码, 并更新所使用的上下文模型。 在本发明实施例中, 该过程可以 与现有技术相同, 这里为了避免赘述, 省略其说明。  Thereafter, the first index information can be binary arithmetically coded according to the context model selected as described above, and the used context model is updated. In the embodiment of the present invention, the process may be the same as the prior art, and the description thereof is omitted here to avoid redundancy.

在本发明实施例中, 可以根据所选择的最优运动信息, 对目标图像块进 行运动补偿处理, 并将该运动补偿处理后生成的目标图像块的信息以及上述 熵编码处理后的第一索引信息加入码流(目标码流)。  In the embodiment of the present invention, the motion compensation process may be performed on the target image block according to the selected optimal motion information, and the information of the target image block generated by the motion compensation process and the first index after the entropy coding process may be performed. Information is added to the code stream (target stream).

这里, 需要说明的是, 在该目标码流中, 可以包括编码处理后的目标图 像(包括基本层图像和增强层图像), 并且, 该处理过程可以与现有技术相 同, 这里, 为了避免赘述, 省略其说明。 Here, it should be noted that, in the target code stream, the encoded target image (including the base layer image and the enhancement layer image) may be included, and the processing may be related to the prior art. Here, in order to avoid redundancy, the description thereof is omitted.

在解码端, 可以从码流中获取目标图像信息, 并确定目标图像(具体地 说, 是目标图像块), 并使用与编码端相同的方法获取第一运动信息和第二 运动信息, 并生成运动信息列表。  At the decoding end, the target image information may be acquired from the code stream, and the target image (specifically, the target image block) is determined, and the first motion information and the second motion information are acquired and generated using the same method as the encoding end. A list of sports information.

对获取的第一索引信息(熵编码处理后的信息)进行熵解码处理, 该处 理过程可以包括: 上下文模型选择处理, 二进制算术解码处理, 二值化解码 处理, 上下文更新处理。 或相似, 这里省略其说明。  Entropy decoding processing is performed on the acquired first index information (information after entropy encoding processing), and the processing procedure may include: context model selection processing, binary arithmetic decoding processing, binarization decoding processing, and context update processing. Or similar, the description thereof is omitted here.

在二进制算术解码处理中, 可以根据选择的上下文模型从码流中解析得 到表示第一索引信息的二进制符号字串 (bin string )。 其中, 该二进制算术 解码处理与编码端的二进制算术编码处理相对应。  In the binary arithmetic decoding process, a binary symbol string (bin string) representing the first index information can be parsed from the code stream according to the selected context model. The binary arithmetic decoding process corresponds to the binary arithmetic coding process at the encoding end.

在二值化解码处理中, 可以根据解析到的二进制符号字串确定第一索引 信息, 其中, 所使用的二进制符号字串与各第一索引信息(数值)的对应关 系与编码端相同, 如上述表 1所示。  In the binarization decoding process, the first index information may be determined according to the parsed binary symbol string, wherein the correspondence between the used binary symbol string and each first index information (value) is the same as the encoding end, such as Table 1 above.

其后, 可以根据解码后的第一索引信息从运动信息列表中, 选择最优运 动信息, 作为目标图像块的运动信息, 以使用该运动信息对目标图像块进行 运动补偿处理。  Thereafter, the optimal motion information may be selected from the motion information list as the motion information of the target image block according to the decoded first index information, to perform motion compensation processing on the target image block using the motion information.

这里,需要说明的是,在将本发明实施例应用于 MERGE模式的情况下, 需要对目标图像块的各个子块进行运动补偿操作。在通过运动补偿获取当前 块的预测信号后, 还可以叠加另外解码得到的残差信号, 以获取重建信号。  Here, it should be noted that in the case where the embodiment of the present invention is applied to the MERGE mode, it is necessary to perform a motion compensation operation on each sub-block of the target image block. After the prediction signal of the current block is obtained by motion compensation, the residual signal obtained by the additional decoding may also be superimposed to obtain the reconstructed signal.

并且, 在编码模式为 MERGE模式的情况下, 还可以对在目标图像块与 其邻近块之间的边界附近像素滤波。 并且, 在最优运动信息为第一运动信息 作为的情况下,还可以对目标图像块的各子块间的边界附近像素进行滤波处 理。  Also, in the case where the encoding mode is the MERGE mode, it is also possible to filter pixels near the boundary between the target image block and its neighboring blocks. Further, in the case where the optimal motion information is the first motion information, the pixels near the boundary between the sub-blocks of the target image block may be subjected to filtering processing.

在将本发明实施例应用于 AMVP模式的情况下, 可以根据该最优运动 信息, 结合另外熵解码得到的预测方向、 参考图像索引以及运动矢量差值, 推导得到目标图像块的运动信息。使用该运动信息对当前块进行运动补偿操 作。 在通过运动补偿获取当前块的预测信号后, 还可以叠加另外解码得到的 残差信号, 以获取重建信号。  In the case where the embodiment of the present invention is applied to the AMVP mode, the motion information of the target image block can be derived according to the optimal motion information, combined with the prediction direction, the reference image index, and the motion vector difference obtained by the additional entropy decoding. The motion information is used to perform motion compensation on the current block. After acquiring the prediction signal of the current block by motion compensation, the residual signal obtained by the additional decoding may also be superimposed to obtain the reconstructed signal.

根据本发明实施例的用于图像处理的方法, 在 MERGE或 AMVP等利 用邻近图像块的运动信息来确定当前处理的图像块的运动信息的技术中,通 过在运动信息列表中增加根据基本层图像运动信息确定的第一运动信息, 能 够在利用邻近图像块的运动信息来确定当前处理的图像块的运动信息的同 时, 利用基本层图像的运动信息来确定当前处理的图像块的运动信息, 提高 处理效率。 Method for image processing according to an embodiment of the present invention, in MERGE or AMVP In the technique of determining the motion information of the currently processed image block by using the motion information of the adjacent image block, by adding the first motion information determined according to the base layer image motion information in the motion information list, the motion information using the adjacent image block can be utilized While determining the motion information of the currently processed image block, the motion information of the currently processed image block is determined by using the motion information of the base layer image, thereby improving the processing efficiency.

图 5示出了从解码端角度描述的根据本发明实施例的用于图像处理的方 法 200的示意性流程图。 如图 5所示, 该方法 200包括:  Fig. 5 shows a schematic flow chart of a method 200 for image processing according to an embodiment of the present invention, which is described from the perspective of a decoding end. As shown in FIG. 5, the method 200 includes:

S210, 根据基本层图像块的运动信息确定目标图像块的第一运动信息, 其中, 该的基本层图像块位于基本层图像中, 该目标图像块位于增强层图像 中, 该的基本层图像与该增强层图像相对应, 且该基本图像块在该基本层图 像中的空间位置与该目标图像块在该增强层图像中的空间位置相对应;  S210. Determine, according to motion information of the base layer image block, the first motion information of the target image block, where the base layer image block is located in the base layer image, where the target image block is located in the enhancement layer image, and the base layer image is The enhancement layer image corresponds to, and a spatial position of the basic image block in the base layer image corresponds to a spatial position of the target image block in the enhancement layer image;

S220 ,根据该增强层图像中与该目标图像块相邻的邻近图像块的运动信 息确定该目标图像块的第二运动信息;  S220. Determine, according to motion information of a neighboring image block adjacent to the target image block in the enhancement layer image, second motion information of the target image block.

S230, 根据该第一运动信息和该第二运动信息, 生成运动信息列表; S240, 根据目标码流, 获取用于指示该最优运动信息在该运动信息列表 中的位置的第一索引信息;  S230, generating a motion information list according to the first motion information and the second motion information; S240, acquiring first index information for indicating a location of the optimal motion information in the motion information list according to the target code stream;

S250, 根据该第一索引信息, 从该运动信息列表中确定最优运动信息, 根据该最优运动信息, 对该目标码流进行解码, 以获取该目标图像块。  S250. Determine, according to the first index information, optimal motion information from the motion information list, and decode the target code stream according to the optimal motion information to obtain the target image block.

具体地说, 在对图像进行分层编码, 例如, 在空间可伸缩编码时, 可以 将图像进行将分辨率处理得到低分辨率图像,作为对比将原图像称作高分辨 率图像, 编码器分别对该低分辨率图像以及该高分辨率图像进行编码。 为方 便描述, 本文中将质量高的待编码图像称作增强层图像, 将对应的质量低的 待编码图像(例如所述低分辨率图像)称作基本层图像。  Specifically, when the image is hierarchically encoded, for example, in spatial scalable coding, the image may be subjected to resolution processing to obtain a low-resolution image, and the original image is referred to as a high-resolution image as a contrast, respectively. The low resolution image and the high resolution image are encoded. For convenience of description, a high quality image to be encoded is referred to herein as an enhancement layer image, and a corresponding low quality image to be encoded (e.g., the low resolution image) is referred to as a base layer image.

在本发明实施例中, 目标图像是使用分层编码技术进行处理的图像, 基 本层是指分层编码中的质量(包括帧速率、 空间分辨率、 时间分辨率、 信噪 比强度或质量等级等参数)较低的层, 增强层是指分层编码中的质量(包括 帧速率、 空间分辨率、 时间分辨率、 信噪比强度或质量等级等参数)较高的 层。 需要说明的是, 在本发明实施例中, 在本发明实施例中, 对于一个给定 的增强层, 与其相对应的基本层可以为质量低于该增强层的任一层, 例如, 如果当前存在五层, 编码质量依次提高 (即, 第一层质量最低, 第五层质量 最高), 如果增强层为第四层, 则基本层可以是第一层, 也可以是第二层、 也可以是第三层、 也可以是第四层。 同理, 对于一个给定的基本层, 与其相 对应的增强层可以为质量低于该基本层的任一层。 In the embodiment of the present invention, the target image is an image processed by a layered coding technique, and the basic layer refers to a quality in layered coding (including frame rate, spatial resolution, temporal resolution, signal to noise ratio intensity or quality level). The lower layer, the enhancement layer refers to the layer with higher quality (including frame rate, spatial resolution, temporal resolution, signal-to-noise ratio intensity or quality level) in the layered coding. It should be noted that, in the embodiment of the present invention, in the embodiment of the present invention, for a given enhancement layer, the corresponding base layer may be any layer lower in quality than the enhancement layer, for example, if currently There are five layers, and the coding quality is sequentially improved (that is, the first layer has the lowest quality and the fifth layer has the highest quality). If the enhancement layer is the fourth layer, the base layer may be the first layer or the second layer. It can also be the third layer or the fourth layer. Similarly, for a given base layer, the corresponding enhancement layer can be any layer of lower quality than the base layer.

增强层图像为当前处理的增强层中的图像,基本层图像为基本层中与增 强层图像在同一时刻的图像。  The enhancement layer image is the image in the currently processed enhancement layer, and the base layer image is the image in the base layer at the same time as the enhancement layer image.

综上所述, 在本发明实施例中, 该基本层图像的质量低于该增强层图像 的质量。  In summary, in the embodiment of the present invention, the quality of the base layer image is lower than the quality of the enhancement layer image.

目标图像块为该增强层图像中正在处理的图像块。  The target image block is the image block being processed in the enhancement layer image.

基本层图像块为基本层图像中与该目标图像块在空间位置上存在对应 关系的图像块。  The base layer image block is an image block in the base layer image that has a corresponding relationship with the target image block in spatial position.

在本发明实施例中,基本层图像块与目标图像块的对应关系可以根据基 本层图像与增强层图像之间的分辨率比例关系计算得到。 例如, 在包括 X方 向和 y方向的系统内,如果增强层图像在 X方向与 y方向的分辨率分别是基 本层图像的 2倍, 则对于增强层中左上角的像素坐标为 (2x, 2y )且大小为 ( 2m ) X ( 2n )的图像块, 其基本层图像中的对应块可以是左上角的像素坐 标为 (X , y )且大小为 m x n的图像块。  In the embodiment of the present invention, the correspondence between the base layer image block and the target image block may be calculated according to the resolution proportional relationship between the base layer image and the enhancement layer image. For example, in a system including the X direction and the y direction, if the resolution of the enhancement layer image in the X direction and the y direction is twice that of the base layer image, respectively, the pixel coordinates of the upper left corner in the enhancement layer are (2x, 2y). And an image block of size (2m) X ( 2n ), the corresponding block in the base layer image may be an image block whose pixel coordinates are (X , y ) and whose size is mxn in the upper left corner.

在本发明实施例中, 后述子块是指目标图像块的子块(增强层内的图像 块), 后述对应子块是指该子块的在基本层中的基本层图像块(属于上述对 应块)。  In the embodiment of the present invention, a sub-block described later refers to a sub-block of the target image block (an image block in the enhancement layer), and a corresponding sub-block described later refers to a base layer image block in the base layer of the sub-block (belonging to The corresponding block above).

在本发明实施例中, 运动信息可以包括预测方向、 参考图像索引或运动 矢量中的一个或多个, 其中, 预测方向可分为单向和双向预测, 单向预测又 可以分为前向预测与后向预测, 前向预测指使用前向参考图像列表, 即列表 ( list ) 0中的参考图像产生预测信号, 后向预测指使用后向参考图像列表, 即 list 1中的参考图像产生预测信号, 双向预测指同时使用 list 0和 list 1中 的参考图像产生预测信号;对于单向预测,需要一个参考图像索引指示在 list 0或 list l中所选择的参考图像, 对于双向预测, 需要两个参考图像索引, 分 别指示在 list 0与 list 1中所选择的参考图像; 每一个运动矢量包括水平方向 分量 X和竖直方向分量 y , 可记作(X , y ) , 对于单向预测, 需要一个运动矢 量指示预测信号在所选择的 list 0或 list 1参考图像中的位移,对于双向预测, 需要两个运动矢量,分别指示前向预测信号与后向预测信号在所选择的 list O 参考图像与 list 1参考图像中的位移。  In the embodiment of the present invention, the motion information may include one or more of a prediction direction, a reference image index, or a motion vector, where the prediction direction may be divided into one-way and two-way prediction, and the one-way prediction may be further divided into forward prediction. With backward prediction, forward prediction refers to the use of a forward reference picture list, ie, a reference picture in list 0 to generate a prediction signal, and backward prediction refers to using a backward reference picture list, ie, a reference picture in list 1 to generate a prediction. Signal, bidirectional prediction refers to the use of reference pictures in list 0 and list 1 to generate prediction signals; for unidirectional prediction, a reference picture index is required to indicate the reference picture selected in list 0 or list l. For bidirectional prediction, two are required. Reference image indices, respectively indicating the reference images selected in list 0 and list 1; each motion vector includes a horizontal direction component X and a vertical direction component y, which can be written as (X, y), for one-way prediction, Requires a motion vector to indicate the displacement of the predicted signal in the selected list 0 or list 1 reference image, for bidirectional prediction Two motion vectors are required to indicate the displacement of the forward prediction signal and the backward prediction signal in the selected list O reference image and the list 1 reference image, respectively.

在本发明实施例中, 第二运动信息是指从该目标图像块的邻近图像块 (增强层图像的图像块) 中获取的运动信息。 在本发明实施例中, 该第二运 动信息可以包括空间运动信息和时间运动信息, 空间运动信息是从增强层图 像中的空间邻近块获取的运动信息, 时间运动信息是指从增强层图像的参考 图像中的时间邻近块获取的运动信息。 In the embodiment of the present invention, the second motion information refers to a neighboring image block from the target image block. Motion information obtained in (image block of enhancement layer image). In the embodiment of the present invention, the second motion information may include spatial motion information, which is motion information acquired from spatial neighboring blocks in the enhancement layer image, and time motion information refers to images from the enhancement layer. The motion information acquired by the temporal neighboring block in the reference image.

在本发明实施例中, 在 S210中, 解码端设备可以获取该目标图像块的 基本层图像块包括的运动信息, 并根据该基本层图像块包括的运动信息, 确 定第一运动信息。  In the embodiment of the present invention, in S210, the decoding end device may acquire motion information included in the base layer image block of the target image block, and determine the first motion information according to the motion information included in the base layer image block.

可选地, 在本发明实施例中, 该根据基本层图像块的运动信息确定目标 图像块的第一运动信息包括:  Optionally, in the embodiment of the present invention, determining the first motion information of the target image block according to the motion information of the base layer image block includes:

根据该基本层图像块包括的与该目标图像块中包含的目标图像子块对 应的基本层图像子块的运动信息, 确定该目标图像子块的运动信息, 其中, 该目标图像块子块具有预先设定的大小;  Determining motion information of the target image sub-block according to motion information of the base layer image sub-block corresponding to the target image sub-block included in the target image block, wherein the target image block sub-block has Pre-set size;

根据该目标图像子块的运动信息, 确定该第一运动信息。  The first motion information is determined according to motion information of the target image sub-block.

具体地说, 在本发明实施例中, 目标图像块可以看作由一个或多个子块 构成的, 其中, 该子块的大小可以根据预设值确定, 为了便于说明, 以下, 以子块大小为 4 x 4为例进行说明。例如,如果目标图像块的大小为 16 χ 16 , 则可以确定该目标图像块包括 16个子块(大小为 4 x 4 )。 从而, 在本发明实 施例中, 可以确定该目标图像块中的每一个子块在基本层中的对应子块(属 于该基本层图像块), 并确定该对应子块的运动信息。  Specifically, in the embodiment of the present invention, the target image block may be regarded as being composed of one or more sub-blocks, wherein the size of the sub-block may be determined according to a preset value. For convenience of description, the following is a sub-block size. For example, 4 x 4 is explained. For example, if the size of the target image block is 16 χ 16, it can be determined that the target image block includes 16 sub-blocks (size 4 x 4). Therefore, in the embodiment of the present invention, a corresponding sub-block of each sub-block in the target image block (belonging to the base layer image block) may be determined, and motion information of the corresponding sub-block is determined.

可选地, 该根据该基本层图像块包括的与该子块相对应的对应子块的运 动信息, 确定该子块的运动信息, 包括:  Optionally, determining the motion information of the sub-block according to the motion information of the corresponding sub-block corresponding to the sub-block included in the base layer image block, including:

当与第一目标图像子块相对应的第一基本层图像子块的运动信息为非 空时, 将该第一基本层图像子块的运动信息, 作为该第一目标图像子块的运 动信息。  When the motion information of the first base layer image sub-block corresponding to the first target image sub-block is non-empty, the motion information of the first base layer image sub-block is used as the motion information of the first target image sub-block .

具体地说, 可以根据所择的子块(第一目标图像子块) 中的某一像素点 的坐标(记作: " (Ex, Ey ) " ), 确定该像素点在基本层图像中对应位置的坐标 (记作: " ( 并将包含所属对应的位置坐标的基本层图像块作为所 述对应子块。在本发明实施例中,可以按照以上式 1至式 10计算得到 ( 3x , By )。 Specifically, the pixel may be determined in the base layer image according to the coordinates of a certain pixel point in the selected sub-block (the first target image sub-block) (referred to as: "(E x , E y ) " ) The coordinate of the corresponding position in the middle (referred to as: " (and the base layer image block containing the corresponding position coordinates is taken as the corresponding sub-block. In the embodiment of the present invention, it can be calculated according to the above formula 1 to formula 10 (3) x , B y ).

这里, 需要说明的是, 如果基本层图像与增强层图像的分辨率相同, 则 无需进行上述的缩放操作, 而可以直接使用对应子块的运动信息作为子块的 运动信息。 应理解, 在本发明实施例中, 也可以不确定子块, 而直接采用以上方法 获取目标图像块的运动信息。 即, 可以认为目标图像块仅包括一个子块(该 子块大小与目标图像块相同)。 此时, 可以采用与上述同样的方法获取目标 图像块的运动信息。 并且, 如果目标图像块(或者说, 目标图像块包括的唯 一的子块)不存在运动信息, 则使用零运动信息作为该子块的运动信息。 在 本发明实施例中, 可以按照以下方法构造零运动信息。 例如, 在预测编码图 像帧 (P帧) 中, 零运动信息的预测方向为单向预测, 参考图像索引为 0, 运动矢量(0, 0 )。 在双向预测编码图像帧 (B 帧) 中, 零运动信息的预测 方向为双向预测, 两个参考图像索引均为 0, 两个运动矢量均为 (0, 0 )。 Here, it should be noted that if the resolution of the base layer image and the enhancement layer image are the same, the scaling operation described above is not required, and the motion information of the corresponding sub-block may be directly used as the motion information of the sub-block. It should be understood that, in the embodiment of the present invention, the sub-block may also be indeterminate, and the motion information of the target image block is directly obtained by using the above method. That is, it can be considered that the target image block includes only one sub-block (the sub-block size is the same as the target image block). At this time, the motion information of the target image block can be acquired in the same manner as described above. And, if the target image block (or the unique sub-block included in the target image block) does not have motion information, zero motion information is used as the motion information of the sub-block. In the embodiment of the present invention, zero motion information can be constructed in the following manner. For example, in a predictive coded picture frame (P frame), the prediction direction of the zero motion information is unidirectional prediction, and the reference picture index is 0, motion vector (0, 0). In the bidirectionally predictive coded picture frame (B frame), the prediction direction of the zero motion information is bidirectional prediction, both reference picture indexes are 0, and both motion vectors are (0, 0).

可选地, 在本发明实施例中, 该方法还包括:  Optionally, in the embodiment of the present invention, the method further includes:

根据所述基本层图像的编码模式,确定与第一目标图像子块相对应的第 一基本层图像子块是否包括运动信息。  Based on the encoding mode of the base layer image, it is determined whether the first base layer image sub-block corresponding to the first target image sub-block includes motion information.

具体地说, 在本发明实施例中, 可以根据所述基本层图像(基本层图像 块)的编码模式确定该对应子块是否包含有运动信息。 例如, 如果基本层图 像使用帧内预测编码模式, 则可以确定该对应子块不包含运动信息(即, 第 一基本层图像子块的运动信息为空)。  Specifically, in the embodiment of the present invention, whether the corresponding sub-block contains motion information may be determined according to an encoding mode of the base layer image (base layer image block). For example, if the base layer image uses the intra prediction coding mode, it may be determined that the corresponding sub-block does not contain motion information (i.e., the motion information of the first base layer image sub-block is empty).

从而, 在该对应子块包括运动信息时, 可以按如上所述过程确定该对应 子块并获取其运动信息, 在该对应子块不包括运动信息时, 可以跳过以上流 程。  Therefore, when the corresponding sub-block includes motion information, the corresponding sub-block may be determined according to the process as described above and its motion information may be acquired. When the corresponding sub-block does not include motion information, the above process may be skipped.

在对应子块不包括运动信息的情况下。可以基于该对应子块的相邻块的 运动信息来确定所述子块的运动信息。 即, 可选地, 该目标图像块包括至少 两个目标图像子块, 以及  In the case where the corresponding sub-block does not include motion information. The motion information of the sub-block may be determined based on motion information of neighboring blocks of the corresponding sub-block. That is, optionally, the target image block includes at least two target image sub-blocks, and

该根据该基本层图像块包括的与该目标图像块中包含的目标图像子块 对应的基本层图像子块的运动信息,确定该目标图像子块的运动信息,包括: 当与该至少两个目标图像子块中的第一目标图像子块相对应的第一基 本层图像子块的运动信息为空时, 根据该目标图像块的大小、 该目标图像子 块的大小和用于指示该第一目标图像子块在该目标图像块中的位置的第二 索引信息, 确定该至少两个目标图像子块中的第二目标图像子块;  Determining motion information of the target image sub-block according to the motion information of the base layer image sub-block corresponding to the target image sub-block included in the target image block, including: at least two And when the motion information of the first base layer image sub-block corresponding to the first target image sub-block in the target image sub-block is empty, according to the size of the target image block, the size of the target image sub-block, and the indication Determining, by the second index information of a position of the target image sub-block in the target image block, a second target image sub-block in the at least two target image sub-blocks;

根据该第二目标图像子块的运动信息,确定该第一目标图像子块的运动 信息;  Determining motion information of the first target image sub-block according to the motion information of the second target image sub-block;

对应,该根据该目标图像子块的运动信息,确定该第一运动信息, 包括: 根据该第一目标图像子块的运动信息, 确定该第一运动信息; 或 根据该第二目标图像子块的运动信息, 确定该第一运动信息; 或 根据该第一目标图像子块的运动信息以及第二目标图像子块的运动信 息, 确定该第一运动信息。 Correspondingly, determining the first motion information according to the motion information of the target image sub-block includes: Determining the first motion information according to the motion information of the first target image sub-block; or determining the first motion information according to the motion information of the second target image sub-block; or according to the motion of the first target image sub-block The information and the motion information of the second target image sub-block determine the first motion information.

具体地说, 不失一般性, 例如, 如果目标图像块的大小为 16 x 16 , 子块 的大小为 4 x 4 ,在本发明实施例中,子块的索引分配方法可以与现有技术相 同, 这里, 省略其说明, 图 4所示了子块的划分与索引。  Specifically, without loss of generality, for example, if the size of the target image block is 16 x 16 and the size of the sub-block is 4 x 4, in the embodiment of the present invention, the index allocation method of the sub-block may be the same as the prior art. Here, the description thereof is omitted, and the division and indexing of the sub-blocks are shown in FIG.

在本发明实施例中, 可以根据目标图像块的大小和子块的大小, 确定处 理层次, 并按处理层次逐层递推处理。 例如, 在本发明实施例中, 可以规定 最底层的层次(记作, 第一层) 中的每个处理单元(记作, 第一处理单元) 包括四个子块, 第一层的上一层次(记作第二层) 的每个处理单元(记作, 第二处理单元) 包括四个第一处理单元, 以此类推, 为了避免赘述, 省略递 推说明。 从而, 作为示例而非限定, 在图 4所示的目标图像块中, 可以包括 两个层次, 第一层中, 子块 0~子块 3构成了第一处理单元 0 , 子块 4~子块 7 构成了第一处理单元 1 , 子块 8~子块 11构成了第一处理单元 2 , 子块 12~子 块 15构成了第一处理单元 3。 第二层中, 第一处理单元 0~第一处理单元 3 构成了第二处理单元 0。应理解, 以上列举的层次划分方法仅为示例性说明, 本发明并不限定于此。  In the embodiment of the present invention, the processing level may be determined according to the size of the target image block and the size of the sub-block, and the processing layer is recursively layer by layer according to the processing level. For example, in the embodiment of the present invention, each processing unit (referred to as the first processing unit) in the lowest level hierarchy (referred to as the first layer) may be defined to include four sub-blocks, the previous layer of the first layer. Each processing unit (referred to as the second layer) (denoted as the second layer) includes four first processing units, and so on, in order to avoid redundancy, the recursive description is omitted. Thus, by way of example and not limitation, in the target image block shown in FIG. 4, two levels may be included. In the first layer, sub-block 0~sub-block 3 constitute the first processing unit 0, and the sub-block 4~sub The block 7 constitutes the first processing unit 1, the sub-block 8~sub-block 11 constitutes the first processing unit 2, and the sub-block 12~sub-block 15 constitutes the first processing unit 3. In the second layer, the first processing unit 0 to the first processing unit 3 constitute the second processing unit 0. It should be understood that the above-described hierarchical division method is merely illustrative, and the present invention is not limited thereto.

在本发明实施例中, 对于每一个第一处理单元, 可以按照子块的索引号 (例如, 从小到大)依次判定各子块的运动信息是否为空, 如果该子块的运 动信息为空, 则可以基于该第一处理单元内与其相邻的子块(第二目标图像 子块的一例)的运动信息确定其运动信息。 例如, 如果索引为 0的子块(即, 子块 0 , 属于第一处理单元 0 ) 的运动信息为空, 可以获取属于同一个处理 单元(第一处理单元 0 ) 内其他子块的运动信息, 并将该运动信息作为该子 块 0的运动信息。 获取顺序可以为, 例如, 首先获取索引为 1的子块(子块 1 , 即, 第二目标图像子块的一例, 在水平方向上与子块 0相邻) 的运动信 息, 如果子块 1的运动信息为空, 则可以再获取索引为 2 (子块 2 , 即, 第 二目标图像子块的另一例,在竖直方向上与子块 0相邻)的子块的运动信息, 如果子块 2的运动信息为空, 则可以再获取索引为 3 (子块 3 , 即, 第二目 标图像子块的再一例, 在对角线方向上与子块 0相邻) 的子块的运动信息。 同理, 对于各运动信息为空的子块, 均可以通过以上方法对其运动信息进行 填充。 应理解, 以上列举的对运动信息为空的子块的运动信息填充方法仅为 示例性说明, 本发明并不限定于此, 例如, 对于上述获取顺序, 也可以先获 取竖直方向上的规定子块(这里, 为相邻子块)的运动信息, 再获取水平方 向上的规定子块(这里, 为相邻子块)的运动信息, 再获取对角线方向上的 规定子块(这里, 为相邻子块)的运动信息。 即, 该获取顺序可以任意变更。 In the embodiment of the present invention, for each first processing unit, whether the motion information of each sub-block is empty according to the index number of the sub-block (for example, from small to large) may be determined, if the motion information of the sub-block is empty. Then, motion information of the sub-block (an example of the second target image sub-block) adjacent to the first processing unit may be determined based on the motion information. For example, if the motion information of the sub-block with index 0 (ie, sub-block 0, belonging to the first processing unit 0) is empty, motion information of other sub-blocks belonging to the same processing unit (first processing unit 0) may be acquired. And use the motion information as the motion information of the sub-block 0. The obtaining order may be, for example, first obtaining motion information of a sub-block with an index of 1 (sub-block 1, that is, an example of a second target image sub-block, adjacent to sub-block 0 in the horizontal direction), if sub-block 1 If the motion information is empty, the motion information of the sub-block whose index is 2 (sub-block 2, that is, another example of the second target image sub-block, adjacent to the sub-block 0 in the vertical direction) may be acquired again. If the motion information of the sub-block 2 is empty, then the sub-block with the index of 3 (sub-block 3, that is, another example of the second target image sub-block, adjacent to the sub-block 0 in the diagonal direction) may be acquired. Sports information. Similarly, for each sub-block whose motion information is empty, the motion information can be performed by the above method. Fill. It should be understood that the method for filling the motion information of the sub-blocks whose motion information is empty is only an exemplary description, and the present invention is not limited thereto. For example, for the above-mentioned acquisition order, the vertical direction may also be obtained first. The motion information of the sub-block (here, the adjacent sub-block), and the motion information of the specified sub-block (here, the adjacent sub-block) in the horizontal direction is acquired, and the specified sub-block in the diagonal direction is acquired (here , for adjacent sub-blocks) motion information. That is, the order of acquisition can be arbitrarily changed.

从而, 经上述在第一层内进行的处理, 对各第一处理单元内的各子块进 行上述处理后, 只要该第一处理单元内的四个子块中有至少一个子块的运动 信息不为空, 就可以为该第一处理单元内所有运动信息为空的子块填充(或 者说, 获得)运动信息。  Therefore, after the above processing is performed on each sub-block in each first processing unit by the processing performed in the first layer, as long as the motion information of at least one of the four sub-blocks in the first processing unit is not If it is empty, it can fill (or obtain) motion information for all sub-blocks in the first processing unit that are empty.

需要说明的是,对于已根据上述方法从基本层图像获取了运动信息的子 块或者根据上述方法填充了运动信息的子块,在后续处理中需要使用该子块 的运动信息时, 可以直接使用为该子块填充的运动信息。 即, 第二目标图像 子块的运动信息可以是指该第二目标图像子块的基本层对应子块的运动信 息, 也可以是为其填充的其他增强层子块的运动信息。 即, 该根据该目标图 像子块的运动信息, 确定该第一运动信息, 包括:  It should be noted that, for a sub-block that has acquired motion information from a base layer image according to the above method or a sub-block that is filled with motion information according to the above method, when motion information of the sub-block needs to be used in subsequent processing, it can be directly used. The motion information that is populated for this sub-block. That is, the motion information of the second target image sub-block may refer to the motion information of the base layer corresponding sub-block of the second target image sub-block, or may be the motion information of other enhancement layer sub-blocks filled for it. That is, determining the first motion information according to the motion information of the target image sub-block includes:

根据该第一目标图像子块的运动信息, 确定该第一运动信息; 或 根据该第二目标图像子块的运动信息, 确定该第一运动信息; 或 根据该第一目标图像子块的运动信息以及第二目标图像子块的运动信 息, 确定该第一运动信息。  Determining the first motion information according to the motion information of the first target image sub-block; or determining the first motion information according to the motion information of the second target image sub-block; or according to the motion of the first target image sub-block The information and the motion information of the second target image sub-block determine the first motion information.

因此, 当确定某一个子块(例如, 子块 0 ) 的对应子块不包括运动信息 时, 可以从第一层中与该子块 0处于同一第一处理单元(例如, 第一处理单 元 0 ) 的其他子块(例如, 子块 1~子块 3 )获取运动信息。 当与该子块(例 如, 子块 0 )处于同一第一处理单元(例如, 第一处理单元 0 ) 的其他子块 (第一层内的规定子块, 例如, 子块 1~子块 3 )的运动信息为空, 则可以获 取第二处理单元内的规定第一处理单元(例如,第一处理单元 1~第一处理单 元 3 ) 中规定子块(第二目标图像子块的另一例) 的运动信息, 并将该运动 信息作为该子块(例如, 子块 0 ) 的运动信息。  Therefore, when it is determined that the corresponding sub-block of a certain sub-block (for example, sub-block 0) does not include motion information, the first processing unit may be in the same processing unit as the sub-block 0 from the first layer (for example, the first processing unit 0) Other sub-blocks (eg, sub-block 1 - sub-block 3) acquire motion information. When the sub-block (for example, sub-block 0) is in the same other sub-block of the first processing unit (for example, the first processing unit 0) (the specified sub-block in the first layer, for example, sub-block 1~ sub-block 3 If the motion information is empty, the predetermined sub-block in the predetermined first processing unit (for example, the first processing unit 1 to the first processing unit 3) in the second processing unit may be acquired (another example of the second target image sub-block) The motion information is used as the motion information of the sub-block (for example, sub-block 0).

即, 如果一个第一处理单元(例如, 第一处理单元 0 ) 内的所有子块的 对应子块均为空, 则可以获取第二处理单元内的其他第一处理单元(例如, 第一处理单元 1~第一处理单元 3 ) 内的规定子块(为了便于说明, 在本发明 以各第一处理单元左上角的子块为例进行说明)的运动信息, 并将该运动信 息作为该第一处理单元(第一处理单元 0) 内各子块的运动信息。 获取顺序 可以为, 例如, 首先获取索引为 1的第一处理单元(第一处理单元 1, 其在 水平方向上与第一处理单元 0相邻) 的左上角的子块(子块 4, 即, 第二目 标图像子块的一例)的运动信息, 如果子块 4的运动信息为空, 则可以认为 该第一处理单元 1内其他子块的运动信息也为空, 从而可以再获取索引为 2 的第一处理单元(第一处理单元 2,其在竖直方向上与第一处理单元 0相邻) 的左上角的子块(子块 8, 即, 第二目标图像子块的另一例) 的运动信息, 如果子块 8的运动信息为空, 则可以认为该第一处理单元 2内其他子块的运 动信息也为空,从而可以再获取索引为 3的第一处理单元(第一处理单元 3, 其在对角线方向上与第一处理单元 0相邻) 的左上角的子块(子块 12, 即, 第二目标图像子块的再一例)的运动信息。 同理, 对于各运动信息为空的第 一处理单元, 均可以通过以上方法对其运动信息进行填充。 应理解, 以上列 举的对运动信息为空的子块的运动信息填充方法仅为示例性说明, 本发明并 不限定于此, 例如, 对于上述获取顺序, 也可以先获取竖直方向上的规定第 一处理单元(这里, 为相邻第一处理单元)的规定子块的运动信息, 再获取 水平方向上的规定第一处理单元(这里, 为相邻第一处理单元)的规定子块 的运动信息, 再获取对角线方向上的规定第一处理单元(这里, 为相邻第一 处理单元) 的规定子块的运动信息。 即, 该获取顺序可以任意变更。 并且, 作为上述 "规定子块" 并不限定于第一处理单元左上角的子块, 也可以是同 一第一处理单元内任意位置的子块。 That is, if the corresponding sub-blocks of all the sub-blocks in one first processing unit (for example, the first processing unit 0) are all empty, other first processing units in the second processing unit may be acquired (for example, the first processing Motion information of a predetermined sub-block in the unit 1 to the first processing unit 3 (for convenience of explanation, the sub-block in the upper left corner of each first processing unit is described as an example), and the motion information is The information is the motion information of each sub-block in the first processing unit (first processing unit 0). The order of obtaining may be, for example, first obtaining a sub-block of the upper left corner of the first processing unit (the first processing unit 1 adjacent to the first processing unit 0 in the horizontal direction) having an index of 1 (sub-block 4, ie The motion information of the second target image sub-block is empty. If the motion information of the sub-block 4 is empty, the motion information of the other sub-blocks in the first processing unit 1 is also considered to be empty, so that the index can be re-acquired. a sub-block of the upper left corner of the first processing unit (first processing unit 2 adjacent to the first processing unit 0 in the vertical direction) of 2 (subblock 8, that is, another example of the second target image sub-block) The motion information of the sub-block 8 is considered to be empty if the motion information of the sub-block 8 is empty, so that the motion information of the other sub-blocks in the first processing unit 2 is also empty, so that the first processing unit with the index of 3 can be reacquired (first The processing unit 3, which is adjacent to the first processing unit 0 in the diagonal direction, has motion information of the sub-block in the upper left corner (sub-block 12, that is, another example of the second target image sub-block). Similarly, for the first processing unit whose motion information is empty, the motion information can be filled by the above method. It should be understood that the method for filling the motion information of the sub-blocks whose motion information is empty is only an exemplary description, and the present invention is not limited thereto. For example, for the above-mentioned acquisition order, the vertical direction may also be obtained first. Obtaining motion information of a predetermined sub-block of the first processing unit (here, adjacent to the first processing unit), and acquiring a predetermined sub-block of a predetermined first processing unit (here, an adjacent first processing unit) in the horizontal direction The motion information further acquires motion information of a prescribed sub-block of the first processing unit (here, the adjacent first processing unit) in the diagonal direction. That is, the order of acquisition can be arbitrarily changed. Further, the above-mentioned "predetermined sub-block" is not limited to the sub-block in the upper left corner of the first processing unit, and may be a sub-block at an arbitrary position in the same first processing unit.

需要说明的是, 由于上述列举的目标图像块的大小为 16x 16,子块的大 小为 4x 4, 因此该目标图像块仅包括两层, 上述递归过程结束。但是目标图 像块的大小为更大, 例如, 32x 32, 而子块的大小为 4x4, 则该目标图像块 包括三层, 可以按照与上述相同的方法继续进行递归操作, 为当目标图像块 的所有子块获取运动信息。  It should be noted that, since the size of the target image block enumerated above is 16x 16, and the size of the sub-block is 4x 4, the target image block includes only two layers, and the above recursion process ends. However, the size of the target image block is larger, for example, 32x 32, and the size of the sub-block is 4x4, then the target image block includes three layers, and the recursive operation can be continued in the same manner as described above, as the target image block All sub-blocks get motion information.

该根据该目标图像块的大小、该目标图像子块的大小和用于指示该第一 目标图像子块在该目标图像块中的位置的第二索引信息,确定该至少两个目 标图像子块中的第二目标图像子块, 包括:  Determining the at least two target image sub-blocks according to a size of the target image block, a size of the target image sub-block, and second index information indicating a position of the first target image sub-block in the target image block. The second target image sub-block in the middle includes:

根据以下任一公式, 确定该第二目标图像子块,  Determining the second target image sub-block according to any of the following formulas,

Idx2 + {idx, %N/(N/2))x2 + (l- Idx, %N /(N / 4)%2))χ N /4 ;Idx 2 + {idx, %N/(N/2))x2 + (l- Idx, %N /(N / 4)%2))χ N /4 ;

Idx2

Figure imgf000042_0001
+ ((l - ldxx %N/(N/2))x2 + {ldxx %N / (N / 4) %2)) xN/4; W¾ =/^/NxN + ((l-/ 1%N/(N/2))x2 + (l-/^%N/(N/4)%2))xN/4; 其中, 表示用于指示该第二目标图像子块在该目标图像块中的位置 的第三索引信息, / 表示该第二索引信息, N是根据该目标图像块的大小 和该目标图像子块的大小确定的。 Idx 2
Figure imgf000042_0001
+ ((l - ldx x %N/(N/2))x2 + {ldx x %N / (N / 4) %2)) xN/4; W3⁄4 = /^/NxN + ((l-/ 1 %N/(N/2))x2 + (l-/^%N/(N/4)%2))xN/4; where The third index information indicating the position of the second target image sub-block in the target image block, / indicates the second index information, and N is determined according to the size of the target image block and the size of the target image sub-block.

具体地说, 根据上述各公式可以根据当前正在处理的子块的索引, 确定 当前处理的层次内的第二目标图像子块,其中 Ν与当前正在处理的层次相对 应, 并且, Ν是根据目标图像块的大小和预设值确定的, 例如, 如果目标图 像块的大小为 16 x 16, 子块的大小为 4x 4, 则如上所述该目标图像块包括 两层, 在处理第一层时, Ν为该层中各处理单元(第一处理单元) 包括的子 块数量, 这里为 4。 在处理第二层时, Ν为该层中各处理单元(第二处理单 元) 包括的子块数量, 这里为 16。  Specifically, according to the above formulas, the second target image sub-block within the currently processed hierarchy may be determined according to the index of the sub-block currently being processed, where Ν corresponds to the layer currently being processed, and Ν is according to the target The size of the image block and the preset value are determined, for example, if the size of the target image block is 16 x 16 and the size of the sub-block is 4x 4, the target image block includes two layers as described above, when processing the first layer , Ν is the number of sub-blocks included in each processing unit (first processing unit) in the layer, here is 4. When processing the second layer, Ν is the number of sub-blocks included in each processing unit (second processing unit) in the layer, here 16.

以上, 列举了当上述 "规定子块" 为所述处理单元的左上角子块时, 所 使用的公式。 但本发明并不限定与此, 还可以根据 "规定子块" 所述处理单 元中的位置, 对上述公式进行变更。  In the above, the formula used when the above-mentioned "prescribed sub-block" is the upper-left sub-block of the processing unit is listed. However, the present invention is not limited thereto, and the above formula may be changed in accordance with the position in the processing unit of the "predetermined sub-block".

可选地, 该根据该基本层图像块包括的与该目标图像块中包含的目标图 像子块对应的基本层图像子块的运动信息, 确定该目标图像子块的运动信 息, 进一步包括:  Optionally, the determining, according to the motion information of the base layer image sub-block corresponding to the target image sub-block included in the target image block, the motion information of the target image sub-block, further comprising:

如果该第二目标图像子块的运动信息为空, 则确定该第一目标图像子块 的运动信息为零运动信息。  If the motion information of the second target image sub-block is empty, determining that the motion information of the first target image sub-block is zero motion information.

具体地说, 如果经上述处理后, 不能为该子块填充运动信息, 则使用零 运动信息作为该子块的运动信息。 在本发明实施例中, 可以按照以下方法构 造零运动信息。 例如, 在预测编码图像帧 (P帧) 中, 零运动信息的预测方 向为单向预测, 参考图像索引为 0, 运动矢量(0, 0)。 在双向预测编码图像 帧 (B帧) 中, 零运动信息的预测方向为双向预测, 两个参考图像索引均为 0, 两个运动矢量均为 (0, 0)。  Specifically, if the sub-block cannot be filled with motion information after the above processing, zero motion information is used as the motion information of the sub-block. In the embodiment of the present invention, zero motion information can be constructed in the following manner. For example, in predictive coded picture frames (P frames), the prediction direction of zero motion information is unidirectional prediction, and the reference picture index is 0, motion vector (0, 0). In the bidirectionally predictive coded picture frame (B frame), the prediction direction of the zero motion information is bidirectional prediction, both reference picture indices are 0, and both motion vectors are (0, 0).

需要说明的是, 当目标图像块包括多个处理层次, 上述使用零运动信息 作为该子块的运动信息的方法, 可以在对最后一个层次进行处理后进行, 也 可以在对其他任一层次进行处理后进行, 本发明并未特别限定。 应理解, 以 上列举的获取子块的运动信息的方法仅为本发明的示例性说明,本发明并不 限定于此, 例如, 在本发明是示例中, 还可以如上所述, 根据所述基本层图 像(基本层图像块)的编码模式确定该对应子块是否包含有运动信息。例如, 如果基本层图像使用帧内预测编码模式, 则可以确定该对应子块不包含运动 信息 (即, 第一基本层图像子块的运动信息为空)。 如果确定目标图像块的 所有子块中只有一个子块(具体地说, 是其对应子块)具有运动信息, 则可 以将该子块的运动信息作为其他子块的运动信息。 It should be noted that, when the target image block includes multiple processing levels, the foregoing method of using the zero motion information as the motion information of the sub-block may be performed after processing the last layer, or may be performed on any other layer. The treatment is carried out, and the present invention is not particularly limited. It should be understood that the method for obtaining the motion information of the sub-blocks listed above is only an exemplary description of the present invention, and the present invention is not limited thereto. For example, in the example of the present invention, as described above, according to the basic The coding mode of the layer image (base layer image block) determines whether the corresponding sub-block contains motion information. E.g, If the base layer image uses the intra prediction coding mode, it may be determined that the corresponding sub-block does not contain motion information (ie, the motion information of the first base layer image sub-block is empty). If it is determined that only one of the sub-blocks of the target image block (specifically, its corresponding sub-block) has motion information, the motion information of the sub-block may be used as motion information of the other sub-blocks.

由此,完成了对目标图像块的第一运动信息的获取处理,从而,在 S120, 可以将该第一运动信息和第二运动信息加入运动信息列表。  Thereby, the acquisition processing of the first motion information of the target image block is completed, and thus, at S120, the first motion information and the second motion information can be added to the motion information list.

这里,需要说明的是,在将本发明实施例应用于 MERGE技术的情况下, 除了将目前图像块中所有子块的运动信息作为一个整体(即, 各运动信息由 统一的索引 (第一索引信息)指示)加入运动信息列表, 还可以将各子块的 运动信息中的部分或全部运动信息加入运动信息列表(即, 各运动信息由不 同的索引 (第一索引信息)指示)。  Here, it should be noted that, in the case where the embodiment of the present invention is applied to the MERGE technique, the motion information of all the sub-blocks in the current image block is taken as a whole (that is, the motion information is unified index (the first index). The information) indication) is added to the motion information list, and some or all of the motion information in the motion information of each sub-block may also be added to the motion information list (ie, each motion information is indicated by a different index (first index information)).

当将各子块的运动信息中的部分或全部加入运动信息列表时, 可选地, 该根据该子块的运动信息, 确定该第一运动信息, 包括:  When the motion information of each sub-block is added to the motion information list, the first motion information is determined according to the motion information of the sub-block, and the method includes:

根据第三目标图像子块的运动信息, 确定该第一运动信息, 其中, 该第 三目标图像子块为该目标图像块中位于预设位置的子块, 或  Determining the first motion information according to motion information of the third target image sub-block, where the third target image sub-block is a sub-block located at a preset position in the target image block, or

该第三目标图像子块的运动信息在该子块的运动信息中的出现频率最 高。  The motion information of the third target image sub-block has the highest frequency of occurrence in the motion information of the sub-block.

具体地说, 在本发明实施例中, 该一个或多个运动信息可以从基本层中 的基本层图像块的不同位置获取。 本发明实施例可以提供上述方法 a、 方法 b和方法 c三种获取该运动信息 (第一运动信息) 的方法。  Specifically, in an embodiment of the invention, the one or more motion information may be obtained from different locations of the base layer image blocks in the base layer. The embodiment of the present invention can provide the foregoing methods a, b, and c to obtain the motion information (first motion information).

在将本发明实施例应用于 AMVP技术的情况下, 可以根据预设值(用 于指示运动信息列表中包括的运动信息的个数), 将从各子块的运动信息中 选择一个或多个运动信息。  In the case where the embodiment of the present invention is applied to the AMVP technology, one or more pieces of motion information of each sub-block may be selected according to a preset value (for indicating the number of pieces of motion information included in the motion information list). Sports information.

可选地, 该根据该子块的运动信息, 确定该第一运动信息, 包括: 根据第三目标图像子块的运动信息, 确定该第一运动信息, 其中, 该第 三目标图像子块为该目标图像块中位于预设位置的子块, 或  Optionally, determining the first motion information according to the motion information of the sub-block includes: determining, according to motion information of the third target image sub-block, the third target image sub-block is a sub-block located in a preset position in the target image block, or

该第三目标图像子块的运动信息在该子块的运动信息中的出现频率最 高。  The motion information of the third target image sub-block has the highest frequency of occurrence in the motion information of the sub-block.

具体地说, 在本发明实施例中, 该一个或多个运动信息可以从基本层中 的基本层图像块的不同位置获取。 本发明实施例可以提供上述方法 a、 方法 b和方法 c三种获取该运动信息 (第一运动信息) 的方法。 可选地, 该根据第三目标图像子块的运动信息, 确定该第一运动信息, 包括: Specifically, in an embodiment of the invention, the one or more motion information may be obtained from different locations of the base layer image block in the base layer. Embodiments of the present invention may provide three methods for obtaining the motion information (first motion information) in the foregoing method a, method b, and method c. Optionally, determining the first motion information according to the motion information of the third target image sub-block includes:

根据该第三目标图像子块的运动信息的参考图像、该目标图像和该目标 图像块的参考图像的时域距离关系,对该第三目标图像子块的运动信息进行 缩放处理;  And scaling the motion information of the third target image sub-block according to a reference image of the motion information of the third target image sub-block, a time domain distance relationship between the target image and the reference image of the target image block;

根据该缩放处理后的第三目标图像子块的运动信息,确定该第一运动信 息。  The first motion information is determined based on the motion information of the third target image sub-block after the scaling process.

具体地说,在本发明实施例中,可以根据所选择的运动信息的参考图像、 该增强层图像以及目标图像块的参考图像三者在时间上的距离关系,对选择 的运动信息进行适当缩放处理,将该放缩处理后的运动信息作为第一运动信 息加入运动信息列表。  Specifically, in the embodiment of the present invention, the selected motion information may be appropriately scaled according to the distance relationship between the reference image of the selected motion information, the enhancement layer image, and the reference image of the target image block in time. Processing, adding the motion information after the scaling process to the motion information list as the first motion information.

具体地说, 在 S220, 可以从码流中获取目标图像, 获取当前处理的目 标图像块的第一运动信息和第二运动信息, 并生成运动信息列表。 其中, 获 取该第二运动信息的方法可以列举, 上述方法 1和方法 2。  Specifically, at S220, the target image may be acquired from the code stream, the first motion information and the second motion information of the currently processed target image block are acquired, and a motion information list is generated. The method for obtaining the second motion information may be the above method 1 and method 2.

在 S230, 可以确定该运动信息列表。  At S230, the list of motion information can be determined.

可选地,在本发明实施例中该第二运动信息包括时间运动信息和空间运 动信息, 以及  Optionally, in the embodiment of the present invention, the second motion information includes time motion information and spatial motion information, and

该根据该第一运动信息和该第二运动信息, 确定运动信息列表, 包括: 根据该第一运动信息和该第二运动信息, 确定运动信息列表, 以使该第 一运动信息位于运动信息列表的首位; 或  Determining the motion information list according to the first motion information and the second motion information, comprising: determining, according to the first motion information and the second motion information, the motion information list, so that the first motion information is located in the motion information list. First place; or

根据该第一运动信息和该第二运动信息, 确定运动信息列表, 以使该第 一运动信息位于运动信息列表的末位; 或  Determining, according to the first motion information and the second motion information, a motion information list such that the first motion information is located at a last position of the motion information list; or

根据该第一运动信息和该第二运动信息, 确定运动信息列表, 以使该第 一运动信息位于该运动信息列表中的空间运动信息与该时间运动信息之间。  Based on the first motion information and the second motion information, the motion information list is determined such that the first motion information is located between the spatial motion information in the motion information list and the temporal motion information.

具体地说, 在本发明实施例中, 第一运动信息可以位于运动信息列表的 首位末位, 或者, 在运动信息列表中第一运动信息可以位于所有空间运动信 息之后, 且位于时间运动信息之前。  Specifically, in the embodiment of the present invention, the first motion information may be located at the last position of the motion information list, or the first motion information may be located after all the spatial motion information in the motion information list, and before the time motion information. .

在 S240中, 可以从码流中获取第一索引信息, 并对获取的第一索引信 息(熵编码处理后的信息)进行熵解码处理, 该处理过程可以包括: 上下文 模型选择处理, 二进制算术解码处理, 二值化解码处理, 上下文更新处理。  In S240, the first index information may be obtained from the code stream, and the obtained first index information (the information after the entropy coding process) is subjected to entropy decoding processing, where the processing may include: context model selection processing, binary arithmetic decoding Processing, binarization decoding processing, context update processing.

在二值化处理中, 可以采用, 例如截断一元(TU, Truncated Unary )码 二值化。 在运动信息列表包括的运动信息的数目为 5 (预设值为 5 ) 的情况 下, TU码二值化如上述表 1所示。 In the binarization process, for example, a truncated unary (TU, Truncated Unary) code can be used. Binarization. In the case where the number of pieces of motion information included in the motion information list is 5 (the preset value is 5), the TU code binarization is as shown in Table 1 above.

可选地, 该第一索引信息包括用于指示该最优运动信息是否为该第一运 动信息的第一符号和用于指示该最优运动信息在该运动列表中的位置的第 二符号, 以及  Optionally, the first index information includes a first symbol for indicating whether the optimal motion information is the first motion information, and a second symbol for indicating a location of the optimal motion information in the motion list, as well as

该编码单元具体用于根据第一上下文模型,对该第一符号进行算术编码 处理;  The coding unit is specifically configured to perform arithmetic coding processing on the first symbol according to the first context model;

用于根据第二上下文模型, 对该第二符号进行算术编码处理, 其中, 该 第一上下文模型与该第二上下文模型相异。  And performing arithmetic coding processing on the second symbol according to the second context model, wherein the first context model is different from the second context model.

具体地说, 本发明实施例的第一索引信息可以包括两种符号, 即, 用于 指示该最优运动信息是否为该第一运动信息的第一符号和用于指示该最优 运动信息在该运动列表中的位置的第二符号。 并且, 该第一索引信息可以只 包括一个符号位也可以包括多个符号位。  Specifically, the first index information of the embodiment of the present invention may include two symbols, that is, a first symbol for indicating whether the optimal motion information is the first motion information, and for indicating the optimal motion information. The second symbol of the position in the list of sports. And, the first index information may include only one symbol bit or a plurality of symbol bits.

例如, 当第一运动信息位于运动信息列表的首位, 且选择的最优运动信 息为该第一运动信息时, 可以仅包括一个符号位, 此时, 第一符号与第二符 号相同, 均位于该唯一的符号位。  For example, when the first motion information is located in the first position of the motion information list, and the selected optimal motion information is the first motion information, only one symbol bit may be included. At this time, the first symbol is the same as the second symbol, and both are located. The only sign bit.

当第一运动信息不位于运动信息列表的首位时, 例如, 第一符号可以用 一个符号位来承载, 例如, 0表示该最优运动信息为该第一运动信息, 1表 示该最优运动信息不为该第一运动信息。 并且, 第二符号可以用其他符号位 来承载。  When the first motion information is not located in the first position of the motion information list, for example, the first symbol may be carried by one symbol bit, for example, 0 indicates that the optimal motion information is the first motion information, and 1 indicates the optimal motion information. Not for the first motion information. Also, the second symbol can be carried with other symbol bits.

在本发明实施例中, 对上述两种符号使用不同的上下文模型 (或者说, 上下文)。  In the embodiment of the present invention, different context models (or contexts) are used for the above two symbols.

在上下文模型选择处理中,如果第一运动信息放置在运动信息列表的首 位, 且, 该第一运动信息为最优运动信息, 则可以将第一索引信息二值化之 后得到的二进制符号字串中的第一个二进制符号作为第一符号。  In the context model selection process, if the first motion information is placed in the first position of the motion information list, and the first motion information is the optimal motion information, the binary symbol string obtained after binarizing the first index information may be used. The first binary symbol in the first symbol.

并且, 在本实施例中, 第一符号使用的上下文模型如上述表 2所示, 可 以包含 0、 1、 2三种上下文模型。 在本实施例中, 例如, 可以根据目标图像 块左边和上方的图像块是否使用其各自的第一运动信息,确定使用哪一种上 下文模型, 例如, 如果目标图像块左边和上方的图像块都不使用第一运动信 息, 那么选择索引为 0的上下文模型, 如果目标图像块左边和上方的图像块 有一个使用第一运动信息, 那么选择索引为 1的上下文模型, 如果目标图像 块左边和上方的图像块都使用第一运动信息, 那么选择索引为 2的上下文。 在本实施例中, 所述第二上下文模型可以是等概率模型。 而使用等概率 模型编码的编码方式也就是旁路(by-pass )编码方式, 即直接将所述第二符 号写入码流的编码方式。 如果使用 by-pass编码方式, 则无需进行上下文更 新处理。 Moreover, in this embodiment, the context model used by the first symbol may include three context models of 0, 1, and 2 as shown in Table 2 above. In this embodiment, for example, which context model is used may be determined according to whether the image blocks on the left and the top of the target image block use their respective first motion information, for example, if the image blocks on the left and the top of the target image block are If the first motion information is not used, then the context model with index 0 is selected. If the image block on the left and the top of the target image block has a first motion information, then the context model with index 1 is selected, if the target image The image blocks on the left and top of the block use the first motion information, then the context with index 2 is selected. In this embodiment, the second context model may be an equal probability model. The coding method using the equal probability model coding is also a by-pass coding mode, that is, the coding mode in which the second symbol is directly written into the code stream. If you use the by-pass encoding, no context update processing is required.

应理解, 以上列举的选择上下文模型的方法仅为示例性说明, 本发明并 不限定于此, 例如, 第一符号和第二符号也可以使用相同的上下文模型, 或 者采用 by-pass模式(即不使用上下文模型而将该二进制符号直接写入码流) 编码该第一索引信息。  It should be understood that the above enumerated methods for selecting a context model are merely exemplary, and the present invention is not limited thereto. For example, the first symbol and the second symbol may also use the same context model, or adopt a by-pass mode (ie, The binary symbol is directly written to the code stream without using the context model. The first index information is encoded.

其后, 可以根据如上所述选择的上下文模型对该第一索引信息进行二进 制算术解码, 并更新所使用的上下文模型。 在本发明实施例中, 该过程可以 与现有技术相同, 这里为了避免赘述, 省略其说明。  Thereafter, the first index information can be subjected to binary arithmetic decoding according to the context model selected as described above, and the used context model is updated. In the embodiment of the present invention, the process may be the same as the prior art, and the description thereof is omitted here to avoid redundancy.

在 S250中, 在本发明实施例中, 可以根据所选择的最优运动信息, 对 目标图像块进行运动补偿处理, 并将该运动补偿处理后生成的目标图像块的 信息以及上述熵编码处理后的第一索引信息加入码流。  In S250, in the embodiment of the present invention, the motion compensation process may be performed on the target image block according to the selected optimal motion information, and the information of the target image block generated by the motion compensation process and the entropy coding process are processed. The first index information is added to the code stream.

这里,需要说明的是,在将本发明实施例应用于 MERGE模式的情况下, 需要对目标图像块的各个子块进行运动补偿操作。在通过运动补偿获取当前 块的预测信号后, 还可以叠加另外解码得到的残差信号, 以获取重建信号。  Here, it should be noted that in the case where the embodiment of the present invention is applied to the MERGE mode, it is necessary to perform a motion compensation operation on each sub-block of the target image block. After the prediction signal of the current block is obtained by motion compensation, the residual signal obtained by the additional decoding may also be superimposed to obtain the reconstructed signal.

并且, 在编码模式为 MERGE模式的情况下, 还可以对在目标图像块与 其邻近块之间的边界附近像素滤波。 并且, 在最优运动信息为第一运动信息 作为的情况下,还可以对目标图像块的各子块间的边界附近像素进行滤波处 理。  Also, in the case where the encoding mode is the MERGE mode, it is also possible to filter pixels near the boundary between the target image block and its neighboring blocks. Further, in the case where the optimal motion information is the first motion information, the pixels near the boundary between the sub-blocks of the target image block may be subjected to filtering processing.

在将本发明实施例应用于 AMVP模式的情况下, 可以根据该最优运动 信息, 结合另外熵解码得到的预测方向、 参考图像索引以及运动矢量差值, 推导得到目标图像块的运动信息。使用该运动信息对当前块进行运动补偿操 作。 在通过运动补偿获取当前块的预测信号后, 还可以叠加另外解码得到的 残差信号, 以获取重建信号。  In the case where the embodiment of the present invention is applied to the AMVP mode, the motion information of the target image block can be derived according to the optimal motion information, combined with the prediction direction, the reference image index, and the motion vector difference obtained by the additional entropy decoding. The motion information is used to perform motion compensation on the current block. After acquiring the prediction signal of the current block by motion compensation, the residual signal obtained by the additional decoding may also be superimposed to obtain the reconstructed signal.

根据本发明实施例的用于图像处理的方法, 在 MERGE或 AMVP等利 用邻近图像块的运动信息来确定当前处理的图像块的运动信息的技术中,通 过在运动信息列表中增加根据基本层图像运动信息确定的第一运动信息, 能 够在利用邻近图像块的运动信息来确定当前处理的图像块的运动信息的同 时, 利用基本层图像的运动信息来确定当前处理的图像块的运动信息, 提高 处理效率。 A method for image processing according to an embodiment of the present invention, in a technique of determining motion information of a currently processed image block using motion information of a neighboring image block, such as MERGE or AMVP, by adding a base layer image to the motion information list The first motion information determined by the motion information can determine the motion information of the currently processed image block by using motion information of the adjacent image block. At the time, the motion information of the currently processed image block is determined by using the motion information of the base layer image, thereby improving the processing efficiency.

上文中, 结合图 1至图 5 , 详细描述了根据本发明实施例的用于图像处 理的方法, 下面, 将结合图 6至图 7, 详细描述根据本发明实施例的用于图 像处理的装置。  Hereinabove, a method for image processing according to an embodiment of the present invention is described in detail with reference to FIGS. 1 to 5. Hereinafter, a device for image processing according to an embodiment of the present invention will be described in detail with reference to FIGS. 6 to 7. .

图 6示出了根据本发明实施例的用于图像处理的装置 300 的示意性框 图。 如图 6所示, 该装置 300包括:  Figure 6 shows a schematic block diagram of an apparatus 300 for image processing in accordance with an embodiment of the present invention. As shown in Figure 6, the apparatus 300 includes:

获取单元 310, 用于根据基本层图像块的运动信息确定目标图像块的第 一运动信息, 其中, 该的基本层图像块位于基本层图像中, 该目标图像块位 于增强层图像中, 该的基本层图像与该增强层图像相对应, 且该基本图像块 在该基本层图像中的空间位置与该目标图像块在该增强层图像中的空间位 置相对应;  The acquiring unit 310 is configured to determine first motion information of the target image block according to the motion information of the base layer image block, where the base layer image block is located in the base layer image, where the target image block is located in the enhancement layer image, where a base layer image corresponding to the enhancement layer image, and a spatial position of the base image block in the base layer image corresponds to a spatial position of the target image block in the enhancement layer image;

用于根据该增强层图像中与该目标图像块相邻的邻近图像块的运动信 息确定该目标图像块的第二运动信息, 并向生成单元 320传输该第一运动信 息和该第二运动信息;  And determining second motion information of the target image block according to motion information of the adjacent image block adjacent to the target image block in the enhancement layer image, and transmitting the first motion information and the second motion information to the generating unit 320 ;

生成单元 320, 用于从该获取单元获取该第一运动信息和该第二运动信 息, 并根据该第一运动信息和该第二运动信息, 生成运动信息列表, 以及, 向选择单元传输该运动信息列表;  a generating unit 320, configured to acquire the first motion information and the second motion information from the acquiring unit, generate a motion information list according to the first motion information and the second motion information, and transmit the motion to the selecting unit Information List;

选择单元 330, 用于从该生成单元 320获取该运动信息列表, 并根据预 定规则从该运动信息列表中确定该目标图像块的最优运动信息, 并向编码单 元 340传输该最优运动信息;  The selecting unit 330 is configured to acquire the motion information list from the generating unit 320, and determine optimal motion information of the target image block from the motion information list according to a predetermined rule, and transmit the optimal motion information to the encoding unit 340;

编码单元 340, 用于从选择单元 330获取该最优运动信息, 并根据该最 优运动信息, 对该目标图像块进行编码, 以生成目标码流, 该目标码流包括 用于指示该最优运动信息在该运动信息列表中的位置的第一索引信息。  The encoding unit 340 is configured to obtain the optimal motion information from the selecting unit 330, and encode the target image block according to the optimal motion information to generate a target code stream, where the target code stream includes The first index information of the position of the motion information in the motion information list.

可选地, 该获取单元 310具体用于根据该基本层图像块包括的与该目标 图像块中包含的目标图像子块对应的基本层图像子块的运动信息,确定该目 标图像子块的运动信息, 其中, 该目标图像块子块具有预先设定的大小; 用于根据该目标图像子块的运动信息, 确定该第一运动信息。  Optionally, the acquiring unit 310 is specifically configured to determine motion of the target image sub-block according to motion information of the base layer image sub-block corresponding to the target image sub-block included in the target image block included in the base layer image block. Information, wherein the target image block sub-block has a preset size; and is configured to determine the first motion information according to the motion information of the target image sub-block.

在本发明实施例中, 该基本层图像的质量低于该增强层图像的质量。 可选地, 该获取单元 310具体用于当与该至少两个目标图像子块中的第 一目标图像子块相对应的第一基本层图像子块的运动信息为空时,根据该目 标图像块的大小、该目标图像子块的大小和用于指示该第一目标图像子块在 该目标图像块中的位置的第二索引信息,确定该至少两个目标图像子块中的 第二目标图像子块; In an embodiment of the invention, the quality of the base layer image is lower than the quality of the enhancement layer image. Optionally, the acquiring unit 310 is specifically configured to: when the motion information of the first base layer image sub-block corresponding to the first target image sub-block in the at least two target image sub-blocks is empty, according to the Determining a size of the target image block, a size of the target image sub-block, and second index information indicating a position of the first target image sub-block in the target image block, determining a number of the at least two target image sub-blocks Two target image sub-blocks;

用于根据该第二目标图像子块的运动信息,确定该第一目标图像子块的 运动信息;  And determining, according to the motion information of the second target image sub-block, motion information of the first target image sub-block;

用于根据该第一目标图像子块的运动信息, 确定该第一运动信息; 或 用于根据该第二目标图像子块的运动信息, 确定该第一运动信息; 或 用于根据该第一目标图像子块的运动信息以及第二目标图像子块的运 动信息, 确定该第一运动信息。  Determining, according to the motion information of the first target image sub-block, the first motion information; or determining the first motion information according to the motion information of the second target image sub-block; or for using the first The motion information of the target image sub-block and the motion information of the second target image sub-block determine the first motion information.

可选地, 该获取单元 310具体用于根据以下任一公式, 确定该第二目标 图像子块,  Optionally, the obtaining unit 310 is specifically configured to determine the second target image sub-block according to any one of the following formulas.

Idx2 + {idx, %N/(N/2))x2 + (l- Idx, %N /(N / 4)%2))χ N /4 ;Idx 2 + {idx, %N/(N/2))x2 + (l- Idx, %N /(N / 4)%2))χ N /4 ;

Idx2

Figure imgf000049_0001
+ ((l - ldxx %N/(N/2))x2 + {ldxx %N / (N / 4) %2)) xN/4;Idx 2
Figure imgf000049_0001
+ ((l - ldx x %N/(N/2))x2 + {ldx x %N / (N / 4) %2)) xN/4;

W¾ =/^/NxN + ((l-/ x1 N/(N/2))x2 + (l-/^ N/(N/4) 2))xN/4; 其中, 表示用于指示该第二目标图像子块在该目标图像块中的位置 的第三索引信息, / 表示该第二索引信息, N是根据该目标图像块的大小 和该目标图像子块的大小确定的。 W3⁄4 = /^/NxN + ((l-/ x 1 N/(N/2))x2 + (l-/^ N/(N/4) 2))xN/4; where The third index information of the position of the second target image sub-block in the target image block, / represents the second index information, and N is determined according to the size of the target image block and the size of the target image sub-block.

可选地, 该获取单元 310具体用于如果该第二目标图像子块的运动信息 为空, 则确定该第一目标图像子块的运动信息为零运动信息。  Optionally, the acquiring unit 310 is specifically configured to determine that the motion information of the first target image sub-block is zero motion information if the motion information of the second target image sub-block is empty.

可选地, 该获取单元 310具体用于根据第三目标图像子块的运动信息, 确定该第一运动信息, 其中, 该第三目标图像子块为该目标图像块中位于预 设位置的目标图像子块, 或  Optionally, the acquiring unit 310 is specifically configured to determine the first motion information according to the motion information of the third target image sub-block, where the third target image sub-block is a target located in the target location in the target image block. Image sub-block, or

该第三目标图像子块的运动信息在该目标图像子块的运动信息中的出 现频率最高。  The motion information of the third target image sub-block has the highest frequency of occurrence in the motion information of the target image sub-block.

可选地, 该获取单元 310具体用于根据该第三目标图像子块的运动信息 的参考图像、 该目标图像和该目标图像块的参考图像的时域距离关系, 对该 第三目标图像子块的运动信息进行缩放处理;  Optionally, the acquiring unit 310 is specifically configured to: according to a reference image of the motion information of the third target image sub-block, a time domain distance relationship between the target image and a reference image of the target image block, the third target image The motion information of the block is scaled;

用于根据该缩放处理后的第三目标图像子块的运动信息,确定该第一运 动信息。  And determining the first motion information according to the motion information of the third target image sub-block after the scaling process.

可选地, 该目标图像块包括至少两个子块, 以及当该最优信息为该第一 运动信息时, 该编码单元 340还用于对位于该子块之间的边界附近的像素进 行去块效应滤波处理。 Optionally, the target image block includes at least two sub-blocks, and when the optimal information is the first motion information, the encoding unit 340 is further configured to enter a pixel located near a boundary between the sub-blocks. Line deblocking filtering.

可选地, 该第二运动信息包括时间运动信息和空间运动信息, 以及 该生成单元 320具体用于根据该第一运动信息和该第二运动信息,确定 运动信息列表, 以使该第一运动信息位于运动信息列表的首位; 或  Optionally, the second motion information includes time motion information and spatial motion information, and the generating unit 320 is specifically configured to determine, according to the first motion information and the second motion information, a motion information list, so that the first motion Information is at the top of the list of sports information; or

用于根据该第一运动信息和该第二运动信息, 确定运动信息列表, 以使 该第一运动信息位于运动信息列表的末位; 或  And determining, according to the first motion information and the second motion information, the motion information list, so that the first motion information is located at a last position of the motion information list; or

用于根据该第一运动信息和该第二运动信息, 确定运动信息列表, 以使 该第一运动信息位于该运动信息列表中的空间运动信息与该时间运动信息 之间。  And configured to determine, according to the first motion information and the second motion information, a motion information list, such that the first motion information is located between the spatial motion information in the motion information list and the time motion information.

可选地, 该第一索引信息包括用于指示该最优运动信息是否为该第一运 动信息的第一符号和用于指示该最优运动信息在该运动列表中的位置的第 二符号, 以及  Optionally, the first index information includes a first symbol for indicating whether the optimal motion information is the first motion information, and a second symbol for indicating a location of the optimal motion information in the motion list, as well as

该编码单元 340具体用于根据第一上下文模型,对该第一符号进行算术 编码处理;  The encoding unit 340 is specifically configured to perform arithmetic coding processing on the first symbol according to the first context model;

用于根据第二上下文模型, 对该第二符号进行算术编码处理, 其中, 该 第一上下文模型与该第二上下文模型相异。  And performing arithmetic coding processing on the second symbol according to the second context model, wherein the first context model is different from the second context model.

根据本发明实施例的用于图像处理的装置 300可对应于本发明实施例的 方法中的编码端, 并且, 该图像处理的装置 300中的各单元即模块和上述其 他操作和 /或功能分别为了实现图 1中的方法 100的相应流程, 为了筒洁,在 此不再赘述。  The apparatus 300 for image processing according to an embodiment of the present invention may correspond to an encoding end in the method of the embodiment of the present invention, and each unit in the image processing apparatus 300, that is, a module and the above other operations and/or functions respectively In order to implement the corresponding process of the method 100 in FIG. 1, for the sake of cleaning, no further details are provided herein.

根据本发明实施例的用于图像处理的装置, 在 MERGE或 AMVP等利 用邻近图像块的运动信息来确定当前处理的图像块的运动信息的技术中,通 过在运动信息列表中增加根据基本层图像运动信息确定的第一运动信息, 能 够在利用邻近图像块的运动信息来确定当前处理的图像块的运动信息的同 时, 利用基本层图像的运动信息来确定当前处理的图像块的运动信息, 提高 处理效率。  An apparatus for image processing according to an embodiment of the present invention, in a technique of determining motion information of a currently processed image block using motion information of a neighboring image block, such as MERGE or AMVP, by adding a base layer image to the motion information list The first motion information determined by the motion information can determine the motion information of the currently processed image block by using the motion information of the base layer image while determining the motion information of the currently processed image block by using the motion information of the adjacent image block. Processing efficiency.

图 7 示出了根据本发明实施例的用于图像处理的装置 400 的示意性框 图。 如图 7所示, 该装置 400包括:  FIG. 7 shows a schematic block diagram of an apparatus 400 for image processing in accordance with an embodiment of the present invention. As shown in Figure 7, the apparatus 400 includes:

获取单元 410, 用于根据基本层图像块的运动信息确定目标图像块的第 一运动信息, 其中, 该的基本层图像块位于基本层图像中, 该目标图像块位 于增强层图像中, 该的基本层图像与该增强层图像相对应, 且该基本图像块 在该基本层图像中的空间位置与该目标图像块在该增强层图像中的空间位 置相对应; The acquiring unit 410 is configured to determine first motion information of the target image block according to the motion information of the base layer image block, where the base layer image block is located in the base layer image, where the target image block is located in the enhancement layer image, where The base layer image corresponds to the enhancement layer image, and the basic image block a spatial position in the base layer image corresponding to a spatial position of the target image block in the enhancement layer image;

用于根据该增强层图像中与该目标图像块相邻的邻近图像块的运动信 息确定该目标图像块的第二运动信息, 并向生成单元 420传输该第一运动信 息和该第二运动信息;  And determining second motion information of the target image block according to motion information of the adjacent image block adjacent to the target image block in the enhancement layer image, and transmitting the first motion information and the second motion information to the generating unit 420 ;

生成单元 420, 用于从该获取单元 410获取该第一运动信息和该第二运 动信息, 并根据该第一运动信息和该第二运动信息, 生成运动信息列表, 以 及, 向确定单元 430传输该运动信息列表;  The generating unit 420 is configured to acquire the first motion information and the second motion information from the acquiring unit 410, generate a motion information list according to the first motion information and the second motion information, and transmit the motion information list to the determining unit 430. The list of sports information;

确定单元 430, 用于根据目标码流, 确定用于指示该最优运动信息在该 运动信息列表中的位置的第一索引信息;  a determining unit 430, configured to determine, according to the target code stream, first index information used to indicate a location of the optimal motion information in the motion information list;

解码单元 440, 用于从该生成单元 420获取该运动信息列表, 并根据该 确定单元 430确定的该第一索引信息,从该运动信息列表中确定最优运动信 息, 根据该最优运动信息, 对该目标码流进行解码, 以获取该目标图像块对 该目标码流进行解码, 以获取该目标图像块。  The decoding unit 440 is configured to obtain the motion information list from the generating unit 420, and determine optimal motion information from the motion information list according to the first index information determined by the determining unit 430, according to the optimal motion information, Decoding the target code stream to obtain the target image block to decode the target code stream to obtain the target image block.

在本发明实施例中, 该基本层图像的质量低于该增强层图像的质量。 可选地, 该获取单元 410具体用于根据该基本层图像块包括的与该目标 图像块中包含的目标图像子块对应的基本层图像子块的运动信息,确定该目 标图像子块的运动信息, 其中, 该目标图像块子块具有预先设定的大小; 用于根据该目标图像子块的运动信息, 确定该第一运动信息。  In an embodiment of the invention, the quality of the base layer image is lower than the quality of the enhancement layer image. Optionally, the acquiring unit 410 is specifically configured to determine motion of the target image sub-block according to motion information of the base layer image sub-block corresponding to the target image sub-block included in the target image block included in the base layer image block. Information, wherein the target image block sub-block has a preset size; and is configured to determine the first motion information according to the motion information of the target image sub-block.

该目标图像块包括至少两个目标图像子块, 以及  The target image block includes at least two target image sub-blocks, and

该获取单元 410具体用于当与该至少两个目标图像子块中的第一目标图 像子块相对应的第一基本层图像子块的运动信息为空时,根据该目标图像块 的大小、该目标图像子块的大小和用于指示该第一目标图像子块在该目标图 像块中的位置的第二索引信息,确定该至少两个目标图像子块中的第二目标 图像子块;  The acquiring unit 410 is specifically configured to: when the motion information of the first base layer image sub-block corresponding to the first target image sub-block in the at least two target image sub-blocks is empty, according to the size of the target image block, Determining a size of the target image sub-block and second index information indicating a position of the first target image sub-block in the target image block, and determining a second target image sub-block in the at least two target image sub-blocks;

用于根据该第二目标图像子块的运动信息,确定该第一目标图像子块的 运动信息;  And determining, according to the motion information of the second target image sub-block, motion information of the first target image sub-block;

用于根据该第一目标图像子块的运动信息, 确定该第一运动信息; 或 用于根据该第二目标图像子块的运动信息, 确定该第一运动信息; 或 用于根据该第一目标图像子块的运动信息以及第二目标图像子块的运 动信息, 确定该第一运动信息。 可选地, 该获取单元 410具体用于根据以下任一公式, 确定该第二目标 图像子块, Determining, according to the motion information of the first target image sub-block, the first motion information; or determining the first motion information according to the motion information of the second target image sub-block; or for using the first The motion information of the target image sub-block and the motion information of the second target image sub-block determine the first motion information. Optionally, the acquiring unit 410 is specifically configured to determine the second target image sub-block according to any one of the following formulas.

Idx2 + idx, %N/(N/2))x2 + (l- Idxl %N /(N / 4)%2))χ N /4 ;Idx 2 + idx, %N/(N/2))x2 + (l- Idx l %N /(N / 4)%2))χ N /4 ;

Idx2

Figure imgf000052_0001
+ ((l - ldxx %N/(N/2))x2 + (ldxx %N / (N / 4) %2)) xN/4; W¾ =/^/NxN + ((l-/ x1 N/(N/2))x2 + (l-/^ N/(N/4) 2))xN/4; 其中, 表示用于指示该第二目标图像子块在该目标图像块中的位置 的第三索引信息, / 表示该第二索引信息, N是根据该目标图像块的大小 和该预设值确定的。 Idx 2
Figure imgf000052_0001
+ ((l - ldx x %N/(N/2))x2 + (ldx x %N / (N / 4) %2)) xN/4; W3⁄4 =/^/NxN + ((l-/ x 1 N/(N/2))x2 + (l-/^ N/(N/4) 2))xN/4; wherein, the representation is used to indicate that the second target image sub-block is in the target image block The third index information of the location, / represents the second index information, and N is determined according to the size of the target image block and the preset value.

可选地, 该获取单元 410具体用于如果该第二目标图像子块的运动信息 为空, 则确定该第一目标图像子块的运动信息为零运动信息。  Optionally, the acquiring unit 410 is specifically configured to determine that the motion information of the first target image sub-block is zero motion information if the motion information of the second target image sub-block is empty.

可选地, 该获取单元 410具体用于根据第三目标图像子块的运动信息, 确定该第一运动信息, 其中, 该第三目标图像子块为该目标图像块中位于预 设位置的子块, 或  Optionally, the acquiring unit 410 is specifically configured to determine the first motion information according to the motion information of the third target image sub-block, where the third target image sub-block is a sub-block located in the target image block. Block, or

该第三目标图像子块的运动信息在该子块的运动信息中的出现频率最 高。  The motion information of the third target image sub-block has the highest frequency of occurrence in the motion information of the sub-block.

可选地, 该获取单元 410具体用于根据该第三目标图像子块的运动信息 的参考图像、 该目标图像和该目标图像块的参考图像的时域距离关系, 对该 第三目标图像子块的运动信息进行缩放处理;  Optionally, the acquiring unit 410 is specifically configured to: according to a reference image of the motion information of the third target image sub-block, a time domain distance relationship between the target image and a reference image of the target image block, the third target image The motion information of the block is scaled;

用于根据该缩放处理后的第三目标图像子块的运动信息,确定该第一运 动信息。  And determining the first motion information according to the motion information of the third target image sub-block after the scaling process.

可选地, 当该最优信息为该第一运动信息时, 该目标图像块包括至少两 个子块, 以及该解码单元 430还用于位于该子块之间的边界附近的像素进行 去块效应滤波处理。  Optionally, when the optimal information is the first motion information, the target image block includes at least two sub-blocks, and the decoding unit 430 is further configured to perform deblocking on pixels located near a boundary between the sub-blocks. Filter processing.

可选地, 该第二运动信息包括时间运动信息和空间运动信息, 以及 该生成单元 420具体用于根据该第一运动信息和该第二运动信息,确定 运动信息列表, 以使该第一运动信息位于运动信息列表的首位; 或  Optionally, the second motion information includes time motion information and spatial motion information, and the generating unit 420 is specifically configured to determine, according to the first motion information and the second motion information, a motion information list, so that the first motion Information is at the top of the list of sports information; or

用于根据该第一运动信息和该第二运动信息, 确定运动信息列表, 以使 该第一运动信息位于运动信息列表的末位; 或  And determining, according to the first motion information and the second motion information, the motion information list, so that the first motion information is located at a last position of the motion information list; or

用于根据该第一运动信息和该第二运动信息, 确定运动信息列表, 以使 该第一运动信息位于该运动信息列表中的空间运动信息与该时间运动信息 之间。 可选地, 该第一索引信息包括用于指示该最优运动信息是否为该第一运 动信息的第一符号和用于指示该最优运动信息在该运动列表中的位置的第 二符号, 以及 And configured to determine, according to the first motion information and the second motion information, a motion information list, so that the first motion information is located between the spatial motion information in the motion information list and the time motion information. Optionally, the first index information includes a first symbol for indicating whether the optimal motion information is the first motion information, and a second symbol for indicating a location of the optimal motion information in the motion list, as well as

该解码单元 430具体用于根据第一上下文模型,对该第一符号进行算术 解码处理, 并根据第二上下文模型, 对该第二符号进行算术解码处理, 以根 据该算术解码处理后的第一索引信息,从该运动信息列表中确定最优运动信 息, 其中, 该第一上下文模型与该第二上下文模型相异。  The decoding unit 430 is specifically configured to perform arithmetic decoding processing on the first symbol according to the first context model, and perform arithmetic decoding processing on the second symbol according to the second context model, to perform the first processing according to the arithmetic decoding process. The index information determines the optimal motion information from the motion information list, wherein the first context model is different from the second context model.

根据本发明实施例的用于图像处理的装置 400可对应于本发明实施例的 方法中解码端, 并且, 该用于图像处理的装置 400中的各单元即模块和上述 其他操作和 /或功能分别为了实现图 5中的方法 200的相应流程, 为了筒洁, 在此不再赘述。  The apparatus 400 for image processing according to an embodiment of the present invention may correspond to a decoding end in the method of the embodiment of the present invention, and the units in the apparatus 400 for image processing, that is, modules and other operations and/or functions described above In order to implement the corresponding processes of the method 200 in FIG. 5, respectively, for the sake of cleaning, no further details are provided herein.

根据本发明实施例的用于图像处理的装置, 在 MERGE或 AMVP等利 用邻近图像块的运动信息来确定当前处理的图像块的运动信息的技术中,通 过在运动信息列表中增加根据基本层图像运动信息确定的第一运动信息, 能 够在利用邻近图像块的运动信息来确定当前处理的图像块的运动信息的同 时, 利用基本层图像的运动信息来确定当前处理的图像块的运动信息, 提高 处理效率。  An apparatus for image processing according to an embodiment of the present invention, in a technique of determining motion information of a currently processed image block using motion information of a neighboring image block, such as MERGE or AMVP, by adding a base layer image to the motion information list The first motion information determined by the motion information can determine the motion information of the currently processed image block by using the motion information of the base layer image while determining the motion information of the currently processed image block by using the motion information of the adjacent image block. Processing efficiency.

上文中, 结合图 1至图 7, 详细描述了根据本发明实施例的用于图像处 理的方法和装置, 下面将结合图 8和图 9, 详细描述根据本发明实施例的用 于图像处理的编码器和解码器。  Hereinabove, a method and apparatus for image processing according to an embodiment of the present invention are described in detail with reference to FIGS. 1 through 7, and a method for image processing according to an embodiment of the present invention will be described in detail below with reference to FIGS. 8 and 9. Encoder and decoder.

图 8示出了根据本发明实施例的用于图像处理的编码器 500的示意性框 图。 如图 8所示, 该编码器 500可以包括:  Fig. 8 shows a schematic block diagram of an encoder 500 for image processing in accordance with an embodiment of the present invention. As shown in FIG. 8, the encoder 500 can include:

总线 510;  Bus 510;

与该总线相连的处理器 520;  a processor 520 connected to the bus;

与该总线相连的存储器 530;  a memory 530 connected to the bus;

其中,该处理器 520通过该总线 510,调用该存储器 530中存储的程序, 以用于根据基本层图像块的运动信息确定目标图像块的第一运动信息, 其 中,该的基本层图像块位于基本层图像中,该目标图像块位于增强层图像中, 该的基本层图像与该增强层图像相对应,且该基本图像块在该基本层图像中 的空间位置与该目标图像块在该增强层图像中的空间位置相对应;  The processor 520, through the bus 510, invokes a program stored in the memory 530, for determining first motion information of the target image block according to motion information of the base layer image block, where the base layer image block is located In the base layer image, the target image block is located in the enhancement layer image, the base layer image corresponding to the enhancement layer image, and the spatial position of the basic image block in the base layer image and the target image block are in the enhancement The spatial position in the layer image corresponds;

用于根据该增强层图像中与该目标图像块相邻的邻近图像块的运动信 息确定该目标图像块的第二运动信息; a motion signal for a neighboring image block adjacent to the target image block in the enhancement layer image Determining second motion information of the target image block;

用于根据该第一运动信息和该第二运动信息, 生成运动信息列表; 用于根据预定规则从该运动信息列表中确定该目标图像块的最优运动 信息;  And configured to generate, according to the first motion information and the second motion information, a motion information list, configured to determine, according to a predetermined rule, optimal motion information of the target image block from the motion information list;

用于根据该最优运动信息,对该目标图像块进行编码,以生成目标码流, 该目标码流包括用于指示该最优运动信息在该运动信息列表中的位置的第 一索引信息。  And for encoding the target image block according to the optimal motion information to generate a target code stream, where the target code stream includes first index information for indicating a position of the optimal motion information in the motion information list.

在本发明实施例中, 该基本层图像的质量低于该增强层图像的质量。 可选地,该处理器 520具体用于根据该基本层图像块包括的与该目标图 像块中包含的目标图像子块对应的基本层图像子块的运动信息,确定该目标 图像子块的运动信息, 其中, 该目标图像块子块具有预先设定的大小;  In an embodiment of the invention, the quality of the base layer image is lower than the quality of the enhancement layer image. Optionally, the processor 520 is configured to determine motion of the target image sub-block according to motion information of the base layer image sub-block corresponding to the target image sub-block included in the target image block included in the base layer image block. Information, wherein the target image block sub-block has a preset size;

根据该目标图像子块的运动信息, 确定该第一运动信息。  The first motion information is determined according to motion information of the target image sub-block.

可选地, 该目标图像块包括至少两个目标图像子块, 以及  Optionally, the target image block includes at least two target image sub-blocks, and

该处理器 520具体用于当与该至少两个目标图像子块中的第一目标图像 子块相对应的第一基本层图像子块的运动信息为空时,根据该目标图像块的 大小、该目标图像子块的大小和用于指示该第一目标图像子块在该目标图像 块中的位置的第二索引信息,确定该至少两个目标图像子块中的第二目标图 像子块;  The processor 520 is specifically configured to: when the motion information of the first base layer image sub-block corresponding to the first target image sub-block of the at least two target image sub-blocks is empty, according to the size of the target image block, Determining a size of the target image sub-block and second index information indicating a position of the first target image sub-block in the target image block, and determining a second target image sub-block in the at least two target image sub-blocks;

用于根据该第二目标图像子块的运动信息,确定该第一目标图像子块的 运动信息;  And determining, according to the motion information of the second target image sub-block, motion information of the first target image sub-block;

用于根据该第一目标图像子块的运动信息, 确定该第一运动信息; 或 用于根据该第二目标图像子块的运动信息, 确定该第一运动信息; 或 用于根据该第一目标图像子块的运动信息以及第二目标图像子块的运 动信息, 确定该第一运动信息。  Determining, according to the motion information of the first target image sub-block, the first motion information; or determining the first motion information according to the motion information of the second target image sub-block; or for using the first The motion information of the target image sub-block and the motion information of the second target image sub-block determine the first motion information.

可选地, 该处理器 520具体用于根据以下任一公式, 确定该第二目标图 像子块,  Optionally, the processor 520 is specifically configured to determine the second target image sub-block according to any one of the following formulas.

Idx2 + idx, %N/(N/2))x2 + (l- Idxl %N /(N / 4)%2))χ N /4 ; Idx2

Figure imgf000054_0001
+ ((l - ldxx %N/(N/2))x2 + (ldxx %N / (N / 4) %2)) xN/4; W¾ =/^/NxN + ((l-/ x1 N/(N/2))x2 + (l-/^ N/(N/4) 2))xN/4; 其中, 表示用于指示该第二目标图像子块在该目标图像块中的位置 的第三索引信息, / 表示该第二索引信息, N是根据该目标图像块的大小 和该目标图像子块的大小确定的。 Idx 2 + idx, %N/(N/2))x2 + (l- Idx l %N /(N / 4)%2))χ N /4 ; Idx 2
Figure imgf000054_0001
+ ((l - ldx x %N/(N/2))x2 + (ldx x %N / (N / 4) %2)) xN/4; W3⁄4 =/^/NxN + ((l-/ x 1 N/(N/2))x2 + (l-/^ N/(N/4) 2))xN/4; wherein, the representation is used to indicate that the second target image sub-block is in the target image block The third index information of the location, / represents the second index information, and N is based on the size of the target image block And the size of the target image sub-block is determined.

可选地,该处理器 520具体用于如果该第二目标图像子块的运动信息为 空, 则确定该第一目标图像子块的运动信息为零运动信息。  Optionally, the processor 520 is specifically configured to determine that the motion information of the first target image sub-block is zero motion information if the motion information of the second target image sub-block is empty.

可选地, 该处理器 520具体用于根据第三目标图像子块的运动信息, 确 定该第一运动信息, 其中, 该第三目标图像子块为该目标图像块中位于预设 位置的目标图像子块, 或  Optionally, the processor 520 is specifically configured to determine the first motion information according to the motion information of the third target image sub-block, where the third target image sub-block is a target located in the target location in the target image block. Image sub-block, or

该第三目标图像子块的运动信息在该目标图像子块的运动信息中的出 现频率最高。  The motion information of the third target image sub-block has the highest frequency of occurrence in the motion information of the target image sub-block.

可选地,该处理器 520具体用于根据该第三目标图像子块的运动信息的 参考图像、 该目标图像和该目标图像块的参考图像的时域距离关系, 对该第 三目标图像子块的运动信息进行缩放处理;  Optionally, the processor 520 is specifically configured to: according to a reference image of the motion information of the third target image sub-block, a time domain distance relationship between the target image and a reference image of the target image block, to the third target image The motion information of the block is scaled;

用于根据该缩放处理后的第三目标图像子块的运动信息,确定该第一运 动信息。  And determining the first motion information according to the motion information of the third target image sub-block after the scaling process.

可选地, 该目标图像块包括至少两个目标图像子块, 以及  Optionally, the target image block includes at least two target image sub-blocks, and

当该最优信息为该第一运动信息时,该处理器 520还用于对位于该目标 图像子块之间的边界附近的像素进行去块效应滤波处理。  When the optimal information is the first motion information, the processor 520 is further configured to perform a deblocking filtering process on pixels located near a boundary between the target image sub-blocks.

可选地, 该第二运动信息包括时间运动信息和空间运动信息, 以及 该处理器 520具体用于根据该第一运动信息和该第二运动信息,确定运 动信息列表, 以使该第一运动信息位于运动信息列表的首位; 或  Optionally, the second motion information includes time motion information and spatial motion information, and the processor 520 is specifically configured to determine, according to the first motion information and the second motion information, a motion information list, so that the first motion Information is at the top of the list of sports information; or

用于根据该第一运动信息和该第二运动信息, 确定运动信息列表, 以使 该第一运动信息位于运动信息列表的末位; 或  And determining, according to the first motion information and the second motion information, the motion information list, so that the first motion information is located at a last position of the motion information list; or

用于根据该第一运动信息和该第二运动信息, 确定运动信息列表, 以使 该第一运动信息位于该运动信息列表中的空间运动信息与该时间运动信息 之间。  And configured to determine, according to the first motion information and the second motion information, a motion information list, such that the first motion information is located between the spatial motion information in the motion information list and the time motion information.

可选地, 该第一索引信息包括用于指示该最优运动信息是否为该第一运 动信息的第一符号和用于指示该最优运动信息在该运动列表中的位置的第 二符号, 以及  Optionally, the first index information includes a first symbol for indicating whether the optimal motion information is the first motion information, and a second symbol for indicating a location of the optimal motion information in the motion list, as well as

该处理器 520具体用于根据第一上下文模型,对该第一符号进行算术编 码处理;  The processor 520 is specifically configured to perform arithmetic coding processing on the first symbol according to the first context model;

用于根据第二上下文模型, 对该第二符号进行算术编码处理, 其中, 该 第一上下文模型与该第二上下文模型相异。 根据本发明实施例的用于图像处理的编码器 500可对应于本发明实施例 的方法中编码端, 并且, 该用于图像处理的编码器 500中的各单元即模块和 上述其他操作和 /或功能分别为了实现图 1中的方法 100的相应流程,为了筒 洁, 在此不再赘述。 And performing arithmetic coding processing on the second symbol according to the second context model, where the first context model is different from the second context model. The encoder 500 for image processing according to an embodiment of the present invention may correspond to an encoding end in the method of the embodiment of the present invention, and each unit in the encoder 500 for image processing, that is, a module and the above-described other operations and/or For the purpose of implementing the corresponding process of the method 100 in FIG. 1 , the functions are not described here.

根据本发明实施例的用于图像处理的编码器, 在 MERGE或 AMVP等 利用邻近图像块的运动信息来确定当前处理的图像块的运动信息的技术中, 通过在运动信息列表中增加根据基本层图像运动信息确定的第一运动信息, 能够在利用邻近图像块的运动信息来确定当前处理的图像块的运动信息的 同时, 利用基本层图像的运动信息来确定当前处理的图像块的运动信息, 提 高处理效率。  An encoder for image processing according to an embodiment of the present invention, in a technique of determining motion information of a currently processed image block using motion information of a neighboring image block, such as MERGE or AMVP, by adding a base layer according to the motion information list The first motion information determined by the image motion information can determine the motion information of the currently processed image block by using the motion information of the base layer image while determining the motion information of the currently processed image block by using the motion information of the adjacent image block. Improve processing efficiency.

图 9示出了根据本发明实施例的用于图像处理的解码器 600的示意性框 图。 如图 9所示, 该解码器 600可以包括:  FIG. 9 shows a schematic block diagram of a decoder 600 for image processing in accordance with an embodiment of the present invention. As shown in FIG. 9, the decoder 600 can include:

总线 610;  Bus 610;

与该总线相连的处理器 620;  a processor 620 connected to the bus;

与该总线相连的存储器 630;  a memory 630 connected to the bus;

其中,该处理器 620通过该总线 610,调用该存储器 630中存储的程序, 以用于根据基本层图像块的运动信息确定目标图像块的第一运动信息, 其 中,该的基本层图像块位于基本层图像中,该目标图像块位于增强层图像中, 该的基本层图像与该增强层图像相对应,且该基本图像块在该基本层图像中 的空间位置与该目标图像块在该增强层图像中的空间位置相对应;  The processor 620 calls, by using the bus 610, a program stored in the memory 630, for determining first motion information of the target image block according to motion information of the base layer image block, where the base layer image block is located. In the base layer image, the target image block is located in the enhancement layer image, the base layer image corresponding to the enhancement layer image, and the spatial position of the basic image block in the base layer image and the target image block are in the enhancement The spatial position in the layer image corresponds;

用于根据该增强层图像中与该目标图像块相邻的邻近图像块的运动信 息确定该目标图像块的第二运动信息;  And determining second motion information of the target image block according to motion information of the adjacent image block adjacent to the target image block in the enhancement layer image;

用于根据该第一运动信息和该第二运动信息, 生成运动信息列表; 用于根据目标码流, 获取用于指示该最优运动信息在该运动信息列表中 的位置的第一索引信息;  And configured to generate, according to the first motion information and the second motion information, a motion information list, configured to acquire, according to the target code stream, first index information used to indicate a location of the optimal motion information in the motion information list;

用于根据该第一索引信息, 从该运动信息列表中确定最优运动信息, 根 据该最优运动信息, 对该目标码流进行解码, 以获取该目标图像块。  And determining, according to the first index information, optimal motion information from the motion information list, and decoding the target code stream according to the optimal motion information to obtain the target image block.

在本发明实施例中, 该基本层图像的质量低于该增强层图像的质量。 可选地,该处理器 620具体用于根据该基本层图像块包括的与该目标图 像块中包含的目标图像子块对应的基本层图像子块的运动信息,确定该目标 图像子块的运动信息, 其中, 该目标图像块子块具有预先设定的大小; 根据该目标图像子块的运动信息, 确定该第一运动信息。 In an embodiment of the invention, the quality of the base layer image is lower than the quality of the enhancement layer image. Optionally, the processor 620 is configured to determine motion of the target image sub-block according to motion information of the base layer image sub-block corresponding to the target image sub-block included in the target image block included in the base layer image block. Information, wherein the target image block sub-block has a preset size; The first motion information is determined according to motion information of the target image sub-block.

可选地, 该目标图像块包括至少两个目标图像子块, 以及  Optionally, the target image block includes at least two target image sub-blocks, and

该处理器 620具体用于当与该至少两个目标图像子块中的第一目标图像 子块相对应的第一基本层图像子块的运动信息为空时,根据该目标图像块的 大小、该目标图像子块的大小和用于指示该第一目标图像子块在该目标图像 块中的位置的第二索引信息,确定该至少两个目标图像子块中的第二目标图 像子块;  The processor 620 is specifically configured to: when the motion information of the first base layer image sub-block corresponding to the first target image sub-block of the at least two target image sub-blocks is empty, according to the size of the target image block, Determining a size of the target image sub-block and second index information indicating a position of the first target image sub-block in the target image block, and determining a second target image sub-block in the at least two target image sub-blocks;

用于根据该第二目标图像子块的运动信息,确定该第一目标图像子块的 运动信息;  And determining, according to the motion information of the second target image sub-block, motion information of the first target image sub-block;

用于根据该第一目标图像子块的运动信息, 确定该第一运动信息; 或 用于根据该第二目标图像子块的运动信息, 确定该第一运动信息; 或 用于根据该第一目标图像子块的运动信息以及第二目标图像子块的运 动信息, 确定该第一运动信息。  Determining, according to the motion information of the first target image sub-block, the first motion information; or determining the first motion information according to the motion information of the second target image sub-block; or for using the first The motion information of the target image sub-block and the motion information of the second target image sub-block determine the first motion information.

可选地, 该处理器 620具体用于根据以下任一公式, 确定该第二目标图 像子块,  Optionally, the processor 620 is specifically configured to determine the second target image sub-block according to any one of the following formulas.

Idx2 / 2)) χ 2 + (1 - Idxl %N /(N/4) %2)) xN/4;Idx 2 / 2)) χ 2 + (1 - Idx l %N /(N/4) %2)) xN/4;

Idx2

Figure imgf000057_0001
(N/2))x2 + (ldxx %N / (N / 4) %2)) xN/4;Idx 2
Figure imgf000057_0001
(N/2))x2 + (ldx x %N / (N / 4) %2)) xN/4;

W¾ =/^/NxN + ((l-/ x1 N/(N/2))x2 + (l-/^ N/(N/4) 2))xN/4; 其中, 表示用于指示该第二目标图像子块在该目标图像块中的位置 的第三索引信息, / 表示该第二索引信息, N是根据该目标图像块的大小 和该目标图像子块的大小确定的。 W3⁄4 = /^/NxN + ((l-/ x 1 N/(N/2))x2 + (l-/^ N/(N/4) 2))xN/4; where The third index information of the position of the second target image sub-block in the target image block, / represents the second index information, and N is determined according to the size of the target image block and the size of the target image sub-block.

可选地,该处理器 620具体用于如果该第二目标图像子块的运动信息为 空, 则确定该第一目标图像子块的运动信息为零运动信息。  Optionally, the processor 620 is specifically configured to determine that the motion information of the first target image sub-block is zero motion information if the motion information of the second target image sub-block is empty.

可选地, 该处理器 620具体用于根据第三目标图像子块的运动信息, 确 定该第一运动信息, 其中, 该第三目标图像子块为该目标图像块中位于预设 位置的目标图像子块, 或  Optionally, the processor 620 is specifically configured to determine the first motion information according to the motion information of the third target image sub-block, where the third target image sub-block is a target located in the target location in the target image block. Image sub-block, or

该第三目标图像子块的运动信息在该目标图像子块的运动信息中的出 现频率最高。  The motion information of the third target image sub-block has the highest frequency of occurrence in the motion information of the target image sub-block.

可选地,该处理器 620具体用于根据该第三目标图像子块的运动信息的 参考图像、 该目标图像和该目标图像块的参考图像的时域距离关系, 对该第 三目标图像子块的运动信息进行缩放处理; 用于根据该缩放处理后的第三目标图像子块的运动信息,确定该第一运 动信息。 Optionally, the processor 620 is specifically configured to: according to a reference image of the motion information of the third target image sub-block, a time domain distance relationship between the target image and a reference image of the target image block, the third target image The motion information of the block is scaled; And determining the first motion information according to the motion information of the third target image sub-block after the scaling process.

可选地, 该目标图像块包括至少两个目标图像子块, 以及  Optionally, the target image block includes at least two target image sub-blocks, and

当该最优信息为该第一运动信息时, 该处理器 620还用于对位于该目标 图像子块之间的边界附近的像素进行去块效应滤波处理。  When the optimal information is the first motion information, the processor 620 is further configured to perform deblocking filtering processing on pixels located near a boundary between the target image sub-blocks.

可选地, 该第二运动信息包括时间运动信息和空间运动信息, 以及 该处理器 620具体用于根据该第一运动信息和该第二运动信息,确定运 动信息列表, 以使该第一运动信息位于运动信息列表的首位; 或  Optionally, the second motion information includes time motion information and spatial motion information, and the processor 620 is specifically configured to determine, according to the first motion information and the second motion information, a motion information list, so that the first motion Information is at the top of the list of sports information; or

用于根据该第一运动信息和该第二运动信息, 确定运动信息列表, 以使 该第一运动信息位于运动信息列表的末位; 或  And determining, according to the first motion information and the second motion information, the motion information list, so that the first motion information is located at a last position of the motion information list; or

用于根据该第一运动信息和该第二运动信息, 确定运动信息列表, 以使 该第一运动信息位于该运动信息列表中的空间运动信息与该时间运动信息 之间。  And configured to determine, according to the first motion information and the second motion information, a motion information list, such that the first motion information is located between the spatial motion information in the motion information list and the time motion information.

可选地, 该第一索引信息包括用于指示该最优运动信息是否为该第一运 动信息的第一符号和用于指示该最优运动信息在该运动列表中的位置的第 二符号, 以及  Optionally, the first index information includes a first symbol for indicating whether the optimal motion information is the first motion information, and a second symbol for indicating a location of the optimal motion information in the motion list, as well as

该处理器 620具体用于根据第一上下文模型,对该第一符号进行算术解 码处理, 并根据第二上下文模型, 对该第二符号进行算术解码处理, 以根据 该算术解码处理后的第一索引信息, 从该运动信息列表中确定最优运动信 息, 其中, 该第一上下文模型与该第二上下文模型相异。  The processor 620 is specifically configured to perform arithmetic decoding processing on the first symbol according to the first context model, and perform arithmetic decoding processing on the second symbol according to the second context model, to perform the first processing according to the arithmetic decoding process. Index information, determining optimal motion information from the motion information list, wherein the first context model is different from the second context model.

根据本发明实施例的用于图像处理的解码器 600可对应于本发明实施例 的方法中解码端, 并且, 该用于图像处理的解码器 600中的各单元即模块和 上述其他操作和 /或功能分别为了实现图 5中的方法 200的相应流程,为了筒 洁, 在此不再赘述。  The decoder 600 for image processing according to an embodiment of the present invention may correspond to a decoding end in the method of the embodiment of the present invention, and each unit in the decoder 600 for image processing, that is, a module and the other operations described above and/or For the purpose of implementing the corresponding process of the method 200 in FIG. 5, the functions are not described here.

根据本发明实施例的用于图像处理的解码器, 在 MERGE或 AMVP等 利用邻近图像块的运动信息来确定当前处理的图像块的运动信息的技术中, 通过在运动信息列表中增加根据基本层图像运动信息确定的第一运动信息, 能够在利用邻近图像块的运动信息来确定当前处理的图像块的运动信息的 同时, 利用基本层图像的运动信息来确定当前处理的图像块的运动信息, 提 高处理效率。  A decoder for image processing according to an embodiment of the present invention, in a technique of determining motion information of a currently processed image block using motion information of a neighboring image block, such as MERGE or AMVP, by adding a base layer in the motion information list The first motion information determined by the image motion information can determine the motion information of the currently processed image block by using the motion information of the base layer image while determining the motion information of the currently processed image block by using the motion information of the adjacent image block. Improve processing efficiency.

应理解, 在本发明实施例中, 第一目标图像子块可以是一个也可以是多 个, 本发明并未特别限定。 同样, 第三目标图像子块可以是一个也可以是多 个, 本发明并未特别限定。 It should be understood that, in the embodiment of the present invention, the first target image sub-block may be one or more The present invention is not particularly limited. Similarly, the third target image sub-block may be one or plural, and the present invention is not particularly limited.

应理解, 在本发明实施例中, 编码端的处理与解码端的处理中获取第一 运动信息和生成运动信息列表的过程相对应, 以确保编码端与解码端最终确 定的运动信息列表一致, 从而, 对以一个第一索引信息(编码端确定并通过 码流传输给解码端 )在编码端与解码端确定的运动信息列表中指示的运动信 息相同。 编码端与解码端的其他编码操作与解码操作可以相对应。 换言之, 可以根据所描述的编码端处理方法对应的确定解码端处理方法,或者根据所 描述的解码端处理方法对应的确定编码端处理方法。  It should be understood that, in the embodiment of the present invention, the processing of the encoding end corresponds to the process of acquiring the first motion information and generating the motion information list in the processing of the decoding end, so as to ensure that the encoding end is consistent with the motion information list finally determined by the decoding end, thereby The motion information indicated in the motion information list determined at the encoding end and the decoding end by the first index information (determined by the encoding end and transmitted to the decoding end by the code stream) is the same. Other encoding operations and decoding operations of the encoding end and the decoding end may correspond. In other words, the decoding end processing method corresponding to the described encoding end processing method may be determined, or the encoding end processing method corresponding to the described decoding end processing method may be determined.

应理解, 本文中术语 "和 /或", 仅仅是一种描述关联对象的关联关系, 表示可以存在三种关系, 例如, A和 /或 B, 可以表示: 单独存在 A, 同时存 在 A和 B, 单独存在 B这三种情况。 另外, 本文中字符 "/" , 一般表示前后 关联对象是一种 "或" 的关系。  It should be understood that the term "and/or" in this context is merely an association describing the associated object, indicating that there may be three relationships, for example, A and / or B, which may represent: A exists separately, and A and B exist simultaneously There are three cases of B alone. In addition, the character "/" in this article generally indicates that the context object is an "or" relationship.

应理解, 在本发明的各种实施例中, 上述各过程的序号的大小并不意味 着执行顺序的先后, 各过程的执行顺序应以其功能和内在逻辑确定, 而不应 对本发明实施例的实施过程构成任何限定。  It should be understood that, in various embodiments of the present invention, the size of the sequence numbers of the above processes does not mean the order of execution, and the order of execution of each process should be determined by its function and internal logic, and should not be taken to the embodiments of the present invention. The implementation process constitutes any limitation.

本领域普通技术人员可以意识到, 结合本文中所公开的实施例描述的各 示例的单元及算法步骤, 能够以电子硬件、 或者计算机软件和电子硬件的结 合来实现。 这些功能究竟以硬件还是软件方式来执行, 取决于技术方案的特 定应用和设计约束条件。 专业技术人员可以对每个特定的应用来使用不同方 法来实现所描述的功能, 但是这种实现不应认为超出本发明的范围。  Those of ordinary skill in the art will appreciate that the elements and algorithm steps of the various examples described in connection with the embodiments disclosed herein can be implemented in a combination of electronic hardware or computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the solution. A person skilled in the art can use different methods for implementing the described functions for each particular application, but such implementation should not be considered to be beyond the scope of the present invention.

所属领域的技术人员可以清楚地了解到, 为描述的方便和筒洁, 上述描 述的系统、 装置和单元的具体工作过程, 可以参考前述方法实施例中的对应 过程, 在此不再赘述。  It will be apparent to those skilled in the art that, for the convenience of the description and the cleaning process, the specific operation of the system, the device and the unit described above may be referred to the corresponding processes in the foregoing method embodiments, and details are not described herein again.

在本申请所提供的几个实施例中, 应该理解到, 所揭露的系统、 装置和 方法, 可以通过其它的方式实现。 例如, 以上所描述的装置实施例仅仅是示 意性的, 例如, 所述单元的划分, 仅仅为一种逻辑功能划分, 实际实现时可 以有另外的划分方式, 例如多个单元或组件可以结合或者可以集成到另一个 系统, 或一些特征可以忽略, 或不执行。 另一点, 所显示或讨论的相互之间 的耦合或直接耦合或通信连接可以是通过一些接口, 装置或单元的间接耦合 或通信连接, 可以是电性, 机械或其它的形式。 所述作为分离部件说明的单元可以是或者也可以不是物理上分开的,作 为单元显示的部件可以是或者也可以不是物理单元, 即可以位于一个地方, 或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或 者全部单元来实现本实施例方案的目的。 In the several embodiments provided herein, it should be understood that the disclosed systems, devices, and methods may be implemented in other ways. For example, the device embodiments described above are merely illustrative. For example, the division of the unit is only a logical function division. In actual implementation, there may be another division manner, for example, multiple units or components may be combined or Can be integrated into another system, or some features can be ignored, or not executed. In addition, the mutual coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection through some interface, device or unit, and may be in an electrical, mechanical or other form. The units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of the embodiment.

另外, 在本发明各个实施例中的各功能单元可以集成在一个处理单元 中, 也可以是各个单元单独物理存在, 也可以两个或两个以上单元集成在一 个单元中。  In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.

所述功能如果以软件功能单元的形式实现并作为独立的产品销售或使 用时, 可以存储在一个计算机可读取存储介质中。 基于这样的理解, 本发明 的技术方案本质上或者说对现有技术做出贡献的部分或者该技术方案的部 分可以以软件产品的形式体现出来,该计算机软件产品存储在一个存储介质 中, 包括若干指令用以使得一台计算机设备(可以是个人计算机, 服务器, 或者网络设备等)执行本发明各个实施例所述方法的全部或部分步骤。 而前 述的存储介质包括: U盘、移动硬盘、只读存储器( ROM, Read-Only Memory )、 随机存取存储器(RAM, Random Access Memory ), 磁碟或者光盘等各种可 以存储程序代码的介质。  The functions, if implemented in the form of software functional units and sold or used as separate products, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention, which is essential to the prior art or part of the technical solution, may be embodied in the form of a software product stored in a storage medium, including The instructions are used to cause a computer device (which may be a personal computer, server, or network device, etc.) to perform all or part of the steps of the methods described in various embodiments of the present invention. The foregoing storage medium includes: a U disk, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, and the like, which can store program codes. .

以上所述, 仅为本发明的具体实施方式, 但本发明的保护范围并不局限 于此, 任何熟悉本技术领域的技术人员在本发明揭露的技术范围内, 可轻易 想到变化或替换, 都应涵盖在本发明的保护范围之内。 因此, 本发明的保护 范围应以所述权利要求的保护范围为准。  The above is only the specific embodiment of the present invention, but the scope of the present invention is not limited thereto, and any person skilled in the art can easily think of changes or substitutions within the technical scope of the present invention. It should be covered by the scope of the present invention. Therefore, the scope of the invention should be determined by the scope of the appended claims.

Claims

权利要求 Rights request 1. 一种用于图像处理的方法, 其特征在于, 所述方法包括:  A method for image processing, the method comprising: 根据基本层图像块的运动信息确定目标图像块的第一运动信息, 其中, 所述的基本层图像块位于基本层图像中, 所述目标图像块位于增强层图像 中, 所述的基本层图像与所述增强层图像相对应, 且所述基本图像块在所述 基本层图像中的空间位置与所述目标图像块在所述增强层图像中的空间位 置相对应;  Determining first motion information of the target image block according to motion information of the base layer image block, where the base layer image block is located in the base layer image, the target image block is located in the enhancement layer image, and the base layer image is Corresponding to the enhancement layer image, and a spatial position of the basic image block in the base layer image corresponds to a spatial position of the target image block in the enhancement layer image; 根据所述增强层图像中与所述目标图像块相邻的邻近图像块的运动信 息确定所述目标图像块的第二运动信息;  Determining second motion information of the target image block according to motion information of adjacent image blocks adjacent to the target image block in the enhancement layer image; 根据所述第一运动信息和所述第二运动信息, 生成运动信息列表; 根据预定规则从所述运动信息列表中确定所述目标图像块的最优运动 信息;  Generating a motion information list according to the first motion information and the second motion information; determining optimal motion information of the target image block from the motion information list according to a predetermined rule; 根据所述最优运动信息,对所述目标图像块进行编码,以生成目标码流, 所述目标码流包括用于指示所述最优运动信息在所述运动信息列表中的位 置的第一索引信息。  And encoding, according to the optimal motion information, the target image block to generate a target code stream, where the target code stream includes a first part for indicating a position of the optimal motion information in the motion information list. Index information. 2. 根据权利要求 1所述的方法, 其特征在于, 所述根据基本层图像块 的运动信息确定目标图像块的第一运动信息包括:  The method according to claim 1, wherein the determining, according to the motion information of the base layer image block, the first motion information of the target image block comprises: 根据所述基本层图像块包括的与所述目标图像块中包含的目标图像子 块对应的基本层图像子块的运动信息, 确定所述目标图像子块的运动信息, 其中, 所述目标图像块子块具有预先设定的大小;  Determining motion information of the target image sub-block according to motion information of the base layer image sub-block corresponding to the target image sub-block included in the target image block, where the target layer image The block sub-block has a preset size; 根据所述目标图像子块的运动信息, 确定所述第一运动信息。  And determining the first motion information according to the motion information of the target image sub-block. 3. 根据权利要求 2所述的方法, 其特征在于, 所述目标图像块包括至 少两个目标图像子块, 以及  3. The method of claim 2, wherein the target image block comprises at least two target image sub-blocks, and 所述根据所述基本层图像块包括的与所述目标图像块中包含的目标图 像子块对应的基本层图像子块的运动信息,确定所述目标图像子块的运动信 息, 包括:  Determining the motion information of the target image sub-block according to the motion information of the base layer image sub-block corresponding to the target image sub-block included in the target image block, including: 当与所述至少两个目标图像子块中的第一目标图像子块相对应的第一 基本层图像子块的运动信息为空时, 根据所述目标图像块的大小、 所述目标 图像子块的大小和用于指示所述第一目标图像子块在所述目标图像块中的 位置的第二索引信息,确定所述至少两个目标图像子块中的第二目标图像子 块; 根据所述第二目标图像子块的运动信息,确定所述第一目标图像子块的 运动信息; And when the motion information of the first base layer image sub-block corresponding to the first target image sub-block of the at least two target image sub-blocks is empty, according to the size of the target image block, the target image sub- Determining a second target image sub-block of the at least two target image sub-blocks by using a size of the block and second index information indicating a position of the first target image sub-block in the target image block; Determining motion information of the first target image sub-block according to motion information of the second target image sub-block; 对应,所述根据所述目标图像子块的运动信息,确定所述第一运动信息, 包括:  Correspondingly, the determining the first motion information according to the motion information of the target image sub-block includes: 根据所述第一目标图像子块的运动信息, 确定所述第一运动信息; 或 根据所述第二目标图像子块的运动信息, 确定所述第一运动信息; 或 根据所述第一目标图像子块的运动信息以及第二目标图像子块的运动 信息, 确定所述第一运动信息。  Determining the first motion information according to motion information of the first target image sub-block; or determining the first motion information according to motion information of the second target image sub-block; or according to the first target The motion information of the image sub-block and the motion information of the second target image sub-block determine the first motion information. 4. 根据权利要求 3所述的方法, 其特征在于, 所述根据所述目标图像 块的大小、所述目标图像子块的大小和用于指示所述第一目标图像子块在所 述目标图像块中的位置的第二索引信息,确定所述至少两个目标图像子块中 的第二目标图像子块, 包括:  The method according to claim 3, wherein the size according to the target image block, the size of the target image sub-block, and the indication that the first target image sub-block is at the target Determining, by the second index information of the location in the image block, the second target image sub-block in the at least two target image sub-blocks, including: 根据以下任一公式, 确定所述第二目标图像子块,  Determining the second target image sub-block according to any of the following formulas, Idx2 + idx, %N/(N/2))x2 + (l- Idxl %N /(N / 4)%2))χ N /4 ; Idx2
Figure imgf000062_0001
+ ((l - ldxx %N/(N/2))x2 + (ldxx %N / (N / 4) %2)) xN/4;
Idx 2 + idx, %N/(N/2))x2 + (l- Idx l %N /(N / 4)%2))χ N /4 ; Idx 2
Figure imgf000062_0001
+ ((l - ldx x %N/(N/2))x2 + (ldx x %N / (N / 4) %2)) xN/4;
W¾ =/^/NxN + ((l-/ 1%N/(N/2))x2 + (l-/^%N/(N/4)%2))xN/4; 其中, Idx2表示用于指示所述第二目标图像子块在所述目标图像块中的 位置的第三索引信息, / 表示所述第二索引信息, N是根据所述目标图像 块的大小和所述目标图像子块的大小确定的。 W3⁄4 = /^/NxN + ((l-/ 1 %N/(N/2))x2 + (l-/^%N/(N/4)%2))xN/4; where Idx 2 represents Third index information indicating a position of the second target image sub-block in the target image block, / indicating the second index information, N being according to a size of the target image block and the target image The size of the sub-block is determined.
5. 根据权利要求 3或 4所述的方法, 其特征在于, 所述根据所述基本 层图像块包括的与所述目标图像块中包含的目标图像子块对应的基本层图 像子块的运动信息, 确定所述目标图像子块的运动信息, 进一步包括:  The method according to claim 3 or 4, wherein the motion of the base layer image sub-block corresponding to the target image sub-block included in the target image block according to the base layer image block is included Information, determining motion information of the target image sub-block, further comprising: 如果所述第二目标图像子块的运动信息为空, 则确定所述第一目标图像 子块的运动信息为零运动信息。  If the motion information of the second target image sub-block is empty, determining that the motion information of the first target image sub-block is zero motion information. 6. 根据权利要求 2至 5中任一项所述的方法, 其特征在于, 所述根据 所述目标图像子块的运动信息, 确定所述第一运动信息, 包括:  The method according to any one of claims 2 to 5, wherein the determining the first motion information according to the motion information of the target image sub-block comprises: 根据第三目标图像子块的运动信息, 确定所述第一运动信息, 其中, 所 述第三目标图像子块为所述目标图像块中位于预设位置的目标图像子块, 或 所述第三目标图像子块的运动信息在所述目标图像子块的运动信息中 的出现频率最高。  Determining, according to the motion information of the third target image sub-block, the third target image sub-block is a target image sub-block located at a preset position in the target image block, or the The motion information of the three-target image sub-block has the highest frequency of occurrence in the motion information of the target image sub-block. 7. 根据权利要求 6所述的方法, 其特征在于, 所述根据所述目标图像 子块的运动信息, 确定所述第一运动信息, 进一步包括: 7. The method according to claim 6, wherein the image according to the target The motion information of the sub-block, determining the first motion information, further includes: 根据所述第三目标图像子块的运动信息的参考图像、所述目标图像和所 述目标图像块的参考图像的时域距离关系,对所述第三目标图像子块的运动 信息进行缩放处理;  And scaling, according to a time domain distance relationship of the reference image of the motion information of the third target image sub-block, the target image, and the reference image of the target image block, the motion information of the third target image sub-block ; 根据所述缩放处理后的第三目标图像子块的运动信息,确定所述第一运 动信息。  And determining the first motion information according to the motion information of the third target image sub-block after the scaling process. 8. 根据权利要求 2至 7中任一项所述的方法, 其特征在于, 所述目标 图像块包括至少两个目标图像子块, 以及  The method according to any one of claims 2 to 7, wherein the target image block includes at least two target image sub-blocks, and 当所述最优信息为所述第一运动信息时, 所述根据所述最优运动信息, 对所述目标图像块进行编码, 包括:  When the optimal information is the first motion information, the encoding the target image block according to the optimal motion information includes: 对位于所述目标图像子块之间的边界附近的像素进行去块效应滤波处 理。  Deblocking filtering processing is performed on pixels located near the boundary between the target image sub-blocks. 9. 根据权利要求 1至 8中任一项所述的方法, 其特征在于, 所述第二 运动信息包括时间运动信息和空间运动信息, 以及  The method according to any one of claims 1 to 8, wherein the second motion information comprises time motion information and spatial motion information, and 所述根据所述第一运动信息和所述第二运动信息, 确定运动信息列表, 包括:  Determining the motion information list according to the first motion information and the second motion information, including: 根据所述第一运动信息和所述第二运动信息, 确定运动信息列表, 以使 所述第一运动信息位于运动信息列表的首位; 或  Determining, according to the first motion information and the second motion information, a motion information list, so that the first motion information is located at a top of the motion information list; or 根据所述第一运动信息和所述第二运动信息, 确定运动信息列表, 以使 所述第一运动信息位于运动信息列表的末位; 或  Determining, according to the first motion information and the second motion information, a motion information list, so that the first motion information is located at a last position of the motion information list; or 根据所述第一运动信息和所述第二运动信息, 确定运动信息列表, 以使 所述第一运动信息位于所述运动信息列表中的空间运动信息与所述时间运 动信息之间。  And determining, according to the first motion information and the second motion information, the motion information list such that the first motion information is located between the spatial motion information in the motion information list and the time motion information. 10. 根据权利要求 1至 9中任一项所述的方法, 其特征在于, 所述第一 索引信息包括用于指示所述最优运动信息是否为所述第一运动信息的第一 符号和用于指示所述最优运动信息在所述运动列表中的位置的第二符号, 以 及  The method according to any one of claims 1 to 9, wherein the first index information includes a first symbol for indicating whether the optimal motion information is the first motion information and a second symbol for indicating a location of the optimal motion information in the motion list, and 所述根据所述最优运动信息, 进行编码, 包括:  The encoding according to the optimal motion information includes: 根据第一上下文模型, 对所述第一符号进行算术编码处理;  Performing an arithmetic coding process on the first symbol according to a first context model; 根据第二上下文模型, 对所述第二符号进行算术编码处理, 其中, 所述 第一上下文模型与所述第二上下文模型相异。 Performing an arithmetic coding process on the second symbol according to a second context model, wherein the first context model is different from the second context model. 11. 一种用于图像处理的方法, 其特征在于, 所述方法包括: 根据基本层图像块的运动信息确定目标图像块的第一运动信息, 其中, 所述的基本层图像块位于基本层图像中, 所述目标图像块位于增强层图像 中, 所述的基本层图像与所述增强层图像相对应, 且所述基本图像块在所述 基本层图像中的空间位置与所述目标图像块在所述增强层图像中的空间位 置相对应; A method for image processing, the method comprising: determining first motion information of a target image block according to motion information of a base layer image block, wherein the base layer image block is located at a base layer In the image, the target image block is located in an enhancement layer image, the base layer image corresponds to the enhancement layer image, and a spatial position of the basic image block in the base layer image and the target image The spatial position of the block in the enhancement layer image corresponds; 根据所述增强层图像中与所述目标图像块相邻的邻近图像块的运动信 息确定所述目标图像块的第二运动信息;  Determining second motion information of the target image block according to motion information of adjacent image blocks adjacent to the target image block in the enhancement layer image; 根据所述第一运动信息和所述第二运动信息, 生成运动信息列表; 根据目标码流, 获取用于指示所述最优运动信息在所述运动信息列表中 的位置的第一索引信息;  Generating, according to the first motion information and the second motion information, a motion information list; and acquiring, according to the target code stream, first index information for indicating a location of the optimal motion information in the motion information list; 根据所述第一索引信息, 从所述运动信息列表中确定最优运动信息, 根 据所述最优运动信息, 对所述目标码流进行解码, 以获取所述目标图像块。  Determining, according to the first index information, optimal motion information from the motion information list, and decoding the target code stream according to the optimal motion information to obtain the target image block. 12. 根据权利要求 11所述的方法, 其特征在于, 所述根据基本层图像 块的运动信息确定目标图像块的第一运动信息包括:  The method according to claim 11, wherein the determining, according to the motion information of the base layer image block, the first motion information of the target image block comprises: 根据所述基本层图像块包括的与所述目标图像块中包含的目标图像子 块对应的基本层图像子块的运动信息, 确定所述目标图像子块的运动信息, 其中, 所述目标图像块子块具有预先设定的大小;  Determining motion information of the target image sub-block according to motion information of the base layer image sub-block corresponding to the target image sub-block included in the target image block, where the target layer image The block sub-block has a preset size; 根据所述目标图像子块的运动信息, 确定所述第一运动信息。  And determining the first motion information according to the motion information of the target image sub-block. 13. 根据权利要求 12所述的方法, 所述目标图像块包括至少两个目标 图像子块, 以及  13. The method of claim 12, the target image block comprising at least two target image sub-blocks, and 所述根据所述基本层图像块包括的与所述目标图像块中包含的目标图 像子块对应的基本层图像子块的运动信息,确定所述目标图像子块的运动信 息, 包括:  Determining the motion information of the target image sub-block according to the motion information of the base layer image sub-block corresponding to the target image sub-block included in the target image block, including: 当与所述至少两个目标图像子块中的第一目标图像子块相对应的第一 基本层图像子块的运动信息为空时, 根据所述目标图像块的大小、 所述目标 图像子块的大小和用于指示所述第一目标图像子块在所述目标图像块中的 位置的第二索引信息,确定所述至少两个目标图像子块中的第二目标图像子 块;  And when the motion information of the first base layer image sub-block corresponding to the first target image sub-block of the at least two target image sub-blocks is empty, according to the size of the target image block, the target image sub- Determining a second target image sub-block of the at least two target image sub-blocks by using a size of the block and second index information indicating a position of the first target image sub-block in the target image block; 根据所述第二目标图像子块的运动信息,确定所述第一目标图像子块的 运动信息; 对应,所述根据所述目标图像子块的运动信息,确定所述第一运动信息, 包括: Determining motion information of the first target image sub-block according to motion information of the second target image sub-block; Correspondingly, the determining the first motion information according to the motion information of the target image sub-block includes: 根据所述第一目标图像子块的运动信息, 确定所述第一运动信息; 或 根据所述第二目标图像子块的运动信息, 确定所述第一运动信息; 或 根据所述第一目标图像子块的运动信息以及第二目标图像子块的运动 信息, 确定所述第一运动信息。  Determining the first motion information according to motion information of the first target image sub-block; or determining the first motion information according to motion information of the second target image sub-block; or according to the first target The motion information of the image sub-block and the motion information of the second target image sub-block determine the first motion information. 14. 根据权利要求 13所述的方法, 其特征在于, 所述根据所述目标图 像块的大小、所述目标图像子块的大小和用于指示所述第一目标图像子块在 所述目标图像块中的位置的第二索引信息,确定所述至少两个目标图像子块 中的第二目标图像子块, 包括:  The method according to claim 13, wherein the according to the size of the target image block, the size of the target image sub-block, and the indication that the first target image sub-block is at the target Determining, by the second index information of the location in the image block, the second target image sub-block in the at least two target image sub-blocks, including: 根据以下任一公式, 确定所述第二目标图像子块,  Determining the second target image sub-block according to any of the following formulas, Idx2 + {idx, %N/(N/2))x2 + (l- Idx, %N /(N / 4)%2))χ N /4 ;Idx 2 + {idx, %N/(N/2))x2 + (l- Idx, %N /(N / 4)%2))χ N /4 ; Idx2
Figure imgf000065_0001
+ ((l - ldxx %N/(N/2))x2 + {ldxx %N / (N / 4) %2)) xN/4;
Idx 2
Figure imgf000065_0001
+ ((l - ldx x %N/(N/2))x2 + {ldx x %N / (N / 4) %2)) xN/4;
W¾ =/^/NxN + ((l-/ x1 N/(N/2))x2 + (l-/^ N/(N/4) 2))xN/4; 其中, 表示用于指示所述第二目标图像子块在所述目标图像块中的 位置的第三索引信息, / 表示所述第二索引信息, N是根据所述目标图像 块的大小和所述目标图像子块的大小确定的。 W3⁄4 = /^/NxN + ((l-/ x 1 N/(N/2))x2 + (l-/^ N/(N/4) 2))xN/4; where, the indication is used to indicate The third index information of the position of the second target image sub-block in the target image block, / represents the second index information, N is according to the size of the target image block and the size of the target image sub-block definite.
15. 根据权利要求 13或 14所述的方法, 其特征在于, 所述根据所述基 本层图像块包括的与所述目标图像块中包含的目标图像子块对应的基本层 图像子块的运动信息, 确定所述目标图像子块的运动信息, 进一步包括: 如果所述第二目标图像子块的运动信息为空, 则确定所述第一目标图像 子块的运动信息为零运动信息。  The method according to claim 13 or 14, wherein the motion of the base layer image sub-block corresponding to the target image sub-block included in the target image block according to the base layer image block is included The determining the motion information of the target image sub-block further includes: if the motion information of the second target image sub-block is empty, determining that the motion information of the first target image sub-block is zero motion information. 16. 根据权利要求 12至 15中任一项所述的方法, 其特征在于, 所述根 据所述目标图像子块的运动信息, 确定所述第一运动信息, 包括:  The method according to any one of claims 12 to 15, wherein the determining the first motion information according to the motion information of the target image sub-block comprises: 根据第三目标图像子块的运动信息, 确定所述第一运动信息, 其中, 所 述第三目标图像子块为所述目标图像块中位于预设位置的目标图像子块, 或 所述第三目标图像子块的运动信息在所述目标图像子块的运动信息中 的出现频率最高。  Determining, according to the motion information of the third target image sub-block, the third target image sub-block is a target image sub-block located at a preset position in the target image block, or the The motion information of the three-target image sub-block has the highest frequency of occurrence in the motion information of the target image sub-block. 17. 根据权利要求 16所述的方法, 其特征在于, 所述根据所述目标图 像子块的运动信息, 确定所述第一运动信息进一步包括:  The method according to claim 16, wherein the determining the first motion information according to the motion information of the target image sub-block further comprises: 根据所述第三目标图像子块的运动信息的参考图像、所述目标图像和所 述目标图像块的参考图像的时域距离关系,对所述第三目标图像子块的运动 信息进行缩放处理; a reference image, the target image, and a location according to motion information of the third target image sub-block a time domain distance relationship of the reference image of the target image block, and performing scaling processing on the motion information of the third target image sub-block; 根据所述缩放处理后的第三目标图像子块的运动信息,确定所述第一运 动信息。  And determining the first motion information according to the motion information of the third target image sub-block after the scaling process. 18. 根据权利要求 12至 17中任一项所述的方法, 其特征在于, 所述目 标图像块包括至少两个目标图像子块, 以及  The method according to any one of claims 12 to 17, wherein the target image block comprises at least two target image sub-blocks, and 当所述最优信息为所述第一运动信息时, 所述根据所述最优运动信息, 对所述目标码流进行解码, 包括:  Decoding the target code stream according to the optimal motion information, when the optimal information is the first motion information, including: 对位于所述目标图像子块之间的边界附近的像素进行去块效应滤波处 理。  Deblocking filtering processing is performed on pixels located near the boundary between the target image sub-blocks. 19. 根据权利要求 11至 18中任一项所述的方法, 其特征在于, 所述第 二运动信息包括时间运动信息和空间运动信息, 以及  The method according to any one of claims 11 to 18, wherein the second motion information comprises time motion information and spatial motion information, and 所述根据所述第一运动信息和所述第二运动信息, 确定运动信息列表, 包括:  Determining the motion information list according to the first motion information and the second motion information, including: 根据所述第一运动信息和所述第二运动信息, 确定运动信息列表, 以使 所述第一运动信息位于运动信息列表的首位; 或  Determining, according to the first motion information and the second motion information, a motion information list, so that the first motion information is located at a top of the motion information list; or 根据所述第一运动信息和所述第二运动信息, 确定运动信息列表, 以使 所述第一运动信息位于运动信息列表的末位; 或  Determining, according to the first motion information and the second motion information, a motion information list, so that the first motion information is located at a last position of the motion information list; or 根据所述第一运动信息和所述第二运动信息, 确定运动信息列表, 以使 所述第一运动信息位于所述运动信息列表中的空间运动信息与所述时间运 动信息之间。  And determining, according to the first motion information and the second motion information, the motion information list such that the first motion information is located between the spatial motion information in the motion information list and the time motion information. 20. 根据权利要求 11至 19中任一项所述的方法, 其特征在于, 所述第 一索引信息包括用于指示所述最优运动信息是否为所述第一运动信息的第 一符号和用于指示所述最优运动信息在所述运动列表中的位置的第二符号, 以及  The method according to any one of claims 11 to 19, wherein the first index information includes a first symbol for indicating whether the optimal motion information is the first motion information and a second symbol for indicating a location of the optimal motion information in the motion list, and 所述根据所述第一索引信息, 从所述运动信息列表中确定最优运动信 息, 包括:  Determining the optimal motion information from the motion information list according to the first index information, including: 根据第一上下文模型, 对所述第一符号进行算术解码处理, 并根据第二 上下文模型, 对所述第二符号进行算术解码处理, 以根据所述算术解码处理 后的第一索引信息, 从所述运动信息列表中确定最优运动信息, 其中, 所述 第一上下文模型与所述第二上下文模型相异。 Performing an arithmetic decoding process on the first symbol according to the first context model, and performing an arithmetic decoding process on the second symbol according to the second context model, according to the first index information after the arithmetic decoding process The optimal motion information is determined in the motion information list, wherein the first context model is different from the second context model. 21. 一种用于图像处理的装置, 其特征在于, 所述装置包括: 获取单元, 用于根据基本层图像块的运动信息确定目标图像块的第一运 动信息, 其中, 所述的基本层图像块位于基本层图像中, 所述目标图像块位 于增强层图像中, 所述的基本层图像与所述增强层图像相对应, 且所述基本 图像块在所述基本层图像中的空间位置与所述目标图像块在所述增强层图 像中的空间位置相对应; An apparatus for image processing, the apparatus comprising: an acquiring unit, configured to determine first motion information of a target image block according to motion information of a base layer image block, where the basic layer An image block is located in a base layer image, the target image block is located in an enhancement layer image, the base layer image corresponds to the enhancement layer image, and a spatial position of the basic image block in the base layer image Corresponding to a spatial position of the target image block in the enhancement layer image; 用于根据所述增强层图像中与所述目标图像块相邻的邻近图像块的运 动信息确定所述目标图像块的第二运动信息, 并向生成单元传输所述第一运 动信息和所述第二运动信息;  And determining second motion information of the target image block according to motion information of adjacent image blocks adjacent to the target image block in the enhancement layer image, and transmitting the first motion information and the Second motion information; 生成单元, 用于从所述获取单元获取所述第一运动信息和所述第二运动 信息, 并根据所述第一运动信息和所述第二运动信息, 生成运动信息列表, 以及, 向选择单元传输所述运动信息列表;  a generating unit, configured to acquire the first motion information and the second motion information from the acquiring unit, and generate a motion information list according to the first motion information and the second motion information, and The unit transmits the motion information list; 选择单元, 用于从所述生成单元获取所述运动信息列表, 并根据预定规 则从所述运动信息列表中确定所述目标图像块的最优运动信息, 并向编码单 元传输所述最优运动信息;  a selecting unit, configured to acquire the motion information list from the generating unit, and determine optimal motion information of the target image block from the motion information list according to a predetermined rule, and transmit the optimal motion to a coding unit Information 编码单元, 用于从选择单元获取所述最优运动信息, 并根据所述最优运 动信息, 对所述目标图像块进行编码, 以生成目标码流, 所述目标码流包括 用于指示所述最优运动信息在所述运动信息列表中的位置的第一索引信息。  a coding unit, configured to acquire the optimal motion information from the selection unit, and encode the target image block according to the optimal motion information to generate a target code stream, where the target code stream includes The first index information of the location of the optimal motion information in the motion information list. 22. 根据权利要求 21所述的装置, 其特征在于, 所述获取单元具体用 于根据所述基本层图像块包括的与所述目标图像块中包含的目标图像子块 对应的基本层图像子块的运动信息, 确定所述目标图像子块的运动信息, 其 中, 所述目标图像块子块具有预先设定的大小;  The device according to claim 21, wherein the acquiring unit is configured to: according to the base layer image sub-block corresponding to the target image sub-block included in the target image block, according to the base layer image block The motion information of the block, the motion information of the target image sub-block is determined, where the target image block sub-block has a preset size; 用于根据所述目标图像子块的运动信息, 确定所述第一运动信息。 And configured to determine the first motion information according to motion information of the target image sub-block. 23. 根据权利要求 22所述的装置, 其特征在于, 所述目标图像块包括 至少两个目标图像子块, 以及 23. The apparatus according to claim 22, wherein the target image block comprises at least two target image sub-blocks, and 所述获取单元具体用于当与所述至少两个目标图像子块中的第一目标 图像子块相对应的第一基本层图像子块的运动信息为空时,根据所述目标图 像块的大小、所述目标图像子块的大小和用于指示所述第一目标图像子块在 所述目标图像块中的位置的第二索引信息,确定所述至少两个目标图像子块 中的第二目标图像子块;  The acquiring unit is specifically configured to: when motion information of the first base layer image sub-block corresponding to the first target image sub-block of the at least two target image sub-blocks is empty, according to the target image block Determining a size, a size of the target image sub-block, and second index information indicating a position of the first target image sub-block in the target image block, determining a number of the at least two target image sub-blocks Two target image sub-blocks; 用于根据所述第二目标图像子块的运动信息,确定所述第一目标图像子 块的运动信息; And determining, according to the motion information of the second target image sub-block, the first target image sub Motion information of the block; 用于根据所述第一目标图像子块的运动信息, 确定所述第一运动信息; 或  And determining, according to the motion information of the first target image sub-block, the first motion information; or 用于根据所述第二目标图像子块的运动信息, 确定所述第一运动信息; 或  And determining, according to the motion information of the second target image sub-block, the first motion information; or 用于根据所述第一目标图像子块的运动信息以及第二目标图像子块的 运动信息, 确定所述第一运动信息。  And determining, according to the motion information of the first target image sub-block and the motion information of the second target image sub-block, the first motion information. 24. 根据权利要求 23所述的装置, 其特征在于, 所述获取单元具体用 于根据以下任一公式, 确定所述第二目标图像子块,  The device according to claim 23, wherein the acquiring unit is specifically configured to determine the second target image sub-block according to any one of the following formulas, Idx2 / 2)) χ 2 + (l - Idxl %N / (N / 4) %2)) x N / 4;Idx 2 / 2)) χ 2 + (l - Idx l %N / (N / 4) %2)) x N / 4; Idx2
Figure imgf000068_0001
(N/2))x2 + (ldxx %N / (N / 4) %2)) xN/4; W¾ =/^/NxN + ((l-/ x1 N/(N/2))x2 + (l-/^ N/(N/4) 2))xN/4; 其中, Idx2表示用于指示所述第二目标图像子块在所述目标图像块中的 位置的第三索引信息, / 表示所述第二索引信息, N是根据所述目标图像 块的大小和所述目标图像子块的大小确定的。
Idx 2
Figure imgf000068_0001
(N/2))x2 + (ldx x %N / (N / 4) %2)) xN/4; W3⁄4 =/^/NxN + ((l-/ x 1 N/(N/2))x2 + (l-/^ N/(N/4) 2))xN/4; wherein Idx 2 represents third index information indicating a position of the second target image sub-block in the target image block , / represents the second index information, N is determined according to the size of the target image block and the size of the target image sub-block.
25. 根据权利要求 23或 24所述的装置, 其特征在于, 所述获取单元具 体用于如果所述第二目标图像子块的运动信息为空, 则确定所述第一目标图 像子块的运动信息为零运动信息。  The device according to claim 23 or 24, wherein the acquiring unit is specifically configured to: if the motion information of the second target image sub-block is empty, determine the first target image sub-block The motion information is zero motion information. 26. 根据权利要求 22至 25中任一项所述的装置, 其特征在于, 所述获 取单元具体用于根据第三目标图像子块的运动信息, 确定所述第一运动信 息, 其中, 所述第三目标图像子块为所述目标图像块中位于预设位置的目标 图像子块, 或  The device according to any one of claims 22 to 25, wherein the acquiring unit is specifically configured to determine the first motion information according to motion information of a third target image sub-block, where The third target image sub-block is a target image sub-block located at a preset position in the target image block, or 所述第三目标图像子块的运动信息在所述目标图像子块的运动信息中 的出现频率最高。  The motion information of the third target image sub-block has the highest frequency of occurrence in the motion information of the target image sub-block. 27. 根据权利要求 26所述的装置, 其特征在于, 所述获取单元具体还 用于根据所述第三目标图像子块的运动信息的参考图像、所述目标图像和所 述目标图像块的参考图像的时域距离关系,对所述第三目标图像子块的运动 信息进行缩放处理;  The device according to claim 26, wherein the acquiring unit is further configured to use, according to the reference image of the motion information of the third target image sub-block, the target image, and the target image block. And scaling a motion information of the third target image sub-block according to a time domain distance relationship of the reference image; 用于根据所述缩放处理后的第三目标图像子块的运动信息,确定所述第 一运动信息。  And determining the first motion information according to the motion information of the third target image sub-block after the scaling process. 28. 根据权利要求 22至 27中任一项所述的装置, 其特征在于, 所述目 标图像块包括至少两个目标图像子块, 以及 The apparatus according to any one of claims 22 to 27, wherein The target image block includes at least two target image sub-blocks, and 当所述最优信息为所述第一运动信息时, 所述编码单元还用于对位于所 述目标图像子块之间的边界附近的像素进行去块效应滤波处理。  When the optimal information is the first motion information, the coding unit is further configured to perform deblocking filtering processing on pixels located near a boundary between the target image sub-blocks. 29. 根据权利要求 21至 28中任一项所述的装置, 其特征在于, 所述第 二运动信息包括时间运动信息和空间运动信息, 以及  The apparatus according to any one of claims 21 to 28, wherein the second motion information includes time motion information and spatial motion information, and 所述生成单元具体用于根据所述第一运动信息和所述第二运动信息,确 定运动信息列表, 以使所述第一运动信息位于运动信息列表的首位; 或  The generating unit is specifically configured to determine, according to the first motion information and the second motion information, a motion information list, so that the first motion information is located at a top of the motion information list; or 用于根据所述第一运动信息和所述第二运动信息, 确定运动信息列表, 以使所述第一运动信息位于运动信息列表的末位; 或  And configured to determine, according to the first motion information and the second motion information, a motion information list, so that the first motion information is located at a last position of the motion information list; or 用于根据所述第一运动信息和所述第二运动信息, 确定运动信息列表, 以使所述第一运动信息位于所述运动信息列表中的空间运动信息与所述时 间运动信息之间。  And configured to determine, according to the first motion information and the second motion information, a motion information list, such that the first motion information is located between the spatial motion information in the motion information list and the time motion information. 30. 根据权利要求 21至 29中任一项所述的装置, 其特征在于, 所述第 一索引信息包括用于指示所述最优运动信息是否为所述第一运动信息的第 一符号和用于指示所述最优运动信息在所述运动列表中的位置的第二符号, 以及  The apparatus according to any one of claims 21 to 29, wherein the first index information includes a first symbol for indicating whether the optimal motion information is the first motion information and a second symbol for indicating a location of the optimal motion information in the motion list, and 所述编码单元具体用于根据第一上下文模型,对所述第一符号进行算术 编码处理;  The coding unit is specifically configured to perform an arithmetic coding process on the first symbol according to the first context model; 用于根据第二上下文模型, 对所述第二符号进行算术编码处理, 其中, 所述第一上下文模型与所述第二上下文模型相异。  And performing arithmetic coding processing on the second symbol according to the second context model, where the first context model is different from the second context model. 31. 一种用于图像处理的装置, 其特征在于, 所述装置包括: 获取单元, 用于根据基本层图像块的运动信息确定目标图像块的第一运 动信息, 其中, 所述的基本层图像块位于基本层图像中, 所述目标图像块位 于增强层图像中, 所述的基本层图像与所述增强层图像相对应, 且所述基本 图像块在所述基本层图像中的空间位置与所述目标图像块在所述增强层图 像中的空间位置相对应;  An apparatus for image processing, the apparatus comprising: an acquiring unit, configured to determine first motion information of a target image block according to motion information of a base layer image block, where the basic layer An image block is located in a base layer image, the target image block is located in an enhancement layer image, the base layer image corresponds to the enhancement layer image, and a spatial position of the basic image block in the base layer image Corresponding to a spatial position of the target image block in the enhancement layer image; 用于根据所述增强层图像中与所述目标图像块相邻的邻近图像块的运 动信息确定所述目标图像块的第二运动信息, 并向生成单元传输所述第一运 动信息和所述第二运动信息;  And determining second motion information of the target image block according to motion information of adjacent image blocks adjacent to the target image block in the enhancement layer image, and transmitting the first motion information and the Second motion information; 生成单元, 用于从所述获取单元获取所述第一运动信息和所述第二运动 信息, 并根据所述第一运动信息和所述第二运动信息, 生成运动信息列表, 以及, 向确定单元传输所述运动信息列表; a generating unit, configured to acquire the first motion information and the second motion information from the acquiring unit, and generate a motion information list according to the first motion information and the second motion information, And transmitting the motion information list to the determining unit; 确定单元, 用于根据目标码流, 确定用于指示所述最优运动信息在所述 运动信息列表中的位置的第一索引信息, 并向所述解码单元传输所述第一索 引信息;  a determining unit, configured to determine, according to the target code stream, first index information used to indicate a location of the optimal motion information in the motion information list, and transmit the first index information to the decoding unit; 解码单元, 用于从所述生成单元获取所述运动信息列表, 并根据所述确 定单元确定的所述第一索引信息, 从所述运动信息列表中确定最优运动信 息, 根据所述最优运动信息, 对所述目标码流进行解码, 以获取所述目标图 像块。  a decoding unit, configured to acquire the motion information list from the generating unit, and determine optimal motion information from the motion information list according to the first index information determined by the determining unit, according to the optimal Motion information, decoding the target code stream to obtain the target image block. 32. 根据权利要求 31所述的装置, 其特征在于, 所述获取单元具体用 于根据所述基本层图像块包括的与所述目标图像块中包含的目标图像子块 对应的基本层图像子块的运动信息, 确定所述目标图像子块的运动信息, 其 中, 所述目标图像块子块具有预先设定的大小;  The device according to claim 31, wherein the acquiring unit is configured to: according to the base layer image sub-block corresponding to the target image sub-block included in the target image block, according to the base layer image block The motion information of the block, the motion information of the target image sub-block is determined, where the target image block sub-block has a preset size; 用于根据所述目标图像子块的运动信息, 确定所述第一运动信息。 And configured to determine the first motion information according to motion information of the target image sub-block. 33. 根据权利要求 32所述的装置, 其特征在于, 所述目标图像块包括 至少两个目标图像子块, 以及 33. The apparatus according to claim 32, wherein the target image block comprises at least two target image sub-blocks, and 所述获取单元具体用于当与所述至少两个目标图像子块中的第一目标 图像子块相对应的第一基本层图像子块的运动信息为空时,根据所述目标图 像块的大小、所述目标图像子块的大小和用于指示所述第一目标图像子块在 所述目标图像块中的位置的第二索引信息,确定所述至少两个目标图像子块 中的第二目标图像子块;  The acquiring unit is specifically configured to: when motion information of the first base layer image sub-block corresponding to the first target image sub-block of the at least two target image sub-blocks is empty, according to the target image block Determining a size, a size of the target image sub-block, and second index information indicating a position of the first target image sub-block in the target image block, determining a number of the at least two target image sub-blocks Two target image sub-blocks; 用于根据所述第二目标图像子块的运动信息,确定所述第一目标图像子 块的运动信息;  And determining, according to the motion information of the second target image sub-block, motion information of the first target image sub-block; 用于根据所述第一目标图像子块的运动信息, 确定所述第一运动信息; 或  And determining, according to the motion information of the first target image sub-block, the first motion information; or 用于根据所述第二目标图像子块的运动信息, 确定所述第一运动信息; 或  And determining, according to the motion information of the second target image sub-block, the first motion information; or 用于根据所述第一目标图像子块的运动信息以及第二目标图像子块的 运动信息, 确定所述第一运动信息。  And determining, according to the motion information of the first target image sub-block and the motion information of the second target image sub-block, the first motion information. 34. 根据权利要求 33所述的装置, 其特征在于, 所述获取单元具体用 于根据以下任一公式, 确定所述第二目标图像子块,  The device according to claim 33, wherein the acquiring unit is specifically configured to determine the second target image sub-block according to any one of the following formulas, Idx2 ^ Idx N x N + (i^Idx, %N / (N / 2)) χ 2 + (1 - Idx, %N / (N / 4) <¾2)) x N / 4 ; Idx2
Figure imgf000071_0001
+ ((l - Idxx %N/(N/2))x2 + [ldxx %N / (N / 4) %2)) xN/4; W¾ =/^/NxN + ((l-/ x1 N/(N/2))x2 + (l-/^ N/(N/4) 2))xN/4; 其中, Idx2表示用于指示所述第二目标图像子块在所述目标图像块中的 位置的第三索引信息, / 表示所述第二索引信息, N是根据所述目标图像 块的大小和所述目标图像子块的大小确定的。
Idx 2 ^ Idx N x N + (i^Idx, %N / (N / 2)) χ 2 + (1 - Idx, %N / (N / 4) <3⁄42)) x N / 4 ; Idx 2
Figure imgf000071_0001
+ ((l - Idx x %N/(N/2))x2 + [ldx x %N / (N / 4) %2)) xN/4; W3⁄4 =/^/NxN + ((l-/ x 1 N / ( N / 2) x 2 + (l - / ^ N / (N / 4) 2)) x N / 4; wherein Idx 2 is used to indicate that the second target image sub-block is at the target The third index information of the position in the image block, / represents the second index information, and N is determined according to the size of the target image block and the size of the target image sub-block.
35. 根据权利要求 33或 34所述的装置, 其特征在于, 所述获取单元具 体用于如果所述第二目标图像子块的运动信息为空, 则确定所述第一目标图 像子块的运动信息为零运动信息。  The device according to claim 33 or 34, wherein the acquiring unit is specifically configured to: if the motion information of the second target image sub-block is empty, determine the first target image sub-block The motion information is zero motion information. 36. 根据权利要求 32至 35中任一项所述的装置, 其特征在于, 所述获 取单元具体用于根据第三目标图像子块的运动信息, 确定所述第一运动信 息, 其中, 所述第三目标图像子块为所述目标图像块中位于预设位置的目标 图像子块, 或  The device according to any one of claims 32 to 35, wherein the acquiring unit is specifically configured to determine the first motion information according to motion information of a third target image sub-block, where The third target image sub-block is a target image sub-block located at a preset position in the target image block, or 所述第三目标图像子块的运动信息在所述目标图像子块的运动信息中 的出现频率最高。  The motion information of the third target image sub-block has the highest frequency of occurrence in the motion information of the target image sub-block. 37. 根据权利要求 36所述的装置, 其特征在于, 所述获取单元具体还 用于根据所述第三目标图像子块的运动信息的参考图像、所述目标图像和所 述目标图像块的参考图像的时域距离关系,对所述第三目标图像子块的运动 信息进行缩放处理;  The device according to claim 36, wherein the acquiring unit is further configured to use, according to the reference image of the motion information of the third target image sub-block, the target image, and the target image block. And scaling a motion information of the third target image sub-block according to a time domain distance relationship of the reference image; 用于根据所述缩放处理后的第三目标图像子块的运动信息,确定所述第 一运动信息。  And determining the first motion information according to the motion information of the third target image sub-block after the scaling process. 38. 根据权利要求 32至 37中任一项所述的装置, 其特征在于, 所述目 标图像块包括至少两个目标图像子块, 以及  The apparatus according to any one of claims 32 to 37, wherein the target image block includes at least two target image sub-blocks, and 当所述最优信息为所述第一运动信息时, 所述解码单元还用于对位于所 述目标图像子块之间的边界附近的像素进行去块效应滤波处理。  When the optimal information is the first motion information, the decoding unit is further configured to perform deblocking filtering processing on pixels located near a boundary between the target image sub-blocks. 39. 根据权利要求 31至 38中任一项所述的装置, 其特征在于, 所述第 二运动信息包括时间运动信息和空间运动信息, 以及  The apparatus according to any one of claims 31 to 38, wherein the second motion information includes time motion information and spatial motion information, and 所述生成单元具体用于根据所述第一运动信息和所述第二运动信息,确 定运动信息列表, 以使所述第一运动信息位于运动信息列表的首位; 或  The generating unit is specifically configured to determine, according to the first motion information and the second motion information, a motion information list, so that the first motion information is located at a top of the motion information list; or 用于根据所述第一运动信息和所述第二运动信息, 确定运动信息列表, 以使所述第一运动信息位于运动信息列表的末位; 或  And configured to determine, according to the first motion information and the second motion information, a motion information list, so that the first motion information is located at a last position of the motion information list; or 用于根据所述第一运动信息和所述第二运动信息, 确定运动信息列表, 以使所述第一运动信息位于所述运动信息列表中的空间运动信息与所述时 间运动信息之间。 And configured to determine a motion information list according to the first motion information and the second motion information, The first motion information is located between the spatial motion information in the motion information list and the temporal motion information. 40. 根据权利要求 31至 39中任一项所述的装置, 其特征在于, 所述第 一索引信息包括用于指示所述最优运动信息是否为所述第一运动信息的第 一符号和用于指示所述最优运动信息在所述运动列表中的位置的第二符号, 以及  The apparatus according to any one of claims 31 to 39, wherein the first index information includes a first symbol for indicating whether the optimal motion information is the first motion information and a second symbol for indicating a location of the optimal motion information in the motion list, and 所述解码单元具体用于根据第一上下文模型,对所述第一符号进行算术 解码处理, 并根据第二上下文模型, 对所述第二符号进行算术解码处理, 以 根据所述算术解码处理后的第一索引信息,从所述运动信息列表中确定最优 运动信息, 其中, 所述第一上下文模型与所述第二上下文模型相异。  The decoding unit is specifically configured to: perform arithmetic decoding processing on the first symbol according to the first context model, and perform arithmetic decoding processing on the second symbol according to the second context model, to perform processing according to the arithmetic decoding The first index information determines the optimal motion information from the motion information list, wherein the first context model is different from the second context model. 41. 一种用于图像处理的编码器, 其特征在于, 所述编码器包括: 总线;  41. An encoder for image processing, the encoder comprising: a bus; 与所述总线相连的处理器;  a processor coupled to the bus; 与所述总线相连的存储器;  a memory connected to the bus; 其中, 所述处理器通过所述总线, 调用所述存储器中存储的程序, 以用 于根据基本层图像块的运动信息确定目标图像块的第一运动信息, 其中, 所 述的基本层图像块位于基本层图像中, 所述目标图像块位于增强层图像中, 所述的基本层图像与所述增强层图像相对应,且所述基本图像块在所述基本 层图像中的空间位置与所述目标图像块在所述增强层图像中的空间位置相 对应;  The processor, by using the bus, invoking a program stored in the memory, for determining first motion information of a target image block according to motion information of a base layer image block, where the basic layer image block Located in the base layer image, the target image block is located in the enhancement layer image, the base layer image corresponds to the enhancement layer image, and the spatial position and location of the basic image block in the base layer image The spatial position of the target image block in the enhancement layer image corresponds; 用于根据所述增强层图像中与所述目标图像块相邻的邻近图像块的运 动信息确定所述目标图像块的第二运动信息;  And determining second motion information of the target image block according to motion information of adjacent image blocks adjacent to the target image block in the enhancement layer image; 用于根据所述第一运动信息和所述第二运动信息, 生成运动信息列表; 用于根据预定规则从所述运动信息列表中确定所述目标图像块的最优 运动信息;  And configured to generate, according to the first motion information and the second motion information, a motion information list, configured to determine, according to a predetermined rule, optimal motion information of the target image block from the motion information list; 用于根据所述最优运动信息, 对所述目标图像块进行编码, 以生成目标 码流, 所述目标码流包括用于指示所述最优运动信息在所述运动信息列表中 的位置的第一索引信息。  And encoding, according to the optimal motion information, the target image block to generate a target code stream, where the target code stream includes a location for indicating the location of the optimal motion information in the motion information list. First index information. 42. 根据权利要求 41所述的编码器, 其特征在于, 所述处理器具体用 于根据所述基本层图像块包括的与所述目标图像块中包含的目标图像子块 对应的基本层图像子块的运动信息, 确定所述目标图像子块的运动信息, 其 中, 所述目标图像块子块具有预先设定的大小; The encoder according to claim 41, wherein the processor is specifically configured to: according to the base layer image included in the base layer image block, a base layer image corresponding to a target image sub-block included in the target image block Motion information of the sub-block, determining motion information of the target image sub-block, The target image block sub-block has a preset size; 根据所述目标图像子块的运动信息, 确定所述第一运动信息。  And determining the first motion information according to the motion information of the target image sub-block. 43. 根据权利要求 42所述的编码器, 其特征在于, 所述目标图像块包 括至少两个目标图像子块, 以及  43. The encoder of claim 42, wherein the target image block comprises at least two target image sub-blocks, and 所述处理器具体用于当与所述至少两个目标图像子块中的第一目标图 像子块相对应的第一基本层图像子块的运动信息为空时,根据所述目标图像 块的大小、所述目标图像子块的大小和用于指示所述第一目标图像子块在所 述目标图像块中的位置的第二索引信息,确定所述至少两个目标图像子块中 的第二目标图像子块;  The processor is specifically configured to: when motion information of the first base layer image sub-block corresponding to the first target image sub-block of the at least two target image sub-blocks is empty, according to the target image block Determining a size, a size of the target image sub-block, and second index information indicating a position of the first target image sub-block in the target image block, determining a number of the at least two target image sub-blocks Two target image sub-blocks; 用于根据所述第二目标图像子块的运动信息,确定所述第一目标图像子 块的运动信息;  And determining, according to the motion information of the second target image sub-block, motion information of the first target image sub-block; 用于根据所述第一目标图像子块的运动信息, 确定所述第一运动信息; 或  And determining, according to the motion information of the first target image sub-block, the first motion information; or 用于根据所述第二目标图像子块的运动信息, 确定所述第一运动信息; 或  And determining, according to the motion information of the second target image sub-block, the first motion information; or 用于根据所述第一目标图像子块的运动信息以及第二目标图像子块的 运动信息, 确定所述第一运动信息。  And determining, according to the motion information of the first target image sub-block and the motion information of the second target image sub-block, the first motion information. 44. 根据权利要求 43所述的编码器, 其特征在于, 所述处理器具体用 于根据以下任一公式, 确定所述第二目标图像子块,  The encoder according to claim 43, wherein the processor is specifically configured to determine the second target image sub-block according to any one of the following formulas, Idx2 + idx, %N/(N/2))x2 + (l- Idxl %N /(N / 4)%2))χ N /4 ;Idx 2 + idx, %N/(N/2))x2 + (l- Idx l %N /(N / 4)%2))χ N /4 ; Idx2
Figure imgf000073_0001
+ ((l - ldxx %N/(N/2))x2 + (ldxx %N / (N / 4) %2)) xN/4;
Idx 2
Figure imgf000073_0001
+ ((l - ldx x %N/(N/2))x2 + (ldx x %N / (N / 4) %2)) xN/4;
W¾ =/^/NxN + ((l-/ 1%N/(N/2))x2 + (l-/^%N/(N/4)%2))xN/4; 其中, Idx2表示用于指示所述第二目标图像子块在所述目标图像块中的 位置的第三索引信息, / 表示所述第二索引信息, N是根据所述目标图像 块的大小和所述目标图像子块的大小确定的。 W3⁄4 = /^/NxN + ((l-/ 1 %N/(N/2))x2 + (l-/^%N/(N/4)%2))xN/4; where Idx 2 represents Third index information indicating a position of the second target image sub-block in the target image block, / indicating the second index information, N being according to a size of the target image block and the target image The size of the sub-block is determined.
45. 根据权利要求 43或 44所述的编码器, 其特征在于, 所述处理器具 体用于如果所述第二目标图像子块的运动信息为空, 则确定所述第一目标图 像子块的运动信息为零运动信息。  The encoder according to claim 43 or 44, wherein the processor is specifically configured to determine the first target image sub-block if the motion information of the second target image sub-block is empty The motion information is zero motion information. 46. 根据权利要求 42至 45中任一项所述的编码器, 其特征在于, 所述 处理器具体用于根据第三目标图像子块的运动信息, 确定所述第一运动信 息, 其中, 所述第三目标图像子块为所述目标图像块中位于预设位置的目标 图像子块, 或 The encoder according to any one of claims 42 to 45, wherein the processor is specifically configured to determine the first motion information according to motion information of a third target image sub-block, where The third target image sub-block is a target located in a preset position in the target image block Image sub-block, or 所述第三目标图像子块的运动信息在所述目标图像子块的运动信息中 的出现频率最高。  The motion information of the third target image sub-block has the highest frequency of occurrence in the motion information of the target image sub-block. 47. 根据权利要求 46所述的编码器, 其特征在于, 所述处理器具体还 用于根据所述第三目标图像子块的运动信息的参考图像、所述目标图像和所 述目标图像块的参考图像的时域距离关系,对所述第三目标图像子块的运动 信息进行缩放处理;  The encoder according to claim 46, wherein the processor is further configured to use, according to the reference image of the motion information of the third target image sub-block, the target image, and the target image block. And scaling the motion information of the third target image sub-block according to a time domain distance relationship of the reference image; 用于根据所述缩放处理后的第三目标图像子块的运动信息,确定所述第 一运动信息。  And determining the first motion information according to the motion information of the third target image sub-block after the scaling process. 48. 根据权利要求 42至 47中任一项所述的编码器, 其特征在于, 所述 目标图像块包括至少两个目标图像子块, 以及  The encoder according to any one of claims 42 to 47, wherein the target image block includes at least two target image sub-blocks, and 当所述最优信息为所述第一运动信息时, 所述处理器还用于对位于所述 目标图像子块之间的边界附近的像素进行去块效应滤波处理。  And when the optimal information is the first motion information, the processor is further configured to perform deblocking filtering processing on pixels located near a boundary between the target image sub-blocks. 49. 根据权利要求 41至 48中任一项所述的编码器, 其特征在于, 所述 第二运动信息包括时间运动信息和空间运动信息, 以及  The encoder according to any one of claims 41 to 48, wherein the second motion information includes time motion information and spatial motion information, and 所述处理器具体用于根据所述第一运动信息和所述第二运动信息,确定 运动信息列表, 以使所述第一运动信息位于运动信息列表的首位; 或  The processor is specifically configured to determine, according to the first motion information and the second motion information, a motion information list, so that the first motion information is located at a top of the motion information list; or 用于根据所述第一运动信息和所述第二运动信息, 确定运动信息列表, 以使所述第一运动信息位于运动信息列表的末位; 或  And configured to determine, according to the first motion information and the second motion information, a motion information list, so that the first motion information is located at a last position of the motion information list; or 用于根据所述第一运动信息和所述第二运动信息, 确定运动信息列表, 以使所述第一运动信息位于所述运动信息列表中的空间运动信息与所述时 间运动信息之间。  And configured to determine, according to the first motion information and the second motion information, a motion information list, such that the first motion information is located between the spatial motion information in the motion information list and the time motion information. 50. 根据权利要求 41至 49中任一项所述的编码器, 其特征在于, 所述 第一索引信息包括用于指示所述最优运动信息是否为所述第一运动信息的 第一符号和用于指示所述最优运动信息在所述运动列表中的位置的第二符 号, 以及  The encoder according to any one of claims 41 to 49, wherein the first index information includes a first symbol for indicating whether the optimal motion information is the first motion information And a second symbol for indicating a position of the optimal motion information in the motion list, and 所述处理器具体用于根据第一上下文模型,对所述第一符号进行算术编 码处理;  The processor is specifically configured to perform arithmetic coding processing on the first symbol according to the first context model; 用于根据第二上下文模型, 对所述第二符号进行算术编码处理, 其中, 所述第一上下文模型与所述第二上下文模型相异。  And performing arithmetic coding processing on the second symbol according to the second context model, where the first context model is different from the second context model. 51. 一种用于图像处理的解码器, 其特征在于, 所述解码器包括: 总线; 51. A decoder for image processing, wherein the decoder comprises: bus; 与所述总线相连的处理器;  a processor coupled to the bus; 与所述总线相连的存储器;  a memory connected to the bus; 其中, 所述处理器通过所述总线, 调用所述存储器中存储的程序, 以用 于根据基本层图像块的运动信息确定目标图像块的第一运动信息, 其中, 所 述的基本层图像块位于基本层图像中, 所述目标图像块位于增强层图像中, 所述的基本层图像与所述增强层图像相对应,且所述基本图像块在所述基本 层图像中的空间位置与所述目标图像块在所述增强层图像中的空间位置相 对应;  The processor, by using the bus, invoking a program stored in the memory, for determining first motion information of a target image block according to motion information of a base layer image block, where the basic layer image block Located in the base layer image, the target image block is located in the enhancement layer image, the base layer image corresponds to the enhancement layer image, and the spatial position and location of the basic image block in the base layer image The spatial position of the target image block in the enhancement layer image corresponds; 用于根据所述增强层图像中与所述目标图像块相邻的邻近图像块的运 动信息确定所述目标图像块的第二运动信息;  And determining second motion information of the target image block according to motion information of adjacent image blocks adjacent to the target image block in the enhancement layer image; 用于根据所述第一运动信息和所述第二运动信息, 生成运动信息列表; 用于根据目标码流, 获取用于指示所述最优运动信息在所述运动信息列 表中的位置的第一索引信息;  And configured to generate, according to the first motion information and the second motion information, a motion information list, configured to acquire, according to the target code stream, a location for indicating a location of the optimal motion information in the motion information list. An index information; 用于根据所述第一索引信息, 从所述运动信息列表中确定最优运动信 息, 根据所述最优运动信息, 对所述目标码流进行解码, 以获取所述目标图 像块。  And determining, according to the first index information, optimal motion information from the motion information list, and decoding the target code stream according to the optimal motion information to obtain the target image block. 52. 根据权利要求 51所述的解码器, 其特征在于, 所述处理器具体用 于根据所述基本层图像块包括的与所述目标图像块中包含的目标图像子块 对应的基本层图像子块的运动信息, 确定所述目标图像子块的运动信息, 其 中, 所述目标图像块子块具有预先设定的大小;  The decoder according to claim 51, wherein the processor is specifically configured to: according to the base layer image included in the base layer image block, a base layer image corresponding to a target image sub-block included in the target image block The motion information of the sub-block determines motion information of the target image sub-block, where the target image block sub-block has a preset size; 根据所述目标图像子块的运动信息, 确定所述第一运动信息。  And determining the first motion information according to the motion information of the target image sub-block. 53. 根据权利要求 52所述的解码器, 其特征在于, 所述目标图像块包 括至少两个目标图像子块, 以及  53. The decoder of claim 52, wherein the target image block comprises at least two target image sub-blocks, and 所述处理器具体用于当与所述至少两个目标图像子块中的第一目标图 像子块相对应的第一基本层图像子块的运动信息为空时,根据所述目标图像 块的大小、所述目标图像子块的大小和用于指示所述第一目标图像子块在所 述目标图像块中的位置的第二索引信息,确定所述至少两个目标图像子块中 的第二目标图像子块;  The processor is specifically configured to: when motion information of the first base layer image sub-block corresponding to the first target image sub-block of the at least two target image sub-blocks is empty, according to the target image block Determining a size, a size of the target image sub-block, and second index information indicating a position of the first target image sub-block in the target image block, determining a number of the at least two target image sub-blocks Two target image sub-blocks; 用于根据所述第二目标图像子块的运动信息,确定所述第一目标图像子 块的运动信息; 用于根据所述第一目标图像子块的运动信息, 确定所述第一运动信息; 或 And determining, according to the motion information of the second target image sub-block, motion information of the first target image sub-block; And determining, according to the motion information of the first target image sub-block, the first motion information; or 用于根据所述第二目标图像子块的运动信息, 确定所述第一运动信息; 或  And determining, according to the motion information of the second target image sub-block, the first motion information; or 用于根据所述第一目标图像子块的运动信息以及第二目标图像子块的 运动信息, 确定所述第一运动信息。  And determining, according to the motion information of the first target image sub-block and the motion information of the second target image sub-block, the first motion information. 54. 根据权利要求 53所述的解码器, 其特征在于, 所述处理器具体用 于根据以下任一公式, 确定所述第二目标图像子块,  The decoder according to claim 53, wherein the processor is specifically configured to determine the second target image sub-block according to any one of the following formulas, Idx2 + idx, %N/(N/2))x2 + (l- Idxl %N /(N / 4)%2))χ N /4 ; Idx2
Figure imgf000076_0001
+ ((l - ldxx %N/(N/2))x2 + (ldxx %N / (N / 4) %2)) xN/4;
Idx 2 + idx, %N/(N/2))x2 + (l- Idx l %N /(N / 4)%2))χ N /4 ; Idx 2
Figure imgf000076_0001
+ ((l - ldx x %N/(N/2))x2 + (ldx x %N / (N / 4) %2)) xN/4;
W¾ =/^/NxN + ((l-/ x1 N/(N/2))x2 + (l-/^ N/(N/4) 2))xN/4; 其中, Idx2表示用于指示所述第二目标图像子块在所述目标图像块中的 位置的第三索引信息, / 表示所述第二索引信息, N是根据所述目标图像 块的大小和所述目标图像子块的大小确定的。 W3⁄4 = /^/NxN + ((l-/ x 1 N/(N/2))x2 + (l-/^ N/(N/4) 2))xN/4; where Idx 2 is used for a third index information indicating a position of the second target image sub-block in the target image block, / representing the second index information, N being according to a size of the target image block and the target image sub-block The size is ok.
55. 根据权利要求 53或 54所述的解码器, 其特征在于, 所述处理器具 体用于如果所述第二目标图像子块的运动信息为空, 则确定所述第一目标图 像子块的运动信息为零运动信息。  The decoder according to claim 53 or 54, wherein the processor is specifically configured to determine the first target image sub-block if the motion information of the second target image sub-block is empty The motion information is zero motion information. 56. 根据权利要求 52至 55中任一项所述的解码器, 其特征在于, 所述 处理器具体用于根据第三目标图像子块的运动信息, 确定所述第一运动信 息, 其中, 所述第三目标图像子块为所述目标图像块中位于预设位置的目标 图像子块, 或  The decoder according to any one of claims 52 to 55, wherein the processor is specifically configured to determine the first motion information according to motion information of a third target image sub-block, where The third target image sub-block is a target image sub-block located at a preset position in the target image block, or 所述第三目标图像子块的运动信息在所述目标图像子块的运动信息中 的出现频率最高。  The motion information of the third target image sub-block has the highest frequency of occurrence in the motion information of the target image sub-block. 57. 根据权利要求 56所述的解码器, 其特征在于, 所述处理器具体还 用于根据所述第三目标图像子块的运动信息的参考图像、所述目标图像和所 述目标图像块的参考图像的时域距离关系,对所述第三目标图像子块的运动 信息进行缩放处理;  The decoder according to claim 56, wherein the processor is further configured to use, according to the reference image of the motion information of the third target image sub-block, the target image, and the target image block. And scaling the motion information of the third target image sub-block according to a time domain distance relationship of the reference image; 用于根据所述缩放处理后的第三目标图像子块的运动信息,确定所述第 一运动信息。  And determining the first motion information according to the motion information of the third target image sub-block after the scaling process. 58. 根据权利要求 52至 57中任一项所述的解码器, 其特征在于, 所述 目标图像块包括至少两个目标图像子块, 以及 当所述最优信息为所述第一运动信息时, 所述处理器还用于对位于所述 目标图像子块之间的边界附近的像素进行去块效应滤波处理。 The decoder according to any one of claims 52 to 57, wherein the target image block includes at least two target image sub-blocks, and When the optimal information is the first motion information, the processor is further configured to perform deblocking filtering processing on pixels located near a boundary between the target image sub-blocks. 59. 根据权利要求 51至 58中任一项所述的解码器, 其特征在于, 所述 第二运动信息包括时间运动信息和空间运动信息, 以及  The decoder according to any one of claims 51 to 58, wherein the second motion information includes time motion information and spatial motion information, and 所述处理器具体用于根据所述第一运动信息和所述第二运动信息,确定 运动信息列表, 以使所述第一运动信息位于运动信息列表的首位; 或  The processor is specifically configured to determine, according to the first motion information and the second motion information, a motion information list, so that the first motion information is located at a top of the motion information list; or 用于根据所述第一运动信息和所述第二运动信息, 确定运动信息列表, 以使所述第一运动信息位于运动信息列表的末位; 或  And configured to determine, according to the first motion information and the second motion information, a motion information list, so that the first motion information is located at a last position of the motion information list; or 用于根据所述第一运动信息和所述第二运动信息, 确定运动信息列表, 以使所述第一运动信息位于所述运动信息列表中的空间运动信息与所述时 间运动信息之间。  And configured to determine, according to the first motion information and the second motion information, a motion information list, such that the first motion information is located between the spatial motion information in the motion information list and the time motion information. 60. 根据权利要求 51至 59中任一项所述的解码器, 其特征在于, 所述 第一索引信息包括用于指示所述最优运动信息是否为所述第一运动信息的 第一符号和用于指示所述最优运动信息在所述运动列表中的位置的第二符 号, 以及  The decoder according to any one of claims 51 to 59, wherein the first index information includes a first symbol for indicating whether the optimal motion information is the first motion information And a second symbol for indicating a position of the optimal motion information in the motion list, and 所述处理器具体用于根据第一上下文模型,对所述第一符号进行算术解 码处理, 并根据第二上下文模型, 对所述第二符号进行算术解码处理, 以根 据所述算术解码处理后的第一索引信息,从所述运动信息列表中确定最优运 动信息, 其中, 所述第一上下文模型与所述第二上下文模型相异。  The processor is specifically configured to perform an arithmetic decoding process on the first symbol according to a first context model, and perform an arithmetic decoding process on the second symbol according to the second context model, to perform processing according to the arithmetic decoding. The first index information determines the optimal motion information from the motion information list, wherein the first context model is different from the second context model.
PCT/CN2013/084538 2012-09-29 2013-09-27 Method and device for image processing, coder and decoder Ceased WO2014048378A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201210375082.9 2012-09-29
CN201210375082.9A CN103716631B (en) 2012-09-29 2012-09-29 For the method for image procossing, device, encoder

Publications (1)

Publication Number Publication Date
WO2014048378A1 true WO2014048378A1 (en) 2014-04-03

Family

ID=50387020

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2013/084538 Ceased WO2014048378A1 (en) 2012-09-29 2013-09-27 Method and device for image processing, coder and decoder

Country Status (2)

Country Link
CN (1) CN103716631B (en)
WO (1) WO2014048378A1 (en)

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109922336B (en) * 2017-12-12 2023-07-18 华为技术有限公司 Method and device for inter-frame prediction of video data
CN109996075B (en) * 2017-12-29 2022-07-12 华为技术有限公司 Image decoding method and decoder
EP4362468A3 (en) 2018-07-02 2024-06-26 Huawei Technologies Co., Ltd. Motion vector prediction method and device, and codec
CN110933426B (en) * 2018-09-20 2022-03-01 杭州海康威视数字技术股份有限公司 A decoding and encoding method and device thereof
CN112118447B (en) 2019-06-19 2023-06-20 华为技术有限公司 Method, device and codec for constructing fusion candidate motion information list
CN119788885B (en) * 2022-07-14 2025-12-26 杭州海康威视数字技术股份有限公司 A neural network-based image decoding and encoding method, apparatus, and device.

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050226335A1 (en) * 2004-04-13 2005-10-13 Samsung Electronics Co., Ltd. Method and apparatus for supporting motion scalability
US20060133677A1 (en) * 2004-12-06 2006-06-22 Park Seung W Method and apparatus for performing residual prediction of image block when encoding/decoding video signal
CN101147399A (en) * 2005-04-06 2008-03-19 汤姆森许可贸易公司 Method and apparatus for encoding enhancement layer video data
CN101198064A (en) * 2007-12-10 2008-06-11 武汉大学 A Motion Vector Prediction Method in Resolution Hierarchical Technology
CN101204094A (en) * 2005-04-15 2008-06-18 Lg电子株式会社 Method for scalable encoding and decoding of video signals
US20100272183A1 (en) * 2008-04-11 2010-10-28 Huawei Technologies Co., Ltd. Inter-frame prediction coding method, device and system

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102004059993B4 (en) * 2004-10-15 2006-08-31 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Apparatus and method for generating a coded video sequence using interlayer motion data prediction, and computer program and computer readable medium
EP1969853A1 (en) * 2006-01-05 2008-09-17 Thomson Licensing Inter-layer motion prediction method

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050226335A1 (en) * 2004-04-13 2005-10-13 Samsung Electronics Co., Ltd. Method and apparatus for supporting motion scalability
US20060133677A1 (en) * 2004-12-06 2006-06-22 Park Seung W Method and apparatus for performing residual prediction of image block when encoding/decoding video signal
CN101147399A (en) * 2005-04-06 2008-03-19 汤姆森许可贸易公司 Method and apparatus for encoding enhancement layer video data
CN101204094A (en) * 2005-04-15 2008-06-18 Lg电子株式会社 Method for scalable encoding and decoding of video signals
CN101198064A (en) * 2007-12-10 2008-06-11 武汉大学 A Motion Vector Prediction Method in Resolution Hierarchical Technology
US20100272183A1 (en) * 2008-04-11 2010-10-28 Huawei Technologies Co., Ltd. Inter-frame prediction coding method, device and system

Also Published As

Publication number Publication date
CN103716631B (en) 2017-04-05
CN103716631A (en) 2014-04-09

Similar Documents

Publication Publication Date Title
JP7693895B2 (en) Video decoding method and video decoder
KR102334151B1 (en) Image prediction method and related device
KR101650635B1 (en) Coding of last significant transform coefficient
CN112005551B (en) A video image prediction method and device
CN104662908B (en) Depth map decoding
TWI536812B (en) Constraints on neighboring block based disparity vector (nbdv) techniques for 3d video
CN105519116A (en) Scalable HEVC device and method for generating an adapted motion vector candidate list for motion prediction in an enhancement layer
WO2014048378A1 (en) Method and device for image processing, coder and decoder
CN103716629B (en) Image processing method, device, coder and decoder
JP2016501483A (en) Multi-layer low complexity support for HEVC extension in video coding
CN110381317B (en) Method and apparatus for deriving motion information between time points of sub-prediction units
CN112771869B (en) Video encoding and decoding methods and devices
WO2020042630A1 (en) Video image prediction method and apparatus
CN103079067B (en) Motion vector predictor list builder method and video coding-decoding method and device
JP2014509093A (en) Video decoding method using buffer compression for motion vector competition
CN110868589A (en) Inter-frame prediction method, device and encoding/decoding method and device for its application
TWI543590B (en) Spatial motion vector scaling for scalable video coding
CN111010565B (en) Inter-frame prediction method and device and coding/decoding method and device applied by same
CN119213765A (en) Method and apparatus for candidate derivation of affine merge modes in video coding
JP7804765B2 (en) Candidate derivation for affine merging modes in video coding
JP7764600B2 (en) Method and device for candidate derivation for affine merging modes in video coding - Patents.com
CN104301734B (en) The method and apparatus for handling image
RU2783337C2 (en) Method for video decoding and video decoder
JP2026021367A (en) Method and device for candidate derivation for affine merging modes in video coding - Patents.com
JP2025540521A (en) Method and non-transitory computer-readable storage medium for performing sub-block-based inter prediction

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 13840911

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 13840911

Country of ref document: EP

Kind code of ref document: A1