WO2014048353A1

WO2014048353A1 - Processing method and device for scaled code stream and coder for scaled code stream

Info

Publication number: WO2014048353A1
Application number: PCT/CN2013/084380
Authority: WO
Inventors: 杨海涛; 周建同
Original assignee: Huawei Technologies Co Ltd
Current assignee: Huawei Technologies Co Ltd
Priority date: 2012-09-30
Filing date: 2013-09-27
Publication date: 2014-04-03
Anticipated expiration: 2015-03-30
Also published as: CN103716633A

Abstract

Provided is a processing method for a scaled code stream, including: receiving a code stream of a base layer and a code stream of an enhancement layer; decoding the code stream of the base layer to obtain a decoded image block of the base layer; parsing the code stream of the enhancement layer to obtain mode information about a block to be decoded of the enhancement layer contained in the code stream of the enhancement layer, the mode information being used for indicating a decoding mode for the block to be decoded of the enhancement layer; acquiring a predicted value of an image block of the enhancement layer to be decoded and reconstructed from the decoded image block of the base layer; and according to the predicted value and the mode information about the image block to be decoded of the enhancement layer, decoding a module to be decoded of the enhancement layer.

Description

一种分层码流的处理方法，装置及分层码流的编码器 Method for processing layered code stream, device and encoder for layered code stream

技术领域本发明涉及技术，尤其涉及一种分层码流的处理方法，装置及分层码流的编码器。背景技术 TECHNICAL FIELD The present invention relates to the field, and in particular, to a method, a device, and an encoder for layered code streams. Background technique

随着网络技术和终端处理能力的不断提高和发展，人们对视频编码的要求越来越高。高效率视频编码（ High Efficiency Video Coding , 简称 HEVC ) 是新一代的视频编码标准，可以提供良好的视频压缩效率。 With the continuous improvement and development of network technology and terminal processing capabilities, people are increasingly demanding video coding. High Efficiency Video Coding (HEVC) is a new generation of video coding standards that provide good video compression efficiency.

HEVC编解码技术釆用混合编码框架进行编码和解码。视频图像被分为 NxM的图像块进行预测、变换、量化和熵编码，为达到压缩信息的目的， N 和 M可以为 64、 32或者 16等不同的尺寸。其中预测编码技术包括帧内预测和帧间预测，帧内预测主要利用图像块的空间相关性，使用当前编码块周边重建像素生成当前块的预测值，对当前图像块像素和预测值的差值信号进行变换、量化和熵编码，实现压缩。帧间预测利用图像块的时间相关性，使用来自当前块所在图像前或后的重建图像中的匹配块生成当前块的预测值，后续经过和帧内预测近似的过程完成帧间编码过程。釆用预测编码后的码流中包含有预测模式信息或差值信息。特别的，对于帧间预测编码码流，包含一种特殊的预测模式一帧间预测跳过模式，对于使用帧间预测跳过模式的图像块编码数据，不包含差值信息。 The HEVC codec technology uses a hybrid coding framework for encoding and decoding. The video image is divided into NxM image blocks for prediction, transformation, quantization and entropy coding. For the purpose of compressing information, N and M can be 64, 32 or 16 different sizes. The predictive coding technique includes intra prediction and inter prediction. The intra prediction mainly utilizes the spatial correlation of the image block, and uses the reconstructed pixels around the current coding block to generate a prediction value of the current block, and the difference between the current image block pixel and the predicted value. The signal is transformed, quantized, and entropy encoded to achieve compression. Inter-frame prediction utilizes the temporal correlation of the image block, uses the matching block from the reconstructed image before or after the image of the current block to generate the predicted value of the current block, and then completes the inter-frame encoding process through the process of approximating with the intra prediction. The predictive coded code stream includes prediction mode information or difference information. Specifically, for the interframe predictive coded stream, a special prediction mode-inter prediction skip mode is included, and the block coded data using the inter prediction skip mode does not include the difference information.

可分层视频编解码（Scaled Video Coding, 简称 SVC ), 是一种能将视频流分割为多个分辨率、质量和帧速率层的技术，将 SVC技术作为 HEVC的扩展，视频数据被分为多个可调整分辨率、帧速率或质量的可选增强层组成的多层视频流。 SVC编码技术引入了层间预测概念，对于分辨率分层编码技术，视频数据被分为不同分辨率的多个视频数据层，对于每一层视频数据，除了可以釆用和 HEVC相同的视频压缩方法，还可以通过层间预测的方法来实现更加高效的视频压缩性能。当视频图像被分为多个不同分辨率的图像时，比如分为 L层，第 0层分辨率最小，第 L层分辨率最大。相对于 L层， L-1 层为第 L层的基础层。编码当前层时，可以利用当前层的基础层重建图像对当前层像素快进行预测编码。如何利用层间信息提高分层视频编码效率是分层编码技术需要解决的关键问题。 Scalable Video Coding (SVC) is a technology that can split a video stream into multiple resolution, quality, and frame rate layers. SVC technology is used as an extension of HEVC, and video data is divided into Multiple layers of video streams with optional enhancement layers that adjust resolution, frame rate, or quality. SVC coding technology introduces the concept of inter-layer prediction. For resolution layered coding technology, video data is divided into multiple video data layers of different resolutions. For each layer of video data, the same video compression as HEVC can be used. In this way, more efficient video compression performance can be achieved by inter-layer prediction. When the video image is divided into a plurality of images of different resolutions, for example, it is divided into L layers, the 0th layer has the smallest resolution, and the Lth layer has the largest resolution. Relative to the L layer, L-1 The layer is the base layer of the Lth layer. When encoding the current layer, the current layer's base layer reconstructed image can be used to predictively encode the current layer of pixels. How to improve the efficiency of layered video coding by using inter-layer information is a key problem that layered coding technology needs to solve.

发明内容 Summary of the invention

本发明提供一种分层码流的处理方法，装置及分层码流的编码器用以提高分层编码的压缩效率。第一方面，提供了一种分层码流的处理方法，该方法包括：接收基础层码流和增强层码流；解码所述基础层码流得到解码后的基础层图像块；解析所述增强层码流，得到包含在所述增强层码流中的增强层待解码块的模式信息，所述模式信息用于指示所述增强层待解码块的解码方式；从所述解码后的基础层图像块中获取所述增强层待解码重建图像块的预测值；根据所述预测值和所述增强层待解码图像块的模式信息解码所述增强层待解码模块。结合第一方面，在一种可能的实施方式中，该方法还包括：其中，所述模式信息所指示的所述增强层待解码块的解码方式包括层间预测跳过模式，对应的，所述根据所述预测值和所述增强层待解码图像块的模式信息解码所述增强层待解码模块包括：根据所述预测值和所述层间预测跳过模式解码所述增强层待解码模块。结合第一方面和第一种可能的实施方式，在第二种可能的实施方式中，所述根据所述预测值和所述层间预测跳过模式解码所述增强层待解码模块包括：将所述预测值作为所述增强层待解码图像块的解码后图像块。结合第一方面、第一种可能的实施方式和第二种可能的实施方式，在第三种可能的实施方式中，所述将所述预测值作为所述增强层待解码图像块的解码后图像块包括：选取和所述增强层的待解码图像块对应的所述解码后的基础层图像块，经过上釆样后得到所述增强层待解码重建图像块的预测值；所述预测值作为所述增强层的待解码重建图像块的像素值得到所述增强层待解码图像块的解码后图像块。 The present invention provides a method for processing a layered code stream, and an apparatus and an encoder for layered code streams are used to improve the compression efficiency of layered coding. In a first aspect, a method for processing a layered code stream is provided, the method comprising: receiving a base layer code stream and an enhancement layer code stream; decoding the base layer code stream to obtain a decoded base layer image block; An enhancement layer code stream, where mode information of an enhancement layer to be decoded block included in the enhancement layer code stream is obtained, where the mode information is used to indicate a decoding mode of the enhancement layer to be decoded block; Obtaining a prediction value of the enhancement layer to be decoded reconstructed image block in a layer image block; decoding the enhancement layer to be decoded module according to the prediction value and mode information of the enhancement layer to be decoded image block. With reference to the first aspect, in a possible implementation, the method further includes: wherein, the decoding manner of the enhanced layer to be decoded block indicated by the mode information includes an inter-layer prediction skip mode, corresponding, Decoding the enhancement layer to be decoded module according to the prediction value and mode information of the enhancement layer to be decoded image block includes: decoding the enhancement layer to be decoded module according to the prediction value and the inter-layer prediction skip mode . With reference to the first aspect and the first possible implementation manner, in the second possible implementation, the decoding, by the prediction value and the inter-layer prediction skip mode, the enhancement layer to be decoded module includes: The predicted value is used as a decoded image block of the enhancement layer to be decoded image block. With reference to the first aspect, the first possible implementation manner, and the second possible implementation manner, in a third possible implementation manner, the predicting value is used as the decoding of the enhanced layer to be decoded image block. The image block includes: selecting the decoded base layer image block corresponding to the image block to be decoded of the enhancement layer, and obtaining a predicted value of the enhanced layer to be decoded reconstructed image block after being uploaded; A pixel value of the reconstructed image block to be decoded of the enhancement layer is obtained as a decoded image block of the enhancement layer image block to be decoded.

结合第一方面、第一种可能的实施方式、第二种可能的实施方式或第三种可能的实施方式，在第四种可能的实施方式中，所述解析所述增强层码流，得到包含在所述增强层码流中的增强层待解码块的模式信息，包括：解析包含在所述增强层码流中的增强层待解码图像块的层间预测跳过模式标识，将所述层间预测跳过模式标识作为所述增强层待解码图像块的模式信息，用于根据所述层间预测跳过模式标识确定所述增强层待解码图像块是否釆用层间预测跳过模式解码；对应的，当层间预测跳过模式标识指示所述增强层待解码图像块是釆用层间预测跳过模式解码时，则执行所述的根据所述预测值和所述层间预测跳过模式解码所述增强层待解码模块。 With reference to the first aspect, the first possible implementation manner, the second possible implementation manner, or the third possible implementation manner, in a fourth possible implementation manner, the analyzing the enhancement layer code stream, Mode information of an enhancement layer to be decoded block included in the enhancement layer code stream, including: parsing packet An inter-layer prediction skip mode identifier of an enhancement layer to be decoded image block included in the enhancement layer code stream, where the inter-layer prediction skip mode identifier is used as mode information of the enhancement layer to be decoded image block, Determining, according to the inter-layer prediction skip mode identifier, whether the enhancement layer to be decoded image block uses inter-layer prediction skip mode decoding; correspondingly, when the inter-layer prediction skip mode identifier indicates the enhancement layer to be decoded image block When the inter-layer prediction skip mode decoding is used, the enhancement layer to be decoded module is decoded according to the prediction value and the inter-layer prediction skip mode.

结合第一方面和第四种可能的实施方式，所述解析所述增强层码流，得到包含在所述增强层码流中的增强层待解码块的模式信息，还包括：解析所述增强层的待解码图像块的跳过模式标识，如果所述跳过模式标识标识所述增强层的待解码图像块的解码方式为跳过模式，则执行所述的解析包含在所述增强层码流中的增强层待解码图像块的层间预测跳过模式标识。 With reference to the first aspect and the fourth possible implementation manner, the parsing the enhancement layer code stream to obtain mode information of an enhancement layer to be decoded block included in the enhancement layer code stream, further includes: parsing the enhancement a skip mode identifier of the image block to be decoded of the layer, if the skip mode identifier identifies that the decoding mode of the image block to be decoded of the enhancement layer is a skip mode, performing the parsing included in the enhancement layer code The inter-layer prediction skip mode identification of the enhancement layer to be decoded in the stream.

第二方面，提供一种分层码流的处理方法，该方法包括：编码基础层图像块，生成基础层码流；根据预设的编码方式编码增强层图像块，形成增强层码流，并将与所述预设的编码方式对应的模式信息写入所述增强层码流中用于使解码端根据所述模式信息解码所述增强层码流。 A second aspect provides a method for processing a layered code stream, the method comprising: encoding a base layer image block to generate a base layer code stream; encoding an enhancement layer image block according to a preset encoding manner to form an enhancement layer code stream, and Mode information corresponding to the preset coding mode is written into the enhancement layer code stream for causing a decoding end to decode the enhancement layer code stream according to the mode information.

结合第二方面，在一种可能的实施方式中，该方法还包括：所述预设的编码方式为层间预测跳过模式;对应的，所述根据预设的编码方式编码增强层图像块，形成增强层码流，并将于所述与所述预设的编码方式对应的模式信息写入所述的增强层码流中用于使解码端根据所述模式信息解码所述增强层码流，包括：根据层间预测跳过模式编码增强层图像块，形成增强层码流，并将于所述与所述层间预测跳过模式对应的层间预测跳过模式标识作为模式信息写入所述的增强层码流中用于使解码端根据所述层间预测跳过模式标识解码所述增强层码流。结合第二方面或第一种可能的实施方式，在第二种可能的实施方式中所述方法还包括：将跳过模式标识写入所述增强层码流中，所述跳过模式标识用以指示所述预设的编码方式是否为跳过模式。第三方面提供一种分层码流的处理装置，该装置包括：接收模块，用于接收基础层码流和增强层码流；解码模块，用于解码所述基础层码流得到解码后的基础层图像块；解析模块，解析所述增强层码流，得到包含在所述增强层码流中的增强层待解码块的模式信息，所述模式信息用于指示所述增强层待解码块的解码方式；参数获取模块，用于从所述解码后的基础层图像块中获取所述增强层待解码重建图像块的预测值；所述解码模块，还用于根据所述预测值和所述增强层待解码图像块的模式信息解码所述增强层待解码模块。结合第三方面，在一种可能的实施方式中，其中，所述模式信息所指示的所述增强层待解码块的解码方式包括层间预测跳过模式，对应的，所述的所述解码模块，还用于根据所述预测值和所述增强层待解码图像块的模式信息解码所述增强层待解码模块具体包括：所述解码模块，还用于根据所述预测值和所述层间预测跳过模式解码所述增强层待解码模块。 With reference to the second aspect, in a possible implementation, the method further includes: the preset coding mode is an inter-layer prediction skip mode; correspondingly, the coding the enhancement layer image block according to a preset coding manner And forming an enhancement layer code stream, and writing the mode information corresponding to the preset coding mode into the enhancement layer code stream, so that the decoding end decodes the enhancement layer code according to the mode information. Flowing, including: encoding an enhancement layer image block according to an inter-layer prediction skip mode, forming an enhancement layer code stream, and writing the inter-layer prediction skip mode identifier corresponding to the inter-layer prediction skip mode as mode information The enhancement layer code stream is used to enable the decoding end to decode the enhancement layer code stream according to the inter-layer prediction skip mode identifier. With reference to the second aspect or the first possible implementation manner, in a second possible implementation manner, the method further includes: writing a skip mode identifier into the enhancement layer code stream, where the skip mode identifier is used To indicate whether the preset encoding mode is a skip mode. A third aspect provides a processing apparatus for layered code stream, the apparatus comprising: a receiving module, configured to receive a base layer code stream and an enhancement layer code stream; and a decoding module, configured to decode the base layer code stream to obtain a decoded a base layer image block; a parsing module, parsing the enhancement layer code stream, and obtaining the inclusion in the increase The mode information of the enhanced layer to be decoded in the strong layer code stream, the mode information is used to indicate the decoding mode of the enhanced layer to be decoded block, and the parameter obtaining module is configured to use the decoded base layer image block. And acquiring, by the decoding module, the enhancement layer to be decoded module according to the prediction value and the mode information of the enhancement layer to be decoded image block. With reference to the third aspect, in a possible implementation, the decoding manner of the enhanced layer to be decoded block indicated by the mode information includes an inter-layer prediction skip mode, corresponding to the decoding And the module is further configured to: decode the enhanced layer to be decoded module according to the predicted value and the mode information of the enhanced layer to be decoded image block, where the method further includes: the decoding module, further configured to use the predicted value and the layer The inter prediction skip mode decodes the enhancement layer to be decoded module.

结合第三方面和第一种可能的实施方式，在第二种可能的实施方式中，所述解码模块具体用于将所述预测值作为所述增强层待解码图像块的解码后图像块。 With reference to the third aspect and the first possible implementation manner, in a second possible implementation manner, the decoding module is specifically configured to use the predicted value as a decoded image block of the enhancement layer to be decoded image block.

结合第三方面、第一种可能的实施方式和第二种可能的实施方式，所述解码模块具体用于选取和所述增强层的待解码图像块对应的所述解码后的基础层图像块，经过上釆样后得到所述增强层待解码重建图像块的预测值；将所述预测值作为所述增强层的待解码重建图像块的像素值得到所述增强层待解码图像块的解码后图像块。 With reference to the third aspect, the first possible implementation manner, and the second possible implementation manner, the decoding module is specifically configured to select the decoded base layer image block corresponding to the image block to be decoded of the enhancement layer. Obtaining a prediction value of the reconstructed image block to be decoded by the enhancement layer; and using the predicted value as a pixel value of the reconstructed image block of the enhancement layer to obtain decoding of the image block to be decoded of the enhancement layer Post image block.

结合第三方面、第一种可能的实施方式、第二种可能的实施方式和第三种可能的实施方式，在第四种可能的实施方式中，所述解析模块具体用于：解析包含在所述增强层码流中的增强层待解码图像块的层间预测跳过模式标识，将所述层间预测跳过模式标识作为所述增强层待解码图像块的模式信息，用于根据所述层间预测跳过模式标识确定所述增强层待解码图像块是否釆用层间预测跳过模式解码；对应的，当层间预测跳过模式标识指示所述增强层待解码图像块是釆用层间预测跳过模式解码时，所述解码模块，用于根据所述预测值和所述层间预测跳过模式解码所述增强层待解码模块。 With reference to the third aspect, the first possible implementation manner, the second possible implementation manner, and the third possible implementation manner, in a fourth possible implementation manner, the parsing module is specifically configured to: An inter-layer prediction skip mode identifier of an enhancement layer to be decoded image block in the enhancement layer code stream, where the inter-layer prediction skip mode identifier is used as mode information of the enhancement layer to be decoded image block, The inter-layer prediction skip mode identifier determines whether the enhancement layer to-be-decoded image block uses inter-layer prediction skip mode decoding; correspondingly, when the inter-layer prediction skip mode identifier indicates that the enhancement layer to be decoded image block is 釆The decoding module is configured to decode the enhancement layer to be decoded module according to the prediction value and the inter-layer prediction skip mode when decoding by using an inter-layer prediction skip mode.

结合第三方面和第四种可能的实施方式，在第五种可能的实施方式中，所述解析模块还用于解析所述增强层的待解码图像块的跳过模式标识，如果所述跳过模式标识标识所述增强层的待解码图像块的解码方式为跳过模式，则用于执行所述的解析包含在所述增强层码流中的增强层待解码图像块的层间预测跳过模式标识。第四方面，提供一种分层码流的编码器，该装置包括：第一编码模块，用于编码基础层图像块，生成基础层码流；第二编码模块，用于根据预设的编码方式编码增强层图像块，形成增强层码流，并将与所述预设的编码方式对应的模式信息写入所述增强层码流中用于使解码端根据所述模式信息解码所述增强层码流。结合第四方面，在一种可能的实施方式中，所述预设的编码方式为层间预测跳过模式；对应的，所述第二编码模块用于，根据层间预测跳过模式编码增强层图像块，形成增强层码流，并将于所述与所述层间预测跳过模式对应的层间预测跳过模式标识作为模式信息写入所述的增强层码流中用于使解码端根据所述层间预测跳过模式标识解码所述增强层码流。结合第四方面或第一种可能的实施方式中，在第二种可能的所述第二编码模块还用于将跳过模式标识写入所述增强层码流中，所述跳过模式标识用以指示所述预设的编码方式是否为跳过模式。第五方面，提供了一种分层码流的处理装置，该装置包括存储器及处理器，所述处理器用于读取存储在所述存储其中的可执行指令，以执行如下步骤：接收基础层码流和增强层码流；解码所述基础层码流得到解码后的基础层图像块；解析所述增强层码流，得到包含在所述增强层码流中的增强层待解码块的模式信息，所述模式信息用于指示所述增强层待解码块的解码方式；从所述解码后的基础层图像块中获取所述增强层待解码重建图像块的预测值；根据所述预测值和所述增强层待解码图像块的模式信息解码所述增强层待解码模块。 With reference to the third aspect and the fourth possible implementation manner, in a fifth possible implementation, the parsing module is further configured to parse a skip mode identifier of the image block to be decoded of the enhancement layer, if the hop The mode identifier identifies that the decoding mode of the image block to be decoded of the enhancement layer is a skip mode, and is used to perform the layer of the enhancement layer to be decoded image block that is included in the enhancement layer code stream. Inter prediction skip mode identification. In a fourth aspect, an encoder for layered code stream is provided, where the apparatus includes: a first encoding module, configured to encode a base layer image block, to generate a base layer code stream; and a second encoding module, configured to use a preset encoding And encoding an enhancement layer image block, forming an enhancement layer code stream, and writing mode information corresponding to the preset coding mode into the enhancement layer code stream for causing the decoding end to decode the enhancement according to the mode information. Layer code stream. With reference to the fourth aspect, in a possible implementation manner, the preset coding mode is an inter-layer prediction skip mode; correspondingly, the second coding module is configured to perform, according to an inter-layer prediction skip mode coding enhancement. a layer image block, forming an enhancement layer code stream, and writing the inter-layer prediction skip mode identifier corresponding to the inter-layer prediction skip mode as mode information in the enhancement layer code stream for decoding The terminal decodes the enhancement layer code stream according to the inter-layer prediction skip mode identifier. In conjunction with the fourth aspect or the first possible implementation, the second possible second encoding module is further configured to write a skip mode identifier into the enhancement layer code stream, where the skip mode identifier is It is used to indicate whether the preset encoding mode is a skip mode. In a fifth aspect, a processing apparatus for layered code stream is provided, the apparatus comprising a memory and a processor, wherein the processor is configured to read executable instructions stored in the storage to perform the following steps: receiving a base layer a code stream and an enhancement layer code stream; decoding the base layer code stream to obtain a decoded base layer image block; parsing the enhancement layer code stream to obtain a mode of an enhancement layer to be decoded block included in the enhancement layer code stream Information, the mode information is used to indicate a decoding mode of the enhanced layer to be decoded block; and the predicted value of the enhanced layer to be decoded reconstructed image block is obtained from the decoded base layer image block; according to the predicted value And the mode information of the enhancement layer to be decoded image block is decoded by the enhancement layer to be decoded module.

结合第五方面，在一种可能的实施方式中，该处理装置还包括：其中，所述模式信息所指示的所述增强层待解码块的解码方式包括层间预测跳过模式，对应的，所述根据所述预测值和所述增强层待解码图像块的模式信息解码所述增强层待解码模块包括：根据所述预测值和所述层间预测跳过模式解码所述增强层待解码模块。结合第五方面和第一种可能的实施方式，在第二种可能的实施方式中，所述根据所述预测值和所述层间预测跳过模式解码所述增强层待解码模块包括：将所述预测值作为所述增强层待解码图像块的解码后图像块。结合第五方面、第一种可能的实施方式和第二种可能的实施方式，在第三种可能的实施方式中，所述将所述预测值作为所述增强层待解码图像块的解码后图像块包括：选取和所述增强层的待解码图像块对应的所述解码后的基础层图像块，经过上釆样后得到所述增强层待解码重建图像块的预测值；所述预测值作为所述增强层的待解码重建图像块的像素值得到所述增强层待解码图像块的解码后图像块。 With reference to the fifth aspect, in a possible implementation, the processing apparatus further includes: the decoding mode of the enhanced layer to be decoded block indicated by the mode information includes an inter-layer prediction skip mode, corresponding, Decoding the enhancement layer to be decoded according to the prediction value and the mode information of the enhancement layer to be decoded image block includes: decoding the enhancement layer to be decoded according to the prediction value and the inter-layer prediction skip mode Module. With reference to the fifth aspect and the first possible implementation manner, in a second possible implementation manner, the decoding, by the prediction value and the inter-layer prediction skip mode, the enhancement layer to be decoded module package The prediction value is used as a decoded image block of the enhancement layer to be decoded image block. With reference to the fifth aspect, the first possible implementation manner, and the second possible implementation manner, in a third possible implementation manner, the predicting value is used as the decoding layer of the enhancement layer to be decoded image block. The image block includes: selecting the decoded base layer image block corresponding to the image block to be decoded of the enhancement layer, and obtaining a predicted value of the enhanced layer to be decoded reconstructed image block after being uploaded; A pixel value of the reconstructed image block to be decoded of the enhancement layer is obtained as a decoded image block of the enhancement layer image block to be decoded.

结合第五方面、第一种可能的实施方式、第二种可能的实施方式或第三种可能的实施方式，在第四种可能的实施方式中，所述解析所述增强层码流，得到包含在所述增强层码流中的增强层待解码块的模式信息，包括：解析包含在所述增强层码流中的增强层待解码图像块的层间预测跳过模式标识，将所述层间预测跳过模式标识作为所述增强层待解码图像块的模式信息，用于根据所述层间预测跳过模式标识确定所述增强层待解码图像块是否釆用层间预测跳过模式解码；对应的，当层间预测跳过模式标识指示所述增强层待解码图像块是釆用层间预测跳过模式解码时，则执行所述的根据所述预测值和所述层间预测跳过模式解码所述增强层待解码模块。 With reference to the fifth aspect, the first possible implementation manner, the second possible implementation manner, or the third possible implementation manner, in the fourth possible implementation manner, the analyzing the enhancement layer code stream, The mode information of the enhancement layer to be decoded in the enhancement layer code stream, comprising: parsing an inter-layer prediction skip mode identifier of an enhancement layer to be decoded image block included in the enhancement layer code stream, An inter-layer prediction skip mode identifier is used as the mode information of the enhancement layer to be decoded image block, and is used to determine, according to the inter-layer prediction skip mode identifier, whether the enhancement layer to be decoded image block uses an inter-layer prediction skip mode Decoding; correspondingly, when the inter-layer prediction skip mode identifier indicates that the enhancement layer to be decoded image block is to use inter-layer prediction skip mode decoding, performing the performing according to the predicted value and the inter-layer prediction The skip mode decodes the enhancement layer to be decoded module.

结合第五方面和第四种可能的实施方式，所述解析所述增强层码流，得到包含在所述增强层码流中的增强层待解码块的模式信息，还包括：解析所述增强层的待解码图像块的跳过模式标识，如果所述跳过模式标识标识所述增强层的待解码图像块的解码方式为跳过模式，则执行所述的解析包含在所述增强层码流中的增强层待解码图像块的层间预测跳过模式标识。第六方面，提供了一种分层码流的处理装置，该装置包括存储器及处理器，所述处理器用于读取存储在所述存储其中的可执行指令，以执行如下步骤：：编码基础层图像块，生成基础层码流；根据预设的编码方式编码增强层图像块，形成增强层码流，并将与所述预设的编码方式对应的模式信息写入所述增强层码流中用于使解码端根据所述模式信息解码所述增强层码流。结合第六方面，在一种可能的实施方式中，该方法还包括：所述预设的编码方式为层间预测跳过模式;对应的，所述根据预设的编码方式编码增强层图像块，形成增强层码流，并将于所述与所述预设的编码方式对应的模式信息写入所述的增强层码流中用于使解码端根据所述模式信息解码所述增强层码流，包括：根据层间预测跳过模式编码增强层图像块，形成增强层码流，并将于所述与所述层间预测跳过模式对应的层间预测跳过模式标识作为模式信息写入所述的增强层码流中用于使解码端根据所述层间预测跳过模式标识解码所述增强层码流。结合第六方面或第一种可能的实施方式，在第二种可能的实施方式中所述方法还包括：将跳过模式标识写入所述增强层码流中，所述跳过模式标识用以指示所述预设的编码方式是否为跳过模式。 With reference to the fifth aspect and the fourth possible implementation manner, the parsing the enhancement layer code stream to obtain mode information of an enhancement layer to be decoded block included in the enhancement layer code stream, further includes: parsing the enhancement a skip mode identifier of the image block to be decoded of the layer, if the skip mode identifier identifies that the decoding mode of the image block to be decoded of the enhancement layer is a skip mode, performing the parsing included in the enhancement layer code The inter-layer prediction skip mode identification of the enhancement layer to be decoded in the stream. In a sixth aspect, a processing apparatus for layered code stream is provided, the apparatus comprising a memory and a processor, wherein the processor is configured to read executable instructions stored in the storage to perform the following steps: a layer image block, generating a base layer code stream; encoding an enhancement layer image block according to a preset coding manner, forming an enhancement layer code stream, and writing mode information corresponding to the preset coding mode to the enhancement layer code stream The method is used for causing a decoding end to decode the enhancement layer code stream according to the mode information. With reference to the sixth aspect, in a possible implementation manner, the method further includes: the preset coding mode is an inter-layer prediction skip mode; correspondingly, the encoding the enhancement layer image block according to a preset coding manner Forming an enhancement layer code stream, and writing the mode information corresponding to the preset coding mode to the enhancement layer code stream, so that the decoding end decodes the enhancement layer according to the mode information. The code stream includes: encoding an enhancement layer image block according to an inter-layer prediction skip mode, forming an enhancement layer code stream, and using the inter-layer prediction skip mode identifier corresponding to the inter-layer prediction skip mode as mode information And being written into the enhancement layer code stream for causing the decoding end to decode the enhancement layer code stream according to the inter-layer prediction skip mode identifier. With reference to the sixth aspect or the first possible implementation manner, in a second possible implementation manner, the method further includes: writing a skip mode identifier into the enhancement layer code stream, where the skip mode identifier is used To indicate whether the preset encoding mode is a skip mode.

由上述技术方案可知，本发明提供的一种分层码流的处理方法，装置及分层码流的编码器能够有效提升压缩效率。附图说明为了更清楚地说明本发明实施例或现有技术中的技术方案，下面将对实施例或现有技术描述中所需要使用的附图作一简单地介绍，显而易见地，下面描述中的附图是本发明的一些实施例，对于本领域普通技术人员来讲，在不付出创造性劳动性的前提下，还可以根据这些附图获得其他的附图。 It can be seen from the above technical solution that the method for processing a layered code stream, the device and the layered code stream encoder can effectively improve the compression efficiency. BRIEF DESCRIPTION OF THE DRAWINGS In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, a brief description of the drawings used in the embodiments or the prior art description will be briefly described below. The drawings are some embodiments of the present invention, and those skilled in the art can obtain other drawings based on these drawings without any inventive labor.

图 1为本发明一种实施方式提供的分层编码方法 100; Figure 1 is a layered coding method 100 according to an embodiment of the present invention;

图 2为釆用图 1中的分层编码方法 100对高清视频序列 Kimono进行分层编码的性能测试仿真图； FIG. 2 is a performance test simulation diagram of layered coding of the high-definition video sequence Kimono by using the layered coding method 100 in FIG. 1;

图 3为本发明另一种实施方式提供的分层解码方法 200; Figure 3 is a layered decoding method 200 provided by another embodiment of the present invention;

图 4为图 3中的分层解码方法 200所处理的编码端生成的增强层的码流的数据结构。 4 is a data structure of a code stream of an enhancement layer generated by a coding end processed by the layered decoding method 200 in FIG.

图 5为本发明一种实施方式提供的分层编码器 300; Figure 5 is a layered encoder 300 according to an embodiment of the present invention;

图 6为本发明另一种实施方式提供的分层解码装置 400。具体实施方式为使本发明实施例的目的、技术方案和优点更加清楚，下面将结合本发明实施例中的附图，对本发明实施例中的技术方案进行清楚、完整地描述，显然，所描述的实施例是本发明一部分实施例，而不是全部的实施例。基于本发明中的实施例，本领域普通技术人员在没有作出创造性劳动前提下所获得的所有其他实施例，都属于本发明保护的范围。在本发明实施例中，以生成两层分辨率码流为例，说明本发明技术方案。其中基础层码流提供分辨率为 960x540的图像质量，增强层码流提供分辨率为 1920x1080的图像质量。在实际应用中可以根据应用需求生成满足多种分辨率质量的分层码流，基础层和增强层分辨率的比例关系也可以是任意的。 FIG. 6 is a layered decoding apparatus 400 according to another embodiment of the present invention. The technical solutions in the embodiments of the present invention are clearly and completely described in the following with reference to the accompanying drawings in the embodiments of the present invention. The embodiments are a part of the embodiments of the invention, and not all of the embodiments. All other embodiments obtained by those skilled in the art based on the embodiments of the present invention without creative efforts are within the scope of the present invention. In the embodiment of the present invention, the technical solution of the present invention is described by taking a two-layer resolution code stream as an example. The base layer code stream provides image quality with a resolution of 960x540, and the enhancement layer code stream provides image quality with a resolution of 1920x1080. In practical applications, a layered code stream satisfying multiple resolution qualities can be generated according to application requirements, and the proportional relationship between the base layer and the enhancement layer resolution can also be arbitrary.

图 1为本发明实施例提供的第一种分层编码方法流程图。本实施例提供 FIG. 1 is a flowchart of a first hierarchical coding method according to an embodiment of the present invention. This embodiment provides

装置来执行，该分层编码装置可以集成在例如电视机、机顶盒、个人计算机、笔记本电脑、平板电脑或手机等设备的视频处理器中，也可以单独设置，该分层编码装置可以通过软件和 /或硬件的方式来实现。 Executed by the device, the layered encoding device may be integrated in a video processor of a device such as a television, a set top box, a personal computer, a notebook computer, a tablet computer or a mobile phone, or may be separately provided, and the layered encoding device may be software and / or hardware way to achieve.

本实施例提供的分层编码方法 100具体包括：步骤 110、编码基础层图像块，生成基础层码流； The hierarchical coding method 100 provided in this embodiment specifically includes: Step 110: Encoding a base layer image block to generate a base layer code stream;

具体的，本发明所述的编码方法中，首先完成基础层图像块编码，生成基础层图像块码流，包含能够提供 960x540分辨率质量的码流信息，同时得到解码后的基础层图像。基础层图像块编码方法釆用现有的 HEVC编码方法进行编码；步骤 120、根据预设的编码方式编码增强层图像块，形成增强层码流，并将与所述预设的编码方式对应的模式信息写入所述增强层码流中用于使解码端根据所述模式信息解码所述增强层码流。具体地，编码增强层图像块，生成增强层图像码流，包含能够提供 1920x1080 分辨率质量的码流信息。对增强层图像块编码可以使用除了釆用现有 HEVC编码模式，还可以釆用层间预测跳过模式对增强层进行编码。当使用层间预测跳过模式对增强层待编码图像块编码时，比如编码位于增强层待编码图像的（64, 64 )位置的大小为 64x64的增强层图像块，直接编码层间预测跳过模式标识，写入码流，生成增强层码流。值得注意的是，上述编码位于增强层待编码图像的（64 , 64 )位置和大小作为增强层图像块仅是用来解释说明书本发明的具体实施方式中所釆用的示例，实际使用中可釆用编码位于增强层待编码图像的任意位置和大小作为增强层图像块。编码端是否使用层间预测跳过模式，需要对层间预测跳过模式以及其他模式进行编码效率代价比较。具体的，需要釆用层间预测模式编码的（64 , 64 )位置的大小为 64x64的增强层图像块的编码代价，使用解码后的基础层对应位置的图像块，即位于基础层图像（32, 32 ) 的大小为 32x32的解码后基础层图像块，利用上釆样算法对该基础层图像块进行上釆样处理，得到大小为 64x64的预测块，将该预测块作为增强层的（64 , 64 )位置大小为 64x64的解码后增强层图像块，计算该解码后增强层图像块和增强层的（ 64 , 64 )位置大小为 64x64 的解码后增强层图像块原始图像的失真度 D— skip; 比较 D— Skip和其他编码方法解码图像后的失真度 Dn, n = 1,2,3... , 选取失真度最小的编码模式作为当前增强层编码块的编码模式。请参阅图 2, 为釆用本发明的分层解码方法 100对高清视频序列 Kimono 进行分层编码的性能测试仿真图，测试条件为全 I帧编码条件，码流分为两层，增强层分辨率为 1920x1080, 基础层为 1280x720。图中圓形标点曲线是本发明方案性能，菱形标点曲线是原有方案性能，和现有技术相比，本发明方案可以有效节省分层编码码流的码率 16 % , 因此釆用本发明的分层解码方法 100能够有效的节省编码资源，提高编码的效率。请参阅图 3 , 本发明实施例还提供一种分层解码方法 200, 具体包括：步骤 210、接收基础层码流和增强层码流；该步骤中，所述基础层码流提供分辨率 960x540的视频质量，所述增强层提供分辨率 1920x1080的视频质量； Specifically, in the coding method of the present invention, the base layer image block coding is first completed, and the base layer image block code stream is generated, and the code stream information capable of providing the resolution quality of 960×540 is obtained, and the decoded base layer image is obtained at the same time. The base layer image block coding method is encoded by using the existing HEVC coding method. Step 120: Encoding the enhancement layer image block according to a preset coding manner to form an enhancement layer code stream, and corresponding to the preset coding mode. Mode information is written into the enhancement layer code stream for causing the decoding end to decode the enhancement layer code stream according to the mode information. Specifically, the enhancement layer image block is encoded to generate an enhancement layer image code stream, including code stream information capable of providing 1920x1080 resolution quality. Encoding the enhancement layer image block may use encoding the enhancement layer in addition to the existing HEVC coding mode, and may also use the inter-layer prediction skip mode. When the enhancement layer to be coded image block is encoded using the inter-layer prediction skip mode, for example, an 64x64-enhanced enhancement layer image block located at the (64, 64) position of the enhancement layer to-be-encoded image, direct coding inter-layer prediction skip The mode identifier, written to the code stream, generates an enhancement layer code stream. It should be noted that the above-mentioned code is located at the (64, 64) position and size of the image to be encoded of the enhancement layer as the enhancement layer image block is only used to explain the example used in the specific embodiment of the present invention, and may be used in actual use. The encoding is located at any position and size of the image to be encoded of the enhancement layer as an enhancement layer image block. Whether the inter-layer prediction skip mode is used at the encoding end requires comparison of the coding efficiency cost of the inter-layer prediction skip mode and other modes. Specifically, it is necessary to use the size of the (64, 64) position encoded by the inter-layer prediction mode. For the coding cost of the 64x64 enhancement layer image block, the image block corresponding to the position of the decoded base layer is used, that is, the decoded base layer image block of the size of the base layer image (32, 32) is 32x32, using the upper sample algorithm Performing a sample processing on the base layer image block to obtain a prediction block of size 64x64, and using the prediction block as a (64, 64) decoded enhancement layer image block with a 64x64 position size of the enhancement layer, and calculating the decoded enhancement block. The distortion of the original image of the decoded enhancement layer image block of the layer image block and the enhancement layer (64, 64) is 64x64; the distortion Dn of the decoded image after comparing D_Skip and other encoding methods, n = 1, 2, 3..., select the encoding mode with the least distortion as the encoding mode of the current enhancement layer encoding block. Referring to FIG. 2, a performance test simulation diagram of hierarchical coding of a high-definition video sequence Kimono is performed by using the layered decoding method 100 of the present invention. The test condition is a full I frame coding condition, and the code stream is divided into two layers, and the enhancement layer is resolved. The rate is 1920x1080 and the base layer is 1280x720. The circular punctuation curve in the figure is the performance of the scheme of the present invention, and the diamond punctuation curve is the performance of the original scheme. Compared with the prior art, the scheme of the invention can effectively save the code rate of the layered coded stream by 16%, so the invention is used. The layered decoding method 100 can effectively save coding resources and improve coding efficiency. Referring to FIG. 3, an embodiment of the present invention further provides a layered decoding method 200, which specifically includes: Step 210: Receive a base layer code stream and an enhancement layer code stream. In this step, the base layer code stream provides a resolution of 960×540. Video quality, the enhancement layer provides a video quality of 1920x1080 resolution;

步骤 220、解码所述基础层码流得到解码后的基础层图像块；具体地，本发明中使用 HEVC技术解码所述基础层码流得到解码后的基础层图像块；可以理解，所述解码也可以釆用业界所熟悉的其他类似的解码方法，如 H.264的解码方式。步骤 230、解析所述增强层码流，得到包含在所述增强层码流中的增强层待解码块的模式信息，所述模式信息用于指示所述增强层待解码块的解码方式； Step 220: Decode the base layer code stream to obtain a decoded base layer image block. Specifically, the present invention uses the HEVC technology to decode the base layer code stream to obtain a decoded base layer image block. Other similar decoding methods familiar to the industry, such as the decoding method of H.264, can also be used. Step 230: Parse the enhancement layer code stream to obtain mode information of an enhancement layer to be decoded block included in the enhancement layer code stream, where the mode information is used to indicate a decoding mode of the enhancement layer to be decoded block.

具体地，解析增强层待解码图像块的码流数据，解析得到当前块的层间预测跳过模式标识，所述层间预测跳过模式标识指示所述的模式信息所指示的所述增强层待解码块的解码方式包括层间预测跳过模式，如果该标识为 1 , 则表明当前块使用层间预测跳过模式进行解码，否则按照 HEVC所规定的帧间或帧内预测模式解码； Specifically, parsing the code stream data of the image block to be decoded of the enhancement layer, and parsing the inter-layer prediction skip mode identifier of the current block, where the inter-layer prediction skip mode identifier indicates that the mode information is indicated The decoding mode of the enhancement layer to be decoded block includes an inter-layer prediction skip mode. If the identifier is 1, it indicates that the current block uses the inter-layer prediction skip mode for decoding, otherwise the inter-frame or intra prediction according to HEVC is specified. Mode decoding

步骤 240、从所述解码后的基础层图像块中获取所述增强层待解码重建图像块的预测值；具体地，如果增强层待解码图像块的预测模式为层间预测跳过模式，则码流中不包含差值信息，此时将对应的基础层重建图像块进行上釆样后做为增强层待解码图像块重建像素值。具体的，对于位于增强层待编码图像的（64, 64 )位置的大小为 64x64的待解码增强层图像块，获取基本层位置为（32, 32 ) 的大小为 32x32的解码后基础层图像块，使用上釆样算法将该基础层图像块上釆样为 64x64大小的图像块作为增强层待编码图像的预测值。步骤 250、根据所述预测值和所述增强层待解码图像块的模式信息解码所述增强层待解码模块；具体地，当所述增强层待解码图像块的模式信息为层间预测跳过模式则所述预测值即为增强层（64, 64 )位置的大小为 64x64的待解码增强层图像块的解码图像块。 Step 240: Obtain a prediction value of the enhanced layer to be decoded reconstructed image block from the decoded base layer image block. Specifically, if the prediction mode of the enhancement layer to be decoded image block is an inter-layer prediction skip mode, The difference information is not included in the code stream. At this time, the corresponding base layer reconstructed image block is subjected to the upper image and then reconstructed as the enhancement layer image block to be decoded. Specifically, for the 64x64 to be decoded enhancement layer image block located at the (64, 64) position of the image to be encoded of the enhancement layer, a decoded base layer image block having a base layer position of (32, 32) and a size of 32x32 is obtained. The image block of 64×64 size is used as the prediction value of the image to be encoded of the enhancement layer by using the upper sample algorithm. Step 250: Decode the enhancement layer to be decoded module according to the prediction value and mode information of the enhancement layer to be decoded image block. Specifically, when the mode information of the enhancement layer to be decoded image block is an inter-layer prediction skip The mode then the predicted value is the decoded image block of the enhancement layer image block to be decoded whose size of the enhancement layer (64, 64) is 64x64.

进一步地，根据本发明实施例，请参阅图 4揭示对于步骤 130, 解析增强层待解码图像块的码流数据还可以为： Further, according to the embodiment of the present invention, referring to FIG. 4, for step 130, the code stream data of the image block to be decoded of the enhanced layer may also be:

解析增强层待解码图像块码流 coding— unit— svc(xO,yO,log2CbSize) , 其中 χθ和 yO表示当前待解码图像块在当前待解码图像中的位置信息， log2CbSize 表示当前待解码图像块的大小信息； Analyze the enhancement layer to be decoded image block code stream coding_unit_svc(xO, yO, log2CbSize), where χθ and yO represent the position information of the current image block to be decoded in the current image to be decoded, and log2CbSize represents the image block to be decoded currently. Size information

如果增强层的编码类型 slice— type是帧间预测编码类型 I, 或者增强层的编码类型为帧内预测编码并且其层标识 layerlD大于 0, 则解析得到跳过模式标识 skip_flag[xO][yO]; If the coding type slice_type of the enhancement layer is the inter prediction coding type I, or the coding type of the enhancement layer is intra prediction coding and its layer identifier layer1D is greater than 0, the parsing obtains the skip mode identifier skip_flag[xO][yO] ;

如果增强层的编码类型 slice— type为帧内编码类型 I,并且 layerlD大于 0, 则增强层待解码图像块使用层间预测跳过模式解码； If the coding type slice_type of the enhancement layer is intra coding type I, and layer1D is greater than 0, the enhancement layer to be decoded image block is decoded using inter-layer prediction skip mode;

如果增强层的编码类型 slice— type为帧间编码类型，并且 layerlD大于 0, 则进一步解析得到层间预测跳过模式标识 base— recon— skip— flag[x0][y0] , 如果 base— recon— skip— flag[x0][y0]为 1表明增强层待解码图像块使用层间预测跳过模式解码，如果 base— recon— skip— flag[x0][y0]为 1表明增强层待解码图像块使用层间预测模式解码。 If the coding type slice_type of the enhancement layer is an interframe coding type, and layerlD is greater than 0, further parsing results in an inter-layer prediction skip mode identifier base_recon_skip_flag[x0][y0], if base_recon- Skip_flag[x0][y0] is 1 indicating that the enhancement layer to be decoded uses an inter-layer prediction skip Mode decoding, if base_recon_skip_flag[x0][y0] is 1, indicates that the enhancement layer to be decoded image block is decoded using inter-layer prediction mode.

根据解析得到的模式信息完成解码过程。 The decoding process is completed according to the parsed mode information.

在本发明实施例中，解码器可以设计为解码晚整个基础层图像后再开始解码增强层，也可以解码晚基础层图像一部分后，即开始解码增强层，实际系统可以根据硬件架构和复杂度要求给出不同设计。 In the embodiment of the present invention, the decoder may be designed to decode the entire base layer image and then start decoding the enhancement layer, or after decoding a part of the late base layer image, start decoding the enhancement layer, and the actual system may be based on hardware architecture and complexity. Ask for a different design.

图 5为本发明实施例提供的第一种分层编器 300的示意框图。本实施例提供的分层编码装置具体可以应用于对视频的编码，该编码可以基于但并不限于 HEVC-SVC 技术。本实施例提供的分层编码装置可以集成在例如电视机、机顶盒、个人计算机、笔记本电脑、平板电脑或手机等设备的视频处理器中，也可以单独设置，该分层编码装置可以通过软件和 /或硬件的方式来实现。 FIG. 5 is a schematic block diagram of a first layered editor 300 according to an embodiment of the present invention. The layered coding apparatus provided in this embodiment may be specifically applied to coding a video, which may be based on, but not limited to, HEVC-SVC technology. The layered coding apparatus provided in this embodiment may be integrated in a video processor of a device such as a television set, a set top box, a personal computer, a notebook computer, a tablet computer or a mobile phone, or may be separately provided, and the layered coding apparatus may be software and / or hardware way to achieve.

请参阅图 5 , 本实施例提供的分层编码器 300具体包括：第一编码模块 310, 用于编码基础层图像块，生成基础层码流；具体的，本发明所述的编码方法中，首先完成基础层图像块编码，生成基础层图像块码流，包含能够提供 960x540分辨率质量的码流信息，同时得到解码后的基础层图像。基础层图像块编码方法釆用现有的 HEVC编码方法进行编码；第二编码模块 320, 用于根据预设的编码方式编码增强层图像块，形成增强层码流，并将与所述预设的编码方式对应的模式信息写入所述增强层码流中用于使解码端根据所述模式信息解码所述增强层码流。具体地，编码增强层图像块，生成增强层图像码流，包含能够提供 1920x1080 分辨率质量的码流信息。对增强层图像块编码可以使用除了釆用现有 HEVC编码模式，还可以釆用层间预测跳过模式对增强层进行编码。当使用层间预测跳过模式对增强层待编码图像块编码时，比如编码位于增强层待编码图像的（64, 64 )位置的大小为 64x64的增强层图像块，直接编码层间预测跳过模式标识，写入码流，生成增强层码流。编码端是否使用层间预测跳过模式，需要对层间预测跳过模式以及其他模式进行编码效率代价比较。具体的，需要釆用层间预测模式编码的（64, 64 )位置的大小为 64x64的增强层图像块的编码代价，使用解码后的基础层对应位置的图像块，即位于基础层图像（32, 32 ) 的大小为 32x32的解码后基础层图像块，利用上釆样算法对该基础层图像块进行上釆样处理，得到大小为 64x64的预测块，将该预测块作为增强层的（64 , 64 )位置大小为 64x64的解码后增强层图像块，计算该解码后增强层图像块和增强层的（64, 64 )位置大小为 64x64的解码后增强层图像块原始图像的失真度 D— skip; 比较 D— Skip和其他编码方法解码图像后的失真度 Dn, n = 1,2,3... , 选取失真度最小的编码模式作为当前增强层编码块的编码模式。 Referring to FIG. 5, the layered encoder 300 provided in this embodiment specifically includes: a first encoding module 310, configured to encode a base layer image block, and generate a base layer code stream. Specifically, in the encoding method according to the present invention, First, the base layer image block coding is completed, and the base layer image block code stream is generated, and the code stream information capable of providing 960x540 resolution quality is obtained, and the decoded base layer image is obtained at the same time. The base layer image block coding method is encoded by using the existing HEVC coding method; the second coding module 320 is configured to encode the enhancement layer image block according to a preset coding manner, form an enhancement layer code stream, and The mode information corresponding to the coding mode is written into the enhancement layer code stream for causing the decoding end to decode the enhancement layer code stream according to the mode information. Specifically, the enhancement layer image block is encoded to generate an enhancement layer image code stream, including code stream information capable of providing 1920x1080 resolution quality. Encoding the enhancement layer image block may use encoding the enhancement layer in addition to the existing HEVC coding mode, and may also use the inter-layer prediction skip mode. When the enhancement layer to be coded image block is encoded using the inter-layer prediction skip mode, for example, an 64x64-enhanced enhancement layer image block located at the (64, 64) position of the enhancement layer to-be-encoded image, direct coding inter-layer prediction skip The mode identifier, written to the code stream, generates an enhancement layer code stream. Whether the coding end uses the inter-layer prediction skip mode requires comparison of the coding efficiency cost of the inter-layer prediction skip mode and other modes. Specifically, the coding cost of the 64x64 enhanced layer image block of the (64, 64) position encoded by the inter-layer prediction mode is required, and the image block corresponding to the position of the decoded base layer is used, that is, located at the base The base layer image (32, 32) is a 32x32 decoded base layer image block, and the base layer image block is subjected to the upper sample processing by using the upper sample algorithm to obtain a prediction block of size 64x64, and the prediction block is used as the prediction block. The enhanced layer (64, 64) is a 64x64 decoded enhancement layer image block, and the decoded enhanced layer image block and the enhancement layer (64, 64) have a 64x64 decoded enhanced layer image original image. Distortion D_skip; Compare D-Skip and other encoding methods to decode the image with distortion Dn, n = 1,2,3... , select the encoding mode with the least distortion as the encoding mode of the current enhancement layer encoding block .

本发明实施例提供的分层编码器 300可以实现如分层编码方法 100相同的有益效果。 The layered encoder 300 provided by the embodiment of the present invention can achieve the same advantageous effects as the layered coding method 100.

请参参阅图 6 , 本发明实施例还提供一种分层解码装置 400具体包括：接收模块 410 , 用于接收基础层码流和增强层码流；所述接收接收模块 410所接收的所述基础层码流提供分辨率 960x540的视频质量，所述增强层提供分辨率 1920x1080的视频质量；解码模块 420 , 用于解码所述基础层码流得到解码后的基础层图像块；具体地，所述解码模块 420可以使用 HEVC技术解码所述基础层码流得到解码后的基础层图像块；可以理解，所述解码模块 320也可以釆用业界所熟悉的其他类似的解码方式，如 H.264的解码方式。解析模块 430 , 用于解析所述增强层码流，得到包含在所述增强层码流中的增强层待解码块的模式信息，所述模式信息用于指示所述增强层待解码块的解码方式；具体地，所述解析模块 430解析增强层待解码图像块的码流数据，解析得到当前块的层间预测跳过模式标识，所述层间预测跳过模式标识指示所述的模式信息所指示的所述增强层待解码块的解码方式包括层间预测跳过模式，如果该标识为 1 , 则表明当前块使用层间预测跳过模式进行解码，否则按照 HEVC所规定的帧间或帧内预测模式解码；参数获取模块 440, 用于从所述解码后的基础层图像块中获取所述增强层待解码重建图像块的预测值；具体地，如果增强层待解码图像块的预测模式为层间预测跳过模式，则码流中不包含差值信息，此时将对应的基础层重建图像块进行上釆样后做为增强层待解码图像块重建像素值。具体地，对于位于增强层待编码图像的（ 64, 64 )位置的大小为 64x64的待解码增强层图像块，获取基本层位置为（32, 32 ) 的大小为 32x32的解码后基础层图像块，使用上釆样算法将该基础层图像块上釆样为 64x64大小的图像块作为增强层待编码图像的预测值。所述解码模块 420 , 进一步用于根据所述预测值和所述增强层待解码图像块的模式信息解码所述增强层待解码模块；具体地，当所述增强层待解码图像块的模式信息为层间预测跳过模式则所述预测值即为增强层（64, 64 )位置的大小为 64x64的待解码增强层图像块的解码图像块。 Referring to FIG. 6 , an embodiment of the present invention further provides a layered decoding apparatus 400, including: a receiving module 410, configured to receive a base layer code stream and an enhancement layer code stream; and the receiving and receiving module 410 receives the The base layer code stream provides a video quality of a resolution of 960x540, and the enhancement layer provides a video quality of a resolution of 1920×1080; the decoding module 420 is configured to decode the base layer code stream to obtain a decoded base layer image block; specifically, The decoding module 420 can use the HEVC technology to decode the base layer code stream to obtain a decoded base layer image block. It can be understood that the decoding module 320 can also use other similar decoding methods familiar to the industry, such as H.264. The way to decode. The parsing module 430 is configured to parse the enhancement layer code stream to obtain mode information of an enhancement layer to be decoded block included in the enhancement layer code stream, where the mode information is used to indicate decoding of the enhancement layer to be decoded block Specifically, the parsing module 430 parses the code stream data of the image block to be decoded of the enhancement layer, and parses the inter-layer prediction skip mode identifier of the current block, where the inter-layer prediction skip mode identifier indicates the mode information. The indicated decoding mode of the enhancement layer to be decoded block includes an inter-layer prediction skip mode. If the identifier is 1, it indicates that the current block uses the inter-layer prediction skip mode for decoding, otherwise the inter-frame or frame according to the HEVC is specified. a prediction mode decoding module 440, configured to acquire, from the decoded base layer image block, a prediction value of the enhanced layer to be decoded image block to be decoded; specifically, if a prediction mode of the enhancement layer to be decoded image block Skip mode for inter-layer prediction, then The difference information is not included in the code stream. At this time, the corresponding base layer reconstructed image block is subjected to the upper image and then reconstructed as the enhancement layer image block to be decoded. Specifically, for the 64×64 to be decoded enhancement layer image block located at the (64, 64) position of the image to be encoded of the enhancement layer, a decoded base layer image block having a base layer position of (32, 32) and a size of 32×32 is obtained. The image block of 64×64 size is used as the prediction value of the image to be encoded of the enhancement layer by using the upper sample algorithm. The decoding module 420 is further configured to: decode the enhancement layer to be decoded module according to the prediction value and mode information of the enhancement layer to be decoded image block; specifically, when the enhancement layer is to decode the mode information of the image block to be decoded For the inter-layer prediction skip mode, the predicted value is the decoded image block of the enhancement layer image block to be decoded whose size of the enhancement layer (64, 64) is 64x64.

进一步地，根据本发明实施例，所述解析模块 430进一步用于：解析增强层待解码图像块码流 coding— unit— svc(xO,yO,log2CbSize) , 其中 χθ和 y0表示当前待解码图像块在当前待解码图像中的位置信息， log2CbSize 表示当前待解码图像块的大小信息； Further, according to the embodiment of the present invention, the parsing module 430 is further configured to: parse the enhancement layer to be decoded image block code stream coding_unit_svc(xO, yO, log2CbSize), where χθ and y0 represent the current image block to be decoded In the position information in the current image to be decoded, log2CbSize represents the size information of the image block to be decoded currently;

如果增强层的编码类型 slice— type为帧间编码类型，并且 layerlD大于 0, 则进一步解析得到层间预测跳过模式标识 base— recon— skip— flag[x0][y0] , 如果 base— recon— skip— flag[x0][y0]为 1表明增强层待解码图像块使用层间预测跳过模式解码，如果 base— recon— skip— flag[x0][y0]为 1表明增强层待解码图像块使用层间预测模式解码。 If the coding type slice_type of the enhancement layer is an interframe coding type, and layerlD is greater than 0, further parsing results in an inter-layer prediction skip mode identifier base_recon_skip_flag[x0][y0], if base_recon- Skip_flag[x0][y0] is 1 to indicate that the enhancement layer to be decoded image block uses inter-layer prediction skip mode decoding. If base_recon_skip_flag[x0][y0] is 1, the enhancement layer to be decoded image block is indicated. Inter-layer prediction mode decoding is used.

根据解析得到的模式信息完成解码过程。在本发明实施例中，解码器可以设计为解码晚整个基础层图像后再开始解码增强层，也可以解码晚基础层图像一部分后，即开始解码增强层，实际系统可以根据硬件架构和复杂度要求给出不同设计。 The decoding process is completed according to the parsed mode information. In the embodiment of the present invention, the decoder may be designed to decode the entire base layer image and then start decoding the enhancement layer, or after decoding a part of the late base layer image, start decoding the enhancement layer, and the actual system may be based on hardware architecture and complexity. Ask for a different design.

本领域普通技术人员可以理解：实现上述方法实施例的全部或部分步骤可以通过程序指令相关的硬件来完成，前述的程序可以存储于一计算机可读取存储介质中，该程序在执行时，执行包括上述方法实施例的步骤；而前述的存储介质包括： ROM, RAM, 磁碟或者光盘等各种可以存储程序代码的介最后应说明的是：以上实施例仅用以说明本发明的技术方案，而非对其限制；尽管参照前述实施例对本发明进行了详细的说明，本领域的普通技术人员应当理解：其依然可以对前述各实施例所记载的技术方案进行修改，或者对其中部分技术特征进行等同替换；而这些修改或者替换，并不使相应技术方案的本质脱离本发明各实施例技术方案的范围。 A person skilled in the art can understand that all or part of the steps of implementing the above method embodiments may be completed by using hardware related to the program instructions, and the foregoing program may be stored in a computer readable In the storage medium, when the program is executed, the steps including the foregoing method embodiments are performed; and the foregoing storage medium includes: ROM, RAM, disk or optical disk, and the like, which can store program codes, and finally: The above embodiments are only used to illustrate the technical solutions of the present invention, and are not intended to be limiting; although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that The technical solutions are modified, or some of the technical features are replaced by equivalents; and the modifications or substitutions do not deviate from the scope of the technical solutions of the embodiments of the present invention.

Claims

Rights request

1. A method for processing layered code streams, which is characterized by including:

Receive the base layer code stream and the enhancement layer code stream; decode the base layer code stream to obtain the decoded base layer image block;

Parse the enhancement layer code stream to obtain the mode information of the enhancement layer block to be decoded contained in the enhancement layer code stream, where the mode information is used to indicate the decoding method of the enhancement layer block to be decoded;

Obtain the predicted value of the reconstructed image block to be decoded in the enhancement layer from the decoded base layer image block; decode the module to be decoded in the enhancement layer according to the predicted value and the mode information of the image block to be decoded in the enhancement layer. .

2. The layered code stream processing method according to claim 1, wherein, the decoding mode of the enhancement layer to-be-decoded block indicated by the mode information includes an inter-layer prediction skip mode, correspondingly, The module for decoding the enhancement layer to be decoded according to the prediction value and the mode information of the enhancement layer image block to be decoded includes: decoding the enhancement layer to be decoded according to the prediction value and the inter-layer prediction skip mode. module.

3. The layered code stream processing method according to claim 2, characterized in that: decoding the enhancement layer to be decoded module according to the prediction value and the inter-layer prediction skip mode includes: The value is used as the decoded image block of the enhancement layer image block to be decoded.

4. The layered code stream processing method according to claim 3, characterized in that using the predicted value as the decoded image block of the enhancement layer image block to be decoded includes:

Select the decoded base layer image block corresponding to the image block to be decoded in the enhancement layer, and obtain the predicted value of the reconstructed image block to be decoded in the enhancement layer after sampling; the predicted value is used as the enhancement The pixel value of the reconstructed image block to be decoded in the layer is used to obtain the decoded image block of the image block to be decoded in the enhancement layer.

5. The layered code stream processing method according to any one of claims 2 to 4, characterized in that: parsing the enhancement layer code stream to obtain the enhancement layer to be decoded included in the enhancement layer code stream Block mode information, including: Analyze the inter-layer prediction skip mode identifier of the enhancement layer image block to be decoded contained in the enhancement layer code stream, and use the inter-layer prediction skip mode identifier as the mode information of the enhancement layer image block to be decoded, using Determining whether the image block to be decoded in the enhancement layer is decoded using inter-layer prediction skip mode according to the inter-layer prediction skip mode identifier; Correspondingly,

When the inter-layer prediction skip mode identifier indicates that the image block to be decoded in the enhancement layer is decoded using inter-layer prediction skip mode, the decoding process based on the prediction value and the inter-layer prediction skip mode is performed. The enhancement layer module to be decoded.

6. The layered code stream processing method according to claim 5, characterized in that: the parsing the enhancement layer code stream obtains the mode information of the enhancement layer to-be-decoded blocks included in the enhancement layer code stream, Also includes:

Parsing the skip mode identifier of the image block to be decoded in the enhancement layer. If the skip mode identifier identifies that the decoding mode of the image block to be decoded in the enhancement layer is skip mode, performing the analysis is included in the step. The inter-layer prediction skip mode identifier of the enhancement layer image block to be decoded in the enhancement layer code stream.

7. A method for processing layered code streams, which is characterized by including:

Encode the base layer image blocks to generate a base layer code stream; encode the enhancement layer image blocks according to a preset encoding method to form an enhancement layer code stream, and write mode information corresponding to the preset encoding method into the enhancement layer The code stream is used to enable the decoder to decode the enhancement layer code stream according to the mode information.

8. The processing method according to claim 7, wherein the preset encoding method is inter-layer prediction skip mode; correspondingly, the enhancement layer image block is encoded according to the preset encoding method to form an enhancement layer code stream, and write the mode information corresponding to the preset encoding method into the enhancement layer code stream to enable the decoding end to decode the enhancement layer code stream according to the mode information, including :

Encoding the enhancement layer image blocks according to the inter-layer prediction skip mode to form an enhancement layer code stream, and writing the inter-layer prediction skip mode identifier corresponding to the inter-layer prediction skip mode as mode information. The enhancement layer code stream is used to enable the decoder to decode the enhancement layer code stream according to the inter-layer prediction skip mode identifier.

9. The processing method according to claim 7 or 8, characterized in that, the method further includes: writing a skip mode identifier into the enhancement layer code stream, the skip mode identifier is used to indicate the Whether the default encoding method is skip mode.

10. A layered code stream processing device, characterized in that it includes: a receiving module, used to receive the base layer code stream and the enhancement layer code stream;

The decoding module is used to decode the base layer code stream to obtain the decoded base layer image blocks; the parsing module is to parse the enhancement layer code stream to obtain the pattern of the enhancement layer to-be-decoded blocks included in the enhancement layer code stream. Information, the mode information is used to indicate the decoding mode of the block to be decoded in the enhancement layer;

The parameter acquisition module is used to obtain the predicted value of the reconstruction image block to be decoded in the enhancement layer from the decoded base layer image block; the decoding module is also used to obtain the predicted value of the reconstructed image block to be decoded in the enhancement layer based on the predicted value and the enhancement layer to be decoded. Decoding the mode information of the image block decodes the enhancement layer module to be decoded.

11. The layered code stream processing device according to claim 10, wherein, the decoding mode of the enhancement layer to-be-decoded block indicated by the mode information includes an inter-layer prediction skip mode, correspondingly, The decoding module is further configured to decode the enhancement layer to be decoded according to the prediction value and the mode information of the enhancement layer image block to be decoded. The module to be decoded specifically includes: the decoding module, and is further configured to decode the enhancement layer to be decoded according to the The prediction value and the inter-layer prediction skip mode decoding of the enhancement layer module to be decoded.

12. The layered code stream processing device according to claim 11, characterized in that the decoding module is specifically configured to: use the predicted value as the decoded image block of the image block to be decoded in the enhancement layer.

13. The layered code stream processing device according to claim 12, characterized in that the decoding module is specifically used for:

Select the decoded base layer image block corresponding to the image block to be decoded in the enhancement layer, and obtain the predicted value of the reconstructed image block to be decoded in the enhancement layer after sampling; use the predicted value as the The pixel value of the reconstructed image block to be decoded in the enhancement layer is obtained by the enhancement The decoded image block of the strong layer image block to be decoded.

14. The layered code stream processing device according to any one of claims 11 to 13, characterized in that the parsing module is specifically used for:

Parse the inter-layer prediction skip mode identifier of the enhancement layer image block to be decoded contained in the enhancement layer code stream, and use the inter-layer prediction skip mode identifier as the mode information of the enhancement layer image block to be decoded, using Determining whether the image block to be decoded in the enhancement layer is decoded using inter-layer prediction skip mode according to the inter-layer prediction skip mode identifier; Correspondingly,

When the inter-layer prediction skip mode flag indicates that the image block to be decoded in the enhancement layer is decoded using inter-layer prediction skip mode,

The decoding module is configured to decode the enhancement layer module to be decoded according to the prediction value and the inter-layer prediction skip mode.

15. The layered code stream processing device according to claim 14, characterized in that the parsing module is also used to:

Parsing the skip mode identifier of the image block to be decoded in the enhancement layer. If the skip mode identifier identifies that the decoding mode of the image block to be decoded in the enhancement layer is skip mode, performing the parsing includes: An inter-layer prediction skip mode identifier of the image block to be decoded in the enhancement layer in the enhancement layer code stream.

16. A layered code stream encoder, characterized in that it includes: a first coding module, used to encode base layer image blocks and generate a base layer code stream;

The second encoding module is used to encode the enhancement layer image blocks according to the preset encoding method to form an enhancement layer code stream, and write the mode information corresponding to the preset encoding method into the enhancement layer code stream for The decoding end is caused to decode the enhancement layer code stream according to the mode information.

17. The encoder according to claim 16, wherein the preset encoding method is an inter-layer prediction skip mode; correspondingly, the second encoding module is configured to perform an inter-layer prediction skip mode according to Encoding the enhancement layer image blocks to form an enhancement layer code stream, and writing the inter-layer prediction skip mode identifier corresponding to the inter-layer prediction skip mode as mode information into the enhancement layer code stream for use The decoder is caused to decode the enhancement layer code stream according to the inter-layer prediction skip mode identifier.

18. The encoder according to claim 16 or 17, characterized in that, the second encoding module The block is further configured to write a skip mode identifier into the enhancement layer code stream, where the skip mode identifier is used to indicate whether the preset encoding method is a skip mode.