RU2803896C2 - Intra-inter prediction mode for video data - Google Patents

Abstract

FIELD: video encoding.

SUBSTANCE: device for coding (encoding or decoding) video data includes a memory device for storing video data and one or more processors implemented in the circuit and configured to generate an inter-prediction block for the current video color block; generate an intra prediction block for the current chrominance block of the video data; determine the number of adjacent blocks with respect to the luminance block corresponding to the current chrominance block, which are encoded with intra prediction; determine the first weight coefficient and the second weight coefficient according to the number of adjacent blocks that are encoded with intra prediction; apply a first weight to the inter prediction block and a second weight to the intra prediction block; combine the first weighted inter prediction block and the second weighted intra prediction block to generate a prediction block for the current chrominance block; and encode the current chrominance block using the prediction block.

EFFECT: increasing the video encoding efficiency.

44 cl, 14 dwg

Description

[0001] This application claims priority to U.S. Application No. 16/781,751, filed Feb. 4, 2020, and U.S. Provisional Patent Application No. 62/802,515, filed Feb. 7, 2019, the contents of each of which are incorporated herein in their entirety. via link.

Field of technology to which the invention relates

[0002] This disclosure relates to video encoding, including video encoding and video decoding.

State of the art

[0003] Digital video support may be included in a wide range of devices, including digital television receivers, digital direct broadcast systems, wireless broadcast systems, personal digital devices (PDAs), laptop or desktop computers, tablet computers, e-readers books, digital cameras, digital recorders, digital media players, video game devices, video game consoles, cellular or satellite radio telephones, so-called "smart phones", video conferencing devices, video streaming devices, etc. Digital video devices implement video encoding technologies such as video encoding technologies described in standards defined by MPEG-2, MPEG-4, ITU-T H.263, ITU-T H.264/MPEG-4 Part 10, Enhanced video coding (AVC), ITU-T H.265/High Efficiency Video Coding (HEVC) standard, and extensions to such standards. Video devices can transmit, receive, encode, decode and/or store digital video information more efficiently by implementing such video encoding technologies.

[0004] Video encoding technologies include spatial (within a picture) prediction and/or temporal (between pictures) prediction to reduce or remove redundancy inherent in video sequences. For block-based video encoding, a video slice (eg, a video picture or part of a video picture) may be segmented into video blocks, which may also be referred to as "coding tree units (CTUs)", "coding units (CUs)" and/or "encoding nodes". Video blocks in an intra-picture slice (I-) are encoded using spatial prediction relative to reference samples in adjacent blocks in the same picture. Video blocks in a mutually encoded slice (P- or B-) of a picture may use spatial prediction relative to reference samples in adjacent blocks in the same picture or temporal prediction relative to reference samples in other reference pictures. The pictures may be called "frames" and the reference pictures may be called "reference frames".

The essence of the invention

[0005] In general, this disclosure describes technologies for performing combined inter-intra prediction. Thus, in video encoding, a video encoder (eg, a video encoder or video decoder) may perform encoding based on blocks of pictures forming a video sequence. A video encoder may encode picture blocks by generating a prediction block and encoding a residual block representing sample-by-sample differences between the prediction block and the actual block to be encoded. Inter prediction represents prediction from a reference block of a previous encoded picture, while intra prediction represents prediction from previously encoded reference data of the current picture. Combined inter-intraforecasting represents forecasting using both interforecasting and intraforecasting. In particular, this disclosure describes improved technologies for performing combined inter-intra forecasting. The techniques of this disclosure may be used, for example, in the Versatile Video Coding (VVC) standard or other video coding standards that support combined inter-intra prediction.

[0006] In one example, a method for encoding video data includes generating an inter-prediction block for a current chrominance block of the video data; generating an internal prediction block for the current color block of video data; determining the number of neighboring blocks with respect to the luma block corresponding to the current chrominance block, which are intra-prediction encoded; determining a first weight coefficient and a second weight coefficient according to the number of neighboring blocks that are intra prediction encoded; applying a first weight coefficient to the inter-prediction block and a second weight coefficient to the intra-prediction block; combining the first weighted inter-prediction block and the second weighted intra-prediction block to form a prediction block for the current chrominance block; and encoding the current chrominance block using the prediction block.

[0007] In another example, an apparatus for encoding video data includes a memory device for storing video data and one or more processors implemented in the circuit and configured to generate an inter-prediction block for a current chroma block of video data; generate an internal prediction block for the current color block of video data; determine the number of neighboring blocks with respect to the luma block corresponding to the current chrominance block, which are encoded with intra prediction; determine the first weight coefficient and the second weight coefficient according to the number of neighboring blocks that are intra prediction encoded; apply a first weight to the inter-prediction block and a second weight to the intra-prediction block; combine the first weighted inter-prediction block and the second weighted intra-prediction block to generate a prediction block for the current chrominance block; and encode the current chrominance block using a prediction block.

[0008] In another example, a computer-readable storage medium has instructions stored thereon that, when executed, instruct the processor to generate an inter-prediction block for the current chrominance block of video data; generate an internal prediction block for the current color block of video data; determine the number of neighboring blocks with respect to the luma block corresponding to the current chrominance block, which are encoded with intra prediction; determine the first weight coefficient and the second weight coefficient according to the number of neighboring blocks that are intra prediction encoded; apply a first weight to the inter-prediction block and a second weight to the intra-prediction block; combine the first weighted inter-prediction block and the second weighted intra-prediction block to generate a prediction block for the current chrominance block; and encode the current chrominance block using a prediction block.

[0009] In another example, an apparatus for encoding video data includes means for generating an inter-prediction block for a current chroma block of video data; means for generating an internal prediction block for the current chrominance block of video data; means for determining the number of neighboring blocks with respect to the luma block corresponding to the current chrominance block that are intra-prediction encoded; means for determining a first weight coefficient and a second weight coefficient according to the number of neighboring blocks that are intra prediction encoded; means for applying a first weight to the inter-prediction block and a second weight to the intra-prediction block; means for combining the first weighted inter-prediction block and the second weighted intra-prediction block to generate a prediction block for the current chrominance block; and means for encoding the current chrominance block using the prediction block.

[0010] Details of one or more examples are set forth in the accompanying drawings and in the description below. Other features, objects and advantages will become apparent from the description, drawings and claims.

Brief description of drawings

[0011] FIG. 1 is a block diagram illustrating an exemplary video encoding and decoding system that can implement the technologies of this disclosure.

[0012] FIG. 2A and 2B are conceptual diagrams illustrating an exemplary quadtree and binary tree (QTBT) structure and a corresponding coding tree unit (CTU).

[0013] FIG. 3A-3F are conceptual diagrams illustrating exemplary locations of neighboring blocks relative to current blocks.

[0014] FIG. 4 is a block diagram illustrating an example video encoder that may implement the techniques of this disclosure.

[0015] FIG. 5 is a block diagram illustrating an example video decoder that may implement the techniques of this disclosure.

[0016] FIG. 6 is a flowchart illustrating an exemplary method for encoding a current block in accordance with the technology of this disclosure.

[0017] FIG. 7 is a flowchart illustrating an exemplary method for decoding a current block in accordance with the techniques of this disclosure.

[0018] FIG. 8 is a flowchart illustrating an exemplary method for encoding (encoding or decoding) video data according to the technologies of this disclosure.

Detailed Description of the Invention

[0019] Video encoding standards include ITU-T H.261, ISO/IEC MPEG-1 Visual, ITU-T H.262 or ISO/IEC MPEG-2 Visual, ITU-T H.263, ISO/IEC MPEG -4 Visual and ITU-T H.264 (also known as ISO/IEC MPEG-4 AVC), which includes extensions to Scalable Video Coding (SVC) and Multi-View Video Coding (MVC).

[0020] The High Efficiency Video Coding (HEVC) standard was completed by the Joint Collaborative Group on Video Standards (JCT-VC) of the ITU-T Video Coding Experts Group (VCEG) and the ISO/IEC Motion Picture Experts Group (MPEG) in April 2013.

[0021] The Joint Video Experts Team (JVET), a collaborative team formed through MPEG study group 16 of the ITU-T VCEG, has recently been working on a new video coding standard known as the Versatile Video Coding (VVC) standard. The main goal of VVC is to provide significant improvements in compression performance over the existing HEVC standard, facilitating the deployment of higher quality video services and new use cases such as 360° omnidirectional immersive media and high dynamic range (HDR) video ).

[0022] This disclosure describes technologies that can improve the combined inter-intra prediction mode for predicting video data. Multi-Hypothesis Intra-mode (MHI) is shown to improve the fusion mode by combining one intra-forecast and one fusion indexed prediction and implemented at the 12th JVET Macao Meeting by the authors: M.-S. Chiang, C.-W. Hsu, Y.-W. Huang, S.-M. Lei "CE10.1.1: Multi-hypothesis prediction for improving AMVP mode, skip or merge mode and intra mode", on JVET-L0100, October 2018. According to MHI, candidate options in a set of 4 internal modes, including planar, DC, horizontal and vertical forecasting, are evaluated to select the optimal forecast to be combined with the pooling indexed forecast. In the combining process outlined in the example above, if planar or DC mode is selected or the block size is less than 4, equal weights are unwrapped. Otherwise, the weights for the internally and mutually predicted samples (wIntra, wInter) differ based on the area of the samples in the encoding block.

[0023] This disclosure recognizes that in the inter-intra prediction technologies described in JVET-L0100, neighbor block coding information is not used to improve the coding performance of these tools. Additionally, region-based weighting is used for horizontal and vertical prediction modes, which may cause artifacts along region boundaries.

[0024] This disclosure techniques can improve inter-intra coding performance. These improvements may result from the position-independent weighting scheme of these technologies. According to the techniques of this disclosure, weights for the inter- and intra-prediction samples can be adaptively determined using encoding information, such as the number of intra-encoded neighboring blocks, the inter-prediction number of indexed merge blocks (uni- or bi-prediction), and/or the size of the current block.

[0025] FIG. 1 is a block diagram illustrating an exemplary video encoding and decoding system 100 that can implement the technologies of this disclosure. The technologies of this disclosure generally focus on encoding (encoding and/or decoding) video data. In general, video data includes any video processing data. Thus, video data may include raw unencoded video, encoded video, decoded (eg, reconstructed) video, and video metadata such as overhead data.

[0026] As shown in FIG. 1, system 100 includes a source device 102 that provides encoded video data to be decoded and displayed by the target device 116, in this example. Specifically, source device 102 provides video data to target device 116 via computer-readable media 110. Source device 102 and target device 116 may comprise any of a wide range of devices including desktop computers, laptops (i.e., laptop computers), tablet computers , set-top boxes, handsets, for example, smartphones, televisions, cameras, display devices, digital media players, video game consoles, video streaming device, etc. In some cases, source device 102 and target device 116 may be equipped with wireless communication capabilities and may therefore be referred to as “wireless communication devices.”

[0027] In the example of FIG. 1, source device 102 includes a video source 104, a storage device 106, a video encoder 200, and an output interface 108. The target device 116 includes an input interface 122, a video decoder 300, a storage device 120, and a display device 118. According to this disclosure, video encoder 200 of source device 102 and video decoder 300 of target device 116 may be configured to employ inter-intra coding technologies. Thus, the source device 102 represents an example of a video encoding device, while the target device 116 represents an example of a video decoding device. In other examples, the source device and target device may include other components or arrangements. For example, source device 102 may receive video data from an external video source, such as an external camera. Likewise, target device 116 may interface with an external display device instead of including an integrated display device.

[0028] System 100, as shown in FIG. 1 is simply one example. In general, any digital video encoding and/or decoding apparatus may implement inter-intra coding techniques. Source device 102 and target device 116 are simply examples of such encoding devices in which source device 102 generates encoded video data for transmission to target device 116. This disclosure refers to an "encoder" device as a device that performs encoding (encoding and/or or decoding) data. Thus, video encoder 200 and video decoder 300 represent examples of encoding devices, particularly video encoder and video decoder, respectively. In some examples, devices 102, 116 may operate substantially symmetrically such that each of devices 102, 116 includes video encoding and decoding components. Therefore, system 100 may support one-way and two-way video transmission between video devices 102, 116, for example, for video streaming, video playback, video broadcasting, or video telephony.

[0029] In general, video source 104 represents a source of video data (ie, raw, unencoded video data) and provides a sequential series of pictures (also referred to as “frames”) of video data to video encoder 200, which encodes the data for the pictures. Video source 104 of source device 102 may include a video capture device such as a video camera, a video archive containing previously captured raw video, and/or a live video interface to receive video from a video content provider. As a further alternative, video source 104 may generate computer graphics data as source video or a combination of live video, archived video, and machine-generated video. In each case, video encoder 200 encodes captured, pre-captured, or machine-generated video data. Video encoder 200 may rearrange pictures from reception order (sometimes called "display order") to encoding order for encoding. Video encoder 200 may generate a bit stream including encoded video data. The source device 102 may then output the encoded video data through an output interface 108 to a computer-readable medium 110 for reception and/or retrieval, such as through an input interface 122 of the target device 116.

[0030] The storage device 106 of the source device 102 and the storage device 120 of the target device 116 are general purpose storage devices. In some example, storage devices 106, 120 may store raw video data, such as raw video from video source 104 and raw decoded video data from video decoder 300. Additionally or alternatively, storage devices 106, 120 may store program instructions executed, for example, by video encoder 200 and video decoder 300, respectively. Although shown separately from video encoder 200 and video decoder 300 in this example, it should be understood that video encoder 200 and video decoder 300 may also include internal storage devices for functionally similar or equivalent purposes. In addition, the storage devices 106, 120 may store encoded video data, such as output from the video encoder 200 and input to the video decoder 300. In some examples, portions of the storage devices 106, 120 may be allocated as one or more video buffers, for example, to store raw, decoded and/or encoded video data.

[0031] Computer readable media 110 may represent any type of media or device capable of transporting encoded video data from a source device 102 to a target device 116. In one example, computer readable media 110 represents a communication medium to enable source device 102 to transmit encoded video data directly to a target device device 116 in real time, for example, via a radio frequency network or a computer network. Output interface 108 may modulate a transmitted signal including encoded video data, and input interface 122 may demodulate a received transmission signal according to a communication standard such as a wireless communication protocol. The communication medium may comprise any wireless or wired communication medium, such as radio frequency (RF) spectrum or one or more physical transmission lines. The communication medium may form part of a packet switched network, such as a local area network, a wide area network, or a wide area network such as the Internet. The communications environment may include routers, switches, base stations, or any other equipment that may be useful to facilitate transmission from source device 102 to target device 116.

[0032] In some examples, source device 102 may output encoded data from output interface 108 to storage device 112. Likewise, target device 116 may access encoded data from storage device 112 via input interface 122. Storage device 112 may include any of a variety of distributed or locally accessible storage media, such as a hard disk, Blu-ray discs, DVD, CD-ROM, flash memory, volatile or non-volatile storage device, or any other suitable digital storage media for storing encoded video data.

[0033] In some examples, source device 102 may output encoded video data to a file server 114 or other intermediate storage device that may store encoded video generated by source device 102. Destination device 116 may access stored video data from file server 114 via streaming or downloading. The file server 114 may be any type of server device capable of storing encoded video data and transmitting the encoded video data to the target device 116. The file server 114 may be a web server (eg, for a web site), a file transfer protocol (FTP) server. , a network-attached content delivery device or network-attached storage (NAS) protocol device. Target device 116 can access encoded video data from file server 114 over any standard data connection, including an Internet connection. This may include a wireless link (eg, Wi-Fi connection), a wired link (eg, digital subscriber line (DSL), cable modem, etc.), or a combination thereof, which is suitable for accessing the encoded video data stored on file server 114. File server 114 and input interface 122 may be configured to operate according to a streaming protocol, a download-based transfer protocol, or a combination of the above.

[0034] Output interface 108 and input interface 122 may represent wireless transmitters/receivers, modems, wired network components (eg, Ethernet cards), wireless communication components that operate according to any of a variety of IEEE 802.11 standards, or other physical Components. In examples in which the output interface 108 and the input interface 122 include wireless components, the output interface 108 and the input interface 122 may be configured to transmit data, such as encoded video data, according to a cellular communication standard such as 4G, 4G LTE (standard long-term development), improved standard LTE, 5G, etc. In some examples in which the output interface 108 includes a wireless transmitter, the output interface 108 and the input interface 122 may be configured to transmit data, such as encoded video data, in accordance with other wireless communication standards, such as the IEEE 802.11 specification, IEEE 802.15 -specification (for example, ZigBee™), Bluetooth™ standard, etc. In some examples, source device 102 and/or target device 116 may include corresponding on-chip (SoC) devices. For example, source device 102 may include an SoC device to perform functionality associated with video encoder 200 and/or output interface 108, and target device 116 may include an SoC device to perform functionality associated with video decoder 300 and/or interface 122 inputs.

[0035] The technologies of this disclosure can be applied to video encoding in support of any of a variety of multimedia applications such as over-the-air television broadcasts, cable television broadcasts, satellite television broadcasts, Internet video streaming such as dynamic adaptive streaming over the Internet. HTTP (DASH), digital video that is encoded onto a storage medium, decoding digital video stored on a storage medium, or other applications.

[0036] Input interface 122 of target device 116 receives an encoded video bit stream from computer-readable medium 110 (eg, storage device 112, file server 114, etc.). The encoded video bitstream may include overhead information specified by video encoder 200 that is also used by video decoder 300, such as syntax elements having meanings that describe the characteristics and/or processing of video blocks or other encoded units (e.g., slices, pictures, groups pictures, sequences, etc.). The display device 118 displays decoded pictures of the decoded video data to the user. Display device 118 may be any of a variety of display devices, such as a cathode ray tube (CRT) display, liquid crystal display (LCD), plasma display, organic light-emitting diode (OLED) display, or other type of display device.

[0037] Although not shown in FIG. 1, in some examples, video encoder 200 and video decoder 300 may be integrated with an audio encoder and/or audio decoder and may include corresponding multiplexer-demultiplexer modules or other hardware and software to process media streams including both audio , and video in the general data stream. If applicable, multiplexer-demultiplexer modules may conform to the ITU H.223 multiplexer protocol or other protocols such as User Datagram Protocol (UDP).

[0038] Video encoder 200 and video decoder 300 may be implemented as any of a variety of suitable encoder and/or decoder circuits, such as one or more microprocessors, digital signal processors (DSPs), application specific integrated circuits (ASICs), field programmable gate arrays ( FPGA), such as discrete logic, software, hardware, firmware, or any combination of the above. When the technologies are implemented partially in software, the apparatus may store the instructions for the software on a suitable non-transitory computer readable medium and execute the instructions in hardware using one or more processors to implement the technologies of this disclosure. Video encoder 200 and video decoder 300 may each be included in one or more encoders or decoders, any of which may be integrated as part of a combined encoder/decoder (codec) in a corresponding device. The device including video encoder 200 and/or video decoder 300 may include an integrated circuit, a microprocessor, and/or a wireless communication device such as a cellular telephone.

[0039] Video encoder 200 and video decoder 300 may operate according to a video coding standard such as ITU-T H.265, also referred to as the “High Efficiency Video Coding (HEVC) standard,” or extensions thereof, such as multi-view and/or scalable video coding extensions. video encoding. Alternatively, video encoder 200 and video decoder 300 may operate according to other proprietary or industry standards, such as the Joint Research Group Test Model (JEM) standard or ITU-T H.266, also referred to as “Versatile Video Coding (VVC)”. However, the techniques of this disclosure are not limited to any particular coding standard.

[0040] In general, video encoder 200 and video decoder 300 may perform block-based encoding of pictures. The term "block" generally means a structure including data to be processed (eg, encoded, decoded, or otherwise used in the encoding and/or decoding process). For example, the block may include a two-dimensional matrix of luma and/or chrominance data samples. In general, video encoder 200 and video decoder 300 can encode video data represented in YUV (eg, Y, Cb, Cr) format. Thus, instead of encoding red, green, and blue (RGB) data for the picture samples, video encoder 200 and video decoder 300 may encode luma and chrominance components, wherein the chrominance components may include red and blue chrominance components. . In some examples, video encoder 200 converts received RGB-formatted data to a YUV representation prior to encoding, and video decoder 300 converts the YUV representation to an RGB format. Alternatively, pre- and post-processing modules (not shown) can perform these transformations.

[0041] This disclosure may generally refer to picture encoding (eg, encoding and decoding), which includes the process of encoding or decoding picture data. Likewise, this disclosure may relate to encoding of picture blocks to include a data encoding or decoding process for the blocks, such as predictive encoding and/or residual encoding. A coded video bitstream generally includes a sequence of values for syntactic elements representing encoding decisions (eg, encoding modes) and segmentation of pictures into blocks. Thus, references to encoding a picture or block should generally be understood as encoding values for the syntactic elements that form the picture or block.

[0042] HEVC defines various blocks including coding units (CU), prediction units (PU), and transformation units (TU). According to HEVC, a video encoder (eg, video encoder 200) segments a coding tree unit (CTU) into CUs according to a quadtree structure. Thus, the video encoder segments the CTU and CU into four equal non-overlapping quadrants, and each quadtree node has either zero or four child nodes. Nodes without child nodes may be referred to as “leaf nodes,” and the CUs of such leaf nodes may include one or more PUs and/or one or more TUs. The video encoder can further segment PUs and TUs. For example, in HEVC, a residual quadtree (RQT) represents the TU segmentation. In HEVC, PUs represent inter-prediction data while TUs represent residual data. CUs that are internally predicted include internal prediction information such as an internal mode indicator.

[0043] As another example, video encoder 200 and video decoder 300 may be configured to operate according to JEM or VVC. According to JEM or VVC, a video encoder (eg, video encoder 200) segments a picture into a number of coding tree units (CTUs). Video encoder 200 may segment CTUs according to a tree structure, such as a quadrant-binary tree (QTBT) structure or a multi-type tree (MTT) structure. The QTBT structure removes the concepts of several types of segmentation, such as the division between CUs, PUs and HEVC TUs. The QTBT structure includes two layers: a first layer segmented according to a quadtree-based segmentation and a second level segmented according to a binary tree-based segmentation. The root node of the QTBT structure corresponds to the CTU. The leaf nodes of binary trees correspond to coding units (CUs).

[0044] In an MTT segmentation structure, blocks may be segmented using a quadtree (QT) segment, a binary tree (BT) segment, and one or more types of ternary tree (TT) segments. A ternary tree segment is a segment in which a block is split into three subblocks. In some examples, a ternary tree segment splits a block into three subblocks without splitting the original block down the center. The segmentation types in MTT (e.g., QT, BT, and TT) can be symmetrical or asymmetrical.

[0045] In some examples, video encoder 200 and video decoder 300 may use one QTBT or MTT structure to represent each of the luma and chrominance components, while in other examples, video encoder 200 and video decoder 300 may use two or more QTBT or MTT structures, for example, one QTBT/MTT structure for the luma component and another QTBT/MTT structure for both chrominance components (or two QTBT/MTT structures for the corresponding chrominance components).

[0046] Video encoder 200 and video decoder 300 may be configured to use HEVC quadtree segmentation, QTBT segmentation, MTT segmentation, or other segmentation structures. For purposes of explanation, a description of the techniques of this disclosure is presented with respect to QTBT segmentation. However, it should be understood that the techniques of this disclosure may also be applied to video encoders configured to also use quadtree segmentation or other types of segmentation.

[0047] This disclosure may use "NxN" and "N by N" interchangeably to refer to dimensions within samples of a block (eg, CU or other video block) in terms of vertical and horizontal dimensions, e.g., 16× samples 16 or 16 by 16 samples. In general, a 16x16 CU should have 16 pixels in the vertical direction (y=16) and 16 pixels in the horizontal direction (x=16). Likewise, a NxN CU generally has N samples in the vertical direction and N samples in the horizontal direction, with N representing a non-negative integer value. Selections in CU can be arranged in rows and columns. In addition, CUs do not necessarily have the same number of samples in the horizontal direction and in the vertical direction. For example, CUs may contain NxM samples, where M is not necessarily equal to N.

[0048] Video encoder 200 encodes video data for CUs representing prediction information and/or residual information and other information. The prediction information indicates how the CU should be predicted to generate a prediction block for the CU. The residual information generally represents the successive sample differences between the pre-encoding CU samples and the prediction block.

[0049] To predict a CU, video encoder 200 may generally generate a prediction block for the CU through inter prediction or intra prediction. Inter prediction generally refers to predicting CUs from previously encoded picture data, while intra prediction generally refers to predicting CUs from previously encoded data of the same picture. To perform inter-prediction, video encoder 200 may generate a prediction block using one or more motion vectors. Video encoder 200 may generally perform a motion search to identify a reference block that closely matches a CU, for example, in terms of differences between the CU and the reference block. Video encoder 200 may calculate a difference metric using sum of absolute differences (SAD), sum of squared differences (SSD), mean absolute difference (MAD), mean square differences (MSD), or other such difference calculations to determine whether or not a reference block closely matches with the current CU. In some examples, video encoder 200 may predict the current CU using unidirectional prediction or bidirectional prediction.

[0050] Some examples of JEM and VVC also provide an affine motion compensation mode, which can be considered a mutual prediction mode. In affine motion compensation mode, video encoder 200 may determine two or more motion vectors that represent non-translational motion in space, such as zooming in or out, rotation, perspective motion, or other types of irregular motion.

[0051] To perform intra prediction, video encoder 200 may select an intra prediction mode to generate a prediction block. Some JEM and VVC examples provide sixty-seven intraprediction modes, including various directional modes as well as planar mode and DC mode. In general, video encoder 200 selects an intra-prediction mode that describes adjacent samples relative to the current block (eg, a CU block) from which samples of the current block can be predicted. Such samples may generally be above, above and to the left or left of the current block in the same picture as the current block, provided that video encoder 200 encodes the CTUs and CUs in raster scan order (left to right, top to bottom).

[0052] In accordance with the techniques of this disclosure, video encoder 200 can perform inter-intra prediction of video data blocks (eg, CUs). Thus, video encoder 200 can generate a prediction block using both an inter-prediction block and an intra-prediction block. Video encoder 200 may generate a final prediction block for the current block by performing a weighted combination of samples of the inter-prediction block and the intra-prediction block. When the current block is a chroma block, video encoder 200 may determine weights according to the number of neighboring blocks to the luma block corresponding to the current chroma block that are intra-prediction encoded (and/or the number of blocks that are inter-prediction encoded). Thus, instead of determining weights according to neighboring blocks with respect to the current chroma block, video encoder 200 may determine the number of internally and/or inter-predicted blocks adjacent to a luma block corresponding to the current chroma block, then determine weights based on the number of internally and/or inter-predicted blocks. or mutually predicted blocks adjacent to a luminance block.

[0053] As an example, video encoder 200 may determine whether or not a top adjacent block and/or a left adjacent block are mutually predicted with respect to a corresponding luminance block. When none of these neighboring blocks are mutually predicted, video encoder 200 may determine a weight of 3 to be applied to the intra-prediction block and a weight of 1 to be applied to the inter-prediction block. When both of these adjacent blocks are mutually predicted, video encoder 200 may determine a weight of 3 to be applied to the inter-prediction block and a weight of 1 to be applied to the intra-prediction block. When one of these neighboring blocks is inter-predicted and the other is intra-predicted, video encoder 200 may determine weights of 2 to be applied to both the inter-prediction block and the intra-prediction block. In some examples, video encoder 200 may count neighboring blocks predicted using inter-intra prediction and/or intra-block copy as inter-prediction coded blocks. Video decoder 300 may perform a substantially identical process to determine the weights to be applied to the inter- and intra-prediction blocks for the current chroma block based on the prediction modes of neighboring blocks relative to the luma block corresponding to the current chroma block.

[0054] Video encoder 200 encodes data representing the prediction mode for the current block. For example, for inter-prediction modes, video encoder 200 may encode data representing which of the various available inter-prediction modes is used, as well as motion information for the corresponding mode. For unidirectional or bidirectional inter-prediction, for example, video encoder 200 may encode motion vectors using advanced motion vector prediction (AMVP) or a combining mode. Video encoder 200 may use similar modes to encode motion vectors for the affine motion compensation mode.

[0055] After prediction, such as intra prediction or inter prediction of a block, video encoder 200 may calculate residual data for the block. Residual data, such as a residual block, represents a sample by sample differences between a block and a prediction block for a block generated using the corresponding prediction mode. Video encoder 200 may apply one or more transforms to the residual block to generate transformed data in a transform region instead of a sample region. For example, video encoder 200 may apply a discrete cosine transform (DCT), an integer transform, a wavelet transform, or a conceptually similar transform to the residual video data. Additionally, video encoder 200 may apply a secondary transform after the first transform, such as a mode dependent inseparable secondary transform (MDNSST), a signal dependent transform, a Karhunen-Loeve transform (KLT), and the like. Video encoder 200 generates transform coefficients after applying one or more transforms.

[0056] As noted above, after transformations to generate transform coefficients, video encoder 200 may perform quantization of the transform coefficients. Quantization, in general, means a process in which transform coefficients are quantized to possibly reduce the amount of data used to represent the coefficients, providing additional compression. By performing a quantization process, video encoder 200 may reduce the bit depth associated with some or all of the coefficients. For example, video encoder 200 may round an n-bit value down to an m-bit value during quantization, where n is greater than m. In some examples, in order to perform quantization, video encoder 200 may perform a bitwise right shift of the value to be quantized.

[0057] After quantization, video encoder 200 may scan transform coefficients forming a one-dimensional vector from a two-dimensional matrix including the quantized transform coefficients. The scan can be designed to place higher energy (and therefore lower frequency) coefficients at the beginning of the vector and place lower energy (and therefore higher frequency) coefficients at the end of the vector. In some examples, video encoder 200 may use a predefined scan order to scan the quantized transform coefficients to generate a serialized vector, and then entropy encode the quantized vector transform coefficients. In other examples, video encoder 200 may perform adaptive scanning. After scanning the quantized transform coefficients to form a one-dimensional vector, video encoder 200 may entropy encode the one-dimensional vector, for example, according to context-adaptive binary arithmetic coding (CABAC). Video encoder 200 may also entropy encode other syntax elements describing metadata associated with encoded video data for use by video decoder 300 in decoding the video data.

[0058] To perform CABAC, video encoder 200 may assign a context in the context model to the symbol to be transmitted. The context may relate, for example, to whether a symbol's neighboring values are zero-valued or not. The determination of probability may be based on the context assigned to the symbol.

[0059] Video encoder 200 may further generate syntax data, such as block-based syntax, picture-based syntax, and sequence-based syntax, into video decoder 300, such as a picture header, a block header, a slice header, or others. syntax data, such as a sequence parameter set (SPS), a picture parameter set (PPS), or a video parameter set (VPS). Video decoder 300 likewise may decode such syntax data to determine how to decode the corresponding video data.

[0060] Thus, video encoder 200 may generate a bitstream including encoded video data, eg, syntax elements describing the segmentation of a picture into blocks (eg, CUs), and prediction and/or residual information for the blocks. Ultimately, video decoder 300 can receive the bit stream and decode the encoded video data.

[0061] In general, video decoder 300 performs the inverse process of the process performed by video encoder 200 to decode encoded bitstream video data. For example, video decoder 300 may decode values for bitstream syntax elements using CABAC in a manner substantially similar, although inverse, to the CABAC encoding process of video encoder 200. The syntax elements may specify segmentation of picture information into CTUs and segmentation of each CTU according to an appropriate segmentation structure. such as a QTBT structure to specify a CU CTU. The syntax elements may further specify prediction information and residual information for blocks (eg, CUs) of video data.

[0062] The residual information may be represented, for example, by quantized transform coefficients. Video decoder 300 may dequantize and deconvert the quantized transform coefficients of the block to reproduce a residual block for the block. Video decoder 300 uses the signaled prediction mode (intra or inter prediction) and associated prediction information (eg, motion information for inter prediction) to generate a prediction block for the block. Video decoder 300 may then combine the prediction block and the residual block (on a sample-by-sample basis) to reproduce the original block. Video decoder 300 may perform additional processing, such as performing a deblocking process, to reduce visual artifacts along block boundaries.

[0063] In accordance with the techniques of this disclosure, video encoder 200 and/or video decoder 300 may be configured to perform inter-intra coding. Thus, video encoder 200 and/or video decoder 300 may predict a block of video data using combined inter-intra prediction in accordance with any of the techniques described herein.

[0064] For example, video encoder 200 and video decoder 300 may adaptively determine weights to be applied to inter-prediction and intra-prediction samples based on a position-independent weighting scheme. For example, video encoder 200 and video decoder 300 may adaptively determine weights according to (eg, as a function of) encoding information such as the number of intra- and/or inter-encoded neighboring blocks, the inter-prediction number of indexed merge blocks (uni- or bi-prediction), the size of the current block. Let (wInter, wIntra) represent the weights for the mutual and internal prediction samples in the description below. That is, wInter represents a weight value applied to the inter-prediction block samples, and wIntra represents a weight value applied to the intra prediction block samples. In some examples, wInter+wIntra=1, where wInter and wIntra are rational values between 0 and 1.

[0065] This disclosure may generally relate to "signalling" certain information, such as syntactic elements. The term "signalling" may generally mean transmitting values for syntax elements and/or other data used to decode encoded video data. Thus, video encoder 200 may signal values for syntax elements in the bit stream. In general, signaling means generating a value in a stream of bits. As noted above, source device 102 may transport a stream of bits to target device 116 in near real time or non-real time, for example, which may occur when syntax elements are stored in data storage device 112 for later retrieval by target device 116.

[0066] FIG. 2A and 2B is a conceptual diagram illustrating an example quadtree and binary tree (QTBT) structure 130 and a corresponding coding tree unit (CTU) 132. Solid lines represent quadtree partitioning, and dotted lines indicate binary tree partitioning. At each split (i.e., non-leaf) node in the binary tree, one flag is signaled to indicate which type of split (i.e., horizontal or vertical) is used, where 0 indicates horizontal split and 1 indicates vertical split in this example. For quadtree partitioning, there is no need to specify a partition type because the quadtree nodes split the block horizontally and vertically into 4 subblocks of equal size. Accordingly, video encoder 200 may encode and video decoder 300 may decode syntactic elements (eg, split information) for the tree level of the region of QTBT structure 130 (i.e., solid lines) and syntactic elements (eg, split information) for the tree level predicting QTBT structure 130 (i.e., dotted lines). Video encoder 200 may encode and video decoder 300 may decode video data, such as prediction and transform data, for CUs represented by terminal leaf nodes of the QTBT structure 130.

[0067] In general, the CTU 132 of FIG. 2B may be associated with parameters specifying the sizes of blocks corresponding to nodes of the QTBT structure 130 at the first and second levels. These parameters may include CTU size (representing the size of CTU 132 in samples), minimum quadtree size (MinQTSize, representing the minimum allowed size of quadtree leaf nodes), maximum binary tree size (MaxBTSize, representing the maximum allowed size of binary root nodes). tree), the maximum binary tree depth (MaxBTDepth, representing the maximum allowed depth of a binary tree), and the minimum binary tree size (MinBTSize, representing the minimum allowed size of leaf nodes of a binary tree).

[0068] The root node of a QTBT structure corresponding to a CTU may have four child nodes at the first level of the QTBT structure, each of which may be segmented according to quadtree-based segmentation. Thus, the first level nodes are either leaf nodes (having child nodes) or have four child nodes. Example QTBT structure 130 represents such nodes as including a parent node and child nodes having solid lines for branches. If first-level nodes do not exceed the maximum allowed size of binary tree root nodes (MaxBTSize), they can additionally be segmented through corresponding binary trees. A single node binary tree split can be processed iteratively until the nodes resulting from the split reach the minimum allowed binary tree leaf node size (MinBTSize) or the maximum allowed binary tree depth (MaxBTDepth). Example QTBT structure 130 represents such nodes as having dashed lines for branches. A leaf node of a binary tree is called a "coding unit (CU)", which is used for prediction (for example, intra-picture or inter-picture prediction) and transformation, without further segmentation. As explained above, CUs may also be referred to as "video units" or "blocks".

[0069] In one example of a QTBT segmentation structure, the CTU size is set to 128×128 (luma samples and two corresponding 64×64 chrominance samples), MinQTSize is set to 16×16, MaxBTSize is set to 64×64, MinBTSize ( for width and height) is set to 4, and MaxBTDepth is set to 4. Quadtree-based segmentation is applied to the CTU first to form quadtree leaf nodes. Quadtree leaf nodes can have sizes from 16x16 (i.e., MinQTSize) to 128x128 (i.e., up to CTU size). If a quadtree leaf node is 128x128, then it should not be further split by a binary tree because the size exceeds MaxBTSize (i.e. 64x64, in this example). Otherwise, the quadtree leaf node is further segmented by a binary tree. Therefore, the quadtree leaf node is also the root node for the binary tree and has a binary tree depth of 0. When the binary tree depth reaches MaxBTDepth (4, in this example), no further splitting is allowed. When a binary tree node has a width equal to MinBTSize (4, in this example), this implies that additional horizontal splitting is not allowed. Likewise, a binary tree node having a height equal to MinBTSize implies that additional vertical splitting is not permitted for that binary tree node. As noted above, the leaf nodes of a binary tree are called "CU" and are further processed according to prediction and transformation without additional segmentation.

[0070] FIG. 3A-3F are conceptual diagrams illustrating exemplary locations of neighboring blocks with respect to current blocks. In particular, FIG. 3A represents an example of a current block 140 having a top neighbor block 142 and a left neighbor block 144, FIG. 3B represents an example of a current block 146 having a top right neighbor block 148 and a bottom left neighbor block 150, FIG. 3C represents an example of a current block 152 having a top neighbor block 154, a left neighbor block 156, and a top left neighbor block 158, FIG. 3D represents an example of a current block 160 having a top right neighbor block 162, a bottom left neighbor block 164, and a top left neighbor block 166, FIG. 3E represents an example of a current block 168 having a top neighbor block 170, a right top neighbor block 172, a left neighbor block 174, and a left bottom neighbor block 176, and FIG. 3F represents an example of a current block 178 having a top neighbor block 180, a top right neighbor block 182, a left neighbor block 184, a bottom left neighbor block 186, and a top left neighbor block 188.

[0071] In accordance with the techniques of this disclosure, video encoder 200 and video decoder 300 can adaptively determine weights for intra- and inter-samples based on the number of intra- and/or inter-encoded neighboring blocks, for example, as explained in US Application No. 16/ 684379, filed November 14, 2019, the contents of which are contained in their entirety herein by reference. However, according to the techniques of this disclosure, video encoder 200 and video decoder 300 can only mix inter- and intra-prediction samples without position-dependent intra-prediction combining (PDPC). Video encoder 200 and video decoder 300 may use reference neighbor blocks to determine weights, where the reference neighbor blocks may be any combination of top, top right, top left, left, or bottom left neighbor blocks, for example, as shown in the various examples of FIGS. 3A-3F.

[0072] In one example, for example, as shown in FIG. 3A, video encoder 200 and video decoder 300 use the top neighbor block 142 and the left neighbor block 144 to determine the weights that should be applied to the intra and inter-prediction samples for the inter-intra prediction of the current block 140. Thus, the top neighbor block 142 and the left neighbor block 144 are used to check the internally encoded neighbors for the current block 140 in this example.

[0073] In another example, such as shown in FIG. 3B, video encoder 200 and video decoder 300 use the top right neighbor block 148 and the bottom left neighbor block 150 to determine weights that should be applied to the intra and inter-prediction samples for the inter-intra prediction of the current block 146. Thus, the top right neighbor block 148 and lower left neighbor block 150 are used to check the internally encoded neighbors for the current block 146 in this example.

[0074] In another example, such as shown in FIG. 3C, top neighbor block 154, left neighbor block 156, and top left neighbor block 158 are used to check internally encoded neighbors for the current block 152.

[0075] In another example, such as shown in FIG. 3D, top right neighbor block 162, bottom left neighbor block 164, and top left neighbor block 166 are used to check internally encoded neighbors for the current block 160.

[0076] In another example, such as shown in FIG. 3E, top neighbor block 170, top right neighbor block 172, left neighbor block 174, and bottom left neighbor block 176 are used to check internally encoded neighbors for the current block 168.

[0077] In another example, for example, as shown in FIG. 3F, top neighbor block 180, top right neighbor block 182, left neighbor block 184, bottom left neighbor block 186, and top left neighbor block 188 are used to check internally encoded neighbors for the current block 178.

[0078] In some examples, video encoder 200 and video decoder 300 select reference neighboring blocks according to the block size of the current block (eg, blkWidth and blkHeight). For example, if blkWidth and blkHeight are identical, video encoder 200 and video decoder 300 may use the combination of FIG. 3D, fig. 3E or FIG. 3F. In another example, if blkWidth and blkHeight are different, video encoder 200 and video decoder 300 may use top-n and left-n, for example, as shown in FIG. 3B.

[0079] In another example, if blkWidth and blkHeight are identical, then video encoder 200 and video decoder 300 may select neighboring block positions symmetrically along the width and height dimensions of the current block, for example, according to the examples of FIGS. 3A-3F. On the other hand, if blkWidth and blkHeight are different, video encoder 200 and video decoder 300 can select neighboring block positions asymmetrically along the width and height dimensions of the current block. For example, if blkWidth is greater than blkHeight, video encoder 200 and video decoder 300 may select neighboring blocks as top-n and left, whereas if blkWidth is less than blkHeight, video encoder 200 and video decoder 300 may select neighboring blocks as left-n and top.

[0080] In some examples, if a checked adjacent block is IBC/CPR-encoded (based on an intra-block copy/current picture reference), the adjacent block may be treated as a cross-encoded block.

[0081] In some examples, if a checked adjacent block is IBC/CPR-encoded, the adjacent block may be treated as an intra-encoded block.

[0082] In some examples, when the checked neighbor block is a combined intra-reciprocal block, the neighbor block may be treated as a reciprocal encoded block.

[0083] In some examples, when the checked neighboring block is a combined intra-mutual block, the neighboring block may be considered an intra-encoded block.

[0084] In some examples, when a single luma and chroma tree or dual (separate) luma and chroma trees are activated, video encoder 200 and video decoder 300 may determine weights for mixing chrominance blocks according to an internal check of the corresponding luma block or neighboring blocks in relation to the corresponding block of luminance signals.

[0085] In some examples, when dual tree coding is enabled, video encoder 200 and video decoder 300 may determine weights for mixing chroma blocks according to an internal check of adjacent chroma blocks.

[0086] Video encoder 200 and video decoder 300 may determine weights based on internal verification. Let wInter and wIntra represent the weights for the cross- and intra-samples in cross-internal mixing. The weights can be normalized by ²ⁿ , where n is an integer that is equal to the sum of the weights. In other words, these weights can be normalized to 4, 8, 16, ..., which is implementable with a simple right shift operation.

[0087] In some examples, if all checked neighboring blocks are internally encoded, video encoder 200 and video decoder 300 may determine that the weight for the internal samples is higher than the weight for the cross samples (e.g., (wInter, wIntra)=(1, 3) or (wInter, wIntra)=(3, 5)).

[0088] In some examples, if all checked neighboring blocks are not internally encoded, video encoder 200 and video decoder 300 may determine that the weight for the internal samples is lower than the weight for the cross samples (for example, (wInter, wIntra)=(3, 1 ) or (wInter, wIntra)=(5, 3)).

[0089] In some examples, if only one of the checked neighboring blocks is internally encoded, video encoder 200 and video decoder 300 may determine that the weights for the internal and intersamples are identical.

[0090] In some examples, if the top-left, top-n, and left-n adjacent blocks are internally encoded, video encoder 200 and video decoder 300 may determine that the weights (wInter, wIntra) are (1, 3) or (3, 5). In another example, if at least one of the top-left, top-n, or left-n adjacent blocks is internally encoded, video encoder 200 and video decoder 300 may set (wInter, wIntra) equal to (2, 2) or (4, 4 ). In yet another example, if all left-top, top-n, or left-adjacent blocks are not internally encoded, video encoder 200 and video decoder 300 may set (wInter, wIntra) to (3, 1) or (5, 3).

[0091] In some examples, if at least one of the tested blocks is an MHI-coded (multi-hypothesis intra) block, video encoder 200 and video decoder 300 may copy the weight for the current block from the weight of one of the tested blocks.

[0092] In some examples, if only one of these checked blocks is internally encoded, video encoder 200 and video decoder 300 may determine that the weight for the internal samples is higher than the weight for the cross samples (for example, (wInter, wIntra)=(1, 3) or (wInter, wIntra)=(3, 5)).

[0093] In some examples, if only one of these checked blocks is internally encoded, video encoder 200 and video decoder 300 may determine that the weight for the internal samples is lower than the weight for the inter-samples (for example, (wInter, wIntra)=(3, 1) or (wInter, wIntra)=(5, 3)).

[0094] In some examples, if all of these checked blocks are not internally encoded, video encoder 200 and video decoder 300 may determine that the weight for the internal samples is higher than the weight for the cross samples (for example, (wInter, wIntra)=(1, 3 ) or (wInter, wIntra)=(3, 5)).

[0095] In some examples, video encoder 200 and video decoder 300 may determine (wInter, wIntra) according to the intra prediction mode of the checked neighboring blocks. In one example, if there is at least one adjacent block encoded using intra DC mode or planar mode, the weight for the internal samples may be higher than the weight for the inter samples (eg, (wInter, wIntra)=(1 , 3) or (wInter, wIntra)=(3, 5)).

[0096] In some examples, video encoder 200 and video decoder 300 may determine (wInter, wIntra) based on the inter-prediction number of the indexed combine block, i.e. In addition, the merge index block is predicted using unidirectional or bidirectional prediction.

[0097] In some examples, if the indexed combiner is a biprediction, video encoder 200 and video decoder 300 may set wInter higher than wIntra (for example, (wInter, wIntra)=(3, 1) or (wInter, wIntra)=(5, 3 )).

[0098] In some examples, if the indexed combiner is a uniprediction, video encoder 200 and video decoder 300 may set wInter higher than wIntra (for example, (wInter, wIntra)=(3, 1) or (wInter, wIntra)=(5, 3 )).

[0099] In some examples, if the indexed combiner is a biprediction, video encoder 200 and video decoder 300 may set wInter higher than wIntra (for example, (wInter, wIntra)=(3, 1) or (wInter, wIntra)=(5, 3 )). Meanwhile, for an indexed uni-prediction combining block, video encoder 200 and video decoder 300 may determine (wInter, wIntra) using the number of adjacent intra and/or mutual blocks, for example, as explained above.

[0100] In some examples, video encoder 200 and video decoder 300 may determine (wInter, wIntra) according to the size of the current block. The size (SIZEblk) of the current block is based on its width and height.

[0101] In some examples, video encoder 200 and video decoder 300 may determine the size of the current block as the minimum value of the width and height of the current block. In another example, video encoder 200 and video decoder 300 may determine the size of the current block as the maximum value of the width and height of the current block. In yet another example, video encoder 200 and video decoder 300 may determine the size of the current block by multiplying (ie, multiplying) the width and height of the current block. In yet another example, video encoder 200 and video decoder 300 may determine the size of the current block by adding the width and height of the current block.

[0102] In some examples, if SIZEblk is above a predetermined threshold, video encoder 200 and video decoder 300 may set wInter higher or lower than wIntra (for example, (wInter, wIntra)=(3, 1) or (wInter, wIntra)=(5 , 3)).

[0103] In some examples, if SIZEblk is below a predetermined threshold, video encoder 200 and video decoder 300 may set wInter higher or lower than wIntra (for example, (wInter, wIntra)=(3, 1) or (wInter, wIntra)=(5 , 3)).

[0104] In some examples, if the indexed combiner is a biprediction, video encoder 200 and video decoder 300 may set wInter above or below wIntra (for example, (wInter, wIntra)=(3, 1) or (wInter, wIntra)=(5 , 3)). Meanwhile, for an indexed uni-prediction combining block, the video encoder 200 and the video decoder 300 can determine (wInter, wIntra) adaptively according to the size of the current block.

[0105] In some examples, a set of pairs of weights (wInter, wIntra) may be predefined. A set of pairs of weights may be signaled in a bitstream header or sequence parameter set (SPS). Thus, video encoder 200 may encode a set of pairs of weights, while video decoder 300 may decode a set of pairs of weights. During the encoding process of the MHI block, video encoder 200 may determine the best weight using a rate-dependent distortion (RD) estimate. In this example, video encoder 200 may extract the RD costs of all elements in a pair of weights. Video encoder 200 may select a pair having minimal RD cost to encode the current block and signal the index of that pair into the bitstream. Video encoder 200 may encode the index using a CABAC algorithm using bypass or context entropy coding. Video decoder 300 may perform a decoding process to obtain an index to determine weights (eg, a pair of weights) to apply to the current block.

[0106] In some examples, video encoder 200 and video decoder 300 may encode a list of weights in a parameter set (e.g., an SPS, a picture parameter set (PPS), a video parameter set (VPS), an adaptation parameter set (APS) etc.) or in headers (tiles, slices, encoding units, etc.) corresponding to the cases described in the above technologies, which are based on checking adjacent block modes, block sizes, etc.

[0107] FIG. 4 is a block diagram illustrating an example video encoder 200 that may implement the techniques of this disclosure. Fig. 4 is provided for explanatory purposes and should not be construed as limiting the technologies illustrated and described generally in this disclosure. For purposes of explanation, this disclosure describes video encoder 200 in the context of video encoding standards, such as the HEVC video encoding standard and the upcoming H.266 video encoding standard. However, the techniques of this disclosure are not limited to these video coding standards and are generally applicable to video encoding and decoding.

[0108] In the example of FIG. 4, the video encoder 200 includes a video data memory 230, a mode selection unit 202, a residual generation unit 204, a transform processing unit 206, a quantization unit 208, an inverse quantization unit 210, an inverse transform processing unit 212, a restoration unit 214, a filtering unit 216, a decoded picture buffer (DPB) 218 and an entropy encoding module 220. Any of the video data storage unit 230, the mode selecting unit 202, the residual generation unit 204, the transform processing unit 206, the quantization unit 208, the inverse quantization unit 210, the inverse transform processing unit 212, the restoration unit 214, the filtering unit 216, the DPB 218, and the unit 220 entropy encoding may be implemented in one or more processors or processing circuitry. In addition, video encoder 200 may include additional or alternative processors or processing circuitry to perform these and other functions.

[0109] Video data storage device 230 may store video data to be encoded by components of video encoder 200. Video encoder 200 may receive video data stored in video data storage device 230, for example, from video source 104 (FIG. 1). DPB 218 may act as a reference picture memory that stores reference video data for use in predicting subsequent video data by video encoder 200. Video data memory 230 and DPB 218 may be configured by any of a variety of storage devices, such as dynamic random access memory (DRAM). DRAM), including synchronous DRAM (SDRAM), magnetoresistive RAM (MRAM), resistive RAM (RRAM), or other types of memory devices. The video data storage device 230 and the DPB 218 may be provided through an identical storage device or separate storage devices. In various examples, video data storage device 230 may be on-chip with other components of video encoder 200, as illustrated, or off-chip with respect to those components.

[0110] In this disclosure, reference to video data storage device 230 should not be interpreted as limited to storage device internal to video encoder 200 unless specifically described as such, or storage device external to video encoder 200 unless specifically described as such. quality. Conversely, reference to video data storage device 230 is to be understood as a reference storage device that stores video data that video encoder 200 receives for encoding (eg, video data for the current block to be encoded). The storage device 106 of FIG. 1 may also provide temporary storage of outputs from various modules of video encoder 200.

[0111] Various modules of FIG. 4 are illustrated to assist in understanding the operations performed by the video encoder 200. The modules may be implemented as fixed function circuits, programmable circuits, or a combination of the above. Fixed function diagrams mean diagrams that provide specific functionality and are pre-set regarding the operations that can be performed. Programmable circuits mean circuits that can be programmed to perform various tasks and provide flexible functionality in the operations that can be performed. For example, programmable circuits may execute software or firmware that instructs the programmable circuits to operate in a manner specified by software or firmware instructions. Fixed function diagrams can execute program instructions (for example, to accept parameters or output parameters), but the types of operations that fixed function diagrams perform are generally immutable. In some examples, one or more modules may be various circuit blocks (fixed function or programmable), and in some examples, one or more modules may be integrated circuits.

[0112] Video encoder 200 may include arithmetic logic units (ALUs), elementary function units (EFUs), digital circuits, analog circuits, and/or programmable cores formed from programmable circuits. In examples in which the operations of video encoder 200 are performed using software executed through programmable circuitry, storage device 106 (FIG. 1) may store object code of software that video encoder 200 receives and executes, or other storage device in video encoder 200 (not shown) can store such instructions.

[0113] The video data storage device 230 is configured to store received video data. The video encoder 200 may retrieve a video data picture from the video data storage device 230 and provide the video data to the residual generating unit 204 and the mode selecting unit 202 . The video data in the video data storage device 230 may be raw video data to be encoded.

[0114] The mode selection unit 202 includes a motion estimation unit 222, a motion compensation unit 224, and an internal prediction unit 226. The mode selection module 202 may include additional functional modules to perform video prediction in accordance with other prediction modes. As an example, mode selection module 202 may include a palette processing module, an intra-block copy module (which may be part of motion estimation module 222 and/or motion compensation module 224), an affine processing module, a linear model (LM) processing module ) and so on.

[0115] Mode selection module 202 generally coordinates multiple encoding passes to test combinations of encoding parameters and the resulting distortion values as a function of bit rate for such combinations. Encoding parameters may include CTU to CU segmentation, prediction modes for CUs, transform types for CU residual data, quantization parameters for CU residual data, etc. The mode selector 202 may ultimately select a combination of encoding parameters having rate-dependent distortion values that are better than the other combinations tested.

[0116] Video encoder 200 may segment a picture retrieved from video data storage device 230 into a sequence of CTUs and encapsulate one or more CTUs in a slice. The mode selection unit 202 may segment CTU pictures according to a tree structure such as a QTBT structure or a HEVC quadtree structure described above. As described above, video encoder 200 may generate one or more CUs from a CTU segmentation according to a tree structure. Such a CU may also generally be referred to as a "video unit" or "unit".

[0117] In general, mode selection module 202 also controls its components (e.g., motion estimation module 222, motion compensation module 224, and internal prediction module 226) so as to generate a predictive block for the current block (e.g., the current CU or, in HEVC, overlapping part PU and TU). To mutually predict the current block, motion estimation module 222 may perform a motion search to identify one or more closely matching reference blocks in one or more reference pictures (eg, in one or more previously encoded pictures stored in DPB 218). In particular, motion estimation module 222 may calculate a value representing how similar a potential reference block is to a current block, for example, according to sum absolute differences (SAD), sum of squared differences (SSD), mean absolute difference (MAD), root mean square differences (MSD), etc. Motion estimation module 222 may generally perform these calculations using successive sample differences between the current block and the reference block in question. Motion estimation module 222 may identify the reference block having the smallest value resulting from these calculations, indicating the reference block that most closely matches the current block.

[0118] Motion estimation module 222 may generate one or more motion vectors (MVs) that define positions of reference blocks in reference pictures relative to the position of the current block in the current picture. Motion estimation module 222 may then provide motion vectors to motion compensation module 224 . For example, for unidirectional inter-prediction, motion estimator 222 may provide one motion vector, whereas for bi-directional inter-prediction, motion estimator 222 may provide two motion vectors. Motion compensation module 224 can then generate a prediction block using the motion vectors. For example, motion compensation module 224 may extract reference block data using a motion vector. As another example, if the motion vector has fractional subsample precision, motion compensation module 224 may interpolate values for the prediction block according to one or more interpolation filters. In addition, for bidirectional inter-prediction, motion compensation module 224 may extract data for two reference blocks identified by corresponding motion vectors and combine the extracted data, for example, through sequential sample averaging or weighted averaging.

[0119] As another example, for intra prediction or intra prediction coding, intra prediction module 226 may generate a prediction block from samples adjacent to the current block. For example, for directional modes, intra prediction module 226 may generally mathematically combine the values of adjacent samples and populate those calculated values in a given direction for the current block to generate a prediction block. As another example, for DC mode, intra prediction module 226 may calculate the average of neighboring samples with respect to the current block and generate a prediction block that includes this resulting average for each sample of the prediction block.

[0120] In accordance with the techniques of this disclosure, the mode selection module 202 can perform inter-intra prediction of video data blocks (eg, CUs). Thus, the mode selection unit 202 can generate a prediction block by causing the motion estimation unit 222 and the motion compensation unit 224 to generate an inter-prediction unit, and the intra-prediction unit 226 to generate an intra-prediction unit. The mode selection unit 202 can generate a final prediction block for the current block by performing weighted combination of samples of the inter-prediction block and the intra-prediction block. When the current block is a chrominance block, the mode selector 202 may determine weights to perform weighting prediction according to the number of neighboring blocks to the luma block corresponding to the current chroma block, which are intra- and/or inter-prediction encoded. That is, instead of determining the weights according to neighboring blocks with respect to the current chroma block, the mode selection unit 202 can determine the number of mutually predicted blocks adjacent to the luma block corresponding to the current chroma block, then determine the weights based on the number of mutually predicted blocks adjacent with brightness block.

[0121] As an example, the mode selection unit 202 may determine whether or not a top adjacent block and/or a left adjacent block are mutually predicted with respect to a corresponding luminance block. When none of these neighboring blocks are mutually predicted, the mode selector 202 may determine a weight of 3 to be applied to the intra-prediction block and a weight of 1 to be applied to the inter-prediction block. When both of these adjacent blocks are inter-predicted, the mode selection unit 202 may determine a weight of 3 to be applied to the inter-prediction block and a weight of 1 to be applied to the intra-prediction block. When one of these neighboring blocks is inter-predicted and the other is internally predicted, mode selector 202 may determine weights of 2 to be applied to both the inter-prediction block and the intra-prediction block. In some examples, mode selection module 202 may count neighboring blocks predicted using inter-intra prediction and/or intra-block copy as inter-prediction coded blocks.

[0122] The mode selection module 202 provides the prediction block to the residual generating module 204. The residual generation module 204 receives the raw, uncoded version of the current block from the video data storage device 230 and the prediction block from the mode selection module 202. Residual generation module 204 calculates successive sample differences between the current block and the prediction block. The resulting sequential sample differences define the residual block for the current block. In some examples, residual generating module 204 may also determine differences between sample values in a residual block to generate a residual block using residual differential pulse code modulation (RDPCM). In some examples, residual generation module 204 may be generated using one or more subtractor circuits that perform binary subtraction.

[0123] In examples in which mode selection module 202 segments CUs into PUs, each PU may be associated with a luma prediction unit and corresponding chrominance prediction units. Video encoder 200 and video decoder 300 may support PUs having different sizes. As stated above, the CU size may refer to the size of a luminance signal coding unit of the CU, and the PU size may refer to the size of a luminance signal prediction unit of the PU. Assuming that the size of a particular CU is 2Nx2N, video encoder 200 may support PU sizes of 2Nx2N or NxN for intra-prediction and symmetric PU sizes of 2Nx2N, 2NxN, Nx2N, NxN or similar for inter-prediction. Video encoder 200 and video decoder 300 may also support asymmetric segmentation for PU sizes of 2NxnU, 2NxnD, nLx2N, and nRx2N for inter-prediction.

[0124] In examples in which the mode selection module does not further segment the CU into PUs, each CU may be associated with a luma coding block and corresponding chrominance coding blocks. As described above, the CU size may refer to the size of the luminance signal coding block of the CU. Video encoder 200 and video decoder 300 may support CU sizes of 2Nx2N, 2NxN, or Nx2N.

[0125] For other video encoding technologies, such as intra-block copy mode encoding, affine mode encoding, and linear model (LM) mode encoding, as a few examples, mode selection module 202, through corresponding modules associated with the technologies encoding, generates a prediction block for the current block being encoded. In some examples, such as palette mode encoding, mode selection module 202 may not generate a predictive block and instead generate syntactic elements that indicate the manner in which the block should be reconstructed based on the selected palette. In such modes, mode selection module 202 may provide these syntactic elements to entropy encoding module 220 for encoding.

[0126] In some examples, mode selection module 202 may select an inter-intra prediction mode. In such examples, the mode selection module 202 may weigh the inter-prediction block generated by the motion compensation module 224 and the intra-prediction block generated by the intra-prediction module 226, according to any of the various techniques of this disclosure. The mode selection unit 202 can generate a prediction block from the weighted inter-prediction and intra-prediction blocks and output the generated prediction block.

[0127] As described above, the residual generation module 204 receives video data for the current block and the corresponding prediction block. The residual generating unit 204 then generates a residual block for the current block. To generate a residual block, the residual generation module 204 calculates successive sample differences between the prediction block and the current block.

[0128] Transform processing unit 206 applies one or more transforms to the residual block to generate a block of transform coefficients (referred to herein as a “transform coefficient block”). The transform processing unit 206 may apply various transforms to the residual block to generate a block of transform coefficients. For example, transform processing module 206 may apply a discrete cosine transform (DCT), a directed transform, a Karhunen-Loeve transform (KLT), or a conceptually similar transform to the residual block. In some examples, transform processing module 206 may perform multiple transforms on a residual block, for example, a primary transform and a secondary transform, such as a rotational transform. In some examples, transformation processing module 206 does not apply transformations to the remainder block.

[0129] The quantization unit 208 may quantize the transform coefficients in the transform coefficient block to generate a quantized transform coefficient block. The quantization unit 208 may quantize the transform coefficients of the transform coefficient block according to a quantization parameter (QP) value associated with the current block. Video encoder 200 (eg, through mode selector 202) may adjust the degree of quantization applied to coefficient blocks associated with the current block by adjusting the QP value associated with the CU. Quantization may introduce information loss, and as such, the quantized transform coefficients may have less accuracy than the original transform coefficients generated by the transform processing unit 206.

[0130] The inverse quantization unit 210 and the inverse transform processing unit 212 may apply inverse quantization and inverse transforms to the block of quantized transform coefficients, respectively, to recover a residual block from the block of transform coefficients. The reconstruction module 214 may generate a reconstructed block corresponding to the current block (albeit potentially with a certain degree of distortion) based on the reconstructed residual block and the prediction block generated by the mode selection module 202 . For example, recovery module 214 may add samples of the reconstructed residual block with corresponding samples from the prediction block generated by mode selection module 202 to generate a reconstructed block.

[0131] Filtering module 216 may perform one or more filtering operations on the reconstructed blocks. For example, filtering module 216 may perform deblocking operations to reduce blocking artifacts along the edges of the CU. The operations of filtering module 216 may be skipped in some examples.

[0132] Video encoder 200 stores the reconstructed blocks in DPB 218. For example, in examples in which the operations of filtering module 216 are not required, reconstruction module 214 may store the reconstructed blocks in DPB 218. In examples in which operations of filtering module 216 are required, module 216 filtering may store the filtered reconstructed blocks in the DPB 218. The motion estimation module 222 and the motion compensation module 224 may extract a reference picture from the DPB 218 formed from the reconstructed (and potentially filtered) blocks in order to mutually predict blocks of subsequent encoded pictures. In addition, the intra prediction module 226 may use the reconstructed blocks in the DPB 218 of the current picture to internally predict other blocks in the current picture.

[0133] In general, entropy encoding module 220 may entropy encode syntax elements received from other functional components of video encoder 200. For example, entropy encoding module 220 may entropy encode blocks of quantized transform coefficients from quantization module 208. As another example, entropy encoding module 220 may entropy encode prediction syntax elements (eg, motion information for inter-prediction or intra-mode information for intra-prediction) from mode selection module 202 . Entropy encoding module 220 may perform one or more entropy encoding operations on syntax elements that are another example of video data to generate entropy encoded data. For example, entropy encoding module 220 may perform a context-adaptive variable-length coding (CAVLC) operation, a CABAC operation, a variable-to-variable (V2V) length encoding operation, a syntactic context-adaptive binary arithmetic coding (SBAC) operation, an entropy-based entropy encoding operation. probability interval encoding (PIPE), Golomb exponential encoding operation, or another type of entropy encoding operation on the data. In some examples, entropy encoding module 220 may operate in a bypass mode in which syntactic elements are not entropy encoded.

[0134] Video encoder 200 may output a bitstream that includes entropy-coded syntax elements required to reconstruct slice or picture blocks. In particular, entropy encoding module 220 may output a bit stream.

[0135] The operations described above are described in relation to a block. Such description is to be understood as operations for a luma coding block and/or chrominance coding blocks. As described above, in some examples, the luma coding block and the chrominance coding blocks are components of the luma signal and the chrominance signal CU. In some examples, the luma encoding unit and the chrominance encoding units are components of the luma signal and the chrominance signal PU.

[0136] In some examples, operations performed on a luma coding block need not be repeated for chrominance coding blocks. As one example, the operations for identifying a motion vector (MV) and a reference picture for a luma coding block do not need to be repeated to identify the MV and a reference picture for chrominance blocks. Conversely, the MV for a luma encoding block may be scaled with the ability to determine the MV for chrominance blocks, and the reference picture may be the same. As another example, the intra prediction process may be identical for luma coding blocks and chrominance coding blocks.

[0137] Video encoder 200 of FIG. 4 represents an example of a video encoding apparatus comprising one or more processors configured to generate an inter-prediction block for a current block of video data; generate an internal prediction block for the current block of video data; apply a first weight to the inter-prediction block and a second weight to the intra-prediction block; combine the first weighted inter-prediction block and the second weighted intra-prediction block to generate a prediction block for the current block; and encode (ie encode, in this example) the current block using the prediction block.

[0138] Video encoder 200 also provides an example of a device for encoding video data, comprising one or more processors configured to generate an inter-prediction block for a current chrominance block of video data; generate an internal prediction block for the current color block of video data; determine the number of neighboring blocks with respect to the luma block corresponding to the current chrominance block, which are encoded with intra prediction; determine the first weight coefficient and the second weight coefficient according to the number of neighboring blocks that are intra prediction encoded; apply a first weight to the inter-prediction block and a second weight to the intra-prediction block; combine the first weighted inter-prediction block and the second weighted intra-prediction block to generate a prediction block for the current chrominance block; and encode the current chrominance block using a prediction block.

[0139] FIG. 5 is a block diagram illustrating an example video decoder 300 that may implement the techniques of this disclosure. Fig. 5 is provided for explanatory purposes and is not intended to be limiting of the technologies illustrated and described generally in this disclosure. For purposes of explanation, this disclosure describes a video decoder 300 according to JEM, VVC and HEVC technologies. However, the techniques of this disclosure may be performed by video encoding devices that are configured for other video encoding standards.

[0140] In the example of FIG. 5, video decoder 300 includes a coded picture buffer (CPB) 320, an entropy decoding unit 302, a prediction processing unit 304, an inverse quantization unit 306, an inverse transform processing unit 308, a restoration unit 310, a filtering unit 312, and a decoded picture buffer 314. (DPB). Any of the CPB memory device 320, entropy decoding module 302, prediction processing module 304, inverse quantization module 306, inverse transform processing module 308, reconstruction module 310, filtering module 312, and DPB 314 may be implemented in one or more processors or processing circuitry. . In addition, video decoder 300 may include additional or alternative processors or processing circuitry to perform these and other functions.

[0141] The prediction processing module 304 includes a motion compensation module 316 and an internal prediction module 318 . The prediction processing module 304 may include additional modules to perform prediction in accordance with other prediction modes. As an example, prediction processing module 304 may include a palette processing module, an intra-block copy module (which may be part of motion compensation module 316), an affine processing module, a linear model (LM) processing module, and the like. In other examples, video decoder 300 may include more, fewer, or other functional components.

[0142] In some examples, prediction processing module 304 may select an inter-intra prediction mode. In such examples, the prediction processing module 304 may weigh the inter-prediction block generated by the motion compensation module 316 and the intra-prediction block generated by the intra-prediction module 318, according to any of the various techniques of this disclosure. The prediction processing unit 304 can generate a prediction block from the weighted inter-prediction and intra-prediction blocks and output the generated prediction block.

[0143] In accordance with the techniques of this disclosure, prediction processing module 304 can perform inter-intra prediction of video data blocks (eg, CUs). Thus, the prediction processing module 304 can generate a prediction block by causing the motion compensation module 316 to generate an inter-prediction block and the intra-prediction module 318 to generate an intra-prediction block. The prediction processing unit 304 may generate a final prediction block for the current block by performing weighted combination of samples of the inter-prediction block and the intra-prediction block. When the current block is a chroma block, the prediction processing unit 304 may determine weights for performing weighting prediction according to the number of neighboring blocks to the luma block corresponding to the current chroma block that are intra-prediction encoded. That is, instead of determining the weights according to neighboring blocks with respect to the current chroma block, the prediction processing unit 304 may determine the number of internally predicted blocks adjacent to the luma block corresponding to the current chroma block, then determine the weights based on the number of internally predicted blocks adjacent with brightness block.

[0144] As an example, prediction processing module 304 may determine whether or not a top adjacent block and/or a left adjacent block are mutually predicted with respect to a corresponding luminance block. When none of these neighboring blocks are mutually predicted, the prediction processing unit 304 may determine a weight of 3 to be applied to the intra-prediction block and a weight of 1 to be applied to the inter-prediction block. When both of these adjacent blocks are inter-predicted, the prediction processing unit 304 may determine a weight of 3 to be applied to the inter-prediction block and a weight of 1 to be applied to the intra-prediction block. When one of these neighboring blocks is inter-predicted and the other is internally predicted, prediction processing module 304 may determine weights of 2 to be applied to both the inter-prediction block and the intra-prediction block. In some examples, prediction processing module 304 may count neighboring blocks predicted using inter-intra prediction and/or intra-block copy as inter-prediction coded blocks.

[0145] The CPB storage device 320 may store video data, such as an encoded video bit stream, to be decoded by components of the video decoder 300. The video data stored in the CPB storage device 320 may be obtained, for example, from a computer-readable medium 110 (FIG. 1). . CPB storage device 320 may include a CPB that stores encoded video data (eg, syntax elements) from the encoded video bitstream. In addition, CPB storage device 320 may store video data other than syntax elements of the encoded picture, such as temporary data representing outputs from various modules of video decoder 300. DPB 314 generally stores decoded pictures that video decoder 300 may output and/or used as reference video data when decoding subsequent data or pictures of the encoded video bit stream. CPB memory 320 and DPB 314 may be formed by any of a variety of memory devices, for example, dynamic random access memory (DRAM), including synchronous DRAM (SDRAM), magnetoresistive RAM (MRAM), resistive RAM (RRAM), or other types of storage devices. CPB storage device 320 and DPB 314 may be provided by identical storage device or separate storage devices. In various examples, CPB storage device 320 may be on-chip with other components of video decoder 300 or off-chip with respect to those components.

[0146] Additionally or alternatively, in some examples, video decoder 300 may retrieve encoded video data from storage device 120 (FIG. 1). Thus, memory 120 may store data as explained above for CPB memory 320. Likewise, memory 120 may store instructions to be executed by video decoder 300 when part or all of the functionality of video decoder 300 is implemented in software to be executed by video decoder 300 processing circuits.

[0147] The various modules shown in FIG. 5 are illustrated to assist in understanding the operations performed by the video decoder 300. The modules may be implemented as fixed functional circuits, programmable circuits, or a combination of the above. Similar to Fig. 4, fixed function circuits mean circuits that provide specific functionality and are preset regarding the operations that can be performed. Programmable circuits mean circuits that can be programmed to perform various tasks and provide flexible functionality in the operations that can be performed. For example, programmable circuits may execute software or firmware that instructs the programmable circuits to operate in a manner specified by software or firmware instructions. Fixed function diagrams can execute program instructions (for example, to accept parameters or output parameters), but the types of operations that fixed function diagrams perform are generally immutable. In some examples, one or more modules may be various circuit blocks (fixed function or programmable), and in some examples, one or more modules may be integrated circuits.

[0148] Video decoder 300 may include ALUs, EFUs, digital circuits, analog circuits, and/or programmable cores formed from programmable circuits. In examples in which the operations of the video decoder 300 are performed by software running in programmable circuits, on-chip or off-chip memory may store instructions (e.g., object code) of the software that the video decoder 300 receives and executes.

[0149] Entropy decoding module 302 may receive encoded video data from the CPB and entropy decode the video data to reproduce syntax elements. The prediction processing unit 304, the inverse quantization unit 306, the inverse transform processing unit 308, the restoration unit 310, and the filtering unit 312 may generate decoded video data based on syntactic elements extracted from the bitstream.

[0150] In general, video decoder 300 reconstructs a picture on a block-by-block basis. Video decoder 300 may perform the reconstruction operation on a block-by-block basis (wherein the block currently being reconstructed, ie, being decoded, may be referred to as the "current block").

[0151] Entropy decoding module 302 may entropy decode syntax elements defining quantized transform coefficients of a block of quantized transform coefficients, as well as transform information such as quantization parameter (QP) and/or transform mode indicator(s). The inverse quantization module 306 may use the QP associated with the block of quantized transform coefficients to determine the degree of quantization and, likewise, the degree of inverse quantization for the inverse quantization module 306 to be applied. Inverse quantization module 306, for example, may perform a bit left shift operation to inversely quantize the quantized transform coefficients. The inverse quantization unit 306 can therefore generate a transform coefficient block including transform coefficients.

[0152] After the inverse quantization unit 306 generates a block of transform coefficients, the inverse transform processing unit 308 may apply one or more inverse transforms to the block of transform coefficients to generate a residual block associated with the current block. For example, inverse transform processing module 308 may apply an inverse DCT, inverse integer transform, inverse Karhunen-Loeve transform (KLT), inverse rotational transform, inverse directional transform, or other inverse transform to the block of coefficients.

[0153] In addition, the prediction processing unit 304 generates a prediction block according to syntax elements with prediction information that are entropy decoded by the entropy decoding unit 302. For example, if syntax elements with prediction information indicate that the current block is mutually predicted, motion compensation module 316 may generate the prediction block. In this case, the syntax elements with the prediction information may indicate a reference picture in the DPB 314 from which a reference block can be retrieved, as well as a motion vector identifying the location of the reference block in the reference picture relative to the location of the current block in the current picture. The motion compensation module 316 can generally perform the inter-prediction process in a manner that is substantially similar to the method described with respect to the motion compensation module 224 (FIG. 4).

[0154] As another example, if the prediction information syntax elements indicate that the current block is internally predicted, the intra prediction module 318 may generate the prediction block according to the intra prediction mode indicated by the prediction information syntax elements. On the other hand, the intra prediction module 318 can generally perform the intra prediction process in a manner that is substantially similar to the method described with respect to the intra prediction module 226 (FIG. 4). The intra prediction module 318 may retrieve data from neighboring samples relative to the current block from the DPB 314.

[0155] The recovery module 310 may recover the current block using the prediction block and the residual block. For example, reconstruction module 310 may sum the residual block samples with the corresponding prediction block samples to reconstruct the current block.

[0156] Filtering module 312 may perform one or more filtering operations on the reconstructed blocks. For example, filtering module 312 may perform deblocking operations to reduce blocking artifacts along the edges of reconstructed blocks. The operations of filtering module 312 are not necessarily performed in all examples.

[0157] The video decoder 300 may store the reconstructed blocks in the DPB 314. As explained above, the DPB 314 may provide reference information, such as samples of the current picture for intra prediction and previously decoded pictures for subsequent motion compensation, to the prediction processing module 304. In addition, video decoder 300 may output decoded pictures from the DPB for subsequent presentation on a display device, such as display device 118 of FIG. 1.

[0158] Video decoder 300 of FIG. 5 represents an example of a video encoding apparatus comprising one or more processors configured to generate an inter-prediction block for a current block of video data; generate an internal prediction block for the current block of video data; apply a first weight to the inter-prediction block and a second weight to the intra-prediction block; combine the first weighted inter-prediction block and the second weighted intra-prediction block to generate a prediction block for the current block; and encode (ie, decode, in this example) the current block using the prediction block.

[0159] Video decoder 300 also provides an example of a device for encoding video data, comprising one or more processors configured to generate an inter-prediction block for a current chrominance block of video data; generate an internal prediction block for the current color block of video data; determine the number of neighboring blocks with respect to the luma block corresponding to the current chrominance block, which are encoded with intra prediction; determine the first weight coefficient and the second weight coefficient according to the number of neighboring blocks that are intra prediction encoded; apply a first weight to the inter-prediction block and a second weight to the intra-prediction block; combine the first weighted inter-prediction block and the second weighted intra-prediction block to generate a prediction block for the current chrominance block; and encode the current chrominance block using a prediction block.

[0160] FIG. 6 is a flowchart illustrating an exemplary method for encoding a current block in accordance with the technology of this disclosure. The current block may contain the current CU. Although described in relation to video encoder 200 (FIGS. 1 and 4), it should be understood that other devices may be configured to perform a method similar to the method of FIGS. 6.

[0161] In this example, video encoder 200 initially predicts the current block (350). For example, video encoder 200 may generate a prediction block for the current block using inter-intra prediction according to the techniques of this disclosure. Video encoder 200 may then calculate a residual block for the current block (352). To calculate a residual block, video encoder 200 may calculate the difference between the original, uncoded block and the prediction block for the current block. Video encoder 200 may then transform and quantize the coefficients of the residual block (354). Next, video encoder 200 may scan the quantized transform coefficients of the residual block (356). During or after scanning, video encoder 200 may entropy encode the coefficients (358). For example, video encoder 200 may encode the coefficients using CAVLC or CABAC. Video encoder 200 may then output entropy encoded block data (360).

[0162] Thus, the method of FIG. 6 represents an example of a method including generating an inter-prediction block for a current video data block; generating an internal prediction block for the current block of video data; applying a first weight coefficient to the inter-prediction block and a second weight coefficient to the intra-prediction block; combining the first weighted inter-prediction block and the second weighted intra-prediction block to form a prediction block for the current block; and encoding (ie, encoding) the current block using the prediction block.

[0163] FIG. 7 is a flowchart illustrating an exemplary method for decoding a current block in accordance with the techniques of this disclosure. The current block may contain the current CU. Although described in relation to video decoder 300 (FIGS. 1 and 5), it should be understood that other devices may be configured to perform a method similar to the method of FIGS. 7.

[0164] Video decoder 300 may receive entropy encoded data for the current block, eg, entropy encoded prediction information and entropy encoded data for coefficients of a residual block corresponding to the current block (370). Video decoder 300 may entropy decode the entropy encoded data to determine prediction information for the current block and reproduce coefficients of the residual block (372). Video decoder 300 may predict the current block (374), for example, using an inter-intra prediction mode according to the techniques of this disclosure, as indicated by the prediction information for the current block, to calculate a prediction block for the current block. Video decoder 300 may then backscan the reproduced coefficients (376) to create a block of quantized transform coefficients. Video decoder 300 can then dequantize and deconvert the coefficients to generate a residual block (378). Video decoder 300 may ultimately decode the current block by combining a prediction block and a residual block (380).

[0165] Thus, the method of FIG. 7 represents an example of a method including generating an inter-prediction block for a current video data block; generating an internal prediction block for the current block of video data; applying a first weight coefficient to the inter-prediction block and a second weight coefficient to the intra-prediction block; combining the first weighted inter-prediction block and the second weighted intra-prediction block to form a prediction block for the current block; and encoding (ie, decoding) the current block using the prediction block.

[0166] FIG. 8 is a flowchart illustrating an exemplary method for encoding (encoding or decoding) video data according to the technologies of this disclosure. For purposes of example and explanation, the method of FIG. 8 is explained with respect to the video decoder 300 of FIG. 1 and 5, although video encoder 200 of FIG. 1 and 4 or other video encoding devices may implement this or a similar method. The method according to FIG. 8 may be performed by video encoder 200 in predicting the current chrominance block, for example, at step 350 of the method of FIG. 6, or by video decoder 300 when predicting the current chrominance block, for example, at step 374 of FIG. 7.

[0167] Initially, video decoder 300 generates an inter-prediction block for the current chrominance block (400). Video decoder 300 may also generate an intra prediction block for the current chrominance block (402). Video decoder 300 may then determine a luma block corresponding to the chrominance block (404), for example, a luma block that is co-located with the chrominance block in the luma array.

[0168] Video decoder 300 can then determine neighboring block prediction modes relative to the luminance block (406). For example, video decoder 300 may determine the prediction modes of the top neighbor block 142 and the left neighbor block 144 of FIG. 3A, the upper right adjacent block 148 and the lower left adjacent block 150 of FIG. 3B, etc. according to other examples of adjacent blocks, as shown in FIG. 3A-3F. Video decoder 300 may also determine the number of internally predicted neighboring blocks relative to the luminance block (408). Alternatively, video decoder 300 may determine the number of mutually predicted neighboring blocks with respect to the luminance block.

[0169] Video decoder 300 may also determine weights to be applied to the inter-prediction block and the intra-prediction block according to the number of intra-predicted neighboring blocks with respect to the luminance block (410). If there are more inter-prediction blocks than intra-prediction blocks, video decoder 300 may determine that the weight to be applied to the inter-prediction block is greater than the weight to be applied to the intra-prediction block. For example, the weight to be applied to the inter-prediction block may be 3, and the weight to be applied to the intra-prediction block may be 1. If the number of intra-prediction blocks exceeds the number of inter-prediction blocks, video decoder 300 may determine that the weight to be applied to the intra prediction block is greater than the weight to be applied to the inter prediction block. For example, the weight to be applied to the intra prediction block may be 3, and the weight to be applied to the inter prediction block may be 1. If the numbers of intra and inter prediction blocks are identical, the weights may be equal eg 2 for each of them.

[0170] Video decoder 300 may then combine the inter-prediction block and the intra-prediction block using weights to generate a prediction block for the current chrominance block (412). Video decoder 300 may then encode the current chrominance block using a prediction block (414).

[0171] Thus, the method of FIG. 8 represents an example of a method for encoding video data, the method comprising generating an inter-prediction block for a current chrominance block of video data; generating an internal prediction block for the current color block of video data; determining the number of neighboring blocks with respect to the luma block corresponding to the current chrominance block, which are intra-prediction encoded; determining a first weight coefficient and a second weight coefficient according to the number of neighboring blocks that are intra prediction encoded; applying a first weight coefficient to the inter-prediction block and a second weight coefficient to the intra-prediction block; combining the first weighted inter-prediction block and the second weighted intra-prediction block to form a prediction block for the current chrominance block; and encoding the current chrominance block using the prediction block.

[0172] Certain techniques of this disclosure are summarized in the examples below.

[0173] Example 1: A method for encoding video data, the method comprising: generating an inter-prediction block for a current block of video data; generating an internal prediction block for the current block of video data; applying a first weight coefficient to the inter-prediction block and a second weight coefficient to the intra-prediction block; combining the first weighted inter-prediction block and the second weighted intra-prediction block to form a prediction block for the current block; and encoding the current block using the prediction block.

[0174] Example 2: The method of Example 1, wherein encoding the current block comprises decoding the current block, comprising: decoding a residual block for the current block; and combining the samples of the residual block with the samples of the prediction block.

[0175] Example 3: The method as in any one of Examples 1 and 2, wherein the encoding of the current block comprises encoding the current block comprising: subtracting prediction block samples from the current block samples to form a residual block; and encoding the residual block.

[0176] Example 4: The method as in any one of Examples 1-3, further comprising determining the first weight coefficient and the second weight coefficient according to the number of internally coded neighboring blocks with respect to the current block.

[0177] Example 5: The method of Example 4, wherein the adjacent blocks include an upper adjacent block.

[0178] Example 6: The method of any one of Examples 4 and 5, wherein the adjacent blocks include a left adjacent block.

[0179] Example 7: The method of any one of Examples 4-6, wherein the adjacent blocks include a right upper adjacent block.

[0180] Example 8: The method as in any one of Examples 4-7, wherein the adjacent blocks include a lower left adjacent block.

[0181] Example 9: The method of any one of Examples 4-8, wherein the adjacent blocks include a left upper adjacent block.

[0182] Example 10: The method as in any one of Examples 4-9, further comprising determining adjacent blocks according to the height of the current block and the width of the current block.

[0183] Example 11: The method of Example 10, wherein when the height and width are equal, the adjacent blocks include a right upper adjacent block and a left lower adjacent block.

[0184] Example 12: The method of Example 11, wherein the adjacent blocks further include an upper adjacent block and a left adjacent block.

[0185] Example 13: The method of Example 12, wherein the adjacent blocks further include a left upper adjacent block.

[0186] Example 14: The method as in any one of Examples 10-13, wherein, when the height and width are different, the adjacent blocks include a right upper adjacent block and a left lower adjacent block.

[0187] Example 15: The method of Example 10, in which, when the height and width are equal, adjacent blocks are symmetrical along the width and height dimensions of the current block, and when the height and width are not equal, adjacent blocks are asymmetrical along the width and height dimensions height of the current block.

[0188] Example 16: The method of Example 15, wherein when the width exceeds the height, the adjacent blocks include a right upper adjacent block and a left adjacent block, and when the height exceeds the width, the adjacent blocks include an upper adjacent block and a lower left adjacent block.

[0189] Example 17: The method of any one of Examples 4-16, further comprising determining that one of the adjacent blocks that is encoded with intra-block copy or encoded based on current picture references is a cross-encoded block.

[0190] Example 18: The method of any one of Examples 4-16, further comprising determining that one of the adjacent blocks that is encoded with intra-block copy or encoded based on references to current pictures is an intra-encoded block.

[0191] Example 19: The method of any one of Examples 4-18, further comprising determining that one of the adjacent blocks that is inter-intra-encoded is an inter-encoded block.

[0192] Example 20: The method of any one of Examples 4-18, further comprising determining that one of the adjacent blocks that is inter-intra-coded is an intra-coded block.

[0193] Example 21: The method as in any one of Examples 4-20, wherein determining the first weight and the second weight comprises selecting the second weight to be greater than the first weight when all adjacent blocks are internally encoded.

[0194] Example 22: The method as in any one of Examples 4-21, wherein determining the first weight and the second weight comprises selecting the first weight to be greater than the second weight when at least one of the adjacent blocks is not internally encoded.

[0195] Example 23: The method as in any one of Examples 4-22, wherein determining the first weight and the second weight comprises selecting the first weight to be equal to the second weight when only one of the adjacent blocks is internally encoded.

[0196] Example 24: The method as in any one of Examples 4-23, wherein determining the first weight coefficient and the second weight coefficient comprises selecting the first weight coefficient as equal to 1 and the second weight coefficient as equal to 3 when the upper left adjacent block, the upper right adjacent block and the lower left adjacent block in the current block are internally encoded.

[0197] Example 25: The method as in any one of Examples 4-23, wherein determining the first weight coefficient and the second weight coefficient comprises selecting the first weight coefficient as equal to 3 and the second weight coefficient as equal to 5 when the upper left adjacent block, the upper right adjacent block and the lower left adjacent block in the current block are internally encoded.

[0198] Example 26: The method as in any one of Examples 4-25, wherein determining the first weight coefficient and the second weight coefficient comprises selecting the first weight coefficient as equal to 2 and the second weight coefficient as equal to 2 when at least one of the left top adjacent block, top right neighbor block, or bottom left neighbor block to the current block is internally encoded.

[0199] Example 27: The method as in any one of Examples 4-25, wherein determining the first weight coefficient and the second weight coefficient comprises selecting the first weight coefficient as equal to 4 and the second weight coefficient as equal to 4 when at least one of the left top adjacent block, top right neighbor block, or bottom left neighbor block to the current block is internally encoded.

[0200] Example 28: The method as in any one of Examples 4-27, wherein determining the first weight coefficient and the second weight coefficient comprises selecting the first weight coefficient as equal to 3 and the second weight coefficient as equal to 1 when none of the upper left adjacent block, the upper right adjacent block and the lower left adjacent block with respect to the current block are not internally encoded.

[0201] Example 29: The method as in any one of Examples 4-27, wherein determining the first weight coefficient and the second weight coefficient comprises selecting the first weight coefficient as equal to 5 and the second weight coefficient as equal to 3 when none of the upper left adjacent block, the upper right adjacent block and the lower left adjacent block with respect to the current block are not internally encoded.

[0202] Example 30: The method as in any one of Examples 4-29, wherein determining the first weight and the second weight comprises copying the first weight and the second weight from one of the adjacent blocks that is multi-hypothesis internally encoded.

[0203] Example 31: The method as in any one of Examples 4-30, wherein determining the first weight coefficient and the second weight coefficient comprises selecting the second weight coefficient to be greater than the first ratio when only one of the adjacent blocks is internally encoded.

[0204] Example 32: The method of Example 31, wherein the second weighting factor is 3 and the first weighting factor is 1.

[0205] Example 33: The method of Example 31, wherein the second weighting factor is 5 and the first weighting factor is 3.

[0206] Example 34: The method as in any one of Examples 4-30, wherein determining the first weight coefficient and the second weight coefficient comprises selecting the first weight coefficient to be greater than the second ratio when only one of the adjacent blocks is internally encoded.

[0207] Example 35: The method of Example 34, wherein the first weighting factor is 3 and the second weighting factor is 1.

[0208] Example 36: The method of Example 34, wherein the first weighting factor is 5 and the second weighting factor is 3.

[0209] Example 37: The method as in any one of Examples 4-30, wherein determining the first weight coefficient and the second weight coefficient comprises selecting the second weight coefficient to be greater than the first ratio when none of the adjacent blocks are internally encoded.

[0210] Example 38: The method of Example 37, wherein the second weighting factor is 3 and the first weighting factor is 1.

[0211] Example 39: The method of Example 37, wherein the second weighting factor is 5 and the first weighting factor is 3.

[0212] Example 40: The method as in any one of Examples 4-30, wherein determining the first weight coefficient and the second weight coefficient comprises selecting the second weight coefficient to be greater than the first ratio when at least one of the adjacent blocks is predicted using an internal DC -mode or planar mode.

[0213] Example 41: The method of Example 40, wherein the second weighting factor is 3 and the first weighting factor is 1.

[0214] Example 42: The method of Example 40, wherein the second weighting factor is 5 and the first weighting factor is 3.

[0215] Example 43: The method as in any one of Examples 1-42, further comprising determining a first weight and a second weight according to a luminance signal block of one of the adjacent blocks, when one of the adjacent blocks has a single luminance and chroma coding tree or a dual tree enabled brightness and color coding.

[0216] Example 44: The method as in any one of Examples 1-43, further comprising determining a first weight and a second weight according to a chroma block of one of the adjacent blocks when one of the adjacent blocks has a dual luma and chroma coding tree enabled.

[0217] Example 45: The method as in any one of Examples 1-44, further comprising determining the first weight coefficient and the second weight coefficient according to the inter-prediction number of the indexed merge block.

[0218] Example 46: The method of Example 45, wherein determining the first weight coefficient and the second weight coefficient comprises setting the first weight coefficient higher than the second weight coefficient when the indexed combine block is a bi-prediction.

[0219] Example 47: The method of Example 46, wherein the first weighting factor is 3 and the second weighting factor is 1.

[0220] Example 48: The method of Example 46, wherein the first weighting factor is 5 and the second weighting factor is 3.

[0221] Example 49: The method of any one of Examples 46-48, wherein the determination of the first weight coefficient and the second weight coefficient comprises the determination of the first weight coefficient and the second weight coefficient according to one of Examples 4-42, when the indexed combine block is a uniprediction.

[0222] Example 50: The method of Example 45, wherein determining the first weight coefficient and the second weight coefficient comprises setting the first weight coefficient higher than the second weight coefficient when the indexed combine block is a uniprediction.

[0223] Example 51: The method of Example 50, wherein the first weighting factor is 3 and the second weighting factor is 1.

[0224] Example 52: The method of Example 50, wherein the first weighting factor is 5 and the second weighting factor is 3.

[0225] Example 53: The method as in any one of Examples 1-52, further comprising determining a first weighting factor and a second weighting factor according to the size of the current block.

[0226] Example 54: The method of Example 53, wherein the size of the current block contains the minimum of the width of the current block and the height of the current block.

[0227] Example 55: The method of Example 53, wherein the size of the current block contains the maximum of the width of the current block and the height of the current block.

[0228] Example 56: The method of Example 53, wherein the size of the current block comprises the product of the width of the current block and the height of the current block.

[0229] Example 57: The method of Example 53, wherein the size of the current block contains the sum of the width of the current block and the height of the current block.

[0230] Example 58: The method as in any one of Examples 53-57, wherein determining the first weight coefficient and the second weight coefficient comprises setting the first weight coefficient higher than the second weight coefficient when the block size is higher than a predetermined threshold value.

[0231] Example 59: The method of Example 58, wherein the first weighting factor is 3 and the second weighting factor is 1.

[0232] Example 60: The method of Example 58, wherein the first weighting factor is 5 and the second weighting factor is 3.

[0233] Example 61: The method as in any one of Examples 53-57, wherein determining the first weight coefficient and the second weight coefficient comprises setting the second weight coefficient higher than the first weight coefficient when the block size is higher than a predetermined threshold value.

[0234] Example 62: The method of Example 61, wherein the second weighting factor is 3 and the first weighting factor is 1.

[0235] Example 63: The method of Example 61, wherein the second weighting factor is 5 and the first weighting factor is 3.

[0236] Example 64: The method as in any one of Examples 53-57, wherein determining the first weight coefficient and the second weight coefficient comprises setting the first weight coefficient above the second weight coefficient when the block size is below a predetermined threshold value.

[0237] Example 65: The method of Example 64, wherein the first weighting factor is 3 and the second weighting factor is 1.

[0238] Example 66: The method of Example 64, wherein the first weighting factor is 5 and the second weighting factor is 3.

[0239] Example 67: The method as in any one of Examples 53-57, wherein determining the first weight coefficient and the second weight coefficient comprises setting the second weight coefficient higher than the first weight coefficient when the block size is below a predetermined threshold value.

[0240] Example 68: The method of Example 67, wherein the second weighting factor is 3 and the first weighting factor is 1.

[0241] Example 69: The method of Example 67, wherein the second weighting factor is 5 and the first weighting factor is 3.

[0242] Example 70: The method of any one of Examples 1-69, further comprising encoding data of a bit stream representing the first weight and the second weight.

[0243] Example 71: The method of Example 70, wherein the bitstream data comprises at least one of a sequence parameter set, a picture parameter set, an adaptation parameter set, a video parameter set, a picture header, a slice header, a tile header, or a header block.

[0244] Example 72: An apparatus for encoding video data, the apparatus comprising one or more means for implementing the method of any one of Examples 1-71.

[0245] Example 73: The apparatus of Example 72, wherein the one or more means comprise one or more processors implemented in the circuit.

[0246] Example 74: The apparatus of Example 72 further comprising a display configured to display decoded video data.

[0247] Example 75: The device of Example 72, wherein the device comprises one or more of a camera, a computer, a mobile device, a broadcast receiver, or a set-top box.

[0248] Example 76: The apparatus of Example 72 further comprising a storage device configured to store video data.

[0249] Example 77: An apparatus for encoding video data, the apparatus comprising: means for generating an inter-prediction block for a current block of video data; means for generating an internal prediction block for the current block of video data; means for applying a first weight to the inter-prediction block and a second weight to the intra-prediction block; means for combining the first weighted inter-prediction block and the second weighted intra-prediction block to generate a prediction block for the current block; and means for encoding the current block using the prediction block.

[0250] Example 78: A computer-readable storage medium having stored instructions that, when executed, instruct a processor to carry out the method of any of Examples 1-71.

[0251] It is recognized that, depending on the example, certain steps or events of any of the technologies described herein may be performed in a different sequence, may be added, combined, or omitted altogether (for example, not all steps or events described are required to practical implementation of technologies). Additionally, in certain examples, steps or events may be executed concurrently, such as through multithreading, interrupt processing, or across multiple processors, rather than sequentially.

[0252] In one or more examples, the described functions may be implemented in hardware, software, firmware, or any combination thereof. When implemented in software, the functions may be stored or transmitted, as one or more instructions or code, on a computer-readable medium and executed by a hardware processing unit. Computer-readable media may include computer-readable storage media that corresponds to a tangible medium, such as storage media, or communication media, including any medium that facilitates the transfer of a computer program from one location to another, such as according to a communications protocol. Thus, computer-readable media may generally correspond to (1) a tangible computer-readable storage medium that is non-volatile, or (2) a communication medium such as a signal or carrier. Storage media can be any available media that can be accessed by one or more computers or one or more processors to retrieve instructions, code and/or data structures to implement the technologies described in this disclosure. The computer program product may include a machine-readable medium.

[0253] By way of example, and not limitation, these computer readable storage media may include RAM, ROM, EEPROM, CD-ROM or other optical disk storage device, magnetic disk storage device or other magnetic storage devices, flash memory or any other medium that can be used to store required program code in the form of instructions or data structures and that can be accessed by a computer. In addition, any connection is correctly called a machine-readable medium. For example, if instructions are transmitted from a Web site, server, or other remote source using coaxial cable, fiber optic cable, twisted pair cable, digital subscriber line (DSL), or wireless technologies such as infrared, radio, and microwave media, then coaxial cable , fiber optic cable, twisted pair, DSL or wireless technologies such as infrared, radio and microwave media are included in the definition of media. However, it should be understood that computer-readable storage media and storage media do not include connections, carriers, signals or other volatile media, but are instead directed to non-volatile tangible storage media. Disk and disc as used herein include compact disc (CD), laser disc, optical disc, digital versatile disc (DVD), floppy disk and Blu-ray disc, wherein disc ) typically reproduce data magnetically, while discs (discs) typically reproduce data optically using lasers. Combinations of the above should also be included among machine-readable media.

[0254] The instructions may be executed by one or more processors, such as one or more digital signal processors (DSPs), general purpose microprocessors, application specific integrated circuits (ASICs), field programmable gate arrays (FPGAs), or other equivalent integrated or discrete logic circuits . Accordingly, the terms "processor" and "processing circuitry" as used herein can mean any of the above structures or any other structure suitable for implementing the technologies described herein. Additionally, in some aspects, the functionality described herein may be provided within specialized hardware and/or software modules configured to encode or decode, or embedded within a combination codec. In addition, technologies may be implemented entirely in one or more circuits or logic elements.

[0255] The technologies of this disclosure may be implemented in a wide variety of devices or equipment, including a wireless handset, an integrated circuit (IC), or a set of ICs (eg, a chipset). Various components, modules, or blocks are described in this disclosure to highlight the functional aspects of devices configured to implement the disclosed technologies, but do not necessarily require implementation through various hardware modules. Conversely, as described above, various modules may be combined into a codec hardware module or provided through a set of interoperable hardware modules including one or more processors as described above in combination with appropriate software and/or firmware.

[0256] Various examples are described above. These and other examples are within the scope of the appended claims.

Claims (90)

1. A method for encoding video data, the method comprising the steps of: forming a mutual prediction block for the current color block of video data; forming an internal prediction block for the current color block of video data; determining the number of neighboring blocks with respect to the luma block corresponding to the current chrominance block, which are encoded with intra prediction; determining a first weight coefficient and a second weight coefficient according to the number of neighboring blocks that are intra prediction encoded; applying a first weight coefficient to the inter-prediction block and a second weight coefficient to the intra-prediction block; combining the first weighted inter-prediction block and the second weighted intra-prediction block to generate a prediction block for the current chrominance block; And encode the current chrominance block using a prediction block. 2. The method of claim 1, wherein determining the number of neighboring blocks that are intra-prediction encoded comprises determining that the number of neighboring blocks that are intra-prediction encoded excludes neighboring blocks that are predicted using intra-block copying or combined intra-cross forecasting. 3. The method of claim 1, wherein determining the number of neighboring blocks that are intra prediction encoded comprises determining that the number of neighboring blocks that are intra prediction encoded excludes neighboring blocks that are predicted using a combined mutual -internal forecasting. 4. The method of claim 1, wherein determining the first weight coefficient and the second weight coefficient further comprises determining the first weight coefficient and the second weight coefficient according to the luminance block of one of the neighboring blocks when one of the neighboring blocks has a single coding tree activated luminance and chrominance or a dual luminance and chrominance coding tree. 5. The method of claim 1, wherein the adjacent blocks include an upper adjacent block and a left adjacent block. 6. The method of claim 1, wherein determining the first weight coefficient and the second weight coefficient comprises determining the first weight coefficient and the second weight coefficient according to whether the indexed merge block is predicted using unidirectional prediction or bidirectional prediction. 7. The method of claim 1, wherein determining the first weight coefficient and the second weight coefficient comprises determining the first weight coefficient and the second weight coefficient according to the size of the current chromaticity block. 8. The method of claim 1, further comprising encoding data of a bit stream representing the first weight coefficient and the second weight coefficient. 9. The method of claim 8, wherein the bitstream data comprises at least one of a sequence parameter set, a picture parameter set, an adaptation parameter set, a video parameter set, a picture header, a slice header, a tile header, or a block header. 10. The method of claim 1, wherein encoding the current chrominance block comprises decoding the current chrominance block comprising the steps of: decoding a residual block for the current chrominance block; And combining the samples of the residual block with the samples of the prediction block. 11. The method of claim 1, wherein encoding the current chrominance block comprises encoding the current chrominance block comprising the steps of: subtracting the prediction block samples from the current chrominance block samples to form a residual block; And encode the residual block. 12. A device for encoding video data, wherein the device contains: a storage device for storing video data; And one or more processors implemented in the circuit and configured to: generate a mutual prediction block for the current color block of video data; generate an internal prediction block for the current color block of video data; determine the number of neighboring blocks with respect to the luma block corresponding to the current chrominance block, which are encoded with intra prediction; determine the first weight coefficient and the second weight coefficient according to the number of neighboring blocks that are intra prediction encoded; apply a first weight to the inter-prediction block and a second weight to the intra-prediction block; combine the first weighted inter-prediction block and the second weighted intra-prediction block to generate a prediction block for the current chrominance block; And encode the current chrominance block using a prediction block. 13. The apparatus of claim 12, wherein the one or more processors are configured to determine that the number of neighboring blocks that are encoded with intra-prediction excludes neighboring blocks that are predicted using intra-block copying or combined intra-inter prediction. 14. The apparatus of claim 12, wherein the one or more processors are configured to determine that the number of neighboring blocks that are encoded with intra prediction excludes neighboring blocks that are predicted using combined inter-intra prediction. 15. The apparatus of claim 12, wherein the one or more processors are configured to determine the first weight and the second weight according to a luminance block of one of the adjacent blocks when one of the adjacent blocks has a single luma and chrominance coding tree or a dual coding tree enabled brightness and color. 16. The apparatus of claim 12, wherein the adjacent blocks include an upper adjacent block and a left adjacent block. 17. The apparatus of claim 12, wherein the one or more processors are configured to determine the first weight coefficient and the second weight coefficient according to whether the indexed merge block is predicted using unidirectional prediction or bidirectional prediction. 18. The apparatus of claim 12, wherein the one or more processors are configured to determine the first weight coefficient and the second weight coefficient according to the size of the current chroma block. 19. The apparatus of claim 12, wherein the one or more processors are further configured to encode data of a bitstream representing the first weight and the second weight. 20. The apparatus of claim 19, wherein the bitstream data comprises at least one of a sequence parameter set, a picture parameter set, an adaptation parameter set, a video parameter set, a picture header, a slice header, a tile header, or a block header. 21. The apparatus of claim 12, wherein one or more processors are configured to decode the current chroma block and, to decode the current chroma block, the one or more processors are configured to: decode the residual block for the current chrominance block; And combine samples from the residual block with samples from the prediction block. 22. The apparatus of claim 12, wherein one or more processors are configured to encode the current chroma block and, to encode the current chroma block, the one or more processors are configured to: subtract the prediction block samples from the current chrominance block samples to form a residual block; And encode the remainder block. 23. A computer-readable storage medium having stored instructions that, when executed, instruct a processor to: generate a mutual prediction block for the current color block of video data; generate an internal prediction block for the current color block of video data; determine the number of neighboring blocks with respect to the luma block corresponding to the current chrominance block, which are encoded with intra prediction; determine the first weight coefficient and the second weight coefficient according to the number of neighboring blocks that are intra prediction encoded; apply a first weight to the inter-prediction block and a second weight to the intra-prediction block; combine the first weighted inter-prediction block and the second weighted intra-prediction block to generate a prediction block for the current chrominance block; And encode the current chrominance block using a prediction block. 24. The computer-readable storage medium of claim 23, wherein the instructions that instruct the processor to determine the number of neighboring blocks that are intra-prediction encoded comprise instructions that instruct the processor to determine that the number of neighboring blocks that are intra-prediction encoded excludes the neighboring ones. blocks that are predicted using intra-block copying or combined intra-cross prediction. 25. The computer-readable storage medium of claim 23, wherein the instructions that instruct the processor to determine the number of neighboring blocks that are intra-predicted encoded comprise instructions that instruct the processor to determine that the number of neighboring blocks that are internally predicted excludes the neighboring blocks, which are predicted using combined inter-intraforecasting. 26. The computer-readable storage medium of claim 23, wherein the instructions that instruct the processor to determine the first weight and the second weight further comprise instructions that instruct the processor to determine the first weight and the second weight according to a luminance block of one of the adjacent blocks, when one of the adjacent blocks has a single luma-chroma tree or a dual luma-chroma tree activated. 27. The computer-readable storage medium of claim 23, wherein the adjacent blocks include an upper adjacent block and a left adjacent block. 28. The computer-readable storage medium of claim 23, wherein the instructions that instruct the processor to determine the first weight and the second weight comprise instructions that instruct the processor to determine the first weight and the second weight according to whether the indexed merge block is predicted with using unidirectional forecasting or bidirectional forecasting. 29. The computer-readable storage medium of claim 23, wherein the instructions that instruct the processor to determine the first weight and the second weight comprise instructions that instruct the processor to determine the first weight and the second weight according to the size of the current chroma block. 30. The computer-readable storage medium of claim 23, further comprising instructions that instruct the processor to encode data of a bitstream representing the first weight and the second weight. 31. The computer-readable storage medium of claim 30, wherein the bitstream data comprises at least one of a sequence parameter set, a picture parameter set, an adaptation parameter set, a video parameter set, a picture header, a slice header, a tile header, or a block header. 32. The computer-readable storage medium of claim 23, wherein the instructions that instruct the processor to encode the current chrominance block comprise instructions that instruct the processor to decode the current chroma block, wherein the instructions comprise instructions that instruct the processor: decode the residual block for the current chrominance block; And combine samples from the residual block with samples from the prediction block. 33. The computer-readable storage medium of claim 23, wherein the instructions that instruct the processor to encode the current chrominance block comprise instructions that instruct the processor to encode the current chroma block, wherein the instructions comprise instructions that instruct the processor: subtract the prediction block samples from the current chrominance block samples to form a residual block; And encode the remainder block. 34. A device for encoding video data, wherein the device contains: means for generating a mutual prediction block for the current chrominance block of video data; means for generating an internal prediction block for the current chrominance block of video data; means for determining the number of neighboring blocks with respect to the luma block corresponding to the current chrominance block that are intra-prediction encoded; means for determining a first weight coefficient and a second weight coefficient according to the number of neighboring blocks that are intra prediction encoded; means for applying a first weight to the inter-prediction block and a second weight to the intra-prediction block; means for combining the first weighted inter-prediction block and the second weighted intra-prediction block to generate a prediction block for the current chrominance block; And means for encoding the current chrominance block using a prediction block. 35. The apparatus of claim 34, wherein the means for determining the number of neighboring blocks that are intra-prediction encoded comprises means for determining that the number of neighboring blocks that are intra-prediction encoding excludes neighboring blocks that are predicted using intra-block copying. or combined intra-cross forecasting. 36. The apparatus of claim 34, wherein the means for determining the number of neighboring blocks that are intra prediction encoded comprises means for determining that the number of neighboring blocks that are intra prediction encoded excludes neighboring blocks that are predicted using a combined mutual -internal forecasting. 37. The apparatus of claim 34, wherein the means for determining the first weight coefficient and the second weight coefficient further comprises means for determining the first weight coefficient and the second weight coefficient according to a luminance block of one of the adjacent blocks when one of the adjacent blocks has a single coding tree activated luminance and chrominance or a dual luminance and chrominance coding tree. 38. The apparatus of claim 34, wherein the adjacent blocks include an upper adjacent block and a left adjacent block. 39. The apparatus of claim 34, wherein the means for determining the first weight coefficient and the second weight coefficient comprises means for determining the first weight coefficient and the second weight coefficient according to whether the indexed combine block is predicted using unidirectional prediction or bidirectional prediction. 40. The apparatus of claim 34, wherein the means for determining the first weight coefficient and the second weight coefficient comprises means for determining the first weight coefficient and the second weight coefficient according to the size of the current chroma block. 41. The apparatus of claim 34, further comprising means for encoding data of a bit stream representing the first weight coefficient and the second weight coefficient. 42. The apparatus of claim 41, wherein the bitstream data comprises at least one of a sequence parameter set, a picture parameter set, an adaptation parameter set, a video parameter set, a picture header, a slice header, a tile header, or a block header. 43. The apparatus of claim 34, wherein the means for encoding the current chrominance block comprises means for decoding the current chroma block, comprising: means for decoding a residual block for the current chrominance block; And means for combining the residual block samples with the prediction block samples. 44. The apparatus of claim 34, wherein the means for encoding the current chroma block comprises means for encoding the current chrominance block comprising: means for subtracting samples of the prediction block from samples of the current chrominance block to form a residual block; And means for encoding the residual block.

Images