[go: up one dir, main page]

WO2024154030A1 - Flexible gradual decoding refresh - Google Patents

Flexible gradual decoding refresh Download PDF

Info

Publication number
WO2024154030A1
WO2024154030A1 PCT/IB2024/050339 IB2024050339W WO2024154030A1 WO 2024154030 A1 WO2024154030 A1 WO 2024154030A1 IB 2024050339 W IB2024050339 W IB 2024050339W WO 2024154030 A1 WO2024154030 A1 WO 2024154030A1
Authority
WO
WIPO (PCT)
Prior art keywords
area
gdr
indication message
picture
information
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/IB2024/050339
Other languages
French (fr)
Inventor
Limin Wang
Seungwook Hong
Krit Panusopone
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Nokia Technologies Oy
Original Assignee
Nokia Technologies Oy
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nokia Technologies Oy filed Critical Nokia Technologies Oy
Priority to CN202480018247.8A priority Critical patent/CN120917734A/en
Priority to EP24701289.1A priority patent/EP4652730A1/en
Publication of WO2024154030A1 publication Critical patent/WO2024154030A1/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/103Selection of coding mode or of prediction mode
    • H04N19/107Selection of coding mode or of prediction mode between spatial and temporal predictive coding, e.g. picture refresh
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/167Position within a video image, e.g. region of interest [ROI]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/172Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a picture, frame or field
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/174Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a slice, e.g. a line of blocks or a group of blocks

Definitions

  • teachings in accordance with the exemplary embodiments of this invention relate generally to video coding, more specifically, relate to gradual decoding refresh.
  • Example 1 A method comprising: using a general gradual decoding refresh (GDR) technique, in which a refreshed area starts at any location in a gradual decoding refresh (GDR) picture and gradually expands over associated recovering picture.
  • GDR general gradual decoding refresh
  • the general GDR technique is used for a low-latency video.
  • Example 2 The method of example 1 further comprising: determining an area in a gradual decoding refresh (GDR) or recovering (GDR/recovering) picture; defining one or more virtual boundaries for the GDR/recovering picture, wherein the one or more virtual boundaries separate the GDR/recovering picture into two or more areas; associating an indication message or information with each of the one or more virtual boundaries, wherein the indication message or information specifies at least one of which side of the associated virtual boundary is in a refreshed area or which side in a non-refreshed area; and encoding and signaling the indication message or information to a decoder.
  • An example of the indication message or information include but is not limited to, a flag.
  • Example 3 A method comprising: receiving a gradual decoding refresh (GDR) or recovering (GDR/recovering) picture, wherein a refreshed area starts at any location in the gradual decoding refresh (GDR) picture and expands over the recovering picture.
  • GDR gradual decoding refresh
  • GDR/recovering recovering
  • Example 4 The method of example 3, wherein the GDR/recovering picture comprises one or more virtual boundaries, wherein the one or more virtual boundaries separate the GDR/recovering picture into two or more areas, and wherein the method further comprises; receiving an indication message or information associated with each of the one or more virtual boundaries, wherein the indication message or information specifies at least one of which side of each of the one or more virtual boundaries is in refreshed area or which side is in a non-refreshed area; and decoding the GDR/recovering picture based on the one or more virtual boundaries and associated indication message or information.
  • An example of the indication message or information include but is not limited to, a flag.
  • Example 5 The method of any of the previous examples, wherein when the indication message or information is equal to 1 specifies position or location of the refreshed area with respect to the virtual boundary associated with the indication message or information.
  • Example 6 The method of any of the previous examples, wherein when the indication message or information is equal to 0 specifies position or location of a non-refreshed area with respect to the virtual boundary associated with the indication message or information.
  • Example 7 The method of any of the previous examples, wherein the one or more virtual boundaries comprise one or more vertical virtual boundaries and/or one or more horizontal virtual boundaries.
  • Example 8 The method of example 7, wherein when the indication message or information is equal to 1 and is associated with a vertical virtual boundary, the indication message or information specifies that the area on left of the vertical virtual boundary is the refreshed area and the area on the right of the vertical virtual boundary is the non-refreshed area.
  • Example 9 The method of example 7, wherein when the indication message or information is equal to 1 and is associated with a horizontal virtual boundary, the indication message or information specifies that the area above the horizontal virtual boundary is the refreshed area and the area below the horizontal virtual boundary is the non-refreshed area.
  • Example 10 The method of example 7, wherein when the indication message or information is equal to 0 and is associated with a vertical virtual boundary, the indication message or information specifies that the area on left of the vertical virtual boundary is the non-refreshed area and the area on right of the vertical virtual boundary is the refreshed area.
  • Example 11 The method of example 7, wherein when the indication message or information is equal to 0 and is associated with a horizontal virtual boundary, the indication message or information specifies that the area above the horizontal virtual boundary is the non- refreshed area and the area below the horizontal virtual boundary is the refreshed area.
  • Example 12 An apparatus comprising: at least one processor; and at least one memory storing instructions that, when executed by the at least one processor, cause the apparatus at least to perform: using a general gradual decoding refresh (GDR) technique, in which a refreshed area starts at any location in a gradual decoding refresh (GDR) picture and gradually expands over associated recovering picture.
  • GDR general gradual decoding refresh
  • the general GDR technique is used for a low- latency video.
  • Example 13 The apparatus of example 12, wherein the apparatus is further caused to perform: determining an area in a gradual decoding refresh (GDR) or recovering (GDR/recovering) picture; defining one or more virtual boundaries for the GDR/recovering picture, wherein the one or more virtual boundaries separate the GDR/recovering picture into two or more areas; associating an indication message or information with each of the one or more virtual boundaries, wherein the indication message or information specifies at least one of which side of the associated virtual boundary is in a refreshed area or which side in a non-refreshed area; and encoding and signaling the indication message or information to a decoder.
  • GDR gradual decoding refresh
  • GDR/recovering recovering
  • Example 14 An apparatus comprising: at least one processor; and at least one memory storing instructions that, when executed by the at least one processor, cause the apparatus at least to perform: receiving a gradual decoding refresh (GDR) or recovering (GDR/recovering) picture, wherein a refreshed area starts at any location in the gradual decoding refresh (GDR) picture and expands over the recovering picture.
  • GDR gradual decoding refresh
  • GDR/recovering recovering
  • Example 15 The apparatus of example 14, wherein the GDR/recovering picture comprises one or more virtual boundaries, wherein the one or more virtual boundaries separate the GDR/recovering picture into two or more areas, wherein the apparatus is further caused to perform; receiving an indication message or information associated with each of the one or more virtual boundaries, wherein the indication message or information specifies at least one of which side of each of the one or more virtual boundaries is in the refreshed area or which side is in a non-refreshed area; and decoding the GDR/recovering picture based on the one or more virtual boundaries and associated indication message or information.
  • Example 16 The apparatus of any of the previous examples, wherein when the indication message or information is equal to 1 specifies position or location of the refreshed area with respect to the virtual boundary associated with the indication message or information.
  • Example 17 The apparatus of any of the previous examples, wherein when the indication message or information is equal to 0 specifies position or location of a non-refreshed area with respect to the virtual boundary associated with the indication message or information.
  • Example 18 The apparatus of any of the previous examples, wherein the one or more virtual boundaries comprise one or more vertical virtual boundaries and/or one or more horizontal virtual boundaries.
  • Example 19 The apparatus of example 14, wherein when the indication message or information is equal to 1 and is associated with a vertical virtual boundary, the indication message or information specifies that the area on left of the vertical virtual boundary is the refreshed area and the area on the right of the vertical virtual boundary is the non-refreshed area.
  • Example 20 The apparatus of example 14, wherein when the indication message or information is equal to 1 and is associated with a horizontal virtual boundary, the indication message or information specifies that the area above the horizontal virtual boundary is the refreshed area and the area below the horizontal virtual boundary is the non-refreshed area.
  • Example 21 The apparatus of example 14, wherein when the indication message or information is equal to 0 and is associated with a vertical virtual boundary, the indication message or information specifies that the area on left of the vertical virtual boundary is the non-refreshed area and the area on right of the vertical virtual boundary is the refreshed area.
  • Example 22 The apparatus of example 14, wherein when the indication message or information is equal to 0 and is associated with a horizontal virtual boundary, the indication message or information specifies that the area above the horizontal virtual boundary is the nonrefreshed area and the area below the horizontal virtual boundary is the refreshed area.
  • Example 23 A computer-readable medium encoded with instructions that, when executed by a computer, causing an apparatus to perform methods as described in any of the examples 1 to 11.
  • Example 24 The computer-readable medium of example 23, wherein the computer- readable medium comprises a non-transitory computer-readable medium.
  • Example 25 An apparatus comprising means for performing the methods as described in any of the examples 1 to 11.
  • FIG. 1 illustrates the basic concept of vertical GDR, where a refreshed area starts from left of a gradual decoding refresh (GDR) picture;
  • FIG. 2a and 2b show two possible examples of a GDR picture; where in FIG. 2a, a refreshed area starts in the middle of a GDR picture and expands to the left and the right of associated recovering pictures, and in FIG. 2b, a refreshed area starts in the center of a GDR picture and expands in all the four directions of associated recovering pictures,
  • FIG. 3 shows an example picture header syntax structure, in accordance with an embodiment
  • FIG. 4 shows an example, in which a central area is refreshed, in accordance with an embodiment
  • FIG. 5 shows an example of proposed syntax changes in a picture header structure syntax, in accordance with an embodiment
  • FIG. 6 is an example apparatus, which may be implemented in hardware, and caused to implement the examples described herein;
  • FIG. 7 shows a schematic representation of non-volatile memory media
  • FIG. 8 is an example method to implement the examples described herein, in accordance with an embodiment
  • FIG. 9 is an example method to implement the examples described herein, in accordance with another embodiment.
  • FIG. 10 is an example method to implement the examples described herein, in accordance with yet another embodiment
  • FIG. 11 is an example method to implement the examples described herein, in accordance with still another embodiment.
  • FIG. 12 shows a block diagram of one possible and non-limiting exemplary system in which the exemplary embodiments may be practiced.
  • GDR gradual decoding refresh
  • a coded video sequence may include intra coded pictures (e.g., I picture) and inter coded pictures (e.g., P and B pictures).
  • Intra coded pictures usually use many more bits than inter coded pictures. Transmission time of such intra coded pictures increases the encoder to decoder delay. For (ultra) low-delay applications, it is desirable that all the coded pictures have similar number of bits so that the encoder to decoder delay may be reduced to around 1 picture interval. Hence, intra coded picture may not be a fit for (ultra) low-delay applications. However, on the other hand, an intra coded picture is indeed needed at random access point.
  • Gradual decoding refresh (GDR) approaches alleviate the delay issue with intra coded pictures. Instead of coding an intra picture at a random access point, GDR progressively refreshes pictures over several pictures.
  • FIG. 1 illustrates the basic concept of vertical GDR, where a refreshed area starts from the left of a picture and gradually expands over a few following pictures.
  • the first picture is a GDR picture 106 and the last picture is a recovery point picture 116.
  • Pictures between a GDR picture and its recovery point picture are called associated recovering pictures, for example, recovering picture 115.
  • FIG. 1 in some versatile video coding (VVC)Zenhanced compression model (ECM) software implementations, GDR starts with a refreshed area 102 at a left side 104 of the GDR picture 106, and then gradually expands the refreshed area 102 (e.g., expanded refreshed area 109 and 113) to the right of the associated recovering picture(s) 115.
  • VVC versatile video coding
  • ECM enhanced compression model
  • a virtual boundary included in picture header is used to separate refreshed area and non-refreshed area of a GDR/recovering picture.
  • a virtual boundary 117 is used to separate refreshed area 102 and non-refreshed area 114 of the GDR picture 106
  • a virtual boundary 118 is used to separate refreshed area 108 and non-refreshed area 119 of the recovering picture 115.
  • FIG. 2a and 2b show two possible examples of GDR.
  • the refreshed area 202 starts in the middle of a picture 208 and then expands to the left 204 and the right 206 of future picture(s).
  • a refreshed area 210 starts in the center of a picture 220 and then expands in all four directions 212, 214, 216, and 218 in future picture(s).
  • Various embodiments propose a more general GDR, where a refreshed area may start in anywhere or any location of a GDR picture and gradually expand over associated recovering picture(s).
  • multiple virtual boundaries may be required. These multiple virtual boundaries may separate a GDR/recovering picture into a few areas. Further, a decoder needs to know which area separated by virtual boundaries is refreshed area of a GDR/recovering picture. It is therefore further proposed that for GDR/recovering pictures, a flag associated with each virtual boundary is signaled. The flag may specify which side of a virtual boundary is in refreshed area.
  • a flag equal to 1 for a vertical/horizontal virtual boundary may specify the left/above of the vertical/horizontal virtual boundary is in refreshed area
  • a flag equal to 0 for a vertical/horizontal virtual boundary may specify the left/above of the vertical/horizontal virtual boundary is in non-refreshed area.
  • Virtual boundaries may be used to determine whether an area is a refreshed area, or not, in a GDR/recovering picture.
  • picture boundaries may not be used to determine whether an area is a refreshed area, or not, in a GDR/recovering picture.
  • a refreshed area of a GDR/recovering picture may be an area that has all the flags associated with its surrounded virtual boundaries indicate it is ‘in refreshed area’ .
  • FIG. 3 shows an example picture header syntax structure 300, in accordance with an embodiment.
  • FIG. 3 shows example proposed syntax changes 302a, 302b in picture header of VVC.
  • the proposed picture header syntax structure 300 is conditionally added for each virtual boundary.
  • ph_virtual_boundary_pos_x_minusl_lf_refreshed_flag[ i ] 1 specifies that the area on the left and the right of the i-th vertical virtual boundary specified by ph_virtual_boundary_pos_x_minusl[ i ] is in refreshed area and non-refreshed area, respectively.
  • ph_virtual_boundary_pos_x_minusl_lf_refreshed_flag[ i ] 0 specifies that the left and the right of the i-th vertical virtual boundary specified by ph_virtual_boundary_pos_x_minusl[ i ] is in non-refreshed area and refreshed area, respectively.
  • ph_virtual_boundary_pos_x_minusl_lf_refreshed_flag[ i ] 0 specifies that the area on the left and the right of the i-th vertical virtual boundary specified by ph_virtual_boundary_pos_x_minusl[ i ] is in refreshed area and non-refreshed area, respectively.
  • ph_virtual_boundary_pos_x_minusl_lf_refreshed_flag[ i ] 1 specifies that the left and the right of the i-th vertical virtual boundary specified by ph_virtual_boundary_pos_x_minusl[ i ] is in non-refreshed area and refreshed area, respectively.
  • ph_virtual_boundary_pos_y_minusl_ab_refreshed_flag[ i ] 1 specifies that the area above and below the i-th horizontal virtual boundary specified by ph_virtual_boundary_pos_y_minusl[ i ] is in refreshed area and non-refreshed area, respectively.
  • ph_virtual_boundary_pos_y_minusl_ab_refreshed_flag[ i ] 0 specifies that the area above and below the i-th horizontal virtual boundary specified by ph_virtual_boundary_pos_y_minusl[ i ] is in non-refreshed area and refreshed area, respectively.
  • ph_virtual_boundary_pos_y_minusl_ab_refreshed_flag[ i ] 0 specifies that the area above and below the i-th horizontal virtual boundary specified by ph_virtual_boundary_pos_y_minusl[ i ] is in refreshed area and non-refreshed area, respectively.
  • ph_virtual_boundary_pos_y_minusl_ab_refreshed_flag[ i ] 1 specifies that the area above and below the i-th horizontal virtual boundary specified by ph_virtual_boundary_pos_y_minusl[ i ] is in non-refreshed area and refreshed area, respectively.
  • FIG. 4 shows an example, in which a central area 402 is refreshed, in accordance with an embodiment.
  • the central area 402 surrounded by four virtual boundaries (VBs) 402a, 402b, 402c, and 402d, is the refreshed area of a GDR/recovering picture 300.
  • VBs virtual boundaries
  • the virtual vertical boundary 402a has its associated flag ph_virtual_boundary_pos_x_minusl_lf_refreshed_flag[ 0 ] equal to 0, and the virtual vertical boundary 402b has its associated flag ph_virtual_boundary_pos_x_minusl_lf_refreshed_flag[ 1 ] equal to 1. Accordingly, an area on the right side of the virtual vertical boundary 402a is the refreshed area 404, which is on the left side of the virtual vertical boundary 402b.
  • the virtual horizontal boundary 402c has its associated flag ph_virtual_boundary_pos_y_minusl_ab_refreshed_flag[ 0 ] equal to 0 and the virtual horizontal boundary 402d has its associated flag ph_virtual_boundary_pos_y_minusl_ab_refreshed_flag[ 1 ] equal to 1. Accordingly, an area below the virtual horizontal boundary 402c is the refreshed area 404, which is above the virtual horizontal boundary 402d. As seen, the flags associated with all the four virtual boundaries 402a, 402b, 402c, and 402d, indicate that the refreshed area 404 is comprised in a central area.
  • All the other areas in FIG. 4 have at least one flag associated with their virtual boundaries to indicate they are in a non-refreshed area 406a, 406b, 406c, 406d, 406e, 406f, 406g and 406h. Accordingly, these areas in FIG. 4 are in non-refreshed areas.
  • the proposed picture header syntax structure (e.g., the picture header syntax structure 300) per virtual boundary is conditionally applied to GDR/recovering pictures.
  • each virtual boundary is associated with a flag of 0 or 1 indicting which side of the virtual boundary is in refreshed area.
  • a GDR/recovering picture may be determined using syntax in a picture header of VVC.
  • FIG. 5 shows an example of proposed syntax changes 502a, 502b in a picture header structure syntax 500, in accordance with an embodiment.
  • PicOrderCntVal is a picture order count (POC) of a current picture.
  • ph_recovery_poc_cnt specifies a recovery point of decoded pictures in output order.
  • the current picture is also referred to as the recovery point picture.
  • the picture picA is referred to as the recovery point picture; otherwise, the first picture in output order that has PicOrderCntVal greater than recovery PointPoc Vai in the CL VS is referred to as the recovery point picture.
  • the recovery point picture may not precede the current GDR picture in decoding order.
  • the pictures that are associated with the current GDR picture and have PicOrderCntVal less than recovery PointPoc Vai are referred to as the recovering pictures of the GDR picture.
  • the value of ph_recovery_poc_cnt may be in a range of 0 to MaxPicOrderCntLsb - 1, inclusive.
  • FIG. 6 is an example apparatus 600, which may be implemented in hardware, and caused to implement the examples described herein.
  • the apparatus 600 comprises at least one processor 602, at least one non-transitory memory 604 including computer program code 605, wherein the at least one memory 604 and the computer program code 605 are configured to, with the at least one processor 602, cause the apparatus 600 to implement a gradual decoding refresh technique 606, in which a refresh area starts at any location of a GDR/recovering picture and gradually expands over associated recovering pictures, based on the examples described herein.
  • the apparatus 600 optionally includes a display 608 that may be used to display content during rendering.
  • the apparatus 600 optionally includes one or more network (NW) interfaces (I/F(s)) 610.
  • NW I/F(s) 610 may be wired and/or wireless and communicate over the Internet/other network(s) via any communication technique.
  • the NW I/F(s) 610 may comprise one or more transmitters and one or more receivers.
  • the N/W I/F(s) 610 may comprise standard well-known components such as an amplifier, filter, frequency-converter, (de)modulator, and encoder/decoder circuitry(ies) and one or more antennas.
  • the apparatus 600 may be a remote, virtual or cloud apparatus.
  • the apparatus 600 may be either a coder or a decoder, or both a coder and a decoder.
  • the at least one memory 604 may be implemented using any suitable data storage technology, such as semiconductor based memory devices, flash memory, magnetic memory devices and systems, optical memory devices and systems, fixed memory and removable memory.
  • the at least one memory 604 may comprise a database for storing data.
  • the apparatus 600 need not comprise each of the features mentioned, or may comprise other features as well.
  • the apparatus 600 may correspond to or be another embodiment for example, apparatuses shown in FIG. 1 , including a receiver device 110, a sender device 170, or a network element(s) 190.
  • FIG. 7 shows a schematic representation of non-volatile memory media 700a (e.g., computer/compact disc (CD) or digital versatile disc (DVD)) and 700b (e.g., universal serial bus (USB) memory stick) storing instructions and/or parameters 702 which when executed by a processor allows the processor to perform one or more of the steps of the methods described herein.
  • non-volatile memory media 700a e.g., computer/compact disc (CD) or digital versatile disc (DVD)
  • 700b e.g., universal serial bus (USB) memory stick
  • FIG. 8 is an example method 800 to implement the examples described herein, in accordance with an embodiment.
  • the method 800 includes determining an area in a gradual decoding refresh (GDR) or recovering (GDR/recovering) picture.
  • the method 800 includes defining one or more virtual boundaries for the GDR/recovering picture, wherein the one or more virtual boundaries separate the GDR/recovering picture into two or more areas.
  • the method 800 includes associating a flag with each of the one or more virtual boundaries, wherein the flag specifies at least one of which side of the associated virtual boundary is in a refreshed area and which side in a non-refreshed area.
  • the method 800 includes encoding and signaling the flag to a decoder.
  • An example of the indication message or information include but is not limited to, a flag.
  • the method 800 may be performed with an apparatus described herein, for example, the apparatus 600.
  • FIG. 9 is an example method 900 to implement the examples described herein, in accordance with another embodiment.
  • the method 900 includes receiving a gradual decoding refresh (GDR) or recovering (GDR/recovering) picture, wherein the GDR/recovering picture comprises one or more virtual boundaries, wherein the one or more virtual boundaries separate the GDR/recovering picture into two or more areas.
  • the method 900 includes receiving a flag associated with each of the one or more virtual boundaries, wherein the flag specifies at least one of which side of each of the one or more virtual boundaries is in a refreshed area or which side is in a non-refreshed area.
  • the method 900 includes decoding the GDR/recovering picture based on the one or more virtual boundaries and associated flags.
  • An example of the indication message or information include but is not limited to, a flag.
  • the method 900 may be performed with an apparatus described herein, for example, the apparatus 600.
  • FIG. 10 is an example method 1000 to implement the examples described herein, in accordance with yet another embodiment.
  • the method 1000 includes using a general gradual decoding refresh (GDR) technique, in which a refreshed area starts at any location in a gradual decoding refresh (GDR) picture and gradually expands over associated recovering picture.
  • GDR general gradual decoding refresh
  • the method may further include further comprising: determining an area in a gradual decoding refresh (GDR) or recovering (GDR/recovering) picture; defining one or more virtual boundaries for the GDR/recovering picture, wherein the one or more virtual boundaries separate the GDR/recovering picture into two or more areas; associating an indication message or information with each of the one or more virtual boundaries, wherein the indication message or information specifies at least one of which side of the associated virtual boundary is in a refreshed area or which side in a non-refreshed area; and encoding and signaling the indication message or information to a decoder.
  • An example of the indication message or information include but is not limited to, a flag.
  • the general GDR technique is used for a low-latency video.
  • the method 1000 may be performed with an apparatus described herein, for example, the apparatus 600.
  • FIG. 11 is an example method 1100 to implement the examples described herein, in accordance with still another embodiment.
  • the method 1100 includes receiving a gradual decoding refresh (GDR) or recovering (GDR/recovering) picture, wherein a refreshed area starts at any location in the gradual decoding refresh (GDR) picture and expands over the recovering picture.
  • GDR gradual decoding refresh
  • GDR/recovering recovering
  • the GDR/recovering picture comprises one or more virtual boundaries, wherein the one or more virtual boundaries separate the GDR/recovering picture into two or more areas
  • the method further comprises; receiving an indication message or information associated with each of the one or more virtual boundaries, wherein the indication message or information specifies at least one of which side of each of the one or more virtual boundaries is in refreshed area or which side is in a non-refreshed area; and decoding the GDR/recovering picture based on the one or more virtual boundaries and associated indication message or information.
  • An example of the indication message or information include but is not limited to, a flag.
  • the method 1100 may be performed with an apparatus described herein, for example, the apparatus 600.
  • FIG. 12 shows a block diagram of one possible and non-limiting exemplary system in which the exemplary embodiments may be practiced.
  • a receiver device 110 is in wireless communication with a wireless network 100.
  • a UE is a wireless, typically mobile device that can access a wireless network.
  • the receiver device 110 includes one or more processors 120, one or more memories 125, and one or more transceivers 130 interconnected through one or more buses 127.
  • Each of the one or more transceivers 130 includes a receiver Rx, 132 and a transmitter Tx 133.
  • the one or more buses 127 may be address, data, or control buses, and may include any interconnection mechanism, such as a series of lines on a motherboard or integrated circuit, fiber optics or other optical communication equipment, and the like.
  • the one or more transceivers 130 are connected to one or more antennas 128.
  • the one or more memories 125 include computer program code 123.
  • the receiver device 110 may include an encoding and/or decoding module 140 which is configured to perform the example embodiments of the invention as described herein.
  • the encoding and/or decoding module 140-1 or 140-2 may be implemented in hardware by itself of as part of the processors and/or the computer program code of the receiver device 110.
  • encoding and/or decoding module 140 comprising one of or both parts 140-1 and/or 140-2, which may be implemented in a number of ways, encoding and/or decoding module 140 may be implemented in hardware as encoding and/or decoding module 140-1, such as being implemented as part of the one or more processors 120.
  • the encoding and/or decoding module 140-1 may be implemented also as an integrated circuit or through other hardware such as a programmable gate array.
  • the encoding and/or decoding module 140 may be implemented as encoding and/or decoding module 140-2, which is implemented as computer program code 123 and is executed by the one or more processors 120. Further, it is noted that the encoding and/or decoding modules 140-1 and/or 140-2 are optional.
  • the one or more memories 125 and the computer program code 123 may be configured, with the one or more processors 120, to cause the user equipment 110 to perform one or more of the operations as described herein.
  • the receiver device 110 communicates with sender device 170 via a wireless link 111 and the LMF 200 via link 221.
  • the sender device 170 (NR/5G Network device e.g., for LTE, long term evolution) that provides access by wireless devices such as the receiver device 110 to the wireless network 100.
  • the sender device 170 includes one or more processors 152, one or more memories 155, one or more network interfaces (N/W I/F(s)) 161, and one or more transceivers 160 interconnected through one or more buses 157.
  • Each of the one or more transceivers 160 includes a receiver Rx 162 and a transmitter Tx 163.
  • the one or more transceivers 160 are connected to one or more antennas 158.
  • the one or more memories 155 include computer program code 153.
  • the sender device 170 includes encoding and/or decoding module 150 which is configured to perform example embodiments of the invention as described herein.
  • the encoding and/or decoding module 150 may comprise one of or both parts 150-1 and/or 150-2, which may be implemented in a number of ways.
  • the encoding and/or decoding module 150 may be implemented in hardware by itself or as part of the processors and/or the computer program code of the sender device 170.
  • the encoding and/or decoding module 150-1 such as being implemented as part of the one or more processors 152.
  • the encoding and/or decoding module 150-1 may be implemented also as an integrated circuit or through other hardware such as a programmable gate array.
  • the encoding and/or decoding module 150 may be implemented as the encoding and/or decoding module 150-2, which is implemented as computer program code 153 and is executed by the one or more processors 152. Further, it is noted that the encoding and/or decoding modules 150-1 and/or 150-2 are optional.
  • the one or more memories 155 and the computer program code 153 may be configured to cause, with the one or more processors 152, the sender device 170 to perform one or more of the operations as described herein.
  • the one or more network interfaces 161 communicate over a network such as via the links 176, 221, and 131. Two or more sender device 170 may communicate using, e.g., link 176.
  • the link 176 may be wired or wireless or both and may implement, e.g., an X2 interface.
  • the one or more buses 157 may be address, data, or control buses, and may include any interconnection mechanism, such as a series of lines on a motherboard or integrated circuit, fiber optics or other optical communication equipment, wireless channels, and the like.
  • the one or more transceivers 160 may be implemented as a remote radio head (RRH) 195, with the other elements of the sender device 170 being physically in a different location from the RRH, and the one or more buses 157 could be implemented in part as fiber optic cable to connect the other elements of the sender device 170 to the RRH 195.
  • RRH remote radio head
  • the wireless network 100 may include a NCE/MME/SGW/UDM/PCF/AMM/SMF 190, which can comprise a network control element (NCE), and/or serving gateway (SGW) 190, and/or MME (Mobility Management Entity) and/or SGW (Serving Gateway) functionality, and/or user data management functionality (UDM), and/or PCF (Policy Control) functionality, and/or Access and Mobility Management (AMM) functionality, and/or Session Management (SMF) functionality, and/or Authentication Server (AUSF) functionality and which provides connectivity with a further network, such as a telephone network and/or a data communications network (e.g., the Internet), and which is configured to perform any 5G and/or NR operations in addition to or instead of other standards operations at the time of this application.
  • NCE network control element
  • SGW serving gateway
  • MME Mobility Management Entity
  • UDM User Data Management
  • AMM Access and Mobility Management
  • AUSF Authentication Server
  • the NCE/MME/SGW/UDM/PCF/AMM/SMF 190 is configurable to perform operations in accordance with example embodiments of the invention in any of an LTE, NR, 5G and/or any standards based communication technologies being performed or discussed at the time of this application.
  • the sender device 170 is coupled via a link 131 to the NCE/MME/SGW 190 and via link 131 and link 225 to the LMF 200.
  • the link 131 or link 225 may be implemented as, e.g., an SI interface.
  • the NCE/MME/SGW 190 includes one or more processors 175, one or more memories 171, and one or more network interfaces (N/W I/F(s)) 180, interconnected through one or more buses 185.
  • the one or more memories 171 include computer program code 173.
  • the one or more memories 171 and the computer program code 173 are configured to, with the one or more processors 175, cause the NCE/MME/SGW 190 to perform one or more operations.
  • the NCE/MME/SGW 190 is equipped to perform operations of such as by controlling the receiver device 110 and/or sender device 170 for 5G and/or NR operations in addition to any other standards operations at the time of this application.
  • the LMF 200 (NR/5G Node B, an evolved NB, or LTE device) is a network node such as a node including a location management function device (e.g., for NR or LTE long term evolution) that communicates with devices such the sender device 170 and receiver device 110 of FIG. 12.
  • the LMF 12 provides access to wireless devices such as the UE 10 to the wireless network 1.
  • the LMF 12 includes one or more processors DP 12A, one or more memories MEM 12B, and one or more transceivers TRANS 12D interconnected through one or more buses. In accordance with the example embodiments these TRANS 12D can include X2 and/or Xn interfaces for use to perform the example embodiments.
  • Each of the one or more transceivers TRANS 12D includes a receiver and a transmitter.
  • the one or more transceivers TRANS 12D can be optionally connected to one or more antennas for communication over at least link 221 with the receiver device 110.
  • the one or more memories MEM 12B and the computer program code PROG 12C are configured to cause, with the one or more processors DP 12A, the LMF 12 to perform one or more of the operations as described herein.
  • the LMF 12 may communicate with the gNB or eNB 170 such as via link 225 and 131. Further, the link 221, 225, or 131and/or any other link may be wired or wireless or both and may implement, e.g., an X2 or Xn interface. Further the link 221, 225, or 13 land may be through other network devices such as, but not limited to an NCE/MME/SGW/UDM/PCF/AMF/SMF/LMF 14 device as in FIG. 13.
  • the LMF 12 may perform functionalities of an MME (Mobility Management Entity) or SGW (Serving Gateway), such as a User Plane Functionality, and/or an Access Management functionality for LTE and similar functionality for 5G.
  • MME Mobility Management Entity
  • SGW Serving Gateway
  • the wireless network 100 may implement network virtualization, which is the process of combining hardware and software network resources and network functionality into a single, software-based administrative entity, a virtual network.
  • Network virtualization involves platform virtualization, often combined with resource virtualization.
  • Network virtualization is categorized as either external, combining many networks, or parts of networks, into a virtual unit, or internal, providing network-like functionality to software containers on a single system. Note that the virtualized entities that result from the network virtualization are still implemented, at some level, using hardware such as processors 152 or 175 and memories 155 and 171, and also such virtualized entities create technical effects.
  • the computer readable memories 125, 155, and 171 may be of any type suitable to the local technical environment and may be implemented using any suitable data storage technology, such as semiconductor based memory devices, flash memory, magnetic memory devices and systems, optical memory devices and systems, fixed memory and removable memory.
  • the computer readable memories 125, 155, and 171 may be means for performing storage functions.
  • the processors 120, 152, and 175 may be of any type suitable to the local technical environment, and may include one or more of general purpose computers, special purpose computers, microprocessors, digital signal processors (DSPs) and processors based on a multi-core processor architecture, as non-limiting examples.
  • the processors 120, 152, and 175 may be means for performing functions and other functions as described herein to control a network device such as the receiver device 110, sender device 170, and/or NCE/MME/SGW 190 as in FIG. 12.
  • functionality(ies), in accordance with example embodiments of the invention, of any devices as shown in FIG. 12, e.g., the receiver device 110 and/or sender device 170 can also be implemented by other network nodes, e.g., a wireless or wired relay node (a.k.a., integrated access and/or backhaul (IAB) node).
  • IAB integrated access and/or backhaul
  • UE functionalities may be carried out by MT (mobile termination) part of the IAB node, and gNB functionalities by DU (Data Unit) part of the IAB node, respectively.
  • MT mobile termination
  • DU Data Unit
  • example embodiments of the invention relate to a gradual decoding refresh technique, in which a refresh area starts at any location of GDR/recovering picture and gradually expands over associated recovering pictures.
  • a non-transitory computer-readable medium (Memory(ies) 155 as in FIG. 12) storing program code (Computer Program Code 153 and/or the encoding and/or decoding module 150-2 as in FIG. 12), the program code executed by at least one processor (Processor(s) 152 and/or the encoding and/or decoding module 150-1 as in FIG. 12) to perform the operations as at least described in the paragraphs above.
  • an apparatus comprising: means for determining (Memory(ies) 125, 155; Computer Program Code 123, 153; encoding/decoding module 140-1, 150-1; and Processor(s) 120, 152 as in FIG. 12) an area in a gradual decoding refresh (GDR) or recovering (GDR/recovering) picture; means for defining (Memory(ies) 125, 155; Computer Program Code 123, 153; encoding/decoding module 140-1, 150-1; and Processor(s) 120, 152 as in FIG.
  • GDR gradual decoding refresh
  • Processor(s) 120, 152 as in FIG.
  • a flag with each of the one or more virtual boundaries wherein the flag specifies at least one of which side of the associated virtual boundary is in a refreshed area or which side is in a non-refreshed area; and means for encoding and signaling (One or more antennas/Remote radio head 128, 195; Memory(ies) 125, 155; Computer Program Code 123, 153 the flag to a decoder.
  • At least the means for determining, defining, associating, and encoding and signaling comprises a non-transitory computer readable medium [One or more antennas/Remote radio head 128, 195; Memory(ies) 125, 155 as in FIG. 12] encoded with a computer program [Computer Program Code 123, 153 and/or the encoding/decoding module 140-1, 150-2 as in FIG. 12] executable by at least one processor [Processor(s) 120, 152 as in FIG. 12].
  • a non-transitory computer-readable medium (Memory(ies) 125, 155 as in FIG. 12) storing program code (Computer Program Code 123, 153 and/or the encoding/decoding Module 140-1, 150-2 as in FIG. 12), the program code executed by at least one processor (Processor(s) 120, 152) to perform the operations as at least described in the paragraphs above.
  • an apparatus comprising: means for receiving (One or more antennas/Remote radio head 128, 195; Memory(ies) 125, 155; Computer Program Code 123, 153; encoding/decoding module 140-1, 150-1; and Processor(s) 120, 152 as in FIG.
  • GDR gradual decoding refresh
  • GDR/recovering recovering picture
  • the GDR/recovering picture comprises one or more virtual boundaries, wherein the one or more virtual boundaries separate the GDR/recovering picture into two or more areas
  • means for receiving One or more antennas/Remote radio head 128, 195; Memory(ies) 125, 155; Computer Program Code 123, 153; encoding/decoding module 140-1, 150-1; and Processor(s) 120, 152 as in FIG.
  • a flag associated with each of the one or more virtual boundaries wherein the flag specifies at least one of which side of each of the one or more virtual boundaries is in a refreshed area or which side in a non-refreshed area; and means for decoding (Memory(ies) 125, 155; Computer Program Code 123, 153; encoding/decoding module 140-1, 150-1; and Processor(s) 120, 152 as in FIG. 12) the GDR/recovering picture based on the one or more virtual boundaries and associated flags.
  • At least the means for receiving and decoding comprises a non-transitory computer readable medium [One or more antennas/Remote radio head 128, 195; Memory(ies) 125, 155 as in FIG. 12] encoded with a computer program [Computer Program Code 123, 153 and/or the encoding/decoding module 140-1, 150-2 as in FIG. 12] executable by at least one processor [Processor(s) 120, 152 as in FIG. 12].
  • a non-transitory computer-readable medium (Memory(ies) 125, 155 as in FIG. 12) storing program code (Computer Program Code 123, 153 and/or the encoding/decoding Module 140-1, 150-2 as in FIG. 12), the program code executed by at least one processor (Processor(s) 120, 152) are caused to perform the operations as at least described in the paragraphs above.
  • an apparatus comprising: means for using (Memory(ies) 125, 155; Computer Program Code 123, 153; encoding/decoding module 140-1, 150-1; and Processor(s) 120, 152 as in FIG. 12) a general gradual decoding refresh (GDR) technique, in which a refreshed area starts at any location in a gradual decoding refresh (GDR) picture and gradually expands over associated recovering picture.
  • GDR general gradual decoding refresh
  • At least the means for using comprises a non-transitory computer readable medium [One or more antennas/Remote radio head 128, 195; Memory(ies) 125, 155 as in FIG. 12] encoded with a computer program [Computer Program Code 123, 153 and/or the encoding/decoding module 140-1, 150-2 as in FIG. 12] executable by at least one processor [Processor(s) 120, 152 as in FIG. 12].
  • a non-transitory computer-readable medium (Memory(ies) 125, 155 as in FIG. 12) storing program code (Computer Program Code 123, 153 and/or the encoding/decoding Module 140-1, 150-2 as in FIG. 12), the program code executed by at least one processor (Processor(s) 120, 152) are caused to perform the operations as at least described in the paragraphs above.
  • an apparatus comprising: means for receiving (One or more antennas/Remote radio head 128, 195; Memory(ies) 125, 155; Computer Program Code 123, 153; encoding/decoding module 140-1, 150-1; and Processor(s) 120, 152 as in FIG. 12) a gradual decoding refresh (GDR) or recovering (GDR/recovering) picture, wherein a refreshed area starts at any location in the gradual decoding refresh (GDR) picture and expands over the recovering picture.
  • GDR gradual decoding refresh
  • GDR recovering
  • At least the means for receiving comprises a non-transitory computer readable medium [One or more antennas/Remote radio head 128, 195; Memory(ies) 125, 155 as in FIG. 12] encoded with a computer program [Computer Program Code 123, 153 and/or the encoding/decoding module 140-1, 150-2 as in FIG. 12] executable by at least one processor [Processor(s) 120, 152 as in FIG. 12].
  • a non-transitory computer-readable medium (Memory(ies) 125, 155 as in FIG. 12) storing program code (Computer Program Code 123, 153 and/or the encoding/decoding Module 140-1, 150-2 as in FIG. 12), the program code executed by at least one processor (Processor(s) 120, 152) are caused to perform the operations as at least described in the paragraphs above.
  • circuitry for performing operations in accordance with example embodiments of the invention as disclosed herein.
  • This circuitry may include any type of circuitry including content coding circuitry, content decoding circuitry, processing circuitry, image generation circuitry, data analysis circuitry, and the like.). Further, this circuitry may include discrete circuitry, application-specific integrated circuitry (ASIC), and/or field-programmable gate array circuitry (FPGA), and the like, as well as a processor specifically configured by software to perform the respective function, or dualcore processors with software and corresponding digital signal processors, and the like.).
  • ASIC application-specific integrated circuitry
  • FPGA field-programmable gate array circuitry
  • circuitry may include at least one or more or all of the following:
  • any portions of hardware processor(s) with software including digital signal processor(s)), software, and memory(ies) that work together to cause an apparatus, such as a mobile phone or server, to perform various functions, such as functions or operations in accordance with example embodiments of the invention as disclosed herein); and (c) hardware circuit(s) and or processor(s), such as a microprocessor(s) or a portion of a microprocessor(s), that requires software (e.g., firmware) for operation, but the software may not be present when it is not needed for operation.”
  • software e.g., firmware
  • the various embodiments may be implemented in hardware or special purpose circuits, software, logic or any combination thereof.
  • some features may be implemented in hardware, while other aspects may be implemented in firmware or software which may be executed by a controller, microprocessor or other computing device, although the invention is not limited thereto.
  • firmware or software which may be executed by a controller, microprocessor or other computing device, although the invention is not limited thereto.
  • While various aspects of the invention may be illustrated and described as block diagrams, flow charts, or using some other pictorial representation, it is well understood that these blocks, apparatus, systems, techniques or methods described herein may be implemented in, as non-limiting examples, hardware, software, firmware, special purpose circuits or logic, general purpose hardware or controller or other computing devices, or some combination thereof.
  • Embodiments of the inventions may be practiced in various components such as integrated circuit modules.
  • the design of integrated circuits is by and large a highly automated process.
  • Complex and powerful software tools are available for converting a logic level design into a semiconductor circuit design ready to be etched and formed on a semiconductor substrate.
  • certain ones of the operations above may be modified or further amplified. Furthermore, in some embodiments, additional optional operations may be included. Modifications, additions, or amplifications to the operations above may be performed in any order and in any combination.
  • connection means any connection or coupling, either direct or indirect, between two or more elements, and may encompass the presence of one or more intermediate elements between two elements that are “connected” or “coupled” together.
  • the coupling or connection between the elements can be physical, logical, or a combination thereof.
  • two elements may be considered to be “connected” or “coupled” together by the use of one or more wires, cables and/or printed electrical connections, as well as by the use of electromagnetic energy, such as electromagnetic energy having wavelengths in the radio frequency region, the microwave region and the optical (both visible and invisible) region, as several non-limiting and non-exhaustive examples.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)

Abstract

Various embodiments provide an apparatus, a method, and a computer program product. An example apparatus includes: at least one processor; and at least one memory storing instructions that, when executed by the at least one processor, cause the apparatus at least to perform: using a general gradual decoding refresh (GDR) technique, in which a refreshed area starts at any location in a gradual decoding refresh (GDR) picture and gradually expands over associated recovering picture.

Description

FLEXIBLE GRADUAL DECODING REFRESH
TECHNICAL FIELD
[0001] The teachings in accordance with the exemplary embodiments of this invention relate generally to video coding, more specifically, relate to gradual decoding refresh.
BACKGROUND
[0002] It is known to perform video coding.
SUMMARY
[0003] Example 1. A method comprising: using a general gradual decoding refresh (GDR) technique, in which a refreshed area starts at any location in a gradual decoding refresh (GDR) picture and gradually expands over associated recovering picture. In an embodiment, the general GDR technique is used for a low-latency video.
[0004] Example 2. The method of example 1 further comprising: determining an area in a gradual decoding refresh (GDR) or recovering (GDR/recovering) picture; defining one or more virtual boundaries for the GDR/recovering picture, wherein the one or more virtual boundaries separate the GDR/recovering picture into two or more areas; associating an indication message or information with each of the one or more virtual boundaries, wherein the indication message or information specifies at least one of which side of the associated virtual boundary is in a refreshed area or which side in a non-refreshed area; and encoding and signaling the indication message or information to a decoder. An example of the indication message or information, include but is not limited to, a flag.
[0005] Example 3. A method comprising: receiving a gradual decoding refresh (GDR) or recovering (GDR/recovering) picture, wherein a refreshed area starts at any location in the gradual decoding refresh (GDR) picture and expands over the recovering picture.
[0006] Example 4. The method of example 3, wherein the GDR/recovering picture comprises one or more virtual boundaries, wherein the one or more virtual boundaries separate the GDR/recovering picture into two or more areas, and wherein the method further comprises; receiving an indication message or information associated with each of the one or more virtual boundaries, wherein the indication message or information specifies at least one of which side of each of the one or more virtual boundaries is in refreshed area or which side is in a non-refreshed area; and decoding the GDR/recovering picture based on the one or more virtual boundaries and associated indication message or information. An example of the indication message or information, include but is not limited to, a flag.
[0007] Example 5. The method of any of the previous examples, wherein when the indication message or information is equal to 1 specifies position or location of the refreshed area with respect to the virtual boundary associated with the indication message or information.
[0008] Example 6. The method of any of the previous examples, wherein when the indication message or information is equal to 0 specifies position or location of a non-refreshed area with respect to the virtual boundary associated with the indication message or information.
[0009] Example 7. The method of any of the previous examples, wherein the one or more virtual boundaries comprise one or more vertical virtual boundaries and/or one or more horizontal virtual boundaries.
[0010] Example 8. The method of example 7, wherein when the indication message or information is equal to 1 and is associated with a vertical virtual boundary, the indication message or information specifies that the area on left of the vertical virtual boundary is the refreshed area and the area on the right of the vertical virtual boundary is the non-refreshed area.
[0011] Example 9. The method of example 7, wherein when the indication message or information is equal to 1 and is associated with a horizontal virtual boundary, the indication message or information specifies that the area above the horizontal virtual boundary is the refreshed area and the area below the horizontal virtual boundary is the non-refreshed area.
[0012] Example 10. The method of example 7, wherein when the indication message or information is equal to 0 and is associated with a vertical virtual boundary, the indication message or information specifies that the area on left of the vertical virtual boundary is the non-refreshed area and the area on right of the vertical virtual boundary is the refreshed area.
[0013] Example 11. The method of example 7, wherein when the indication message or information is equal to 0 and is associated with a horizontal virtual boundary, the indication message or information specifies that the area above the horizontal virtual boundary is the non- refreshed area and the area below the horizontal virtual boundary is the refreshed area.
[0014] Example 12. An apparatus comprising: at least one processor; and at least one memory storing instructions that, when executed by the at least one processor, cause the apparatus at least to perform: using a general gradual decoding refresh (GDR) technique, in which a refreshed area starts at any location in a gradual decoding refresh (GDR) picture and gradually expands over associated recovering picture. In an embodiment, the general GDR technique is used for a low- latency video.
[0015] Example 13. The apparatus of example 12, wherein the apparatus is further caused to perform: determining an area in a gradual decoding refresh (GDR) or recovering (GDR/recovering) picture; defining one or more virtual boundaries for the GDR/recovering picture, wherein the one or more virtual boundaries separate the GDR/recovering picture into two or more areas; associating an indication message or information with each of the one or more virtual boundaries, wherein the indication message or information specifies at least one of which side of the associated virtual boundary is in a refreshed area or which side in a non-refreshed area; and encoding and signaling the indication message or information to a decoder.
[0016] Example 14. An apparatus comprising: at least one processor; and at least one memory storing instructions that, when executed by the at least one processor, cause the apparatus at least to perform: receiving a gradual decoding refresh (GDR) or recovering (GDR/recovering) picture, wherein a refreshed area starts at any location in the gradual decoding refresh (GDR) picture and expands over the recovering picture.
[0017] Example 15. The apparatus of example 14, wherein the GDR/recovering picture comprises one or more virtual boundaries, wherein the one or more virtual boundaries separate the GDR/recovering picture into two or more areas, wherein the apparatus is further caused to perform; receiving an indication message or information associated with each of the one or more virtual boundaries, wherein the indication message or information specifies at least one of which side of each of the one or more virtual boundaries is in the refreshed area or which side is in a non-refreshed area; and decoding the GDR/recovering picture based on the one or more virtual boundaries and associated indication message or information.
[0018] Example 16. The apparatus of any of the previous examples, wherein when the indication message or information is equal to 1 specifies position or location of the refreshed area with respect to the virtual boundary associated with the indication message or information. [0019] Example 17. The apparatus of any of the previous examples, wherein when the indication message or information is equal to 0 specifies position or location of a non-refreshed area with respect to the virtual boundary associated with the indication message or information.
[0020] Example 18. The apparatus of any of the previous examples, wherein the one or more virtual boundaries comprise one or more vertical virtual boundaries and/or one or more horizontal virtual boundaries.
[0021] Example 19. The apparatus of example 14, wherein when the indication message or information is equal to 1 and is associated with a vertical virtual boundary, the indication message or information specifies that the area on left of the vertical virtual boundary is the refreshed area and the area on the right of the vertical virtual boundary is the non-refreshed area.
[0022] Example 20. The apparatus of example 14, wherein when the indication message or information is equal to 1 and is associated with a horizontal virtual boundary, the indication message or information specifies that the area above the horizontal virtual boundary is the refreshed area and the area below the horizontal virtual boundary is the non-refreshed area.
[0023] Example 21. The apparatus of example 14, wherein when the indication message or information is equal to 0 and is associated with a vertical virtual boundary, the indication message or information specifies that the area on left of the vertical virtual boundary is the non-refreshed area and the area on right of the vertical virtual boundary is the refreshed area.
[0024] Example 22. The apparatus of example 14, wherein when the indication message or information is equal to 0 and is associated with a horizontal virtual boundary, the indication message or information specifies that the area above the horizontal virtual boundary is the nonrefreshed area and the area below the horizontal virtual boundary is the refreshed area.
[0025] Example 23. A computer-readable medium encoded with instructions that, when executed by a computer, causing an apparatus to perform methods as described in any of the examples 1 to 11.
[0026] Example 24. The computer-readable medium of example 23, wherein the computer- readable medium comprises a non-transitory computer-readable medium. [0027] Example 25. An apparatus comprising means for performing the methods as described in any of the examples 1 to 11.
[0028] Certain abbreviations that may be found in the description and/or in the Figures are herewith defined as follows:
GDR gradual decoding refresh
ECM enhanced compression model
JVET joint video experts team
IRAP intra random access point
POC picture order count
VVC versatile video coding
BRIEF DESCRIPTION OF THE DRAWINGS:
[0029] The above and other features, and benefits of various embodiments of the present disclosure will become more fully apparent from the following detailed description with reference to the accompanying drawings, in which like reference signs are used to designate like or equivalent elements. The drawings are illustrated for facilitating better understanding of the embodiments of the disclosure and are not necessarily drawn to scale, in which:
[0030] FIG. 1 illustrates the basic concept of vertical GDR, where a refreshed area starts from left of a gradual decoding refresh (GDR) picture;
[0031] FIG. 2a and 2b show two possible examples of a GDR picture; where in FIG. 2a, a refreshed area starts in the middle of a GDR picture and expands to the left and the right of associated recovering pictures, and in FIG. 2b, a refreshed area starts in the center of a GDR picture and expands in all the four directions of associated recovering pictures,
[0032] FIG. 3 shows an example picture header syntax structure, in accordance with an embodiment;
[0033] FIG. 4 shows an example, in which a central area is refreshed, in accordance with an embodiment;
[0034] FIG. 5 shows an example of proposed syntax changes in a picture header structure syntax, in accordance with an embodiment;
[0035] FIG. 6 is an example apparatus, which may be implemented in hardware, and caused to implement the examples described herein;
[0036] FIG. 7 shows a schematic representation of non-volatile memory media;
[0037] FIG. 8 is an example method to implement the examples described herein, in accordance with an embodiment;
[0038] FIG. 9 is an example method to implement the examples described herein, in accordance with another embodiment; and
[0039] FIG. 10 is an example method to implement the examples described herein, in accordance with yet another embodiment;
[0040] FIG. 11 is an example method to implement the examples described herein, in accordance with still another embodiment; and
[0041] FIG. 12 shows a block diagram of one possible and non-limiting exemplary system in which the exemplary embodiments may be practiced.
DETAILED DESCRIPTION:
[0042] In example embodiments, there is proposed at least a gradual decoding refresh (GDR) technique, in which a refreshed area may start at any location in a GDR picture and gradually expand over associated recovering pictures. Also proposed are method and apparatus to implement the proposed GDR.
[0043] A coded video sequence may include intra coded pictures (e.g., I picture) and inter coded pictures (e.g., P and B pictures). Intra coded pictures usually use many more bits than inter coded pictures. Transmission time of such intra coded pictures increases the encoder to decoder delay. For (ultra) low-delay applications, it is desirable that all the coded pictures have similar number of bits so that the encoder to decoder delay may be reduced to around 1 picture interval. Hence, intra coded picture may not be a fit for (ultra) low-delay applications. However, on the other hand, an intra coded picture is indeed needed at random access point. [0044] Gradual decoding refresh (GDR) approaches alleviate the delay issue with intra coded pictures. Instead of coding an intra picture at a random access point, GDR progressively refreshes pictures over several pictures.
[0045] FIG. 1 illustrates the basic concept of vertical GDR, where a refreshed area starts from the left of a picture and gradually expands over a few following pictures. The first picture is a GDR picture 106 and the last picture is a recovery point picture 116. Pictures between a GDR picture and its recovery point picture are called associated recovering pictures, for example, recovering picture 115. As shown in FIG. 1, in some versatile video coding (VVC)Zenhanced compression model (ECM) software implementations, GDR starts with a refreshed area 102 at a left side 104 of the GDR picture 106, and then gradually expands the refreshed area 102 (e.g., expanded refreshed area 109 and 113) to the right of the associated recovering picture(s) 115. A virtual boundary included in picture header is used to separate refreshed area and non-refreshed area of a GDR/recovering picture. For example, in FIG. 1, a virtual boundary 117 is used to separate refreshed area 102 and non-refreshed area 114 of the GDR picture 106, and a virtual boundary 118 is used to separate refreshed area 108 and non-refreshed area 119 of the recovering picture 115.
[0046] However, it has been observed that most of gaming sequences and many nature sequences have their main characters and activities in the middle of pictures. Therefore, it makes sense to have a refreshed area starting in the middle of a GDR picture and gradually expanding over the associated recovering pictures. FIG. 2a and 2b show two possible examples of GDR. In example shown in FIG. 2a, the refreshed area 202 starts in the middle of a picture 208 and then expands to the left 204 and the right 206 of future picture(s). In the example shown in FIG. 2b, a refreshed area 210 starts in the center of a picture 220 and then expands in all four directions 212, 214, 216, and 218 in future picture(s).
[0047] Various embodiments propose a more general GDR, where a refreshed area may start in anywhere or any location of a GDR picture and gradually expand over associated recovering picture(s).
[0048] With this more general GDR, all existing coding modes in VVC/ECM may still be performed as it is.
[0049] To support such more general GDR, multiple virtual boundaries may be required. These multiple virtual boundaries may separate a GDR/recovering picture into a few areas. Further, a decoder needs to know which area separated by virtual boundaries is refreshed area of a GDR/recovering picture. It is therefore further proposed that for GDR/recovering pictures, a flag associated with each virtual boundary is signaled. The flag may specify which side of a virtual boundary is in refreshed area. For example, a flag equal to 1 for a vertical/horizontal virtual boundary may specify the left/above of the vertical/horizontal virtual boundary is in refreshed area, while a flag equal to 0 for a vertical/horizontal virtual boundary may specify the left/above of the vertical/horizontal virtual boundary is in non-refreshed area. Virtual boundaries may be used to determine whether an area is a refreshed area, or not, in a GDR/recovering picture.
[0050] In an addition embodiment, it is proposed that picture boundaries may not be used to determine whether an area is a refreshed area, or not, in a GDR/recovering picture.
[0051] A refreshed area of a GDR/recovering picture may be an area that has all the flags associated with its surrounded virtual boundaries indicate it is ‘in refreshed area’ .
[0052] When an area is surrounded by both virtual boundaries and picture boundaries, the flags associated with its virtual boundaries are used to determine whether the area is a refreshed area or not, and picture boundaries are not taken into consideration.
[0053] FIG. 3 shows an example picture header syntax structure 300, in accordance with an embodiment. FIG. 3 shows example proposed syntax changes 302a, 302b in picture header of VVC. The proposed picture header syntax structure 300 is conditionally added for each virtual boundary.
[0054] In an example, ph_virtual_boundary_pos_x_minusl_lf_refreshed_flag[ i ] equal to 1 specifies that the area on the left and the right of the i-th vertical virtual boundary specified by ph_virtual_boundary_pos_x_minusl[ i ] is in refreshed area and non-refreshed area, respectively. ph_virtual_boundary_pos_x_minusl_lf_refreshed_flag[ i ] equal to 0 specifies that the left and the right of the i-th vertical virtual boundary specified by ph_virtual_boundary_pos_x_minusl[ i ] is in non-refreshed area and refreshed area, respectively. In another example, ph_virtual_boundary_pos_x_minusl_lf_refreshed_flag[ i ] equal to 0 specifies that the area on the left and the right of the i-th vertical virtual boundary specified by ph_virtual_boundary_pos_x_minusl[ i ] is in refreshed area and non-refreshed area, respectively. ph_virtual_boundary_pos_x_minusl_lf_refreshed_flag[ i ] equal to 1 specifies that the left and the right of the i-th vertical virtual boundary specified by ph_virtual_boundary_pos_x_minusl[ i ] is in non-refreshed area and refreshed area, respectively. [0055] In an example, ph_virtual_boundary_pos_y_minusl_ab_refreshed_flag[ i ] equal to 1 specifies that the area above and below the i-th horizontal virtual boundary specified by ph_virtual_boundary_pos_y_minusl[ i ] is in refreshed area and non-refreshed area, respectively. ph_virtual_boundary_pos_y_minusl_ab_refreshed_flag[ i ] equal to 0 specifies that the area above and below the i-th horizontal virtual boundary specified by ph_virtual_boundary_pos_y_minusl[ i ] is in non-refreshed area and refreshed area, respectively. In another example, ph_virtual_boundary_pos_y_minusl_ab_refreshed_flag[ i ] equal to 0 specifies that the area above and below the i-th horizontal virtual boundary specified by ph_virtual_boundary_pos_y_minusl[ i ] is in refreshed area and non-refreshed area, respectively. ph_virtual_boundary_pos_y_minusl_ab_refreshed_flag[ i ] equal to 1 specifies that the area above and below the i-th horizontal virtual boundary specified by ph_virtual_boundary_pos_y_minusl[ i ] is in non-refreshed area and refreshed area, respectively.
[0056] FIG. 4 shows an example, in which a central area 402 is refreshed, in accordance with an embodiment. The central area 402, surrounded by four virtual boundaries (VBs) 402a, 402b, 402c, and 402d, is the refreshed area of a GDR/recovering picture 300. In this example, there are two virtual vertical boundaries 402a, 402b; and two virtual horizontal boundaries 402c, 402d. The virtual vertical boundary 402a has its associated flag ph_virtual_boundary_pos_x_minusl_lf_refreshed_flag[ 0 ] equal to 0, and the virtual vertical boundary 402b has its associated flag ph_virtual_boundary_pos_x_minusl_lf_refreshed_flag[ 1 ] equal to 1. Accordingly, an area on the right side of the virtual vertical boundary 402a is the refreshed area 404, which is on the left side of the virtual vertical boundary 402b. The virtual horizontal boundary 402c has its associated flag ph_virtual_boundary_pos_y_minusl_ab_refreshed_flag[ 0 ] equal to 0 and the virtual horizontal boundary 402d has its associated flag ph_virtual_boundary_pos_y_minusl_ab_refreshed_flag[ 1 ] equal to 1. Accordingly, an area below the virtual horizontal boundary 402c is the refreshed area 404, which is above the virtual horizontal boundary 402d. As seen, the flags associated with all the four virtual boundaries 402a, 402b, 402c, and 402d, indicate that the refreshed area 404 is comprised in a central area.
[0057] All the other areas in FIG. 4 have at least one flag associated with their virtual boundaries to indicate they are in a non-refreshed area 406a, 406b, 406c, 406d, 406e, 406f, 406g and 406h. Accordingly, these areas in FIG. 4 are in non-refreshed areas.
[0058] In the above example, the proposed picture header syntax structure (e.g., the picture header syntax structure 300) per virtual boundary is conditionally applied to GDR/recovering pictures. In an example, each virtual boundary is associated with a flag of 0 or 1 indicting which side of the virtual boundary is in refreshed area.
[0059] A GDR/recovering picture may be determined using syntax in a picture header of VVC. FIG. 5 shows an example of proposed syntax changes 502a, 502b in a picture header structure syntax 500, in accordance with an embodiment.
[0060] PicOrderCntVal is a picture order count (POC) of a current picture.
[0061] ph_recovery_poc_cnt specifies a recovery point of decoded pictures in output order. When the current picture is a GDR picture, the variables gdrPicPocVal and recovery PointPoc Vai are derived as follows: gdrPicPOCVal = PicOrderCntVal recovery PointPoc Vai = PicOrderCntVal + ph_recovery_poc_cnt
[0062] When the current picture is a GDR picture and ph_recovery_poc_cnt is equal to 0, the current picture is also referred to as the recovery point picture. Otherwise, when the current picture is a GDR picture, and there is a picture picA that follows the current GDR picture in decoding order in the CL VS that has PicOrderCntVal equal to recovery PointPoc Vai, the picture picA is referred to as the recovery point picture; otherwise, the first picture in output order that has PicOrderCntVal greater than recovery PointPoc Vai in the CL VS is referred to as the recovery point picture. The recovery point picture may not precede the current GDR picture in decoding order. The pictures that are associated with the current GDR picture and have PicOrderCntVal less than recovery PointPoc Vai are referred to as the recovering pictures of the GDR picture. The value of ph_recovery_poc_cnt may be in a range of 0 to MaxPicOrderCntLsb - 1, inclusive.
[0063] When a sps_gdr_enabled_flag is equal to 1 and PicOrderCntVal of the current picture is greater than or equal to recovery PointPoc Vai of the associated GDR picture, the current and subsequent decoded pictures in output order are exact match to the corresponding pictures produced by starting the decoding process from the previous intra random access point (IRAP) picture, when present, preceding the associated GDR picture in decoding order.
[0064] FIG. 6 is an example apparatus 600, which may be implemented in hardware, and caused to implement the examples described herein. The apparatus 600 comprises at least one processor 602, at least one non-transitory memory 604 including computer program code 605, wherein the at least one memory 604 and the computer program code 605 are configured to, with the at least one processor 602, cause the apparatus 600 to implement a gradual decoding refresh technique 606, in which a refresh area starts at any location of a GDR/recovering picture and gradually expands over associated recovering pictures, based on the examples described herein.
[0065] The apparatus 600 optionally includes a display 608 that may be used to display content during rendering. The apparatus 600 optionally includes one or more network (NW) interfaces (I/F(s)) 610. The NW I/F(s) 610 may be wired and/or wireless and communicate over the Internet/other network(s) via any communication technique. The NW I/F(s) 610 may comprise one or more transmitters and one or more receivers. The N/W I/F(s) 610 may comprise standard well-known components such as an amplifier, filter, frequency-converter, (de)modulator, and encoder/decoder circuitry(ies) and one or more antennas.
[0066] The apparatus 600 may be a remote, virtual or cloud apparatus. The apparatus 600 may be either a coder or a decoder, or both a coder and a decoder. The at least one memory 604 may be implemented using any suitable data storage technology, such as semiconductor based memory devices, flash memory, magnetic memory devices and systems, optical memory devices and systems, fixed memory and removable memory. The at least one memory 604 may comprise a database for storing data. The apparatus 600 need not comprise each of the features mentioned, or may comprise other features as well. The apparatus 600 may correspond to or be another embodiment for example, apparatuses shown in FIG. 1 , including a receiver device 110, a sender device 170, or a network element(s) 190.
[0067] FIG. 7 shows a schematic representation of non-volatile memory media 700a (e.g., computer/compact disc (CD) or digital versatile disc (DVD)) and 700b (e.g., universal serial bus (USB) memory stick) storing instructions and/or parameters 702 which when executed by a processor allows the processor to perform one or more of the steps of the methods described herein.
[0068] FIG. 8 is an example method 800 to implement the examples described herein, in accordance with an embodiment. At 802, the method 800 includes determining an area in a gradual decoding refresh (GDR) or recovering (GDR/recovering) picture. At 804, the method 800 includes defining one or more virtual boundaries for the GDR/recovering picture, wherein the one or more virtual boundaries separate the GDR/recovering picture into two or more areas. At 806, the method 800 includes associating a flag with each of the one or more virtual boundaries, wherein the flag specifies at least one of which side of the associated virtual boundary is in a refreshed area and which side in a non-refreshed area. At 808, the method 800 includes encoding and signaling the flag to a decoder. An example of the indication message or information, include but is not limited to, a flag.
[0069] The method 800 may be performed with an apparatus described herein, for example, the apparatus 600.
[0070] FIG. 9 is an example method 900 to implement the examples described herein, in accordance with another embodiment. At 902, the method 900 includes receiving a gradual decoding refresh (GDR) or recovering (GDR/recovering) picture, wherein the GDR/recovering picture comprises one or more virtual boundaries, wherein the one or more virtual boundaries separate the GDR/recovering picture into two or more areas. At 904, the method 900 includes receiving a flag associated with each of the one or more virtual boundaries, wherein the flag specifies at least one of which side of each of the one or more virtual boundaries is in a refreshed area or which side is in a non-refreshed area. At 906, the method 900 includes decoding the GDR/recovering picture based on the one or more virtual boundaries and associated flags. An example of the indication message or information, include but is not limited to, a flag.
[0071] The method 900 may be performed with an apparatus described herein, for example, the apparatus 600.
[0072] FIG. 10 is an example method 1000 to implement the examples described herein, in accordance with yet another embodiment. At 1002, the method 1000 includes using a general gradual decoding refresh (GDR) technique, in which a refreshed area starts at any location in a gradual decoding refresh (GDR) picture and gradually expands over associated recovering picture. In an embodiment, the method may further include further comprising: determining an area in a gradual decoding refresh (GDR) or recovering (GDR/recovering) picture; defining one or more virtual boundaries for the GDR/recovering picture, wherein the one or more virtual boundaries separate the GDR/recovering picture into two or more areas; associating an indication message or information with each of the one or more virtual boundaries, wherein the indication message or information specifies at least one of which side of the associated virtual boundary is in a refreshed area or which side in a non-refreshed area; and encoding and signaling the indication message or information to a decoder. An example of the indication message or information, include but is not limited to, a flag. In an embodiment, the general GDR technique is used for a low-latency video.
[0073] The method 1000 may be performed with an apparatus described herein, for example, the apparatus 600.
[0074] FIG. 11 is an example method 1100 to implement the examples described herein, in accordance with still another embodiment. At 1102, the method 1100 includes receiving a gradual decoding refresh (GDR) or recovering (GDR/recovering) picture, wherein a refreshed area starts at any location in the gradual decoding refresh (GDR) picture and expands over the recovering picture. In an embodiment, wherein the GDR/recovering picture comprises one or more virtual boundaries, wherein the one or more virtual boundaries separate the GDR/recovering picture into two or more areas, and wherein the method further comprises; receiving an indication message or information associated with each of the one or more virtual boundaries, wherein the indication message or information specifies at least one of which side of each of the one or more virtual boundaries is in refreshed area or which side is in a non-refreshed area; and decoding the GDR/recovering picture based on the one or more virtual boundaries and associated indication message or information. An example of the indication message or information, include but is not limited to, a flag.
[0075] The method 1100 may be performed with an apparatus described herein, for example, the apparatus 600.
[0076] FIG. 12 shows a block diagram of one possible and non-limiting exemplary system in which the exemplary embodiments may be practiced. As shown in FIG. 12, a receiver device 110 is in wireless communication with a wireless network 100. A UE is a wireless, typically mobile device that can access a wireless network. The receiver device 110 includes one or more processors 120, one or more memories 125, and one or more transceivers 130 interconnected through one or more buses 127. Each of the one or more transceivers 130 includes a receiver Rx, 132 and a transmitter Tx 133. The one or more buses 127 may be address, data, or control buses, and may include any interconnection mechanism, such as a series of lines on a motherboard or integrated circuit, fiber optics or other optical communication equipment, and the like. The one or more transceivers 130 are connected to one or more antennas 128. The one or more memories 125 include computer program code 123. The receiver device 110 may include an encoding and/or decoding module 140 which is configured to perform the example embodiments of the invention as described herein. The encoding and/or decoding module 140-1 or 140-2 may be implemented in hardware by itself of as part of the processors and/or the computer program code of the receiver device 110. encoding and/or decoding module 140 comprising one of or both parts 140-1 and/or 140-2, which may be implemented in a number of ways, encoding and/or decoding module 140 may be implemented in hardware as encoding and/or decoding module 140-1, such as being implemented as part of the one or more processors 120. The encoding and/or decoding module 140-1 may be implemented also as an integrated circuit or through other hardware such as a programmable gate array. In another example, the encoding and/or decoding module 140 may be implemented as encoding and/or decoding module 140-2, which is implemented as computer program code 123 and is executed by the one or more processors 120. Further, it is noted that the encoding and/or decoding modules 140-1 and/or 140-2 are optional. For instance, the one or more memories 125 and the computer program code 123 may be configured, with the one or more processors 120, to cause the user equipment 110 to perform one or more of the operations as described herein. The receiver device 110 communicates with sender device 170 via a wireless link 111 and the LMF 200 via link 221.
[0077] The sender device 170 (NR/5G Network device e.g., for LTE, long term evolution) that provides access by wireless devices such as the receiver device 110 to the wireless network 100. The sender device 170 includes one or more processors 152, one or more memories 155, one or more network interfaces (N/W I/F(s)) 161, and one or more transceivers 160 interconnected through one or more buses 157. Each of the one or more transceivers 160 includes a receiver Rx 162 and a transmitter Tx 163. The one or more transceivers 160 are connected to one or more antennas 158. The one or more memories 155 include computer program code 153. The sender device 170 includes encoding and/or decoding module 150 which is configured to perform example embodiments of the invention as described herein. The encoding and/or decoding module 150 may comprise one of or both parts 150-1 and/or 150-2, which may be implemented in a number of ways. The encoding and/or decoding module 150 may be implemented in hardware by itself or as part of the processors and/or the computer program code of the sender device 170. The encoding and/or decoding module 150-1, such as being implemented as part of the one or more processors 152. The encoding and/or decoding module 150-1 may be implemented also as an integrated circuit or through other hardware such as a programmable gate array. In another example, the encoding and/or decoding module 150 may be implemented as the encoding and/or decoding module 150-2, which is implemented as computer program code 153 and is executed by the one or more processors 152. Further, it is noted that the encoding and/or decoding modules 150-1 and/or 150-2 are optional. For instance, the one or more memories 155 and the computer program code 153 may be configured to cause, with the one or more processors 152, the sender device 170 to perform one or more of the operations as described herein. The one or more network interfaces 161 communicate over a network such as via the links 176, 221, and 131. Two or more sender device 170 may communicate using, e.g., link 176. The link 176 may be wired or wireless or both and may implement, e.g., an X2 interface.
[0078] The one or more buses 157 may be address, data, or control buses, and may include any interconnection mechanism, such as a series of lines on a motherboard or integrated circuit, fiber optics or other optical communication equipment, wireless channels, and the like. For example, the one or more transceivers 160 may be implemented as a remote radio head (RRH) 195, with the other elements of the sender device 170 being physically in a different location from the RRH, and the one or more buses 157 could be implemented in part as fiber optic cable to connect the other elements of the sender device 170 to the RRH 195.
[0079] It is noted that description herein indicates that “cells” perform functions, but it should be clear that the gNB that forms the cell will perform the functions. The cell makes up part of a gNB. That is, there can be multiple cells per gNB.
[0080] The wireless network 100 may include a NCE/MME/SGW/UDM/PCF/AMM/SMF 190, which can comprise a network control element (NCE), and/or serving gateway (SGW) 190, and/or MME (Mobility Management Entity) and/or SGW (Serving Gateway) functionality, and/or user data management functionality (UDM), and/or PCF (Policy Control) functionality, and/or Access and Mobility Management (AMM) functionality, and/or Session Management (SMF) functionality, and/or Authentication Server (AUSF) functionality and which provides connectivity with a further network, such as a telephone network and/or a data communications network (e.g., the Internet), and which is configured to perform any 5G and/or NR operations in addition to or instead of other standards operations at the time of this application. The NCE/MME/SGW/UDM/PCF/AMM/SMF 190 is configurable to perform operations in accordance with example embodiments of the invention in any of an LTE, NR, 5G and/or any standards based communication technologies being performed or discussed at the time of this application.
[0081] The sender device 170 is coupled via a link 131 to the NCE/MME/SGW 190 and via link 131 and link 225 to the LMF 200. The link 131 or link 225 may be implemented as, e.g., an SI interface. The NCE/MME/SGW 190 includes one or more processors 175, one or more memories 171, and one or more network interfaces (N/W I/F(s)) 180, interconnected through one or more buses 185. The one or more memories 171 include computer program code 173. The one or more memories 171 and the computer program code 173 are configured to, with the one or more processors 175, cause the NCE/MME/SGW 190 to perform one or more operations. In addition, the NCE/MME/SGW 190, as are the other devices, is equipped to perform operations of such as by controlling the receiver device 110 and/or sender device 170 for 5G and/or NR operations in addition to any other standards operations at the time of this application. [0082] The LMF 200 (NR/5G Node B, an evolved NB, or LTE device) is a network node such as a node including a location management function device (e.g., for NR or LTE long term evolution) that communicates with devices such the sender device 170 and receiver device 110 of FIG. 12. The LMF 12 provides access to wireless devices such as the UE 10 to the wireless network 1. The LMF 12 includes one or more processors DP 12A, one or more memories MEM 12B, and one or more transceivers TRANS 12D interconnected through one or more buses. In accordance with the example embodiments these TRANS 12D can include X2 and/or Xn interfaces for use to perform the example embodiments. Each of the one or more transceivers TRANS 12D includes a receiver and a transmitter. The one or more transceivers TRANS 12D can be optionally connected to one or more antennas for communication over at least link 221 with the receiver device 110. The one or more memories MEM 12B and the computer program code PROG 12C are configured to cause, with the one or more processors DP 12A, the LMF 12 to perform one or more of the operations as described herein. The LMF 12 may communicate with the gNB or eNB 170 such as via link 225 and 131. Further, the link 221, 225, or 131and/or any other link may be wired or wireless or both and may implement, e.g., an X2 or Xn interface. Further the link 221, 225, or 13 land may be through other network devices such as, but not limited to an NCE/MME/SGW/UDM/PCF/AMF/SMF/LMF 14 device as in FIG. 13. The LMF 12 may perform functionalities of an MME (Mobility Management Entity) or SGW (Serving Gateway), such as a User Plane Functionality, and/or an Access Management functionality for LTE and similar functionality for 5G.
[0083] The wireless network 100 may implement network virtualization, which is the process of combining hardware and software network resources and network functionality into a single, software-based administrative entity, a virtual network. Network virtualization involves platform virtualization, often combined with resource virtualization. Network virtualization is categorized as either external, combining many networks, or parts of networks, into a virtual unit, or internal, providing network-like functionality to software containers on a single system. Note that the virtualized entities that result from the network virtualization are still implemented, at some level, using hardware such as processors 152 or 175 and memories 155 and 171, and also such virtualized entities create technical effects.
[0084] The computer readable memories 125, 155, and 171 may be of any type suitable to the local technical environment and may be implemented using any suitable data storage technology, such as semiconductor based memory devices, flash memory, magnetic memory devices and systems, optical memory devices and systems, fixed memory and removable memory. The computer readable memories 125, 155, and 171 may be means for performing storage functions. The processors 120, 152, and 175 may be of any type suitable to the local technical environment, and may include one or more of general purpose computers, special purpose computers, microprocessors, digital signal processors (DSPs) and processors based on a multi-core processor architecture, as non-limiting examples. The processors 120, 152, and 175 may be means for performing functions and other functions as described herein to control a network device such as the receiver device 110, sender device 170, and/or NCE/MME/SGW 190 as in FIG. 12.
[0085] It is noted that functionality(ies), in accordance with example embodiments of the invention, of any devices as shown in FIG. 12, e.g., the receiver device 110 and/or sender device 170 can also be implemented by other network nodes, e.g., a wireless or wired relay node (a.k.a., integrated access and/or backhaul (IAB) node). In the IAB case, UE functionalities may be carried out by MT (mobile termination) part of the IAB node, and gNB functionalities by DU (Data Unit) part of the IAB node, respectively. These devices can be linked to the receiver device 110 as in FIG. 12 at least via the wireless link 111 and/or via the NCE/MME/SGW 190 using link 199 to Other Network(s)/Internet as in FIG. 12.
[0086] As similarly stated above, example embodiments of the invention relate to a gradual decoding refresh technique, in which a refresh area starts at any location of GDR/recovering picture and gradually expands over associated recovering pictures.
[0087] A non-transitory computer-readable medium (Memory(ies) 155 as in FIG. 12) storing program code (Computer Program Code 153 and/or the encoding and/or decoding module 150-2 as in FIG. 12), the program code executed by at least one processor (Processor(s) 152 and/or the encoding and/or decoding module 150-1 as in FIG. 12) to perform the operations as at least described in the paragraphs above.
[0088] In accordance with an example embodiments as described above there is an apparatus comprising: means for determining (Memory(ies) 125, 155; Computer Program Code 123, 153; encoding/decoding module 140-1, 150-1; and Processor(s) 120, 152 as in FIG. 12) an area in a gradual decoding refresh (GDR) or recovering (GDR/recovering) picture; means for defining (Memory(ies) 125, 155; Computer Program Code 123, 153; encoding/decoding module 140-1, 150-1; and Processor(s) 120, 152 as in FIG. 12) one or more virtual boundaries for the GDR/recovering picture, wherein the one or more virtual boundaries separate the GDR/recovering picture into two or more areas; means for associating (Memory(ies) 125, 155; Computer Program Code 123, 153; encoding/decoding module 140-1, 150-1; and Processor(s) 120, 152 as in FIG. 12) a flag with each of the one or more virtual boundaries, wherein the flag specifies at least one of which side of the associated virtual boundary is in a refreshed area or which side is in a non-refreshed area; and means for encoding and signaling (One or more antennas/Remote radio head 128, 195; Memory(ies) 125, 155; Computer Program Code 123, 153 the flag to a decoder.
[0089] In an example embodiment to the paragraph above, wherein at least the means for determining, defining, associating, and encoding and signaling comprises a non-transitory computer readable medium [One or more antennas/Remote radio head 128, 195; Memory(ies) 125, 155 as in FIG. 12] encoded with a computer program [Computer Program Code 123, 153 and/or the encoding/decoding module 140-1, 150-2 as in FIG. 12] executable by at least one processor [Processor(s) 120, 152 as in FIG. 12].
[0090] A non-transitory computer-readable medium (Memory(ies) 125, 155 as in FIG. 12) storing program code (Computer Program Code 123, 153 and/or the encoding/decoding Module 140-1, 150-2 as in FIG. 12), the program code executed by at least one processor (Processor(s) 120, 152) to perform the operations as at least described in the paragraphs above.
[0091] In accordance with an example embodiments as described above there is an apparatus comprising: means for receiving (One or more antennas/Remote radio head 128, 195; Memory(ies) 125, 155; Computer Program Code 123, 153; encoding/decoding module 140-1, 150-1; and Processor(s) 120, 152 as in FIG. 12) a gradual decoding refresh (GDR) or recovering (GDR/recovering) picture, wherein the GDR/recovering picture comprises one or more virtual boundaries, wherein the one or more virtual boundaries separate the GDR/recovering picture into two or more areas; means for receiving (One or more antennas/Remote radio head 128, 195; Memory(ies) 125, 155; Computer Program Code 123, 153; encoding/decoding module 140-1, 150-1; and Processor(s) 120, 152 as in FIG. 12) a flag associated with each of the one or more virtual boundaries, wherein the flag specifies at least one of which side of each of the one or more virtual boundaries is in a refreshed area or which side in a non-refreshed area; and means for decoding (Memory(ies) 125, 155; Computer Program Code 123, 153; encoding/decoding module 140-1, 150-1; and Processor(s) 120, 152 as in FIG. 12) the GDR/recovering picture based on the one or more virtual boundaries and associated flags.
[0092] In an example embodiment to the paragraph above, wherein at least the means for receiving and decoding comprises a non-transitory computer readable medium [One or more antennas/Remote radio head 128, 195; Memory(ies) 125, 155 as in FIG. 12] encoded with a computer program [Computer Program Code 123, 153 and/or the encoding/decoding module 140-1, 150-2 as in FIG. 12] executable by at least one processor [Processor(s) 120, 152 as in FIG. 12].
[0093] A non-transitory computer-readable medium (Memory(ies) 125, 155 as in FIG. 12) storing program code (Computer Program Code 123, 153 and/or the encoding/decoding Module 140-1, 150-2 as in FIG. 12), the program code executed by at least one processor (Processor(s) 120, 152) are caused to perform the operations as at least described in the paragraphs above.
[0094] In accordance with an example embodiments as described above there is an apparatus comprising: means for using (Memory(ies) 125, 155; Computer Program Code 123, 153; encoding/decoding module 140-1, 150-1; and Processor(s) 120, 152 as in FIG. 12) a general gradual decoding refresh (GDR) technique, in which a refreshed area starts at any location in a gradual decoding refresh (GDR) picture and gradually expands over associated recovering picture.
[0095] In an example embodiment to the paragraph above, wherein at least the means for using comprises a non-transitory computer readable medium [One or more antennas/Remote radio head 128, 195; Memory(ies) 125, 155 as in FIG. 12] encoded with a computer program [Computer Program Code 123, 153 and/or the encoding/decoding module 140-1, 150-2 as in FIG. 12] executable by at least one processor [Processor(s) 120, 152 as in FIG. 12].
[0096] A non-transitory computer-readable medium (Memory(ies) 125, 155 as in FIG. 12) storing program code (Computer Program Code 123, 153 and/or the encoding/decoding Module 140-1, 150-2 as in FIG. 12), the program code executed by at least one processor (Processor(s) 120, 152) are caused to perform the operations as at least described in the paragraphs above.
[0097] In accordance with an example embodiments as described above there is an apparatus comprising: means for receiving (One or more antennas/Remote radio head 128, 195; Memory(ies) 125, 155; Computer Program Code 123, 153; encoding/decoding module 140-1, 150-1; and Processor(s) 120, 152 as in FIG. 12) a gradual decoding refresh (GDR) or recovering (GDR/recovering) picture, wherein a refreshed area starts at any location in the gradual decoding refresh (GDR) picture and expands over the recovering picture.
[0098] In an example embodiment to the paragraph above, wherein at least the means for receiving comprises a non-transitory computer readable medium [One or more antennas/Remote radio head 128, 195; Memory(ies) 125, 155 as in FIG. 12] encoded with a computer program [Computer Program Code 123, 153 and/or the encoding/decoding module 140-1, 150-2 as in FIG. 12] executable by at least one processor [Processor(s) 120, 152 as in FIG. 12].
[0099] A non-transitory computer-readable medium (Memory(ies) 125, 155 as in FIG. 12) storing program code (Computer Program Code 123, 153 and/or the encoding/decoding Module 140-1, 150-2 as in FIG. 12), the program code executed by at least one processor (Processor(s) 120, 152) are caused to perform the operations as at least described in the paragraphs above.
[0100] Further, in accordance with example embodiments of the invention there is circuitry for performing operations in accordance with example embodiments of the invention as disclosed herein. This circuitry may include any type of circuitry including content coding circuitry, content decoding circuitry, processing circuitry, image generation circuitry, data analysis circuitry, and the like.). Further, this circuitry may include discrete circuitry, application-specific integrated circuitry (ASIC), and/or field-programmable gate array circuitry (FPGA), and the like, as well as a processor specifically configured by software to perform the respective function, or dualcore processors with software and corresponding digital signal processors, and the like.). Additionally, there are provided necessary inputs to and outputs from the circuitry, the function performed by the circuitry and the interconnection (perhaps via the inputs and outputs) of the circuitry with other components that may include other circuitry in order to perform example embodiments of the invention as described herein.
[0101] In accordance with example embodiments as disclosed in this application this application, the “circuitry” provided may include at least one or more or all of the following:
(a) hardware-only circuit implementations (such as implementations in only analog and/or digital circuitry);
(b) combinations of hardware circuits and software, such as (as applicable):
(i) a combination of analog and/or digital hardware circuit(s) with software/firmware; and
(ii) any portions of hardware processor(s) with software (including digital signal processor(s)), software, and memory(ies) that work together to cause an apparatus, such as a mobile phone or server, to perform various functions, such as functions or operations in accordance with example embodiments of the invention as disclosed herein); and (c) hardware circuit(s) and or processor(s), such as a microprocessor(s) or a portion of a microprocessor(s), that requires software (e.g., firmware) for operation, but the software may not be present when it is not needed for operation.”
[0102] In general, the various embodiments may be implemented in hardware or special purpose circuits, software, logic or any combination thereof. For example, some features may be implemented in hardware, while other aspects may be implemented in firmware or software which may be executed by a controller, microprocessor or other computing device, although the invention is not limited thereto. While various aspects of the invention may be illustrated and described as block diagrams, flow charts, or using some other pictorial representation, it is well understood that these blocks, apparatus, systems, techniques or methods described herein may be implemented in, as non-limiting examples, hardware, software, firmware, special purpose circuits or logic, general purpose hardware or controller or other computing devices, or some combination thereof.
[0103] Embodiments of the inventions may be practiced in various components such as integrated circuit modules. The design of integrated circuits is by and large a highly automated process. Complex and powerful software tools are available for converting a logic level design into a semiconductor circuit design ready to be etched and formed on a semiconductor substrate.
[0104] In some embodiments, certain ones of the operations above may be modified or further amplified. Furthermore, in some embodiments, additional optional operations may be included. Modifications, additions, or amplifications to the operations above may be performed in any order and in any combination.
[0105] Though, some example embodiments have been described with the help of gradual decoding refresh and gradual decoding refresh picture(s), it needs to be understood, however, that the embodiments are also applicable to other refresh decoding techniques and recovering pictures. Further, the embodiments may have been described with help of the central area of the recovering picture as start of the refreshed area, it needs to be understood, however the embodiments are also applicable to scenarios where the start of the refreshed area is any other location in the recovering picture.
[0106] In the above, where example embodiments have been described with reference to an encoder, it needs to be understood that the resulting bitstream and the decoder have corresponding elements in them. Likewise, where example embodiments have been described with reference to a decoder, it needs to be understood that the encoder has structure and/or computer program for generating the bitstream to be decoded by the decoder.
[0107] The word "exemplary" is used herein to mean "serving as an example, instance, or illustration." Any embodiment described herein as "exemplary" is not necessarily to be construed as preferred or advantageous over other embodiments. All of the embodiments described in this Detailed Description are exemplary embodiments provided to enable persons skilled in the art to make or use the invention and not to limit the scope of the invention which is defined by the claims.
[0108] The foregoing description has provided by way of exemplary and non-limiting examples a full and informative description of the best method and apparatus presently contemplated by the inventors for carrying out the invention. However, various modifications and adaptations may become apparent to those skilled in the relevant arts in view of the foregoing description, when read in conjunction with the accompanying drawings and the appended claims. However, all such and similar modifications of the teachings of this invention will still fall within the scope of this invention.
[0109] It should be noted that the terms "connected," "coupled," or any variant thereof, mean any connection or coupling, either direct or indirect, between two or more elements, and may encompass the presence of one or more intermediate elements between two elements that are "connected" or "coupled" together. The coupling or connection between the elements can be physical, logical, or a combination thereof. As employed herein two elements may be considered to be "connected" or "coupled" together by the use of one or more wires, cables and/or printed electrical connections, as well as by the use of electromagnetic energy, such as electromagnetic energy having wavelengths in the radio frequency region, the microwave region and the optical (both visible and invisible) region, as several non-limiting and non-exhaustive examples.
[0110] Furthermore, some of the features of the embodiments of this invention could be used to advantage without the corresponding use of other features. As such, the foregoing description should be considered as merely illustrative of the principles of the invention, and not in limitation thereof.

Claims

CLAIMS What is claimed is:
1. A method comprising: using a general gradual decoding refresh (GDR) technique, in which a refreshed area starts at any location in a gradual decoding refresh (GDR) picture and gradually expands over associated recovering picture.
2. The method of claim 1 further comprising: determining an area in the gradual decoding refresh (GDR) or recovering (GDR/recovering) picture; defining one or more virtual boundaries for the GDR/recovering picture, wherein the one or more virtual boundaries separate the GDR/recovering picture into two or more areas; associating an indication message or information with each of the one or more virtual boundaries, wherein the indication message or information specifies at least one of which side of the associated virtual boundary is in a refreshed area or which side is in a nonrefreshed area; and encoding and signaling the indication message or information to a decoder.
3. A method comprising: receiving a gradual decoding refresh (GDR) or recovering (GDR/recovering) picture, wherein a refreshed area starts at any location in the gradual decoding refresh (GDR) picture and expands over the recovering picture.
4. The method of claim 3, wherein the GDR/recovering picture comprises one or more virtual boundaries, wherein the one or more virtual boundaries separate the GDR/recovering picture into two or more areas, and wherein the method further comprises: receiving an indication message or information associated with each of the one or more virtual boundaries, -wherein the indication message or information specifies at least one of which side of each of the one or more virtual boundaries is in the refreshed area or which side is in a non-refreshed area; and decoding the GDR/recovering picture based on the one or more virtual boundaries and associated indication message or information.
5. The method of any of the previous claims, wherein when the indication message or information is equal to 1 specifies position or location of the refreshed area with respect to the virtual boundary associated with the indication message or information.
6. The method of any of the previous claims, wherein when the indication message or information is equal to 0 specifies position or location of a non-refreshed area with respect to the virtual boundary associated with the indication message or information.
7. The method of any of the previous claims, wherein the one or more virtual boundaries comprise one or more vertical virtual boundaries and/or one or more horizontal virtual boundaries.
8. The method of claim 7, wherein when the indication message or information is equal to 1 and is associated with a vertical virtual boundary, the indication message or information specifies that the area on left of the vertical virtual boundary is the refreshed area and the area on the right of the vertical virtual boundary is the non-refreshed area.
9. The method of claim 7, wherein when the indication message or information is equal to 1 and is associated with a horizontal virtual boundary, the indication message or information specifies that the area above the horizontal virtual boundary is the refreshed area and the area below the horizontal virtual boundary is the non-refreshed area.
10. The method of claim 7, wherein when the indication message or information is equal to 0 and is associated with a vertical virtual boundary, the indication message or information specifies that the area on left of the vertical virtual boundary is the nonrefreshed area and the area on right of the vertical virtual boundary is the refreshed area.
11. The method of claim 7, wherein when the indication message or information is equal to 0 and is associated with a horizontal virtual boundary, the indication message or information specifies that the area above the horizontal virtual boundary is the nonrefreshed area and the area below the horizontal virtual boundary is the refreshed area.
12. An apparatus comprising: at least one processor; and at least one memory storing instructions that, when executed by the at least one processor, cause the apparatus at least to perform: using a general gradual decoding refresh (GDR) technique, in which a refreshed area starts at any location in a gradual decoding refresh (GDR) picture and gradually expands over associated recovering picture.
13. The apparatus of claim 12, wherein the apparatus is further caused to perform: determining an area in a gradual decoding refresh (GDR) or recovering (GDR/recovering) picture; defining one or more virtual boundaries for the GDR/recovering picture, wherein the one or more virtual boundaries separate the GDR/recovering picture into two or more areas; associating an indication message or information with each of the one or more virtual boundaries, wherein the indication message or information specifies at least one of which side of the associated virtual boundary is in a refreshed area or which side is in a nonrefreshed area; and encoding and signaling the indication message or information to a decoder.
14. An apparatus comprising: at least one processor; and at least one memory storing instructions that, when executed by the at least one processor, cause the apparatus at least to perform: receiving a gradual decoding refresh (GDR) or recovering (GDR/recovering) picture, wherein a refreshed area starts at any location in the gradual decoding refresh (GDR) picture and expands over the recovering picture.
15. The apparatus of claim 14, wherein the GDR/recovering picture comprises one or more virtual boundaries, wherein the one or more virtual boundaries separate the GDR/recovering picture into two or more areas, and wherein the apparatus is further caused to perform: receiving an indication message or information associated with each of the one or more virtual boundaries, wherein the indication message or information specifies at least one of which side of each of the one or more virtual boundaries is in the refreshed area or which side is in a non-refreshed area; and decoding the GDR/recovering picture based on the one or more virtual boundaries and associated indication message or information.
16. The apparatus of any of the previous claims, wherein when the indication message or information is equal to 1 specifies position or location of the refreshed area with respect to the virtual boundary associated with the indication message or information.
17. The apparatus of any of the previous claims, wherein when the indication message or information is equal to 0 specifies position or location of a non-refreshed area with respect to the virtual boundary associated with the indication message or information.
18. The apparatus of any of the previous claims, wherein the one or more virtual boundaries comprise one or more vertical virtual boundaries and/or one or more horizontal virtual boundaries.
19. The apparatus of claim 18, wherein when the indication message or information is equal to 1 and is associated with a vertical virtual boundary, the indication message or information specifies that the area on left of the vertical virtual boundary is the refreshed area and the area on the right of the vertical virtual boundary is the non-refreshed area.
20. The apparatus of claim 18, wherein when the indication message or information is equal to 1 and is associated with a horizontal virtual boundary, the indication message or information specifies that the area above the horizontal virtual boundary is the refreshed area and the area below the horizontal virtual boundary is the non-refreshed area.
21. The apparatus of claim 18, wherein when the indication message or information is equal to 0 and is associated with a vertical virtual boundary, the indication message or information specifies that the area on left of the vertical virtual boundary is the nonrefreshed area and the area on right of the vertical virtual boundary is the refreshed area.
22. The apparatus of claim 18, wherein when the indication message or information is equal to 0 and is associated with a horizontal virtual boundary, the indication message or information specifies that the area above the horizontal virtual boundary is the nonrefreshed area and the area below the horizontal virtual boundary is the refreshed area.
23. A computer-readable medium encoded with instructions that, when executed by a computer, causing an apparatus to perform methods as claimed in any of the claims 1 to 9.
24. The computer-readable medium of claim 23, wherein the computer-readable medium comprises a non-transitory computer-readable medium.
25. An apparatus comprising means for performing the methods as claimed in any of the claims 1 to 11.
PCT/IB2024/050339 2023-01-16 2024-01-12 Flexible gradual decoding refresh Ceased WO2024154030A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN202480018247.8A CN120917734A (en) 2023-01-16 2024-01-12 Flexible progressive decoding refresh
EP24701289.1A EP4652730A1 (en) 2023-01-16 2024-01-12 Flexible gradual decoding refresh

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US202363480085P 2023-01-16 2023-01-16
US63/480,085 2023-01-16

Publications (1)

Publication Number Publication Date
WO2024154030A1 true WO2024154030A1 (en) 2024-07-25

Family

ID=89661968

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/IB2024/050339 Ceased WO2024154030A1 (en) 2023-01-16 2024-01-12 Flexible gradual decoding refresh

Country Status (3)

Country Link
EP (1) EP4652730A1 (en)
CN (1) CN120917734A (en)
WO (1) WO2024154030A1 (en)

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7826531B2 (en) * 2002-04-29 2010-11-02 Nokia Corporation Indicating regions within a picture
WO2022200042A1 (en) * 2021-03-25 2022-09-29 Nokia Technologies Oy General region-based hash

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7826531B2 (en) * 2002-04-29 2010-11-02 Nokia Corporation Indicating regions within a picture
WO2022200042A1 (en) * 2021-03-25 2022-09-29 Nokia Technologies Oy General region-based hash

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
WANG (NOKIA) L ET AL: "AHG 12: Flexible GDR", no. JVET-AE0145, 4 July 2023 (2023-07-04), XP030311432, Retrieved from the Internet <URL:https://jvet-experts.org/doc_end_user/documents/31_Geneva/wg11/JVET-AE0145-v1.zip JVET-AE0145.docx> [retrieved on 20230704] *

Also Published As

Publication number Publication date
EP4652730A1 (en) 2025-11-26
CN120917734A (en) 2025-11-07

Similar Documents

Publication Publication Date Title
US20200260117A1 (en) Methods and Apparatuses for Coding and Decoding Depth Map
EP3618441A1 (en) Method and device for motion vector prediction
JP6194427B2 (en) Coding and derivation of quantization parameters
EP3550836B1 (en) Decoding method and apparatus
EP3557874B1 (en) Image prediction method and related device
US8929450B2 (en) Temporal block merge mode
EP2991349A1 (en) Method of palette index signaling for image and video coding
US11297316B2 (en) Method and system for adaptive cross-component filtering
JP2019511153A (en) Method and device for intra-prediction coding / decoding a coding unit comprising picture data, wherein the intra-prediction coding is dependent on a prediction tree and a transformation tree
US9729885B2 (en) Apparatus and method for compressing color index map
BR112013002029B1 (en) METHOD, DEVICE AND STORAGE MEANS
KR20210104907A (en) Method and apparatus for constructing a candidate MV list
US20140153648A1 (en) Method and apparatus for encoding motion information using skip mode, and method and apparatus for decoding same
US12052437B2 (en) Systems and methods for explicit signaling of scaling factors for joint coding of motion vector difference
JP2023105074A (en) A Global Motion Model for Motion Vector Inter Prediction
EP4652730A1 (en) Flexible gradual decoding refresh
US20220264135A1 (en) Motion Model Signaling
WO2024199832A1 (en) Context adapaptive binary arithmetic coding initialization for gradual decoder refresh pictures
JP2025510431A (en) Systems and methods for explicit signaling of scaling factors for joint coding of motion vector differentials - Patents.com
US20250097481A1 (en) Method, apparatus, and medium for video processing
CN116389763B (en) Video coding method and device based on multiple encoders
CN111447453B (en) Image processing method and device
US10003813B2 (en) Method and system for decoding by enabling optimal picture buffer management
WO2025214712A1 (en) Coding with multiple history-based motion vector prediction tables
CN117397240A (en) Systems and methods for explicit signaling of scaling factors for joint coding of motion vector differences

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 24701289

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 202547075754

Country of ref document: IN

NENP Non-entry into the national phase

Ref country code: DE

WWP Wipo information: published in national office

Ref document number: 202547075754

Country of ref document: IN

WWE Wipo information: entry into national phase

Ref document number: CN2024800182478

Country of ref document: CN

Ref document number: 202480018247.8

Country of ref document: CN

WWP Wipo information: published in national office

Ref document number: 202480018247.8

Country of ref document: CN

WWP Wipo information: published in national office

Ref document number: 2024701289

Country of ref document: EP