JP2009038782A - Image processing apparatus, image processing method, program for image processing method, and recording medium recording program for image processing method - Google Patents

Abstract

The present invention relates to an image processing apparatus, an image processing method, a program for the image processing method, and a recording medium on which the program for the image processing method is recorded. The processing time when displaying the image data is shortened, and the bandwidth and power consumption required for processing the image data are reduced.
[Solution]
The present invention converts the encoded data D1 into the independently decodable encoded data D2 and stores it in the storage unit 21 so that it can be independently decoded for each independent decoding unit formed by dividing one screen. The image data D3 is decoded and processed in units of processing blocks by one or a plurality of independent decoding units.
[Selection] Figure 1

Description

  The present invention relates to an image processing apparatus, an image processing method, a program for the image processing method, and a recording medium on which the program for the image processing method is recorded, and can be applied to, for example, a digital still camera. The present invention converts encoded data into independently-decodable encoded data after being stored in a storage unit so as to be independently decodable for each independent decoding unit formed by dividing one screen. By decoding and processing the image data in units of processing blocks with a size larger than the encoding unit, the processing time for displaying the encoded image data is shortened compared to conventional processing, and the image data processing To reduce bandwidth and power consumption.

  Conventionally, a digital still camera encodes image data obtained from an image sensor by a JPEG (Joint Photographic Experts Group) method to generate encoded data, and records the encoded data on a recording medium. . Also, the digital still camera reproduces the encoded data recorded on the recording medium and decodes the image data by the user's operation, and then resizes and displays the image data at a resolution suitable for display.

  Regarding processing such as resizing, for example, in Japanese Patent Application Laid-Open No. 2007-15884, when encoded data recorded on a recording medium is subjected to image processing and re-recorded, the encoded data is decoded in units of image processing. A method for reducing the capacity of a buffer memory for temporarily storing image processing results after rearranging after processing, image processing, and encoding processing has been proposed.

  By the way, the conventional digital still camera has a problem that it takes time to process the encoded data recorded on the recording medium and displays it, and also requires a sufficient bandwidth for the processing, resulting in an increase in power consumption. There was a problem.

  Specifically, FIG. 30 is a schematic diagram for explaining the case where image data is decoded and displayed in a conventional digital still camera. The example of FIG. 30 is a case where 10 [Mpixel] and 4 [MB] of encoded data DA1 indicated by the encoded image is stored in the recording medium 1. In this case, the digital still camera transfers the encoded data DA1 of 4 [MB] from the recording medium 1 to the decoding unit 2, decodes the image data DA2, and stores the decoded image data DA2 indicated by the decoded image in the memory 3. Store. The image data DA2 stored in the memory 3 is input to the image processing unit 4 and resized to a resolution suitable for the display unit. Further, the resized image data DA3 indicated by the processing result image is stored in the memory 3, and the image data stored in the memory 3 is displayed on the display unit.

  Here, it is assumed that the encoded data stored in the recording medium 1 is processed by the decoding unit 2 and 20 [MB] image data DA2 is decoded. In the image processing unit 4, the number of pixels of the 20 [MB] image data DA2 is reduced to 1/10 to generate image data DA3 of 1 [Mpixel] and 2 [MB]. In this case, it is necessary to transfer a total of 46 [MB] data until the encoded data DA1 is read from the recording medium 1 and the image data DA3 is stored in the memory 3. As a result, the digital still camera requires a sufficient band for processing image data, and power consumption increases. In addition, the number of times the memory 3 is accessed increases, and processing takes time.

As one method for solving this problem, a method of directly inputting the image data DA2 decoded by the decoding unit 2 to the image processing unit 4 and processing it can be considered. In this method, a plurality of lines are added to the image processing unit 4. It is necessary to provide a delay circuit for a minute, and the configuration of the image processing unit 4 becomes extremely complicated.
JP 2007-15884 A

  The present invention has been made in consideration of the above points, and compared with the prior art, the processing time when displaying encoded image data is shortened, and the bandwidth and power consumption required for processing the image data are reduced. Image processing apparatus, image processing method, image processing method program, and recording medium on which the image processing method program is recorded are proposed.

  In order to solve the above problems, the invention of claim 1 is applied to an image processing apparatus that decodes and processes image data from variable-length encoded data, and independently decodes one screen divided by the encoded data. A code conversion unit that converts the encoded data into encoded data that can be independently decoded, and the independent decoding that is output from the code conversion unit can be decoded into image data based on the encoded data independently for each unit. A storage unit that stores encoded data, and a decoding unit that reads the independently decodable encoded data stored in the storage unit and decodes the image data in units of processing blocks larger than the independent decoding unit. And an image processing unit that processes the image data decoded by the decoding unit in units of the processing blocks.

  The invention of claim 15 is applied to an image processing method for decoding and processing image data from variable-length encoded data, and is independent for each independent decoding unit obtained by dividing one screen of the encoded data. A code conversion step for converting the encoded data into independently decodable encoded data so that the encoded data can be decoded into image data, and the independently decodable encoded data output from the code conversion step. And a decoding step of reading out the independently decodable encoded data stored in the storage unit and decoding the image data in units of processing blocks larger than the independent decoding unit, An image processing step of processing the image data decoded in the decoding step in units of the processing blocks.

  The invention of claim 16 is applied to a program of an image processing method for decoding and processing image data from variable-length encoded data, and for each independent decoding unit obtained by dividing one screen of the encoded data, A code conversion step for converting the encoded data into independently decodable encoded data so that the encoded data can be independently decoded into image data; and the independently decodable encoded data output from the code conversion step. A storage step of storing in the storage unit; and a decoding step of reading out the independently decodable encoded data stored in the storage unit and decoding the image data in units of processing blocks larger than the independent decoding unit. And an image processing step of processing the image data decoded in the decoding step in units of the processing blocks.

  The invention of claim 17 is applied to a recording medium on which a program of an image processing method for decoding and processing image data from variable-length encoded data is recorded, and the program displays one screen of the encoded data. A code conversion step for converting the encoded data into independently decodable encoded data so that it can be decoded into image data based on the encoded data independently for each divided independent decoding unit, and output from the code conversion step. Storing the independently decodable encoded data in the storage unit; and reading the independently decodable encoded data stored in the storage unit in units of processing blocks larger than the independent decoding unit. A decoding step for decoding the image data; and an image processing step for processing the image data decoded in the decoding step in units of the processing blocks. So that provided the door.

  According to the configuration of claim 1, claim 15, claim 16, or claim 17, instead of the decoded image data, the independently decodable encoded data having a smaller data amount than the decoded image data is obtained. Independently decodable encoded data of an independent decoding unit corresponding to a processing block of image processing can be selectively read from the storage unit and image processed by being held in the storage unit. Therefore, the capacity of the storage means can be reduced as compared with the case where the decoded image data is stored in the storage means, the amount of data from the storage means is reduced, the processing time is shortened, and the image data Bandwidth and power consumption required for processing can be reduced.

  According to the present invention, it is possible to shorten the processing time when displaying image data that has been subjected to encoding processing as compared with the prior art, and to reduce the bandwidth and power consumption required for processing the image data.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings as appropriate.

(1) Overall Configuration FIG. 2 is a block diagram showing a digital still camera according to Embodiment 1 of the present invention. The digital still camera 11 captures a desired subject with an imaging unit (not shown) and acquires image data. The digital still camera 11 generates encoded data D1 by encoding the acquired image data using a JPEG technique by an encoding unit (not shown). The digital still camera 11 records the encoded data D1 on the recording medium 13. Here, the recording medium 13 is an optical disk, a hard disk, a memory card, or the like. The digital still camera 11 decodes the encoded data D1 recorded on the recording medium 13 and displays it on the display 14 in response to a user operation.

  Here, the control unit 15 records the encoded data D1 output from the encoding unit to the bus BUS on the recording medium 13 under the control of the central processing unit (CPU) 16. Also, the encoded data D1 recorded on the recording medium 13 is reproduced and output to the bus BUS.

  The code conversion unit 17 acquires encoded data D1 that is reproduced from the recording medium 13 and output to the bus BUS under the control of the central processing unit 16. Further, in a predetermined block unit formed by dividing one screen by the encoded data D1, each block can be individually decoded independently, and the obtained encoded data D1 is subjected to data conversion and independently decoded encoded data. D2 is generated. The code conversion unit 17 stores the generated independently decodable encoded data D2 in the random access memory 21 via the bus BUS. Hereinafter, these independently decodable blocks are referred to as independent decoding units, and are configured by one or a plurality of MCUs (Minimum Code Units).

  The decoding unit 12 acquires independently decodable encoded data D2 from the random access memory 21 via the bus BUS in accordance with the processing in the image processing unit 19. The acquired independently decodable encoded data D2 is processed and decoded into image data D3. The decoding unit 12 outputs the decoded image data D3 to the image processing unit 19 via a buffer memory (not shown).

  The image processing unit 19 receives the image data D3 output from the decoding unit 12 under the control of the central processing unit 16. The image processing unit 19 resizes the image data D3, converts the image data D3 into image data D4 corresponding to the resolution of the display 14, and outputs the image data D4.

  The display unit 20 drives the display 14 with the image data D4 output from the image processing unit 19, and displays the image data D4 on the display 14. The display 14 is configured by a liquid crystal display device, for example.

  The central processing unit 16 secures a work area in a random access memory (RAM) 21 and executes a program stored in a read only memory (ROM) 22, and in response to an operation of the key 23, the central processing unit 16 Control the operation of each part.

  The random access memory (RAM) 21 constitutes a work area of the central processing unit 16, and constitutes a buffer for temporarily storing the encoded data DA1, the independently decodable encoded data D2 and the like output to the bus BUS.

(2) Detailed Configuration of Code Conversion Unit 17, Decoding Unit 12, and Image Processing Unit 19 In this digital still camera 11, the image processing unit 19 performs a filtering process on the image data D3 output from the decoding unit 12 in units of processing blocks. Then, the resizing process is executed. Corresponding to the processing block unit processing of the image processing unit 19, the decoding unit 12 selectively decodes only the image data D 3 of the processing block processed by the image processing unit 19 and outputs it to the image processing unit 19. Prior to the processing of the decoding unit 12 and the image processing unit 19, the code conversion unit 17 converts the encoded data D1 for one screen into the independently decodable encoded data D2 and stores it in the random access memory 21. Here, this processing block is a block of processing units set for one screen by the encoded data D1, and is formed by one or a plurality of independent decoding processing units in the horizontal direction and the vertical direction, respectively.

  Here, as shown in FIG. 3A, in JPEG, image data is orthogonally transformed in units of MCUs that are units of encoding processing, and coefficient data obtained as a result is subjected to quantization processing and variable length encoding processing. Encoded data D1 is generated. In JPEG, among the coefficient data obtained by sequentially processing the MCU in the order of raster scanning and performing orthogonal transform processing, for the DC component coefficient data, encoded data D1 is generated by a so-called DC difference. Here, the DC difference is a difference value from the coefficient value of the DC component in the MCU processed immediately before. Therefore, in the encoded data D1 of JPEG, it is necessary to sequentially decode the MCUs in the order of the encoding process as indicated by the arrows in the encoded image that cannot be independently decoded in FIG. With selective processing, the original image data cannot be decoded.

  Therefore, as shown in FIG. 3B, the code conversion unit 17 sets a delimiter code for the delimiter of independent decoding units in the continuous encoded data D1, and continues to correspond to the setting of the delimiter code. The coefficient data of the direct current component provided in the MCU is changed, and the encoded data D1 is converted into the independently decodable encoded data D2. Here, the delimiter code is a code indicating that the subsequent encoding processing unit can be decoded without decoding the immediately preceding encoding processing unit. As described above, in JPEG, the coefficient data of the DC component is encoded by so-called DC difference, and in this embodiment, a restart marker indicating the processing start position by this DC difference is applied to this delimiter code. Is done.

  Here, in this embodiment, since the independent decoding unit is composed of one or a plurality of MCUs, and in the case of JPEG encoded data, the MCUs are sequentially processed in the raster scanning order. When one MCU is set, the restart marker is set for each MCU. When the independent decoding unit is composed of a plurality of MCUs that are continuous only in the horizontal direction, the restart marker is set when the MCU at the end of raster scanning of the independent decoding unit ends. In addition, when the independent decoding unit is configured by a plurality of MCUs that are continuous in the vertical direction and the horizontal direction, the restart marker is the raster scan end point of each line that is continuous in the horizontal direction in the independent decoding unit. Set when the MCU is finished.

  As shown in FIGS. 5A and 5B, the code conversion unit 17 sequentially reads the encoded data D1 from the recording medium 13, and generates DC component coefficient data DC-A, DC-B, DC-C, and DC. Only D and DC-E are selectively decoded sequentially. Also, according to the independent decoding unit, the decoded DC component coefficient data DC-C and DC-E are quantized and variable-length encoded, and the DC component encoded data DC-C2 independent of the DC difference is obtained. DC-E2 is generated. The code conversion unit 17 replaces the generated DC component encoded data DC-C2 and DC-E2 with the generated DC difference coefficient data DC-C and DC-E (FIG. 5B). Further, as shown in FIG. 5C, a restart marker RST is set at the head of the MCU in which the coefficient data is replaced to generate independently decodable encoded data D2. Therefore, in the example of FIG. 5, independent decoding units are created by MCU-A and MCU-B, MCU-C and MCU-D, respectively.

  Accordingly, as shown by the independently decodable image in FIG. 4, the independently decodable encoded data D2 can be independently decoded for each independent decoding unit. FIG. 4 shows a case where one MCU is set as an independent coding unit.

  Further, the code conversion unit 17 counts the number of bits of the independently decodable encoded data D2, and generates independent decoding start position information DS indicating the start position of the independent decoding processing unit based on the count value when the delimiter code is set. Here, the independent decoding start position information DS may be start position information from the head of the independently decodable encoded data D2, as shown in FIGS. 4 and 5, and a restart marker that continues from one restart marker RST. It may be the code length up to RST, or both of them. In these cases, the bit amount of the restart marker RST may be included in any unit of independent decoding processing before and after. Note that the insertion of the restart marker may be omitted and only the independent decoding start position information may be provided. In this case, the independent decoding start position information is in bit units.

  As shown in FIG. 1, the code conversion unit 17 converts the encoded data D1 for one screen into encoded data D2 that can be independently decoded before the processing in the decoding unit 12 and the image processing unit 19, and converts the converted independent data. The decodable encoded data D2 is stored in the memory 21 together with the independent decoding start position information DS. Therefore, in the example of FIG. 1, the encoded data DA1 of 10 [Mpixel] and 4 [MB] is converted into the independently decodable encoded data D2 of 10 [Mpixel] and 4.2 [MB], and this independent decoding is possible. The encoded data D2 is stored in the memory 21 together with the independent decoding start position information DS of 300 [KB].

  As shown in FIG. 6, the decoding unit 12 controls the independent processing of the independently decodable units constituting the processing block to be processed based on the independent decoding start position information DS stored in the memory 21 as shown in FIG. The decodable encoded data D2 is sequentially input from the memory 21. The decoding unit 12 decodes the image data D3 from the input independently decodable encoded data D2, and outputs it to the image processing unit 19 via a buffer memory (not shown).

  In FIG. 6, as shown in FIG. 7, the image of one screen based on the encoded data D <b> 1 is divided into three equal parts in the horizontal direction and the vertical direction to set independent decodable units A to I, and each independent decoding is possible. This is a case where the independently decodable encoded data D2 of the independently decodable unit E is processed when the units A to I are created by two MCUs in the vertical direction. In FIG. 6, the amount of data of each independently decodable unit A to I of the independently decodable encoded data D2 is indicated by the horizontal size of the block indicating each independently decodable unit A to I.

  The image processing unit 19 resizes the image data D3 to generate image data D4, and stores the image data D4 in the memory 21. That is, the image processing unit 19 performs a resizing process by filtering the image data D3 with a two-dimensional FIR (Finite Impulse Response) filter. In the image processing unit 19, a delay circuit that sequentially delays sequentially input image data by the length in the horizontal direction of the processing block is connected in series by the number corresponding to the number of taps in the vertical direction of the filter. A series connection circuit of the circuits is provided at the input stage of the two-dimensional filter. The image processing unit 19 sequentially inputs the output of each delay circuit to the two-dimensional filter while sequentially inputting and transferring the image data D3 to the serial circuit of the delay circuit in the raster scanning order in the processing block. Filtering is performed, and resizing processing is executed in units of processing blocks. Note that the series circuit of the delay circuits may be configured by a buffer memory.

(3) Independently Decodable Unit Here, when image data is subjected to filtering processing in the image processing unit 19, it is necessary to process overlapping image data in adjacent blocks. That is, as shown in FIG. 8A, for example, when resizing the central area A created by dividing one screen into three equal parts in the horizontal direction and then resizing the adjacent right area B, the boundary indicated by the arrow It is necessary to perform a new filtering process on the image data D3 in the area A adjacent to the image data. Therefore, in the case of FIG. 8A, as shown in FIG. 8B, the image data D3 of the areas a and b corresponding to the number of taps to be filtered are overlapped at the boundary between the areas A and B. It is necessary to perform filtering processing. Hereinafter, the areas a and b are referred to as overlapping processing areas.

  The independently decodable unit is set to a size that allows this overlapping processing area to be independently decoded so that this overlapping processing area can be repeatedly processed.

  Here, as shown in FIGS. 9A to 9D, the processing blocks of the image processing unit 19 are assumed to be blocks AA and AB each having one independently decodable unit in the horizontal direction and four in the vertical direction. It is assumed that the blocks AA and AB are sequentially filtered by the image processor 19. In FIG. 9A, one of the independently decodable units is indicated by hatching. In the following, although the filtering process is considered only in the horizontal direction, the overlapping processing region occurs between processing blocks adjacent in the vertical direction, and the same can be said as in the horizontal direction described below.

  Here, as shown in FIG. 9A, when the left block AA is filtered by the image processing unit 19, as shown in FIG. 9B, it is subjected to filtering processing on the boundary side with the right block AB. As many samples as t corresponding to the number of taps generate regions that cannot be normally filtered. Further, as shown in FIG. 9C, when the right block AB is subsequently filtered, the number of taps to be used for the filtering process similarly on the boundary side with the left block as shown in FIG. 9D. An area that cannot be normally filtered is generated by the number of samples t corresponding to.

  As a result, as shown in FIG. 9E, in this case, there are regions that cannot be normally filtered by a predetermined number of samples, with the boundary between the blocks AA and AB interposed therebetween. In this case, if the block C according to the size of the blocks AA and AB is set as a processing block, as shown in FIG. 9F, this normally unprocessable area can be processed normally. However, in this case, the configuration of the delay circuit or buffer memory provided in the input stage of the image processing unit 19 is increased. If an increase in the size of the delay circuit and the buffer memory can be allowed, a processing block and an independent decoding unit may be set as shown in FIG.

  Therefore, in this embodiment, as shown by reference numerals BLA and BLB in FIG. 10A in comparison with FIG. 9, an independent encoding processing unit is set so that the overlapping processing portion can be processed independently, and the overlapping processing portion is set. The processing block is set so that is processed multiple times together with the blocks on both sides. Specifically, in the example showing the horizontal processing in FIG. 10A, one independent encoding processing unit is set in the overlapping processing portion indicated by the symbol w. In addition, the block width WBL of the processing blocks on the right side and the left side of the overlapping portion is set to a width corresponding to two independent encoding processing units. Therefore, in the example of FIG. 10A, the processing blocks BLA, BLB, and BLC are sequentially decoded by the decoding unit 12 and sequentially resized by the image processing unit 19.

  Here, as shown in FIG. 10 (B) in comparison with FIG. 10 (A), two or more independent encoding processing units are set in the overlapping processing area so that the overlapping processing area can be processed independently. Also good.

  If the width of the independent decoding unit is W, the number of taps of the filtering process is T, and the width obtained by converting the output sample interval to the input sample interval is S, the minimum value of the width w of the overlapping processing region is The width w of the overlapping processing area needs to be equal to or larger than the width obtained by rounding up the minimum number of samples required for the filtering process in units of independent decoding. If the width w of the overlap processing area is smaller than the value of (1), it becomes difficult for the digital still camera 11 to input an extra number of samples necessary for the filtering process to the image processing unit 19 and the image quality deteriorates. Will do. Here, ceil is a function that rounds up the parentheses to make an integer.

  From this equation (1), the minimum value of the maximum width required for processing one image of the processing block width WBL can be expressed by the following equation, and the processing block width WBL is the minimum required width for filtering processing. It is necessary to set the overlap width by adding one or more independent decoding units to the width obtained by rounding up the number of independent decoding units. Here, the right side of Expression (2) is obtained by adding the width W of the independent decoding unit to the right side of Expression (1). Therefore, the width of the processing block needs to be a value obtained by adding one or more independent decoding units to the width of the independent decoding units set in the overlapping processing area.

(4) Operation of Embodiment In the above configuration, in the digital still camera 11 (FIG. 2), the image data of the imaging result obtained by the imaging unit (not shown) is encoded by the encoding unit and obtained as a result. The encoded data D1 is recorded on the recording medium 13 by the control unit 15. When the user instructs to monitor the imaging result recorded on the recording medium 13, the encoded data D 1 recorded on the recording medium 13 is read out and decoded by the decoding unit 12, and then resized by the image processing unit 19. And displayed on the display 14.

  In the display of the image data on the display 14, as in the conventional case, if all the encoded data D1 is processed and the original image data is decoded and then resized (FIG. 30), the memory capacity is large. In addition, time is required for processing, and the bandwidth and power consumption required for processing image data increase.

  Therefore, in this embodiment, in the image processing unit 19, the resizing process is executed in units of processing blocks set for one screen by the encoded data D 1, and for each processing block subjected to image processing by the image processing unit 19, The image data D3 is decoded by the decoding unit 12. In addition, in order to enable decoding for each processing block, the encoded data D1 is encoded data that can be independently decoded in advance in the code conversion unit 17 so that it can be decoded for each independent decoding unit constituting the processing block. It is converted to D2 and stored in the memory 21. In addition, since the encoded data D1 that is the generation source of the independently decodable encoded data D2 is variable length encoded data, the independent decoding start indicating the start position of each independent decoding unit in the independently decodable encoded data D2 The position information DS is detected, and this independent decoding start position information DS is stored in the memory 21. Further, based on the independent decoding start position information DS stored in the memory 21, the image data D3 is decoded from the independently decodable encoded data D2 in units of processing blocks.

  As a result, as shown in FIG. 1 in comparison with FIG. 30, in this embodiment, the independently-decodable encoded data D2 and the independent decoding start position information DS are stored in the memory 21 instead of the decoded image data DA2. As a result, the capacity of the memory 21 can be reduced. In addition, the access frequency of the memory 21 can be reduced, the processing time can be shortened, and the bandwidth and power consumption required for processing image data can be reduced. In the example of FIG. 1, the data transfer amount, which conventionally required 46 [MB] as a whole, can be reduced to 15 [MB], and the processing speed is remarkably improved as compared with the conventional case. Bandwidth and power consumption can be reduced.

  More specifically, in the digital still camera 11, the encoded data D1 is an independent decoding unit of one or a plurality of MCUs which are encoding processing units, and a delimiter code by a restart marker is set. Also, the coefficient data of the DC difference is replaced to generate independently decodable encoded data D2 (FIGS. 3 and 5), and this independently decodable encoded data D2 is stored in the memory 21 for one screen (FIG. 4). ).

  In the digital still camera 11, based on the independent decoding start position information DS recorded in the memory 21, the independently decodable encoded data D <b> 2 of the encoding processing unit constituting the processing block is read from the memory 21 and sequentially imaged. Data D3 is decoded. The decoded image data is sequentially resized by the image processing unit 19.

  In this series of image data processing, the digital still camera 11 is configured such that adjacent processing blocks overlap to form an overlapping processing region by a width equal to or greater than the width obtained by rounding up the minimum number of samples required for filtering processing in units of independent decoding. A continuous processing block is set. As a result, in the digital still camera 11, with respect to this overlapping processing area, the image data D 3 is repeatedly decoded and filtered in the processing of each processing block, and extra necessary for the filtering processing of the image processing unit 19. A large number of samples is ensured, and image quality deterioration due to filtering processing is prevented.

  Also, in the digital still camera 11, one or more independent decoding units are set in the overlapping processing area so that the overlapping processing area can be decoded independently, and image data is wasted when the overlapping processing area is repeatedly decoded. It is set not to decrypt. As a result, in the digital still camera 11, when the image data D3 is subjected to filtering processing while securing the number of samples necessary for filtering processing, the setting is made so as not to decode the image data D3 as much as possible. Can be processed.

(5) Advantages of the embodiment According to the above configuration, the encoded data is converted into the independently decodable encoded data so that it can be independently decoded for each independent decoding unit formed by dividing one screen. Processing when displaying image data encoded as compared with the prior art by decoding and processing the image data in units of processing blocks by one or more independent decoding units after storage in the memory The time can be shortened, and the bandwidth and power consumption required for processing image data can be reduced.

  Also, the start position information of the independent decoding unit in the independently decodable encoded data and / or the start position information of the independent decoding unit based on the information based on the data length of each independent decoding unit is recorded in the memory and retained. Based on the position information, by processing the independently decodable encoded data stored in the memory in units of processing blocks, variable length independently decodable encoded data that can be decoded independently for each independent decoding unit Data can be read from the memory and processed in units of processing blocks.

  In addition, by setting a delimiter code in the encoded data, and replacing the code of the encoded data so as to correspond to the setting of the delimiter code and generating independently decodable encoded data, It can be converted into independently decodable encoded data.

  More specifically, by setting a delimiter code with a restart marker indicating the start position of the encoding process based on DC difference, encoded data according to the JPEG method can be converted into encoded data that can be independently decoded.

  In addition, when processing image data by filtering using a filter with a predetermined number of taps, the adjacent processing blocks overlap each other by a width equal to or more than the width obtained by rounding up the minimum number of extra samples necessary for this filtering processing in units of independent decoding. By setting the processing block so that the processing area is formed, the filtering process can be executed while ensuring the minimum number of samples necessary for the filtering process, and the image quality deterioration in the processing result can be surely prevented. it can.

  In addition, by setting the width of the overlapping processing area to be one or more widths of the independent decoding processing unit, the overlapping processing area can be independently and repeatedly decoded. If the minimum number of samples necessary for the filtering process is ensured by repeating the above process, it is possible to reduce the processing of extra image data.

  FIG. 11 is a block diagram showing the configuration of the digital still camera according to the second embodiment of the present invention in comparison with FIG. The digital still camera 31 of the second embodiment is configured in the same way as the digital still camera 11 of the first embodiment except that the configurations of the decoding unit 12 and the image processing unit 19 shown in FIG. 11 are different.

  Here, in the digital still camera 31, the decoding unit 12 and the image processing unit 19 repeat the decoding process and the image processing of the independently decodable encoded data D <b> 2 stored in the memory 21, and display a special effect image on the display 14. To do. Here, the special effect image is an image that gradually changes corresponding to the repeated processing in the decoding unit 12 and the image processing unit 19, and is a moving image. Specifically, this special effect processing includes, for example, processing for gradually enlarging and reducing an image based on encoded data D1 as shown in FIG. 12, and gradually displaying an image based on encoded data D1 as shown in FIG. 14, a process of wiping and switching display from an image based on the encoded data D1A to an image based on the encoded data D1B, a process of gradually blurring the image based on the encoded data, and the like, as shown in FIG.

  In the digital still camera 31, when a user instructs display using these special effects, the code conversion unit 17 generates encoded data D 2 that can be independently decoded and stores the encoded data D 2 in the memory 21. In addition, the independently decodable encoded data D2 stored in the memory 21 is read and decoded by the decoding unit 12 and processed by the image processing unit 19 and stored in the memory 21 for each processing block of the image processing unit 19. In the digital still camera 31, the processing in the image processing unit 19 is gradually switched according to the special effect selected by the user, and the processing of the decoding unit 12 and the image processing unit 19 is repeated for a plurality of frames. D4 is overwritten and saved in the memory 21.

  Specifically, in the enlargement / reduction process, zooming process, blurring process, and the like, the filter coefficients in the image processing unit 19 are gradually switched, and the independently decodable encoded data D2 is repeatedly processed.

  On the other hand, in the wipe process, as shown in FIG. 15, the encoded data D1A displayed at the start of the wipe is converted into the independently decodable encoded data D2 and stored in the memory 21 as a preliminary process. Further, the image data D3 is decoded from the independently decodable encoded data D2 and resized by the image processing unit 19, and the image data D4 as a result of processing is stored in the memory 21 and displayed on the display 14. Subsequently, the encoded data D1B to be displayed by wiping is converted into independently decodable encoded data D2 and stored in the memory 21.

  After these pre-processes, the image data D3 is repeatedly decoded and resized using the encoded data D2 that can be independently decoded by the encoded data D1B stored in the memory 21 by the start of wipe, and the image processing is performed. The image data to be stored is overwritten and saved in the memory 21. In the repetition of the decoding and resizing processing of the image data D3, the processing can be simplified by selectively processing only the processing block of the portion whose display changes due to the wipe.

  As in this embodiment, when the characteristics of the image processing unit are gradually switched and the processing of the decoding unit and the image processing unit is repeated to display a moving image, the processing of the image data is further improved as compared with the conventional case. It is possible to display a special effect image by reducing the required bandwidth and power consumption.

  Incidentally, the processing in the image processing unit 19 includes processing that does not involve filtering processing. Specifically, for example, when the display is switched by wiping as described above for the second embodiment in a state where the image is displayed on the display 14 without being resized at all, the image processing unit 19 performs the wiping operation without performing the filtering process. Only the overwrite process to the memory 21 corresponding to the process is executed. Therefore, in this case, it is possible to omit the process of decoding extra image data necessary for the filtering process.

  Therefore, in this embodiment, the setting of the processing block is switched according to the processing in the image processing unit 19, and in the case of filtering processing, the processing block and the independent decoding unit are set as in the first embodiment. On the other hand, when the filtering process is not necessary, as shown in FIG. 16A, a processing block is set so as not to generate an overlapping processing area in comparison with FIG. In this case, the setting of the independent decoding unit may be switched so as to correspond to the switching of the setting of the processing block. Further, as shown in FIG. 16 (B) by comparison with FIG. 10 (B), the size of the processing block can be variously set as required.

  When filtering processing is not required for image data processing as in this embodiment, processing blocks are set so that adjacent processing blocks do not overlap, thereby further reducing unnecessary image data processing. Thus, the bandwidth and power consumption required for processing image data can be reduced.

  FIG. 17 is a block diagram showing the configuration of a digital still camera according to the fourth embodiment of the present invention in comparison with FIG. The digital still camera 41 of the fourth embodiment is configured in the same way as the digital still camera 11 of the above-described first embodiment except that the configuration shown in FIG. 17 is different.

  In the digital still camera 41, the code conversion unit 47 reads the encoded data D1 recorded on the recording medium 13 to generate independently decodable encoded data D2 and independent decoding start position information DS. Store in 21A. The decoding unit 42 processes the independently decodable encoded data D2 stored in the memory 21 in units of processing blocks, and outputs the image data D3 to the image processing unit 19.

  The code conversion unit 47 and the decoding unit 42 sequentially process the encoded data D1 using the predetermined area 21A as a ring buffer.

  That is, the code conversion unit 47 and the decoding unit 42 notify each other of the progress of the process, and the code conversion unit 47 monitors the empty area in the area 21 </ b> A based on the notification of the progress from the decoding unit 42. Based on this monitoring result, the code conversion unit 47, when the empty area from the position where the writing of the independently decodable encoded data D2 was stopped immediately before becomes equal to or greater than a predetermined value in the area 21A, The independently decodable encoded data D2 is stored in the area 21A from the location where the writing is stopped. Further, the independent decoding start position information DS is stored in the memory 21 so as to correspond to the storage of the independently decodable encoded data D2. In addition, the independent decoding unit stored in the memory 21 is notified to the decoding unit 42 to notify the progress of processing.

  On the other hand, the decoding unit 42 monitors the storage of the independently decodable encoded data D2 and the independent decoding start position information DS in the region 21A in response to the progress status notification from the code converting unit 47, and is stored in the region 21A. When the independently decodable encoded data D2 can be read in units of processing blocks, the independently decodable encoded data D2 is read and processed with respect to the processing blocks that can be read. Further, the independent decoding unit for which processing has been completed is notified to the code converting unit 47 to notify the progress status. Note that the processing progress status may be notified by the data amount instead of the progress status notification by the independent decoding unit.

  In this embodiment, the memory capacity can be further reduced by using the memory as a ring buffer.

  FIG. 18 is a block diagram showing the configuration of the digital still camera according to the fifth embodiment of the present invention in comparison with FIG. The digital still camera 51 of the fifth embodiment is configured in the same way as the digital still cameras of the above-described embodiments except that the configuration of the code conversion unit 17 shown in FIG. 17 is different.

  In this embodiment, when the encoded data D1 recorded on the recording medium 13 is independently decodable encoded data, the size of the independent decoding unit set in the encoded data D1 is set as the first to the first embodiments. 4 is changed to a size suitable for the processing block of the image processing unit 19 described above to generate independently decodable encoded data D2. Here, when the encoded data D1 recorded on the recording medium 13 is independently decodable encoded data, for example, the encoded data is generated by encoding the image data acquired by the imaging system by the encoding unit. At this time, when a delimiter code is set at a certain period to reset the encoding process based on the DC difference, the independently decodable encoded data recorded in the memory 21 for image processing is recorded for backup. For example, it is recorded on the medium 13 and held.

  In this case, the code converting unit 17 processes the encoded data D1 in the same manner as described above with respect to the first embodiment to generate the independently-decodable encoded data D2 and the independent decoding start position information DS. Data D2 and independent decoding start position information DS are stored in the memory 21.

  Even if the size of the independent decoding unit is changed to generate independently decodable encoded data as in this embodiment, the same effect as in the above-described embodiment can be obtained.

  FIG. 19 is a block diagram showing the configuration of the digital still camera according to the sixth embodiment of the present invention in comparison with FIG. The digital still camera 61 of the fifth embodiment is configured in the same way as the digital still cameras of the above-described embodiments except that the configuration of the code conversion unit 17 shown in FIG. 19 is different.

  In this embodiment, the encoded data D1 recorded on the recording medium 13 is converted into independently decodable encoded data, and the independent decoding unit of the encoded data D1 is processed by the image processing unit 19. This is the case of the size corresponding to the block. In the digital still camera 61, only the independent decoding start position information DS is generated by the code conversion unit 17 and stored in the memory 21.

  Corresponding to the recording in the memory 21, the decoding unit 12 accesses the recording medium 13 based on the independent decoding start position information DS recorded in the memory 21, and decodes the image data D3 in units of processing blocks. When the processing related to the image data D3 is the special effect processing described above with reference to the second embodiment, all the encoded data D1 based on the independently decodable encoded data recorded on the recording medium 13 is transferred to the memory 21. In this case, the decryption unit 12 may process the data.

  As in this embodiment, when the encoded data to be processed is converted into the independently decodable encoded data, only the independent decoding start position information may be detected and processed. The same effect can be obtained.

  FIG. 20 is a block diagram showing the configuration of a digital still camera according to the seventh embodiment of the present invention in comparison with FIG. The digital still camera 71 of the seventh embodiment is configured the same as the digital still camera of each of the above-described embodiments except that the configuration relating to the code conversion unit 77 shown in FIG. 20 is different.

  Here, in the digital still camera 71, the code converting unit 77 is provided with an image processing unit 77B for processing the image data decoded by the decoding unit 77A. The digital still camera 71 performs image processing on the encoded data D1 by sharing the processing between the image processing unit 77B and the image processing unit 19 built in the code conversion unit 77. Here, the sharing of this processing is performed by the image processing unit 77B and the image processing unit 19, respectively, for example, filtering processing such as resizing and overwriting processing to the memory 21 related to the wipe processing described in the second embodiment. Is the case. In the following, image processing in the image processing unit 77B will be referred to as preprocessing as appropriate.

  Here, as shown in FIGS. 21A and 21B, the decoding unit 77A repeatedly reads out the encoded data D1 from the recording medium 13 under the control of the central processing unit 16, and decodes the image data. The processed image data is output to the image processing unit 77B. The image processing unit 77B selectively inputs the image data output from the decoding unit 77A in units of preprocessing blocks, performs image processing, and outputs the image data of the processing result. Here, the preprocessing block is one or a plurality of independent decoding units.

  Here, in this embodiment, it is assumed that the processing block of the preprocessing is created by dividing one screen into two equal parts in the horizontal direction as shown in FIGS. 21 (A) and (B), for example. In FIG. 21, the independent decoding units are denoted by numerals 1 to 16. In addition, as described above, when filtering is performed by the image processing unit 77B, it is necessary to overlap the processing blocks. In the example of FIG. 21, the decoding unit 77A first decodes image data for one screen and sequentially outputs the image data to the image processing unit 77B. The image processing unit 77B selectively inputs the image data of the left preprocessing block MBLA from the image data for one screen output from the decoding unit 77A, performs image processing, and encodes the image data of the processing result. To the conversion unit 77C. Subsequently, the decoding unit 77A decodes the image data for one screen and sequentially outputs the image data to the image processing unit 77B. The image processing unit 77B reads the image of the processing block MBLB for the right preprocessing from the image data for one screen. Data is selectively input to perform image processing, and image data as a processing result is output to the encoding unit 77C.

  The encoding unit 77C sequentially encodes the processing result image data output from the image processing unit 77B to generate independently decodable encoded data D2A, and the generated independently decodable encoded data D2A is generated in the order of generation. Store in the memory 21. Independent decoding start position information DSA of the independently decodable encoded data D2A is generated and stored in the memory 21 in the generation order. Therefore, in this case, as shown in FIG. 22 in comparison with FIG. 21, the independently-decodable encoded data D2A has the independent decoding unit data of the left processing block MBLA, and then the independent processing of the right processing block MBLB. Decoding unit data is continuously stored in the memory 21. FIG. 22 shows a case where the code length is applied to the independent decoding start position information DSA.

  Based on the independent decoding start position information DSA stored in the memory 21, the decoding unit 12 reads out the independently decodable encoded data D2A stored in the memory 21 for each processing block of the image processing unit 19, and outputs image data. Is output to the image processing unit 19.

  As in this embodiment, when the encoded data is converted into the independently decodable encoded data, the image processing is executed and the image processing is shared, so that iterative processing in the subsequent image processing unit is omitted. And the entire process can be simplified. That is, in the configuration of the second embodiment, the image processing unit 19 in the subsequent stage needs to repeat the resize process and the process related to the wipe. However, according to this embodiment, the resize process is performed only once in the preprocess. The resize process in the image processing unit 19 can be omitted, and the entire process can be simplified. Further, when the image is reduced in the preprocessing, the image data is reduced, so that the memory amount, the bus bandwidth, and the power consumption can be reduced. In the case of direct transfer from the image processing unit 77B to the encoding unit 77C via a buffer (not shown), it is desirable that the processing block of the image processing unit 77B becomes the encoding unit of the encoding unit 77C after processing.

  FIG. 23 is a block diagram showing the configuration of the digital still camera according to the eighth embodiment of the present invention in comparison with FIG. The digital still camera 81 of the eighth embodiment is configured in the same way as the digital still camera 71 of the seventh embodiment, except that the configuration relating to the code conversion unit 87 shown in FIG. 23 is different.

  The code conversion unit 87 is configured in the same manner as the code conversion unit 77 of the digital still camera 81 except that a code rearrangement unit 87D is provided. Here, as shown in FIG. 24, the code rearranging unit 87D performs the independent decoding enabled encoded data D2A and the independent decoding start position information DSA stored in the memory 21 so that the independent decoding units are continuous in the raster scanning order. Are rearranged to generate independently decodable encoded data D2 and independent decoding start position information DS, and the independently decodable encoded data D2 and independent decoding start position information DS are stored in the memory 21.

  As in this embodiment, when the encoded data is converted into independently decodable encoded data, image processing is executed, and the independent independently decodable encoded data in units of processing blocks in the preprocessing is raster scanned. By rearranging the independent decoding units in this order, the process of accessing the independently decodable encoded data can be simplified.

  FIG. 25 is a block diagram showing the configuration of a digital still camera according to the ninth embodiment of the present invention in comparison with FIG. The digital still camera 91 of the ninth embodiment is configured in the same way as the digital still camera 81 of the eighth embodiment except that the configuration related to the code conversion unit 97 shown in FIG. 25 is different.

  The code converting unit 97 is the same as the code converting unit 87 of the digital still camera 81 except that an encoding unit 97C and a code converting unit 97D are provided instead of the encoding unit 77C and the code rearranging unit 87D. Composed. Therefore, in the code converting unit 97, the image data is sequentially decoded by the decoding unit 77A, and the image processing unit 77B, which is followed by the decoded image data, performs image processing in units of processing blocks. The encoding unit 97C encodes the image data output from the image processing unit 77B by a normal JPEG technique to generate intermediate processing encoded data D1A, and stores the intermediate processing encoded data D1A in the memory. 21.

  The code conversion unit 97D converts the encoded data D1A of the intermediate processing into encoded data D2 that can be independently decoded, and stores it in the memory 21. Further, at this time, the independent decoding units are rearranged so that the independent decoding units are successively arranged in the order of the raster scanning, and the independently decodable encoded data D2 is generated.

  As in this embodiment, after the image processed image data is recorded in the memory with the normal encoded data, it is converted into the independently decodable encoded data, and simultaneously converted into the independently decodable encoded data. Even if the decoding units are rearranged, the same effect as in the eighth embodiment can be obtained.

  26, 27, and 28 are block diagrams showing the configuration of a digital still camera according to another embodiment of the present invention in comparison with FIGS. 20, 23, and 25, respectively. These digital still cameras 101, 111, and 121 shown in FIGS. 26, 27, and 28 correspond, except that the configurations relating to the code conversion units 107, 117, and 127 shown in FIGS. 26, 27, and 28 are different. This is the same as the digital still cameras 71, 81, 91 of the seventh, eighth, and ninth embodiments.

  Here, the code conversion units 107, 117, and 127 of FIGS. 26, 27, and 28 correspond to the corresponding digital still cameras except that a code conversion unit 107A and a decoding unit 107B are provided instead of the decoding unit 77A. This is configured in the same way as the code converters 77, 87, 97 of 71, 81, 91.

  The code conversion units 107, 117, and 127 convert the encoded data D 1 into the independently decodable encoded data D 2 B by the code conversion unit 107 A and store it in the memory 21. Further, the independent decoding start position information DSB of the independently decodable encoded data D2B is generated and stored in the memory 21.

  Based on the independent decoding start position information DSB, the decoding unit 107B decodes the image data by reading the independently decodable encoded data D2B stored in the memory 21 in units of preprocessing blocks related to the processing of the image processing unit 77B. The decoded image data is output to the image processing unit 77B.

  In this embodiment, when image processing is performed when converting encoded data into independently decodable encoded data, the image processing is performed by converting the encoded data into independently decodable encoded data in advance. Image processing can be performed.

  In the above-described embodiment, the case where one screen is divided in the horizontal direction and the vertical direction and the independent decoding unit is set has been described. However, the present invention is not limited to this, and the horizontal decoding is performed according to the configuration of the image processing unit. The independent decoding unit may be set by omitting the division in the direction or the vertical direction.

  In the above-described embodiment, the case where the independent decoding unit is set to a certain size in one screen has been described. However, the present invention is not limited to this. For example, the overlapping processing area in the processing block and other areas are used. For example, when the size is changed, the size of the independent decoding unit may be changed in one screen. In this way, the number of independent decoding units can be reduced to further reduce the memory capacity.

  In the above-described embodiment, the case where the processing block is formed by one or a plurality of independent decoding units has been described. However, the present invention is not limited to this, and the size of the processing block is basically the independent decoding unit. If the size is larger than, the independent decoding unit corresponding to the processing block of the image processing unit can be read from the memory and the image data can be decoded. For example, the independent decoding unit is set so as to cross the boundary of the processing block. You may make it do. In addition, when the independent decoding unit is set so as to cross the boundary of the processing block in this way, the image data obtained by decoding the image data in the independent encoding processing unit is obtained before or after the processing in the image processing unit. It may be thrown away.

  In the above-described embodiments, the case where the present invention is applied to the processing of still images by the JPEG method has been described. However, the present invention is not limited to this, and is widely applied to still image processing by various encoding processes other than the JPEG method. Can be applied.

  In the above-described embodiments, the case where the present invention is applied to still image processing has been described. However, the present invention is not limited to this and can be widely applied to moving image processing. In this case, as shown in FIG. 29, for example, when processing MPEG (Moving Picture Experts Group) encoded data, a slice code is applied to the delimiter code, and this slice code setting is supported. It is possible to stop the encoding process using the DC difference and generate independently decodable encoded data.

  In the above-described embodiments, the present invention is applied to a digital still camera. However, the present invention is not limited to this, and various image display functions such as various image display devices, various image editing devices, and mobile phones can be used. The present invention can be widely applied to information processing apparatuses and the like. Further, the present invention can be applied to the case where image processing is performed by changing the size of the obtained image, performing the same processing as the display, and encoding the obtained image by various known encoding methods.

  In the above-described embodiments, the case where the present invention is configured by hardware has been described. However, the present invention is not limited to this, and may be configured by software. In this case, for example, the present invention can be applied to an image processing program of a computer. The image processing program or the like may be provided by downloading via a network such as the Internet, and further, an optical disc, a magnetic disc, a memory card, etc. It may be provided by being recorded on the recording medium.

  The present invention relates to an image processing apparatus, an image processing method, a program for the image processing method, and a recording medium on which the program for the image processing method is recorded, and can be applied to, for example, a digital still camera.

It is a basic diagram with which it uses for description of the process of the image data in the digital still camera of Example 1 of this invention. It is a block diagram which shows the digital still camera of Example 1 of this invention. It is an approximate line figure used for explanation of coding data. FIG. 3 is a schematic diagram for explaining the operation of a preprocessing unit in the digital still camera of FIG. 2. It is a basic diagram with which it uses for description of the production | generation process of independently decodable encoded data. FIG. 3 is a schematic diagram for explaining operations of a decoding unit and an image processing unit in the digital still camera of FIG. 2. It is a basic diagram with which it uses for description of an independent decoding unit. It is a basic diagram which shows an duplication process area | region. It is a basic diagram with which it uses for description of the relationship between a duplication process area | region and an independent decoding unit. It is a basic diagram which shows the relationship between a duplication process area | region and an independent decoding unit. FIG. 4 is a block diagram showing a configuration of a digital still camera according to a second embodiment of the present invention in comparison with FIG. 1. It is a basic diagram which shows the process of expansion / contraction in the digital still camera of FIG. FIG. 12 is a schematic diagram illustrating zoom processing in the digital still camera of FIG. 11. FIG. 12 is a schematic diagram illustrating a wipe process in the digital still camera of FIG. 11. It is a basic diagram with which it uses for description of the image processing in the digital still camera of FIG. It is a basic diagram which shows the relationship between a duplication process area | region and an independent decoding unit when a filtering process is not required. It is a block diagram which shows the structure of the digital still camera of Example 4 of this invention. It is a block diagram which shows the structure of the digital still camera of Example 5 of this invention. It is a block diagram which shows the structure of the digital still camera of Example 6 of this invention. It is a block diagram which shows the structure of the digital still camera of Example 7 of this invention. 21 is a chart for explaining image conversion processing in the digital still camera of FIG. 20. FIG. 21 is a chart for explaining independently-decodable encoded data in the digital still camera of FIG. 20. FIG. It is a block diagram which shows the structure of the digital still camera of Example 8 of this invention. FIG. 24 is a schematic diagram for explaining rearrangement in the digital still camera of FIG. 23. It is a block diagram which shows the structure of the digital still camera of Example 9 of this invention. It is a block diagram which shows the structure of the digital still camera by the other Example of this invention. FIG. 27 is a block diagram showing a configuration of a digital still camera according to another embodiment of the present invention different from the example of FIG. 26. It is a block diagram which shows the structure of the digital still camera by other Examples of this invention different from the example of FIG. 26, FIG. It is a basic diagram with which it uses for description of the encoding data of a moving image. It is a basic diagram with which it uses for description of the process of the conventional encoded data.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1,13 ... Recording medium 2, 12, 42, 77A, 107B ... Decoding part 3, 21 ... Memory 4, 19, 77B ... Image processing part 11, 31, 41, 51, 61, 71, 81, 91, 101, 111, 121 ... Digital still camera, 14 ... Display, 17, 47, 77, 87, 97, 97D, 107, 107A ... Code converter, 77C, 97C ... Encoding Part, 87D ... code rearrangement part

Claims (16)

In an image processing apparatus for decoding and processing image data from variable-length encoded data,
A code conversion unit for converting the encoded data into independently decodable encoded data so as to be independently decodable into image data based on the encoded data for each independent decoding unit obtained by dividing one screen of the encoded data; ,
A storage unit for storing the independently decodable encoded data output from the code conversion unit;
A decoding unit that reads out the independently decodable encoded data stored in the storage unit and decodes the image data in units of processing blocks having a size greater than or equal to the independent decoding unit;
An image processing apparatus comprising: an image processing unit that processes the image data decoded by the decoding unit in units of the processing blocks. The code converter is
Outputting start position information of the independent decoding unit in the independently decodable encoded data and storing it in the storage unit;
The decoding unit
The image processing according to claim 1, wherein the image data is decoded by reading out the independently decodable encoded data stored in the storage unit in units of the processing block based on the start position information. apparatus. The code converter is
2. The encoded data is generated by setting a delimiter code in the encoded data and replacing the code of the encoded data so as to correspond to the setting of the delimiter code. The image processing apparatus described. The encoded data is encoded still image data;
The image processing apparatus according to claim 3, wherein the delimiter code is a restart marker indicating a start position of an encoding process based on a DC difference. The image processing unit
Processing the image data by filtering the image data with a filter having a predetermined number of taps;
The processing block is
Adjacent processing blocks overlap each other by a minimum number of samples required for the filtering processing, rounded up by the independent decoding unit, and an overlapping processing region is formed in which image data is repeatedly processed in the processing in the adjacent processing blocks. The image processing apparatus according to claim 1, wherein the image processing apparatus is set to be configured as described above. The image processing apparatus according to claim 5, wherein a width of the overlapping processing area is set to be at least one width of the independent decoding processing unit. The decoding unit
The process of reading the independently decodable encoded data stored in the storage unit and decoding the image data is repeated a plurality of frames,
The image processing unit
The image processing apparatus according to claim 1, wherein characteristics of processing the image data in the plurality of frames are gradually switched to process the image data decoded by the decoding unit. The processing of the image processing unit is processing that does not require filtering processing,
The image processing apparatus according to claim 1, wherein the processing block is set so that an overlapping region does not occur between the adjacent processing blocks. The image processing apparatus according to claim 1, wherein the storage unit is a memory that sequentially and cyclically stores the independently decodable encoded data. The image processing according to claim 1, wherein the encoded data is encoded data capable of independently decoding image data for each decoding unit having a size different from that of the independent decoding unit. apparatus. The code converter is
A preprocessing decoding unit for decoding image data from the encoded data;
A preprocessing image processing unit that performs image processing on the image data decoded by the preprocessing decoding unit;
The preprocessing encoding unit that generates the independently decodable encoded data by encoding the image data processed by the preprocessing image processing unit. Image processing device. The preprocessing image processing unit includes:
Selectively input image data output from the preprocessing decoding unit in units of predetermined preprocessing blocks,
The code converter is
A rearrangement unit that rearranges the independently decodable encoded data in an order corresponding to the processing in units of the preprocessing block in the preprocessing image processing unit in an order in which the independent decoding units are consecutive in raster scanning order; The image processing apparatus according to claim 11, further comprising: The preprocessing image processing unit includes:
Selectively processing image data output from the preprocessing decoding unit in units of predetermined preprocessing blocks;
The preprocessing encoding unit includes:
The image data processed by the pre-processing image processing unit is encoded, and for each independent decoding unit, independently generated encoded data for intermediate processing that is difficult to decode the image data, The image processing apparatus according to claim 11, wherein encoded data of intermediate processing is converted into the independently decodable encoded data. In an image processing method for decoding and processing image data from variable-length encoded data,
A code conversion step for converting the encoded data into independently decodable encoded data so as to be independently decodable into image data based on the encoded data for each independent decoding unit obtained by dividing one screen of the encoded data; ,
A storage step of storing the independently decodable encoded data output from the code conversion step in a storage unit;
A decoding step of reading the independently decodable encoded data stored in the storage unit and decoding the image data in units of processing blocks having a size greater than or equal to the independent decoding unit;
An image processing method comprising: processing the image data decoded in the decoding step in units of the processing blocks. In a program of an image processing method for decoding and processing image data from variable-length encoded data,
A code conversion step for converting the encoded data into independently decodable encoded data so as to be independently decodable into image data based on the encoded data for each independent decoding unit obtained by dividing one screen of the encoded data; ,
A storage step of storing the independently decodable encoded data output from the code conversion step in a storage unit;
A decoding step of reading the independently decodable encoded data stored in the storage unit and decoding the image data in units of processing blocks having a size greater than or equal to the independent decoding unit;
An image processing method comprising: processing the image data decoded in the decoding step in units of the processing blocks. In a recording medium recording a program of an image processing method for decoding and processing image data from variable-length encoded data,
The program is
A code conversion step for converting the encoded data into independently decodable encoded data so as to be independently decodable into image data based on the encoded data for each independent decoding unit obtained by dividing one screen of the encoded data; ,
A storage step of storing the independently decodable encoded data output from the code conversion step in a storage unit;
A decoding step of reading the independently decodable encoded data stored in the storage unit and decoding the image data in units of processing blocks having a size greater than or equal to the independent decoding unit;
An image processing step of processing the image data decoded in the decoding step in units of processing blocks. A recording medium on which a program of an image processing method is recorded.

Images