JP2000092499A - Image encoding control device, image encoding control method, and storage medium - Google Patents

Abstract

(57) [Summary] [PROBLEMS] To reduce the search time for a motion vector and to reduce the time required for encoding in total. SOLUTION: An image pickup means for picking up an image of a subject, a movement detection means for detecting a movement of the image pickup means, and an output from the movement detection means are operated to calculate a speed and a direction and a movement of the movement of the image pickup means. Calculating means for calculating the amount, the speed and direction of the movement of the imaging means calculated by the calculating means,
A motion vector search range setting unit for arbitrarily setting a motion vector search range according to a motion amount, and a coding mode of a macro block in a frame or a field according to the speed and direction of the motion of the imaging unit and the motion amount. And a coding mode determining unit for determining the motion vector search range, so that the motion vector search range can be set efficiently and flexibly, so that the motion vector search time can be shortened.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image encoding control device, an image encoding control method, and a storage medium, and more particularly, to a method for encoding digital image data generated from an image signal output from an imaging means. The present invention relates to a suitable image coding control device.

[0002]

2. Description of the Related Art An encoding mode (intra, inter) performed in a video recorder with a camera (hereinafter, referred to as a cam coder) employing an image encoding system represented by MPEG includes a frame (field). Is determined as a unit in a cycle of several frames, and the motion vector in the inter-encoding mode is obtained only by comparison between input frame (field) images.

[0003] Further, in H.263, an encoding mode in units of frames, such as MPEG, can be arbitrarily determined. However, a motion vector in inter encoding is the same as that in the above-described MPEG. there were.

[0004] The inter coding reduces the redundancy of image data based on a motion vector obtained by comparing pixels in a frame (field) present at an input time-independent position. In general, the above-mentioned encoding / mode is selected in units of macro blocks constituting a frame (field) to be encoded.

The search range of the motion vector is evaluated by an arbitrary matching evaluation method within a predetermined search range defined independently of the size of the resultant motion vector, and the error and the deviation are minimized. An object indicating a region is determined as a motion vector.

Therefore, in the case of the above-described cam coder, if the cam coder is always fixed, the conventional motion vector search method hardly causes a serious problem. But,
Conventional camcorders are generally handy type, and the current situation is that the camera itself is often moved in pan and tilt directions for photographing.

[0007]

Therefore, the image photographed by the camcorder has almost no change in the background image, unlike the case of photographing with the camera fixed, and only the photographing object (subject) is obtained. In many cases, the image is not a moving image, and the background and the subject move at the same time. In this case, there is a problem that the correlation (redundancy) between frames (fields) is reduced.

[0008] Under the above conditions, if the best matching area is outside the defined motion vector search range, the motion vector searched and defined within the search range is
Its accuracy is low. Therefore, in such a case, there is a problem that not only the merit of reducing the code amount while maintaining the image quality by the inter-frame coding is reduced, but also the increase in the code amount and the deterioration of the image quality.

When it is determined that the motion vector cannot be searched,
Even in the case where the macro block currently being encoded is changed from the inter-coding mode to the intra-coding mode, in the conventional system, the change processing is performed after the above-described predetermined motion vector search step. The coding efficiency deteriorates.

Conversely, for the search range defined above,
Even when the motion of the image is sufficiently small, since the entire search range of the motion vector defined above is searched, there is a problem that the temporal search efficiency deteriorates.

SUMMARY OF THE INVENTION In view of the above problems, it is a first object of the present invention to shorten the search time for a motion vector and to reduce the time required for encoding in total. In addition, when the entire screen moves due to the movement of the imaging means itself, the inconvenience that the correlation (redundancy) between the screens is reduced is reduced, and the amount of motion of the image in the screen can be estimated at high speed. As a second object.

[0012]

According to the present invention, there is provided an image coding control apparatus for calculating an image of a subject, a motion detecting means for detecting a motion of the image capturing means, and an output from the motion detecting means. Calculating means for calculating the speed and direction of the movement of the imaging means, and the amount of movement, and the range for searching for a motion vector based on the speed and direction of the movement of the imaging means calculated by the calculation means, and the amount of movement. A motion vector search range setting means for arbitrarily setting; a coding mode determining means for determining a coding mode of a macro block in a frame or a field according to a speed and a direction of movement of the imaging means, and an amount of movement; It is characterized by having. Further, other features of the image encoding control device of the present invention include: an imaging unit that captures an image of a subject; an imaging state detection unit that detects a speed and a direction of movement of the imaging unit as a global motion vector; Of a plurality of screens taken by the imaging means, between the front screen and the current screen,
Or a motion vector detecting means for detecting a motion vector between the current screen and the rear screen, wherein the motion vector detected by the motion vector detecting means is determined by the motion of the imaging means detected by the imaging state detecting means. It is characterized in that compensation is made according to Another feature of the image encoding control device of the present invention is that a frame in which encoding is performed on image data to be encoded using information in a frame or a field in which the image data exists. Intra-encoding and temporally past, future, or both past and future frames or fields to determine a motion vector, and between frames to be encoded with reference to image data indicated by the motion vector In an image encoding control device capable of performing encoding, a speed of an object, a motion detecting means for detecting an amount and a direction of the motion, and a detection output of the motion detecting means, Motion calculating means for calculating the speed and amount of movement, comparing means for comparing the calculation result of the motion calculating means with a predetermined threshold value, and comparing means Depending on the comparison result, it is characterized by comprising setting means for setting a forward or backward motion vector search range of between coding and each screen. Another feature of the image encoding control device of the present invention is that a frame in which encoding is performed on image data to be encoded using information in a frame or a field in which the image data exists. Inner coding, temporally past, future,
Alternatively, it is possible to obtain a motion vector by referring to both the past and future frames or fields, and perform inter-frame encoding by referring to image data indicated by the motion vector. An imaging unit that controls either one of the inner encoding and the inter-frame encoding by a parameter and can select an encoding method for each frame / field, a supporting unit that supports the imaging unit in an arbitrary posture, Means for controlling the attitude of supporting the imaging means. Another feature of the image encoding control device of the present invention is that one screen is divided into a plurality of small blocks each including n × m pixels, and the k
In an image encoding control device that encodes (k> O) as one unit (macroblock), an imaging unit that captures an image of a subject, a motion detection unit that detects a motion of the imaging unit,
With respect to the motion amount obtained from the output of the motion detection means and the encoding target frame or field,
Comparing means for comparing a motion vector obtained between future frames or fields; comparing the comparison result of the comparing means with a predetermined threshold value set in advance; Determining means for determining whether the image data belongs to an area or a still image area. Another feature of the image encoding control device of the present invention is that, based on the image data or the motion vector, the orthogonal transformation is performed on the difference between the referred temporally past or future frame or field image based on the image data or the motion vector. Coordinate transformation means for performing coordinate transformation including: a coefficient after coordinate transformation by the coordinate transformation means, a quantization means for quantizing with a quantization coefficient selected by an arbitrary method,
Image data compression means for compressing the image data quantized by the quantization means, movement detection means for detecting the movement of the imaging means, calculation means for calculating the output of the movement detection means, and calculation means A comparing unit that compares the obtained motion amount with a motion vector obtained by comparing image data between frames or fields; a classifying unit that classifies a comparison result of the comparing unit into a plurality of ranks; Selecting means for selecting the quantization coefficient based on each of the classified ranks.

The image encoding control method according to the present invention includes an image pickup step of picking up an image of a subject by an image pickup means, a movement detection step of detecting the movement of the image pickup means by a movement detection means, and calculating an output from the movement detection means. A calculating step of calculating the speed and direction of the movement of the imaging unit and the amount of movement, and a range for searching for a motion vector based on the speed and direction of the movement of the imaging unit and the amount of movement calculated by the calculating step. A motion vector search range setting step of arbitrarily setting the encoding mode, and an encoding mode determining step of determining an encoding mode of a macro block in a frame or a field according to the speed and direction of the motion of the imaging unit and the amount of motion. And is performed. Another feature of the image encoding control method of the present invention is that an imaging step of imaging an object by an imaging unit, an imaging state detecting step of detecting a speed and a direction of movement of the imaging unit, Performing a motion vector detecting step of detecting a motion vector between the front screen and the current screen or between the current screen and the rear screen among the plurality of screens captured by the process, and detecting the motion vector in the motion vector detecting step. The motion vector to be compensated is compensated according to the detection result in the above-described imaging state detection step. Another feature of the image encoding control method of the present invention is that a frame in which encoding is performed on image data to be encoded using information in a frame or a field in which the image data exists. Inner coding,
Find a motion vector by referring to the past, future, or both past and future frames or fields temporally,
In an image encoding control method for performing inter-frame encoding with reference to image data indicated by the motion vector, a motion detection step of detecting the speed of the motion of the object, the amount and direction of the motion, A motion calculation step of calculating a speed and an amount of movement of the object based on the detection output of the motion detection step, and a calculation result of the motion calculation step;
A comparing step of comparing a predetermined threshold value set in advance; and a motion vector search range setting step of setting a coding method and a forward or backward motion vector search range between each screen according to the comparison result of the comparing step. And is performed. Another feature of the image coding control method of the present invention is that one screen is divided into a plurality of small blocks each including n × m pixels, and k pieces (k
> O) as one unit (macroblock), an image capturing step of capturing an object by an image capturing unit, a motion detecting unit detecting a motion of the image capturing unit, and a motion detecting step. A comparison step of comparing the obtained motion amount of the imaging unit with a motion vector obtained between a frame or a field to be encoded and a temporally past or future frame or field; and a comparison result in the comparison step. And a determination step of determining whether the macroblock belongs to a moving image area or a still image area based on a result of comparing the macroblock with a predetermined threshold value set in advance. Another feature of the image encoding control method of the present invention is that an image capturing step of capturing an image of a subject by an image capturing unit and, based on image data or a motion vector, a temporally past or future reference. A coordinate transformation step of performing coordinate transformation including orthogonal transformation on a difference between the frame and the field image, and a quantization step of quantizing a coefficient after the coordinate transformation in the coordinate transformation step with a quantization coefficient selected by an arbitrary method. An image data compression step of compressing the image data quantized by the quantization step, a motion detection step of detecting a motion of the imaging means, and a calculation step of calculating a motion detection output of the motion detection step. A comparison step of comparing the amount of motion determined in the calculation step with a motion vector determined by comparing image data between frames or fields. A classification step of classifying a plurality of ranks the comparison results of the comparison process, is characterized by performing a selection step of selecting the quantization coefficient based on each rank is classified by the classification step.

A storage medium according to the present invention is characterized by storing a program for causing a computer to function as each means according to any one of the first to sixth aspects. Another feature of the storage medium of the present invention is that a program for causing a computer to execute the procedure of the image coding control method according to any one of claims 7 to 12 is stored. And

[0015]

Since the present invention has the above technical means, the output from the motion detecting means provided in the camcorder is calculated by the calculating means, and the speed and direction of the motion of the camcorder and the amount of motion are estimated (calculated). . Then, a global motion vector including information such as the calculated direction and amount of the motion or the speed of the motion is obtained, and the motion vector search range can be set arbitrarily based on the global motion vector. Also, according to the speed and direction of the motion of the camcorder and the amount of motion, a conventional frame (field)
Since the coding mode of a frame (field) or a macro block in a frame (field) can be determined without depending on the motion vector obtained by the degree of correlation between pixel values between the pixels, the motion vector search range can be efficiently set.
In addition, it is possible to flexibly set, and it is possible to shorten a motion vector search time. According to the present invention, from the magnitude of the motion vector, whether the motion vector is within the range being investigated in the format,
Since the determination can be made based on the global motion vector including information such as the direction and amount of motion of the camcorder or the speed of the motion, the search time of the motion vector and the coding of a macroblock in a frame (field) or a frame (field) are determined. Mode selection time can be reduced,
It is possible to easily select a frame (field) or a macro block in the frame (field) that requires intra coding.

[0016]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS (First Embodiment) FIG. 1 shows a first embodiment of an image encoding control device, an image encoding control method and a storage medium according to the present invention. In FIG. 1, 101
Is a video camera system equipped with a gyro for detecting the inertia (movement) of the main body, and 102 is the speed and direction of the motion of the camcorder output from the gyro (not shown) in the camera of the video camera system 101. , And the amount of motion are estimated (calculated). The arithmetic unit calculates a global motion vector (GMV) including information such as the calculated direction and amount of the motion or the speed of the motion.

Reference numeral 105 denotes a buffer memory for digital image data photographed by the video camera system 101;
Is a block for detecting a motion vector between frames (fields), and 103 is an intra, inter (forward prediction: P, bidirectional prediction) from the global motion vector GMV calculated by the arithmetic unit 102 and the motion vector of the detection block 106. : B) is a coding mode determination block for selecting a coding mode such as: Reference numeral 104 denotes an encoder conforming to an encoding format using inter-moving image frame (field) encoding such as MPEG or H.263.

In this embodiment, a gyro built in the video camera system 101 outputs data corresponding to the speed and direction of the movement according to the movement of the camera body.

The data output from the video camera system 101 is input to an arithmetic unit 102 and operated to calculate a global motion vector (GMV) corresponding to the speed and direction of the motion of the video camera system 101. , To the encoding mode determination block 103.

On the other hand, digital moving image data photographed and output by the video camera system 101 is temporarily stored in an input buffer 105, read out as appropriate, input to a motion vector detecting circuit of a detecting block 106, Similarly, by evaluating the correlation between frames (fields),
The forward and backward vectors are detected and output to the coding mode determination block 103.

The coding mode determination block 103 includes a motion vector output from the arithmetic unit 102 and a detection block 106.
In consideration of the motion vector output from the CPU, an appropriate encoding mode is determined, and the instruction is output to the encoding block 104.

Here, the coding mode determination block of the motion vector detection block 106 changes the determination program to provide a motion vector accuracy (a threshold is set by a matching error) priority mode, a code amount priority mode, an image quality priority mode, and the like. Mode can be arbitrarily selected.

FIG. 5 shows an example of the motion detecting means built in the camera of the video camera system 101. In FIG. 5, reference numeral 501 denotes a gyro for converting the magnitude and direction of an external stress into an electric signal, and 502 denotes a gyro for converting an electric signal corresponding to the magnitude and direction of the stress output from the gyro 501 into digital data. analog/
It is a digital converter.

Reference numeral 503 denotes a motion vector (GMV: global motion vector) having the same dimension as the motion vector in the encoding format from the magnitude and direction of the stress, which is the motion element converted into digital data by the analog / digital converter 502. Digital signal processor (DSP).

With the system shown in FIG. 5, the speed and direction of the movement of the main body, that is, the movement of the camera (change of the photographed image due to the movement of the camera main body such as panning).
Is detected, and a motion vector between the captured front frame (field) and the current frame (field) or between the current frame (field) and the rear frame (field) is used as auxiliary data for estimation. is there.

(Second Embodiment) FIG. 2 shows a second embodiment of the present invention. In FIG. 2, 201 is a video camera system equipped with a rotator, and 202 is a video camera system.
This is an arithmetic unit that calculates a motion vector (GMV) from rotation angle and rotation speed information output from a rotator provided in the camera system 201.

Reference numeral 205 denotes a buffer memory for digital image data captured by the video camera system 201, 206 denotes a motion detection block for detecting a motion vector between frames (fields), and 203 denotes a global motion vector GMV and a global motion vector GMV of the arithmetic unit 202. A coding mode determination block for selecting a coding mode such as intra or inter (forward prediction: P, bidirectional prediction: B) from the motion vector of the motion detection block 206.

Reference numeral 204 denotes an encoder conforming to an encoding format using inter-video frame (field) encoding such as MPEG or H.263.

In the present embodiment, the rotator provided in the video camera system 201 can rotate the camera body at an arbitrary angle of 360 degrees and an arbitrary rotation speed in order to photograph a desired subject. And outputs data corresponding to the rotation angle and the rotation speed (angular speed).

The data output from the video / camera system 201 is input to an arithmetic unit 202 and calculated, and a global motion vector (GMV) corresponding to the rotation speed and direction of the camera body is calculated. Then, the calculated value is output to the encoding mode determination block 203.

On the other hand, photographed digital image data output from the video / camera system 201 is temporarily stored in an input buffer 205, read out as appropriate, and input to a motion vector detection circuit 206. The forward and backward vectors are detected by the correlation evaluation between (fields) and output to the coding mode determination block 203.

The coding mode determination block 203 includes a global motion vector GMV output from the arithmetic unit 202,
The motion vector output from the motion vector detection circuit 206 is examined, an appropriate encoding mode is determined, and the instruction is output to the encoding block 204.

The coding mode determination block 203 changes the determination program in the same manner as in the first embodiment, so that the motion vector accuracy (a threshold is set based on the matching error) priority mode, the code amount priority mode, the image quality priority mode It is possible to select an arbitrary mode from the modes and the like.

Here, FIGS. 6 and 7 show an example of a system for detecting the rotation angle and rotation speed of the rotator provided in the video camera system 201. FIG.

In FIG. 7, reference numeral 701 denotes a video camera;
Reference numeral denotes a buffer memory for digital video data output from the video camera 701, reference numeral 703 denotes an encoding processing block for digital video data, and reference numeral 704 denotes a motion vector detection block based on comparison between frames (fields).

Further, in H.263, the encoding mode in units of frames, such as MPEG, can be arbitrarily determined. However, the motion vector in the inter encoding is the same as in the case of MPEG. there were.

By the way, as shown in FIG. 3, in the inter coding, the image data is decoded based on a motion vector obtained by comparing pixels in a frame (field) existing at an independent time position. In order to reduce the redundancy, in particular, the above-described coding / mode is usually selected in units of macro blocks constituting a frame (field) to be coded.

In FIG. 6, reference numeral 601 denotes 201 in FIG.
603, 604 camera system with rotator
Is a magnetic pattern in an enlarged view of a support 602 connecting the rotator of the camera system 601 and the camera, and 605 is a magnetic head for converting a change in magnetic flux into an electric signal.

On the surface of the cylindrical support, 603, 604
The magnetic pattern (black band: magnetized, white band: non-magnetized) with a fixed period is engraved as shown by.
As shown in (1), the magnetic head 605 detects a magnetic flux that changes due to the rotation of the column 602, converts this into an electric (pulse) signal, and outputs it.

The frequency of the pulse signal output from the magnetic head 605 is made to correspond to the rotation speed of the rotator, and the number of pulses of the pulse signal is made to correspond to the rotation angle, and these are processed by the arithmetic unit 202 shown in FIG. Then, a global motion vector (GMV) is obtained as in the first embodiment.

The global motion vector GMV calculated as described above is used to encode an image captured by the video camera system 201 between a forward frame (field) and a current frame (field) or a current frame (field). ) And a subsequent frame (field) are used as auxiliary data for estimating a motion vector.

(Third Embodiment) Next, a third embodiment of the present invention will be described with reference to FIGS.
In FIG. 4, the same components as those in FIG. 1 are denoted by the same reference numerals, and detailed description is omitted.

In FIG. 4, reference numeral 407 denotes an output buffer;
Is a code amount control block for preventing underflow / overflow of the output buffer 407 and always encoding an appropriate code amount.

FIG. 8 shows an example of the internal configuration of the encoding processing block 104. Here, an encoding processing block of a general inter-frame (field) encoding method such as MPEG is shown.

In FIG. 8, reference numeral 801 denotes an encoding mode selector; 802, a processing circuit for performing motion vector detection and difference (subtraction) processing in inter-frame (field) encoding;
803 is a DCT for each block divided by the selector 801.
Is a coordinate conversion circuit that performs coordinate conversion processing such as.

Reference numeral 804 denotes a quantization circuit that quantizes the block-based coefficients converted by the coordinate conversion circuit 803. Reference numeral 805 denotes entropy coding that assigns variable-length codes to the quantized block-based coefficients in an arbitrary order. Circuit.

Reference numeral 806 denotes a parameter selection circuit for selecting the parameters of the selector 801 and the quantization circuit 804 based on the code amount control information input from the outside. Reference numerals 807 to 809 denote local decoders.

Reference numeral 809 denotes an inverse coordinate transformation circuit (IDCT), 808 denotes an inverse quantization circuit, and 807 denotes a memory circuit for storing locally decoded digital image data.

In FIG. 4, the code amount control block 408
In order to prevent the output buffer 407 from overflowing / underflowing and to achieve proper utilization efficiency, the memory of the global motion vectors GMV and 407 described in the first embodiment corresponding to the movement of the camera body is used. An appropriate code amount is calculated from the instantaneous value information, and the code amount control parameter is output to the 404 encoding processing block.

As shown in FIG. 8, inside the encoding processing circuit, the above-mentioned code amount control parameter is input to a parameter selection circuit 806. Mode (I, P, B
etc.), a motion vector search range, and the like are selected and designated, and instructions are given to the selector 801, the quantization circuit 804, and the motion vector detection / difference circuit 802, respectively.

(Other Embodiments of the Present Invention) The present invention is applied to a system composed of a plurality of devices (for example, a host computer, an interface device, a reader, a printer, etc.), but is also applicable to a device composed of one device. You may.

Further, in order to realize the functions of the above-described embodiment, a device connected to the above-mentioned various devices or a computer in a system is operated so as to operate various devices so as to realize the functions of the above-described embodiments. The present invention also includes programs implemented by supplying the program code of the software described above and operating the various devices according to programs stored in a computer (CPU or MPU) of the system or apparatus.

In this case, the program code of the software implements the functions of the above-described embodiment, and the program code itself and means for supplying the program code to the computer,
For example, a storage medium storing such a program code constitutes the present invention. As a storage medium for storing such a program code, for example, a floppy disk, hard disk, optical disk, magneto-optical disk, CD-ROM,
A magnetic tape, a nonvolatile memory card, a ROM, or the like can be used.

When the computer executes the supplied program code, not only the functions of the above-described embodiment are realized, but also the OS (operating system) or other operating system running on the computer. Needless to say, even when the functions of the above-described embodiments are realized in cooperation with application software or the like, such program codes are included in the embodiments of the present invention.

Further, after the supplied program code is stored in the memory provided in the function expansion board of the computer or the function expansion unit connected to the computer, the function expansion board or the function expansion unit is specified based on the instruction of the program code. It is needless to say that the present invention also includes a case where the CPU or the like provided in the first embodiment performs part or all of the actual processing, and the processing realizes the functions of the above-described embodiments.

[0056]

As described above, according to the present invention, since a motion vector can be estimated according to the present invention, whether or not the search range of the motion vector is within the range permitted by the format is determined. Is estimated, and as a result of the above estimation, when the motion vector falls within the above range, the search range can be easily limited. When the motion vector exceeds the search range, the motion vector search process can be bypassed and the encoding mode can be changed to intra, so that the search time for the motion vector can be significantly reduced. it can. As a result, the time required for encoding can be reduced in total, and the encoding process can be speeded up.

According to another feature of the present invention, when an image is similar to a scene change in which the entire screen moves with the movement of the camera itself, the correlation (redundancy) between frames (fields) is reduced. It is possible to quickly estimate the amount of motion of an image without the disadvantage that the image quality is reduced, and to shorten the encoding processing time (encoding mode determination time) from the viewpoint of code amount control (selection of an encoding mode). be able to.

[Brief description of the drawings]

FIG. 1 is a block diagram showing a first embodiment according to the present invention.

FIG. 2 is a block diagram showing a second embodiment according to the present invention.

FIG. 3 is a conceptual diagram showing a motion vector search between frames (fields).

FIG. 4 is a block diagram showing a third embodiment according to the present invention.

FIG. 5 is a diagram illustrating an example of a motion detection unit and a signal processing circuit according to a second embodiment.

FIG. 6 is a diagram illustrating an example of a motion detection unit and a signal processing circuit according to the second embodiment.

FIG. 7 is a block diagram showing a third embodiment according to the present invention.

FIG. 8 is a diagram illustrating an example of an encoding processing block according to the present invention.

[Explanation of symbols]

 101 Video camera system 102 Arithmetic unit 103 Coding mode judgment block 104 Encoder 105 Buffer memory 106 Vector detection block

Claims (13)

[Claims] 1. An image pickup means for picking up an image of a subject, a movement detection means for detecting a movement of the image pickup means, an output from the movement detection means being calculated, and a speed and a direction of the movement of the image pickup means and a movement amount. A motion vector search range setting means for arbitrarily setting a range in which a motion vector is searched based on the speed and direction of motion of the imaging means calculated by the calculation means and the amount of motion; An image coding control device comprising: a coding mode determining means for determining a coding mode of a macro block in a frame or a field in accordance with the speed and direction of movement of the means and the amount of movement. 2. An image pickup means for picking up an image of a subject, an image pickup state detecting means for detecting a speed and a direction of movement of the image pickup means as a global motion vector, and a plurality of image signals constituted by image signals outputted from the image pickup means. Among the screens, comprising a motion vector detecting means for detecting a motion vector between the front screen and the current screen, or between the current screen and the rear screen, wherein the motion vector detected by the motion vector detecting means is An image encoding control device, wherein compensation is performed in accordance with the movement of the imaging means detected by the imaging state detection means. 3. Intra-frame encoding for encoding image data to be encoded using information in a frame or a field in which the image data exists,
Find a motion vector by referring to the past, future, or both past and future frames or fields temporally,
An image coding control device capable of performing inter-frame coding that performs coding with reference to the image data indicated by the motion vector, wherein the motion detecting the speed, the amount, and the direction of the motion of the object Detecting means, a motion calculating means for calculating the speed and the amount of movement of the object based on the detection output of the motion detecting means, a calculation result of the motion calculating means, a predetermined threshold value set in advance, And a setting means for setting a coding method and a forward or backward motion vector search range between screens according to a comparison result of the comparing means. Control device. 4. Intra-frame encoding for encoding image data to be encoded using information in a frame or a field in which the image data exists,
Find a motion vector by referring to a frame or field in the past, the future, or both the past and the future in time,
It is possible to perform inter-frame encoding for encoding with reference to the image data indicated by the motion vector, and control either one of the intra-frame encoding or the inter-frame encoding by using a parameter. Image pickup means capable of selecting a frame / field encoding method; support means for supporting the image pickup means in an arbitrary posture; and posture control means for controlling the posture in which the support means supports the image pickup means. An image coding control device characterized by the above-mentioned. 5. An image coding system which divides one screen into a plurality of small blocks composed of n × m pixels and codes k (k> O) of the small blocks as one unit (macro block). In the control device, imaging means for imaging the subject, motion detection means for detecting the motion of the imaging means, a motion amount obtained from an output of the motion detection means, and a temporal In the past,
Comparing means for comparing a motion vector obtained between future frames or fields; comparing the comparison result of the comparing means with a predetermined threshold value set in advance; An image encoding control device comprising: a determination unit configured to determine whether the pixel belongs to an area or a still image area. 6. A coordinate conversion means for performing a coordinate conversion including an orthogonal transformation on a difference from a past or future frame or field image which is referred to at the time based on image data or a motion vector, and said coordinate conversion means A quantizing means for quantizing the coefficient after the coordinate transformation by a quantization coefficient selected by an arbitrary method, and image data compression for compressing the image data quantized by the quantizing means by a predetermined compression method. Means, a motion detecting means for detecting the motion of the imaging means, a calculating means for calculating an output of the motion detecting means, and a motion amount obtained by the calculating means and a comparison of image data between frames or fields. Comparing means for comparing the obtained motion vector with the obtained motion vector; classifying means for classifying the comparison result of the comparing means into a plurality of ranks; Picture coding control apparatus characterized by comprising a selection means for selecting the quantization factor based on each rank that is like. 7. An image capturing step of capturing an image of a subject by an image capturing means, a motion detecting step of detecting a motion of the image capturing means by a motion detecting means, and calculating an output from the motion detecting means to calculate a motion of the image capturing means. A calculation step of calculating a speed, a direction, and a movement amount; and a motion vector search for arbitrarily setting a range in which a motion vector is searched based on the movement speed, the direction, and the movement amount of the imaging unit calculated in the calculation step. Performing a range setting step and a coding mode determining step of determining a coding mode of a macro block in a frame or a field according to the speed and direction of movement of the imaging unit and the amount of movement. Image coding control method. 8. An image capturing step of capturing an image of a subject by an image capturing means, an image capturing state detecting step of detecting a speed and a direction of movement of the image capturing means, and a front screen among a plurality of screens captured by the image capturing step. Performing a motion vector detection step of detecting a motion vector between the current screen, or between the current screen and the rear screen, a motion vector detected in the motion vector detection step,
An image encoding control method, wherein compensation is performed according to a detection result in the imaging state detecting step. 9. Intra-frame encoding for encoding image data to be encoded using information in a frame or a field in which the image data exists,
Find a motion vector by referring to the past, future, or both past and future frames or fields temporally,
An image encoding control method for performing inter-frame encoding with reference to image data indicated by the motion vector, comprising: a motion detecting step of detecting a speed, an amount and a direction of motion of an object; A motion calculating step of calculating the speed and the amount of movement of the object based on the detection output of the motion detecting step; and comparing the calculation result of the motion calculating step with a predetermined threshold value set in advance. And a motion vector search range setting step of setting a coding method and a forward or backward motion vector search range between screens according to the comparison result of the comparison step. Control method. 10. A screen is divided into a plurality of small blocks each including n × m pixels, and k small blocks (k> O) of the small blocks are divided.
An image encoding control method for encoding the object as one unit (macroblock), an image capturing step of capturing an object by an image capturing unit, a motion detecting unit detecting a motion of the image capturing unit, A comparison step of comparing the motion amount of the imaging unit and a motion vector obtained between a temporally past frame and a future frame or field with respect to the encoding target frame or field; and a comparison result in the comparison step, A determination step of determining whether the macroblock belongs to a moving image area or a still image area based on a result of comparison with a set predetermined threshold value. 11. An image pickup step of picking up an object by an image pickup means, and a coordinate transformation including an orthogonal transformation to a difference between a referred temporally past or future frame or field image based on image data or a motion vector. A quantization step of quantizing the coefficient after the coordinate transformation by the coordinate transformation step with a quantization coefficient selected by an arbitrary method, and image data quantized by the quantization step. An image data compression step of compressing the image data; a motion detection step of detecting the motion of the imaging unit; a calculation step of calculating a motion detection output of the motion detection step; a motion amount obtained in the calculation step; A comparison step of comparing a motion vector obtained by comparing image data between fields, and dividing a comparison result of the comparison step into a plurality of ranks. Classification process and an image coding control method characterized by performing a selection step of selecting the quantization coefficient based on each rank is classified by the classification step of. 12. A storage medium storing a program for causing a computer to function as each means according to claim 1. Description: 13. A storage medium storing a program for causing a computer to execute the procedure of the image encoding control method according to claim 7. Description: