CA1327074C - Interframe adaptive vector quantization encoding apparatus and video encoding transmission apparatus - Google Patents

Abstract

??stract The present invention relates to a video encoding transmission apparatus. The apparatus is comprised of a video encoding circuit for inputting video signal and performing an A/D conversion of the signal and them applying an efficient video encoding processing per frame to digital video data taken per every other frame. The apparatus further includes a transmission buffer which is comprised of a double buffer to enable simultaneous read/write, for storing one video frame of variable length encoding data with the information generating amount as the video encoding circuit output is not constant and then outputting the encoded data at a constant speed by using speed smoothing. A transmission control member is provided at the transmission side for performing the transmission framing to enable discrimination per one frame unit to the encoding data transmitted from the transmission buffer. The member also transmits the encoded data from the transmission buffer to the digital transmission path at a constant speed.

Description

~ 1 3~707~
VIDEO ENCODING TRANSMISSION APPARATUS

This is a division of co-pending Canadian Patent Application Serial No. 502,755 which was filed on February 26, 1986.
The present invention relates to an interframe adaptive vector quantization encoding apparatus which performs encoding of video signals at high efficiency using vector quantization, and also to a video encoding transmission apparatus which transmits the encoding signals.
In accordance with one aspect of the invention there is provided a video encoding transmission apparatus comprising: a video:encoding circuit for inputting video signal and performing AjD conversion of the signal and then : applying efficient video encoding processing per frame to digital video data taken per every other video frame, a transmission buffer constituted by a dou~le buffer to enable ~simultaneous write/read, for storing one video frame of variable length encoding data with the information generating amount as~the video encoding circuit output being not constant ~ and outputting the encoding data at constant spe d by the speed smoothing; a transmission control member at transmission ; side~for per~orming the transmission framing to enable discrimination per one frame unit to the encoding data transmitted ~rom the transmission buffer and transmitting the encoding data from ths transmission buffer to the digital transmission path at constant speed; a transmission cantrol member at receivin~ side *or receiving the encoding data `q~

~ransmitted from the digital transmission path; a receiving buffer constituted by a double buffer to enable simultaneous write/read, for storing one frame of encoding data among the receiving data supplied from the transmission control member at receiving side and outputting one video frame of the encoding data at speed being different from the inputting state using synchronous signal supplied from a synchronous signal generating circuit at detecting side as hereinafter described; a synchronous signal generating circuit at decoding side for generating various clocks required for the decoding action at asynchronous state to the transmission side; a video decoding circuit for performing decoding of one video frame of the encoding data using the decoding clock supplied from the synchronous signal generating circuit at decoding side; and a controller for controlling the input/output operation of the transmission buffer and the receiving buffer.
The present invention taken in conjunction with the invention disclosed in co-pending Canadian Patent Application Serial No. 502,755 which was filed on February 26, 1986 will be described in detail hereinbelow with the aid of the accompanying drawings, in which:
Fig. 1 is a block diagram illustrating constitution of a vector quantization encoder as an embodiment of the invention;
Fig. 2 is a block diagram illustrating constitution of an encoding member of an interframe adaptive vector quantization encoding apparatus in the prior art;

--- 1 32707~
Fig. 3 is a block diagram illustrating constitution of a decoding member o~ an interframe adaptive vector quantization encoding ap aratus in the prior art;
Fig~ 4 is a block diagram illustrating constitution of a vector quantization decoder in the prior art;
Fig. 5 is a block diagram illustrating constitution of a vector quantization encoder in the prior art;
Fig. 6 is a diagram illustrating operation of a vector quantization encoder as an embodiment of the invention; `
~` Fig. 7 is a block diagram illustrating constitution of a vector quantization encoder as another embodiment on the invention Fig. 8 is a block diagram illustrating constitution of a vector quantization decoder as another embodiment of the invention;
~ Pig. 9 is a block diagram illustrating constitution of an encoding member of a vector quantizer as another embodiment of the inventlon;
Fig. 10 is a block diagram illustrating constitution of a vector quantization member in Fig~ 9;

:: :

-`-`` 1 327074 Fig. 11 is a block diagram illustrating constitution of a code ta~le updating member in Fig. 9;
Fig. 12 is a block diagram illustrating constitution of a decoding member of a vector quantizer as another embodiment of the invention;
Fig. 13 is a block diagram illustrating constitution of an encoding member of an adaptive vector quantizer as still another embodiment of the invention;
~ Fig. 14 i5 a block diagram illustrating constitution of a decoding member as still another embodiment of the invention;
Fig. 15 is a diagram illustrating principle of correction in an embodiment of the invention;
Fig. 16 is a block diagram illustrating lS constitution of an encoding member of a color video signal adaptive vector quantizer as another embodiment of the invention;
Fig. 17 is a block diagram illustrating constitution of a decoding member of a color video signal ~ ~ adaptive vector quantizer as another embodiment of the invention;
Fig~ 18 is a diagram illustratins matrix conversion~ln the quantiæer;

'^-` 1 32707l~
Fig. 19 is a constitut;on diagram o~ an encoding member of a color image efficient encoding apparatus as another embodiment of the invention;
Fig. 20 is a constitution diagram of a decoding member of a color image efficient encoding apparatus as another embodiment of the invention;
Fig. 21 is a constitution diagram of a video encoding transmission apparatus as another embodment of the invention;
Fig. 22 is a constitution diagram of a transm~ssion/receiving buffer used in the video encoding transmission apparatus;
Fig. 23-is a co~stitution diagram illustrating an example OL a transmission frame with header; and Fig. 24 i5 a timing chart illustrating operation o~ a transmission/receiving buffer.
First, principle of the vector quantization ~ill be described briefly. The input signal series of K
in number are ~rought together into input vector X = {xl, x2, ... XK}. Then, the K-dimensional ~uclidean signal space Rk(X~Rk) has ~he representati~e pOilltS of N in number (i.e., output vector~ Yi = {Yilr Yi2~ Yikl~
and set of the representative points is made Y = [Yl~ Y~ N]- The vector quantizer determines output vector ~i as hereinafter described from the set of output vectors, and retrieves it. The output vector Yi is in the minimum distance (minimum distortion) to the input vector, and it follows that:
if , d ( X , ~i ) < d ( X ~ ) for all~

wherein, d(X, ~i) represents dlstance (distortion) between inputjoutput vectors. Then, the input vector X is transmitted or recorded in index i of the output vector.
At reproduction, set Y of the output vector ~i can be determined by clustering using the video signal series ~being the training model (repetition of the selection of ~15 the representative points and the quantization of the training model into each representative point until the total distortion becomin~ minimum). Furthermore, in order to improve efficiency of the vector quantization and versatility of the output vectox set, the ~ector ~0~ quantization may be performed at separation of the mean value of vectors and the normalization in amplitude.
An interframe adaptive vector quantization apparatus in the prior art will be described.
Fig. 2 is a block diagram of an interframe .

adaptive vector quantization apparatus in the prior art illustrating a constitution example of an encoding member thereof. In Fig. 2, numeral 1 designates an A/D
converter, numeral 2 a raster/block scan conversion circuit where digital video signals in raster form by the A/D conversion are made a block per every m picture elements x n lines (m, n: integer), numeral 3 a vector quantization encoder which encodes the block data at high efficiency by means of vector quantization, numeral 4 a transmission data buf~er where the encoded data at high efficiency is stored an~ transmitted to the transmission path at constant speed, numeral 5 a movement detection control circuit which controls threshold value of movement detection in the vector quantization encoder corresponding to the data amount stored in the transmission data buffer, numeral 6 a vector quantization decoder which : decodes the encoding data supplied from the vector ~; quantization encoder and reproduces the block data, numeral 7 a variable delay circuit, and numeral 8 a frame memory.
Fig. 3 is a bloc~ diagram of the interframe adaptive vector quantization encoding apparatus in the prior art illustrating a constitution example of a decoding member. In Fig~ 3, numeral 9 designates a 1 32707~

receiving data buffer where the encoding data supplied from the transmission path is received and stored and then outputted at speed corresponding to the decoding action, numeral lO a block/raster scan conversion circuit where the block data decoded and xeproduced is converted into data in raster form, and numeral ll a D/A converter.
Encoding and decoding operation of the apparatus will now be described referring to Fig. 2 and Pig. 3.
Input vldeo signals (lOl) are analog signals which are raster-scanned from the left to the right on the screen and-from the upper side to the lower side.
The analog signals in raster form are converted into digital signals tlO2) by the A/D converter l, and then ~ the digital signals in raster form are made a block per every m picture elements x n lines (m, n: integer) by the raster/block conversion circuit l, and further vector data S ~103) is obtained from the picture element sample within the block.
Difference signal between the vector data S
2~0 (103) and rame vector data P (104) based on the sam~
position ~lock within the frame memory ~ becomes interframe difference vector ~ (105), which is inputt~d to the vector quantization encoder 3. The vector quanti~ation encoder 3 applies processing o~ mean value : :

f' ~ ,' `

separation and normalization to the interframe difference vector ~ (105), and performs movement detection using mean value and amplitude coefficient obtained by the processing and using threshold value (106), and performs vector quantization of only vector of significant block based on the movement. And then the vector quantization encoder 3 encodes the significance/insignificance information, the mean value, the amplitude coefficient and the vector quantization index information each using variable length encoding or the like, and outputs the encoding data (107). The transmission data buffer 4 stores the encoding data (107) and transmits it to the transmission path at constant spe~d according to prescribed transmission speed, and estimates data storage amount (108) and supplies it to the movement detection control circuit .
5. The movement detection control circuit 5 controls the threshold value (106) for the movement detection depending : on variation of the data storage amount (108).
: The encodiny data outputted from the vector quantization encoder 3 is encoded according to reverse : processing of the encoding in the vector quantization decoder 6, thereby interframe difference reproduction vector ~ ~lOq) is reproduced. The interframe di~ference reproduction vector ~ (109) obtained in the processing and the frame vector data P tlO4) delayed by prescribed time by means of the varia~le delay circuit 7 are added, thereby reproduction vector data S (110) is restored and the block data at corresponding position of the frame memory is updated.
On the other hand, the encoding data (107) after received and apeed-changed in the receiving data buffer 9 is decoded by the vector quantization decoder 6, thereby interframe difference reproduction vector ~ (109) is reproduced. The interframe difference xeproduction vector ~ (109) and the frame vector data P (104) passing through the variable delay circuit 7 are added, and reproduction vector data S (110) i5 restored in ~imilar manner to the processing in the encoding member. The reproduction vector data S (110) is converted lnto data ; ~ (111) o~ raster form by the block/raster scan conversion ` circuit 10, and the data (1113 is converted in DJA
conversion by the D/A converter 11 so as to obtain analog reproduction video qignal (112).

~ .
~ Next, constitution and operation of the vector ~quantization encoder and the vector quantization dscoder will be described in detail. Fig. 5 shows a constitution example of a vector quantization encoder in the prior art.
In Fig. 5, numeral 19 deqignates a mean value separation ` 1 32707~

and normalization circuit, numeral 13 a movement detection circuit, numeral 23 a distortion operation circuit, numeral 20 a minimum distortion detection circuit, numeral 16 a code book ROM, numeral 17 an address counter, and numeral 18 an index latch.
Operation of the vector quantization encoder will be described.
The mean value separation and normalization.
circuit performs operation as hereinafter described to interframe difference vector ~ (113~ being input signal thereof, and converts it into normalization vector x.
Assuming that intrablock mean value of ~ 2~ ----, kl (k = m x n) be m and amplitude coeffici2nt thereof be a, it follows that:

1 lc m ~ J ( ~ , , k a = [ 1 ~ m) 2 ~1/2 ~=~
Approximate expression of a such that a ~ ~ m I, u = ma~ min~
' lc i~1 1 32707~

or the like may be used.
Assuming that æ~ m ) / a æ = ~1 , ~2 ~ ~k ~

the mean value m, the amplitude coefficient a, the normalization vector x can be obtained.
-The mean value m (114) and the amplitude coef~icient a (118j obtained are inputted to the movement detection circ~it 13,,and compared with the threshold values T0,'Tl, thereby the significance/insignificance ~ block discximination, i.e., the movement detection : processing is performed according to following conditions ',; ~ 15 and ,the block discrlmination information v (121~ is ' ` outpu~ted.

(If m ~ To and a < Tl ; v = 0 (insignificant block) If m > To or a ~ Tl ; v = 1 (~significant block) , The blo~k discrimination information v is transmitt d per ::
each block. Only in the case that v is 1, following processing is performed.
The normalization vector x (122) is transmitted ~`

~ 327074 to the distorsion operation circuit 23 and subjected to following vector quantization processing. ;.
Set of a plurality of output vectors ~i (116) (i = 1, 2, ..., N) is produced using clustering method based on statistical property of the normalization vector x, and written in the code book ROM 16. When the normalization vector x (115) is inputted to the distortion ~ operation circuit 23, the address counter 17 performs : count-up in sequence of i = 1, 2r ..., N, and reads the output vector ~i (11~) corresponding to the address information i in~sequence of Ylr ~2~ ~ ~N from the code book ROM 16 of the output vector. Distortions d (x, Yi) :
(117) between the normalization vector x and N output vectors ~i read in sequence are calculated sequentially in : 15~ the distortion operation circuit 23. The distortion calculation is executed according to following formula.

d ~ ) = [ ~ )2~ t~ Z -k) ~ ~Otherwise, approximate expression such that : k d ~ ~, ~i ) = ~ ¦ ~J - Yi~
~= 1 ~ d ( x, ~i 3 - ma~ I x~ - Yl~ 1 `

1 3~7074 may be used.
In the minimum distortion detection circuit 20, the minimum distortion among the N distortions estimated by the above calculation is detected, and the output S vector address information i in the ~ode book ROM
indicated by the address counter is taken in the index latch 18 and outputted as the output vector index i (120)o The intrablock mean value m (114), the amplitude coefficient (1~2), the block discrimination information v (121) and the output vector index i (1203, all obtained in-the above process, are converted into codes being suita~le as the vector quantization encoding information (107) and then outputted. In this ca~e, if v is 0, codes in other information are not outputted.
A vector quanti2ation decoder shown in Fig. 4 will now be described.
In Fig. ~4, numeral 21 designates an amplitude . . . ~
coefficient multiplier, and numeral 22 a mean value adder.
Among the vector quantization encoding 2~ nformation (107) transmitted ~rom the receiviny data buffer 9, the block discrimination information v (121~ is first decoded. If v - 1, i.e., if the block is i .
significant, the ~ecoded output vector index i (120) is taken in the index latch 18. In the code book ROM 1~

`:
' .

-1 32707~

where the same content as that of the code book ROM o~
the vector quantization encoder is wri~ten, the output vector ~i (119) indicated by the index i (120) is read.
The amplitude coefficient o (118) i5 multiplied to the output vector ~i in the amplitude coefficient multiplier 21 and the mean value m (114) is added to the product in ~he mean value adder 22, thereby the interframe difference reproduction vector ~ (109) is decoded. That ~ is, following processing is executed.

f~ = C E 1 9 ~ 2 r ~ ~ i ~i~ ~ m ( ~ = i, 2, - , k ) If v = 0, i.e. t if the block i5 insignificant, ~ is 1~5 decoded and reproduced assuming that m = 0, a = 0.

~ = [O, 0, ..., O]

Since the interframe adaptive vector quantization encoding apparatus in the prior art is constituted as above described, calculation o a for normalization and calculation of the square sum ( (a - b)~ in the vector ~uantization distortion operation must be performed at ;~ many times, thereby the circuit scale of the apparatus increases. When these calculations are executed using the approximate expressions, the picture quality may be deteriorated due to the calculation error.
Also in the prior art, it is difficult to obtain a universal output vector set which can cope with the S picture image having significantly different statistical properties, such as picture image including a document and drawings as main components~ picture image requiring the delicate gradation expression or picture image using different sensor system, thereby content of the code book ROM increases.
Further, there exists problem of mismatchlng in the quantization apparatus.
Moreover, in order to establish the synchroniza-tion of the video frame between receiving and transmission, ~ time de~iation of the top end position hetween the transmission frame synchronous pattern and the vldeo frame the number vf time slots) must be counted at the transmission side and transmitted to the receiving side, ~ and the top end position of the video ~rame must be datected from such information at the receiving side and - ~ clocks necessary for the decoding processing must be repxoduced, thereby the apparatus constitution and the transmission control system become complicated. When the transmission speed is slow, the information amount which 1 ~27074 can be transmitted in one video frame time becomes small.
Even if the speed is smoothed at the buffer memory of the transmission side, the transmission efficiency of the encoding data becomes bad and the synchronization of the video frame between transmission and receiving cannot be established.

SUMMARY OF THE INVENTION

The invention relates to an interfxame adaptive vector quantization encoding apparatus, wherein analog , . . .
signals raster-scanned from the left to the right on the screen and rom the upper side to the lower side are converted into digital signals by an A/D converter, the digital video signals in raster form are made a block per every m picture elements x n lines (m, n: integer) by a raster~block scan conversion circuit, the block data is ..
encoded at high efficiency by means of vector quantization : in a vector quantization encGder, the encoded data at high efficiency is transmitted to the transmission path at constant speed by a transmission data buffer, threshold value of movement detection in the vector quanti2ation encoder i9 controllPd by a movement detection control : circuit, and the encoding data supplied from the vector quantization encoder is decoded and the block data is _, 1 32707~

reproduced by a vector quantization decoder. The vector quantization encoder estimates inner product between input vector subjected to mean value separation and output vector read from a code book ROM by an inner product operation circuit, and estimates the maximum value of the inner product by a maximum inner product detection circuit and makes it amplitude coefficient~
According to the invention, since intrablock mean value i5 separated in a mean value separation circuit and then inner product operation is performed in product sum ~orm and the maximum value is detected so as to estimate the optimum output vector and ~he amplitude coefficient simultaneously, the operation is simplified and the circuit scale in the apparatus decreases. Since the approximate expression need not be used in the inner product operation, the movement detection and the detection of optimum output vector can be performed at higher accuracy and the reproduction picture quality is improved.
:~ 20 ~ In an encoding member of a vector quantizer as :
another embodiment of the invention, mean value separated ;:by a mean value separation circuit is subjected to ~: differential PCM encoding (hereinafter referred to as ~ "DPCM encoding") thereby redundancy is removed. The .::
'' ,,, 1 32707~
.1 input vector after the mean value separation is not subjected to amplitude normalization but the inner product operation is performed in product sum form, and the maximum value is detected and subjected to the DPCM
encoding thereby the`redundancy is removed, and then the encoding is perform d. . .
According to this embodiment, the amplitude normalization circuit is removed in the vector quantiza-tion encoding member, and the scalar quantization enooding processing of the amplitude coefficient can be simplified and the circuit scale be reduced. Further, the vector quantizer to enable the redundancy removing using the DPCM encoding to the mean value component and the amplitude coefficient can be provided.
: A vector quantizer as another embodiment of the invention comprises a code table memory which can rewrite the contact dynamically, cos conversion normalization : member for convexting the input vector in cos conversion and then performing the normalization processing, a ~: : 20 vector quantization member including the code table ~}
: memory for performing vector quantization of the input vector subjected to the cos conversion normalization, a ~ code table updating member where group of the input : vectors of cos conversion normalization quantized into ;

r~ ,~

the same index in the vector quantization member are added and averaged and written as new set of output vectors of cos conversion normalization in the code table memory, and a normalization restoration inverse cos conversion member for performing reverse processing to the cos conversion normalization member.
According to this embodiment, even if images being significantly different in statistical property are inputted, since the circuit is constituted so that a new set of output vectors by the cos conversion normalization are extracted in clustering and the code table in the encoding member and the decoding member is updated and vector quantization is performed in the cos con~ersion normalization state, clustering of high speed using a ~ relatively small clustering model without increasing the : capacity of the code table enables a set of output vectors with little noise and the vector quantization, and the vector quantization of high quality can be effected to various images.
~20 In a urther embodiment of the invent1On, an amplitude correction circuit is provided to correct amplitude component in the minimum distortion, and the ; ~ corrected amplitude component is encoded.
According to this embodiment, correction is applied to amplitude while the normalization output vector is reproduced using the quantization distortion, thereby the adaptive vector quantizer is obtained without mismatching of the quantizer.
In still another embodiment of the invention, when color video input signals are composed of three components, red, green and blue, matrix conversion of the thre~ components is performed into luminance component and color difference component, and then the color difference component is sampled and at the same time the mean value of t~e luminance component is separated or the mean value of the luminance component and the mean value of the color difference component are separated, thereby the vector o~ normalization is subjected to vector quantization.
According to this embodiment, a color video vector quantizer to reduce redundancy of any color video signal is obtained using set of a small number of output vec~ors and increasing the hardware at the least degree.
In another embodiment of the invention, when color video input signals are composed of three components, red, green and blue, each reproduction color video signal after encoding is multiplied by prediction coefficient utilizing correlation between channels so as 1 32707L~

to form color video prediction signal of each channel, thereby the vector quantization noise is smoothed throughout each channel and accumulation of noise in the encoding loop is prevented.
According to this embodiment, a color image eficient enccding apparatus to improve the color reproducibility in reyion of significant color variation : can be obtained without deteriorating the encoding efficiency.
In another embodiment of the invention, a controller is~installed to perform matching in the timing of the video frame between the buffer at trans-mission side and the buffer at receiving side.
According to this embodiment, matching of the ~ 15 timing of the video frame is performed between the : transmission and receiving sides without transmitting the top end position information of the video frame and the clock information of decoding to the receiving side, : thereby the transmission control system and the control o~ the transmission and receiving buffers for the speed : smoothing aan be made easy.

: ::

~ 1 32707~
, .
_ The embodiments of the invention will now be described in detail.
Fig. 2 is a block diagram illustrating a constitution example of an encoding member of an interframe adaptive vector quantization apparatus of the invention. In Fig. 2, numeral 1 designates an A/D
converter, numeral 2 a raster/block scan conversion circuit where digital video signals in raster form by the A/D conversion are made a block per every m picture elements x n lines (m, n: integer), numeral 3 a vector quantization encoder which encodes the block data at high efficiency by means of vector quantization, numeral 4 a transmission data buffer where the encoded data at high efficiency is stored and transmitted to the transmission path at constant speed, numeral 5 a movement detection control circuit which controls threshold value of movement detection in the vector quantization encoder corresponding to the data amount stored in the trans-mission data buffer, numeral 6 a vector quantization decoder which decodes the encoding data supplied from the vector quantization encoder and reproduces the block data, numeral 7 a variable delay circuit, and numeral 8 a frame ~; ~ memory.
Fig. 3 is a block diagram illustrating a :~ ~

1 ~2707~

constitution example of a decoding member of the interframe adaptive quantization encoding a~paratus. In Fig. 3, numeral 9 designates a receiving data buffer where the encoding data supplied from the transmission path l5 received and stored and then outputted at speed corresponding to the decoding action, numeral 10 a block/raster scan conversion circuit where the block data decoded and reproduced is converted into data in raster form, and numeral 11 a D/A converter.
Encoding and decoding operation of the apparatus will now be described referring to Fig. 2 and Fig. 3.
Input video signals (101) are analog signals which are raster-scanned from the left to the right on the screen and from the upper side to the lower side.
The analog signals in raster form are converted into digital signals (102) by the A/D converter 1, and then the digital signals in raster form are made a block per ` every m picture elements x n lines (m, n: integer) by the raster/block conversion circuit 2, and further the picture element sample within the block is arranged in one-dimensional arrangement 50 as to obtain vector data S (103). Difference signal between the vector data S
(103) and frame vector data P ~104~ based on the same 2~

1 32707~

position block within the frame memory 8 becomes interframe difference vector ~ (lOS), which is inputted to the vector quantization encoder 3. The vector quantization encoder 3 applies processing of mean value separation and normalization to the interframe difference vector ~ (105), and performs movement detecting using mean value and amplitude coefficient obtained by the processing and using threshold value (106), and performs vector quantization of only vector of significant block based on the movement. And then the vector quantization .encoder 3 encodes the significance/insigniricance block information, the mean value, the amplitude coefficient and the vector quantization index information each usiny ~ variable length encoding or the like, and outputs the :~15 : encoding data (107). The transmission data buffer 4 stores the encoding data (107) and transmits it to the transmission path at constant speed according to prescribed transmission speed, and estimates data storage amount (108) and supplies it to the movemen, detection 20 ~ control circuit 5. The movement detection circuit 5 controls the threshold value (106) for the movement detection depending on variation of the data storage amount (108).
The encoding data outputted from the vector quantization encoder 3 is decoded according to reverse processing of the encoding in the vector quantization decoder 6, thereby interframe difference reproduction vector ~ (109) is reproduced. The interframe difference reproduction vector ~ (109) obtained in the processiny and the frame vector data P (104) delayed by prescribed time by means of the variable delay circuit 7 are added, thereby reproduction vector da~a S (110) is restored and the block data at corresponding position of the frame memory is updated. Above process is shown in following expressions. ..

= S-- P
~ represents operation error in vector quanti~ation encoding.) ' P = S r ~ ~ ( Z f represents one frame delayO) 20 :
:;
On the other hand, the encoding data (107) after received and speed-changed in the receiving data ; buffer 9 is decoded by the vector quantization decoder 6, thereby interr~me difference reproduction vector ~ (109) .

;~ 1 327074 is reproduced. The interframe difference reproduction vector ~ and the frame vector data P ~104) passing through the variable delay circuit 7 are added, and reproduction vector data S (110) is restored in similar S manner to the processing in the encoding member.
That is, vector operation S = P + ~ = S.~ ~
is executed. The reproduction vector data S (110) is converted into data (111) of raster form by the block/
raster scan conversion circuit 10, and the data (111) is converted in D/A-conversion by the D/A converter 11 so as to obtain analog reproduction video signal (112).
Next, constitution and operation of the vector quantization encoder and the vector quantization decoder will be described in detail.
In Fig. 1, numeral lZ designàtes a mean value . .
separation circuit which estimates intrablock mean value of interframe difference vector and separates the mean value, numeral 14 an inner product operation circuit whicn estimates inner product between input vector by the mean value separation and output vector read from a code book ROM, numeral 15 a maximum inner product detection circuit which detects the optimum output vector by estimating maximum value of inner products between input ~ \!r~
-1 3 2 7 0 7 ~

and output vectors obtained with respect to a plurality of output vectors and determines amplitude coefficient at the vector quantization decoding, numeral 13 a movement detection circuit which performs movement detection using obtained mean value, amplitude coefficient and threshold value and outputs significance/insignificance block discrimination inEormation, numeral 16 a code book ROM, numeral 17 an address counter, and numeral 18 an index latch.
The operation will be described. The mean value separation circuit 12 performs operation as hereinafter described to interfrarne difference vector ~ (113) being input vector, and converts it into input vector x*.
Assuming that intrablock meàn value of 6 = L ~ Z , -, ~k~
be m, execution of k m =-- ~ ~; ( j 1, 2, - , ;s:*; = ~;--m x*=~:*1~*2,~. 3 X ~

produces the m~an value m and the input vector x*.
The inner product operation circuit 14 estimates ~ 327074 the inner product between the obtained input vector x*
and output vector in the code book ROM 16 where set of output vectors Yi (116)(i = 1, 2, ..., N) optimized by clustering or the like are written using normalization vector subjected to mean value separation and normaliza-by x [xl/ x2, ..., xk]. The inner product F (x, Yi) is estimated according to following formula.

Among the obtained inner products of N in number, the maximum value i5 detected by the maximum inner product detection circuit 15 and at the same time the maximum inner product is outputted as amplitude coefficient a* to the movement detecting circuit 13.
Assuming that the output vector index to provide the maximum inner product be 0 and the input/out-put vector be two-dimensional vector (k = 2), y0 becomes the optimum output vector and the maximum inner product is obtalned as amplitude coefficient. This will be ~explained referring to Fig~ 6.
Since.y; is subject to mean value separation and normalization, it follows that i ~1 1=.~

Assuming that angle between x and Yi be a it follows that = Ix I I Y i l~ I '~ ~

Consequently, when 9 = 0, x and Yi become vectors in the same direction and the distance within two-dimensional plane becomes minimum. Since condition of cos ~ is that -l < cos 0 < l, when ~ = 0, cos ~ = l and F ~ X t _i ) becomes maximum.~ Hence, yo to maximize the F (x, Yi) is obtained as the optimum output vector.
Since F ~ x , ~o~ IYOI æ
--a * I YO I
- a *

max F (x, ~i) may b~ used as the amplitude ^oefficient a*.
The obtained amplitude coefficient a* and the mean value m are inputted toget,her to the movement detection circuit 13, and compared with the threshold values Tor Tl (106), thereby the significance/insignifi-cance block discrimination, i.e., the movement detection ` 1 327074 processing is performed according to following conditions and the block discrimination information v (121) is outputted.

~ If m < To and a < Tl ; v = 0 (insigniicant block) If m > To or a > Tl ; v = 1 (significant block~

~ The block discrimination information v is transmitted per each block.
The intrablock mean value m (114~, the amplitude coefficient (122), the block discrimination information : v (121) and the output vector index i tl20), all obtained in the above process, are converted into codes being suitable as the vector quantization encoding information (107) and then output ed. In this case, if v = 0, codes in other in~ormation are not outputted.
A vector quantization decoder shown in Fig. 4 will now be described.
: ~ In Fig. 4, numeral 21 designates an amplitude :: :: ~ : :
;coefficient multlplier, and numeral 22 a mean value adder.
;;: Among the vector quantization encoding : information (107) transmitted from the receiving data :: ' ' .

1 32707~

buffer 9, the block discrimination information v is first decoded. If v = 1, i.e., the block is- significant, the decoded output vector index i (120) is taken in the index latch 19. In the code book ROM 20 where the same content as that of the code book ROM of the vector quantization encoder is written, the output vector Yi (119) indicated by the index i (120) is read. The amplitude coefficient ~* (118) is multiplied to the output vector ~i in the amplitude coefficient multiplier 21 and the mean value m (114) is added to the product in the mean value adder 22L thereby the interframe difference reproduction vector ~ (109) is decoded. That is, following processing is executed.

~ 2 ~ , ~k~
E j--a o ~ m ( ~ = 1 , 2, -- , k ) - .
If ~ = 0, i.e., if the block is insignificant, E iS
decoded and reproduced assuming that m = 0, ~ - 0.

~ - [0, 0, ... , 0]

Fig. 7 and Fig. 8 show another embodiment of the invention. In this embod.iment, an amplitude normalization circuit is removed, and a DPCM encoding 1'~

circuit and a DPCM decoding circuit are inserted in vector quantization encoding member and decoding member respectively for mean value component and amplitude coefficient, so that introduction of the DPCM encoding removes redundancy for the mean value component and the amplitude coefficient.
Description of this embodiment is performed regarding the case that threshold control is not performed.
Fig. 7 shows a constitution example of the vector quantization encoding member. In Fig. 7, numeral 12 designates a mean value separation circuit, numeral 14 an inner product operation circuit, numeral 15 a maximum inner product detection circuit, numeral 16 a waveform code book ROM, numeral 17 an address counter, numeral 18 an index latch~ numeral 25 a DPCM encoding circuit, and numeral 26 an encoding circuit. Also, Fig. 8 shows a constitution axample of the vector quantization decoding member. In Fig. 8, numeral 27 de~ignates a DPCM decoding ~ circuit, numeral 21 an amplitude coefficient multiplier, numeral 22 a mean value adder, and numeral 3 a decoding circuit.
In the vector quantization encoding member constituted as above described, the mean value component m (114) is processed in similar manner to the preceeding embodiment, and its redundant component is deleted by the DPCM encoding circuit 25 and the difference signal d~
(123) is outputtedO
On the other hand, the mean value separation vector _* (115) is processed in similar manner to the preceeding embodiment, and the maximum inner product Pmax (118) is detected by the maximum inner product operatio~ circuit 15, and normalization address informa-tion i is taken in the index latch 18 and outputted as the normalizatiQn output..vector index i (120). The detected maximum inner product Pmax (118) is inputted as the amplitude coefficient g directly to the DPCM encoding circuit 25, and its redundant component is deleted and then the difference signal dg (124) is outputted.
The ~PCM encoding circuit output d~ (123) for the mean value component m (114), the DPCM encoding circuit dg (124) for the amplitude coeEficient g (118), and the normalization output vector index i (120) are.
~ subjected to variable length encoding in the encoding circuit 26.
Next, the vector quantization decoding operation will be described. The difference signal d~l (123) of the mean value component m, the difference signal dg (124~ of 1 32707~

the amplitude coefficient g, and the normalization output vector index i (120) are decoded in sequence in the decoding circuit 3.
The mean value m (114~ is decoded and reproduced in the DPCM decoding circuit 27, and the am~litude coefficient gi (118) is decoded and reproduced in the DPCM encoding circuit 27. The normalization output vector index i (120) is taken in the index latch 18, and the normalization output vector Yi (116) with address indicated by the normali2ation output vector index i (120) ~is read and decQded~within the waveform code book ROM 16 ; ~ where the same content as that of the waveform code book ROM 16 in the vector quantization encoding member is written. The normalization output vector Yi (I16) is multiplied by the decoded amplitude coefficient gj (123) ~in the amplitude coeficient multiplier 21, and the decoded mean value component ~ (114) is added to the ~product thereby the encoding reproduction vector S (109) is obtained.
~20~ Still another embodiment of a vector ~ ~ :
quantization encodlng member will now be described.
;~Fig. 9 shows a constitutlon example of an encoding member in a video signal conYersion vector quantizer. In Fig. 9, numeral 8 designates a video 1 32707'~

memory where image to be quantiæed is stored, numeral 28 cos conversion normalization member, numeral 126 cos conversion normalization input vector, numeral 127 d.c.
component and amplitude component of input vector 125, S numeral 29 a vector quantization member, numeral 128 vector quantization index, numeral 30 a code table updating member, numeral 129 set o cos conversion normalization output vectors updated, numeral 26 an encoder, and numeral 130 encoding member output signal.
Fig. lO shows a detailed constitution example o the vector quantization member 29. . In Fig. lO, numeral 31 designates a normalization input vector register, numeral 17 a code table address counter, numeral 130 code table address, and numeral 16 a dynamic cos conversion normalization output vector code table comprising first and second code table memories.
Numeral 32 designates a normalization output vector register, numeral 33 a parallel subtractor for calculat-; ~ ing difference between the input and output vectors subjected to cos conversion normalization, numeral 34 a parallel absolute value calculator or outputting absolute value o~ the difference calculated in the parallel subtractor 33, numeral 23 an absolute value distortion calculation circuit (accumulator), numeral 20 a minimum distortion detection circuit, and numeral 18 an index latch.
Fig. 11 shows a detailed constitution example of the code table updating member 30. In Fig. 11, S numeral 35 designates a vector accumulator where the cos conversion normalization input vectors are accumulated per mapped index, numeral 36 an index counter for counting what number of the cos conversion normalization input vectors are mapped on each index, numeral 37 a division calculator where the sum calculated in the vector accumulator 35 is.divided by the number counted in the index counter 36, and numeral 38 a register for holding the quotient obtained in the division calculator 37.
Fig. 12 shows a detailed constitution example of the decoding member in video signal conversion vector quantizatîon according to the invention. In Fig. 12, numeral 39 designates a decoder, numeral 132 cos conver~ion normalization output vector, numeral 40 a ~o normalization restoration inverse cos conversion member, and numeral 133 output vector.
Operation of this embodiment will be described.
Basic principle is in that when images of dif~erent properties are inputted and set o~ output vectors must be updated, clustering is performed using group of input vectors as a model and a new set of output vectors are obtained, the input images are subjected to vector quantization using this set, and the vector quantization information and set of the updated output vectors are made the encoding output so as to cope with significant variation of the input images. In this case, vectors are processed in the cos conversion normalization state. In this constitution, clustering can be converged at high speed using relatively small model, although it is usually converged in a lony loop using a large model.
This is because the signal series in the cos conversion is converted from vector in the space axis into vector in the time axis thereby noise component superposed to high frequency component with small power is rapidly removed.
Regarding the signal series f~;) (j = 0, l, ..., M-l), one-dimensional cos conversion F~u) of f(j) becomes as follows:

~ F(~ _ 2C(~ ~ f(j)co~

(u=O, 1 ,~
wherein, ctu)= ¦ l/2 ( u - 0 ) l ( U - l,2, ,h~-l) 1 32707~

Also, inverse cos conversion f(j) o F(u) becomes as follows:

f(~ F(~ co~ ~ ( 2 ) (i = 0,l, ,~

[Detailed description o~ the cos conversion is disclosed, for example, in PRATT "DIGIT~L IM~GE PROCESSING" (WILEY
INTERSCIENCE~
Above-mentioned operation will be described referring to the accompanying drawings. In Fig. 9, video signals stored in the video memory 8 are read in ~o.rm of K-dimensional input vectors (125), S = {Sl, S2, ..., Sk}.
In the cos conversion normalization member 28, for example, as hereinafter described, the cos conversion normalization input vector 126, X = {xl, x2, ..., x~}, the d.c. component (m) and the amplitude component ~a) :20~ (127) are formed.

: 1 k ~: ~: m = ~cos conversion first term) = ~ ~ SJ

~ a = ~ j~ 2 I K ~ co~ 2 2s ~ \
~ 327 07 L~

~ K ~l Stc03 [ (Z~

( j - 2,3, ~ ) ' Xl= O

That is, the d.c. component m as the first term after the cos conversion is separated from the vector.
The second term and so like are normalized by the mean absolute value sum (amplitude) in each term, and equivalently become the cos conversion normalization input vectors (126) in (K-l) dimensions. The d.c.
component (m) and the amplitude component (a) (127) axe separated. Although one-dimensional cos conversion and the mean absolute value sum as amplitude are used in the embodiment, of course, two-dimensional cos conversion or mean square sum may be used.
~ The cos conversion normalization input vectors X (126) are latched to the normalizatlon input vector register 31 in the vector quantization member 29. The ; code ~able address counter 17 sequentially reads ~he last cos conversion normalization output vectors Yi from the dynamic cos conversion normalization output vector co~e ` 1 ~27074 table 16 by the code table address ~130), and latches them to the normalization output vector register 32.
The absolute value distortion operation circuit 23 calculates the absolute value distortion di using the S parallel subtractor 33 and the parallel absolute value calculator 34 as follows:

di= j~ I X~

(Term of j = 1 is unnecessary essentially.) The minimum distortion detection circuit 20 generates strobe signal when the absolute value distor-tion di is minimum, and takes the code table address 130 to the index lutch 18. Conten~ of the index latch 18 at ~ one round of the code table address counter 17 becomes the vector quantization index (120). On the other hand, ; the cos converslon normalization input vectors (126) are accumulated to the vector accumulator 35 per index (1~0) quantized in the code updating member 30. The index counter 36 counts the number of vectors mapped to each : index. Arithmetic mean of the vectors mapped to each in ex is calculated by the division calculator 37. The mean vector is held to the register 38, and written as the updated cos conversion normalization output vector 1 32707~

Yi (129) in the dynamic cos conversion normalization output vector code table 16. The initial content of the dynamic cos conversion normalization output vector code table 16 is picked up from the cos conversion normaliza-tion input vector X (126).

Y i = ~ X II i ~Yi~ C Y1, Y2, --, YN ~ (UPdated set) Wherein, (X)i represents input vector X quanti~ed in the index i, D X 11 i represents the number of input vectors X
quantized in the index i, and N represents the number of output vectors. Above-mentioned process is clustering.
When tke vector quantization index (128), the d.c.
component and the amplitude component (127), and the code ~table are updated, the encoder 26 in ~ig. 9 performs encoding together with set of the updated cos conversion output vectors (129), and outputs them as the encoding member output signals (125).
In the encoding member as shown in Fig. 12, when the vectox quantization index (120), the d.c. component and the amplitude component ~127), and the code table are updated in the decoder 39, set of the updated cos conversion normalization output vectors (129) are decoded.

1 32707~

The updated cos conversion normalization output vectors 129 are written in the dynamic cos conversion normaliza-tion output vector code table 16. The cos conversion normalization output vectors ~i (132) to provide the minimum distortion according to the vector quantization index (120) are latched to the normalization output vector register 32. The normalization restoration inverse cos conversion circuit 40 reproduces the output vectors ( 33)~ S {S 1~ S 2~ --, Slk} using the d.c~
component (m) and the amplitude component (~) as follows:
' '' j i-2 ~ . ~ 2 K

(j--1 ,Z,~

Another embodilllent will now be described wherein .
amplitude component is corrected using minimum quantization : ~istortion in ordex to eliminate mismatching of a vector quan~izer.

In Fig. 13, numeral 132 desi~nates input vector, :
: ~ numeral 28 a mean value separation normalization circuit, numeral 133 normalization input vector, numeral 134 mean value component of the input vector 13?, numeral 135 amplitude component thereof/ numeral 31 a normalization ; t 32~Q74 input vector register, numeral 17 a code table address counter, numeral 131 code table address, numeral 16 a normalization output vector code table memory, numeral 32 a normalization output vector register, numeral 33 a parallel subtractor, numeral 34 a parallel absolute value calculator, numeral 23 an absolute value distortion calculation circuit (accumulator), numeral 20 a minimum distortion normalization output vector detection circuit, numeral 136 minimum quantization distortion detected by th~ minimum distortion normalization output vector detection circuit 20, numeral 137 strobe signal, numeral 18 an index latch, numeral 120 vector quantization index, numeral 41 an amplitude correction circuit, numeral 138 corrected amplitude value, numeral 26 an encoder for encoding the vector quantization index, the mean value component and the amplitude component together, - and numeral 130 encoding member output signal.
Fig. 14 shows an example of a decoding member. In Fig. 14, numeral 39 designates a decoder for decoding the - vecor quantization index, the mean value component and the amplitude component, numer~l 139 normalization output vector, numeral 40 a mean value separation normalization restoration circuit, and numeral 140 output vector.
Operation of this embodiment will be described.
plurelity of input signal series are brouaht together into input vectors !l32), S =~sl, s2, ... , Sk} in block form, alld the inpllt vectors (1~2) are separated by the mean value separation normallzation circuit 28 into the mean value component (134) and the arnplitude component (135), and the normalization input vectors (133), X = {xl, x2, ~ k}
are formed. Assuming that the mean va]ue component (1~4) be m and the am itude component (135) be a, when the absolute value ampli~ude is used for example, they are expressed as ~o~lows:

m = K-l ~ Sj .

j -k a = K~ Sj - ml ~ 1 !absolu~e value amplitude) xj = (Si - m)/a (j = 1, 2, ... , k) _ Although the absolute value ampli-tude is exemplified, k ; a = [K l ~l(sj m)~ (standard ~eviation~

a = 1 rmax(sj - m) - min(sj - m)]

(peak-to-peak value) or the like, of course, may ~e use~..
Since the input vectors-a~proach definite 1 32707~

distribution within the signal space according to the processing of mean value separation and normalization, efficiency of the vector quantization is improved. The normalization input vectors (133) are latched to the normalization input vector register 31. The code table address counter 17 sequentially reads the normalization output vectors yi from the normalization output vector code table memory 16, and latches them to the normalization output vector register 32. The absolute value distortion calculation circuit 23 estimates the distortion di between X and yi from the parallel subtrator 33 and the parallel absolute value calculato.r 34 as follows:

k di = ~-¦xj - Yij¦ (absolute value distortion) ~=1 1S Although the ~bsolute value distortion is exemplified, k di = ~ (xj _ yij)2 (square distortion) ~=1 di = m~x¦xj - yij¦ (maximum element distortion~
~ or the like, of course, may be used.
. The minimum distortion detector 20 detects the minimum value of the distortion di between y~ and X read in sequence. That is, the minimum distortion becomes d = min di ~6 When the normalization output vector with the minimum distortion is detected, the strobe signal (137) is transmitted to the index latch 18 and the code table address (131) be.ing address of vector is taken and the minimum quanti%ation distortion (136) min di is outputted. At the time of one round of the code table address counter 17, the code table address stored in the inde~ latch 18 becomes the vector quantization index (120). The amplitude correction circuit 41 cor~ects the amplitude component (135) using t~le minimum quanti~ation distortion (136) according to the strobe signal from the minimum distortion detector 20, and outputs the corrected amplitude value (138). The correction of amplitude is performed in order to minimize the distort.ion during signal reproduction. For example, when quantization distortion is large, the correction corresponds to . multiplication of factor to the amplitude so as to decrease the amplitude in the reproduction. In this constitution, not only the distortion due to mismatching of the quantizer can be reduced, but also noise component contained in the inpu-t signal can be reduced. The amplitude correction circuit 41 may be constituted by ROM having the minimum quantization distortion (136) and the amplitude component (13S) as address input, and. therefore increase of the apparatus scale is ~uite small. The correction characteristics can be .
:

determined previously in that relation between the quantization distortion min di and the factor multiplied to the amplitude so as to minimize the distortion during reproduction is processed statistically. When the standard deviation is used in the normalization and the square distortion is used as definition of distortion, the correction characteristics may be specified by numerical expression.
Fig. 15 is a diagram illustrating principle of correction in this embodiment using the standard deviation and the square distortion. In Fig. 15, X designates the normalization input vector, and Yi desi~nates the normaliza-tion output vector by vector quantization of X. Since both X and Yi are subjected to mean value separation normalization, they are on hypercircumference of radius ~K in K-dimensional space. Angle ~ between the normalization input vec-tor X and the normalization output vector yi corresponds to distortion of both vectors, and has following relation.
di = 2 K (1 - cos ~) As clearly seen from Fig. 15, in order to obtain the best approximation of X by multipl~ing factor to yl, cos ~ becomes the optimum factor~ Since above relation is held in similar form also at ~ultiplying the amplitude during reproduction, cos ~ is multiplied as ~actor to the amplitude, there~y the f' 1 3~7074 distortion during reproduction can be reduced corresponding to the quantization distortion di. Since di is estimated during the vector quantization, factor cos ~ is specified as follows:

di cos 9 = 1 ~

Hence, the corrected amplitude value (138) a' is specified as follo~s:
di a' = ~

The encoder 26 encodes the corrected amplitude . .
value (138) ~', the mean value component (134) m and the vector ~uantizatioll index 120, and outputs them as the encoding member output signal (130).
In the decoding member, the decoder 39 decodes the ` vector quantization index ~120), the mean value component ~ ~ . (134) and the corrected amylitude value (138), and reads the : 20 normalization output vectors Yi frotn the normalization : ~ output vector code table 16 and latches them to the ; normalization output vector register 32. Further, the mean value separation normalization restoration circuit 40 decodes the output vectors (140), S' = {sl', s2', ... , Sk'}

~' 1 32707l~

using the mean value component (134) and the corrected amplitude value (138). That is, sj' = a Yij + m (j = 1, 2, ... , k) When color video input signals are composed of three components, red, green and blue, the vector quantization including color information is not practicable.
In order to obtain a versatile set of output vectors to enable model formation for any image, the number of the output vectors will become bulky. Consequently, matrix conversion of the three components is performed into luminance component and color difference component, and then the colcr difference component is sampled and at the same time the mean value of the luminance component is separated or the mean value of the luminance component and the mean value of the color difference component are separated, thereby the vec~or of normalization is subjected to vector quantization. In this constitution, a color video quantizer to reduce redundancy of any color video signal is obtained using set of a small number of output vectors and increasing the hardware at the least degree.
An embodiment in such constitution will now be described in detail. In Fig. 16, numerals 141, 142, 143 designate input signal series of R, G and B components respectively, numeral 42 a matrix conversion circuit, numeral 144 luminance Y signal, numerals 145, 1~6 color difference I and Q signals, numeral 1~ a mean value separation circuit, numeral 147 mean value, numeral 1a8 Y slgnal after mean value separation, numeral 28 a normaliza-tion circuit, numerals 149, 150, 151 Y component, I component and Q component after vector normalization respectively, numeral 152 input vector subjected to luminance mean value separation and normalization, numeral 31 an input vector register, numeral 131 output vector address, numeral 16 an output vector code tab.le, numeral 17 an output vector address counter, numeral 116 normalization output vector, numeral 117 intervector distortion, numeral 119 index strobe signal, numeral 153 index signal, numeral 18 an index register, numeral 135 amplitude value, numeral 120 inde~ of minimum distortion output vector, numeral 26 an encoding circuit, znd numeral 130 encoding output signal.
: Also in Fig. 17, numeral 39 designates a decoding circuit, numeral 154 output vector address, numeral 156 normali~ation output vector, numeral 21 an amplitude reproduction circuit, numeral 157 mean value separation Yl signal, numeral 158 Il component signal, numeral 159 ~1 component signal, numeral 22 a luminance mean value adding circuit, numeral 160 Y component signal, numeral 43 ;` 1 32707~

a matrix reverse conversion circuit, and numerals 161, 162, 163 R, G, s output signal series.
Operation of this embodiment ~ill be described.
The description will be performed first referring to an example of matrix conversion shown in Fig. 18.
The R, G, B input signal series 141, 142, 143 are converted by the matrix conversion circuit 42 into the Y
component (luminance) and the I, Q components ~color difference).
Conversion expressions are as follows:
Y = 0.30 R + 0.59 G + 0.11 B
. .
I = 0.60 R - 0.28 G - 0.32 B
Q = 0.21 R - 0.52 G + 0.31 B
Further, the I, Q components are subsampled.
Fig. 18 shows an example of this conversion. In Fig. 18, the R, G, B signals of 4 x 4 picture elements are converted into the Y signals of 4 x 4 picture elements and the I, Q
signals subsampled by the mean values of 2 x 2 picture elements. The luminance Y signals (144) obtained by the 20 ~ matrix conversion eliminate the mean values ~147) being d.c. component of luminance in the mean value separation circuit 12, and are transferred as the Y signals (148) of mean value separation to the normali7.ation circuit 28.
Assuming that the Y signal after matrix conversion -- ` 1 32707~

be Yj, the mean value separation Y signal be yj and the separated mean value be ~, it follows that y 516 j=l Yj = Yj ~ ~ .
In the normalization circuit. 28, the mean value separation Y signals (148) and the color difference I, Q
signals (145), (14~)) are brought together (In the e~ample of Fig. 18, Y, I, ~ are brought togethe~ into 24-dimensional vectors.) and..the normaLization is performed! thereby the amplitude values (135) of the input vectors are separated.
Assuming that the vector before normalization be s, the normalization input vector (152) be u and the amplitude :1~5 value (l35) be a, it follows that s = {Yl, -~ , Yl61 Il, ... , I4, Ql, -~ , Q4}
{ S ~ S ? 4 }

: ~l 24 24 j~

: ~ u j = s j /~
u = {ul, ... , u~4}
Although the absolute value amplitude is shown as amplitude, the standard deviation, the peak-to-peak value or the like may be used.

2 2 ; (standard deviation) 24 ]=1 S a = - {m~x(sj) - m,n(sj)}
; (peak-to-peak value) The Y, I, Q components (149), (150), (151) after normalization are latched to the input vector register 31, and the input vectors (152) subjectecl to lumillallce mean value separation and normalization are supplied to the distortion calculation circuit. The output vector address counter 17 ~enerates the output vector address 131 so that the output vectors (116) are sequentially read from the output vector code table 16. The'distortion calculation circuit 23 calculates the intervector distortion between the normalization input vector u tl52) and the output vector (116) vl from the output vector table 16. Although the absolute value distortion ~2Q ~ ~ d (u, vi) = ~ ¦uj - vij¦

is used in the dis~ortion calculation, the square distortion, the maximum element distortion or the like as hereinafter de~cribed may be used.

24 " 1 3~7 07 ~
d(u, vi) = ~ (uj - vij)2 - ; (square distortion) The minimum distortion detection circuit 20 supervises the intervector distortion (117) outputted from the distortion calculation circuit 23, and transmits the index strobe signal (119) to the index register 18 if the minimum distortion is detected. Then, the index signal (153) from the output vector address counter 17 is takerl in the index register 18 and stored therein. At the time of one ~ round of the output vec~or addres~ counter 17, index within the index regis~er 18 becomes the minimum distortion output vector index (120) and is transmitted to the encoding circuit 26.
The encoding circuit 26 encodes the minimum ~ distortion output vector index (120) together ~ith the mean value (147) and the amplitude value (135), and outputs the encoding output signal (130) to be transmitted : ~ ~
or recorded.
Subsequently in the encoder of Fig. 17, the 20 ~ ~ encoding output signal (130) enters the decoding circuit 39, thereby the output vector index (120), the mean value (147) and the amplitude value (135) are decoded. The minimum distortion output vector index (120) is converted by : .
.

~ 32707~

the index register 18 in-to the output vector address (154), and the normalization output vectors (156) vi are read from the output vector code table 16.
Vi = {Vil, ..., vi2a}
The normalization output vectors (156) are multiplied. by the amplitude value (135) in the amplitude reproduction circuit 21, and then the ~ean value (147) is added to only the mean value separation Y component signal (157) in the mean value adding clrcuit 22.
s'j = vj x a s' - {S'.l, --- , 5..24 = {Y'l, -- , y'l6, I'l, ... , I'4, Q'l, .. , Q 4}
Y'j = y'j +
The Yl component signals (160) subjected to amplitude reproduction and mean value adding and the Il, Ql component signals (1583, (159) after amplitude reproduction are reverse-converted by the matrix reverse conver~ion circuit 43 into the R, G, B output signal series (161), ~ 2), (163).
: 20 : Although only the Y signal component of the input vector is subjected to the mean value separation in the above embodiment, method of mean value separation is not limited to this, but the mean value of the combined component of the I component and the Q component may he separated independently on the mean value of the Y component.and subjected to amplitude normalization.
Althou~h the Y, I, Q si~nals are obtained from the R, 5, B signals by the matrix conversion circuit in the above embodiment, the Y, R-Y, B-Y signals may be used in place of the Y, I, Q signals.
When the color video signals are subiected to the color video difference vector quantization~ accumulation of vector quantization noises between the color video si~nals in the encodirlg loop may be mutually affected and not averaged, resulting in the significant color shift trailing at the image variation point.
Consequently, each reproduction color video signal after encoding is multiplied by prediction coefficient utilizing correlation between channels so as to form color video prediction signal of each channel, thereby the vector quantization noise is smoothed throughout each channel and accumulation of noise in the encoding loop is prevented. In ~ this constitution, a color image efficient encoding apparatus to improve the color reproducibility in region of significant ~: color variation can be obtained without deteriorating the encoding efficiency.
An embodiment in such constitut.ion will now be described. In Fig. 19, nu~erals 44, 45 and 46 desi~nate subtractors for subtracting color video prediction signals from color video input signals composed of the three components, R, G and B, per each component, and outputting the color video difference signals respectively, numeral 29 a vector quantizer for bringing together the color video difference signals of the three components into vector quantization in the three-dimensional signal space and outputting the color video difference vector quantization signals and the vector quantization inde~, numerals 47, ~8 and 49 adders for adding the color video difference vector.
q.uantization signals to the color video predic-tion signals per each component and obtaining the color video reproduction signals respectively, and numerals 50, 51 and 52 R, G and B
prediction devices for forming the color image prediction signals per each component from the color video reproduction signal series respectively.
Numerals 53 through 61 designate multipliers for ~~
multiplying the interchannel prediction coefficients of each color video signal respectively, and numerals 62, 63 and 64 accumulators of signals of multiplying the interchannel prediction coefficients to the prediction devices 50, 51 and 52 of each color video signal per each channel respectively.
Regarding the color video input signals of red, green and blue, assume that the red ~ideo input signal (191) - `
l 3~7o74 be R(Q), the green video input signal (142) be G(.e) and the blue video input signal (143) be B(~). Wherein ~= 1, 2, designates the time series number of each signal. Then, assume that the color video correlation prediction signals 5 (164), (].65) and (166) of the red, green and blue channels be P*R(~), P*G(~) and P*g( e, respectively, the color video difference signals ~167), (168) and (169) obtained by subtracting the color video correlation prediction signals from the color video input signals througll the s-lbtractors 44, 45 and 46 per each channel be ER(~ G(~) and ~B(~) respectively,.and the color video vector quantization signals (170), (171) and (172) obtained in the vector quanti7ati.0n of the three signals ER(Q)~ ~G(l) and ~8(~) by the vector quantizer 29 in the three-dimensional signal lS : space S3 be ~R~ G(~) and ~B(~). Also assume that the color video reproduction signals (173), (174) and (175) obtained by adding the color video vector signals to the color video correla-tion prediction signals per each channel be R(~), G(~) and B(~) respectively, and the color video prediction signals (176~, (177) and (178) formed in multiplication of prescribed coefficients by the R prediction device 50, the G prediction device Sl and the B prediction device 52 utilizing correlation of the color video signal series per each channel based on the color video reproduction .

1 32707~

signal series be PR(Q), PG(Q) and P~(L~) respectively.
Then, the encoding member shown in Fig. 19 executes the operational processing as follows:
~R(~) = R(~) - P~(i) , R(t) ~R(~) + QR( ~ ) G ~ ) PG ( ~ G ( ~ G ( t ) + QG ( ( ) ~ B ( Q ) = ~ B ( 1 ) ~ Q B ( (~ ) (~ ) PR(~ ) + R(~) = R(( ) + QR('~') G ( 1 ) = P~ ( ~ ) + ~ G ( ~ ) G ( ) QG
B( ~) = PB(Q ) + S B( ~) B( ~) Q~(~
10 ~ PR(~) = CR A R(~- 1) PG(Q) = CG _ G(~
Pg(~) = Cg B(~- 1) PR(~) = all PR(l) + al2 PG(i) + al3- PB(~) P~(l!) = a21 P.R(~ ) + a22 PG(~ ) + a23 PB(; ) P~ a31 PR(~) + a32 PG(I~) + a33 PB(~) Wherein, all, al2, al3, a21, a22~ a23, a31, a32, a33 are ` the interchannel prediction coefficients derived ~rom the ; correlation between the color video signals. The coef~icients preferably hold relation as follows:
~20 ~ all + al2 + al3 < 1 ~ a21 + a22 + a23 < 1 : a31 ~ a32 + a33 < 1 ~ Means for forming the color video correlation ;~ prediction si~nals per each channel by multiplying the : coeficients corresponding to the correlation in the color :

,r~ ~

signals between the adjacent picture elements according to the embodiment, can smooth the vector quantization noises generated by the vector quantizer 29 and prevent the accumulation propagation in the encoding loop. That is, ~[Q~(~)2 ~ ~G(~)~ +QB(~)]< ~[~R(l)2 ~ ~Gtl)2~ ~g(i)2]

The vector quantiz3.tion is performed in procedure as hereinafter described. The color video difference signals .

CR(~), G(l') and ~g~f) in the three-dimensional signa1 space S3 are brought together into the illpUt vector xe. Set of the 10 output vectors ~j (j = l., 2, ... , N) of N in number to map the inpl1t vector are prepared, and the output vector to minimize the distance d (x, y~) between the input ve~ctor x and the output vector is selected and outputted as the color video VeGtOr quantization signals~ R(Q), ~G(~) and~ B(~

The index i of the output vector Yi to provide the min~mum distortion is transmitted as the encoding data (130) to the decoding member. Assuming that the vector quantization :processing be VQ, it follows that ~ XQ = (xl, x2, Xl~ R(~ G(~3~ ~B(~)) Yi = (yjl, yj2, yj3) d~, yj) = ~ (Xk ~ yjk) k=l ~ \
i 1 32707~

VQ: XQ -~ Yi if d(~ , yi ~' d (X?, Yi) for allj Yi = (yil, yi2, yi3) = (~'R(~ G(~ B(~
Thereby the color video difference vector quantization signals are obtained, and the encoding data is outputted to the decoding member.
Operation of the decoding member as shown in Fig. 20 is performed in that the encoding data (130) of the vector quantizer 29 is received and converted by the vector quantization decoder 39 into tile color video difference vector quanti,zation signals (170), (171~ and (172) and then the same processing as that of the adding loop in the encodlng member shown in Fig. 19 is performed thereby the color video reproduction signals R(~), G~) and B(e) are obtained. These are improved AS shown in the encoding member because the quantizatlon noise is reduced in comparison to the prior art.
Although the'above embodiment does not include the case of the intraframe prediction encoding or the adaptive control of the prediction device and the vector ~uantizer, of course, the invention may be applied to the intraframe or interframe prediction encoding and further to the adaptive , changing control of characteristics of the prediction device and the vector 4uantizer.

~ 327~7~

Although the efficient encoding of the ~olor video signals of red, green and blue is described in the enlbodiment, the invention can be applied.also to the color video signals in combination of the luminance signal and two color difference signals.
Still another embodiment of the invention will be described referring to the accompanying drawings, wherein matching of the timing of the video frame is performed hetween the transmission and receivin~ sides witllout transmitting the top end position information of the video : frame and the c~ock inf~rmation of decoding to the receiving side, thereby the transmission control system and the control of the transmission and receiving buffers for the speed smoothing can be made easy.
In Fig. 21, numeral 1 designates an A/D converter where inputted analog video signals are converted into digital data, numeral 65 a synchronous si~nal generating circuit for generating clocks required for the encoding such as video frame pulse or line pulse from the analog video signals, numeral 66 a video encoding circuit for converting the A~D converter output signal into the encoding data using efficient encoding method, numeral 67 an error correction encoding circuit for applying the error correction encoding to the encoding data transmitted from the bufer 1 ~27~7'~

memory, numeral 68 a transmission path clock source for outputting clocks to transmit the data onto the transmission path at prescribed speed, numeral 69 a frame constitution circuit to constitute the transmission frame for transmitting data together per prescribed time slot in synchronizatioll with the clocks of the transmission path, numeral 70 a frame analysis circuit where data of the transmission frame transmitted through the transmission path are analysed and converted into the encoding data train, numeral 71 an error 1~ correction decoding circuit for correcting the error in the reverse processing to that of the error correction ençoding circuit, numeral 11 a D/A converter where the digital data decoded by the video decoding circuit is converted into analog video signals and then outputted, numeral 72 a transmission control member at transmission side, and numeral 73 a transmissiQn control member at receiving side.
Numeral 74 designates a header generating circuit for generating a header to di.scriminate the transmitted data ~: frame, numeral 4 a transmission buffer where data taken per ~ one ~ideo frame and encoded in the video encoding circuit are stored according to command of a controller and transmitted at prescribed transmission speed, numeral 7S
.
a transmission data multiplication circuit for performing multiplication of the encoding data transmitted from the transmission buffer and other data such as the headerl numeral 76 a header interpreting circuit ~or interpreting the header of the transmitted data frame, numeral 77 a receiving data separation circuit for separating the encoding data and the voice data, numeral 9 a receiving buffer where received encoding data are stored and supplied sequentially to the video decoding circuit 78 according to command of the controller, numeral 79 a decoding synchronous signal generating circuit for generating various cloc~s to perform the decoding action in asynchronous state to the transmission side, and numeral 80 a controller for controlling the buffers at transmission and receiving sides. In Fig. 22, numerals 81, 82 designate buffers 1, 2 having the same capacity, and ~numerals 83, 84 designate selectors 1, 2 for performing the .
~ action changing of the buffers.
Operation of this embodiment will be described.
Digital data outputted from the A/D converter 1 are taken per every other video frame, and then encoded in the video encoding circult ~6 by efficient encoding method with the 20 ~ encodin~ speed heing not constant, such as interframe : .:
encoding, and supplied to the transmission buffer 4. The transmission buffer is a double buffer for performing read/~rite actions simultaneously, and is constituted as shown in Fig. 2Z. The buffers 1, 2 are changed in the .

1 32707~

input/output states by the selectors l, 2 accord~ to control from the controller 80, and at the same time supply the existing data storage amount to the controller~
The header generatin~ circuit 74 is a circuit to generate header information of the transmission data frame. If the encoding data of the top end position of the video f,~ame is transmitted to the transmission data multiplication circuit, the header generating circuit 74 outputs the specific data indicating the top end position of the video frame. The header information is multiplied together with the encoding data, the voice data or the like in the transmission data multiplication circuit 75. After adding the error correction code, -the frame synchronous pattern is inserted in the frame constitution circuit 69, and the arrangement changing of the data train is performed thereby the transmission frame is constituted. A constitution example of the transmission rame wi~th header is shown in Fig. 23.
The receiving data train transmitted through the digital transmission path is changed in the arrangement by 20~ ~ ~ the~frame analysis circuit 70 in synchronization with the frame synchronous pattern in the reverse processing to that as above describ~d. After the error correction in the error correction decoding circuit 71, the header is separated.
: ~ The header is discrimina~ed by the header interpreting ~ ~ .
&6 1 32707~

circuit 76, and the voice data is separated in the receiving data separation circuit 77 corresponding to constitution of the data frame and the encoding data is transmitted to the receiving buffer. In the recei.ving buffer 9, the encoding data from the data frame indicating the top end of tlle video frame discriminated by the one video frame discrimination header to next similar data frame are stored. The encoding data are transmitted to the video decoding circuit 78 in synchronization with the video pulse supplied from the decoding synchronous signal generating circuit 79. The decoding processing is p.erformed using clocks supplied from the decoding synchronous signal generating circuit, and the data is converted into analog video signals in the D/A
converter 11 and reproduced and outputted.
: Relation between operation of the transmission and receiving buffers and the transmission and receiving vidoo frames will be described referring to Fig. 2a. The transmission and receiving buffers take constltution in ~; Fig. 22. A~ the -transmission side, the controller supervises whether the buffers 1, 2 are empt~ or not accordin~ to the : ~ storage amount from the buffers 1, 2, and supplies the control signal of write/read depending on state of each : buffer. Assume that the buffer 1 is empty. The encoding data of the frame A is written to the buffer 1 in synchronization - ~ 327074 with the encoding ON/OFF signal varying at the timing of frame yulse of every other frame. At this time, the bu~fer 2 reads the frame Y~. If the writing of the buffer 1 and the reading of the buffer 2 are finished, the buffer 1 immediately starts the reading of the frame A and the buffer 2 writes the frame B in synchronization with next encoding ON signal.
Subsequently, the reading and writing operation is repeated in similar se~uence. Even if the writing of the buffer 1 is finished (frame C in the figure), while the readin~ of the buffer continues ~rame B in the figure), the reading of the frame C of the buffer l becomes standby and since the buffer 2 is not empty it cannot write and the frame D is stopped in encoding. On the contrary, even if the reading of the buffer 1 is finished (frame F in the figure), while the writing o the buffer 2 is not finished (frame G in the figure~, until the writing of the buffer 2 is finished, the buffer 1 reads the dummy data and outputs it as idle transmission f~ame. AcCording to above procedure, the transmission is performed without stoppin~ the readin~
operation of the buffers 1, 2.
At the receiving side, the writin~ operation of the buffers 1, 2 is changed alternately and continuously.
If the writing is finished, the huffer immediately performs 1 32707~
the reading in synchronization with the frame pulse ~enerated in asynchronous state to the transmission side.
Until the writing of another buffer is finished, the video frame read just before this and decoded is repeatedly outputted in synchronization with the frame pulse thereby the transmission delay amount of the video frame is adjusted.
In this embodiment, the data frame may be constituted in multiplication of the control data by ' ' .increasing the header information.
In the input signals'of the video encoding circuit, every o,ther frame may be taken.
Although the invention can be utilized in a motion picture transmission apparatus for teleconferencing ` system, it may be applied widely to transmission of motion picture of television without being limited to the teleconferencing system.

: .
: : :

, :

: : : :

:

~ 69

Claims

Claims 1. A video encoding transmission apparatus comprising:
a video encoding circuit for inputting video signal and performing A/D conversion of the signal and then applying efficient video encoding processing per frame to digital video data taken per every other video frame;
a transmission buffer constituted by a double buffer to enable simultaneous write/read, for storing one video frame of variable length encoding data with the information generating amount as the video encoding circuit output being not constant and outputting the encoding data at constant speed by the speed smoothing;
a transmission control member at transmission side.
for performing the transmission framing to enable discrimination per one frame unit to the encoding data transmitted from the transmission buffer and transmitting the encoding data from the transmission buffer to the digital transmission path at constant speed;
a transmission control member at receiving side for receiving the encoding data transmitted from the digital transmission path;
a receiving buffer constituted by a double buffer to enable simultaneous write/read, for storing one frame of encoding data among the receiving data supplied from the transmission control member at receiving side and outputting ?e video frame of the encoding data at speed being different from the inputting state using synchronous signal supplied from a synchronous signal generating circuit at detecting side as hereinafter described;
a synchronous signal generating circuit at decoding side for generating various clocks required for the decoding action at asynchronous state to the transmission side;
a video decoding circuit for performing decoding of one video frame of the encoding data using the decoding clock supplied from the synchronous signal generating circuit at decoding side; and a controller for controlling the input/output operation of the transmission buffer and the receiving buffer.