JP2003198989A - Display device and control method, program and recording medium, and display system - Google Patents

Abstract

(57) [Summary] [PROBLEMS] To display an enlarged image by a plurality of television receivers. SOLUTION: A television receiver as a base unit 1;
Each of the television sets as the handset 2 is obtained by converting the input image into an enlarged image obtained by enlarging the input image and displaying the entire enlarged image together with the other television receivers. Display the enlarged image. In addition, both the parent device 1 and the child device 2 perform authentication with another television receiver, and set an operation mode so that an enlarged image can be displayed when the authentication is successful. I do.

Description

Detailed Description of the Invention

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a display device, a control method, a program and a recording medium, and a display system, and more particularly, when a large number of display devices are connected and used, a higher performance than a single device is used. The present invention relates to a display device, a control method, a program, a recording medium, and a display system that enable a function to be realized.

[0001]

2. Description of the Related Art For example, a television receiver receives a television broadcast signal, displays an image as a television broadcast program, and outputs sound accompanying the image.

[0002]

By the way, the conventional television receiver is premised on the fact that it operates by itself, and therefore, when the user newly purchases the television receiver. The user does not need the television receiver owned by the user and is often discarded even if it is still usable.

Therefore, when a large number of television receivers are connected and a higher function than that of a single television receiver can be realized, disposal of usable television receivers is prevented and effective use of resources is achieved. Can contribute.

The present invention has been made in view of such circumstances, and when a display device such as a large number of television receivers is connected and used, a high function is realized as compared with the case of using it alone. It allows you to do.

[0005]

According to a first display device of the present invention, a prediction tap used for predicting a target pixel of interest among pixels forming an enlarged image obtained by enlarging an input image is input. A predictive tap extracting means for extracting from the image, a class tap extracting means for extracting from the input image a class tap used for classifying the target pixel into any one of a plurality of classes, Based on the class tap, a class classification means for classifying the pixel of interest, a tap coefficient of a class of the pixel of interest among predetermined tap coefficients prepared by performing learning for each of a plurality of classes, and a prediction tap. Using the prediction means for predicting the pixel of interest and the other display device, so that the entire magnified image is displayed An image, characterized by comprising a display control means for displaying on the display means.

According to a first control method of the present invention, a prediction tap used for predicting a target pixel of interest among pixels forming an enlarged image obtained by enlarging an input image is extracted from the input image. Based on the extraction step, the class tap extraction step of extracting the class tap used to classify the target pixel into any one of a plurality of classes from the input image, and the class tap, Using the class classification step of classifying the pixel of interest and the tap coefficient of the class of the pixel of interest among the predetermined tap coefficients prepared by learning for each of a plurality of classes and the prediction tap, the pixel of interest Prediction step for predicting, and, together with other display devices, enlargement consisting of pixels predicted by the prediction means so as to display the entire enlarged image. An image, characterized by comprising a display control step of displaying on the display means.

A first program of the present invention is a prediction tap extraction for extracting a prediction tap used for predicting a target pixel of interest among pixels forming an enlarged image obtained by enlarging an input image from the input image. Step and pixel of interest,
A class tap extraction step of extracting a class tap used for classifying one of a plurality of classes from an input image, and a class classification for classifying a pixel of interest based on the class tap A prediction step of predicting a pixel of interest using a tap coefficient of a class of the pixel of interest and a prediction tap among predetermined tap coefficients prepared by performing learning for each of a plurality of classes; And a display control step of causing the display unit to display the enlarged image composed of the pixels predicted by the prediction unit so as to display the entire enlarged image.

The first recording medium of the present invention is a prediction tap for extracting a prediction tap used for predicting a target pixel of interest among pixels forming an enlarged image obtained by enlarging an input image from the input image. Based on the extraction step, the class tap extraction step of extracting the class tap used to classify the target pixel into any one of a plurality of classes from the input image, and the class tap, Using the class classification step of classifying the pixel of interest and the tap coefficient of the class of the pixel of interest among the predetermined tap coefficients prepared by learning for each of a plurality of classes and the prediction tap, the pixel of interest Prediction step for predicting, and, together with other display devices, enlargement consisting of pixels predicted by the prediction means so as to display the entire enlarged image. An image, a program and a display control step of displaying on the display means, characterized in that it is recorded.

In the first display system of the present invention, each of the plurality of display devices uses a prediction tap used for predicting a target pixel of interest among pixels forming an enlarged image obtained by enlarging an input image, A predictive tap extracting means for extracting from the input image, a class tap extracting means for extracting from the input image a class tap used for classifying the target pixel into one of a plurality of classes, , A class classification means for classifying the pixel of interest based on the class tap, and a tap coefficient of a class of the pixel of interest among the predetermined tap coefficients prepared by learning for each of a plurality of classes, and a prediction tap And the prediction means for predicting the pixel of interest and the prediction means so that the entire enlarged image is displayed on the entire plurality of display devices. An enlarged image made by measuring pixel, characterized by comprising a display control means for displaying on the display means.

A second display device of the present invention displays an input image
An image conversion unit that converts the input image into an enlarged image, an authentication unit that performs authentication with another display device, and if the authentication is successful, the entire enlarged image is displayed together with the other display device. As described above, the display control means for displaying the enlarged image obtained by the image conversion means on the display means is provided.

The second control method of the present invention is to input an input image,
An image conversion step of converting the input image into an enlarged image, an authentication step of performing authentication with another display device, and if the authentication is successful, together with the other display device,
A display control step of displaying the enlarged image obtained in the image conversion step on the display means so as to display the entire enlarged image.

A second program of the present invention is an image conversion step of converting an input image into an enlarged image obtained by enlarging the input image, an authentication step of performing authentication with another display device, and the authentication is successful. In this case, a display control step of displaying the enlarged image obtained in the image conversion step on the display means is provided so as to display the entire enlarged image together with the other display device.

A second recording medium according to the present invention stores an input image,
An image conversion step of converting the input image into an enlarged image, an authentication step of performing authentication with another display device, and if the authentication is successful, together with the other display device,
A program including a display control step of causing the display unit to display the enlarged image obtained in the image conversion step so as to display the entire enlarged image is characterized by being recorded.

In the second display system of the present invention, each of the plurality of display devices performs authentication between the image conversion means for converting the input image into the enlarged image obtained by enlarging the input image and the other display device. The authentication method to perform, and if the authentication is successful,
A display control unit that causes the display unit to display the enlarged image obtained by the image conversion unit so that the entire enlarged image is displayed on the entire plurality of display devices.

A first display device and a control method of the present invention,
Also, in the program and the recording medium, a prediction tap used for predicting a target pixel of interest among pixels forming an enlarged image obtained by enlarging an input image, and the target pixel is one of a plurality of classes. The class tap used for classifying
The pixel of interest extracted from the input image is classified into classes based on the class tap. Then, of the predetermined tap coefficients prepared by performing learning for each of a plurality of classes, using the tap coefficient of the class of the pixel of interest and the prediction tap, the pixel of interest is predicted, together with other display devices. The enlarged image including the predicted pixels is displayed on the display unit so that the entire enlarged image is displayed.

In the first display system of the present invention,
A prediction tap used for predicting a target pixel of interest among pixels forming an enlarged image obtained by enlarging an input image, and a class classification for classifying the target pixel into one of a plurality of classes The class tap used for performing is extracted from the input image, and the pixel of interest is classified into classes based on the class tap. Then, of the predetermined tap coefficients prepared by performing learning for each of the plurality of classes, the target pixel is predicted using the tap coefficient of the class of the target pixel and the prediction tap, and the target pixel is predicted. The enlarged image including the predicted pixels is displayed on the display unit so that the entire enlarged image is displayed.

A second display device and control method of the present invention,
In addition, in the program and the recording medium, the input image is converted into an enlarged image obtained by enlarging the input image. On the other hand, if the authentication is performed with another display device and the authentication is successful, the obtained enlarged image is displayed on the display unit so that the entire enlarged image is displayed together with the other display device. To be done.

In the second display system of the present invention,
The input image is converted into an enlarged image obtained by enlarging the input image. On the other hand, when the authentication is performed with another display device and the authentication is successful, the obtained enlarged image is displayed on the display unit so that the entire enlarged image is displayed on the entire plurality of display devices. Is displayed in.

[0019]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS FIG. 1 shows a scalable TV (Television) system to which the present invention is applied (a system refers to a logical assembly of a plurality of devices, each of which has a single housing. It does not matter whether or not there is) a perspective view showing a configuration example of an embodiment.

In the embodiment of FIG. 1A, the scalable T
The V system includes nine television receivers 1 and 2
It is composed of ₁₁ , 2 ₁₂ , 2 ₁₃ , 2 ₂₁ , 2 ₂₃ , 2 ₃₁ , 2 ₃₂ , and 2 ₃₃ . In the embodiment of FIG. 1B, the scalable TV system includes 25 television receivers 1,
And 2 ₁₁ , 2 ₁₂ , 2 ₁₃ , 2 ₁₄ , 2 ₁₅ , 2 ₂₁ , 2 ₂₂ , 2
₂₃ , 2 ₂₄ , 2 ₂₅ , 2 ₃₁ , 2 ₃₂ , 2 ₃₄ , 2 ₃₅ , 2 ₄₁ ,
2 ₄₂ , 2 ₄₃ , 2 ₄₄ , 2 ₄₅ , 2 ₅₁ , 2 ₅₂ , 2 ₅₃ , 2 ₅₄ , 2
It is composed of ₅₅ .

Here, the number of television receivers constituting the scalable TV system is not limited to 9 or 25. That is, the scalable TV system can be configured by an arbitrary plurality of television receivers. Further, the arrangement of the television receivers constituting the scalable TV system is not limited to 3 × 3 or 5 × 5 in width × length as shown in FIG. That is, the arrangement of the television receivers constituting the scalable TV system may be, for example, 1 × 2 in the width × height, 2 × 1, 2 × 3, or the like. Further, the arrangement shape of the television receivers configuring the scalable TV system is not limited to the lattice shape (matrix shape) as shown in FIG. 1, and may be, for example, a pyramid shape.

In this way, the scalable TV system is
It can be said that the system is “scalable” because it is possible to configure an arbitrary number of television receivers in each of horizontal and vertical directions.

A television receiver constituting a scalable TV system includes a parent television receiver (hereinafter, referred to as appropriate) capable of controlling other television receivers.
Two types: a parent device) and a child television receiver (hereinafter, appropriately referred to as a child device) that can be controlled by another television receiver but cannot control another television receiver. Exists.

In order for the scalable TV system to carry out various kinds of processing described later, the television receiver constituting the scalable TV system must be compatible with the scalable TV system (hereinafter, referred to as a scalable device). At the same time, at least one of them is a master device. For this reason, in the embodiments of FIGS. 1A and 1B, among the television receivers constituting the scalable TV system, for example, the centrally arranged television receiver is the master unit 1.

From the above, when there is a television receiver that is not a scalable device among the television receivers that constitute the scalable TV system, the function of the scalable TV system is enjoyed depending on the television receiver. Can not do it. Furthermore, even if the television receivers that make up the scalable TV system are scalable devices, if all of them are slaves, the functions of the scalable TV system cannot be enjoyed.

Therefore, in order to enjoy the functions of the scalable TV system, the user needs to purchase at least one or more masters, or one master and one or more slaves.

The master unit also has the function of a slave unit,
Therefore, a plurality of parent devices may exist in the television receiver that constitutes the scalable TV system.

In the embodiment shown in FIG. 1A, 3 × 3 TV sets are used.
The center of the vision receiver (second from the left, from the top
The second television receiver 1 is the base unit.
And 8 other TV sets 2₁₁, 2
₁₂, 2₁₃, 2_{twenty one}, 2_{twenty three}, 2₃₁, 2₃₂, 2₃₃Became a child machine
ing. In addition, in the embodiment of FIG.
Of the revision receivers, the center (the third from the left, top
The television receiver 1 located at the third position) is the parent
2 of the other 24 units₁₁, 2₁₂, 2 ₁₃，
Two₁₄, 2₁₅, 2_{twenty one}, 2_{twenty two}, 2_{twenty three}, 2_{twenty four}, 2_{twenty five}, 2₃₁, 2
₃₂, 2₃₄, 2₃₅, 2 ₄₁, 2₄₂, 2₄₃, 2₄₄, 2₄₅，
Two₅₁, 2₅₂, 2₅₃, 2₅₄, 2₅₅Is a child machine.

Therefore, in the embodiment shown in FIG.
Is arranged at the center of the television receiver that constitutes the scalable TV system, but the position of the master unit 1 is not limited to the center of the television receiver that constitutes the scalable TV system, and 1 can be arranged in any position such as the upper left and the lower right.

In the scalable TV system, no matter which position the master unit 1 is located at, the television receiver located at the center of the master unit 1 is regarded as the master unit, and each unit will be described later. It is possible to perform processing.

Here, in the following, for simplification of description, the scalable TV system is assumed to be composed of 3 × 3 television receivers as shown in FIG. 1 is arranged in the center of a television receiver which constitutes a scalable TV system.

Note that the suffix ij of the slave unit 2 _ij constituting the scalable TV system is that the slave unit 2 _ij is the i-th column, the j-th row (the i-th column from the top, the j-th column from the left) in the scalable TV system. ) Indicates that it is arranged.

In the following, the slave unit 2 _ij will be appropriately referred to as the slave unit 2 unless it is necessary to distinguish it.

Next, FIG. 2 is a perspective view showing a configuration example of a television receiver which is the master unit 1.

The main unit 1 is a television receiver having a display screen size of, for example, 14 inches (inch) or 15 inches, and a CRT (Cathod Ray Tube) for displaying an image in the central portion on the front surface thereof. 11 are provided, and speaker units 12L and 12R for outputting sound are provided at the left end and the right end of the front surface, respectively.

The image in the television broadcast signal received by the antenna (not shown) is displayed on the CRT 11, and the L (Left) channel and the R (Right) channel of the sound accompanying the image are the speaker unit. 12
It is output from L and 12R, respectively.

The master unit 1 is provided with a remote commander (hereinafter referred to as a remote controller) 15 for emitting an infrared ray IR (Infrared Ray).
By operating, you can change the receiving channel and volume,
Various other commands can be given to the master device 1.

The remote controller 15 is not limited to the one for performing infrared communication, and may be, for example, BlueTooth.
(Trademark) and other devices that perform wireless communication can be adopted.

The remote controller 15 can control not only the master unit 1 but also the slave unit 2.

Next, FIG. 3 is a six-sided view showing a structural example of the master unit 1 of FIG.

FIG. 3A shows the front of the base unit 1, and FIG. 3B shows the base unit 1.
3C is a bottom surface of the base unit 1, FIG. 3D is a left side surface of the base unit 1, FIG. 3E is a right side surface of the base unit 1, and FIG. 3F is a base unit 1.
The back of each is shown.

The upper surface (FIG. 3B) and the bottom surface (FIG. 3) of the base unit 1
C), the left side surface (FIG. 3D), and the right side surface (FIG. 3E) are provided with a fixing mechanism. As will be described later, similar fixing mechanisms are provided on the upper surface, the bottom surface, the left side surface, and the right side surface of the television receiver that is the slave unit 2, and the upper surface side, the bottom surface side, and the left side surface of the parent device 1 are provided. Side or right side,
When the child device 2 or another parent device is arranged, the fixing mechanism provided on the top surface, bottom surface, left side surface, or right side surface of the parent device 1 and the opposite surface of the child device 2 or another parent device are provided. The fixed mechanism is fitted, for example, so that the base unit 1, the handset 2 and other base units are
It is fixed so that it does not come off easily. As a result, the position shift of the television receiver that constitutes the scalable TV system is prevented.

The fixing mechanism may be a mechanical mechanism, or may be a magnet or the like.

On the rear surface of the base unit 1, as shown in FIG. 3F,
A terminal panel 21, an antenna terminal 22, an input terminal 23, and an output terminal 24 are provided.

The terminal panel 21 includes a master unit 1 and eight slave units 2 ₁₁ , which constitute the scalable TV system of FIG. 1A.
Eight IEEE (Institute of Else) for electrically connecting with each of 2 ₁₂ , 2 ₁₃ , 2 ₂₁ , 2 ₂₃ , 2 ₃₁ , 2 ₃₂ , and 2 _33.
electrical and Electronics Engineers) 1394 terminal 2
1 ₁₁ , 21 ₁₂ , 21 ₁₃ , 21 ₂₁ , 21 ₂₃ , 21 ₃₁ , 21
₃₂ and 21 ₃₃ are provided.

Here, in the embodiment of FIG. 3F, the base unit 1
However, in order to grasp the position of the child device 2 _ij in the scalable TV system of FIG. 1A, in the terminal panel 21, when the user views the scalable TV system from the rear side, the scalable TV system of FIG. a position corresponding to the position of the slave unit 2 _ij in, IEEE1394 terminal 21 _ij is provided which is connected to the handset 2 _ij.

Therefore, the scalable TV system of FIG.
In Mu, cordless handset 2₁₁Is IEEE1394 terminal 21₁₁The slave
Two₁₂Is IEEE1394 terminal 21₁₂The cordless handset 2₁₃Is the IEEE1394 terminal
21 ₁₃The cordless handset 2_{twenty one}Is IEEE1394 terminal 21_{twenty one}The cordless handset 2_{twenty three}
Is IEEE1394 terminal 21_{twenty three}The cordless handset 2₃₁Is IEEE1394 terminal 21
₃₁The cordless handset 2₃₂Is IEEE1394 terminal 21₃₂The cordless handset 2₃₃IE
EE1394 terminal 21₃₃To connect to base unit 1 via
Ask the user to connect as you would.

Note that the scalable TV system of FIG. 1A
At_ijWhich IEEE1394 end of the terminal panel 21
Whether to connect with the child is not particularly limited. However
And child machine_ijThe IEEE1394 terminal 21_ijOther than IEEE1394 terminal
When connecting with _ijBut the scaler in Figure 1A
Located in column i, row j of the Bull TV system
It is necessary to set that it is in the master unit 1 (to the user
Need to be set).

In the embodiment shown in FIG. 3F, the terminal panel is
8 IEEE1394 terminals 21 ₁₁Through 21₃₃Set up
Ke, base unit 1 and 8 handset units 2₁₁Through 2₃₃Each and
I tried to connect them in parallel, but the main unit 1 and 8 children
Machine 2₁₁Through 2₃₃And can also be serially connected
is there. That is, cordless handset 2_ijIs another cordless handset 2_{i'j '}Via
It is possible to connect to the base unit 1. However, in this case
Also a child machine_ijIs the first of the scalable TV systems of FIG. 1A.
If it is arranged in the i-th column and the j-th row,
Must be set to. Therefore, the terminal panel 21
The number of IEEE 1394 terminals is not limited to eight.
Yes.

Further, the electrical connection between the television receivers constituting the scalable TV system is based on the IEEE standard.
It is not limited to 1394, but other things such as LAN
(IEEE802) or the like can be adopted. In addition, electrical connection between the television receivers included in the scalable TV system can be performed wirelessly instead of by wire.

A cable connected to an antenna (not shown) is connected to the antenna terminal 22, so that the television broadcast signal received by the antenna is input to the base unit 1. For example, a VTR (Video Ta
Image data and audio data output from pe recoder) are input. From the output terminal 24, for example, image data and audio data as a television broadcast signal received by the base unit 1 are output.

Next, FIG. 4 is a perspective view showing a configuration example of a television receiver which is the slave unit 2.

The slave unit 2 is a television receiver having the same display screen size as that of the master unit 1 shown in FIG. 2, and a CRT (Cathod Ray Tube) 31 for displaying an image is provided in the central portion of the front face thereof. Further, speaker units 32L and 32R for outputting sound are provided at the left end and the right end of the front surface, respectively. It should be noted that it is possible to adopt different display screen sizes for the master unit 1 and the slave unit 2.

The image in the television broadcast signal received by the antenna (not shown) is displayed on the CRT 31, and the L (Left) channel and the R (Right) channel of the audio accompanying the image are the speaker unit. 32
It is output from L and 32R, respectively.

As with the base unit 1, the handset unit 2 also has an infrared IR.
A remote control 35 for emitting the is attached, and the user can operate the remote control 35 to change the reception channel, volume, and various other commands to the handset 2.

The remote controller 35 can control not only the slave unit 2 but also the master unit 1.

In order to configure the scalable TV system of FIG. 1A, the user needs to purchase one master unit 1 and eight slave units 2 _{11 to} 2 _{33. In} this case,
A remote controller 15 is attached to the base unit 1, and eight handset units 2 _{11 to} 2 are attached.
_{Since the} remote controller 35 is attached to each of the ₃₃ , the user has nine remote controllers, which makes the management complicated.

Therefore, the remote controller 35 of the slave unit 2 is
As an option, it can be sold separately.
Also, the remote controller 15 of the master unit 1 can be sold separately as an option of the master unit 1.

As described above, the remote controllers 15 and 35 can control both the master unit 1 and the slave unit 2. Therefore, only one of the remote controllers 15 and 35 is owned. It is possible to control all of the parent device 1 and the child device 2 even if they are not installed.

Next, FIG. 5 is a six-sided view showing a structural example of the slave unit 2 of FIG.

FIG. 5A shows the front of the child device 2, and FIG. 5B shows the child device 2.
5C is a bottom surface of the child device 2, FIG. 5D is a left side surface of the child device 2, FIG. 5E is a right side surface of the child device 2, and FIG.
The back of each is shown.

The upper surface (FIG. 5B) and the bottom surface (FIG. 5) of the child device 2
C), the left side surface (FIG. 5D), and the right side surface (FIG. 5E) are provided with fixing mechanisms, and the parent device is provided on the upper surface side, the bottom surface side, the left surface side, or the right surface side of the child device 2. 1 and other slaves are arranged, the fixing mechanism provided on the top, bottom, left side, or right side of the slave 2 and the opposing faces of the master 1 and other slaves. The fixing mechanism is fitted, and the slave unit 2 and other slave units or the master unit 1 are fixed so as not to be easily separated.

On the rear surface of the child device 2, as shown in FIG. 5F,
A terminal panel 41, an antenna terminal 42, an input terminal 43, and an output terminal 44 are provided.

The terminal panel 41 is provided with _one IEEE1394 terminal 41 ₁ for electrically connecting the master unit 1 and the slave unit 2. When the handset 2 is the handset 2 ₁₁ arranged in the upper left of the scalable TV system of FIG. 1A, for example, the IEEE1394 terminal 41 ₁ of the terminal panel 41 is
It is connected to the IEEE1394 terminal 21 ₁₁ of the terminal panel 21 in FIG. 3F via an IEEE1394 cable (not shown).

The number of IEEE1394 terminals provided on the terminal panel 41 is not limited to one.

A cable connected to an antenna (not shown) is connected to the antenna terminal 42, whereby the television broadcast signal received by the antenna is input to the slave unit 2. Image data and audio data output from a VTR or the like are input to the input terminal 43. From the output terminal 44, for example, image data and audio data as a television broadcast signal received by the slave 2 are output.

One base unit 1 and 8 configured as described above
The scalable TV system of FIG. 1A is configured by arranging a total of nine television receivers 2 _{11 to} 2 ₃₃ , three television receivers in each of the horizontal and vertical directions.

The scalable TV system shown in FIG. 1A has a television receiver as a master or slave,
Other television receivers are directly arranged on the bottom, left, or right, and the scalable T shown in FIG.
It is also possible to arrange the television receiver in a rack dedicated to the V system. When the dedicated rack is used as described above, it is possible to more securely prevent the displacement of the television receiver that constitutes the scalable TV system.

Here, the television set as the master or the slave.
On the top, bottom, left, or right of the TV receiver.
A scalable TV system by directly arranging the
When configuring a stem, for example,
Tomo, handset 2₃₂Is not present, as shown in Figure 1A.
In addition, it cannot be arranged in the second row and second column. Against this
Then, the rack for exclusive use of the scalable TV system of FIG.
When used, cordless handset 2 ₃₂Base unit 1
Can be arranged in the second row and the second column.

Next, FIG. 7 is a plan view showing a configuration example of the remote controller 15.

The select button switch 51 can be operated (direction operation) in a total of eight directions including four directions of up, down, left and right, and four diagonal directions in the middle. Further, the select button switch 51 can be pressed (select operation) also in the direction perpendicular to the upper surface of the remote controller 15. The menu button switch 54 is used to set various settings (for example, the above-described slave device _ij is a scalable T) on the CRT 11 of the master device 1 (or the CRT 31 of the slave device 2).
It is operated when displaying a menu screen for inputting a command for instructing to perform a predetermined process) or setting that it is arranged in the i-th column and the j-th row of the V system.

Here, when the menu screen is displayed, a cursor for designating items on the menu screen is displayed on the CRT 11. By operating the select button switch 51 in the direction, the cursor moves in the direction corresponding to the operation. When the select button switch 51 is selected while the cursor is located on a predetermined item, the selection of that item is confirmed. In the present embodiment, as will be described later, there is an icon in the items displayed in the menu, and the select button switch 51 is also selected when the icon is clicked.

The exit button switch 55 is operated when returning from the menu screen to the original normal screen.

The volume button switch 52 is operated when moving the volume up or down. The channel up / down button switch 53 is operated to increase or decrease the number of the broadcast channel to be received.

The numeric button (numerical keypad) switch 58 displaying the numbers 0 to 9 is operated when inputting the displayed numbers. Enter button switch 57
When the operation of the numeral button switch 58 is completed, is operated to mean the end of the numeral input and is operated subsequently. In addition,
When switching channels, CRT 11 of base unit 1
(Or the CRT 31 of the handset 2) displays the new channel number, etc. for a predetermined time on the OSD (On Screen Displa
y) Displayed. The display button 56 is operated to switch on / off the OSD display such as the number of the currently selected channel and the current volume.

TV / video switch button switch 59
The input of the master unit 1 (or the slave unit 2) is shown in FIG.
0 built-in tuner 121 (or FIG.
141) or the input terminal 23 of FIG. 3 (or the input terminal 43 of FIG. 5). TV / DSS selector button switch 60
Is a TV mode in which the tuner 121 receives a terrestrial broadcast, or a DSS (Dig
It is operated when ital Satellite System (trademark of Hughes Communications) mode is selected. When the number button switch 58 is operated to switch the channel, the channel before switching is stored, and the jump button switch 61 is operated when returning to the original channel before switching.

The language button 62 is operated when selecting a predetermined language when broadcasting is performed in two or more languages. The guide button switch 63 is operated when the closed caption data is displayed when the image data displayed on the CRT 11 includes the closed caption data. The favorite button switch 64 is operated when selecting a preset user favorite channel.

The cable button switch 65, the television switch 66, and the DSS button switch 67 are button switches for switching the device category of the command code corresponding to the infrared rays emitted from the remote controller 15. That is, the remote controller 15 (similarly to the remote controller 35) can remotely control not only the television receivers as the master unit 1 and the slave unit 2 but also STBs and IRDs not shown, and cable button switches. Reference numeral 65 denotes an STB (Set Top) for receiving a signal transmitted via the CATV network.
It is operated when the Box) is controlled by the remote controller 15. After the operation of the cable button switch 65, the remote controller 15 emits infrared rays corresponding to the command code of the device category assigned to the STB. Similarly, the TV button switch 66 is operated when the master unit 1 (or the slave unit 1) is controlled by the remote controller 15. The DSS button switch 67 is an IRD (Integrated Receiver a) that receives a signal transmitted via a satellite.
nd Decorder) is controlled by the remote controller 15.

LED (Light Emitting Diode) 68, 6
9 and 70 light up when the cable button switch 65, the television button switch 66, or the DSS button switch 67 is turned on, respectively, which enables the remote controller 15 to control which category the device is currently. The user is informed whether or not there is. The LED 68,
69 and 70 are cable button switches 65,
When the TV button switch 66 or the DSS button switch 67 is turned off, the light is turned off.

Cable power button switch 71, TV power button switch 72, DSS power button switch 7
3 is STB, base unit 1 (or handset 2), or IR
It is operated when the power of D is turned on / off.

The muting button switch 74 is operated when setting or canceling the muting state of the master unit 1 (or the slave unit 2). The sleep button switch 75 is operated when setting or canceling a sleep mode in which the power is automatically turned off when a predetermined time comes or when a predetermined time elapses.

When the remote controller 15 is operated, the light emitting section 76 emits infrared rays corresponding to the operation.

Next, FIG. 8 is a plan view showing a configuration example of the remote controller 35 of the slave unit 2.

Since the remote controller 35 is composed of select button switches 81 to light emitting portions 106 having the same configurations as the select button switches 51 to light emitting portion 76 in the remote controller 15 of FIG. 7, the description thereof will be omitted.

Next, FIG. 9 is a plan view showing another configuration example of the remote controller 15 of the parent device 1.

In the embodiment of FIG. 9, instead of the select button switch 51 which can be operated in eight directions in FIG. 7,
Up / down / left / right four-way direction button switches 111, 11
2, 113, 114 and a button switch 110 for performing a selection operation are provided. Further, in the embodiment of FIG. 9, the cable button switch 65, the television button switch 66, and the DSS button switch 67 are internally illuminated, and the LEDs 68 to 70 in FIG. 7 are omitted. However, LEDs (not shown) are arranged on the back side of the button switches 65 to 67, and when the button switches 65 to 67 are operated, corresponding to the operation,
The LEDs arranged on the back side are turned on or off respectively.

The other button switches are basically the same as those shown in FIG. 7, although their positions are different.

The remote controller 35 of the slave unit 2 can also be constructed in the same manner as in FIG.

Further, the remote controller 15 may be provided with a gyro for detecting its movement. In this case, the remote controller 15 detects the moving direction and the moving amount of the remote controller 15 by the built-in gyro and moves the cursor displayed on the menu screen in accordance with the moving direction and the moving amount. Is possible. As described above, when the gyro is built in the remote controller 15, in the embodiment shown in FIG. 7, it is not necessary to configure the select button switch 51 so that it can be moved in eight directions. In the above form, it is not necessary to provide the direction button switches 111 to 114. Similarly, the remote controller 35 can also have a gyro built therein.

Next, FIG. 10 shows an example of the electrical configuration of the base unit 1.

A television broadcast signal received by an antenna (not shown) is supplied to the tuner 121, and the CPU 12
Under the control of 9, the wave is detected and demodulated. The output of the tuner 121 is supplied to a QPSK (Quadrature Phase Shift Keying) demodulation circuit 122, and under the control of the CPU 129, the QP
SK demodulation is performed. The output of the QPSK demodulation circuit 122 is supplied to the error correction circuit 123, the error is detected and corrected under the control of the CPU 129, and the demultiplexer 124 is supplied.
Is supplied to.

The demultiplexer 124 has a CPU 129.
Under the control of the above, the output of the error correction circuit 123 is descrambled if necessary, and the T
S (Transport Stream) packet is extracted. Then, the demultiplexer 124 uses the image data (video data).
The TS packets of MPEG (Moving Picture Experts)
Group) The video data is supplied to the video decoder 125, and TS packets of audio data (audio data) are MP
It is supplied to the EG audio decoder 126. Further, the demultiplexer 124 sends the TS packet included in the output of the error correction circuit 123 to the CPU 129 as necessary.
Supply to. Further, the demultiplexer 124 has a CP
The image data or audio data (including those in the form of TS packets) supplied from U129 is received and supplied to the MPEG video decoder 125 or the MPEG audio decoder 126.

The MPEG video decoder 125 MPEG-decodes the TS packet of the image data supplied from the demultiplexer 124 and supplies it to the frame memory 127. The MPEG audio decoder 126 MPEG-decodes the TS packet of the audio data supplied from the demultiplexer 124. The audio data of the L channel and the R channel obtained by the decoding by the MPEG audio decoder 126 is the speaker unit 1.
It is supplied to 2L and 12R, respectively.

The frame memory 127 temporarily stores the image data output from the MPEG video decoder 125,
It is supplied to an NTSC (National Television System Committee) encoder 128. NTSC encoder 128
Converts the image data supplied from the frame memory 127 into NTSC image data and supplies it to the CRT 11 for display.

The CPU 129 is an EEPROM (Electrica).
lly Erasable Programable Read Only Memory) 130
Alternatively, various processes are executed in accordance with a program stored in a ROM (Read Only Memory) 131. As a result, for example, the tuner 121 and the QPSK demodulation circuit 12
2, error correction circuit 123, demultiplexer 124,
It controls the IEEE1394 interface 133, the modem 136, the signal processing unit 137, and the unit driving unit 138.
The CPU 129 also supplies the data supplied from the demultiplexer 124 to the IEEE1394 interface 133, and supplies the data supplied from the IEEE1394 interface 133 to the demultiplexer 124 and the signal processing unit 137. Further, the CPU 129 is the front panel 1
34 and the IR receiving unit 135 execute processing corresponding to the command. The CPU 129 is the modem 1
By controlling 36, the server (not shown) is accessed through the telephone line to obtain the upgraded program and necessary data.

The EEPROM 130 stores data and programs to be retained even after the power is turned off. ROM1
Reference numeral 31 stores, for example, an IPL (Initial Program Loader) program. The data and programs stored in the EEPROM 130 can be upgraded by overwriting them.

The RAM 132 temporarily stores data and programs necessary for the operation of the CPU 129.

The IEEE1394 interface 133 has a terminal panel 21 (the IEEE1394 terminals 21 _{11 to} 21 ₃₃ (FIG. 3)).
, And functions as an interface for performing communication in conformity with the IEEE1394 standard. This allows
The IEEE1394 interface 133 transmits the data supplied from the CPU 129 to the outside in conformity with the IEEE1394 standard, while receiving the data transmitted from the outside in conformity to the IEEE1394 standard and supplies the data to the CPU129.

The front panel 134 is shown in FIGS.
Although not shown in the figure, it is provided in a part of the front surface of the master unit 1. The front panel 134 is the remote controller 1
5 (FIGS. 7 and 9) has a part of the button switch, and when the button switch of the front panel 134 is operated, an operation signal corresponding to the operation is
It is supplied to the CPU 129. In this case, the CPU 129
Performs processing corresponding to the operation signal from the front panel 134.

The IR receiver 135 receives (receives) infrared rays transmitted from the remote controller 15 in response to the operation of the remote controller 15. Further, the IR receiving unit 135 photoelectrically converts the received infrared ray and supplies a signal obtained as a result to the CPU 129. In this case, the CPU 129
Performs processing corresponding to the signal from the IR receiving unit 135, that is, processing corresponding to operation of the remote controller 15.

The modem 136 controls the communication via the telephone line, whereby the data supplied from the CPU 129 is transmitted via the telephone line and the data transmitted via the telephone line is received. And CPU12
Supply to 9.

The signal processing unit 137 is a DSP (Digital Sig).
nal Processor) 137A, EEPROM 137B, RA
The image data stored in the frame memory 127 is subjected to various digital signal processing under the control of the CPU 129.

That is, the DSP 137A is the EEPROM 1
According to the program stored in 37B, various signal processings are performed as needed using the data stored in the EEPROM 137B. EEPROM137B is
The DSP 137A stores programs and necessary data for performing various processes. RAM137C is DS
The P137A temporarily stores data and programs necessary for performing various processes.

The data and programs stored in the EEPROM 137B can be upgraded by overwriting them.

Here, as the signal processing performed by the signal processing unit 137, for example, decoding of closed caption data, superposition of closed caption data on image data stored in the frame memory 127, and storage in the frame memory 127 are performed. Image data expansion, noise removal, etc. In addition, the signal processing unit 137 is
Generate OSD data for SD display, and use frame memory 1
It is superimposed on the image data stored in 27.

Under the control of the CPU 129, the unit driving section 138 controls the speaker units 12L and 12R.
To drive the main axis of the directivity of the speakers forming the speaker units 12L and 12R to a predetermined direction.

In the base unit 1 configured as described above, the image and sound as the television broadcast program are output (the image is displayed and the sound is output) as follows.

That is, the transport stream as a television broadcast signal received by the antenna is supplied to the demultiplexer 124 via the tuner 121, the QPSK demodulation circuit 122, and the error correction circuit 123. The demultiplexer 124 extracts TS packets of a predetermined program from the transport stream, and extracts TS packets of image data from the MPEG video decoder 12
5 while supplying TS packets of voice data,
It is supplied to the MPEG audio decoder 126.

In the MPEG video data coder 125,
The TS packet from the demultiplexer 124 is MPEG
Is decoded. Then, the resulting image data is transmitted from the MPEG video decoder 125 via the frame memory 127 and the NTSC encoder 128,
It is supplied to the CRT 11 and displayed.

On the other hand, the MPEG audio decoder 126
Then, the TS packet from the demultiplexer 124 is M
PEG decoded. Then, the resulting audio data is supplied from the MPEG audio decoder 126 to the speaker units 12L and 12R and output.

Next, FIG. 11 shows an example of the electrical configuration of the slave unit 2.

The slave unit 2 is composed of a tuner 141 to a unit driving section 158, which are respectively constructed in the same manner as the tuner 121 to the unit driving section 138 of FIG.

The master unit 1 and the slave unit 2 are shown in FIGS. 3F and 5F.
As shown in FIG.
And 42, the master unit 1 and the slave unit 2 as the television receivers configuring the scalable TV system of FIG.
It is possible to connect an antenna (cable from) to each. However, the master unit 1 and the slave unit 2
When connecting an antenna to each, wiring may become complicated. Therefore, in the scalable TV system, an antenna is connected to any one of the television receivers included in the scalable TV system, and a television broadcast signal received by the television receiver is transmitted, for example, to IEEE1394. It is possible to distribute it to other television receivers by communication.

Next, in the present embodiment, the IEEE1394 terminal 21 _ij (FIG. 3) of the terminal panel 21 of the parent device 1 and the IEEE1394 terminal 41 ₁ (FIG. 5) of the terminal panel 41 of the child device 2 _ij are IEE
By connecting with the E1394 cable, the base unit 1
And the child device 2 are electrically connected to each other, whereby the parent device 1
IEEE1394 communication (communication conforming to the IEEE1394 standard) is performed between the mobile device and the child device 2, and various data and the like are exchanged.

Therefore, referring to FIGS. 12 to 21, the IE
EE1394 communication will be described.

IEEE 1394 is one of the serial bus standards. IEEE 1394 communication uses data isochronous.
Since it can perform (nous) transfer, it is suitable for transferring data such as images and sounds that need to be reproduced in real time.

That is, between devices having an IEEE 1394 interface (IEEE 1394 devices), data is transmitted by using a transmission band (which is called a band although it is time) of 125 μs (microseconds) at the maximum and 100 μs at the maximum. Isochronous transfer can be performed. Further, within the range of the above-mentioned transmission band, isochronous transfer can be performed on a plurality of channels.

FIG. 12 shows the layer structure of the IEEE1394 communication protocol.

The IEEE1394 protocol has a three-layer hierarchical structure of a transaction layer (Transaction Layer), a link layer (Link Layer), and a physical layer (Physical Layer).
Each layer communicates with each other, and each layer communicates with Serial Bus Management.
Furthermore, the transaction layer and the link layer also communicate with higher-level applications. Send and receive messages used for this communication are Request, Instruction (Display)
There are four types: (Indication), response (Response), and confirmation (Confirmation), and the arrow in FIG. 12 indicates this communication.

The communication with ".req" at the end of the arrow name indicates a request, and ".ind" indicates an instruction. Also, ".res
"p" represents the response and ".conf" the confirmation, eg T
R_CONT.req is a request communication sent from the serial bus management to the transaction layer.

The transaction layer provides an asynchronous transmission service for performing data communication with other IEEE 1394 equipment (equipment having an IEEE 1394 interface) according to a request from an application, and ISO / IE
Request / response protocol required by C13213
(Request Response Protocol) is realized. That is, IEEE1
As a data transfer method based on the 394 standard, there is an asynchronous transmission in addition to the above-mentioned isochronous transmission, and the transaction layer performs the processing of the asynchronous transmission.
Data transmitted by asynchronous transmission is transmitted between IEEE1394 devices by three types of transactions, which are the unit of processing required by the transaction layer protocol: read transaction, write transaction, and lock transaction. Transmitted in.

The link layer is an acknowledge.
Performs data transmission services using the, address processing, data error confirmation, data framing, and other processing. One packet transmission performed by the link layer is called a sub-action, and there are two types of sub-actions: an asynchronous subaction and an isochronous subaction.

Asynchronous subaction is performed by designating a physical ID (Physical Identification) for identifying a node (unit accessible in IEEE1394) and an address within the node, and the node receiving the data is
Acknowledge is returned. However, in the asynchronous broadcast subaction that sends data to all the nodes in the IEEE1394 serial bus, the node that receives the data does not send back an acknowledge.

On the other hand, in the isochronous sub-action, data is transmitted in a fixed cycle (125 μ as described above).
In s), the channel number is designated and transmitted. In addition,
Acknowledges are not returned for isochronous subactions.

The physical layer converts logical symbols used in the link layer into electric signals. Further, the physical layer performs processing for a request for arbitration (arbitration when a node performing IEEE1394 communication competes) from the link layer,
Performs IEEE1394 serial bus reconfiguration due to bus reset, and automatically assigns physical IDs.

In serious bus management, realization of basic bus control functions and CSR (Control & Status Regis
ter Architecture) is provided. The serial bus management is performed by the node controller (Node Controllor) and the isochronous resource manager (Isochronous Resource Manager).
ger) and a bus manager function. The node controller controls the node status, physical ID, etc., as well as the transaction layer, link layer,
And control the physical layer. The isochronous resource manager provides the usage status of resources used for isochronous communication. In order to perform isochronous communication, at least one of the devices connected to the IEEE1394 serial bus has an isochronous resource manager function. IEEE 1394 equipment is required. The bus manager is the most sophisticated of all the functions
The purpose is to optimize the use of the serial bus. The existence of the isochronous resource manager and the bus manager is arbitrary.

Both IEEE 1394 devices can be connected to a node branch or a node daisy chain.
When an EE1394 device is newly connected, bus reset is performed, and tree identification, determination of root node, physical ID, isochronous resource manager, cycle master, bus manager, etc. are performed.

Here, in tree identification, IEEE1394 is used.
The parent-child relationship between nodes as devices is determined. Also,
The root node is IEEE1394 by arbitration.
Specify the node that has acquired the right to use the serial bus. The physical ID is determined by transferring a packet called a self-ID packet to each node. The self-ID packet contains information such as the data transfer rate of the node and whether the node can become an isochronous resource manager.

As described above, the isochronous resource manager is a node that provides the utilization status of resources used for isochronous communication, and has a bandwidth register (BANDWIDTH_AVAILABLE register) and a channel number register (CHANNELS_AVAILABLE register) described later. Furthermore, the isochronous resource manager also has a register that indicates the physical ID of the node that serves as the bus manager. In addition, IEEE13 connected by IEEE1394 serial bus
94 If the bus manager does not exist in the node as a device, the isochronous resource manager
Functions as a simple bus manager.

The cycle master transmits a cycle start packet on the IEEE1394 serial bus every 125 μs which is the period of isochronous transmission. For this reason,
The cycle master has a cycle time register (CYCLE_TIME register) for counting its cycle (125 μs). The root node becomes the cycle master, but if the root node does not have the function as the cycle master, the bus manager changes the root node.

The bus manager manages electric power on the IEEE1394 serial bus and changes the root node described above.

When the isochronous resource manager is determined as described above after the bus reset, the IE
Enables data transmission via the EE1394 serial bus.

In isochronous transmission, which is one of the IEEE 1394 data transmission methods, a transmission band and a transmission channel are secured, and then a packet (isochronous packet) in which data is arranged is transmitted.

That is, in isochronous transmission, the cycle master broadcasts a cycle start packet on the IEEE1394 serial bus at a cycle of 125 μs.
When the cycle start packet is broadcast, the isochronous packet can be transmitted.

In order to perform isochronous transmission, it is necessary to rewrite the bandwidth register for securing the transmission band and the channel number register for securing the channel provided by the isochronous resource manager to declare the securing of resources for isochronous transmission. is there.

Here, the bandwidth register and the channel number register have a 64-bit address space defined by ISO / IEC13213 and have a CSR (Control & St.
Atus Register).

The bandwidth register is a 32-bit register, the upper 19 bits are reserved areas, and the lower 13 bits are reserved areas.
Bits currently available for transmission (bw_rema
ining).

That is, the initial value of the bandwidth register is 000000
00000000000001001100110011B (B represents that the previous value is a binary number) (= 4915). This is for the following reason. That is, in IEEE1394, 15
The time required to transmit 32 bits at 72.864 Mbps (bit per second) is defined as 1, and the above-mentioned 125 μs
Is 00000000000000000001100000000000B (= 614
It corresponds to 4). However, IEEE1394 specifies that the transmission band that can be used for isochronous transmission is 80% of 125 μs which is one cycle. Therefore, the maximum transmission band that can be used in isochronous transmission is 100 μs, and 100 μs is equal to 00000000000000000001001100110011B (=
4915).

Note that the remaining 25 μs transmission band, which is the maximum transmission band of 100 μs used in isochronous transmission, is used in asynchronous transmission from 125 μs. Asynchronous transmission is used, for example, when reading a stored value in a bandwidth register or a channel number register.

In order to start the isochronous transmission,
It is necessary to secure a transmission band for that purpose. That is, for example, when isochronous transmission is performed using a transmission band of 10 μs in 125 μs which is one cycle,
It is necessary to secure a transmission band of 0 μs. This transmission band is secured by rewriting the value of the bandwidth register. That is, as described above, when securing the transmission band of 10 μs, the value corresponding to 10 μs is 492.
Is subtracted from the value of the bandwidth register, and the subtracted value is set in the bandwidth register. Therefore, for example, when the value of the bandwidth register is 4915 (when isochronous transmission is not performed at all), 10
When the transmission band of μs is secured, the value of the bandwidth register is changed from 4915 to 10 μs from 4915.
4423 (= 000000000000)
00000001000101000111B).

If the value obtained by subtracting the transmission band to be secured (used) from the value of the bandwidth register is smaller than 0, the transmission band cannot be secured, and accordingly, the bandwidth register cannot be secured. The value cannot be rewritten, nor can isochronous transmission be performed.

In order to perform isochronous transmission, it is necessary to secure the transmission band as described above and also secure the transmission channel. This transmission channel is secured by rewriting the channel number register.

The channel number register is a 64-bit register, and each bit corresponds to each channel. That is, when the value of the n-th bit (n-th bit from the least significant bit) is 1, it indicates that the (n-1) th channel is unused, and when it is 0, it indicates the n-th bit.
-1 Indicates that channel 1 is in use. Therefore,
If no channel is used, the channel number register is 11111111111111111111111111111111.
11111111111111111111111111111111B. For example, when the first channel is secured, the channel number register is 11111111111111111111111111111111111111.
It is rewritten to 11111111111111111111111101B.

Since the channel number register is 64 bits as described above, it is possible to secure 64 channels of the 0th to 63rd channels at the maximum in isochronous transmission, but the 63rd channel is isochronous. Used when broadcasting a packet.

As described above, since the isochronous transmission is performed after securing the transmission band and the transmission channel, the data transmission with the guaranteed transmission rate can be performed. It is particularly suitable for data transmission that needs to be reproduced in real time.

Next, the IEEE1394 communication is performed as described above.
It complies with the CSR architecture having a 64-bit address space defined by ISO / IEC13213.

FIG. 13 shows the address space of the CSR architecture.

The upper 16 bits of CSR are a node ID indicating each node, and the remaining 48 bits are used for designating an address space given to each node. The upper 16 bits are further divided into 10 bits of bus ID and 6 bits of physical ID (node ID in a narrow sense). A value in which all the bits are 1 is used for a special purpose, and 1023 buses and 63 nodes can be designated.

25 specified by lower 48 bits of CSR
The space defined by the upper 20 bits of the 6 terabyte address space is the initial register space (Initial Register Space) and private space (Private Space) used for the 2048-byte CSR-specific registers and IEEE1394-specific registers. , And an initial memory space (Initial Memory Space), and the space defined by the lower 28 bits is a configuration ROM (Configuration R) if the space defined by the upper 20 bits is an initial register space.
OM), an initial unit space used for a node-specific application, a plug control register (PCRs), and the like.

Here, FIG. 14 shows the offset address, name, and function of the main CSR.

In FIG. 14, the "offset" column is
Initial register space starts FFFFF0000000h (h
Indicates that the previous value is a hexadecimal number). As described above, the bandwidth register having the offset 220h indicates the bandwidth that can be allocated to the isochronous communication, and only the value of the node operating as the isochronous resource manager is valid. That is, although the CSR of FIG. 13 is included in each node, only the isochronous resource manager of the bandwidth register is valid. Therefore, the bandwidth registers are essentially only owned by the isochronous resource manager.

The channel number registers of offsets 224h to 228h have the bits 0 to 6 as described above.
Corresponds to each of the 3rd channel numbers, and the bit is 0
, It means that the channel is already assigned. Only the channel number register of the node operating as the isochronous resource manager is valid.

Returning to FIG. 13, a configuration ROM based on the general ROM format is arranged at addresses 400h to 800h in the initial register space.

FIG. 15 shows the general ROM format.

A node, which is a unit of access on the IEEE1394, can have a plurality of units that operate independently while commonly using an address space in the node.
The unit directories can indicate the version and location of software for this unit. The positions of the bus info block and the root directory are fixed, but the positions of other blocks are designated by offset addresses.

FIG. 16 shows details of the bus info block, the root directory, and the unit directory.

An ID number indicating the manufacturer of the device is stored in Company ID in the bus info block. Chip ID
In the field, the unique ID unique to the device and unique to the other device in the world is stored. In addition, according to the IEC1833 standard, IEC
The unit spec ID of the unit directory of the device that satisfies 1883 is written with 00h in the first octet, A0h in the second octet, and 2Dh in the third octet. Furthermore, 01h is the first octet of the unit switch version (unit sw version), and LSB (Lea
1 is written in the st Significant Bit).

The node has a PCR (Plug Control Register) defined by IEC1883 at addresses 900h to 9FFh in the initial register space of FIG. This materializes the concept of a plug in order to logically form a signal path similar to an analog interface.

Here, FIG. 17 shows the structure of the PCR.

PCR is an oPCR (output Plu
g Control Resister) and iPCR (input
Plug Control Register). In addition, PCR is a register oMPR (output Master Plug Register) and iMPR (input
Master Plug Register). IEEE1394 equipment is oMP
Although it is not possible to have multiple R and iMPRs, it is possible to have multiple oPCRs and iPCRs that correspond to individual plugs, depending on the capabilities of the IEEE1394 device. Shown in FIG.
The PCR has 31 oPCR # 0 to # 30 and iPCR # 0 to # 30, respectively. The flow of isochronous data is controlled by manipulating the registers corresponding to these plugs.

FIG. 18 shows oMPR, oPCR, iMPR, and iPCR.
Shows the configuration of.

FIG. 18A shows the structure of oMPR, and FIG. 18B shows oPCR.
18C shows the structure of iMPR, and FIG. 18D shows the structure of iPCR.

The 2-bit data rate capability on the MSB side of oMPR and iMPR is as follows:
A code indicating the maximum transmission rate of isochronous data that can be transmitted or received by the device is stored. o MPR broadcast channel base
e) defines the channel number used for broadcast output.

A 5-bit number of output plugs on the LSB side of oMPR stores the number of output plugs of the device, that is, a value indicating the number of oPCRs. The 5-bit number of input plugs on the LSB side of iMPR
The number of input plugs of the device, that is, a value indicating the number of iPCRs is stored. The non-persistent extension field and persistent extension field are areas defined for future extension.

Online MSBs for oPCR and iPCR (on-lin
e) shows the usage status of the plug. That is, if the value is 1, the plug is ON-LINE, and if it is 0, it is OFF-LINE.
Is shown. oPCR and iPCR broadcast connection counter
The value of indicates whether there is a broadcast connection (1) or not (0). Point-to-point connection counter (poi with 6-bit width for oPCR and iPCR)
The value that the nt-to-point connection counter has is the point-to-point connection (poi) that the plug has.
nt-to-point connection).

The value of the channel number having a 6-bit width of oPCR and iPCR indicates the number of the isochronous channel to which the plug is connected. Data rate with 2 bits width of oPCR (data rat
The value of e) indicates the actual transmission speed of the isochronous data packet output from the plug. The code stored in the overhead ID (overhead ID) having a 4-bit width of the oPCR indicates the over-bandwidth of the isochronous communication. oPCR 10-bit width payload (pay
The value of (load) represents the maximum value of the data contained in the isochronous packet that the plug can handle.

Next, the IE for performing the above IEEE1394 communication
For EE1394 equipment, the AV / C command set is specified as a command for its control. Therefore, also in the present embodiment, the master unit 1 is configured to control the slave unit 2 by using this AV / C command set. However,
In controlling the slave unit 2 from the master unit 1, it is possible to use a unique command system other than the AV / C command set.

Here, the AV / C command set will be briefly described.

FIG. 19 shows the data structure of an AV / C command set packet transmitted in the asynchronous transfer mode.

The AV / C command set is an AV (Audio Visua
l) A command set for controlling equipment.In a control system using the AV / C command set, AV / C
Command frames and response frames are FCP (Fu
communication is performed using the nction control protocol). In order not to burden the bus and AV equipment, the response to the command is supposed to be made within 100 ms.

As shown in FIG. 19, the data of the asynchronous packet is 32 bits in the horizontal direction (= 1 quadlet).
It is composed of. The upper part of the figure shows the packet header (p
acketheader), the lower part of the figure is a data block
(data block) is shown. destination_ID indicates the destination.

CTS represents the ID of the command set, and A
In the V / C command set, CTS = “0000”. ctyp
The e / response indicates the function classification of the command when the packet is a command, and the processing result of the command when the packet is a response. The commands are roughly divided into (1)
Command to control function from outside (CONTROL), (2) Command to inquire status from outside (STATUS), (3) Command to inquire whether control command is supported from outside (GENERAL INQUIRY (whether opcode is supported) and SPECIFIC INQUIRY (whether opcode and operands are supported), and (4) four types of commands (NOTIFY) requesting to notify the state change to the outside are defined.

The response is returned according to the type of command. The response to the CONTROL command is NOT I
There are NPLEMENTED (not implemented), ACCEPTED, REJECTED, and INTERIM. The response to the STATUS command is NOT INPL
EMENTED, REJECTED, IN TRANSITION, and
There is STABLE. GENERAL INQUIRY and SPECIFI
The response to the C INQUIRY command is IMPLEMENT
ED (implemented), and NOT IMPLEMENTED. The response to the NOTIFY command is NOT IMPL
There are EMENTED, REJECTED, INTERIM, and CHANGED.

The subunit type is provided to specify the function inside the device. For example, tape recorder / playe
r, tuner, etc. are assigned. In order to determine when there are multiple subunits of the same type, use su as the identification number.
Address by bunit id (located after subunit type). opcode represents a command, and operan
d represents the parameter of the command. Additional op
erands is a field in which additional operands are placed. Padding is a field in which dummy data is arranged so that the packet length has a predetermined number of bits. data
In CRC (Cyclic Redundancy Check), a CRC used for error check during data transmission is arranged.

Next, FIG. 20 shows a concrete example of the AV / C command.

FIG. 20A shows a concrete example of ctype / response. The upper part of the figure represents a command, and the lower part of the figure represents a response.
"0000" is CONTROL, "0001" is STATUS,
"0010" is SPECIFIC INQUIRY, "0011" is
GENERAL INQUIRY is assigned to NOTIFY and “0100”. "0101 to 0111" are reserved and reserved for future specifications. Also, "1000" is NO
T INPLEMENTED, “1001” for ACCEPTED, “101
REJECTED for “0”, IN TRANSITION for “1011”,
"1100" is assigned IMPLEMENTED / STABLE, "1101" is assigned CHNGED, and "1111" is assigned INTERIM. "1110" is reserved and reserved for future specifications.

FIG. 20B shows a specific example of subunit type. Video Monitor, "0001" for "00000"
Disk recorder / Player for 1 ", Ta for" 00100 "
perecorder / Player, Tuner for “00101”, “00”
"111" is a Video Camera and "11100" is a Vendor
unique, "11110" is a Subunit type extended t
o next byte is assigned. Note that "1111
A unit is assigned to 1 ", but this is used when it is sent to the device itself, for example, turning on / off the power.

FIG. 20C shows a specific example of opcode. There is an opcode table for each subunit type. Here, when the subunit type is Tape recorder / Player
shows the opcode. Also, operand is defined for each opcode. Here, "00h" is VENDOR-DEPENDE
NT, SEACH MODE for "50h", TIMECO for "51h"
DE, ATN for "52h", OPEN MIC for "60h",
"61h" is READ MIC, "62h" is WRITE MIC,
LOAD MEDIUM for “C1h”, RECORD for “C2h”,
PLAY is assigned to “C3h” and WIND is assigned to “C4h”.

FIG. 21 shows a concrete example of the AV / C command and response.

For example, when a playback instruction is given to a playback device as a target (consumer) (controlled side), the controller (controlling side) sends a command as shown in FIG. 21A to the target. Since this command uses the AV / C command set, CTS = “0000”. ctype is a command (CO
Since it uses NTROL, it is "0000" (Fig. 2
0A). The subunit type is "00100" because it is Tape recorder / Player (Fig. 20B).
The id indicates the case of ID # 0 and is 000.
The opcode is “C3h” meaning reproduction (FIG. 20C). The operand is "75h" which means FORWARD. Then, when reproduced, the target returns a response as shown in FIG. 21B to the controller. Here, accepted, which means acceptance, is arranged in the response, and the response is “1001” (see FIG. 20A). Other than the response, the other parts are the same as those in FIG.

In the scalable TV system, various controls are performed between the master unit 1 and the slave unit 2 by using the AV / C command set as described above. However, in the present embodiment, among the controls performed between the master unit 1 and the slave unit 2,
New commands and responses are defined for those that cannot be handled with the default commands and responses.
Various controls are performed using the new command and response.

Regarding the above-mentioned IEEE1394 communication and AV / C command set, refer to "WHITE SERISE No.181 IEEE13
94 Multimedia Interface ", published by Trikeps Co., Ltd., for details.

Next, in the signal processing unit 137 of the parent device 1 shown in FIG. 10, (the signal processing unit 157 of the child device 2 shown in FIG. 11 is described.
Similarly, as described above, the DSP 137A executes a program to perform various kinds of digital signal processing. As one of them, the image data is converted from the first image data to the second image data. There is image conversion processing for conversion.

Here, for example, if the first image data is low-resolution image data and the second image data is high-resolution image data, the image conversion process is a resolution improvement process for improving the resolution. Can be said. In addition, for example, the first image data is set to low S / N (Siginal / Noi).
If the second image data is high S / N image data in addition to (se) image data, the image conversion process can be referred to as noise removal process for removing noise. Further, for example, if the first image data is image data of a predetermined size and the second image data is image data in which the size of the first image data is increased or decreased, the image conversion processing is It can be said that the image is resized (enlarged or reduced).

Therefore, according to the image conversion processing, depending on how the first and second image data are defined,
Various processing can be realized.

FIG. 22 shows an example of the functional configuration of the signal processing unit 137 that performs the image conversion processing as described above. The functional configuration of FIG. 22 is the DSP of the signal processing unit 137.
137A is implemented by executing the program stored in the EEPROM 137B.

In the signal processor 137 (FIG. 10), the image data stored in the frame memory 127 or the CPU
The image data supplied from 129 is supplied to the tap extracting units 161 and 162 as the first image data.

The tap extracting portion 161 sequentially sets the pixels forming the second image data as the target pixel, and further defines the pixels (the first image data used for predicting the pixel value of the target pixel ( Some of the pixel values of) are extracted as prediction taps.

Specifically, the tap extracting unit 161 includes a plurality of pixels (for example, the pixel of interest) which are spatially or temporally close to the pixel of the first image data corresponding to the pixel of interest. The corresponding pixel of the first image data,
Pixels that are spatially adjacent to it) are extracted as prediction taps.

The tap extracting unit 162 uses, as class taps, some of the pixels forming the first image data used for classifying the pixel of interest into one of several classes. Extract.

Note that, here, for simplification of description, it is assumed that the prediction tap and the class tap have the same tap structure. However, the prediction tap and the class tap can have different tap structures.

The prediction taps obtained by the tap extraction unit 161 are supplied to the prediction unit 165, and the class taps obtained by the tap extraction unit 162 are supplied to the class classification unit 163.

The class classification unit 163 has a tap extraction unit 16
The pixel of interest is classified into classes based on the class tap from 2, and the class code corresponding to the class obtained as a result is supplied to the coefficient memory 164.

Here, as a method for classifying,
For example, ADRC (Adaptive Dynamic Range Coding) or the like can be adopted.

In the method using ADRC, the pixel values of the pixels forming the class tap are ADRC processed, and the class of the pixel of interest is determined according to the ADRC code obtained as a result.

In K-bit ADRC, for example,
The maximum value MAX and the minimum value MIN of the pixel values forming the class tap are detected, DR = MAX-MIN is set as the local dynamic range of the set, and the class tap is formed based on this dynamic range DR. The pixel value is requantized to K bits. That is, the minimum value MIN is subtracted from the pixel value of each pixel forming the class tap, and the subtracted value is DR / 2 ^K
Is divided (quantized) by. Then, the bit string obtained by arranging the pixel values of the K-bit pixels forming the class tap obtained in the above manner in a predetermined order is output as an ADRC code. Therefore, the class tap is, for example, 1
When bit ADRC processing is performed, the pixel value of each pixel that constitutes the class tap is divided by the average value of the maximum value MAX and the minimum value MIN after the minimum value MIN is subtracted (rounded down to the nearest whole number). As a result, the pixel value of each pixel is set to 1 bit (binarized). Then, a bit string in which the 1-bit pixel values are arranged in a predetermined order is output as an ADRC code.

It should be noted that the class classifying unit 163 is, for example,
It is also possible to output the pattern of the level distribution of the pixel values of the pixels forming the class tap as it is as the class code. However, in this case, if the class tap is composed of pixel values of N pixels and K bits are assigned to the pixel value of each pixel, the number of class codes output by the class classification unit 163. Is (2
^N ) ^K, which is a huge number exponentially proportional to the number of bits K of the pixel value of the pixel.

Therefore, in the class classification unit 163,
It is preferable to perform class classification by compressing the amount of information of class taps by the above-mentioned ADRC process, vector compression, or the like.

The coefficient memory 164 stores the tap coefficient for each class supplied from the coefficient generation section 166, and further, of the stored tap coefficients, the class classification section 1
The tap coefficient (the tap coefficient of the class represented by the class code supplied from the class classification unit 163) stored in the address corresponding to the class code supplied from 63 is
It is supplied to the prediction unit 165.

Here, the tap coefficient corresponds to a coefficient to be multiplied with input data at a so-called tap in the digital filter.

The prediction unit 165 acquires the prediction tap output from the tap extraction unit 161 and the tap coefficient output from the coefficient memory 164, and uses the prediction tap and the tap coefficient to predict the true value of the pixel of interest. A predetermined prediction calculation for obtaining a value is performed. As a result, the prediction unit 165 obtains and outputs the pixel value of the pixel of interest (predicted value thereof), that is, the pixel value of the pixel forming the second image data.

The coefficient generation unit 166 uses the coefficient seed memory 167.
Parameter seed data stored in the parameter memory 1
Based on the parameters stored in 68, tap coefficients for each class are generated, supplied to the coefficient memory 164, and stored in a form of being overwritten.

The coefficient seed memory 167 stores coefficient seed data for each class obtained by learning coefficient seed data described later. Here, the coefficient seed data is, as it were, seed data for generating the tap coefficient.

The parameter memory 168 stores the parameters supplied from the CPU 129 (FIG. 10) in an overwritten form by the user operating the remote controller 15 or the like.

Next, the image conversion processing by the signal processing unit 137 of FIG. 22 will be described with reference to the flowchart of FIG.

In the tap extracting section 161, each pixel constituting the second image data corresponding to the first image data input thereto is sequentially set as a target pixel. Then, in step S1, the parameter memory 168 stores the CPU 1
It is determined whether or not the parameter is supplied from 29, and when it is determined that the parameter is supplied, the process proceeds to step S2, the parameter memory 168 stores the supplied parameter in a form of overwriting, and the process proceeds to step S3.

In step S1, the CPU 12
When it is determined from 9 that the parameter is not supplied, step S2 is skipped and the process proceeds to step S3.

Therefore, in the parameter memory 168, C
When the parameters are supplied from the PU 129, that is, when the user operates the remote controller 15 to input the parameters, or when the parameters are set in the CPU 129, the stored contents are input or set. Updated with the parameters

At step S3, the coefficient generator 166
The coefficient seed data for each class is read from the coefficient seed memory 167, the parameters are read from the parameter memory 168, and the tap coefficient for each class is obtained based on the coefficient seed data and the parameters. Then, in step S4, the coefficient generation unit 166 supplies the tap coefficient for each class to the coefficient memory 164, stores the tap coefficient in the overwritten form, and then advances to step S5.

In step S5, the tap extracting units 161 and 162 respectively extract, from the first image data supplied thereto, the prediction tap and the class tap for the pixel of interest. Then, the prediction taps are supplied from the tap extraction unit 161 to the prediction unit 165, and the class taps are supplied from the tap extraction unit 162 to the class classification unit 163.

The class classification unit 163 has a tap extraction unit 16
From 2, the class tap for the pixel of interest is received, and in step S6, the pixel of interest is classified into classes based on the class tap. Furthermore, the class classification unit 163
Outputs the class code representing the class of the pixel of interest obtained as a result of the class classification to the coefficient memory 164, and proceeds to step S7.

At step S7, the coefficient memory 164 stores
The tap coefficient stored in the address corresponding to the class code supplied from the class classification unit 163 is read and output. Further, in step S7, the prediction unit 165
Acquires the tap coefficient output from the coefficient memory 164,
Go to step S8.

In step S8, the prediction unit 165 calculates the prediction tap output from the tap extraction unit 161 and the coefficient memory 1
A predetermined prediction calculation is performed using the tap coefficient acquired from 64. As a result, the prediction unit 165 obtains the pixel value of the pixel of interest, writes it in the frame memory 127 (FIG. 10), and proceeds to step S9.

At step S9, the tap extraction unit 161
However, it is determined whether there is still the second image data that is not the pixel of interest. In step S9,
When it is determined that there is the second image data that is not the target pixel, one of the pixels of the second image data that is not yet the target pixel is newly set as the target pixel, and the process returns to step S1. After that, similar processing is repeated.

If it is determined in step S9 that there is no second image data that has not been set as the pixel of interest, the process ends.

In FIG. 23, the processing of steps S3 and S4 can be performed when a new parameter is overwritten in the parameter memory 168, and can be skipped in other cases.

Next, the prediction calculation in the prediction unit 165, the tap coefficient generation in the coefficient generation unit 166, and the learning of the coefficient seed data stored in the coefficient seed memory 167 will be described.

Now, while setting the high quality image data (high quality image data) as the second image data, the high quality image data is filtered by an LPF (Low Pass Filter) and the image quality (resolution) is changed. By using the lowered low image quality image data (low image quality image data) as the first image data, a prediction tap is extracted from the low image quality image data, and the pixel value of the high quality pixel is calculated using the prediction tap and the tap coefficient. , Considering (predicting) by a predetermined prediction calculation.

If, for example, a linear first-order prediction calculation is adopted as the predetermined prediction calculation, the pixel value y of the high-quality pixel is obtained by the following linear first-order equation.

[0220]

[Equation 1] ... (1)

However, in the equation (1), x _n is the pixel of the n-th low image quality image data (hereinafter, appropriately referred to as the low image quality pixel) which constitutes the prediction tap for the high image quality pixel y.
, And w _n represents the n-th tap coefficient that is multiplied by (the pixel value of) the n-th low image quality pixel. In equation (1), the prediction tap is N low-quality pixels x ₁ ,
x ₂ , ..., X _N.

Here, the pixel value y of the high image quality pixel may be obtained by a higher-order equation of quadratic or higher order instead of the linear linear equation shown in the equation (1).

On the other hand, in the embodiment of FIG. 22, in the coefficient generator 166, the tap coefficient w _n is the coefficient seed memory 1
The coefficient seed data stored in 67 and the parameter memory 1
The tap coefficient w _n is generated in the coefficient generation unit 166, for example, by the following equation using the coefficient seed data and the parameter.

[0224]

[Equation 2] ... (2)

However, in the equation (2), β _{m, n} represents the m-th coefficient seed data used to obtain the n-th tap coefficient w _n , and z represents a parameter. In equation (2), the tap coefficient w _n is M coefficient seed data β
_{n, 1} , β _{n, 2} , ..., β _{n, M} are used.

The equation for obtaining the tap coefficient w _n from the coefficient seed data β _{m, n} and the parameter z is not limited to the equation (2).

Now, the value z ^m-1 determined by the parameter z in the equation (2) is defined by the following equation by introducing a new variable t _m .

[0228]

[Equation 3] ... (3)

By substituting equation (3) into equation (2), the following equation is obtained.

[0230]

[Equation 4] ... (4)

According to the equation (4), the tap coefficient w _n is obtained by the linear linear equation of the coefficient seed data β _{n, m} and the variable t _m .

[0232] Incidentally, the true value of the pixel values of the high-quality pixel of the k samples with expressed as y _k, when the predicted value of the true value y _k obtained by equation (1) expressed as y _k ', The prediction error e _k is expressed by the following equation.

[0233]

[Equation 5] ... (5)

Since the predicted value y _k 'of equation (5) is obtained according to equation (1), y _k ' of equation (5) is now _obtained .
Is replaced according to the equation (1), the following equation is obtained.

[0235]

[Equation 6] ... (6)

However, in the equation (6), x _{n, k} is the k-th
It represents the nth low quality pixel that constitutes the prediction tap for the high quality pixel of the sample.

By substituting the equation (4) for w _n in the equation (6), the following equation is obtained.

[0238]

[Equation 7] ... (7)

The coefficient seed data β _{n, m in} which the prediction error e _k of the equation (7) is 0 is the most suitable for predicting high quality pixels. It is generally difficult to obtain the coefficient seed data β _{n, m} .

[0240] Therefore, as a norm representing that the coefficient seed data beta _{n, m} is optimal, for example, when adopting the method of least squares, best coefficient seed data beta _{n, m} is the following formula It can be obtained by minimizing the total sum E of the squared errors represented.

[0241]

[Equation 8] ... (8)

However, in the equation (8), K is the high quality pixel y _k and the low quality pixels x _{1, k} , x _{2, k} , ... Which form the prediction tap for the high quality pixel y _k. , X _{N, k} as a set (the number of samples for learning).

The minimum value (minimum value) of the sum E of the squared errors of the equation (8) is set to 0 when the sum E is partially differentiated with the coefficient seed data β _{n, m} as shown in the equation (9). given by β _{n, m} .

[0244]

[Equation 9] ... (9)

By substituting equation (6) into equation (9), the following equation is obtained.

[0246]

[Equation 10] ... (10)

Now, X _{i, p, j, q} and Y _{i, p} are defined as shown in equations (11) and (12).

[0248]

[Equation 11] ... (11)

[Equation 12] ... (12)

In this case, the equation (10) is calculated as X _{i, p, j, q} and Y
It can be expressed by the normal equation shown in Expression (13) using _{i and p} .

[0250]

[Equation 13] ... (13)

The normal equation of equation (13) can be solved for the coefficient seed data β _{n, m} by using, for example, the sweeping method (Gauss-Jordan elimination method).

In the signal processor 137 of FIG. 22, a large number of high quality pixels y ₁ , y ₂ , ..., Y _K are used as teacher data for learning and at the same time, each high quality pixel y _k Low-quality pixels x _{1, k} , x _{2, k} that constitute the prediction tap,
..., x _{N, k} is the student data to be the students of learning,
The coefficient seed data β _{n, m} obtained by performing the learning to solve the equation (13) is stored in the coefficient seed memory 167, and the coefficient seed data β in the coefficient generation unit 166.
_{From n, m} and the parameter z stored in the parameter memory 168, the tap coefficient w _n is generated according to the equation (2). Then, the prediction unit 165 uses Equation (1) using the tap coefficient w _n and the low image quality pixel (pixel of the first image data) x _n that forms the prediction tap for the pixel of interest as the high image quality pixel. Is calculated,
Pixel value of pixel of interest as high-quality pixel (predicted value close to)
Is required.

Next, FIG. 24 shows an example of the structure of a learning device for carrying out learning for obtaining the coefficient seed data β _{n, m} by making and solving the normal equation of the equation (13).

Learning image data used for learning the coefficient seed data β _{n, m} is input to the learning device. Here, as the learning image data, for example,
High-quality image data with high resolution can be used.

In the learning device, the learning image data is
It is supplied to the teacher data generation unit 171 and the student data generation unit 173.

The teacher data generation unit 171 generates teacher data from the learning image data supplied thereto and supplies it to the teacher data storage unit 172. That is, here, the teacher data generation unit 171 supplies the high-quality image data as the learning image data to the teacher data storage unit 172 as the teacher data as it is.

The teacher data storage section 172 stores the high quality image data as the teacher data supplied from the teacher data generation section 171.

The student data generation unit 173 generates student data from the learning image data, and the student data storage unit 174
Supply to. That is, the student data generation unit 173 generates low-quality image data by filtering the high-quality image data as the learning image data to reduce the resolution, and generates the low-quality image data as the student data. Is supplied to the student data storage unit 174.

Here, in the student data generator 173, in addition to the learning image data, the parameter memory 168 shown in FIG.
The parameter generation unit 180 supplies some values in the range of the parameter z supplied to the. That is, assuming that the value that the parameter z can take is a real number in the range of 0 to Z, the student data generation unit 1
For example, z = 0, 1, 2, ..., Z is supplied to the 73 from the parameter generation unit 180.

The student data generation unit 173 filters the high-quality image data as the learning image data by the LPF of the cutoff frequency corresponding to the parameter z supplied thereto, so that the low-quality image as the student data is obtained. Generate data.

Therefore, in this case, the student data generator 17
In FIG. 25, as shown in FIG. 25, Z + 1 types of low-quality image data as student data having different resolutions are generated for high-quality image data as learning image data.

Here, for example, as the value of the parameter z increases, the high quality image data is filtered by using the LPF having a higher cutoff frequency to generate the low quality image data as the student data. .
Therefore, here. The lower the image quality image data corresponding to the parameter z having a larger value, the higher the resolution.

Further, in the present embodiment, in order to simplify the explanation, in the student data generation unit 173, the resolution in both the horizontal direction and the vertical direction of the high quality image data is reduced by the amount corresponding to the parameter z. The generated low-quality image data is generated.

Returning to FIG. 24, the student data storage unit 174.
Stores the student data supplied from the student data generation unit 173.

The tap extracting unit 175 sequentially sets the pixels constituting the high-quality image data as the teacher data stored in the teacher data storage unit 172 as the target teacher pixel, and the student data storage unit 174 for the target teacher pixel. By extracting a predetermined one of the low-quality pixels forming the low-quality image data as the student data stored in, the prediction tap having the same tap structure as that configured by the tap extracting unit 161 in FIG. It is configured and supplied to the adding section 178.

The tap extracting unit 176 extracts a predetermined one of the low image quality pixels forming the low image quality image data as the student data stored in the student data storage unit 174 for the teacher pixel of interest. A class tap having the same tap structure as that of the tap extracting unit 162 of 22 is configured and supplied to the class classifying unit 177.

The tap extracting units 175 and 176 are provided with
The parameter z generated by the parameter generation unit 180 is supplied to the tap extraction units 175 and 176.
Is student data generated corresponding to the parameter z supplied from the parameter generation unit 180 (here, low-quality image data as student data generated using an LPF having a cutoff frequency corresponding to the parameter z). , Are used to configure the prediction tap and the class tap, respectively.

The class classification unit 177 has a tap extraction unit 17
22. Based on the class taps output by 6, the same class classification as the class classifying unit 163 of FIG.
Output to.

The adding unit 178 is the teacher data storage unit 1
The target teacher pixel is read from 72, the target teacher pixel, the student data forming the prediction tap configured for the target teacher pixel supplied from the tap extracting unit 175, and the parameter z when the student data is generated are targeted. Is added for each class code supplied from the class classification unit 177.

That is, the adding section 178 includes the teacher data y _k stored in the teacher data storage section 172, the prediction taps x _{i, k} (x _{j, k} ) output by the tap extracting section 175, and the class classifying section. In addition to the class code output by 177, the parameter z at the time of generating the student data used to configure the prediction tap is also supplied from the parameter generation unit 180.

Then, the adding section 178 uses the prediction tap (student data) x _{i, k} (x _{j, k} ) and the parameter z for each class corresponding to the class code supplied from the class classifying section 177, In the matrix on the left side of Expression (13),
The multiplication (x _i) of the student data and the parameter z for obtaining the component X _{i, p, j, q} defined by the equation (11)
_{, k} t _p x _{j, k} t _q ) and an operation corresponding to the summation (Σ). Note that t _p in Expression (11) is calculated from the parameter z according to Expression (3). T in equation (11)
_The same applies to _q .

Furthermore, the adding unit 178 also outputs prediction taps (student data) x _{i, k} , teacher data y _k , and parameter z for each class corresponding to the class code supplied from the class classification unit 177. Using equation (13)
Of the student data x _{i, k} , the teacher data y _k , and the parameter z for obtaining the component Y _{i, p} defined by the equation (12) in the vector on the right side of (x _{i, k} t
_p y _k ) and the calculation corresponding to the summation (Σ).
Note that t _p in Expression (12) is calculated from the parameter z according to Expression (3).

That is, the adding section 178 calculates the formula (1) obtained for the teacher data set as the focused teacher pixel last time.
The component X of the matrix on the left side in 3)
_{i, p, j, q} and the component Y _{i, p} of the vector on the right side are
About the teacher data which is stored in the built-in memory (not shown) and is newly set as the target teacher pixel for the matrix component X _{i, p, j, q} or the vector component Y _{i, p} , Its teacher data y _k , student data x _{i, k} (x _{j, k} ), and the corresponding component x _{i, k} t _p x _{j, k} t _q or x
Add _{i, k} t _p y _k (component X of equation (11)
_{i, p, j, q} or the addition represented by the summation in the component Y _{i, p} of equation (12)).

Then, the add-in portion 178 has 0, 1, ...
···············································································································································································································. When a normal equation is created, the normal equation is supplied to the coefficient seed calculation unit 179.

The coefficient seed calculation unit 179 has an addition unit 178.
The coefficient seed data β _{m, n} for each class is obtained and output by solving the normal equation for each class supplied from.

The parameter generating section 180 has, for example, z = 0, 1, 2, ... As described above as some values in a range in which the parameter z supplied to the parameter memory 168 of FIG. 22 can take. , Z, and supplies them to the student data generator 173. In addition, the parameter generation unit 180
Supplies the generated parameter z to the tap extracting units 175 and 176 and the adding unit 178.

Next, the processing (learning processing) of the learning device in FIG. 24 will be described with reference to the flowchart in FIG.

First, in step S21, the teacher data generation unit 171 and the student data generation unit 173 respectively generate and output teacher data and student data from the learning image data. That is, the teacher data generation unit 171
Outputs the learning image data as it is as teacher data. Further, the student data generation unit 171 is supplied with the parameter z having Z + 1 values generated by the parameter generation unit 180, and the student data generation unit 171 sends the learning image data to the Z + 1 number of parameters from the parameter generation unit 180. The teacher data (learning image data) of each frame is filtered by the LPF of the cutoff frequency corresponding to the parameter z of the value (0, 1, ..., Z).
For, the student data of Z + 1 frame is generated and output.

The teacher data output by the teacher data generation unit 171 is supplied to and stored in the teacher data storage unit 172, and the student data output by the student data generation unit 173 is
It is supplied to and stored in the student data storage unit 174.

After that, the procedure goes to step S22, and the parameter generator 180 sets the parameter z as an initial value,
For example, set to 0, and tap extraction units 175 and 17
6, as well as supplying to the adding part 178, and step S2
Go to 3. In step S23, the tap extraction unit 175
Of the teacher data stored in the teacher data storage unit 172, the teacher data that has not been set as the target teacher pixel is set as the target teacher pixel. Further, in step S23, the tap extracting unit 175, for the teacher pixel of interest, stores the student data for the parameter z output from the parameter generating unit 180, which is stored in the student data storage unit 174 (the teacher data of the teacher pixel of interest. The corresponding learning image data,
A prediction tap is constructed from the student data generated by filtering with the LPF of the cutoff frequency corresponding to the parameter z, and is supplied to the adding unit 178. A class tap is formed from the student data for the parameter z output from the parameter generation unit 180, which is stored in the student data storage unit 174, and is supplied to the class classification unit 177.

Then, in step S24, the class classification unit 177 classifies the teacher pixel of interest based on the class tap of the teacher pixel of interest, and adds the class code corresponding to the class obtained as a result to the addition unit. 1
Output to 78 and proceed to step S25.

In step S25, the adding portion 178 is added.
Reads out the teacher pixel of interest from the teacher data storage unit 172, uses the teacher pixel of interest, the prediction tap supplied from the tap extraction unit 175, and the parameter z output by the parameter generation unit 180, and uses the matrix on the left side of Expression (13). Component x _{i, K} t _p x _{j, K} t _q and the component x _{i, K} t _p y _K of the vector on the right side are calculated. Further, the adding unit 178 selects the class classification unit 17 from the already obtained matrix components and vector components.
For the components corresponding to the class codes from 7, the matrix component x _{i, K} t _p x _{j, K} t _q and the vector component x _{i, K} t obtained from the pixel of interest, the prediction tap, and the parameter z. summing the _p y _K, the process proceeds to step S26.

At step S26, the parameter generator 1
80 determines whether the parameter z output by itself is equal to Z, which is the maximum value of the possible values.
When it is determined in step S26 that the parameter z output by the parameter generation unit 180 is not equal to the maximum value Z (less than the maximum value Z), the process proceeds to step S27 and the parameter generation unit 180 sets the parameter z to the parameter z. 1 is added, and the added value is used as a new parameter z, and tap extraction units 175 and 176 and addition unit 178 are added.
Output to. Then, the process returns to step S23, and the same processing is repeated thereafter.

If it is determined in step S26 that the parameter z is equal to the maximum value Z, then step S26
In step 28, the tap extracting unit 175 determines whether or not the teacher data storage unit 172 still stores teacher data that is not a target teacher pixel. Step S28
In, in the case where it is determined that the teacher data that is not a target teacher pixel is still stored in the teacher data storage unit 172, the tap extracting unit 175 newly adds the teacher data that is not a target teacher pixel to the target teacher pixel. As a pixel, the process returns to step S22, and the same processing is repeated thereafter.

Further, in step S 28, the teacher data not designated as the target teacher pixel is stored in the teacher data storage unit 17.
If it is determined that it is not stored in 2, the adding section 1
78 represents the matrix on the left side and the vector on the right side in equation (13) for each class obtained by the processing so far,
The coefficient seed calculation unit 179 supplies the coefficient seed calculation unit 179, and the process proceeds to step S29.

In step S29, the coefficient seed calculation unit 179
Is solved by solving a normal equation for each class configured by the matrix on the left side and the vector on the right side in the equation (13) for each class supplied from the adding unit 178,
Calculate and output coefficient seed data β _{m, n} for each class.
The process ends.

It should be noted that there may be a class in which the number of normal equations required to obtain the coefficient seed data cannot be obtained due to insufficient number of learning image data. For the class, the coefficient seed calculation unit 17
9 outputs the default coefficient seed data, for example.

By the way, in the learning device of FIG.
As shown in, the high-quality image data as the learning image data is used as the teacher data, and the high-quality image data is the low-quality image data whose resolution is deteriorated corresponding to the parameter z as the student data. From the tap coefficient w _n represented by the coefficient seed data β _{m, n} and the variable t _m corresponding to the parameter z by the equation (4), and the student data x _n ,
Although learning is performed so as to directly obtain the coefficient seed data β _{m, n} that minimizes the sum of squared errors of the predicted value y of the teacher data predicted by the linear primary expression of the equation (1), the coefficient seed data β
Other learning of _{m and n} can be performed, for example, as shown in FIG.

That is, in the embodiment of FIG. 27, as in the case of the embodiment of FIG. 25, high-quality image data as learning image data is used as teacher data, and
The high-quality image data by filtering by LPF cutoff frequency corresponding to the parameter z, the low-quality image data to reduce its horizontal resolution and vertical resolution as student data, first of all, the tap coefficient w _n , And the tap coefficient w _n that minimizes the sum of squared errors of the predicted value y of the teacher data predicted by the linear first-order prediction formula of Formula (1) using the student data x _n is the value of the parameter z (here , Z = 0, 1, ..., Z). Further, in the embodiment of FIG. 27, the obtained tap coefficient w _n is used as teacher data and the parameter z is used as student data, and the coefficient seed data β _{m, n} and the parameter that is student data are calculated by the equation (4). Learning for obtaining coefficient seed data β _{m, n} that minimizes the sum of squared errors of the predicted values of the tap coefficient w _n as the teacher data predicted from the variable t _m corresponding to z is performed.

Specifically, it is represented by the above equation (8),
The tap coefficient w _n that minimizes (minimizes) the sum E of the squared errors of the predicted value y of the teacher data predicted by the linear first-order prediction formula (1) is a partial differentiation of the sum E with the tap coefficient w _n. The calculated value is set to 0, and therefore the following expression must be satisfied.

[0291]

[Equation 14] ... (14)

Therefore, the tap coefficient w _n is calculated by using the above equation (6).
By partial differentiation with, the following equation is obtained.

[0293]

[Equation 15] ... (15)

From equations (14) and (15), the following equation is obtained.

[0295]

[Equation 16] ... (16)

By substituting equation (6) into e _k of equation (16), equation (16) can be expressed by the normal equation shown in equation (17).

[0297]

[Equation 17] ... (17)

The normal equation of the equation (17) is obtained by using the sweeping method (Gauss-Jordan elimination method) or the like, as in the case of the normal equation of the equation (13).
It can be solved for the tap coefficient w _n .

By solving the normal equation (17), the optimum tap coefficient (here, the tap coefficient that minimizes the sum E of squared errors) w _n is determined for each class and the value of the parameter z (z = 0, 1, ..., Z).

On the other hand, in the present embodiment, the tap coefficient is obtained from the coefficient seed data β _{m, n} and the variable t _m corresponding to the parameter z by the equation (4). the tap coefficient obtained by), 'When is represented as is expressed by the following equation (18), the tap coefficient w _n which is determined by the optimum tap coefficients w _n and equation (4)' w _n error between The coefficient seed data β _{n, m} where e _n is 0 becomes the optimum one for obtaining the optimum tap coefficient w _n ,
It is generally difficult to obtain such coefficient seed data β _{n, m} for all tap coefficients w _n .

[0301]

[Equation 18] ... (18)

The equation (18) is given by the equation (4).
It can be transformed into the following equation.

[0303]

[Formula 19] ... (19)

Therefore, if the least squares method is adopted, for example, as the norm indicating that the coefficient seed data β _{n, m} is optimum, the optimum coefficient seed data β
_{n and m} can be obtained by minimizing the sum E of squared errors represented by the following equation.

[0305]

[Equation 20] ... (20)

The minimum value (minimum value) of the sum E of the squared errors in the equation (20) is set to 0 when the sum E is partially differentiated with the coefficient seed data β _{n, m} as shown in the equation (21). given by β _{n, m} .

[0307]

[Equation 21] ... (21)

By substituting the equation (19) into the equation (21), the following equation is obtained.

[0309]

[Equation 22] (22)

Now, X _{i, j,} and Y _i are given by equations (23) and (2
It is defined as shown in 4).

[0311]

[Equation 23] (23)

[Equation 24] ... (24)

In this case, the equation (22) can be expressed by the normal equation shown in the equation (25) using X _{i, j} and Y _i .

[0313]

[Equation 25] ... (25)

The normal equation of the equation (25) can also be solved for the coefficient seed data β _{n, m} by using, for example, the sweeping method (Gauss-Jordan elimination method).

Next, FIG. 28 shows an example of the structure of a learning device for carrying out learning for obtaining the coefficient seed data β _{n, m} by making and solving the normal equation of the equation (25). In the figure,
The parts corresponding to those in FIG. 24 are denoted by the same reference numerals, and the description thereof will be omitted below as appropriate.

The adding section 190 includes a class classification section 17
7 outputs the class code of the teacher pixel of interest,
The parameter z output by the parameter generation unit 180 is supplied. Then, the adding section 190
Reads out the target teacher pixel from the teacher data storage unit 172, and adds the target teacher pixel and the student data constituting the prediction tap configured for the target teacher pixel supplied from the tap extraction unit 175 as a target. Is performed for each class code supplied from the class classification unit 177 and for each value of the parameter z output by the parameter generation unit 180.

That is, in the adding section 190, the teacher data y _k stored in the teacher data storage section 172, the prediction tap x _{n, k} output from the tap extracting section 175, the class classifying section 1
The class code output by 77 and the parameter z output by the parameter generation unit 180 when the student data used to configure the prediction taps x _{n, k} are generated are supplied.

Then, the adding section 190 makes prediction taps (student data) x for each class corresponding to the class code supplied from the class classification section 177 and for each value of the parameter z output by the parameter generation section 180. _{Using n, k} , multiplication ( _{xn, kxn ', k} ) of the student data in the matrix on the left side of Expression (17) and calculation corresponding to the summation (Σ) are performed.

Furthermore, the adder unit 190 also predicts taps (student data) for each class corresponding to the class code supplied from the class classification unit 177 and for each value of the parameter z output by the parameter generation unit 180. )
with x _{n, k} and the teacher data y _k, the student data x _n in the vector of the right side of equation _{(17), k} and multiplication of teacher data _{y k (x n, k y} k) and, on the summation (sigma) Perform the corresponding calculation.

That is, the adding section 190 calculates the formula (1) obtained for the teacher data set as the attention teacher pixel last time.
7) component of the matrix on the left side (Σx _{n, k} x
_{n ', k} ) and the vector component on the right side (Σx _{n, k)}
y _k ) is stored in its built-in memory (not shown), and for the matrix component (Σx _{n, k} x _{n ', k} ) or vector component (Σx _{n, k} y _k ), , About the teacher data newly set as the attention teacher pixel,
The corresponding component x _{n, k + 1} x _{n ′, k + 1} calculated using the teacher data y _{k + 1} and the student data x _{n , k + 1}
Alternatively, x _{n, k + 1} y _{k + 1} is added (addition represented by the summation of Expression (17) is performed).

Then, the adding section 190 performs the above-mentioned addition by using all the teacher data stored in the teacher data storage section 172 as the teacher pixels of interest, and for each class, for each value of the parameter z, When the normal equation shown in Expression (17) is created, the normal equation is supplied to the tap coefficient calculation unit 191.

The tap coefficient calculation unit 191 uses the addition unit 1
Parameter z for each class supplied from 90
The optimum tap coefficient w _n for each value of the parameter z is obtained for each class by solving the normal equation for each value of and is supplied to the adding unit 192.

The add-in unit 192 adds for each class the parameter z (variable t _m corresponding to it) and the optimum tap coefficient w _n .

That is, the adding section 192 uses the parameter z
Using the variable t _i (t _j ) obtained by the equation (3) from the above, it corresponds to the parameter z for _{obtaining the} component X _{i, j} defined by the equation (23) in the matrix on the left side of the equation (25). Multiplication of variables t _i (t _j ) (t _i t _j )
And the calculation corresponding to the summation (Σ) is performed for each class.

Here, since the component X _{i, j} is determined only by the parameter z and is not related to the class, it is not actually necessary to calculate the component X _{i, j} for each class. You only have to do it once.

Further, the adder 192 uses the variable t _i obtained by the equation (3) from the parameter z and the optimum tap coefficient w _n, and the equation (24) in the vector on the right side of the equation (25) is used. Component Y _i defined by
The multiplication (t _i w _n ) of the variable t _i corresponding to the parameter z and the optimum tap coefficient w _n for obtaining _## EQU1 _## and the calculation corresponding to the summation (Σ) are performed for each class.

The adder 192 adds the component X _{i, j} represented by the equation (23) and the equation (2) for each class.
By obtaining the component Y _i represented by 4), the normal equation of Equation (25) is created for each class, and the normal equation is supplied to the coefficient seed calculation unit 193.

The coefficient seed calculation unit 193 adds the addition unit 192.
The coefficient seed data β _{m, n} for each class is obtained and output by solving the normal equation of Expression (25) for each class supplied from

The coefficient seed memory 167 in the signal processing unit 137 of FIG. 22 may store the coefficient seed data β _{m, n} for each class obtained as described above.

Here, in the signal processor 137 of FIG.
28, for example, without providing the coefficient seed memory 167.
Of each of the parameters z output by the tap coefficient calculation unit 191 of
Optimal tap coefficient w for each value_nStored in memory
Parameter z stored in the parameter memory 168.
Select the optimum tap coefficient stored in the memory according to
And set it in the coefficient memory 164.
It is possible. However, in this case, the parameter z can take
It requires a large amount of memory proportional to the number of values. This
In response to this, a coefficient seed memory 167 is provided, and coefficient seed data
Is stored in the coefficient seed memory 167.
The capacity does not depend on the number of possible values of the parameter z
Then, a small capacity memory is used as the coefficient seed memory 167.
Can be adopted. Furthermore, coefficient seed data β_{m, n}To
If stored, the coefficient seed data β_{m, n}When,
From the value of the parameter z, the tap coefficient w is calculated by the equation (2).
_nIs generated, depending on the value of the parameter z,
So to speak, continuous tap coefficient w _nCan be obtained. So
As a result, the prediction unit 165 of FIG.
Image quality of high-quality image data output as data
It is possible to adjust smoothly.

In the above case, the learning image data is directly used as the teacher data corresponding to the second image data, and the low-quality image data in which the resolution of the learning image data is deteriorated is Since the coefficient seed data is learned as the student data corresponding to the first image data, the coefficient seed data is converted from the first image data into the second image data whose resolution is improved. It is possible to obtain the image conversion processing as the resolution improving processing.

Therefore, the EE of the signal processing unit 137 of the master unit 1
The PROM 137A stores the coefficient seed data, realizes the functional configuration of FIG. 22, and FIG.
By storing a program for performing image conversion processing according to the flowchart of FIG.
Then, the horizontal resolution and the vertical resolution of the image data can be improved in accordance with the parameter z.

Here, depending on how the student data corresponding to the first image data and the image data to be the teacher data corresponding to the second image data are selected, various image conversion processes can be performed as the coefficient seed data. You can get what you do.

That is, for example, the high-quality image data is used as the teacher data, and the high-quality image data as the teacher data is subjected to learning by using the image data in which the noise of the level corresponding to the parameter z is superimposed as the student data. By performing the processing, as the coefficient seed data, the image conversion processing as the noise removal processing for converting the first image data into the second image data in which the noise included therein is removed (reduced) is performed. Obtainable.

Also, for example, a certain image data is used as teacher data, and the number of pixels of the image data as the teacher data is thinned out in correspondence with the parameter z as student data, or in correspondence with the parameter z. The image data of the size to be used as the student data, and the image data obtained by thinning out the pixels of the image data as the student data at the predetermined thinning rate is used as the teacher data, and the learning process is performed. It is possible to obtain the image conversion processing as the resizing processing for converting the one image data into the enlarged or reduced second image data.

Therefore, the EE of the signal processing unit 137 of the master unit 1
By storing the coefficient seed data for noise removal processing and the coefficient seed data for resizing processing in the PROM 137A, the signal processing unit 137 allows the signal processing unit 137 to perform noise removal and resizing (enlargement) of image data in accordance with the parameter z. Or reduction) can be performed.

In the above case, the tap coefficient w
_nAs shown in equation (2),_{1, n}z ⁰+ Β_{2, n}z¹+
... + β_{M, n}z^M-1, And by this equation (2),
Both horizontal and vertical resolution are parameters
Tap coefficient w for improving corresponding to z_nAsk for
However, the tap coefficient w_nAs the horizontal resolution
The vertical resolution is the independent parameter z_xAnd z_yCorresponding to
Independently seek something to improve
Is also possible.

That is, the tap coefficient w_nInstead of equation (2)
For example, the cubic expression β_{1, n}z_x ⁰z_y ⁰+ Β_{2, n}z_x ¹z_y ⁰+ Β
_{3, n}z_x ²z_y ⁰+ Β_{4, n}z_x ³z_y ⁰+ Β_{5, n}z_x ⁰z_y ¹+ Β_{6, n}z
_x ⁰z_y ²+ Β_{7, n}z_x ⁰z_y ³+ Β_{8, n}z_x ¹z_y ¹+ Β_{9, n}z_x ²z_y
¹+ Β_{10, n}z_x ¹z_y ²It is defined by
Variable t_mInstead of equation (3), t₁= Z_x ⁰z_y ⁰，
t₂= Z_x ¹z_y ⁰, T₃= Z_x ²z_y ⁰, T_Four= Z_x ³z_y ⁰, T_Five=
z_x ⁰z_y ¹, T₆= Z_x ⁰z_y ², T₇= Z_x ⁰z_y ³, T₈= Z_x ¹
z_y ¹, T₉= Z_x ²z_y ¹, T_Ten= Z_x ¹z_y ²Define in. This
Also, tap coefficient w_nFinally, in equation (4)
Can be represented and thus the learning device (FIGS. 24, 28)
Where the parameter z_xAnd z_yCorresponding to the teacher data
Image data with degraded horizontal resolution and vertical resolution.
Data is used as student data for learning, and coefficient seed
Data β_{m, n}To obtain the horizontal resolution and vertical solution
Image quality, independent parameter z_xAnd z_yCorresponding to
The tap coefficient w that improves independently_nCan ask
It

In addition, for example, by introducing a parameter z _t corresponding to the resolution in the time direction in addition to the parameters z _x and z _y corresponding to the horizontal resolution and the vertical resolution, respectively, the horizontal resolution, the vertical resolution, the temporal resolution, independent parameters z _x, z _y, corresponding to the z _t, it is possible to determine the tap coefficient w _n to improve independently.

Also in the resizing processing, as in the resolution improving processing, the horizontal and vertical directions are
Both other tap coefficients w _n to resize magnification corresponding to the parameter z (or reduction ratio), the horizontal and vertical directions, respectively enlargement rate corresponding to the parameter z _x and z _y, tap resized independently coefficient It is possible to find w _n .

[0341] Further, in the learning apparatus (Fig. 24, Fig. 28), along with deteriorating the horizontal resolution and vertical resolution of the teacher data corresponding to the parameter z _x, and adds noise to the teacher data corresponding to the parameter z _y Learning is performed using the image data as the student data to obtain the coefficient seed data β _{m, n} , thereby improving the horizontal resolution and the vertical resolution corresponding to the parameter z _x .
Corresponding to the parameter z _y can be calculated tap coefficients w _n to perform noise removal.

Next, the function of performing the image conversion processing as described above has not only the master unit 1 but also the slave unit 2.

Therefore, FIG. 29 shows an example of the functional configuration of the signal processing unit 157 of the child device 2 (FIG. 11) which performs the above-mentioned image conversion processing. Note that the functional configuration of FIG.
Similar to the case of the signal processing unit 137 of (1), the DSP 157A of the signal processing unit 157 is realized by executing the program stored in the EEPROM 157B.

In FIG. 29, the signal processor 15 of the slave unit 2
Since 7 is composed of the tap extracting unit 161 to the parameter memory 168 of the signal processing unit 137 (FIG. 22) of the parent device 1 and the tap extracting unit 201 to the parameter memory 208, respectively, the description thereof will be omitted. .

It is possible to store the same coefficient seed data in the signal processing unit 137 of the master unit 1 and the signal processing unit 157 of the slave unit 2, but in the present embodiment, at least the same coefficient seed data is stored. It is assumed that coefficient seed data, which is partially different, is stored.

That is, for example, the signal processing unit 137 of the base unit 1
Stores the coefficient seed data for resizing processing and the coefficient seed data for resolution improvement processing, and the signal processing unit 157 of the slave 2 stores the coefficient seed data for resizing processing and the noise removal processing. The coefficient seed data of is stored.

Alternatively, for example, the signal processing unit 1 of the base unit 1
The coefficient seed data for resizing processing is stored in the reference numeral 37, and the coefficient seed data for noise removal processing is stored in the signal processing unit 157 of one child device 2 _ij. It is also possible to store the coefficient seed data for resolution improvement processing in the signal processing unit 157 of one slave unit 2 _pq .

Here, it is possible to store coefficient seed data for performing various processes in both the signal processing unit 137 of the master unit 1 and the signal processing unit 157 of the slave unit 2. In that case, it is necessary to store the coefficient seed data for performing the various processes in the EEPROMs 137B and 157B. Therefore, as the EEPROMs 137B and 157B, those having a large storage capacity are required, and the cost of the parent device 1 and the child device 2 becomes large.

On the other hand, in this embodiment, the scalable T
In the V system, since the parent device 1 and the child device 2 are connected so that IEEE1394 communication is possible, the parent device 1 or the child device 2 uses the coefficient seed data which the child device 2 or the parent device 1 has,
It can be acquired by IEEE1394 communication. Therefore,
For example, if the child device 2 that stores the coefficient seed data for performing the noise removal processing is connected to the parent device 1, the parent device 1 (even if it does not have the coefficient seed data) It is possible to obtain the coefficient seed data from the slave unit 2 and perform the noise removal processing (without the need).

As a result, in the parent device 1 (similarly in the child device 2), as the number of child devices 2 connected as a scalable TV system increases, the executable processing, that is, the function increases.

In this case, EEPROMs 137B and 157
B having a small storage capacity can be adopted as B, and the cost of the parent device 1 and the child device 2 can be reduced.
Further, in this case, the function of the entire scalable TV system increases as the number of child devices 2 is increased in addition to the number of parent devices 1, so that the user can be motivated to purchase the child device. Then, even when the user purchases a new child device, the child device 2 already owned by the user 2
Is necessary for the processing performed using the coefficient seed data of the child device 2, and it is possible to prevent the user from discarding the owned child device 2. As a result, it is possible to contribute to effective use of resources.

In this embodiment, for example, the slave unit 2
In the above, the signal processing unit 157 does not perform processing by the slave unit 2 alone. That is, the signal processing unit 157 of the child device 2 receives the CP from the parent device 1 by IEEE1394 communication.
When a command is received via U149 (FIG. 11), the process is performed corresponding to the command.

Therefore, the handset unit 2 roughly displays the image corresponding to the television broadcast signal received by the antenna as C
A function of displaying the sound on the RT 31 and outputting sound from the speaker units 32L and 32R (hereinafter, as appropriate,
Although it has a TV function) and a function (hereinafter, referred to as a special function) provided by the signal processing unit 157 performing processing, only the TV function can be used by itself, and the special function must be used. I can't. That is, cordless handset 2
In order to use the special function of (1), the child device 2 needs to be connected to the parent device 1 to configure a scalable TV system.

Next, referring to the flowchart of FIG. 30, the processing of the parent device 1 of FIG. 10 will be described.

First, in step S41, C
The PU 129 determines whether or not any device is connected to the terminal panel 21 or an event that a command is supplied from the IEEE1394 interface 133 or the IR receiving unit 135 has occurred, and no event has occurred. If it is determined that there is not, step S4
Return to 1.

If it is determined in step S41 that an event that a device is connected to the terminal panel 21 has occurred, the process proceeds to step S42, and the CPU 129 performs the authentication process of FIG. 31, which will be described later, and the process returns to step S41.

Here, in order to determine whether or not the device is connected to the terminal panel 21, it is necessary to detect that the device is connected to the terminal panel 21, and this detection is performed as follows, for example. Is done.

[0358] That is, the IEEE1394 terminal 21 _ij provided to the terminal panel 21 (FIG. 3), (via a IEEE1394 cable) When a device is connected, the terminal voltage of the IEEE1394 terminal 21 _ij is changed. The IEEE1394 interface 133 is
The change in the terminal voltage is reported to the CPU 129. The CPU 129 detects that the device is newly connected to the terminal panel 21 by receiving the change in the terminal voltage from the IEEE1394 interface 133. To do. Note that the CPU 129 recognizes that the device has been disconnected from the terminal panel 21, for example, by the same method.

On the other hand, in step S41, the IEEE1394
From the interface 133 or the IR receiver 135,
When it is determined that an event in which some command is supplied has occurred, the process proceeds to step S43, the master device 1 performs a process corresponding to the command, and returns to step S41.

Next, with reference to the flowchart of FIG. 31, the authentication process performed by the parent device 1 in step S42 of FIG. 30 will be described.

In the authentication process of the master unit 1, a device newly connected to the terminal panel 21 (hereinafter, appropriately referred to as a connected device)
Is a valid IEEE 1394 device, and whether the IEEE 1394 device is a master or slave television receiver (scalable device) is always authenticated. Be seen.

That is, in the authentication process of the base unit 1, first, in step S51, the CPU 129 determines that the IEEE13
By controlling the 94 interface 133, an authentication request command for requesting mutual authentication is transmitted to the connected device, and the process proceeds to step S52.

In step S52, the CPU 129 determines whether or not the response corresponding to the authentication request command has been returned from the connected device. When it is determined in step S52 that the response corresponding to the authentication request command has not been returned from the connected device, step S52
In step 53, the CPU 129 determines whether the time has expired, that is, whether a predetermined time has passed since the authentication request command was transmitted.

If it is determined in step S53 that the time has expired, that is, even if a predetermined time has elapsed after the authentication request command was transmitted to the connection device, the connection device sends the authentication request command. If the corresponding response is not returned, the process proceeds to step S54 and the CPU 1
29 indicates that the connected device is not a legitimate IEEE 1394 device and authentication has failed, and the operation mode is set to a single mode in which no data is exchanged with the connected device, and a return is made. To do.

Therefore, the base unit 1 then proceeds to the valid IEEE13
In addition to IEEE1394 communication, no data is exchanged between connected devices that are not 94 devices.

On the other hand, if it is determined in step S53 that the time is not over, the process returns to step S52,
Hereinafter, similar processing is repeated.

Then, in step S52, when it is determined that the response corresponding to the authentication request command is returned from the connected device, that is, the response from the connected device is received by the IEEE1394 interface 133, and C
When supplied to the PU 129, the process proceeds to step S55,
The CPU 129 generates a random number (pseudo-random number) R1 according to a predetermined algorithm and transmits it to the connected device via the IEEE1394 interface 133.

After that, the CPU 1 advances to the step S56.
29 is for the random number R1 transmitted in step S55,
The random number R1 is converted into a predetermined encryption algorithm (for example,
DES (Data Encryption Standard) and FEAL (Fast data En
cipherment Algorithm), private key encryption method such as RC5)
It is determined whether or not the encrypted random number E ′ (R1) encrypted in step 1 has been transmitted from the connection device.

If it is determined in step S56 that the encrypted random number E '(R1) has not been transmitted from the connected device, the process proceeds to step S57, in which the CPU 129 determines whether the time has expired, that is, the random number R1. It is determined whether or not a predetermined time has passed since the transmission.

If it is determined in step S57 that the time is over, that is, even if a predetermined time has elapsed after the random number R1 was transmitted to the connected device, the encrypted random number E'from the connected device. When (R1) is not transmitted, the process proceeds to step S54, and the CPU 129 determines that the connected device is not a valid IEEE 1394 device as described above.
Set the operation mode to stand-alone mode and return.

If it is determined at step S57 that the time is not over, then the flow returns to step S56,
Hereinafter, similar processing is repeated.

Then, in step S56, when it is determined that the encrypted random number E '(R1) is transmitted from the connected device, that is, the encrypted random number E' (R1 from the connected device is transmitted.
1) is received by the IEEE1394 interface 133, and C
If it is supplied to the PU 129, the process proceeds to step S58,
The CPU 129 determines the random number R1 generated in step S55.
Is encrypted with a predetermined encryption algorithm to generate an encrypted random number E (R1), and the process proceeds to step S59.

[0373] In step S59, the CPU 129 detects the encrypted random number E '(R1) transmitted from the connected device,
Encrypted random number E (R1) generated by itself in step S58
Determine if and are equal.

In step S59, the encrypted random number E '
When it is determined that (R1) and E (R1) are not equal to each other, that is, the encryption algorithm used in the connected device (including the secret key used for encryption, if necessary)
Is different from the encryption algorithm adopted by the CPU 129, the process proceeds to step S54 and the CP
As mentioned above, the U129 is an IEEE13
Assuming that it is not a 94 device, set the operation mode to stand-alone mode and return.

If it is determined in step S59 that the encrypted random numbers E '(R1) and E (R1) are equal, that is, the encryption algorithm adopted by the connected device is adopted by the CPU 129. If the encryption algorithm is equal to the existing encryption algorithm, the process proceeds to step S60, and C
The PU 129 determines whether or not the random number R2 for the connected device to authenticate the master device 1 is transmitted from the connected device.

When it is determined in step S60 that the random number R2 has not been transmitted, the process proceeds to step S61, and the CPU 129 determines whether or not the time is over, that is, the encrypted random number E'in step S59, for example.
After it is determined that (R1) and E (R1) are equal, it is determined whether a predetermined time has elapsed.

If it is determined in step S61 that the time is over, that is, if the random number R2 is not transmitted from the connected device even after a considerable time has elapsed,
As described above, the CPU 129 proceeds to step S54, determines that the connected device is not a valid IEEE1394 device, sets the operation mode to the single mode, and returns.

If it is determined at step S61 that the time is not over, then the flow returns to step S60,
Hereinafter, similar processing is repeated.

If it is determined in step S60 that the connection device has transmitted the random number R2,
That is, when the random number R2 from the connected device is received by the IEEE1394 interface 133 and supplied to the CPU 129, the process proceeds to step S62, and the CPU 129 determines the random number R2.
Is encrypted with a predetermined encryption algorithm and encrypted random number E
(R1) is generated and transmitted to the connected device via the IEEE1394 interface 133.

Here, at step S60, when the random number R2 is transmitted from the connected device, the authentication that the connected device is a valid IEEE 1394 device is successful.

After that, the CPU 1 advances to the step S63.
By controlling the IEEE1394 interface 133, the device 29 requests its own device ID and function information together with the function information request command for requesting the device ID and function information of the connected device.
Send to the connected device.

Here, the device ID is a unique ID for specifying the television receiver which is the master unit 1 and the slave unit 2.

Further, the function information is information relating to the function of itself, for example, the type of coefficient seed data possessed by itself (what kind of image seed conversion data can be used for the coefficient seed data), a command received from the outside. Type (eg power on / off, volume control, channel, brightness,
This includes information such as which command from the outside is received to control sharpness and the like), whether a screen display (OSD display) is possible, whether it can be in a mute state, whether it can be in a sleep state, and the like. Further, the function information also includes information as to whether the device itself has a function as a master device or a slave device.

In the base unit 1, the device ID and the function information are, for example, the EEPROM 130 and vendor_dependent_informa of the configuration ROM shown in FIG.
It can be stored in tion, etc.

After that, the CPU 1 advances to the step S64.
29, in response to the function information request command transmitted to the connection device in step S63, waits for the connection device to transmit the device ID and the function information, and then transmits the device ID and the function information to the IEEE1394 interface. Received via 133,
It is stored in the EEPROM 130, and the process proceeds to step S65.

In step S65, the CPU 129 determines that E
By referring to the function information stored in the EPROM 130, it is determined whether or not the connected device is a slave device. When it is determined in step S65 that the connected device is the slave, that is, when the authentication that the connected device is the slave is successful, steps S66 and S67 are skipped, the process proceeds to step S68, and the CPU 129 , The operation mode is provided with a control command for causing the connected device, which is the slave unit, to perform a process by the special function, that is, the special function command reception / provision mode for controlling the special function of the slave unit is set, To return.

On the other hand, if it is determined in step S65 that the connected device is not the slave device, the process advances to step S66, and the CPU 129 refers to the function information stored in the EEPROM 130 to determine whether the connected device is the master device. Determine whether When it is determined in step S66 that the connected device is the master device, that is, when the authentication that the connected device is the master device is successful, the process proceeds to step S67, and the CPU 129 determines that the connected device is the master device. Parent-child adjustment processing is performed between them.

That is, in this case, since another master device is connected to the master device 1, two of the television receivers forming the scalable TV system function as the master device. Will be done. In this embodiment,
It is necessary for the scalable TV system to have only one master unit. Therefore, in step S67,
A parent-child adjustment process is performed between the parent device as a connection device and which determines which one functions as a television receiver as the parent device.

[0389] Specifically, for example, the master unit that has become a scalable TV system faster, that is, the master unit 1 in this embodiment functions as a television receiver as the master unit. Is decided. In addition,
The other master device determined not to function as the master device functions as the slave device.

After the parent-child adjustment process is performed in step S67, the process proceeds to step S68, and the CPU 129 sets the operation mode to the special function command acceptance / provision mode as described above and returns.

On the other hand, if it is determined in step S66 that the connected device is not the master device, that is, the connected device is neither the master device nor the slave device, and accordingly, the connected device is the master device or the slave device. If the authentication is unsuccessful, the process proceeds to step S69, and the CPU 129 sets the operation mode to the connected device to exchange the default AV / C command set, but the control command for performing the processing by the special function. Set the normal function command reception / provision mode, which cannot be exchanged, and return.

That is, in this case, since the connected device is neither the parent device nor the child device, even if such a connected device is connected to the parent device 1, no special function is provided. However,
In this case, since the connected device is a legitimate IEEE 1394 device, the exchange of the predetermined AV / C command set between the parent device 1 and the connected device is permitted. Therefore, in this case, with respect to the master device 1 and the connected device, the other device (or another IEEE1394 device connected to the master device 1) is set to the default device.
It is possible to control by the AV / C command set.

Next, with reference to the flowchart in FIG. 32, the processing of the slave unit 2 in FIG. 11 will be described.

First, in step S71, C
The PU 149 determines whether any device is connected to the terminal panel 41, or whether an event that some command is supplied from the IEEE1394 interface 153 or the IR receiving unit 155 has occurred, and no event has occurred. If it is determined that there is not, step S7
Return to 1.

If it is determined in step S71 that an event that a device is connected to the terminal panel 41 has occurred, the process proceeds to step S72, and the CPU 149 performs the authentication process of FIG. 33, which will be described later, and the process returns to step S71.

Here, in order to determine whether or not the device is connected to the terminal panel 41, it is necessary to detect that the device is connected to the terminal panel 41. This detection is performed, for example, in the step of FIG. It is performed in the same manner as the case described in S41.

On the other hand, in step S71, the IEEE1394
From the interface 153 or IR receiver 155,
When it is determined that an event in which some command is supplied has occurred, the process proceeds to step S73, the slave unit 2 performs a process corresponding to the command, and the process returns to step S71.

Next, with reference to the flowchart of FIG. 33, the authentication processing performed by the handset 2 in step S72 of FIG. 32 will be described.

In the authentication process of the child device 2, the device (connection device) newly connected to the terminal panel 41 is a valid IEEE1394
Two authentications are performed, one is authentication as to whether or not the device is a device, and the other is authentication as to whether or not the IEEE1394 device is a master device.

That is, in the authentication processing of the handset 2, first, in step S81, the CPU 149 determines whether or not an authentication request command requesting mutual authentication has been sent from the connected device, and then sends the authentication request command. If it is determined that it has not been performed, the process proceeds to step S82.

In step S82, the CPU 149 determines whether or not the time has expired, that is, whether or not a predetermined time has elapsed since the start of the authentication process.

If it is determined in step S82 that the time is over, that is, if the authentication request command is not transmitted from the connected device even if a predetermined time has elapsed since the authentication process was started, In step S83, the CPU 149 determines that the connected device is not a legitimate IEEE1394 device and fails in the authentication, and sets the operation mode to the single mode in which no data is exchanged with the connected device. Set and return.

Therefore, like the parent device 1, the child device 2 does not perform IEEE1394 communication but exchanges any data with a connected device which is not a legitimate IEEE1394 device.

On the other hand, if it is determined in step S82 that the time is not over, the process returns to step S81.
Hereinafter, similar processing is repeated.

If it is determined in step S81 that the authentication request command is transmitted from the connected device, that is, the authentication request command transmitted from the master device 1 as the connected device in step S51 of FIG. , IE
Received by the EE1394 interface 153, the CPU 149
If it is supplied to the CPU 14, the process proceeds to step S84 and the CPU 14
9 controls the IEEE1394 interface 153 to transmit a response to the authentication request command to the connected device.

Here, in this embodiment, the processes of steps S51 to S53 in FIG.
The processes of steps S81, S82, and S84 in step S81 of FIG. 31 are performed by the slave unit 2, but the processes of steps S51 to S53 in FIG. Processing is base unit 1
It is also possible to make each perform.

After that, the CPU 1 advances to the step S85.
49 determines whether or not the random number R1 is transmitted from the connected device, and when it is determined that the random number R1 is not transmitted,
It proceeds to step S86.

[0408] In step S86, the CPU 149 determines whether or not the time has expired, that is, whether or not a predetermined time has elapsed since the response to the authentication request command was transmitted in step S84.

[0409] In step S86, when it is determined that the time is over, that is, when the random number R1 is not transmitted from the connected device even if a predetermined time has elapsed after the response to the authentication command was transmitted. In step S83, the CPU 149 determines that the connected device is not a legitimate IEEE1394 device, and sets the operation mode to the single mode in which no data is exchanged with the connected device, as described above. Set and return.

On the other hand, if it is determined in step S86 that the time is not over, the process returns to step S85,
Hereinafter, similar processing is repeated.

Then, in step S85, when it is determined that the random number R1 is transmitted from the connection device, that is, in step S55 of FIG. 31, the master device 1 as the connection device is transmitted.
When the random number R1 transmitted from the device is received by the IEEE1394 interface 153 and supplied to the CPU 149,
In step S87, the CPU 149 determines that the random number R1
Is encrypted with a predetermined encryption algorithm to generate an encrypted random number E ′ (R1). Further, in step S87, the CPU 149 controls the IEEE1394 interface 153 to transmit the encrypted random number E ′ (R1) to the connected device, and the process proceeds to step S89.

[0412] In step S89, the CPU 149 generates a random number (pseudo-random number) R2 and controls the IEEE1394 interface 153 to transmit the random number R2 to the connected device, and proceeds to step S90.

In step S90, the CPU 149 determines that the encrypted random number E (R2), which is the encrypted random number R2 generated by the master device 1 as the connection device in step S62 of FIG.
It is determined whether or not it is transmitted from the connected device.

If it is determined in step S90 that the encrypted random number E (R2) has not been transmitted from the connected device, the process proceeds to step S91, in which the CPU 149 determines whether the time has expired, that is, the random number R2 is transmitted. Then, it is determined whether a predetermined time has elapsed.

[0415] In step S91, when it is determined that the time is over, that is, even if a predetermined time has elapsed after the random number R2 was transmitted to the connected device, the encrypted random number E ( If R2) is not sent,
As described above, the CPU 149 proceeds to step S83, determines that the connected device is not a valid IEEE 1394 device, sets the operation mode to the single mode, and returns.

On the other hand, if it is determined in step S91 that the time is not over, the process returns to step S90,
Hereinafter, similar processing is repeated.

Then, when it is determined in step S90 that the encrypted random number E (R2) is transmitted from the connected device, that is, the encrypted random number E (R2) from the connected device.
Is received by the IEEE1394 interface 153, and the CPU
If it is supplied to the CP 149, the process proceeds to step S92, and the CP
U149 encrypts the random number R2 generated in step S89 with a predetermined encryption algorithm to generate an encrypted random number E ′.
(R2) is generated and the process proceeds to step S93.

In step S93, the CPU 149 determines whether or not the encrypted random number E (R2) transmitted from the connected device is equal to the encrypted random number E '(R2) generated by itself in step S92.

In step S93, the encrypted random number E
When it is determined that (R2) and E '(R2) are not equal, that is, the encryption algorithm adopted by the connection device (including the secret key used for encryption, if necessary)
Is different from the encryption algorithm adopted by the CPU 149, the process proceeds to step S83 and the CP
As described above, the U149 is an IEEE13
Assuming that it is not a 94 device, set the operation mode to stand-alone mode and return.

If it is determined in step S93 that the encrypted random numbers E (R2) and E '(R2) are equal, that is, the encryption algorithm adopted by the connected device is adopted by the CPU 149. This is the same as the encryption algorithm used by the
When the authentication that the device is an IEEE1394 device is successful, the process proceeds to step S94, and the CPU 149 determines the device ID and the function information transmitted from the master device 1 as the connected device together with the function information request command in step S63 of FIG. , IEEE
Received via the 1394 interface 153, EEPRO
Store in M150.

Then, the process proceeds to step S95, the CPU 1
The control unit 49 controls the IEEE1394 interface 153 to transmit its own device ID and function information to the connected device in response to the function information request command from the connected device received in step S94, and proceeds to step S96.

Here, in the child device 2, the function ID and the function information are the same as those in the case of the parent device 1 described in FIG.
It can be stored in the EPROM 150 or vendor_dependent_information of the configuration ROM shown in FIG.

At step S96, the CPU 149 determines that E
By referring to the function information stored in the EPROM 150, it is determined whether the connected device is the master device. When it is determined in step S96 that the connected device is the master device, that is, when the authentication that the connected device is the master device is successful, the process proceeds to step S97, and the CPU 149
Set the operation mode to the special function command acceptance / provision mode that accepts a control command from the connected device, which is the master unit, and processes the special function in response to the control command, that is, accepts a control command that controls the special function. Set and return.

[0424] Here, when the handset unit 2 enters the special function command reception / provision mode, it basically ignores the commands supplied from its own front panel 154 and IR reception unit 155, and is received by the IEEE1394 interface 153. In this state, various processes are performed according to commands from the master unit 1. That is, the slave unit 2 is in a state of performing, for example, setting of channels and volume, etc., only in response to a command from the master unit 1. Therefore, a scalable TV system
It can be said that the base unit 1 is a so-called centralized control type system that controls all the handset units 2 that make up the scalable TV system.

The command transmission from the base unit 1 (FIG. 10) to the handset unit 2 can be performed based on the input from the front panel 134 or the IR receiving unit 135, or the front panel of the handset unit 2 can be transmitted. It is also possible to transfer the input to 154 and the IR receiving unit 155 to the base unit 1 via the IEEE1394 interface 153, and to perform the input based on the input transferred from the base unit 2 to the base unit 1 in this way.

On the other hand, in step S96, when it is determined that the connected device is not the master device, that is, when the authentication that the connected device is the master device fails, the process proceeds to step S98, and the CPU 149 sets the operation mode to The default AV / C command set can be exchanged with the connected device, but the control commands for performing special function processing cannot be exchanged. Set the normal function command acceptance / provision mode and return. .

That is, in this case, since the connected device is not the master device, even if such a connected device is connected to the slave device 2,
No special features are provided. Therefore, the special function is not provided only by connecting another child device to the child device 2. However, in this case, since the connected device is a legitimate IEEE1394 device, the default AV between the handset 2 and the connected device is set.
/ C Command set interaction is allowed. Therefore, in this case, the slave unit 2 and the connected devices (including other slave units) can be controlled from the other side by the predetermined AV / C command set.

Next, referring to FIG. 31 and FIG.
After the authentication processing described in 1 above is successful, the scalable TV system provides the special function after the master unit 1 and the slave unit 2 have their operation modes set to the special function command reception / provision mode. A detailed example of the processing performed by the child device 2 in step S43 of FIG. 30 and step S73 of FIG. 32 will be described.

First, the base unit 1 outputs the image and sound as the television broadcast program (the image is displayed and the sound is output) as described in FIG. In this way, the user turns on the guide button switch 63 of the remote controller 15 (FIG. 7) (or the guide button switch 93 of the remote controller 35 (FIG. 8)) when the image and sound are output. When operated, the remote controller 15 emits infrared rays corresponding to the user's operation. This infrared ray is received by the IR receiving unit 135 of the base unit 1 (FIG. 10), and the guide button switch 6 is received.
A command corresponding to the operation No. 3 (hereinafter, appropriately referred to as a caption display command) is supplied to the CPU 129.

The infrared ray from the remote controller 15 is also received by the IR receiver 155 of the handset 2 (FIG. 11), but the handset 2 ignores the infrared ray.

When the CPU 129 of the master unit 1 (FIG. 10) receives the caption display command as described above, it performs the closed caption processing of the master unit according to the flowchart of FIG.

That is, the CPU 129 first determines in step S101 whether the transport stream supplied to the demultiplexer 124 includes closed caption data.

[0433] Here, when the closed caption data is included in the MPEG video stream, the closed caption data is arranged, for example, as MPEG user data (MPEG-2 user data) in the sequence layer. In this case, in step S101, the CPU
The reference numeral 129 refers to the transport stream supplied to the demultiplexer 124 to determine whether or not the closed caption data is included in the transport stream.

[0434] If it is determined in step S101 that the transport stream does not include closed caption data, the subsequent processing is skipped and the closed caption processing is terminated.

If it is determined in step S101 that the closed caption data is included in the transport stream, the process proceeds to step S102, and the CPU 129 stores the scalable TV system stored in the EEPROM 130. By referring to the function information and the function information of itself, a television receiver forming a scalable TV system is searched for one having coefficient seed data for closed caption. That is, as described above, the function information includes the type of coefficient seed data included in each television receiver that configures the scalable TV system. In step S102, by referring to such function information, , A search for a television receiver having coefficient seed data for closed captioning is performed.

Here, the coefficient seed data for closed caption means, for example, the image data of the closed caption displayed by the closed caption data is used as the teacher data and the resolution of the teacher data is deteriorated. This is the seed data that is obtained by learning the teacher data with image data added with noise, or the image data obtained by reducing the teacher data, etc., and improves the resolution of closed caption images. , Coefficient seed data particularly suitable for noise removal or expansion.

Thereafter, the flow proceeds to step S103, and the CPU
129 determines whether or not there is a television receiver having coefficient seed data dedicated to closed caption based on the search result of step S102.

If it is determined in step S103 that there is no television receiver having coefficient seed data dedicated to closed captioning, step S104.
Then, the CPU 129 controls the signal processing unit 137 to start the normal closed caption display.

That is, the signal processing unit 137 also has a function as a so-called closed caption decoder, and the CPU 129 requests the demultiplexer 124 for closed caption data in the transport stream, and in response to the request, Demultiplexer 12
The closed caption data supplied from No. 4 is supplied to the signal processing unit 137. The signal processing unit 137 uses the CP
The closed caption data from U129 is decoded, and the closed caption obtained as a result is superimposed on a predetermined position of the image data stored in the frame memory 127. As a result, the CRT 11 has M
Image data in which closed captions are superimposed on the image data decoded by the PEG video decoder 125 is displayed.

Therefore, in this case, in the CRT 11 of the master unit 1, the corresponding closed caption is superimposed on the image as the content, as in the case of a general television receiver having a closed caption decoder. Is displayed.

When the display of the closed caption is started as described above, the process proceeds to step S105 and C
As in step S101, the PU 129 determines whether the transport stream supplied to the demultiplexer 124 still contains closed caption data to be displayed.

If it is determined in step S105 that there is no closed caption data, step S105.
106, skip to step S107, and enter CP
The U129 controls the signal processing unit 137,
The decoding process of the closed caption data is ended, and the closed caption process is ended.

On the other hand, if it is determined in step S105 that the transport stream supplied to the demultiplexer 124 contains closed caption data to be displayed, step S10.
In step 6, the CPU 129 determines whether or not a command for ending the closed caption display (hereinafter, appropriately referred to as a closed caption display off command) has been transmitted.

When it is determined in step S106 that the closed caption display off command has not been transmitted, the process returns to step S105, and the same processing is repeated thereafter. That is, in this case, the display of the closed caption is continued.

[0445] If it is determined in step S106 that the closed caption display off command has been transmitted, that is, for example, if the user operates the remote controller 1
By operating to turn off the guide button switch 63 of 5 (FIG. 7) (or the guide button switch 93 of the remote controller 35 (FIG. 8)), infrared rays corresponding to the closed caption display off command are emitted from the remote controller 15. If received by the IR receiving unit 135, the process proceeds to step S107, and the CPU 129 controls the signal processing unit 137 to end the decoding process of the closed caption data and end the closed caption process as described above. To do.

On the other hand, if it is determined in step S103 that there is a slave unit (hereinafter, referred to as a caption coefficient seed data holding slave unit) as a television receiver having coefficient seed data dedicated to closed caption, it is determined in step S108. Then, the CPU 129 selects the one for displaying the closed caption from the slaves as the television receivers constituting the scalable TV system.

That is, the CPU 129, for example, the slave unit 2 ₂₃ arranged on the left side of the master unit 1 and the slave unit 2 ₃₂ arranged below it.
Is selected as a child device for displaying a closed caption (hereinafter, appropriately referred to as a child device for caption display). It should be noted that the parent device 1 recognizes the arrangement position of the child device 2 _ij as viewed from the parent device 1 in advance, as described above,
As a result, the child device _ij located at each position such as the child device 2 ₂₃ arranged on the left of the parent device 1 and the child device 2 ₃₂ arranged below is specified.

Thereafter, the flow proceeds to step S109, the CPU
The 129 transmits a command to the caption coefficient seed data holding slave unit via the IEEE1394 interface 133, thereby requesting the coefficient seed data dedicated to the closed caption.

Here, the CPU 129 sets the slave unit, which is the caption coefficient seed data holding slave unit, to the EEPROM.
A command for requesting coefficient seed data dedicated to closed captions (hereinafter, referred to as a coefficient seed data request command) is specified by the device ID stored together with the function information in 130 and is transmitted to the device ID. CPU1
29 is a command other than the coefficient seed data request command,
The slave unit to which the command should be sent is specified by the device ID, and the command is sent to the device ID.

At step S109, the CPU 1
29, waits for the coefficient seed data dedicated to closed caption to be transmitted from the caption coefficient seed data holding slave unit that has received the coefficient seed data request command, and then transmits the coefficient seed data dedicated to the closed caption to IEEE13.
94 interface 133, which allows
Get coefficient seed data only for closed captions.

Here, when the CPU 129 stores coefficient seed data dedicated to closed caption in the EEPROM 137B of its own signal processing unit 137,
In step S109, the coefficient seed data dedicated to the closed caption is acquired by reading it from the EEPROM 137B.

Even when the coefficient seed data dedicated to the closed caption is not stored in any of the television receivers constituting the scalable TV system, for example, in the coefficient seed data providing server (not shown). , When the coefficient seed data dedicated to the closed caption is provided, the CPU 129 causes the modem 1
By controlling 36, it is possible to access the coefficient seed data providing server and acquire the coefficient seed data dedicated to the closed caption from the coefficient seed data providing server.

The provision of coefficient seed data by such a coefficient seed data providing server is not limited to coefficient seed data dedicated to closed captions, but may be applied to coefficient seed data used in various processes (image conversion processing) described later. Can be similarly performed.

Further, the coefficient seed data providing server can provide the coefficient seed data either free of charge or for a fee.

When the CPU 129 acquires the coefficient seed data dedicated to the closed caption in step S109,
In step S110, the IEEE1394 interface 13
By controlling 3, the coefficient seed data dedicated to the closed caption is transmitted to the child device for caption display together with the closed caption display command for instructing the display of the closed caption.
Proceed to 11.

At step S111, the CPU 129
By controlling the IEEE1394 interface 133,
For the child device for caption display, select the input to the IEEE1394 interface 153 (Fig. 11), and select C
An external input selection command instructing to display on RT31 is transmitted, and the process proceeds to step S112.

At step S112, the CPU 129
Start the transfer of closed caption data to the caption display slave unit.

That is, the CPU 129 requests the demultiplexer 124 for closed caption data in the transport stream, and receives the closed caption data supplied from the demultiplexer 124 in response to the request. Further, the CPU 129 is the IEEE13
By controlling the 94 interface 133, the closed caption data received from the demultiplexer 124 is transferred to the caption display slave unit.

When the transfer of the closed caption data to the caption display slave unit is started as described above, the process proceeds to step S113, and the CPU 129 is supplied to the demultiplexer 124 as in the case of step S101. It is determined whether or not the closed caption data to be displayed is still included in the transport stream being displayed.

If it is determined in step S113 that there is no closed caption data, step S113.
114, skip to step S115, and enter CP
By controlling the IEEE1394 interface 133, the U129 ends the closed caption data transfer processing and ends the closed caption processing.

On the other hand, if it is determined in step S113 that the transport stream supplied to the demultiplexer 124 contains closed caption data to be displayed, step S11.
In step 4, the CPU 129 determines whether or not a command to close the closed caption display (closed caption display off command) has been transmitted.

If it is determined in step S114 that the closed caption display off command has not been transmitted, the process returns to step S113, and the same processing is repeated thereafter. That is, in this case, the transfer of the closed caption data to the caption display slave unit is continued.

[0463] If it is determined in step S114 that the closed caption display off command has been transmitted, that is, for example, if the user operates the remote controller 1
By operating to turn off the guide button switch 63 of 5 (FIG. 7) (or the guide button switch 93 of the remote controller 35 (FIG. 8)), infrared rays corresponding to the closed caption display off command are emitted from the remote controller 15. If received by the IR receiving unit 135, the CPU 129 controls the IEEE1394 interface 133 to end the transfer processing of the closed caption data, and ends the closed caption processing in step S115.

In the parent device 1, the closed caption process of FIG. 34 is performed, whereby step S1 is executed.
In 10, the closed caption display command is transmitted, and when the closed caption display command is received by the handset 2 as the caption display handset, the IEEE1394 interface 15 of the handset 2 (FIG. 11) is received.
3 and is supplied to the CPU 149), the child device 2 performs the closed caption processing of the child device according to the flowchart of FIG.

That is, in the child device 2 (FIG. 11) as the caption display child device, first, in step S121, the closed caption transmitted from the parent device 1 together with the closed caption display command in step S110 of FIG. The coefficient seed data dedicated to captioning is IEEE
The signal is received by the 1394 interface 153, supplied to the CPU 149, and proceeds to step S122.

At step S122, the CPU 149
The coefficient seed data dedicated to the closed caption is transferred to the signal processing unit 157 and set (stored) in the coefficient seed memory 207 (FIG. 29). At this time, the signal processing unit 157 stores the coefficient seed data stored in the coefficient seed memory 207 by itself in the EEPROM 157 in advance.
Evacuate to the empty area of B.

Here, when the slave unit 2 as the caption display slave unit is also the slave unit having the caption coefficient seed data, that is, the coefficient memory 207 constituting the signal processing unit 157 of the slave unit 2 is originally closed. If the coefficient seed data dedicated to the caption is stored, the above step S
The processing of 121 and S122, and the processing of step S128 described later can be skipped.

Thereafter, the flow proceeds to step S123, and the CPU
149 determines whether the parent device 1 has received the external input selection command transmitted in step S111 of FIG. 34, and if it has not received the external input selection command, step S123.
Return to.

Further, in step S123, the master unit 1
When it is determined that the external input selection command from the base unit 1 is received, that is, the IEEE1394 interface 153 receives the external input selection command from the base unit 1, and the CPU 1
When it is supplied to 49, the process proceeds to step S124, and the CP
The U 149 selects the closed caption data received by the IEEE1394 interface 153 and supplies it to the signal processing unit 157, and proceeds to step S125.

In step S125, the CPU 149
In step S112 of FIG. 34, base unit 1 determines whether or not the closed caption data for starting transfer has been transmitted.

[0471] If it is determined in step S125 that the closed caption data from the parent device 1 has been transmitted, that is, if the closed caption data from the parent device 1 is received by the IEEE1394 interface 153 and supplied to the CPU 149. , Step S1
In step 26, the CPU 149 supplies the closed caption data to the signal processing unit 157 to target the closed caption data, and in step S
At 122, image conversion processing is performed using the coefficient seed data dedicated to the closed caption set in the coefficient seed memory 207 (FIG. 29).

That is, in this case, the signal processing unit 157
Decoding the closed caption data from the PU 149, and subjecting the resulting closed caption image data to image conversion processing using tap coefficients generated from the coefficient seed data dedicated to the closed caption stored in the coefficient seed memory 207. Is converted into high-quality closed caption image data.

This high-quality closed caption image data is CR-processed through the frame memory 147 and NTSC encoder 148 in step S127.
It is supplied to T31 and displayed. And step S1
25, the processes of steps S125 to S127 are repeated until it is determined in step S125 that the closed caption data has not been transmitted from the parent device 1.

If it is determined in step S125 that the closed caption data has not been transmitted from the parent device 1, that is, the IEEE1394 interface 1
In 53, when the closed caption data cannot be received, the process proceeds to step S128, and the signal processing unit 157 stores the original coefficient seed data saved in the EEPROM 157B in the coefficient seed memory 207.
(FIG. 29) is set again (overwritten), and the closed caption process is ended.

According to the closed caption process of the master unit shown in FIG. 34 and the closed caption process of the slave unit shown in FIG. 35, the coefficient seed data dedicated to the closed caption is included in the television receiver forming the scalable TV system. If there is no such thing, base unit 1
Then, similar to the conventional television receiver with a built-in closed caption decoder, the image data of the closed caption is superimposed on the image data of the television broadcast program and displayed on the CRT 11.

On the other hand, in the case where some of the television receivers constituting the scalable TV system have coefficient seed data dedicated to closed caption,
On the CRT 11 of the parent device 1, only image data as a television broadcast program is displayed. Further, in the CRT 31 of the child device 2 as a child device for caption display, the closed caption image data corresponding to the image data displayed on the CRT 11 of the parent device 1 that has been converted to high-quality image data is used. Is displayed.

Therefore, the user can see the image data as the television broadcast program without being disturbed by the image data of the closed caption. Further, the user can see the high-quality closed caption image data.

Even if there is no television receiver forming the scalable TV system having coefficient seed data dedicated to closed caption, the image data of closed caption is the same as that of the television broadcast program. Apart from the image data, it is possible to display it on the CRT 31 of the child device 2 as a child device for caption display. In this case, the user cannot see the high-quality closed caption image data, but can still see the image data as a television broadcast program without being obstructed by the closed caption image data. .

Also, in the above-mentioned case, the closed caption image data is displayed only on one child device 2 as a caption display child device, but the closed caption image data is not It is also possible to display on two or more slave units that compose the TV system. That is, for example, when there are closed caption data in multiple languages, the image data of closed captions in each language is
It is possible to display on different child machines.

[0480] Next, the scalable TV system has, for example, a special function for enlarging a part of the image data, and this special function is partially enlarged by the master unit 1 and the slave unit 2. It is realized by

The instruction to perform the partial enlargement process can be issued from the menu screen, for example.

That is, as described above, the user operates the menu button switch 54 of the remote controller 15 (FIG. 7) (or the menu button switch 84 of the remote controller 35 (FIG. 8)).
When is operated, a menu screen is displayed on the CRT 11 of the parent device 1 (or the CRT 31 of the child device 2). On the menu screen, for example, an icon representing a partial enlargement process (hereinafter, one A partial enlargement icon) is displayed, and when the user operates the remote controller 15 to click the partial enlargement icon, the master unit 1
Partial enlargement processing is started in each of the slave units 2.

[0483] Then, first, with reference to the flowchart in Fig. 36, a partial enlargement process of the master unit will be described.

For example, now, in the CRT 11 of the main unit 1, image data as a television broadcast program (hereinafter, appropriately,
If the partial enlargement icon is clicked while the program image data is being displayed), first, in step S131, the CPU 129
Instead of the master unit 1, a slave unit that displays the entire program image data displayed on the CRT 11 of the master unit 1 (hereinafter, appropriately,
The entire display slave unit) is selected from the television receivers constituting the scalable TV system, and the process proceeds to step S132.

Here, it is possible to select only one of the slaves constituting the scalable TV system as the slave for the entire display, or two or more (including all) slaves. It is also possible to select.

At step S132, the CPU 129
By controlling the IEEE1394 interface 133,
It communicates with the whole display slave unit, and thereby determines whether or not the power of the whole display slave unit is on.

[0487] If it is determined in step S132 that the power supply for the whole display slave unit is not turned on, the process proceeds to step S133, where the CPU 129 controls the IEEE1394 interface 133 so that the whole display slave unit is activated. On the other hand, a command for instructing to turn on the power is transmitted, thereby causing the whole display slave unit to be turned on, and the process proceeds to step S134.

If it is determined in step S132 that the power supply of the slave unit for full display is on, step S133 is skipped and step S13 is performed.
In step 4, the CPU 129 controls the signal processing unit 137 so that in the image displayed on the CRT 11,
A message (hereinafter, referred to as an enlarged position designation request message) requesting to specify a position to be enlarged (enlarged position) is displayed on the CRT 11 by, for example, OSD.

That is, in this case, the signal processing section 137 determines that C
Under the control of the PU 129, the OSD data of the enlarged position designation request message is generated, and the frame memory 12
It is superimposed on the program image data stored in 7. The program image data on which the OSD data of this enlargement position designation request message is superimposed is supplied from the frame memory 127 to the CRT 11 via the NTSC encoder 128, whereby the CRT 11 specifies the enlargement position together with the program image data. The request message is displayed by OSD.

Thereafter, the flow advances to step S135, and the CPU
The user 129 determines whether or not the enlargement position is designated by the user in response to the enlargement position designation request message displayed in step S134, and if it is determined that the enlargement position is not designated, the process returns to step S135.

If it is determined in step S135 that the user has designated the enlargement position, that is, the user operates the remote controller 15 (or remote controller 35) to designate the position on the display screen of the CRT 11. As a result, the infrared ray corresponding to the position is transmitted to the IR receiver 1
When received at 35 and supplied to CPU 129, CP
The U129 recognizes the designated position as the enlarged position, and proceeds to step S136.

[0492] In step S136, the CPU 129
By controlling the IEEE1394 interface 133,
Select the input to the IEEE1394 interface 153 (FIG. 11) for the whole display slave unit, and select the CRT31.
The external input selection command for instructing to display is transmitted, and the process proceeds to step S137.

At step S137, the CPU 129
Start transferring the program image data to the whole display slave unit.

That is, the CPU 129 requests the demultiplexer 124 for the TS packet in the transport stream, which is supplied to the MPEG video decoder 125, and in response to the request, the TS packet supplied from the demultiplexer 124. To receive. Furthermore, CPU1
The control unit 29 controls the IEEE1394 interface 133 to transfer the TS packet received from the demultiplexer 124 to the entire display slave unit. Therefore, the TS packet corresponding to the program image data displayed on the CRT 11 of the master unit 1 is transferred to the slave unit for full display, and the slave unit for full display displays one of the slave units of FIG. By performing the copy enlargement process, the program image data corresponding to the TS packet is displayed. That is, in the whole display slave unit, the entire program image data displayed in the main unit 1 is displayed.

In the CPU 129, the whole display slave unit is not the TS packet but the frame memory 1
It is also possible to read the program image data stored in 27, that is, the image data after MPEG decoding, through the signal processing unit 137 and transfer it. In this case, the program for displaying the program image data in the whole display slave unit is MPEG.
It can be displayed without decoding.

When the transfer of the TS packet to the slave device for full display is started as described above, step S138.
Then, the CPU 129 controls the signal processing unit 137 to set a predetermined range centered on the enlargement position of the program image data stored in the frame memory 127 as an enlargement range, and to target the enlargement range, and An image conversion process using the coefficient seed data for resizing processing set in the coefficient seed memory 167 (FIG. 22) is performed.

That is, in the present embodiment, at least coefficient seed data for resizing processing is stored in the coefficient seed memory 167 which constitutes the signal processing unit 137 (FIG. 22) of the master unit 1, and the signal processing is performed. The unit 137 is a frame memory 12
Image conversion of the expansion range as a predetermined range centered on the expansion position of the program image data stored in No. 7, using tap coefficients generated from the coefficient seed data for resizing processing stored in the coefficient seed memory 167. By processing, the program image data in the enlargement range is converted into image data enlarged (resized) at a predetermined enlargement ratio (hereinafter, appropriately referred to as partially enlarged image data).

This partially enlarged image data is obtained in step S1.
At 39, it is supplied to the CRT 11 via the frame memory 127 and the NTSC encoder 128 for display.

Therefore, in this case, the CRT 11 of the parent device 1 displays partially enlarged image data obtained by enlarging a predetermined range (enlargement range) of the program image data centered on the enlargement position designated by the user.

Here, the size of the enlargement range is set, for example, according to the enlargement ratio.

That is, when performing the partial enlargement processing,
For example, the default enlargement ratio (default enlargement ratio) is preset, and the CPU 129 sets the parameter corresponding to the default enlargement ratio to the signal processing unit 137.
It is set in the parameter memory 168 (FIG. 22). Therefore, the signal processing unit 137 performs resizing processing in which the program image data is enlarged by the default enlargement ratio.

On the other hand, the size of the image data that can be displayed on the CRT 11, that is, the size of the display screen is predetermined.

Therefore, the CPU 129 is configured to set, as the enlargement range, a range around the enlargement position, which is the size of the display screen of the CRT 11 when enlarged by the default enlargement ratio.

Note that the enlargement ratio at the time of performing the image conversion processing in step S138 can be set by the user.

That is, for example, the CPU 129 controls the signal processing unit 137 so that the CRT 11 can specify the enlargement ratio and can be operated by the remote controller 15 (or remote controller 35).
It is possible to display a magnification ratio designating lever) and to designate the magnification ratio depending on the position of the magnification ratio designating lever.

In this case, when the user operates the remote controller 15 to move the position of the enlargement ratio specifying lever, the CPU 129 causes the signal processing unit 137 (see FIG. 22)
Parameter memory 168. Furthermore, CP
U129 sets the enlargement range centering on the enlargement position in the same manner as in the case of the default enlargement ratio, corresponding to the enlargement ratio corresponding to the position of the enlargement ratio designating lever, and targets that enlargement range. Image conversion process (resizing process)
To the signal processing unit 137.

As described above, the CRT 11 displays the partially enlarged image data obtained by enlarging the program image data in the enlargement range centered on the enlargement position at the enlargement ratio according to the operation of the remote controller 15 by the user. .

[0508] The lever for specifying the enlargement ratio is C of the main unit 1.
It is possible to perform OSD display on the RT 11 or display on a television receiver other than the base unit 1 that constitutes the scalable TV system.

After that, the process advances to step S140, and the CPU
129 determines whether or not a command for ending the display of the partially enlarged image data (hereinafter, referred to as a partially enlarged image ending command) has been transmitted.

[0510] If it is determined in step S140 that the partial enlargement end command has not been transmitted, the process returns to step S133, and the same processing is repeated thereafter.

If it is determined in step S140 that the partial enlargement end command has been transmitted, that is, for example, the user operates the remote controller 15 (FIG. 7) to display the menu screen on the CRT 11. ,
Further, the partial enlargement icon on the menu screen is clicked again, whereby infrared rays of the partial enlargement end command which is a command corresponding to the operation of the remote controller 15 is emitted from the remote controller 15 and received by the IR receiving unit 135. If it is generated and supplied to the CPU 129, step S1
Proceeding to step 41, the CPU 129 controls the IEEE1394 interface 133 to terminate the transfer of the program image data to the overall display slave unit.

Then, the flow proceeds to step S142, and the CPU
The control unit 129 controls the signal processing unit 137 to stop execution of the resizing process, and ends the partial enlargement process. As a result, the CRT 11 can display the image in the normal size.

Next, referring to the flow chart of FIG. 37, a partial enlargement process of the slave unit as the slave unit for full display will be described.

In the slave 2 as the slave for overall display, first, in step S151, the CPU 149
It is determined whether or not the parent device 1 has received the external input selection command transmitted in step S136 of FIG. 36. If it is determined that the external input selection command has not been received, the process returns to step S151.

[0515] Further, in step S151, the main unit 1
When it is determined that the external input selection command from the base unit 1 is received, that is, the IEEE1394 interface 153 receives the external input selection command from the base unit 1, and the CPU 1
When it is supplied to 49, the process proceeds to step S152 and the CP
The U149 selects the program image data received by the IEEE1394 interface 153 and supplies it to the MPEG video decoder 145 via the demultiplexer 144, and proceeds to step S153.

In step S153, the CPU 149
In step S137 of FIG. 36, the main | base station 1 determines whether the program image data which starts transfer is transmitted.

[0517] In step S153, when it is determined that the program image data from the parent device 1 is transmitted, that is, when the IEEE1394 interface 153 receives the program image data from the parent device 1 and supplies the program image data to the CPU 149. , Proceeds to step S154, and the CPU 149
The program image data is displayed on the CRT 31.

That is, in the present embodiment, in step S137 of FIG. 36, the transmission of the TS packet as the program image data is started from the base unit 1 to the handset 2 as the whole display handset. , In this case, the CPU 149
Base unit 1 received via the IEEE1394 interface 153
The TS packet from the above is supplied to the MPEG video decoder 145 via the demultiplexer 144. MPE
The G video decoder 145 MPEs the TS packet.
G decoding is performed to obtain program image data, and the program image data is written in the frame memory 147. The program image data written in the frame memory 147 is the NTSC encoder 14
It is supplied to the CRT 31 via 8 and displayed.

Thereafter, the process returns to step S153, and the processes of steps S153 and S154 are repeated until it is determined in step S153 that the program image data has not been transmitted from the parent device 1.

[0520] Also, in step S153, the base unit 1
If it is determined that the program image data has not been transmitted from, that is, if the IEEE 1394 interface 153 cannot receive the program image data, the partial enlargement processing ends.

Partial enlargement processing of the parent device in FIG. 36, and FIG.
According to the partial enlargement process of the child device of No. 7, for example, as shown in FIG. 38A, the second part of the scalable TV system is configured.
When the program image data is displayed on the main unit 1 located in the second column of the row, when a certain position P in the program image data is designated as the enlargement position, the enlargement position P becomes the center (center of gravity). Predetermined rectangular area (Fig. 38A)
The range indicated by the dotted line in is set as the expansion range,
As shown in FIG. 38B, partially enlarged image data obtained by enlarging the program image data in the enlargement range is displayed on the parent device 1 instead of the program image data.

[0522] Furthermore, for example, the child device 2 _{21 on} the left side of the parent device 1
38 is selected as the entire display slave unit,
As shown in B, a child device 2 which is a child device for displaying the entire image.
_{At 21} , the entire program image data displayed on the base unit 1 is displayed.

[0523] Therefore, the user can see, in the master unit 1, the portion of the program image data that he / she wants to see in more detail. Further, the user is the slave unit 2
At, the entire program image data can be viewed.
In addition, in the present embodiment, as described above, the user can set the enlargement ratio of the partially enlarged image data by operating the remote controller 15, so that the user can more specifically describe the program image data. You can freely enlarge the part you want to see to the required extent.

[0524] Here, the signal processing unit 1 of the master unit 1 (Fig. 10).
In FIG. 37 (FIG. 22), the expansion range of the program image data is image-converted into partially expanded image data according to the equation (1) using the tap coefficient w _n generated from the coefficient seed data. At first glance, the conversion seems to be a mere interpolation process if attention is paid only to the equation (1). However, as described with reference to FIGS. 24 to 28, the coefficient seed data used to generate the tap coefficient w _n used in Expression (1) is learned by using the teacher data and the student data. The component included in the teacher data can be reproduced by converting the image using the tap coefficient w _n generated from such coefficient seed data. That is, regarding the coefficient seed data for resizing processing, according to the tap coefficient w _n for which the coefficient seed data is generated, it is possible to reproduce the details not appearing in the original image and enlarge the image. . Therefore, the resizing processing as the image conversion processing by the equation (1) generated from the coefficient seed data obtained by learning is completely different from the image enlargement processing by the simple interpolation processing.

The expansion process of the expansion range of the program image data to the partially expanded image data can be performed by using a tap coefficient obtained from the coefficient seed data or by a simple interpolation process. However, if only the interpolation process is used, it is not possible to reproduce the details that the original program image data does not have. Therefore, the larger the enlargement ratio, the more blurry the image in which the block-shaped angular parts are conspicuous. Will be done.

Further, in the present embodiment, partial enlarged image data is displayed on the base unit 1 and the entire program image data is displayed on the handset unit 2. However, the program image data is displayed on the base unit 1. It is also possible to display a part of the enlarged image data on the child device 2 while keeping the display.

Further, in the present embodiment, a part of the enlarged image data is displayed on the base unit 1 and the whole of the program image data is displayed on the handset 2 as the whole display handset. In addition to the display, it is also possible to display the whole of the partially enlarged image data or the program image data on another television receiver which constitutes the scalable TV system.

[0528] Further, the main unit 1 which constitutes the scalable TV system displays the entire program image data, and the slave units 2 _{11 to} 2 ₃₃ as other television receivers have different enlargement ratios. It is possible to display the enlarged image data. In this case, all the partially enlarged image data having different enlargement ratios may be generated in the signal processing unit 137 of the parent device 1 and supplied to each of the child devices 2 _{11 to} 2 _{33 serving} as other television receivers. Yes, and other handset units as television receivers 2 _{11 to} 2 ₃₃
It is also possible for each signal processing unit 157 to generate partially enlarged image data at each enlargement ratio.

Furthermore, in the present embodiment, the coefficient seed data for resizing processing is stored in the parent device 1, but the coefficient seed data for resizing processing is not stored in the parent device 1. In this case, when another television receiver configuring the scalable TV system stores the coefficient seed data for resizing processing, the master unit 1 receives the coefficient seed data for resizing processing from the television receiver. It is possible to obtain. In addition, the coefficient seed data for the resizing process may be acquired from the coefficient seed data providing server as described above.

In the above case, the resizing process for enlarging the program image data is performed, but it is also possible to reduce the program image data in the resizing process.

In the above case, the image data (program image data) as the television broadcast program is enlarged. However, in the partial enlargement processing, other external devices (optical disk device, magneto-optical device) are used. Image data input from a disk device, a VTR, etc.) can be the target of the processing.

Further, in the partial enlargement processing, both the horizontal direction and the vertical direction of the part of the program image data are enlarged by the same enlargement ratio, and the horizontal direction and the vertical direction are respectively enlarged by different enlargement ratios. It can be expanded.

Further, in the present embodiment, the partial enlargement processing is performed only for the enlargement range that can be displayed on the display screen of the CRT 11 in the program image data. It is also possible to target the entire data. In this case, since the entire enlarged image obtained by enlarging the program image data cannot be displayed on the CRT 11, only a part of the enlarged image is displayed. However, which portion of the enlarged image is displayed on the CRT 11? For example, it can be changed according to the operation of the remote controller 15.

[0534] Next, the scalable TV system has a special function of expanding a part of image data and expanding the entire image data as described above. This special function is performed by the master unit 1 and the slave unit. In 2, the whole enlargement process is performed.

The instruction to perform the entire enlargement process can also be issued from the menu screen in the same manner as the instruction to perform the partial enlargement process, for example.

That is, as described above, the user operates the menu button switch 54 of the remote controller 15 (FIG. 7) (or the menu button switch 84 of the remote controller 35 (FIG. 8)).
When is operated, a menu screen is displayed on the CRT 11 of the parent device 1 (or the CRT 31 of the child device 2). On the menu screen, for example, an icon representing the entire enlargement process (hereinafter, the entire enlargement is appropriately added). The icon) is displayed, and the user operates the remote controller 15 to click the entire enlargement icon,
The entire enlargement process is started in each of the parent device 1 and the child device 2.

Therefore, first, with reference to the flowchart in FIG. 39, the overall enlargement process of the parent device will be described.

For example, suppose that the entire enlargement icon is clicked while image data (program image data) as a television broadcast program is being displayed on the CRT 11 of the base unit 1, first, step S1.
At 61, the CPU 129 of the base unit 1 (FIG. 10) is the IE
By controlling the EE1394 interface 133, the coefficient seed data for resizing processing is transmitted to all the slaves that make up the scalable TV system.

Here, in the present embodiment, it is assumed that the coefficient seed memory 167 of the signal processor 137 (FIG. 22) of the parent device 1 stores the coefficient seed data for resizing processing, and the CPU 129 In step S161, the coefficient seed data for resizing processing is read from the signal processing unit 137 and transmitted.

When the main unit 1 does not have the coefficient seed data for the resizing process, as in the case of the partial enlargement process described above, another television receiver which constitutes the scalable TV system. Among these, it is possible to acquire the coefficient seed data for resizing processing or the coefficient seed data for resizing processing from a coefficient seed data providing server.

Then, the flow advances to step S162, and the CPU
The communication unit 129 communicates with all the slave units 2 _{11 to 33} that configure the scalable TV system via the IEEE1394 interface 133 to determine whether or not there is a slave unit 2 _ij that is powered off.

If it is determined in step S162 that there is a slave unit 2 _ij whose power is off, the process proceeds to step S163, where the CPU 129 commands the IEEE1394 interface 133 to turn on the power. The command is transmitted, and thereby the power of the child device 2 _ij whose power is off is turned on, and step S164
Proceed to.

If it is determined in step S162 that there is no slave unit 2 _ij whose power is off, step S163 is skipped, the process proceeds to step S164, and the CPU 129 controls the IEEE1394 interface 133. Accordingly, for all handset 2 ₁₁ to 2 _33, selects the input of the the IEEE1394 interface 153 (FIG. 11), transmits the external input selection command for instructing to display on the CRT 31, step S165
Proceed to.

At step S165, the CPU 129
Initialize the enlargement ratio N to enlarge the program image data to 1,
Further, the maximum expansion rate N _max and the expansion pitch α are set.

That is, in the overall enlargement processing, for example, as shown in FIG.
In the scalable TV system composed of 3 × 3 television receivers shown in FIG. 3, the entire program image data (full screen) displayed on the base unit 1 is mainly on the base unit 1 and other televisions. The image data is gradually expanded over the slave units 2 _{11 to} 2 ₃₃ which are the image receivers, and finally, the image data (enlarged image of the entire program image data is displayed on the entire 3 × 3 television receivers). Hereinafter, the entire enlarged image data will be appropriately displayed).

Therefore, the entire program image data displayed on the base unit 1 is finally enlarged to the entire enlarged image data of a size that can be displayed on the entire television receiver constituting the scalable TV system. that is, the ratio of the the final overall expanded image data, the original program video data (program image data displayed on the base unit 1) is the maximum enlargement factor N _{ma x}
Is set as. That is, in the present embodiment, the program image data displayed on the base unit 1 is enlarged to the entire enlarged image data displayed on the 3 × 3 television receivers. Since it is simply expanded to 3 times, the maximum expansion rate N _max is set to 3 times.

In the overall enlargement process, as described above, the entire program image data displayed on the parent device 1 is gradually enlarged. For example, the program image data is gradually enlarged to a large extent. It can be realized by expanding at a rate N and finally at a maximum expansion rate N _max . Therefore, in this case, it is necessary to gradually change the enlargement ratio N from 1 to the maximum enlargement ratio N _max . The pitch at which the enlargement ratio N is changed is the enlargement pitch α. A value obtained by dividing N _max −1 by a predetermined value of 1 or more (hereinafter, appropriately referred to as an expansion count value) is set.

Here, the enlargement count value can be set in the master unit 1 in advance, or the user can use the remote controller 1
It is also possible to make setting possible by operating 5 (or the remote controller 35). When the enlargement count value is set to a small value, the program image data displayed on the master unit 1 is immediately enlarged to a large overall enlargement image data, and when the enlargement count value is set to a large value, The program image data displayed on the main | base station 1 will be expanded gradually to big whole expansion image data.

After the enlargement ratio N is initialized and the maximum enlargement ratio N _max and the enlargement pitch α are set in step S165, as described above, step S166 is performed.
Then, the CPU 129 newly sets the enlargement factor N to N + α times, and proceeds to step S167.

[0550] Note that a new setting is made in step S166.
The determined expansion rate N is the maximum expansion rate N _maxWhen crossing
CPU 129 sets the enlargement ratio N to the maximum enlargement ratio N_maxSet up
Set.

At step S167, the CPU 129
In the program image data displayed on the base unit 1, an expansion range as a range to be expanded by the signal processing unit 137 and a range to be expanded by the signal processing unit 157 of each slave unit 2 _ij (FIG. 11). The expansion range is obtained based on the expansion rate N set in step S165, and the process proceeds to step S168. In step S168, the CPU 129 causes the CRT 11 of the parent device 1 to operate.
And a display range as a range in which the image data obtained by enlarging the enlarging range of the program image data (hereinafter also referred to as “partially enlarging image data”) is displayed on each CRT 31 of each child device 2 _ij (FIG. 11). To step S165
Obtained based on the enlargement factor N set in step S169.
Proceed to.

Here, referring to FIG. 40, the expansion range of master unit 1 (the range of program image data to be expanded by signal processing unit 137 of master unit 1) and the expansion range of slave unit 2 _ij (slave unit) 2 _ij
Range of program video data to be enlarged by the signal processing unit 157), as well as handset 2 _ij of the display range (subsidiary unit 2 _ij CRT 31
In the above, a calculation method for calculating a partial enlargement image data which is an enlargement of the program image data in the enlargement range of the child device 2 _ij ) based on the enlargement ratio N will be described.

FIG. 40A shows a display screen of a scalable TV system composed of 3 × 3 television receivers.

That is, the display screen of the scalable TV system is the same as the display screen of the CRT 11 of one base unit 1, and
And a display screen by the total nine CRT of the display screen by the handset 2 ₁₁ to 2 ₃₃ of each CRT31 platform. As described above, the display screen sizes of the parent device 1 and the child device 2 _ij are the same.

In the overall enlargement processing, as described above, the entire program image data displayed on the base unit 1 is gradually enlarged, but now, the program image data displayed on the base unit 1 is converted into the image data Q. In addition, the entire enlarged image data obtained by enlarging the image data Q at a predetermined enlargement ratio N is referred to as image data Q ′.

In this case, if the vertical and horizontal lengths of the display screen size of the base unit 1 are represented by a and b, respectively, the vertical and horizontal lengths of the program image data Q are a and b, respectively.

Further, since the overall enlarged image data Q'is the vertical and horizontal lengths of the program image data Q multiplied by N,
The vertical and horizontal lengths are Na and Nb, respectively.

In the overall enlargement process, as described above, the entire program image data Q displayed on the parent device 1 is enlarged as the entire enlarged image data Q ′ centered on the parent device 1 is displayed. 1 and slaves 2 _{11 to} 2 ₃₃ to display the overall enlarged image data Q ′ centered on the master 1, the master 1 displays the enlarged image data Q ′ shown in FIG.
Must display partial enlarged image data in the range indicated by R ₁ in the 0A, the subsidiary unit 2 _ij, R in FIG. 40A
_It is necessary to display partially enlarged image data in the range indicated by _ij .

Therefore, in step S168 of FIG.
The range R ₁ is obtained as the display range of the parent device 1, and the range R _ij is obtained as the display range of the child device 2 _ij .

That is, for the main unit 1, the entire display screen
Body is the display range R₁Is required as. Also, on the left of base unit 1
Upper cordless handset 2₁₁About, the horizontal X on the lower right side of the display screen
The vertical range is ((Nb-b) / 2) × ((Na-a) / 2).
Enclosed range R₁₁Is required as a child device 2 above the parent device 1
₁₂About, the horizontal x vertical on the bottom of the display screen is b x
The range of ((Na-a) / 2) is the display range R₁₂Asked as
To be Furthermore, the child device 2 on the upper right of the parent device 1₁₃about,
Horizontal x vertical on the lower left side of the display screen is ((Nb-b) / 2)
The range of × ((Na-a) / 2) is the display range R₁₃As
The slave unit 2 on the left of the master unit 1_{twenty one}About the display image
The horizontal x vertical on the right side of the plane is ((Nb-b) / 2) xa
Display range R_{twenty one}Is required as. Also, a child device on the right of the parent device
Two_{twenty three}For, the horizontal x vertical on the left side of the display screen is ((N
The range of bb) / 2) × a is the display screen R_{twenty three}Demanded as
And the child device 2 at the lower left of the parent device 1₃₁About its display screen
Horizontal x vertical on the upper right side of ((Nb-b) / 2) x ((Na-
The range of a) / 2) is the display range R ₃₁Is required as. It
In addition, the child device 2 under the parent device 1₃₂About its display screen
The upper x horizontal x vertical is the range of b x ((Na-a) / 2).
Range R₃₂And the child device 2 at the lower right of the parent device₃₃Nitsu
The horizontal x vertical on the upper left side of the display screen is ((Nb-
The display range R is the range of b) / 2) × ((Na-a) / 2).
₃₃Is required as.

[0561] On the other hand, now, the display range R _ij of the display range R ₁ and subsidiary unit 2 _ij of the main unit 1 shown in FIG. 40A, the entire expanded image data Q 'when viewed as a range of the entire enlarged image data Q' Since the image data of the ranges R ₁ and R _ij in FIG. 3 are partially enlarged image data obtained by enlarging a part of the original program image data Q, the display range R ₁ of the parent device 1 and the display range R of the child device 2 _{ij It} is necessary to find the enlargement range as the range of the program image data Q to be enlarged to the partially enlarged image data to be displayed on _ij .

Therefore, in step S167, FIG.
As shown, the scope of the entire enlarged image data Q 'R ₁ and R
corresponding to _ij, of the original program video data Q ranges r ₁ and r _ij
Are obtained as the expansion range of the master unit 1 and the expansion range of the slave unit 2 _ij , respectively.

That is, in the present case, the entire enlarged image data Q ′ of size Nb × Na is obtained by enlarging the program image data Q of size b × a at an enlargement rate of N times. The ranges r ₁ and r of the program image data Q corresponding to the ranges obtained by reducing the ranges R ₁ and R _ij of the enlarged image data Q ′ to 1 / N
_ij is the expansion range of the master unit 1 and the expansion range of the slave unit 2 _ij ,
Each is required.

[0564] Specifically, for base unit 1, the program image
The width x length of the central part of the data Q is b / N x a / N
Expansion range r₁Is required as. In the upper left of the base unit 1,
Cordless handset 2₁₁About, the horizontal x on the upper left side of the program image data Q
Vertical is ((bb-N) / 2) x ((aa-N) / 2)
Range is expanded range r₁₁As the child on the base unit 1
Machine 2₁₂Regarding, the horizontal x vertical of the program image data Q is
The range of (b / N) x ((a-a / N) / 2) is the expanded range
r₁₂Is required as. Furthermore, the child device 2 on the upper right of the parent device 1
₁₃About, the horizontal x vertical on the upper right side of the program image data Q
((B−b / N) / 2) × ((a−a / N) / 2)
Enclosed range r₁₃And the left handset 2 of the base unit 1
_{twenty one}About, the horizontal x vertical on the left side of the program image data Q
The range of ((b-b / N) / 2) x (a / N) is the expanded range
r_{twenty one}Is required as. Also, the child device 2 on the right side of the parent device_{twenty three}Nitsu
In addition, the horizontal x vertical on the right side of the program image data Q is ((bb
/ N) / 2) × (a / N) range is the display screen R_{twenty three}As
Required, child device 2 at the lower left of base device 1 ₃₁About the program picture
The horizontal x vertical on the lower left side of the image data Q is ((b-b / N) / 2)
The range of x ((a-a / N) / 2) is the expanded range r₃₁As
Desired. Furthermore, the child device 2 under the parent device 1₃₂about
Is the lower horizontal x vertical (b / N) x of the program image data Q.
The range of ((a-a / N) / 2) is the expanded range r₃₂As
The slave unit 2 at the bottom right of the master unit₃₃About the program image
On the lower right side of the data Q, the width x length is ((b-b / N) / 2) x
The range of ((a-a / N) / 2) is the expanded range r₃₃As
Can be

Returning to FIG. 39, in step S169, C
By controlling the IEEE1394 interface 133, the PU 129 uses the coefficient seed data for resizing processing transmitted in step S161 to execute a resizing process for enlarging the image data and display the enlarged display command. The image data, the enlargement ratio N, the enlargement range, and the display range are transmitted to each child device 2 _ij .

Here, for the program image data, the CPU 129 requests the demultiplexer 124 for the TS packet supplied to the MPEG video decoder 125 in the transport stream, and in response to the request, the demultiplexer 124. It receives the TS packet supplied from and sends it to each slave unit 2 _ij .

[0567] Also, CPU 129, for the larger range and display range, the larger range and the display range determined for each child device 2 _ij, and transmits to the handset 2 _ij.

In the CPU 129, each slave unit 2
_ij is not a TS packet but a frame memory 127
It is also possible to read out the program image data stored in, that is, the image data after MPEG decoding through the signal processing unit 137 and transmit it. In this case, it is not necessary for each slave unit 2 _ij to MPEG-decode the program image data.

Also, in this way, after MPEG decoding
The program image data is the slave unit 2_ijWhen sending to
Not the entire image data, but the child of the program image data
Machine 2 _ijSend only the extent of expansion requested for
It is possible to do so.

After that, the process proceeds to step S170, and the CPU
The parameter 129 sets the parameter z corresponding to the enlargement factor N set in step S166 in the parameter memory 168 of the signal processing unit 137 (FIG. 22), and proceeds to step S171.

[0571] In step S171, the CPU 129 determines that
By controlling the signal processing unit 137 (FIG. 22), the expansion of the same program image data stored in the frame memory 127 and transmitted to each slave unit 2 _ij in step S169, obtained for the master unit 1 is obtained. Image conversion processing is performed on the range r ₁ (FIG. 40B).

That is, in the present embodiment, coefficient seed data for resizing processing is stored in the coefficient seed memory 167 which constitutes the signal processor 137 (FIG. 22) of the master unit 1,
The signal processing unit 137 calculates the expansion range r ₁ of the program image data stored in the frame memory 127 as the coefficient seed memory 16
By performing image conversion processing using the coefficient seed data for resizing processing stored in No. 7 and the tap coefficient generated from the parameter z stored in the parameter memory 168, the program image data of the expansion range r ₁ The image data is converted into partially enlarged image data as image data enlarged (resized) at the enlargement ratio N.

Further, at this time, the CPU 129 determines that the partially enlarged image data is in the main unit 1 in the display screen of the CRT 11.
The signal processing unit 137 is controlled so that it is displayed in the position of the display range R ₁ (FIG. 40A) obtained for That is, as a result, in the signal processing unit 137, the partially enlarged image data is displayed in the display screen of the CRT 11 as the main unit 1.
The display position is adjusted so that it is displayed at the position of the display range R ₁ (FIG. 40A) obtained for.

As for the main unit 1, since the display range R ₁ matches the display screen size of the CRT 11 as described in FIG. 40, the display position of the partially enlarged image data is actually set. No need to adjust.

[0575] In step S172, the signal processing unit 1
37 supplies the partially enlarged image data obtained in step S171 to the CRT 11 via the frame memory 127 and the NTSC encoder 128 to display it.

Therefore, in this case, in the CRT 11 of the base unit 1, the expanded range r of the program image data is displayed on the entire display screen.
Partially enlarged image data obtained by enlarging ₁ by the enlargement factor N is displayed.

Thereafter, the flow advances to step S173, and the CPU
129 determines whether the enlargement ratio N is less than the maximum enlargement ratio N _max . When it is determined in step S173 that the enlargement ratio N is less than the maximum enlargement ratio N _max ,
The process proceeds to step S166, and the same process is repeated thereafter.

If it is determined in step S173 that the enlargement ratio N is not less than the maximum enlargement ratio N _max ,
That is, in step S166, the enlargement ratio N is the maximum enlargement ratio N.
If it is set to _max , the process proceeds to step S174, and the CP
U129, as in the case of step S169,
By controlling the IEEE1394 interface 133,
The enlargement display command is transmitted to the respective slaves 2 _ij , the program image data, the enlargement ratio N, the enlargement range, and the display range, and the process proceeds to step S175.

[0579] In step S175, the CPU 129 determines that
By controlling the signal processing unit 137 (FIG. 22), expansion of the same program image data stored in the frame memory 127 and transmitted to each slave unit 2 _ij in step S174, obtained for the master unit 1 is obtained. Image conversion processing is performed on the range r ₁ (FIG. 40B).

[0580] That is, as a result, in step S175, as in step S169, the signal processing unit 137 stores the expansion range r ₁ of the program image data stored in the frame memory 127 in the coefficient seed memory 167. By performing image conversion processing using the coefficient seed data for resizing processing and the tap coefficient generated from the parameter z stored in the parameter memory 168, the program image data in the expansion range r ₁ is expanded at the expansion rate N. Converted to partially enlarged image data as enlarged (resized) image data.

This partially enlarged image data is obtained in step S1.
At 76, as in step S172, frame memory 127 and NTSC encoder 1
It is supplied to the CRT 11 via 28 and displayed.

Here, since the enlargement ratio N, the enlargement range, and the display range transmitted to each child device 2 _ij in step S174 are obtained respectively in the last performed steps S166 to S168, the enlargement ratio is N is the maximum expansion rate N _max . Further, the enlargement range and the display range are obtained for the enlargement ratio N that is the maximum enlargement ratio N _max .

Therefore, in this case, the enlargement range and the display range of the parent device 1 are also obtained for the enlargement ratio N that is the maximum enlargement ratio N _max .

When the image conversion process of step S175 is performed, the maximum expansion rate N _max is stored in the parameter memory 168 of the signal processing unit 137 (FIG. 22) by the process of step S170 performed last. The corresponding parameter z has been set.

[0585] From the above, a part of step S176, the program image data of the enlarged range r ₁ obtained for the enlargement factor N which is the maximum enlargement ratio N _max, obtained by enlarging the maximum enlargement ratio N _max The enlarged image data has the display range R ₁ obtained for the enlargement ratio N that is the maximum enlargement ratio N _max (as described above, for the master device 1, CR
(Equal to the display screen of T11).

Thereafter, the flow advances to step S177, and the CPU
Reference numeral 129 determines whether or not a command for ending the display of the entire enlargement image data (hereinafter, appropriately referred to as an entire enlargement end command) has been transmitted.

If it is determined in step S177 that the overall enlargement end command has not been transmitted, the process returns to step S174, and the same processing is repeated thereafter. Therefore, in this case, the master device 1 has the maximum expansion rate N _max.
Display of the partially enlarged image data enlarged by is continued.

If it is determined in step S177 that the overall enlargement end command has been transmitted, that is, for example, the user operates the remote controller 15 (FIG. 7) to cause the CRT 11 to display the menu screen,
Further, the whole enlargement icon on the menu screen is clicked again, whereby the infrared ray of the whole enlargement end command, which is a command corresponding to the operation of the remote controller 15, is emitted from the remote controller 15 and received by the IR receiving unit 135. If supplied to the CPU 129, step S1
Proceeding to 78, the image conversion processing in the signal processing unit 137 is ended, and the entire enlargement processing of the parent device 1 is ended. As a result, the program image data stored in the frame memory 127 is directly transmitted to the CSC via the NTSC encoder 128 as it is.
The program image data is supplied to the RT 11, and the program image data is displayed in the normal size on the CRT 11.

Next, with reference to the flow chart of FIG. 41, an explanation will be given of the overall enlargement processing of the slave unit which is carried out by each slave unit 2 _ij constituting the scalable TV system.

In the child device 2 _ij (FIG. 11), first, in step S181, the CPU 149 waits for the coefficient seed data for resizing processing to be transmitted from the parent device 1 in step S161 of FIG. , And receives the coefficient seed data via the IEEE1394 interface 153.
Further, in step S181, the CPU 149 converts the received coefficient seed data for resizing processing into the signal processing unit 15
7 (FIG. 29) and set it in the coefficient seed memory 207. At that time, the signal processing unit 157 saves the coefficient seed data originally stored in the coefficient seed memory 207 in the empty area of the EEPROM 157B in advance.

Here, when the coefficient seed 207 for resizing processing is stored in the coefficient memory 207 which constitutes the signal processing unit 157 of the child device 2 _ij , the above-mentioned step S181,
The processing of step S188 described later can be skipped.

After that, the process advances to step S182, and the CPU
149 determines whether the parent device 1 has received the external input selection command transmitted in step S164 of FIG. 39, and if it has not received the external input selection command, step S182.
Return to.

[0593] Also, in step S182, the main unit 1
When it is determined that the external input selection command from the base unit 1 is received, that is, the IEEE1394 interface 153 receives the external input selection command from the base unit 1, and the CPU 1
If it is supplied to 49, the process proceeds to step S183 and the CP
The U 149 selects the program image data received by the IEEE1394 interface 153 and supplies it to the MPEG video decoder 145 via the demultiplexer 144, and proceeds to step S184.

At step S184, the CPU 149
Whether or not the program image data, the enlargement ratio N, the enlargement range r _ij , and the display range R _ij are transmitted from the base unit 1 together with the enlargement display command is determined.

[0595] In step S184, from the base unit 1,
When it is determined that the program image data, the enlargement ratio N, the enlargement range r _ij , and the display range R _ij are transmitted together with the enlargement display command, that is, the IEEE1394 interface 1
In 53, when the enlarged display command from the base unit 1, the program image data, the enlargement ratio N, the enlarged range r _ij , and the display range R _ij are received and supplied to the CPU 149,
The CPU 149 follows the enlarged display command,
The enlargement range r _ij of the program image data transmitted together with the enlargement display command is enlarged by the enlargement ratio N, and the partially enlarged image data obtained as a result is displayed in the display range R _ij on the display screen of the CRT 31. Perform processing.

That is, in this case, steps S184 to S184
In step 185, the CPU 149 sets the parameter z corresponding to the enlargement ratio N received together with the enlargement display command in the parameter memory 208 of the signal processing unit 157 (FIG. 29), and proceeds to step S186.

In step S186, the CPU 149
By controlling the signal processing unit 157 (FIG. 29), the expansion range r _ij (FIG. 40B) of the program image data stored in the frame memory 147, which is received together with the expansion display command, is obtained for the slave unit 2 _ij . The target image conversion process is performed.

That is, in the present embodiment, in steps S169 and S174 of FIG. 39, the base unit 1 transmits the TS packet as the program image data together with the enlarged display command to the handset 2 _ij . ,in this case,
The CPU 149 supplies the TS packet from the base unit 1 received via the IEEE1394 interface 153 to the MPEG video decoder 145 via the demultiplexer 144. The MPEG video decoder 145 uses the TS
The packet is MPEG-decoded to obtain program image data and written in the frame memory 147.

On the other hand, the signal processing unit 157 (FIG. 2) of the child device 2 _ij .
9), the coefficient seed memory 207 is stored in the step S1.
At 81, coefficient seed data for resizing processing is set, and the signal processing unit 157 sets the expansion range r _ij of the program image data stored in the frame memory 147 for resizing processing stored in the coefficient seed memory 207. Coefficient seed data,
By performing image conversion processing using the tap coefficient generated from the parameter z stored in the parameter memory 208, the program image data in the expansion range r _ij is expanded at the expansion rate N.
Is converted into partially enlarged image data as image data enlarged (resized) by.

Further, at this time, the CPU 149 determines that the partially enlarged image data is the slave unit _ij in the display screen of the CRT 31.
The signal processing unit 157 is controlled so that it is displayed in the position of the display range R _ij (FIG. 40A) obtained for That is, as a result, in the signal processing unit 157, the partially enlarged image data is displayed on the display screen of the CRT 31 as a slave unit 2.
The display position is adjusted so that it is displayed at the position of the display range R _ij (FIG. 40A) obtained for _ij .

[0601] Specifically, for example, in the cordless handset 2 ₁₁ shown in FIG.
As shown in 0A, the partially enlarged image data is
The display position of the partially enlarged image data is adjusted so that it is displayed in the lower right display range R ₁₁ in the display screen of T31.

In this case, in the cordless handset 2 ₁₁ , the CRT 3
The image data in the range other than the display range R ₁₁ on the display screen No. 1 is, for example, the black level. The same applies to the other child devices 2 _ij .

[0603] In step S187, the signal processing unit 1
57 supplies the partially enlarged image data obtained in step S186 to the CRT 31 via the frame memory 147 and the NTSC encoder 148 to display it.

Thereafter, the process returns to step S184, and
The processing of steps S184 to S187 is repeated.

[0605] On the other hand, in step S184, the main unit 1
If it is determined that the program image data, the enlargement ratio N, the enlargement range r _ij , and the display range R _ij are not transmitted together with the enlargement display command, that is, in the IEEE1394 interface 153, the enlargement display command and the program image are displayed. Data, magnification N, magnification range r _ij , and display range R
_{If ij} can no longer be received, step S1
Proceeding to 88, the signal processing unit 157 determines that the EEPROM 157
The original coefficient seed data saved in B is reset in the coefficient seed memory 207 (FIG. 29), and the entire enlargement process of the child device is completed.

[0606] The entire enlarging process of the parent device in Fig. 39, and Fig. 4
According to the overall enlargement processing of the first slave unit, for example, as shown in FIG.
When the program image data is displayed on the parent device 1 located in the second column of the row, the entire program image data displayed on the parent device 1 is centered on the parent device 1 as shown in FIG. 42B. , And gradually expanded over the slave units 2 _{11 to} 2 ₃₃ ,
Finally, as shown in FIG. 42C, 3 × 3 base units 1
And the whole of the wireless handset 2 ₁₁ to 2 _33, the entire expanded image data obtained by enlarging the whole of the program image data is to be displayed.

Therefore, the user can see the entire program image data by enlarging the entire program image data in detail.

However, in a scalable TV system, in reality, since there is a casing of a television receiver which constitutes the scalable TV system, the adjacent portion between adjacent television receivers is a casing. Yes, no image is displayed in that part. That is, in FIG.
In order to simplify the drawing, the housing portion existing between adjacent television receivers is omitted. However, in reality, a housing exists between adjacent television receivers, and therefore, the entire magnified image data is not displayed on the housing portion of the television receiver, although slightly. So to speak, there is a problem that they are separated.

However, in human vision, even if a part of the image has a line with a very small width that obstructs viewing, the image hidden by the line is interpolated from the surrounding images. Since there is an action, the above-mentioned problems are
This is not a big problem when viewing the entire enlarged image data.

In the entire enlargement process, as in the case of the partial enlargement process, the image conversion process is performed using the coefficient seed data for the resizing process to obtain the entire enlargement image data, and simple interpolation is performed. By the processing, it is possible to obtain the entire enlarged image data obtained by enlarging the program image data.

However, the entire enlarged image data obtained by enlarging the entire program image data in detail can be seen because the signal processing units 137 and 157 use the coefficient seed data for resizing processing to perform image conversion. This is the case where the processing is performed, and when the program image data is enlarged by simple interpolation processing, the entire enlarged image data can be seen, but details thereof are not reproduced. That is, in the case of simple interpolation processing, compared to the case of image conversion processing using coefficient seed data for resizing processing, it is possible to see only the overall enlarged image data whose image quality is greatly degraded.

Here, in the present embodiment, the special function is provided only when the authentication described in FIGS. 31 and 33 is successful. However, even when the authentication fails, the special function is provided. Can be provided, so to speak, with restrictions.

That is, for example, when the authentication is successful,
It is possible to provide whole enlarged image data by image conversion processing using coefficient seed data for resizing processing, and to provide whole enlarged image data by simple interpolation processing when authentication fails. .

In this case, the scalable TV system is
A user configured with a television receiver that is neither a master unit nor a slave unit can see the entire enlarged image data, but since the entire enlarged image data is simply an interpolation process, a coefficient for resizing processing is used. Compared with the case of the image conversion processing using the seed data, the image quality is considerably deteriorated.

On the other hand, a user who configures a scalable TV system using a television receiver that is a master or a slave receives a high image quality by image conversion processing using coefficient seed data for resizing processing. You can see the whole enlarged image data of.

As a result, the scalable TV system is
For users who are using a television receiver that is neither a master unit nor a slave unit, an incentive to purchase a television receiver that is a master unit or a slave unit works in order to view high-quality overall enlarged image data. It will be.

[0617] In the present embodiment, the entire program image data displayed on the base unit 1 is enlarged to the entire enlarged image data of a size that can be displayed on the entire television receiver constituting the scalable TV system. The maximum enlargement ratio N _max is set as the maximum enlargement ratio N _max.
max is set by the user using the remote controller 15 (or the remote controller 3).
By operating 5), it is possible to set to any value.

In this case, the maximum enlargement ratio N _max is a value for enlarging the program image data to image data larger than the entire enlarged image data of a size that can be displayed on the entire television receiver constituting the scalable TV system. (Hereinafter, it may be appropriately referred to as a non-specified maximum enlargement ratio), and the entire enlarged image data expanded at the non-specified maximum enlargement ratio cannot be displayed on the scalable TV system in its entirety. . That is, the whole enlarged image data enlarged at the non-specified maximum enlargement ratio can display only a part thereof. In this case, which portion of the entire enlarged image data enlarged at the non-specified maximum enlargement ratio is to be displayed can be set by the user, for example, by operating the remote controller 15 (or the remote controller 35). it can.

In the above case, the scalable TV
In each television receiver that constitutes the system, a part of enlarged image data to be displayed on the television receiver is generated, but a portion to be displayed on each television receiver that configures the scalable TV system. The enlarged image data can be generated, for example, in one or a plurality of television receivers such as the base unit 1. That is, for example, the master device 1 generates whole enlarged image data, and partially enlarged image data which is a part of the whole enlarged image data is transmitted to each of the slave devices 2 _ij via the IEEE1394 interface 133. It is possible to do so. However, in this case, the base unit 1 needs to generate the partially enlarged image data to be displayed by itself as well as the partially enlarged image data to be displayed by each of the slave units 2 _ij which are other television receivers. Therefore, the processing load is heavy.

Further, in the above-mentioned case, the image data (program image data) as the television broadcast program is enlarged. However, even in the whole enlargement process, as in the case of the partial enlargement process, an external device is used. Image data input from can be targeted for the processing.

Further, in the whole enlargement processing, as in the case of the partial enlargement processing, it is of course possible to enlarge both the horizontal direction and the vertical direction of a part of the program image data by the same enlargement ratio, as well as the horizontal direction. It is also possible to enlarge each of the and vertical directions by different enlargement ratios.

Further, in the above-mentioned case, in the scalable TV system composed of 3 × 3 television receivers, the image data displayed on the main unit 1 arranged at the center thereof is arranged around it. The entire enlarged image data that is enlarged in the respective directions of the respective cordless handsets 2 _ij (upper left, left, lower left, upper, lower, upper right, right, lower right) are displayed. For example, cordless handset 2 arranged at the lower left
_The image data displayed in ₃₁ has the child device 2 ₂₁ arranged thereon, the parent device 1 arranged at the upper right, and the child device 2 arranged at the right.
It is also possible to display the entire magnified image data that is magnified in each of the ₃₂ directions.

Further, in the above-described case, in the parent device 1 and each child device 2 _ij , the user operates the remote controller 15 to issue an instruction to perform the entire enlargement process, and then the entire enlarged image data ( However, in the master unit 1 and each slave unit 2 _ij , the scaling factor N is always 1 + α, 1 + 2α, 1 + 3α, ...
_.. , when there is a command to generate N _max times the entire enlargement image data and perform the entire enlargement processing, the enlargement ratio N is immediately 1 + α, 1 + 2α, 1 + 3α ,.
.., it is also possible to sequentially display N _max times the entire enlarged image data.

Next, the scalable TV system has a special function of displaying image data, that is, a so-called multi-screen display, on the entire television receiver which constitutes the scalable TV system. It is realized by performing a multi-screen display process in the parent device 1 and the child device 2.

The instruction to perform the multi-screen display processing is also
For example, like the instruction to perform the partial enlargement process or the entire enlargement process, it can be performed from the menu screen.

That is, as described above, the user operates the menu button switch 54 of the remote controller 15 (FIG. 7) (or the menu button switch 84 of the remote controller 35 (FIG. 8)).
When is operated, a menu screen is displayed on the CRT 11 of the master device 1 (or the CRT 31 of the slave device 2). On the menu screen, for example, an icon representing the multi-screen display process (hereinafter, the A screen display icon) is displayed, and the user operates the remote controller 15 to click the multi-screen display icon, and the multi-screen display process is performed in each of the master unit 1 and the slave unit 2. Is started.

[0627] Therefore, the multi-screen display processing of the parent device will be described with reference to the flowchart in Fig. 43.

Here, in the multi-screen display processing, FIG.
As shown in C, the program image data is displayed on the entire television receiver which constitutes the scalable TV system. Therefore, the multi-screen display process of the parent device 1 is substantially equivalent to the entire enlargement process of FIG. 39 in which the enlargement ratio N is fixed to the maximum enlargement ratio N _max and the enlargement pitch α is ignored.

Therefore, in the multi-screen display process of the master unit 1, the same processes as in steps S161 to S164 of FIG. 39 are performed in steps S191 to S194, respectively.

Then, the flow advances to step S195, and FIG.
In the same way as in step S165 of
Large N_maxIs set, and the process proceeds to step S196. Ste
In step S196, the CPU 129 of the parent device 1 (FIG. 10) is
Is the expansion rate N, and the maximum expansion rate N _maxSet to step
Proceed to S197.

[0631] In step S197, the CPU 129 determines that
Based on the enlargement ratio N for which the maximum enlargement ratio N _max is set,
And expanding the range r ₁ of the program video data in the main unit 1, expanded range r of the program video data in each slave 2 _{i j} (Fig. 11)
_ij is obtained in the same manner as in step S167 of FIG. 39, and the process proceeds to step S198.

Here, in the overall enlargement processing of FIG. 39, in addition to obtaining the enlargement range in step S167, step S168 is performed.
The display range is also obtained with, but the enlargement ratio N is the maximum enlargement ratio N _max.
, The display range R ₁ of the base unit ₁ is the CRT.
11 is a display entire screen, also, the display range R _ij handset 2 _ij is also considered because it is the entire display screen of the CRT 31, and known in advance, it is not necessary to obtain (or, to be determined in advance be able to). Therefore, in the multi-screen display process, the display range R ₁ of the master unit 1 and the display range R _ij of the slave unit 2 _ij are not _calculated again.

[0633] In step S198, the CPU 129 determines that
In the same manner as in step S170 of FIG. 39,
The parameter z corresponding to the enlargement ratio N for which the maximum enlargement ratio N _max is set is set in the parameter memory 168 of the signal processing unit 137 (FIG. 22).

Then, the process proceeds to steps S199 to S201 in sequence, and the same processing as in steps S174 to S176 of FIG. 39 is performed, respectively.
On base unit 1, partially enlarged image data enlarged at maximum enlargement ratio N _max is displayed.

Thereafter, the flow advances to step S202, and the CPU
129 is a command for ending the multi-screen display (hereinafter,
It is appropriately determined whether a multi-screen display end command) has been transmitted.

[0636] If it is determined in step S202 that the multi-screen display end command has not been transmitted, the process returns to step S199, and the same processing is repeated thereafter. Therefore, in this case, the base unit 1 continues to display the partially enlarged image data enlarged at the maximum enlargement rate N _max .

If it is determined in step S202 that the multi-screen display end command has been transmitted, that is, for example, the user operates the remote controller 15 (FIG. 7) to display the menu screen on the CRT 11. Further, the multi-screen display icon on the menu screen is re-clicked, whereby the infrared ray of the multi-screen display end command which is a command corresponding to the operation of the remote controller 15 is emitted from the remote controller 15, and I
When received by the R reception unit 135 and supplied to the CPU 129, the process proceeds to step S203, the image conversion process in the signal processing unit 137 ends, and the multi-screen display process of the parent device 1 ends. As a result, the program image data stored in the frame memory 127 is directly supplied to the CRT 11 via the NTSC encoder 128, and the CRT 11 displays the program image data in a normal size.

[0638] Incidentally, handset 2 _ij multi-screen display processing (multi-screen display processing subsidiary unit 2 _ij is performed) are the same as the overall enlargement process of the slave unit 2 _ij as described in FIG. 41, a description thereof will be , Omitted.

[0639] Next, the scalable TV system has a special function that causes each of the television receivers that compose the scalable TV system to perform the same processing. It is realized by performing a control process.

The instruction to perform the batch simultaneous control process can be also issued from the menu screen similarly to the instruction to perform the partial enlargement process, for example.

That is, as described above, the user operates the menu button switch 54 of the remote controller 15 (FIG. 7) (or the menu button switch 84 of the remote controller 35 (FIG. 8)).
When is operated, a menu screen is displayed on the CRT 11 of the parent device 1 (or the CRT 31 of the child device 2). On the menu screen, for example, an icon (hereinafter, referred to as a batch The simultaneous control icon) is displayed, and the user operates the remote controller 15 to click the collective control icon to start the collective control process on the master device 1.

Now, the batch simultaneous control process of the master unit will be described with reference to the flowchart of FIG.

In the batch simultaneous control process, the main unit 1 (FIG. 10)
CPU 129 of remote controller 15 (or remote controller 2
5) is operated to wait for the input of a command instructing a predetermined process, that is, the IR receiving unit 15
At, the infrared rays corresponding to a predetermined command from the remote controller 15 are received and supplied to the CPU 129, and the command is received in step S211. Further, in step S211, the CPU 129
Performs the process corresponding to the command, and executes step S2
Proceed to 12.

[0644] In step S212, the CPU 129 determines that
Among the television receivers constituting the scalable TV system, the slave unit 2 _ij capable of performing the process corresponding to the command corresponding to the operation of the remote controller 15 (hereinafter, appropriately referred to as remote controller command) received in step S211 is one of the television receivers constituting the scalable TV system. Exists in the.

Note that the determination processing in step S212 is C
Each PU 2 has a PU 129 stored in the EEPROM 130.
_This is done by referring to the function information of _ij .

[0646] If it is determined in step S212 that there is a child device 2 _ij capable of performing the process corresponding to the remote control command, the process proceeds to step S213 and the CP
By controlling the IEEE1394 interface 133, the U 129 transmits the remote control command to all the slaves 2 _ij that can perform the process corresponding to the remote control command.

Therefore, for example, now, a scalable TV
All handset 2 _ij constituting the system, as long as it can perform the processing corresponding to the remote control command to all the slave unit 2 _ij, the remote control command is sent, the child devices 2 _ij, the remote control command Processing corresponding to
That is, the same processing as that performed by the parent device 1 in step S211 is performed.

[0648] On the other hand, in step S212, the slave unit 2 _ij capable of performing the process corresponding to the remote control command.
If it is determined that the CPU 129 does not exist, step S213 is skipped, the process proceeds to step S214, and the CPU 129
Determines whether or not a command for ending the collective simultaneous control processing (hereinafter, appropriately referred to as collective simultaneous control end command) has been transmitted.

If it is determined in step S212 that the batch simultaneous control end command has not been transmitted, the remote controller 15 is operated to input a command (remote command) for instructing a predetermined process. After waiting, the process returns to step S211, and the same processing is repeated thereafter.

If it is determined in step S212 that the batch simultaneous control end command has been transmitted, that is, for example, the user operates the remote controller 15 (FIG. 7) to display the menu screen on the CRT 11. , And then re-click the batch simultaneous control icon on the menu screen, and the remote control 1
When the infrared ray of the batch simultaneous control end command, which is the command corresponding to the operation of 5, is emitted from the remote controller 15, received by the IR receiving unit 135, and supplied to the CPU 129, the batch simultaneous control process is ended.

According to the collective simultaneous control process, for example, if all the _slaves 2 _ij constituting the scalable TV system are now capable of performing the process corresponding to the remote control command, the user can operate the remote control 15 For example, when it is instructed to select a certain channel by operating, as shown in FIG. 45A, it is broadcast on that channel in all of the parent device 1 and the child device 2 that configure the scalable TV system. Image data is displayed. Further, when the user operates the remote controller 15 to instruct to switch to another channel, as shown in FIG. 45B, channel switching is performed in all of the parent device 1 and the child device 2 that configure the scalable TV system. Is done.

Therefore, the user can simultaneously control all the television receivers constituting the scalable TV system in the same manner with one remote controller 15.

Next, as described above, it is possible to attach the remote controller 15 to the master unit 1 and the remote controller 35 to each slave unit 2 _ij . Further, as described above, the base unit 1 is
Can be controlled by the slave unit 2 _ij remote control 35, subsidiary unit 2 _ij, nor by its remote controller 35, it can also be controlled by the remote control 15 of the main unit 1.

Therefore, all the television receivers constituting the scalable TV system can be controlled by only one remote controller 15 (or 35).

However, in order to separately control each of the plurality of television receivers with only one remote controller 15, for example, the remote controller 15 is set with the device ID of each of the plurality of television receivers. Prior to performing the operation of inputting the desired command, it is necessary to perform an operation to specify the television receiver to be controlled, such as the operation of inputting the device ID of the television receiver to be controlled, which is troublesome. Is.

[0656] Therefore, a method for controlling the base unit 1, the remote control 15 associated therewith, the control of each child device 2 _ij, again, the remote controller 35 associated with each child device 2 _ij, so as respectively used There is.

However, this method requires a large number of remote controllers of 9 units to individually control each of the television receivers constituting the scalable TV system of FIG. 1A. Further, in this case, it may be difficult to know at first glance which remote controller controls which television receiver.

Therefore, among the master set 1 and each slave set 2 _ij that make up the scalable TV system, the television receiver controlled by the user is the remote controller 15 of the master set 1 and the remote control unit 35 of each slave set 2 _ij . It would be convenient if the user could control by using any of the remote controls without performing the operation of specifying the television receiver to be controlled.

Therefore, in the scalable TV system, the user recognizes the television receiver to be controlled, and the television receiver to be controlled is controlled by the remote controller 1
5 (or the remote controller 35) has a special function that can be controlled, and this special function is realized by performing individual processing in the master unit 1 and the slave unit 2.

The instruction to perform the individual processing can be issued from the menu screen, for example.

That is, as described above, the user operates the menu button switch 54 of the remote controller 15 (FIG. 7) (or the menu button switch 84 of the remote controller 35 (FIG. 8)).
When is operated, a menu screen is displayed on the CRT 11 of the parent device 1 (or the CRT 31 of the child device 2). On this menu screen, for example, an icon representing individual processing (hereinafter, as appropriate, individual processing icon Is displayed, and the user operates the remote controller 15 to click this individual processing icon,
Individual processing is started in each of the parent device 1 and the child device 2.

[0662] Then, first, the individual processing of the parent device 1 will be described with reference to the flowchart in Fig. 46.

In the individual processing of the master unit 1 (FIG. 10), the CPU
129 is a remote controller 15 in the IR receiver 135.
(Or remote controller 35) waits until the infrared ray is received, and in step S221, the IR receiver 135
To detect the infrared reception intensity at. That is, when the user operates the remote controller 15 to control a control target of a certain television receiver constituting the scalable TV system, the remote controller 15 operates as follows.
Infrared rays corresponding to the operation are emitted. This infrared ray
The IR receiving unit 135 of the master unit 1 and each slave unit 2 _ij (see FIG. 1).
The light is received by the IR receiving unit 155 of 1), but in step S2
In 21, the CPU 129 causes the IR receiving unit 135 to detect the infrared reception intensity and receives the supply.

Then, the flow advances to step S222, and the CPU
129 via the IEEE1394 interface 133, to each child device 2 _ij, requests the reception intensity of the infrared rays from the remote controller 15 in each child device 2 _ij, in response to the request, transmitted from the child devices 2 _ij The reception intensity of the incoming infrared rays is acquired (received) via the IEEE1394 interface 133.

That is, as described above, when the user operates the remote controller 15, the infrared rays emitted by the remote controller 15 are received not only by the master unit 1 but also by the slave units 2 _ij , but in step S222. , The reception intensity of the infrared ray at each slave unit 2 _ij is acquired.

[0666] After that, the flow advances to step S223, and the CPU
Reference numeral 129 denotes the infrared reception intensity of the master unit 1 detected in step S221 and each slave unit 2 acquired in step S222.
_The maximum reception intensity (maximum reception intensity) is detected from the infrared reception intensity at _ij , and the process proceeds to step S224.

[0667] In step S224, the CPU 129 determines that
It is determined whether the television receiver (hereinafter, appropriately referred to as the maximum reception intensity device) that has obtained the maximum reception intensity is the master device 1 or the slave device 2.

If it is determined in step S224 that the maximum reception strength device is the master unit 1, step S22
Proceeding to step 5, the CPU 129 determines that the command represented by the infrared ray received by the IR receiving unit 135 is for the master unit 1, and executes the process corresponding to the command.

On the other hand, when it is determined in step S224 that the maximum reception strength device is the slave unit 2, the process proceeds to step S226, and the CPU 129 controls the IEEE1394 interface 133 so that the IR reception unit 135 receives the light. Assuming that the command represented by the infrared ray is for the slave unit 2 _ij that is the maximum reception strength device, the command is transmitted to the slave unit 2 _ij that is the maximum reception strength device.

Therefore, in this case, the slave unit 2 _ij , which is the maximum reception strength device, performs the process corresponding to the command represented by the infrared ray from the remote controller 15, as described later with reference to FIG. 47.

Here, when the user operates a remote controller 15 (or remote controller 35) to control a certain television receiver that constitutes the scalable TV system, the remote controller 15 is generally operated. , Toward the television receiver that is the control target.

In this case, for example, now, the remote controller 15
If the infrared rays emitted by (or the remote controller 35) have strong directivity, the television receiver that the user intends to control is in the direction of the main axis of the infrared rays emitted by the remote controller 15, that is, This means that it is a maximum reception intensity device that has the highest infrared reception intensity.

[0673] Therefore, as described above, by executing the process corresponding to the command represented by the infrared ray from the remote controller 15 in the maximum reception intensity device, the user can control the television receiver, that is, the maximum reception intensity device. At, the processing corresponding to the operation of the remote controller 15 by the user is performed.

[0674] Specifically, for example, when the user directs the remote controller 15 toward the master unit 1 to perform a channel operation or a volume operation, the master unit 1 becomes the maximum reception strength device, and as a result, the maximum reception strength is obtained. In the parent device 1 which is the device, the channel and the volume are changed according to the operation. Further, for example, when the user directs the remote controller 15 to a certain handset 2 _ij and performs a channel operation or volume operation, the handset 2 _ij becomes the maximum reception strength device, and as a result, the maximum reception strength device. In slave unit 2 _ij , in response to the operation,
The channel and volume are changed.

After the processing of steps S225 and S226, the process proceeds to step S227 and CPU 129 is executed.
Determines whether a command for ending the individual processing (hereinafter, appropriately referred to as an individual processing end command) has been transmitted.

If it is determined in step S227 that the individual processing end command has not been transmitted, the infrared rays emitted by the operation of the remote controller 15 are waited for by the IR receiving section 135, Returning to step S221, the same processing is repeated thereafter.

If it is determined in step S227 that the individual processing end command has been transmitted, that is, for example, the user operates the remote controller 15 (FIG. 7) to cause the CRT 11 to display the menu screen,
Further, the individual processing icon on the menu screen is clicked again, whereby the infrared ray of the individual processing end command, which is a command corresponding to the operation of the remote controller 15, is emitted from the remote controller 15 and received by the IR receiving unit 135. If supplied to the CPU 129, step S2
In step 28, the CPU 129 controls the IEEE1394 interface 133 to transmit an individual process end command to each slave unit 2 _ij , and ends the individual process of the master unit 1.

Individual processing of the child device will be described below with reference to the flowchart of FIG.

In the individual processing of the child device 2 (FIG. 11), the CPU
149 is a remote controller 15 in the IR receiver 155.
(Or remote controller 35) waits until the infrared ray is received, and in step S231, the IR receiver 155
To detect the infrared reception intensity at. That is, when the user operates the remote controller 15 to control a control target of a certain television receiver constituting the scalable TV system, the remote controller 15 operates as follows.
An infrared ray corresponding to the operation is emitted, and the infrared ray is received by the IR receiving unit 155 of the slave unit 2 as described above. In step S231, the CPU 149 sets the IR
The receiving unit 155 is caused to detect the reception intensity of the infrared ray and receives the supply.

[0680] Then, the flow advances to step S232, and the CPU
The 149 waits for the infrared reception intensity request to be transmitted from the base unit 1, and then transmits the infrared reception intensity detected in step S231 to the base unit 1 via the IEEE1394 interface 153. In step S232, the reception intensity of the infrared ray transmitted from the slave unit 2 is acquired (received) in step S222 of FIG.
To be done.

Thereafter, the flow advances to step S233, and the CPU
149 determines whether or not a command has been transmitted from base unit 1. That is, the parent device 1 transmits a command to the child device 2 in steps S226 and S228 of FIG. 46 described above. In step S233, whether or not the command is transmitted from the parent device 1 in this way. Is determined.

[0682] If it is determined in step S233 that the command has not been transmitted from the parent device 1, the process returns to step S233.

[0683] Also, in step S233, the base unit 1
If it is determined that the command is transmitted from the base station 1, that is, if the IEEE1394 interface 153 receives the command transmitted from the base unit 1 and supplies the command to the CPU 149, the process proceeds to step S234 and the CPU 14
9 determines whether the command is an individual processing end command.

[0684] If it is determined in step S234 that the command transmitted from the parent device 1 is not the individual process end command, the process proceeds to step S235 and the CPU 1
49 executes the process corresponding to the command transmitted from the parent device 1, and returns to step S233.

As a result, as described with reference to FIG. 46, when the user operates the remote controller 15, in the child device 2 to which the remote controller 15 is directed, a process corresponding to the operation of the remote controller 15 (for example, channel or volume). Change)
Is done.

On the other hand, in step S234, the main unit 1
If it is determined that the command transmitted from the individual processing end command is the individual processing end command, the individual processing of the child device 2 is ended.

As described above, the remote controller 15 (or the remote controller 35) having a strong directivity of infrared rays is used.
Further, in the television receiver constituting the scalable TV system, the maximum reception intensity device having the highest infrared reception intensity from the remote controller 15 is detected to identify the television receiver the user is trying to control. Since it can be (recognized), the television receiver to be controlled by the user among the master unit 1 and each slave unit 2 _ij configuring the scalable TV system is the remote controller 15 of the master unit 1 and each slave unit 2 _{ij. ij} remote control 35
Any of the remote controls can be used for control without the user performing an operation to specify the television receiver to be controlled.

[0688] Next, according to the individual processing, for example, a certain user A operates a channel of a certain slave unit 2 _ij by using the remote controller 15 to watch a certain program PGM _A , and another user B , Another remote unit 2 by remote control 35
_A plurality of users can individually watch different programs, such as performing a channel operation of _pq to watch other programs PGM _B.

In this case, C of the child devices 2 _ij and 2 _pq (FIG. 11)
Image data of different programs will be displayed on the RT 31. Even if the slaves 2 _ij and 2 _pq are arranged at positions adjacent to each other, different programs will be displayed on the slaves 2 _ij and 2 _pq. The display of the image data of is not a big problem.

[0690] In other words, in this case, the program PG is _stored in the slave unit 2 _ij.
The image data of M _A is displayed, and the program PGM _B is displayed on the child device 2 _pq.
Since the image data of No. 2 is displayed, any image data comes into the field of view of the users A and B.

However, the user A tries to view the image data of the program PGM _A displayed on the child device 2 _ij ,
User B, because it attempts to view the image data of the program PGM _B displayed on the handset 2 _pq, in the user A, the image data of the program PGM _B are not trying to viewing, so to speak mask, even in user B The image data of the program PGM _A that is not to be viewed is masked.

[0692] Therefore, for the user A, another child device 2 _pq
The image data of the program PGM _B displayed on the display unit 2 _ij does not greatly hinder the viewing of the image data of the program PGM _A displayed on the child device 2 _ij. The image data of the program PGM _A does not greatly hinder the viewing of the image data of the program PGM _B displayed on the child device 2 _pq .

However, in this case, different audio data associated with different image data are output, that is, the speaker units 32L and 32L of the child device _ij.
The audio data of the program PGM _A is output from R, and the child device 2 _pq
From the speaker units 32L and 32R of the program PGM
There are some problems with outputting the _B audio data.

That is, the so-called cocktail party effect is recognized in human hearing, and it is possible to distinguish desired voice data from among a large number of voice data mixed, but still voice data with low power is The presence of voice data other than the desired voice data, that is, voice data that becomes noise, such as being masked by high-power voice data, hinders viewing of the desired voice data.

Therefore, in the scalable TV system, the speaker units 12L and 12R of the parent device 1 and the speaker units 32L and 32R of the child device 2 are directed toward the user who is watching the program on the parent device 1 and the child device 2. The speaker has a special function of directing the direction of the main axis of directivity, which makes it easy for the user to hear the audio data of the program being watched by the user. This is realized by performing speaker control processing in the parent device 1 and the child device 2.

[0696] That is, here, for example, the base unit 1 (see FIG.
The directivity of the speaker units 12L and 12R of 0) is very strong, and the unit driving unit 13
8 drives the speaker units 12L and 12R,
By changing its direction mechanically (mechanically), the direction of the main axis of directivity can be directed to a predetermined direction. Speaker unit 3 of cordless handset 2
Similarly, 2L and 32R also have strong directivity, and by being driven by the unit drive section 158, the direction of the main axis of directivity can be directed to a predetermined direction.

The speaker control processing is performed in parallel with the individual processing described in FIGS. 46 and 47, for example, when the individual processing is performed.

Therefore, the speaker control processing of the parent device will be described with reference to the flowchart in FIG.

In the speaker control processing of the parent device, the CPU 12
After waiting for the infrared ray from the remote controller 15 (or the remote controller 35) to be received by the IR receiving section 135, the step 9 detects the infrared ray receiving intensity in the IR receiving section 135 in step S241. That is, when the user operates the remote controller 15 to control a control target of a television receiver that constitutes the scalable TV system, the remote controller 15 emits infrared rays corresponding to the operation. . This infrared ray is received by the IR receiving unit 135 of the master unit 1 and the IR receiving unit 155 of each slave unit 2 _ij (FIG. 11). In step S241, the CPU 129 informs the IR receiving unit 135 of the infrared ray. The reception strength is detected and supplied.

Then, the procedure advances to step S242, and the CPU
129 via the IEEE1394 interface 133, to each child device 2 _ij, requests the reception intensity of the infrared rays from the remote controller 15 in each child device 2 _ij, in response to the request, transmitted from the child devices 2 _ij The reception intensity of the incoming infrared rays is acquired (received) via the IEEE1394 interface 133.

That is, as described above, when the user operates the remote controller 15, the infrared rays emitted by the remote controller 15 are received not only by the master unit 1 but also by the slave units 2 _ij , but in step S242. , The reception intensity of the infrared ray at each slave unit 2 _ij is acquired.

Here, in steps S241 and S242 in the speaker control process of base unit 1, processes similar to steps S221 and S222 in the individual process of base unit 1 in FIG. 46 are performed, respectively. Therefore, in the speaker control process of the master device 1, the processes of steps S241 and S242 are not performed, and the reception intensity obtained in steps S221 and S222 in the individual process of the master device 1 can be directly adopted.

Thereafter, the flow advances to step S243, and the CPU
Reference numeral 129 denotes the infrared reception intensity of the master device 1 detected in step S241 and each slave device 2 acquired in step S242.
_From among the infrared reception intensities at _ij , arbitrary three reception intensities, that is, for example, the reception intensities from the first rank to the third rank are selected in descending order of reception strength, and the process proceeds to step S244.

At step S244, the CPU 129
The distances corresponding to the respective reception intensities from the first rank to the third rank selected in step S243 are detected, and the process proceeds to step S245.

[0705] That is, the reception intensity of infrared rays emitted from the remote controller 15 in the television receiver is, for example,
IR receiver 13 of remote controller 15 and television receiver
5 or 155).

[0706] Therefore, the EEPROM of the master unit 1 (Fig. 10)
The remote controller 1 includes, for example, a remote controller 1 as shown in FIG.
An intensity-to-distance table representing a correspondence relationship between the reception intensity of infrared rays emitted from the television receiver 5 at the television receiver and the distance from the remote controller 15 to the television receiver is stored. In step S244, the CPU 129
For example, the distances corresponding to the respective reception intensities of the first rank to the third rank are detected by referring to the strength vs. distance table.

The intensity-to-distance table is created, for example, by operating the remote controller 15 at each of positions separated from the television receiver by a plurality of distances and measuring the reception intensity received by the television receiver. It is possible to

Returning to FIG. 48, in step S245, C
The PU 129 detects the position of the remote controller 15 which has emitted the infrared rays of the reception intensities from the distances corresponding to the reception intensities of the first to third positions, respectively.

Now, with reference to FIG. 50, a method for detecting the position of the remote controller 15 which has emitted the infrared rays of the reception intensities from the distances corresponding to the reception intensities of the first to third positions will be described. . Note that, here, for the sake of simplicity of explanation, only two reception intensities of the first rank and the second rank are considered.

[0710] For example, now, with respect to the reception intensity in the base unit 1, (viewed from the front direction of the scalable TV system)
The reception strength at the handset 2 _{23 on} the right side is the first and second
The distance corresponding to the reception intensity in the base unit 1 is represented by r _1, and the distance corresponding to the reception intensity in the slave unit 2 ₂₃ is represented by r ₂₃ , respectively.

In this case, considering a certain two-dimensional plane, the remote controller 15 has a radius r ₁ around the point P ₁ at which the infrared ray is received by the IR receiver 135 of the parent device 1, as shown in FIG. It exists on the circumference of the circle c ₁ and also exists on the circumference of a circle c ₂₃ with a radius r ₂₃ centered on the point P ₂₃ at which the infrared ray is received by the IR receiver 155 of the slave unit 2 _23. become.

Therefore, the remote controller 15 exists at the intersection P _U of the circumferences of the circles c ₁ and c ₂₃ , and the position P _{U of the} remote controller 15 can be detected.

In the above case, since the position of the remote controller 15 is obtained from the two reception intensities, the position on the two-dimensional plane is detected, but the position of the remote controller 15 on the three-dimensional space is Similarly to the case described with reference to FIG.
This can be detected by finding the intersection of the spherical surfaces of the spheres whose radius corresponds to the distance corresponding to each of the two reception intensities.

Returning to FIG. 48 again, after the position of the remote controller 15 is detected in step S245, step S24
In step 6, the CPU 129 detects the maximum reception intensity from the infrared reception intensity of the master device 1 detected in step S241 and the infrared reception intensity of each slave device 2 _ij acquired in step S242. It is possible to omit the detection of the maximum reception intensity in step S246 and instead use the maximum reception intensity detected in step S223 of FIG. 46 described above.

At step S246, the CPU 1
29 determines whether the television receiver (maximum reception intensity device) that has obtained the maximum reception intensity is the master unit 1 or the slave unit 2.

[0716] If it is determined in step S246 that the maximum reception strength device is the parent device 1, step S24
7, the CPU 129 determines the direction of the main axis of directivity of the speaker units 12L and 12R of the parent device 1 which is the maximum reception strength device to be the position of the remote controller 15 detected in step S245 (hereinafter, appropriately referred to as user position). ) The unit driving section 138 is controlled so as to face the direction of
It returns to step S241.

In this case, the unit driving section 138 is
According to the control of U129, the speaker units 12L and 12R are rotationally driven in, for example, the pan direction or the tilt direction, whereby the direction of the main axis of the directivity is directed toward the user position.

On the other hand, if it is determined in step S246 that the maximum reception strength device is the slave unit 2, the process proceeds to step S248, and the CPU 129 controls the IEEE1394 interface 133 to cause the speaker unit 3 to operate.
A speaker control command for directing the directions of the directional main axes of 2L and 32R to the user position is transmitted to the slave unit 2 _ij which is the maximum reception intensity device, and step S24
Return to 1.

Therefore, in this case, in the slave unit 2 _ij which is the maximum reception strength device, the speaker units 32L and 32R change the direction of the main axis of the directivity to the direction of the user position, as will be described later with reference to FIG. It is rotationally driven in the pan direction or the tilt direction so as to face to.

As described above, the user operates the remote controller 15
(Or remote controller 35), when a certain television receiver that constitutes a scalable TV system is to be controlled and is generally controlled,
The remote controller 15 is operated toward the television receiver that is the control target.

In this case, for example, now, the remote controller 15
If the infrared rays emitted by (or the remote controller 35) have strong directivity, the television receiver that the user intends to control is in the direction of the main axis of the infrared rays emitted by the remote controller 15, that is, This means that it is a maximum reception intensity device that has the highest infrared reception intensity.

Therefore, the maximum reception strength device is the remote controller 1
5 is a television receiver that outputs image data and audio data of a program being viewed by the user who operates 5, and the speaker units 12L and 12R of the master unit 1 which is the maximum reception strength device thereof, or the slave unit 2 By directing the directions of the main axes of directivity of the speaker units 32L and 32R to the direction of the user who operates the remote controller 15, that user can clearly hear the audio data of the desired program.

Next, the speaker control process of the handset 2 will be described with reference to the flowchart of FIG.

In the speaker control process of the handset unit 2 (FIG. 11), the CPU 149 waits for the infrared rays from the remote controller 15 (or the remote controller 35) to be received by the IR receiving section 155, and at step S251, the IR reception is performed. The intensity of infrared rays received by the unit 155 is detected. That is,
When a user operates a remote controller 15 to control a certain television receiver that constitutes a scalable TV system as a control target, the remote control 1
The infrared ray 5 emits infrared rays corresponding to the operation, and the infrared rays are received by the IR receiving section 155 of the handset 2 as described above. In step S251, the CPU 129
The IR receiving unit 155 is caused to detect the reception intensity of the infrared ray and receives the supply.

Then, the flow advances to step S252, and the CPU
The 149 waits for the infrared reception strength request from the base unit 1, and then transmits the infrared reception strength detected in step S251 to the base unit 1 via the IEEE1394 interface 153. In step S252, the reception intensity of the infrared ray transmitted from the slave unit 2 is acquired (received) in step S242 of FIG.
To be done.

Here, in steps S251 and S252 in the speaker control process of the handset 2, the same processes as steps S231 and S232 in the individual process of the handset 2 of FIG. 47 are performed, respectively. Therefore, in the speaker control process of the child device 2, the processes of steps S251 and S252 are not performed, and the reception intensity obtained in steps S231 and S232 in the individual process of the child device 2 can be directly adopted.

Thereafter, the flow advances to step S253, and the CPU
149 determines whether or not the speaker control command has been transmitted from base unit 1. That is, the master unit 1 sends the slave unit 2 to the slave unit 2 in step S248 of FIG.
A speaker control command is transmitted, but step S253
Then, it is determined whether or not the speaker control command is transmitted from base unit 1 in this way.

[0728] If it is determined in step S253 that the speaker control command has not been transmitted from the parent device 1, the process returns to step S251.

[0729] In step S253, the main unit 1
If it is determined that the speaker control command is transmitted from the base station 1, that is, if the IEEE1394 interface 153 receives the speaker control command transmitted from the master unit 1 and is supplied to the CPU 149, step S
In step 254, the CPU 149 follows the speaker control command and outputs the speaker units 32L and
The direction of the main axis of the 2R directivity is set to step S24 in FIG.
The unit drive unit 158 is controlled so as to face the position of the remote controller 15 (user position) detected in step 5,
It returns to step S251.

In this case, the unit driving section 158 determines that the CP
According to the control of U149, the speaker units 32L and 32R are rotationally driven, for example, in the pan direction or the tilt direction, whereby the direction of the main axis of the directivity is directed toward the user position.

Therefore, in this case, in the child device 2, the user who operates the remote controller 15 toward the child device 2,
That is, in the direction of the user who is viewing the program as the image data and audio data output by the child device 2,
The direction of the main axis of directivity of the speaker units 32L and 32R is oriented, and the user can clearly hear the audio data of the desired program.

Note that the speaker control processing of FIGS. 48 and 51 ends, for example, when the individual processing of FIGS. 46 and 47 ends.

In the above case, only the direction of the main axis of directivity of the speaker units 12L and 12R (or the speaker units 32L and 32R) is controlled according to the user position. For example, it is possible to control the volume of the speaker units 12L and 12R. That is, for example, as the television receiver on which the user is watching the program is farther from the user position, the speaker unit 12L
It is possible to make the volume of 12R and louder.

Further, in the above-mentioned case, the position of the remote controller 15 (user position) is detected based on the intensity of infrared rays received from the remote controller 15 in the television receiver. In addition, for example, it is possible to detect by using GPS (Global Positioning System), or by emitting ultrasonic waves from each television receiver and receiving the ultrasonic waves with the remote controller 15 and sending them back. is there.

[0735] Next, in the above speaker control processing, as the speaker units 12L and 12R (and the speaker units 32L and 32R), those having directivity are used, and the direction of the main axis of the directivity is set to the unit drive section 138. (And unit driver 158)
By rotating in the pan or tilt direction,
Although it is directed in a predetermined direction (direction of the user position), such control of the direction of the main axis of directivity can be performed electronically.

That is, FIG. 52 shows a structural example of the speaker unit 12L which electronically controls the direction of the main axis of directivity. The other speaker units 12R, 32
The L and 32R are also configured in the same manner as the speaker unit 12L, and the description thereof will be omitted.

In the embodiment shown in FIG. 52, the audio data output from the MPEG audio decoder 126 (FIG. 10) is supplied to the digital filters 211 ₁ and 211 ₂ . A predetermined tap coefficient is set in the digital filters 211 ₁ and 211 ₂ by the unit driving section 138 (FIG. 10), and the digital filters 211 ₁ and 211 ₂ have the same tap coefficient. By filtering the audio data based on the tap coefficient set by the unit driving unit 138, the audio data obtained by delaying each frequency component included in the audio data by a predetermined delay time is obtained for each frequency component. , the speaker 212 ₁ and 212 _2, respectively supply.

The speakers 212 ₁ and 212 ₂ are both
The omnidirectional speaker outputs (sounds) the audio data supplied from the digital filters 211 ₁ and 211 ₂ .

Now, in the speaker unit 12L,
The main axes of the _two speakers 212 ₁ and 212 ₂ are respectively
When expressed as Y1 and Y2, the speakers 212 ₁ and 212 ₂ have their principal axes Y1 and Y2 in a two-dimensional plane (here, in the plane of the paper).
Are arranged in parallel. Further, the speakers 212 ₁ and 212 ₂ are arranged such that their cones (vibrations) are located at the same position in the directions of the main axes Y1 and Y2.

Here, the distance between the main axes Y1 and Y2 (hereinafter, appropriately referred to as the main axis distance) is represented by a and 2
In the dimensional plane, the angle (radiation angle) in the counterclockwise direction with respect to the principal axis Y1 or Y2 is represented by θ.

When, for example, a sine wave signal having a single frequency component is input as audio data to the speaker unit 12L configured as described above, the sine wave signal as the audio data is converted into a digital filter. 211
It is filtered by ₁ and 211 ₂ , and is thereby delayed by the delay times D1 and D2, respectively, and is supplied to the speakers 212 ₁ and 212 ₂ and output.

In this case, the sound waves output from the speakers 212 ₁ and 212 ₂ interfere with each other. Further, for example, assuming that the delay times D1 and D2 have a relationship of D2 ≧ D1, for example, a time difference of D2-D1 (hereinafter referred to as a time difference) between sound waves output from the speakers 212 ₁ and 212 ₂ respectively. , Which is called a delay time difference). Also, the main axis Y of each of the speakers 212 ₁ and 212 _{2 is}
There is a path difference between the sound waves on the axes Y11 and Y12 forming an angle θ with 1 and Y2.

As a result, the phase relationship at the time of interference between the two sound waves output from the speakers 212 ₁ and 212 ₂ is different for each observation point (listening position). In, the two sound waves are added in phase, and the sound wave has a volume twice that of the case where only one of the speakers 212 ₁ and 212 ₂ is used. At other observation points, the two sound waves are added (cancelled) in opposite phases, and the sound volume becomes zero. Therefore, the speakers 212 ₁ and 2
The total volume characteristic of 12 ₂ has directivity.

53 and 54 show examples of directivity of the total volume characteristics of the speakers 212 ₁ and 212 ₂ obtained as described above. In the embodiments of FIGS. 53 and 54, the maximum volume is normalized to 0 dB.

FIG. 53 shows the directivity of the volume characteristic when the main axis distance a is 10 cm, the delay time difference D2-D1 is a / C, and a sine wave with a frequency of 1000 Hz is input. Note that C represents the speed of sound, and is 340 m / s here.

In the embodiment of FIG. 53, the maximum volume is obtained in the range where the angle θ is 30 degrees or more. Further, at the position where the angle θ is −45 degrees, the sound volume is almost 0 (null).

FIG. 54 shows the conditions described with reference to FIG.
The directivity of the volume characteristic when the input is replaced with a sine wave having a frequency of 5000 Hz is shown.

In the embodiment of FIG. 54, the main beam appears in the range where the angle θ is 45 degrees or more. Also, the angle θ is 0
A sub-beam (grating beam) having the same size as the main beam is generated in the range of 45 degrees to 45 degrees. Such a large sub-beam is generated because the phase difference between the two sound waves is 5000 Hz in the range of the sub-beam in FIG.
This is because the wavelength becomes an integral multiple of the wavelength of the sine wave of, and the two sound waves are added in phase.

This also applies to the other sub-beams. When the distances from the speakers 212 ₁ and 212 ₂ to the observation point are sufficiently larger than the main axis distance a, the following formula is generally used. When established, the speaker 212 ₁
And 212 ₂ output two sound waves in phase with each other to generate a sub-beam having the same size as the main beam.

[0750]       a / C × (1-cos θ) = 1 / f × n                                                       (26)

However, in the equation (26), f represents the frequency of the input, and n is an integer value of 0 or more.

In Expression (26), when n is 0, it represents the main beam.

For example, when the frequency f is 1000 Hz, the equation (26) is satisfied only when n is 0. Therefore, in this case, a sub-beam of the same size is generated in addition to the main beam. There is no such thing.

Here, for example, when n is 1, the equation (2
The frequency f that satisfies 6), that is, the frequency f that causes the sub-beam can be expressed by f = C / (a (1-cos θ)). Under the conditions described in the embodiment of FIG. 53, the frequency f is about 1700 Hz, which is the frequency when the distance a between the main axes is equal to the half wavelength of the sound wave.

From the above, the speaker unit 12 of FIG.
According to L, in the digital filters 211 ₁ and 211 ₂ , each frequency component of the audio data supplied thereto is
Delayed per each of its frequency components, by which, for each frequency component, the audio data given a predetermined delay time difference D2-D1, by outputting supplied to the speaker 212 ₁ and 212 _2, the speaker 212 ₁ The total volume characteristics of and 212 ₂ have directivity. Then, the direction of the main beam and the null direction for each frequency component can be changed by the delay time difference given to the frequency component.

That is, the direction of the main axis of directivity of the speaker unit 12L can be changed by the tap coefficient set in the digital filters 211 ₁ and 211 ₂ .

Therefore, in the unit drive section 138,
By giving a predetermined tap coefficient to the digital filters 211 ₁ and 211 ₂ , the direction of the main axis of directivity of the speaker unit 12L can be directed to a desired direction.

[0758] Incidentally, in the above case, the speaker unit 12L, the two speakers 212 ₁ and 212 ₂ provided, by utilizing the interference of two waves with each other to be output from the two speakers 212 ₁ and 212 ₂ , The direction of the main axis of directivity is controlled. However, in addition, for example, the speaker units 12L and 12R are respectively configured by one speaker, and the speaker units 12L and 12R output the same. It is also possible to control the direction of the main axis of directivity by utilizing the interference between two sound waves.

Also, the speaker unit 12L can be formed by a so-called speaker array having more than two speakers. Speaker unit 12L,
When it is composed of a large number of speakers, steeper directivity can be realized.

Next, in the above case, the position of the remote controller 15 (user position) is detected based on the intensity of infrared rays received from the remote controller 15 in the master unit 1 or the slave unit 2,
In the direction of the position of the remote controller 15, the speaker unit 1
Although the main axis of directivity of 2L and 12R or speaker units 32L and 32R is directed,
The direction of the main axis of directivity of the speaker units 12L and 12R or the speaker units 32L and 32R is
If it is only directed to the position of the remote controller 15, it is not necessary to detect the position of the remote controller 15, and the direction of the remote controller 15 from the master unit 1 or the slave unit 2 may be known.

Therefore, referring to FIGS. 55 and 56,
A method of detecting the direction of the remote controller 15 from the master unit 1 (or the slave unit 2) will be described.

The direction of the remote controller 15 from the base unit 1 is shown in FIG.
As shown in FIG. 5, the IR receiving unit 135 of the parent device 1 (FIG. 10)
And two light receiving parts 135A and 1A separated by a predetermined distance D
It is possible to detect by providing 35B.

Now, assuming that the distance from the base unit 1 to the remote controller 15 is sufficiently larger than the distance D between the light receiving sections 135A and 135B, the remote controller 15 to the light receiving section 135A.
Infrared rays incident on the light receiving section 135B from the remote controller 15
The infrared rays incident on can be regarded as parallel.

Then, as shown in FIG. 55, the remote controller 1
If the angle between the infrared rays entering the light receiving sections 135A and 135B from 5 from the line connecting the light receiving sections 135A and 135B is φ, the infrared rays entering the light receiving section 135A from the remote controller 15 and entering the light receiving section 135B from the remote controller 15. The path difference d between the infrared rays and the infrared rays can be represented by Dcosφ.

Also, the light speed is represented by c, and the light receiving unit 1
When the time difference between the timings at which the infrared rays from the remote controller 15 are received by 35A and 135B is represented by τ, the path difference d is
It can be represented by cτ.

Therefore, the angle φ, that is, the direction φ of the remote controller 15 is represented by arccos (τc / D). That is, the direction φ of the remote controller 15 can be obtained by measuring the time difference τ between the timings at which the infrared rays from the remote controller 15 are received by the light receiving units 135A and 135B.

Next, the direction of the remote controller 15 from the master unit 1 (or the slave unit 2) may be detected by configuring the IR receiving unit 135 (or IR receiving unit 155) as shown in FIG. It is possible.

That is, in the embodiment of FIG. 56, the IR receiver 135 includes an infrared line sensor 221 having pixels as a plurality of infrared light receivers and a lens 222 for condensing infrared rays on the infrared line sensor 221. It is configured.

The infrared line sensor 221 is arranged, for example, on the optical axis of the lens 222.

[0770] The IR receiver 135 configured as above.
Then, the infrared rays emitted from the remote controller 15 are transmitted to the lens 2
The light enters the infrared line sensor 221 via 22 and is received by the pixel at a predetermined position on the infrared line sensor.

In this case, when the incident angle α of the infrared rays on the infrared line sensor 221 changes, in response to this,
The pixel that receives the infrared light, that is, the light receiving position also changes.

Then, the distance between this light receiving position and the intersection of the optical axis of the lens 222 on the infrared line sensor 221 is represented by r, and the infrared line sensor 22
When the distance between 1 and the lens 222 is represented by S, the incident angle α, that is, the direction α of the remote controller 15 is represented by arctan (S / r).

Therefore, the direction α of the remote controller 15 can be obtained by measuring the distance r between the intersection of the infrared ray sensor 221 and the optical axis of the lens 222 and the position of the pixel receiving the infrared ray. .

[0774] Next, Fig. 57 shows another example of the configuration of the base unit 1. In the figure, parts corresponding to those in FIG. 10 are designated by the same reference numerals, and in the following,
The description is omitted as appropriate. That is, the base unit 1 in FIG.
10 except that a connection detection unit 139 is newly provided.
The configuration is the same as in the case of.

The connection detecting unit 139 is adapted to detect, electrically or mechanically, that another television receiver has been connected, and supply it to the CPU 129.

Therefore, in the embodiment of FIG. 57, the terminal pattern is
IEEE1394 terminal 21 in channel 21 _ij(Fig. 3F) terminals
Instead of the change in the voltage, the connection detector 139
The connection with the television receiver is detected.

[0777] Next, Fig. 58 shows another example of the configuration of the slave unit 2. In the figure, parts corresponding to those in FIG. 11 are denoted by the same reference numerals, and in the following,
The description is omitted as appropriate. That is, the cordless handset 2 in FIG.
11 except that a connection detection unit 159 is newly provided.
The configuration is the same as in the case of.

The connection detection unit 159 electrically or mechanically detects that another television receiver has been connected, and supplies it to the CPU 149.

Therefore, in the embodiment of FIG. 58, FIG.
Similar to the case of the embodiment described above, not the change in the terminal voltage of the IEEE1394 terminal 41 ₁ (FIG. 5F) in the terminal panel 41 but the connection detection unit 159 detects the connection with another television receiver.

Next, the series of processes described above can be performed by hardware or software. When performing a series of processing by software, the program that constitutes the software,
It is installed on a general-purpose computer or the like.

Therefore, FIG. 59 shows a configuration example of an embodiment of a computer in which a program for executing the series of processes described above is installed.

The program is stored in the hard disk 305 or ROM 3 as a recording medium built in the computer.
03 can be recorded in advance.

Alternatively, the program is a flexible disk, CD-ROM (Compact Disc Read Only Memory),
MO (Magneto Optical) disc, DVD (Digital Versatile)
Disc), magnetic disk, semiconductor memory, or other removable recording medium 311 can be stored (recorded) temporarily or permanently. Such removable recording medium 311 can be provided as so-called package software.

The program is installed in the computer from the removable recording medium 311 as described above, and is also wirelessly transferred from the download site to the computer via an artificial satellite for digital satellite broadcasting or LAN (Local Area). Network), via a network such as the Internet, and transferred to a computer by wire. In the computer, the program thus transferred can be received by the communication unit 308 and installed in the built-in hard disk 305.

[0785] The computer is a CPU (Central Processing
Unit) 302 is built in. The CPU 302 has a bus 3
The input / output interface 310 is connected via 01, and the CPU 302 is operated by the user via the input / output interface 310 by operating the input unit 307 including a keyboard, a mouse, a microphone and the like. When a command is input, the ROM (Read O
nly Memory) 303 executes the program stored in it. Alternatively, the CPU 302 may execute the program stored in the hard disk 305, the program transferred from the satellite or the network, received by the communication unit 308 and installed in the hard disk 305, or the removable recording medium 311 mounted in the drive 309. Programs that are read and installed on the hard disk 305 can be loaded into RAM (Random Access Memor
y) Load in 304 and execute. As a result, the CPU 30
2 performs processing according to the above-described flowchart or processing performed by the configuration of the above-described block diagram. Then, the CPU 302 displays the processing result as needed, for example, via the input / output interface 310.
The data is output from the output unit 306 configured by an LCD (Liquid CryStal Display), a speaker, or the like, transmitted from the communication unit 308, and further recorded on the hard disk 305.

Here, in the present specification, the processing steps for writing a program for causing a computer to perform various kinds of processing do not necessarily have to be processed in time series in the order described as a flowchart, but in parallel. Alternatively, it also includes processes that are executed individually (for example, parallel processes or processes by objects).

Also, the program may be processed by one computer or may be processed by a plurality of computers in a distributed manner. Further, the program may be transferred to a remote computer and executed.

Note that the scalable TV system described above can be configured by either a digital or analog television receiver.

[0789] Also, the television receiver constituting the scalable TV system is, for example, whether the television receiver is a master unit or a slave unit, and in the case of a slave unit, the number of the slave unit. Depending on whether there is a difference, it is possible to make a difference in the selling price.

[0790] That is, in the scalable TV system, as described above, the special function is not provided unless the base unit exists, so that the base unit has a high value and therefore the selling price can be set high. it can.

It is expected that the user will purchase additional slave units at any time after purchasing the master unit. For the first few slave units, for example, the price is lower than that of the master unit. However, it is possible to set a selling price higher than that of a general television receiver. Then, it is possible to set a lower selling price for the child device purchased thereafter.

[0792] The television receiver, which is the master of the scalable TV system, is, for example, a general digital television receiver, and a signal processing unit 137.
Is added and the program executed by the CPU 129 is changed. Therefore, the television receiver, which is a master unit of the scalable TV system, can be manufactured relatively easily by using a general digital television receiver, and thus the scalable television system provides the above-mentioned receiver. Considering such a special function, it can be said that the cost merit (cost performance) is high. This also applies to a television receiver as a slave.

Further, the present invention can be applied not only to a television receiver which is a display device having a built-in tuner, but also to a display device which does not have a built-in tuner and which outputs an image and sound from the outside.

[0794]

As described above, according to the present invention, an enlarged image can be displayed by a plurality of display devices.

[Brief description of drawings]

FIG. 1 is a perspective view showing a configuration example of an embodiment of a scalable TV system to which the present invention is applied.

FIG. 2 is a perspective view showing an external configuration example of a master unit 1.

FIG. 3 is a six-sided view showing an example of the external configuration of the master unit 1.

FIG. 4 is a perspective view showing an external configuration example of a child device 2.

FIG. 5 is a six-sided view showing an example of the external configuration of a child device 2.

FIG. 6 is a perspective view showing an external configuration example of a dedicated rack that houses a master unit 1 and a slave unit 2 that configure a scalable TV system.

FIG. 7 is a plan view showing an external configuration example of a remote controller 15.

8 is a plan view showing an external configuration example of a remote controller 35. FIG.

9 is a plan view showing another external configuration example of the remote controller 15. FIG.

FIG. 10 is a block diagram showing an electrical configuration example of the master unit 1.

FIG. 11 is a block diagram showing an electrical configuration example of a child device 2.

FIG. 12 is a diagram showing a layer structure of an IEEE1394 communication protocol.

FIG. 13 is a diagram showing an address space of the CSR architecture.

FIG. 14 is a diagram showing an offset address, a name, and a function of a CSR.

FIG. 15 is a diagram showing a general ROM format.

FIG. 16 is a diagram showing details of a bus info block, a root directory, and a unit directory.

FIG. 17 is a diagram showing the structure of PCR.

FIG. 18 is a diagram showing the configurations of oMPR, oPCR, iMPR, and iPCR.

FIG. 19 is a diagram showing a data structure of a packet transmitted in an asynchronous transfer mode of an AV / C command.

FIG. 20 is a diagram showing a specific example of an AV / C command.

FIG. 21 is a diagram showing a specific example of an AV / C command and a response.

22 is a block diagram showing a detailed configuration example of a signal processing unit 137. FIG.

FIG. 23 is a flowchart illustrating an image conversion process performed by the signal processing unit 137.

FIG. 24 is a block diagram illustrating a configuration example of a learning device.

FIG. 25 is a diagram for explaining the processing of the student data generation unit 173.

FIG. 26 is a flowchart illustrating a learning process of coefficient seed data performed by the learning device.

FIG. 27 is a diagram for explaining a learning method of coefficient seed data.

FIG. 28 is a block diagram illustrating another configuration example of the learning device.

FIG. 29 is a block diagram showing a configuration example of a signal processing unit 157.

FIG. 30 is a flowchart illustrating a process of master device 1.

FIG. 31 is a flowchart illustrating an authentication process performed by master device 1.

FIG. 32 is a flowchart illustrating a process of the child device 2.

FIG. 33 is a flowchart illustrating an authentication process performed by the child device 2.

FIG. 34 is a flowchart illustrating closed caption processing by the parent device 1.

FIG. 35 is a flowchart illustrating a closed caption process by the child device 2.

FIG. 36 is a flowchart illustrating a partial enlargement process by the master unit 1.

FIG. 37 is a flowchart illustrating a partial enlargement process by the child device 2.

[Fig. 38] Fig. 38 is a diagram illustrating a display example of the scalable TV system when a partial enlargement process is performed.

FIG. 39 is a flowchart illustrating an overall enlargement process performed by the master device 1.

FIG. 40 is a diagram for explaining how to obtain a display range and an enlarged range.

FIG. 41 is a flowchart illustrating an overall enlargement process by the child device 2.

[Fig. 42] Fig. 42 is a diagram illustrating a display example of the scalable TV system when the entire enlargement process is performed.

[Fig. 43] Fig. 43 is a flowchart illustrating a multi-screen display process by the parent device 1.

FIG. 44 is a flowchart illustrating a batch simultaneous control process by base unit 1.

[Fig. 45] Fig. 45 is a diagram illustrating a display example of the scalable TV system when the collective simultaneous control process is performed.

FIG. 46 is a flowchart illustrating an individual process performed by master device 1.

FIG. 47 is a flowchart illustrating an individual process performed by the child device 2.

FIG. 48 is a flowchart illustrating a speaker control process performed by master device 1.

FIG. 49 is a diagram showing an intensity versus distance table.

FIG. 50 is a diagram for explaining a method of calculating the distance to the remote controller 15.

FIG. 51 is a flowchart illustrating a speaker control process performed by the child device 2.

FIG. 52 is a block diagram showing a configuration example of a speaker unit 12L.

FIG. 53 is a diagram showing directivity.

FIG. 54 is a diagram showing directivity.

FIG. 55 is a diagram for explaining a method of detecting the direction of the remote controller 15.

[Fig. 56] Fig. 56 is a diagram illustrating a configuration example of an IR reception unit 135.

FIG. 57 is a block diagram showing another electrical configuration example of the master unit 1.

FIG. 58 is a block diagram showing another electrical configuration example of the child device 2.

FIG. 59 is a block diagram showing a configuration example of an embodiment of a computer to which the present invention has been applied.

[Explanation of symbols]

1 base unit, 2,2 ₁₁ , 2 ₁₂ , 2 ₁₃ , 2 ₁₄ , 2 ₁₅ ,
2 ₂₁ , 2 ₂₂ , 2 ₂₃ , 2 ₂₄ , 2 ₂₅ , 2 ₃₁ , 2 ₃₂ , 2 ₃₃ , 2
₃₄ , 2 ₃₅ , 2 ₄₁ , 2 ₄₂ , 2 ₄₃ , 2 ₄₄ , 2 ₄₅ , 2 ₅₁ ,
2 ₅₂ , 2 ₅₃ , 2 ₅₄ , 2 ₅₅ Remote Unit, 11 CRT, 1
2L, 12R speaker unit, 15 remote controller,
21 terminal panel, 21 ₁₁ , 21 ₁₂ , 21 ₁₃ , 21
₂₁ , 21 ₂₃ , 21 ₃₁ , 21 ₃₂ , 21 ₃₃ IEEE1394 terminal,
22 antenna terminal, 23 input terminal, 24 output terminal, 31 CRT, 32L, 32R speaker unit, 35 remote controller, 41 terminal panel,
41 ₁ IEEE1394 terminal, 42 antenna terminal, 43
Input terminal, 44 Output terminal, 51 Select button switch, 52 Volume button switch, 53
Channel up / down button switch, 54 menu button switch, 55 exit button switch, 56 display button, 57 enter button switch, 58 number button (numeric keypad) switch, 59 TV / video switch button switch, 6
0 TV / DSS selector button switch, 61 jump button switch, 62 language button, 6
3 guide button switch, 64 favorite button switch, 65 cable button switch, 6
6 TV switch, 67 DSS button switch,
68 to 70 LED, 71 cable power button switch, 72 TV power button switch, 73
DSS power button switch, 74 muting button switch, 75 sleep button switch,
76 light emitting part, 81 select button switch, 8
2 volume button switch, 83 channel up / down button switch, 84 menu button switch, 85 exit button switch, 86 display button, 87 enter button switch,
88 number buttons (numeric keys) switch, 89 TV / video selector button switch, 90 TV / DS
S switch button switch, 91 jump button switch, 92 language button, 93 guide button switch, 94 favorite button switch,
95 cable button switch, 96 TV switch, 97 DSS button switch, 98 to 100
LED, 101 cable power button switch, 1
02 TV power button switch, 103 DSS power button switch, 104 muting button switch, 105 sleep button switch, 106
Light emitting part, 110 button switch, 111 to 1
14-way button switch, 121 tuner, 12
2 QPSK demodulation circuit, 123 error correction circuit,
124 demultiplexer, 125 MPEG video decoder, 126 MPEG audio decoder, 1
27 frame memory, 128 NTSC encoder, 129 CPU, 130 EEPROM, 1
31 ROM, 132 RAM, 133 IEEE1394 interface, 134 front panel, 135 I
R receiver, 135A, 135B light receiver, 136
Modem, 137 signal processor, 137A DSP,
137B EEPROM, 137C RAM, 1
38 unit drive section, 139 connection detection section, 14
1 tuner, 142 QPSK demodulation circuit, 143
Error correction circuit, 144 demultiplexer, 14
5 MPEG Video Decoder, 146 MPEG Audio Decoder, 147 Frame Memory, 148
NTSC encoder, 149 CPU, 150
EEPROM, 151 ROM, 152 RAM,
153 IEEE1394 interface, 154 front panel, 155 IR receiver, 156 modem,
157 Signal processing unit, 157A DSP, 157B
EEPROM, 157C RAM, 158 unit drive section, 159 connection detection section, 161, 162
Tap extraction unit, 163 class classification unit, 164
Coefficient memory, 165 prediction unit, 166 coefficient generation unit, 167 coefficient seed memory, 168 parameter memory, 171 teacher data generation unit, 172 teacher data storage unit, 173 student data generation unit, 174
Student data storage unit, 175, 176 tap extraction unit,
177 class classification part, 178 addition part, 1
79 coefficient seed calculation unit, 180 parameter generation unit,
190 Addition unit, 191 Tap coefficient calculation unit,
192 Addition unit, 193 Coefficient seed calculation unit, 20
1,202 tap extraction unit, 203 class classification unit,
204 coefficient memory, 205 predicting unit, 206 coefficient generating unit, 207 coefficient seed memory, 208 parameter memory, 211 ₁ , 211 ₂ digital filter, 212 ₁ , 212 ₂ speaker, 221 infrared line sensor, 222 lens, 301 bus,
302 CPU, 303 ROM, 304 RAM, 30
5 hard disk, 306 output unit, 307 input unit, 308 communication unit, 309 drive, 31
0 I / O interface, 311 Removable recording medium

─────────────────────────────────────────────────── ─── Continuation of front page (51) Int.Cl. ⁷ Identification code FI theme code (reference) H04N 5/262 G09G 5/36 520F 520C F term (reference) 5C021 RB08 XB11 ZA03 5C023 AA02 AA11 AA14 AA21 AA38 BA11 BA15 CA01 CA04 CA05 5C058 AB07 BA17 BA21 BA22 BA23 BA24 BB17 5C082 AA02 AA34 BA12 BB03 BB53 BC03 CA33 CB05 DA76 DA86 MM05 MM10

Claims (27)

[Claims] 1. A display device, which is connected to another display device and has a display unit for displaying an image, for predicting a pixel of interest of interest among pixels forming an enlarged image obtained by enlarging an input image. Predictive taps used for, a predictive tap extracting means for extracting from the input image, the target pixel, the class tap used to perform the class classification to classify into any one of a plurality of classes, Class tap extraction means for extracting from the input image, a class classification means for classifying the pixel of interest based on the class tap, and a predetermined tap coefficient prepared by performing learning for each of the plurality of classes A prediction unit that predicts the pixel of interest using the tap coefficient of the class of the pixel of interest and the prediction tap, together with the other display device. Wherein to display the entire enlarged image display apparatus, characterized in that the said enlarged image formed of predicted pixels in the prediction means, and a display control means for displaying on the display means. 2. The apparatus further comprises: an authenticating unit that performs authentication with the other display device; and a setting unit that performs setting so that the enlarged image can be displayed when the authentication is successful. The display device according to claim 1, wherein: 3. A tap coefficient generating means for generating the tap coefficient based on predetermined coefficient seed data obtained by learning and a parameter corresponding to an enlargement ratio when the input image is enlarged to the enlarged image. The display device according to claim 1, wherein the display device is provided. 4. An enlargement ratio setting means for setting an enlargement ratio when enlarging the input image to the enlarged image, and the parameter is set in correspondence with the enlargement ratio set by the enlargement ratio setting means. The display device according to claim 3, further comprising parameter setting means. 5. The enlargement ratio setting means sets the enlargement ratio to
The display device according to claim 4, wherein the display device is set to gradually increase. 6. An enlargement range detecting means for obtaining an enlargement range of the input image to be enlarged to the other display device based on the enlargement ratio, and an image obtained by enlarging the input image in the enlargement range, A display range detection means for obtaining a display range to be displayed on the display screen of another display device; and a transmission means for transmitting the enlargement range, the display range, and the enlargement ratio to the other display device. The display device according to claim 4. 7. The display device according to claim 4, further comprising transmitting means for transmitting, to the other display device, a portion of the enlarged image to be displayed on the other display device. 8. The other display device, when transmitting the enlargement ratio when enlarging the input image to the enlarged image, based on the enlargement ratio transmitted from the other display device. The display device according to claim 3, further comprising parameter setting means for setting a parameter. 9. In the case where the other display device transmits a magnifying range of the input image to be magnified and a display range for displaying an image magnifying the input image of the magnifying range on the display means, The display device according to claim 8, wherein the display unit displays an image obtained by enlarging the input image in the enlargement range in the display range. 10. A method of controlling a display device, which is connected to another display device and has a display unit for displaying an image, wherein a pixel of interest of interest among pixels forming an enlarged image obtained by enlarging an input image. Prediction tap used to predict the prediction tap extraction step of extracting from the input image, and the class tap used to perform the class classification to classify the target pixel into any one of a plurality of classes A class tap extraction step of extracting from the input image, a class classification step of classifying the pixel of interest based on the class tap, and a predetermined tap prepared by performing learning for each of the plurality of classes. Of the coefficients, a prediction step of predicting the pixel of interest using the tap coefficient of the class of the pixel of interest and the prediction tap A display control step of causing the display means to display the enlarged image composed of pixels predicted by the prediction means so as to display the entire enlarged image together with the other display device. Control method. 11. A program, which is connected to another display device and causes a computer to perform a control process of a display device having a display unit for displaying an image, among the pixels constituting an enlarged image obtained by enlarging an input image. A prediction tap extraction step of extracting a prediction tap used for predicting a target pixel of interest from the input image, and classifying the target pixel into any one of a plurality of classes A class tap extraction step of extracting a class tap used for performing the input image from the input image; a class classification step of classifying the pixel of interest based on the class tap; and learning for each of the plurality of classes. Using the tap coefficient of the class of the pixel of interest and the prediction tap among the predetermined tap coefficients prepared by A prediction step of predicting the pixel of interest, and a display for causing the display means to display the enlarged image including the pixels predicted by the predicting means so as to display the entire enlarged image together with the other display device. A program comprising a control step. 12. A recording medium in which a program is recorded, which is connected to another display device and has a display device having a display unit for displaying an image, in which a program is recorded. A prediction tap extraction step of extracting from the input image a prediction tap used to predict a target pixel of interest among pixels forming an image; and the target pixel of any one of a plurality of classes. A class tap extraction step of extracting from the input image a class tap used for classifying the class into classes; a class classification step of classifying the pixel of interest based on the class tap; Of the predetermined tap coefficients prepared by learning for each class, the tap coefficient of the class of the pixel of interest, Using the prediction tap, a prediction step of predicting the pixel of interest, together with the other display device, so as to display the entire enlarged image, the enlarged image consisting of pixels predicted by the prediction means And a display control step of causing the display unit to display the program. 13. A display system configured by connecting a plurality of display devices, wherein each of the plurality of display devices includes a display unit that displays an image and a pixel that forms an enlarged image obtained by enlarging an input image. A prediction tap extraction unit that extracts a prediction tap used to predict a target pixel of interest from the input image, and a class that classifies the target pixel into one of a plurality of classes Class tap extraction means for extracting a class tap used for classification from the input image, class classification means for classifying the pixel of interest based on the class tap, and learning for each of the plurality of classes The target pixel is predicted by using the tap coefficient of the class of the target pixel and the prediction tap among the predetermined tap coefficients thus prepared. Display means for displaying the enlarged image composed of the pixels predicted by the predicting means so that the entire enlarged image is displayed in the whole of the plurality of display devices. And a display system. 14. A display device which is connected to another display device and has a display device for displaying an image, the image conversion device converting an input image into a magnified image obtained by enlarging the input image; An authentication unit that performs authentication with a display device, and the enlarged image obtained by the image conversion unit so as to display the entire enlarged image together with the other display device when the authentication is successful. And a display control unit that causes the display unit to display. 15. The display device according to claim 14, wherein the image conversion unit converts the input image into the enlarged image by simple interpolation. 16. The predictive tap extracting means for extracting, from the input image, predictive taps used for predicting a target pixel of interest among the pixels forming the enlarged image, Class tap extraction means for extracting from the input image a class tap used for classifying the pixel of interest into one of a plurality of classes, and the attention based on the class tap. Class classification means for classifying pixels, of the predetermined tap coefficient prepared by performing learning for each of the plurality of classes, using the tap coefficient of the class of the pixel of interest, and the prediction tap, A prediction unit for predicting the pixel of interest, and converting the input image into the enlarged image composed of the pixels predicted by the prediction unit. The display device according to claim 14, wherein. 17. A tap coefficient generating means for generating the tap coefficient based on predetermined coefficient seed data obtained by learning and a parameter corresponding to an enlargement ratio when the input image is enlarged to the enlarged image. The display device according to claim 16, further comprising: 18. An enlargement ratio setting means for setting an enlargement ratio when the input image is enlarged to the enlarged image, and the parameter is set in correspondence with the enlargement ratio set by the enlargement ratio setting means. 18. The display device according to claim 17, further comprising a parameter setting unit. 19. The display device according to claim 18, wherein the enlargement ratio setting means sets the enlargement ratio to be gradually increased. 20. An enlargement range detecting means for obtaining an enlargement range of the input image to be enlarged to the other display device based on the enlargement ratio, and an image obtained by enlarging the input image in the enlargement range. A display range detection means for obtaining a display range to be displayed on the display screen of another display device; and a transmission means for transmitting the enlargement range, the display range, and the enlargement ratio to the other display device. The display device according to claim 18. 21. The display device according to claim 18, further comprising transmitting means for transmitting a portion of the enlarged image to be displayed on the other display device to the other display device. 22. In the case where the other display device transmits an enlargement ratio for enlarging the input image to the enlarged image, the other display device is based on the enlargement ratio transmitted from the other display device. The display device according to claim 17, further comprising parameter setting means for setting a parameter. 23. In the case where the other display device transmits a magnifying range of the input image to be magnified and a display range for displaying an image magnifying the input image of the magnifying range on the display means, 23. The display device according to claim 22, wherein the display unit displays an image obtained by enlarging the input image in the enlargement range in the display range. 24. A method of controlling a display device, which is connected to another display device and has a display means for displaying an image, comprising an image conversion step of converting an input image into an enlarged image obtained by enlarging the input image. An authentication step of performing authentication with the other display device; and, if the authentication is successful, obtained in the image conversion step so as to display the entire enlarged image together with the other display device. A display control step of displaying the enlarged image on the display means. 25. A program for causing a computer to perform control processing of a display device which is connected to another display device and has a display means for displaying an image, wherein the input image is an enlarged image obtained by enlarging the input image. An image conversion step of converting, an authentication step of authenticating with the other display device, and, if the authentication is successful, together with the other display device, to display the entire enlarged image, A display control step of causing the display means to display the enlarged image obtained in the image converting step. 26. A recording medium having a program recorded thereon, which is connected to another display device and causes a computer to perform a control process of the display device having a display unit for displaying an image. An image conversion step of converting the image into an enlarged image, an authentication step of performing authentication with the other display device, and, if the authentication is successful, together with the other display device, the entire enlarged image And a display control step of causing the display unit to display the enlarged image obtained in the image conversion step so as to display the recording medium. 27. A display system configured by connecting a plurality of display devices, each of the plurality of display devices displaying means for displaying an image, and an input image, and an enlarged image obtained by enlarging the input image. An image converting unit that converts the image into an image, an authenticating unit that authenticates with the other display device, and if the authentication is successful, the entire enlarged image is displayed in the entire plurality of display devices. As described above, a display system comprising: a display control unit that displays the enlarged image obtained by the image conversion unit on the display unit.