[go: up one dir, main page]

CN1212008C - Video display control method, video display processing system, video display processing device and screen display device - Google Patents

Video display control method, video display processing system, video display processing device and screen display device Download PDF

Info

Publication number
CN1212008C
CN1212008C CNB008013624A CN00801362A CN1212008C CN 1212008 C CN1212008 C CN 1212008C CN B008013624 A CNB008013624 A CN B008013624A CN 00801362 A CN00801362 A CN 00801362A CN 1212008 C CN1212008 C CN 1212008C
Authority
CN
China
Prior art keywords
image
display
unit
resolution
images
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CNB008013624A
Other languages
Chinese (zh)
Other versions
CN1317197A (en
Inventor
小林秀明
津田贤治郎
锦织义久
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Panasonic Holdings Corp
Original Assignee
Matsushita Electric Industrial Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from JP11194000A external-priority patent/JP2001022335A/en
Priority claimed from JP34219399A external-priority patent/JP2001160933A/en
Application filed by Matsushita Electric Industrial Co Ltd filed Critical Matsushita Electric Industrial Co Ltd
Publication of CN1317197A publication Critical patent/CN1317197A/en
Application granted granted Critical
Publication of CN1212008C publication Critical patent/CN1212008C/en
Anticipated expiration legal-status Critical
Expired - Fee Related legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • H04N21/4316—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
    • H04N21/4508—Management of client data or end-user data
    • H04N21/4532—Management of client data or end-user data involving end-user characteristics, e.g. viewer profile, preferences
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
    • H04N21/462—Content or additional data management, e.g. creating a master electronic program guide from data received from the Internet and a Head-end, controlling the complexity of a video stream by scaling the resolution or bit-rate based on the client capabilities
    • H04N21/4621—Controlling the complexity of the content stream or additional data, e.g. lowering the resolution or bit-rate of the video stream for a mobile client with a small screen
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
    • H04N21/462—Content or additional data management, e.g. creating a master electronic program guide from data received from the Internet and a Head-end, controlling the complexity of a video stream by scaling the resolution or bit-rate based on the client capabilities
    • H04N21/4622—Retrieving content or additional data from different sources, e.g. from a broadcast channel and the Internet
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/222—Studio circuitry; Studio devices; Studio equipment
    • H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/2624—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects for obtaining an image which is composed of whole input images, e.g. splitscreen
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/44—Receiver circuitry for the reception of television signals according to analogue transmission standards
    • H04N5/445—Receiver circuitry for the reception of television signals according to analogue transmission standards for displaying additional information
    • H04N5/45—Picture in picture, e.g. displaying simultaneously another television channel in a region of the screen
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00—Details of colour television systems
    • H04N9/12—Picture reproducers
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2340/00—Aspects of display data processing
    • G09G2340/04—Changes in size, position or resolution of an image

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Databases & Information Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • Marketing (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Controls And Circuits For Display Device (AREA)

Abstract

A video display processing system in which a video display unit determines the display priority of videos according to the displayed states of the videos displayed on screens, determines the resolutions of the videos for resolution conversion and the method for combining the videos according to the display priority, and transmits the determined resolution and the information on the determined combining method to a video input unit through a transmission line; the video input unit converts the resolutions of the videos on the basis of the determined resolution, synthesizing a video from the videos after the resolution conversion by combining the videos by the combining method, and transmits the synthesized video through the transmission line; and the video display unit separates the transmitted synthesized video into the videos according to the determined resolution by the synthesizing method and displays them.

Description

图像显示控制方法、图像显示处理系统及 装置和图像显示装置Image display control method, image display processing system and device, and image display device

技术领域technical field

本发明涉及通过1个传输线路传输多个输入图像并在同一显示画面上混合输出显示的图像显示处理系统、图像显示控制方法和图像显示处理装置，此外，还涉及在1个显示器上同时显示多个频道画面图像等的图像显示装置。The present invention relates to an image display processing system, an image display control method, and an image display processing device that transmit multiple input images through one transmission line and output and display them mixed on the same display screen. An image display device for a channel screen image, etc.

背景技术Background technique

在称为多媒体社会的现在，处理DVD、CATV、STB、数字电视(TV)等各种各样的图像信号的机会越来越多。并且，正在开发将这些多个图像信号向电脑(以下，简称为PC)等图像显示装置传输而用于与PC的图形系统同一进行处理的环境。In today's multimedia society, opportunities to deal with various image signals such as DVD, CATV, STB, and digital television (TV) are increasing. Furthermore, an environment in which these plurality of image signals are transmitted to an image display device such as a computer (hereinafter abbreviated as PC) and used for processing in the same manner as the graphics system of the PC is being developed.

这样，在需要将不特定的多个图像信号同时向图像显示装置传输时，为了可以与各个图像信号对应而预先设置多个传输线路是不现实的。因此，大多是采用将这些多个图像信号重叠或分时进行传输的方法。但是，在所传输的多个图像信号的最数据量增大时，传输线路的传输能力不足就成了问题。因此，以往如特开平6-324662号公报所提案的那样，是通过对其关心度高的图像进行高画质的图像压缩而对关心度低的图像进行低画质的图像压缩而进行传输，来减少图像信号的总数据量，从而可以得到高效的画质。In this way, when it is necessary to simultaneously transmit a plurality of unspecified image signals to an image display device, it is unrealistic to provide a plurality of transmission lines in advance so as to be able to correspond to each image signal. Therefore, a method of superimposing or time-dividing these multiple image signals is often employed. However, when the maximum data volume of a plurality of image signals to be transmitted increases, insufficient transmission capacity of the transmission line becomes a problem. Therefore, conventionally, as proposed in Japanese Unexamined Patent Publication No. 6-324662, high-quality image compression is performed on high-interest images and low-quality image compression is performed on low-interest images for transmission. To reduce the total amount of data of the image signal, so that an efficient image quality can be obtained.

但是，在上述先有技术中，需要多个压缩和解压电路。另外，在PC上或应用PC的图形系统的图像显示装置上，通常只准备了1个图形芯片的图像输入端口，对于这一点人们并未加以考虑。However, in the above prior art, a plurality of compression and decompression circuits are required. In addition, on a PC or an image display device using a PC graphics system, usually only one image input port of a graphics chip is prepared, and no consideration has been given to this point.

另外，还有以迄今的数字图像信号处理技术的性能提高和低成本化为背景将多个缩小的频道画面图像在2维平面上配置为矩阵状显示在一画面上的多频道画面显示。这样，便可方便地看到多个频道的情况，所以，也可以应用于频道的选择。另一方面，使用电脑等的三维图象处理技术最近也飞速地提高了性能和降低了成本，可以获得更具有现实感的图像，可以实现使自己产生宛如身临其境一样的错觉的三维虚拟空间等的视觉效果，作为更接近人的感觉的技术而受到关注。In addition, there is also a multi-channel screen display in which a plurality of reduced channel screen images are arranged in a matrix on a two-dimensional plane and displayed on one screen against the background of performance improvement and cost reduction of conventional digital image signal processing technology. In this way, the situation of multiple channels can be seen conveniently, so it can also be applied to the selection of channels. On the other hand, 3D image processing technology using computers etc. has recently rapidly improved performance and reduced costs, and can obtain more realistic images, and can realize 3D virtual images that give you the illusion of being there. Visual effects such as space are attracting attention as a technology closer to human perception.

现在，有线电视或数字卫星广播等已实现了可以收发先有的利用地面波的电视广播所不能比拟的大量的频道的电视广播系统，作为用户用于搜寻所希望的频道的手段之一，就是利用应用了上述2个技术的三维视觉效果的多频道画面显示系统。At present, TV broadcasting systems such as cable TV or digital satellite broadcasting have realized a large number of channels that can be transmitted and received that cannot be compared with conventional TV broadcasting using terrestrial waves. As one of the means for users to search for desired channels, it is A multi-channel screen display system that utilizes the 3D visual effects of the above two technologies.

图19是表示利用先有的三维视觉效果的多频道画面显示的三维处理的图像的图。FIG. 19 is a diagram showing a three-dimensionally processed image for multi-channel screen display using a conventional three-dimensional visual effect.

在利用先有的三维视觉效果的多频道画面显示中，如图19所示，在配置在虚拟三维空间内的虚拟平面701上粘贴多个频道画面，通过利用使对粘贴了多个频道画面的平面的视点702在虚拟三维空间内上下左右前后移动的三维视觉效果，可以在显示器画面上显示多频道全体或使特定的频道充满晰画面。In the conventional display of multi-channel screens using three-dimensional visual effects, as shown in FIG. The three-dimensional visual effect of the planar viewpoint 702 moving up, down, left, right, back and forth in the virtual three-dimensional space can display the entirety of multiple channels on the display screen or make a specific channel full of clear images.

图20是表示在进行多频道画面显示的图像显示装置中进行频道选择所使用的遥控装置的输入键的结构的一例的图。用户按下遥控装置的“多画面显示”的输入键时，多个频道的节目画面如图21(a)所示的那样，图像显示装置就显示配置为4×4的矩阵状的多频道画面。设置在遥控装置上的“左上”、“右上”、“左下”、“右下”的输入键表示将显示器画面分割为“左上”、“右上”、“左下”、“右下”的4个区域时的各位置，如图21(a)所示，在显示多频道显示画面的状态按下“左上”的键时，就选择了显示器画面的左上部分(包含频道1、2、5、6的画面的部分)，在显示器画面上通过改变例如这部分的颜色表示选择了该部分。并且，在该状态按下遥控装置的“选择”键时，图19中所示的视点702在虚拟三维空间内就向虚拟平面701的左上前方移动，显示器画面切换为图21(b)所示的(包含频道1、2、5、6的画面的多频道画面显示)画面。此外，在显示图21(b)的多频道画面显示的状态按下“左下”的键时，就选择了显示器画面的左下部分(频道5的画面)，按下“选择”键时，图19中所示的视点702在虚拟三维空间内就向虚拟平面701的左下前方移动，从而显示画面切换为图21(c)所示的画面。FIG. 20 is a diagram showing an example of a structure of an input key of a remote control device used for channel selection in an image display device that displays a multi-channel screen. When the user presses the input key of "multi-screen display" on the remote control device, the program screens of multiple channels are shown in Figure 21(a), and the image display device displays a multi-channel screen arranged in a matrix of 4×4 . The input keys of "upper left", "upper right", "lower left" and "lower right" arranged on the remote control device indicate that the display screen is divided into four "upper left", "upper right", "lower left" and "lower right" Each position in the region, as shown in Figure 21 (a), when the state of displaying the multi-channel display screen is pressed the "upper left" key, the upper left part of the display screen (including channels 1, 2, 5, 6) is selected. part of the screen), the part is selected on the display screen by changing, for example, the color of this part. And, when the "Select" key of the remote control device is pressed in this state, the viewpoint 702 shown in FIG. 19 moves to the upper left front of the virtual plane 701 in the virtual three-dimensional space, and the display screen switches to the one shown in FIG. 21(b). (Multi-channel screen display including screens of channels 1, 2, 5, and 6) screen. In addition, when the state of displaying the multi-channel screen display of Figure 21 (b) is pressed when the "lower left" key is pressed, the lower left part of the display screen (the screen of channel 5) is selected, and when the "select" key is pressed, the The viewpoint 702 shown in , moves to the lower left front of the virtual plane 701 in the virtual three-dimensional space, so that the display screen is switched to the screen shown in FIG. 21( c ).

但是，在进行这样的多频道画面显示的图像显示装置中，在选择多频道画面的一部分区域进行显示时，通过使视点在虚拟三维空间内接近粘贴了多个频道画面的虚拟平面，来缩小在显示器画面上进行透视变换而显示的虚拟平面的区域，在选择后的显示器画面上仅显示所选择的画面，已不再显示多频道画面的全体图像，所以，所选择的画面是配置显示在多频道画面的哪个区域的多频道画面与选择画面的位置关系在显示器画面上就不能确认。另外，从正在观看特定的频道画面切换到显示多频道画面全体时，也不能很容易地识别出此前所观看的频道画面是显示在多频道画面的哪个位置。此外，在先有的图像显示装置中，只是视点在虚拟三维空间内移动，多频道画面实际上是2维平面，所以，很难说充分发挥了三维视觉效果。However, in an image display device for displaying such a multi-channel screen, when a part of the multi-channel screen is selected for display, the view point is brought close to a virtual plane on which a plurality of channel screens are pasted in a virtual three-dimensional space, thereby reducing the size of the multi-channel screen. The area of the virtual plane displayed by perspective transformation on the monitor screen only displays the selected screen on the selected monitor screen, and no longer displays the overall image of the multi-channel screen. Therefore, the selected screen is configured and displayed in multiple channels. The positional relationship between the multi-channel screen and the selection screen in which area of the channel screen cannot be confirmed on the monitor screen. In addition, when switching from viewing a specific channel screen to displaying the entire multi-channel screen, it is not easy to recognize where the previously viewed channel screen is displayed on the multi-channel screen. In addition, in the conventional image display device, only the point of view moves in the virtual three-dimensional space, and the multi-channel picture is actually a two-dimensional plane, so it is hard to say that the three-dimensional visual effect is fully utilized.

发明内容Contents of the invention

本发明就是为了解决上述问题而提案的，目的旨在提供在PC上或应用PC的图形系统的图像显示装置上有效地利用传输线路的传输能力从而可以显示处理多个图像的图像控制方法、图像显示处理系统和图像处理装置，同时提供可以完全发挥三维视觉效果从而可以进行容易确认多频道画面与选择画面的位置关系的画面显示的图像显示装置。The present invention is proposed to solve the above problems, and the purpose is to provide an image control method and an image control method that can display and process multiple images by effectively utilizing the transmission capacity of the transmission line on a PC or an image display device using a PC graphics system. The display processing system and the image processing device simultaneously provide an image display device capable of fully displaying a three-dimensional visual effect so that the positional relationship between a multi-channel screen and a selection screen can be easily confirmed.

本发明的图像显示控制方法是使多个图像信号源的图像混合在同一画面上显示的图像显示控制方法，其特征在于：在图像显示部根据显示在上述画面上的各图像的显示状态决定各图像的显示优先度，并根据上述显示优先度决定是使用将多个图像信号源的图像分别按相等面积进行解像度变换并将经过解像度变换后的该多个图像合成为一个图像的合成方法、还是使用将多个图像信号源的图像分别按不同面积进行解像度变换并将经过解像度变换后的该多个图像合成为一个图像的合成方法，作为各图像的解像度变换中的解像度以及各图像的合成方法；通过传输线路向图像输入部传输上述决定的解像度和合成方法信息；在图像输入部根据上述决定的解像度变换各图像的解像度，并根据上述决定的合成方法将上述进行了解像度变换的图像合成为一副图像；通过传输线路传输上述合成的图像；以及在上述图像显示部根据上述决定的解像度和合成方法将上述传输来的合成图像分离，并显示上述分离后的各图像。The image display control method of the present invention is an image display control method in which images from a plurality of image signal sources are mixed and displayed on the same screen. The display priority of the image, and according to the above display priority, decide whether to use the synthesis method of performing resolution conversion on the images of multiple image signal sources in equal areas and combining the multiple images after the resolution conversion into one image, or Using a synthesis method that converts the resolutions of images from multiple image signal sources in different areas and synthesizes the multiple images after resolution conversion into a single image, as the resolution in the resolution conversion of each image and the synthesis method of each image ; transmit the above-mentioned determined resolution and synthesis method information to the image input unit through the transmission line; transform the resolution of each image according to the above-mentioned determined resolution at the image input unit, and synthesize the above-mentioned images with resolution conversion according to the above-mentioned determined synthesis method into An image; transmitting the synthesized image through a transmission line; and separating the transmitted synthesized image in the image display unit according to the determined resolution and synthesis method, and displaying the separated images.

按照这样的图像显示控制方法，由于将多个图像合成为一副图像，所以，可以削减所传输的图像数据量。另外，可以自动地决定显示优先度，从而可以将用户的关心度高的图像显示为高画质。According to such an image display control method, since a plurality of images are synthesized into one image, the amount of image data to be transmitted can be reduced. Also, the display priority can be automatically determined, so that an image of high user interest can be displayed with high quality.

本发明的图像显示控制方法的特征在于：在上述的图像显示控制方法中，上述显示优先度根据上述各图像的显示状态中各图像的显示尺寸的大小来决定。In the image display control method of the present invention, in the above image display control method, the display priority is determined based on the display size of each image in the display state of each image.

按照这样的图像显示控制方法，通过将显示尺寸大的图像变换为高解像度而将显示尺寸小的图像变换为低解像度而进行成分，可以将用户的关心度高的显示尺寸大的图像显示为高画质。According to such an image display control method, by converting an image with a large display size into a high-resolution image and converting an image with a small display size into a low-resolution image for composition, it is possible to display a large image with a large display size that is of high interest to the user as a high-resolution image. picture quality.

本发明的图像显示控制方法的特征在于：在上述的图像显示控制方法中，上述显示优先度根据上述各图像的显示状态中各图像的显示重叠的深度来决定。In the image display control method of the present invention, in the above image display control method, the display priority is determined based on the depth of display overlap of each image in the display state of each image.

按照这样的图像显示控制方法，通过将显示的重叠位于前面的图像变换为高解像度而将显示的重叠位于后面的图像变换为低解像度而进行合成，可以将用户的关心度高的显示的重叠位于前面的图像显示为高画质。According to such an image display control method, by converting the displayed superimposed image at the front into a high resolution and converting the displayed superimposed image at the back into a low resolution and compositing, it is possible to place the displayed superimposed image of high interest to the user at the lower resolution. The preceding image is displayed in high quality.

本发明的图像显示控制方法的特征在于：在上述的图像显示控制方法中，上述显示优先度根据上述各图像的显示状态中的各图像显示的可视面积的大小来决定。In the image display control method of the present invention, in the above image display control method, the display priority is determined based on the size of the visible area of each image display in the display state of each image.

按照这样的图像显示控制方法，通过将显示的可视面积大的图像变换为高解像度而将显示的可视面积小的图像变换为低解像度而进行合成，可以将用户的关心度高的显示的可视面积大的图像显示为高画质。According to such an image display control method, by converting a displayed image with a large viewing area into a high-resolution image and converting a displayed image with a small viewing area into a low-resolution image and combining them, it is possible to display images that are of high interest to the user. Images with a large viewable area are displayed in high quality.

本发明的图像显示控制方法的特征在于：在上述的图像显示控制方法中，上述显示优先度根据上述各图像的显示状态中各图像的显示是否为已聚焦的状态来决定。In the image display control method of the present invention, in the image display control method described above, the display priority is determined based on whether each image is displayed in a focused state among the display states of each image.

按照这样的图像显示控制方法，通过将已聚焦的图像变换为高解像度而将除此以外的图像变换为低解像度进行合成，可以将用户的关心度高的已聚焦的图像显示高画质。According to such an image display control method, by converting a focused image to a high resolution and converting other images to a low resolution and combining them, a focused image of high user interest can be displayed with high quality.

本发明的图像显示控制方法的特征在于：在上述的图像显示控制方法中，上述显示优先度根据上述各图像的显示状态中的各图像的显示时间的长度来决定。In the image display control method of the present invention, in the above image display control method, the display priority is determined based on the length of display time of each image in the display state of each image.

按照这样的图像显示控制方法，通过将显示时间长的图像变换为高解像度而将显示时间短的图像变换为低解像度进行合成，可以将用户的关心度高的显示时间长的图像显示为高画质。According to such an image display control method, by converting an image for a long display time into a high-resolution image and converting an image for a short display time into a low-resolution image for synthesis, it is possible to display a long-display image of high interest to the user in a high-resolution image. quality.

本发明的图像显示控制方法的特征在于：在上述的图像显示控制方法中，上述显示优先度根据上述各图像的显示状态中各图像的显示的顺序来决定。In the image display control method of the present invention, in the image display control method described above, the display priority is determined based on the display order of each image in the display state of each image.

按照这样的图像显示控制方法，通过将最近显示的图像变换为高解像度而将以前显示的图像变换为低解像度进行合成，可以将用户的关心度高的新显示的图像显示为高画质。According to such an image display control method, by converting the recently displayed image to high resolution and converting the previously displayed image to low resolution and compositing, it is possible to display a newly displayed image of high user interest in high quality.

本发明的图像显示控制方法的特征在于：在上述的图像显示控制方法中，上述显示优先度根据上述各图像的显示状态中各图像的显示形式来决定。In the image display control method of the present invention, in the image display control method described above, the display priority is determined based on the display format of each image in the display state of each image.

按照这样的图像显示控制方法，通过使纵横的解像度变换和合成方法与图像的显示形式一致，可以将用户的关心度高的图像显示为高画质。According to such an image display control method, by matching the vertical and horizontal resolution conversion and composition method with the image display format, it is possible to display an image of high user interest with high quality.

本发明的图像显示控制方法是使多个图像信号源的图像混合在同一画面上显示的图像显示控制方法，其特征在于：在图像显示部根据来自外部的用户操作决定各图像的显示优先度，并根据上述显示优先度决定是使用将多个图像信号源的图像分别按相等面积进行解像度变换并将经过解像度变换后的该多个图像合成为一个图像的合成方法、还是使用将多个图像信号源的图像分别按不同面积进行解像度变换并将经过解像度变换后的该多个图像合成为一个图像的合成方法，作为各图像的解像度变换中的解像度以及各图像的合成方法；通过传输线路向图像输入部传输上述决定的解像度和合成方法信息；在图像输入部根据上述决定的解像度变换各图像的解像度；根据上述决定的合成方法将上述进行了解像度变换的图像合成为一个图像；通过传输线路传输上述合成后的图像；以及在上述图像显示部，根据上述决定的解像度和合成方法将上述传输来的合成图像分离，并显示上述分离后的各图像。The image display control method of the present invention is an image display control method in which images from a plurality of image signal sources are mixed and displayed on the same screen. And according to the above-mentioned display priority, it is decided whether to use the method of converting the resolutions of the images of multiple image signal sources in equal areas and combining the multiple images after the resolution conversion into one image, or to use multiple image signals. The image of the source is subjected to resolution transformation according to different areas respectively and the multiple images after the resolution transformation are synthesized into a synthesis method of an image, as the resolution in the resolution transformation of each image and the synthesis method of each image; through the transmission line to the image The input unit transmits the above-mentioned determined resolution and synthesis method information; the image input unit converts the resolution of each image according to the above-mentioned determined resolution; synthesizes the above-mentioned resolution-converted images into one image according to the above-mentioned determined synthesis method; transmits through the transmission line The above-mentioned synthesized image; and in the above-mentioned image display unit, the above-mentioned transmitted composite image is separated according to the above-mentioned determined resolution and the composite method, and each of the above-mentioned separated images is displayed.

按照这样的图像显示控制方法，通过用户操作输入使所希望的图像显示为高画质，可以成为与用户的希望对应的显示画面。According to such an image display control method, a desired image can be displayed with high quality through user operation input, and a display screen corresponding to the user's desire can be obtained.

本发明的图像显示控制方法的特征在于：在上述的图像显示控制方法中，上述合成方法根据上述显示优先度将进行了解像度变换的各图像的纵横比固定而进行合成。In the image display control method of the present invention, in the image display control method described above, the combining method fixes the aspect ratio of each image subjected to resolution conversion according to the display priority and combines them.

按照这样的图像显示控制方法，在进行分离或显示时不必进行纵横比修正，可以直接使用所分离的图像。According to such an image display control method, it is not necessary to perform aspect ratio correction when performing separation or display, and the separated image can be used as it is.

本发明的图像显示控制方法的特征在于：在上述的图像显示控制方法中，上述合成方法根据上述显示优先度改变进行了解像度变换的各图像的纵横比而进行合成。The image display control method according to the present invention is characterized in that in the image display control method described above, the combining method changes the aspect ratio of each image subjected to resolution conversion according to the display priority to combine.

按照这样的图像显示控制方法，可以不浪费地传输并显示各图像。According to such an image display control method, each image can be transmitted and displayed without waste.

本发明的图像显示控制方法的特征在于：在上述的图像显示控制方法中，在上述图像显示部计算多个各图像在画面上进行虚拟三维显示所需要的参量，并使上述分离后的各图像按照上述计算的参量进行三维处理和显示。The image display control method of the present invention is characterized in that: in the above image display control method, the image display unit calculates the parameters required for virtual three-dimensional display of a plurality of images on the screen, and makes the separated images Perform three-dimensional processing and display according to the parameters calculated above.

按照这样的图像显示控制方法，可以有效地传输图像并进行虚拟三维显示。According to such an image display control method, images can be efficiently transmitted and virtually three-dimensionally displayed.

本发明的图像显示控制方法的特征在于：在上述的图像显示控制方法中，在上述图像输入部将上述合成的图像压缩，在上述图像显示部将上述压缩的合成图像解压。In the image display control method of the present invention, in the image display control method described above, the image input unit compresses the combined image, and the image display unit decompresses the compressed combined image.

按照这样的图像显示控制方法，可以削减所传输的图像数据量。According to such an image display control method, the amount of image data to be transmitted can be reduced.

本发明的图像显示控制方法的特征在于：在上述的图像显示控制方法中，在上述图像输入部将解像度变换和合成方法信息作为标题附加到上述合成后的图像数据中，在上述图像显示部解读附加了上述标题的合成图像的标题，并根据上述解读的信息将上述合成图像分离。The image display control method of the present invention is characterized in that in the image display control method described above, the image input unit adds resolution conversion and combination method information as a header to the combined image data, and the image display unit reads the information. A title of the synthesized image to which the above-mentioned title is attached, and the above-mentioned synthesized image is separated based on the information of the above-mentioned interpretation.

按照这样的图像显示控制方法，即使发生了传输延迟，在进行分离时也可以按可靠的时刻传输解像度变换和合成方法信息，所以，不会发生图像混乱。According to such an image display control method, even if a transmission delay occurs, the resolution conversion and composition method information can be transmitted at a reliable timing when separation is performed, so that image confusion does not occur.

本发明的图像显示处理系统是使多个图像信号源的图像在同一画面上混合显示的图像显示处理系统，其特征在于：设置有接收来自多个图像信号源的图像输入的图像输入部、对显示画面进行应显示的图像输出的图像显示部、以及将上述图像输入部与上述图像显示部连接的传输线路；其中，上述图像输入部包括：解像度变换·合成方法控制部，根据经由上述传输线路从上述图像显示部接收到的解像度变换·合成方法信息信号来控制上述多个图像信号源的各图像的解像度变换及合成方法；解像度变换部，根据需要将该多个图像中的每一个变换为由上述解像度变换·合成方法控制部指定的解像度；以及合成部，根据需要用由上述解像度变换·合成方法控制部指定的、将多个图像信号源的图像分别按相等面积进行解像度变换并将经过解像度变换后的该多个图像合成为一个图像的合成方法、和将多个图像信号源的图像分别按不同面积进行解像度变换并将经过解像度变换后的该多个图像合成为一个图像的合成方法中的任一种方法，将上述经解像度变换后的多个图像合成为一个图像；上述图像显示部具有将从上述图像输入部接收到的合成图像分离为原来的多个各图像的分离部、将上述分离后的多个图像同时显示在上述画面上的显示控制部、取得多个各图像的显示状态的状态取得部、以及根据取得的显示状态决定解像度·合成方法信息信号并向上述分离部和上述图像输入部输出的解像度·合成方法决定部。The image display processing system of the present invention is an image display processing system that displays images from a plurality of image signal sources in a mixed manner on the same screen, and is characterized in that an image input unit for receiving image input from a plurality of image signal sources is provided, An image display unit that outputs an image to be displayed on a display screen, and a transmission line that connects the above-mentioned image input unit to the above-mentioned image display unit; wherein, the above-mentioned image input unit includes: a resolution conversion/synthesis method control unit, based on the above-mentioned transmission line The resolution conversion and synthesis method of each image of the above-mentioned plurality of image signal sources is controlled from the resolution conversion and synthesis method information signal received by the above-mentioned image display unit; the resolution conversion unit converts each of the plurality of images into The resolution specified by the above-mentioned resolution conversion and synthesis method control section; and the synthesis section, if necessary, uses the resolution conversion of the images of a plurality of image signal sources in equal areas to be specified by the above-mentioned resolution conversion and synthesis method control section. A synthesis method for synthesizing the multiple images after resolution conversion into one image, and a synthesis method for performing resolution conversion on images from multiple image signal sources according to different areas and synthesizing the multiple images after resolution conversion into one image In any one of the methods, the above-mentioned multiple images after resolution conversion are synthesized into one image; the above-mentioned image display unit has a separating unit that separates the synthesized image received from the above-mentioned image input unit into a plurality of original images, A display control unit for simultaneously displaying the separated plurality of images on the screen, a state acquisition unit for acquiring the display status of each of the plurality of images, and a resolution/synthesis method information signal determined based on the acquired display status and sent to the separation unit and the resolution/synthesis method determination unit output by the above-mentioned image input unit.

按照这种结构的图像显示处理系统，在1系统的图像传输线路上将多个图像合成而进行传输，所以，可以削减所传输的图像数据量。此外，根据需要还根据显示优先度决定各图像的解像度和合成方法，所以，可以成为与用户的希望对应的显示画面。According to the image display processing system configured in this way, a plurality of images are synthesized and transmitted on the image transmission line of one system, so the amount of image data to be transmitted can be reduced. In addition, since the resolution and composition method of each image are determined according to the display priority as necessary, a display screen corresponding to the user's desire can be obtained.

本发明的图像显示处理系统是使多个图像信号源的图像在同一画面上混合显示的图像显示处理系统，其特征在于：设置有接收来自多个图像信号源的图像输入的图像输入部、对显示画面进行应显示的图像输出的图像显示部、以及将上述图像输入部与上述图像显示部连接的传输线路；其中，上述图像输入部包括：解像度变换·合成方法控制部，根据经由上述传输线路从上述图像显示部接收到的解像度变换·合成方法信息信号来控制上述多个图像信号源的各图像的解像度变换及合成方法；解像度变换部，根据需要将该多个图像中的每一个变换为由上述解像度变换·合成方法控制部指定的解像度；以及合成部，根据需要用由上述解像度变换·合成方法控制部指定的、将多个图像信号源的图像分别按相等面积进行解像度变换并将经过解像度变换后的该多个图像合成为一个图像的合成方法、和将多个图像信号源的图像分别按不同面积进行解像度变换并将经过解像度变换后的该多个图像合成为一个图像的合成方法中的任一种方法，将上述经解像度变换后的多个图像合成为一个图像；上述图像显示部具有将从上述图像输入部经上述传输线路接收的到合成图像分离为原来的多个各图像的分离部、用户进行操作输入的操作输入部、使上述分离后的多个图像同时显示在上述画面上的显示控制部、以及通过上述输入的操作决定解像度·合成方法信息信号并向上述分离部和上述图像输入部进行输出的解像度·合成方法决定部。The image display processing system of the present invention is an image display processing system that displays images from a plurality of image signal sources in a mixed manner on the same screen, and is characterized in that an image input unit for receiving image input from a plurality of image signal sources is provided, An image display unit that outputs an image to be displayed on a display screen, and a transmission line that connects the above-mentioned image input unit to the above-mentioned image display unit; wherein, the above-mentioned image input unit includes: a resolution conversion/synthesis method control unit, based on the above-mentioned transmission line The resolution conversion and synthesis method of each image of the above-mentioned plurality of image signal sources is controlled from the resolution conversion and synthesis method information signal received by the above-mentioned image display unit; the resolution conversion unit converts each of the plurality of images into The resolution specified by the above-mentioned resolution conversion and synthesis method control section; and the synthesis section, if necessary, uses the resolution conversion of the images of a plurality of image signal sources in equal areas to be specified by the above-mentioned resolution conversion and synthesis method control section. A synthesis method for synthesizing the multiple images after resolution conversion into one image, and a synthesis method for performing resolution conversion on images from multiple image signal sources according to different areas and synthesizing the multiple images after resolution conversion into one image In any one of the methods, the above-mentioned multiple images after the resolution conversion are synthesized into one image; the above-mentioned image display unit has a function of separating the synthesized image received from the above-mentioned image input unit through the above-mentioned transmission line into a plurality of original images The separation unit, the operation input unit for the user to perform operation input, the display control unit for simultaneously displaying the above-mentioned multiple separated images on the above-mentioned screen, and the resolution/synthesis method information signal determined by the above-mentioned input operation and sent to the above-mentioned separation unit A resolution/synthesis method determination unit for outputting with the above-mentioned image input unit.

按照这种结构的图像显示处理系统，在1系统的图像传输线路上将多个图像合成而进行传输，所以，可以削减所传输的图像数据量。此外，由于用户输入用于使所希望的图像成为高画质的操作，所以，可以成为与用户的希望对应的显示画面。According to the image display processing system configured in this way, a plurality of images are synthesized and transmitted on the image transmission line of one system, so the amount of image data to be transmitted can be reduced. In addition, since the user inputs an operation for making a desired image high-quality, a display screen corresponding to the user's desire can be obtained.

本发明的图像显示处理系统的特征在于：在上述的图像显示处理系统中，上述图像显示部还具有计算多个各图像在画面上进行虚拟三维显示所需要的参量的三维计算部和按照由三维计算部计算的参量将上述分离的多个各图像进行三维处理和显示的三维显示部，上述状态取得部从上述三维计算部取得多个各图像的显示状态。The image display processing system of the present invention is characterized in that in the above image display processing system, the image display unit further includes a three-dimensional calculation unit for calculating parameters required for virtual three-dimensional display of a plurality of images on the screen, and A three-dimensional display unit that three-dimensionally processes and displays the plurality of separated images with parameters calculated by the calculation unit, and the state acquisition unit acquires display states of the plurality of images from the three-dimensional calculation unit.

按照这种结构的图像显示处理系统，即使使用传输能力有限的传输线路，也可以进行有效的图像传输和虚拟三维显示。According to the image display processing system of this structure, effective image transmission and virtual three-dimensional display can be performed even if a transmission line with limited transmission capacity is used.

本发明的图像显示处理系统的特征在于：在上述的图像显示处理系统中，上述图像输入部还具有压缩上述合成图像的压缩部，上述图像显示部还具有将从上述图像输入部接收的压缩过的合成图像进行解压的解压部。The image display processing system of the present invention is characterized in that in the above image display processing system, the image input unit further includes a compression unit for compressing the synthesized image, and the image display unit further includes a compressed image received from the image input unit. The composite image is decompressed by the decompression section.

按照这种结构的图像显示处理系统，可以进一步削减传输的图像数据量，所以，可以有效地利用传输线路。According to the image display processing system configured in this way, the amount of image data to be transmitted can be further reduced, so that the transmission line can be effectively used.

本发明的图像显示处理系统的特征在于：在上述的图像显示处理系统中，上述图像输入部还具有根据上述解像度和合成方法信息信号生成特定的格式并附加到合成后的图像信号中的标题附加部，上述图像显示部还具有从附加到从上述图像输入部接收的合成图像信号中的标题中取出解像度和合成方法信息的标题分析部。The image display processing system of the present invention is characterized in that in the above image display processing system, the image input unit further includes a header that generates a specific format based on the resolution and synthesis method information signal and adds it to the synthesized image signal. The image display section further includes a header analysis section that extracts resolution and composition method information from a header added to the composite image signal received from the image input section.

按照这种结构的图像显示处理系统，在从图像输入部到图像显示部的传输线路中，即使发生了传输延迟，也可以按可靠的时刻向分离部传输解像度变换和合成方法信息，所以，图像不会发生混乱。According to the image display processing system of this structure, in the transmission line from the image input unit to the image display unit, even if a transmission delay occurs, the resolution conversion and synthesis method information can be transmitted to the separation unit at a reliable time, so the image There will be no confusion.

本发明的图像显示处理装置是在使多个图像信号源的图像在同一画面上混合显示的图像显示系统中使用的、可连接上述多个图像信号源的图像显示处理装置，其特征在于，包括：根据从上述图像显示部通过传输线路接收到的解像度·合成方法信息信号控制上述多个图像信号源的各图像的解像度变换和合成方法的解像度变换·合成方法控制部、根据需要将多个各图像变换为由上述解像度变换·合成方法控制部指定的解像度的解像度变换部和根据需要用由上述解像度变换·合成方法控制部指定的、对同一画面按等面积进行分割并在该多个分割画面上显示多个图像信号源的图像或者对同一画面按不同面积进行分割并在该多个分割画面上显示多个图像信号源的图像中的任一合成方法，将上述经解像度变换后的多个图像合成为一个图像的合成部。The image display processing device of the present invention is used in an image display system for mixing and displaying images from multiple image signal sources on the same screen, and is an image display processing device that can be connected to the above-mentioned multiple image signal sources, and is characterized in that it includes : The resolution conversion/synthesis method control unit that controls the resolution conversion and synthesis method of each image of the plurality of image signal sources based on the resolution/synthesis method information signal received from the above-mentioned image display unit through the transmission line, and a plurality of each A resolution conversion unit that converts the image into a resolution specified by the above-mentioned resolution conversion and synthesis method control unit, and divides the same screen into equal areas by dividing the same screen into equal areas according to the need and divides the same screen into the plurality of divided screens. Displaying images of multiple image signal sources on the same screen or dividing the same screen by different areas and displaying images of multiple image signal sources on the multiple split screens, combining the above-mentioned multiple resolution-converted Images are combined into a combined part of one image.

按照这种结构的图像显示处理装置，通过装配PC的扩展卡，可以实现与PC组合。According to this structure, the image display processing device can be combined with a PC by assembling the expansion card of the PC.

本发明的一种图像显示方法，其特征在于，包括：显示步骤，将配置了粘贴有图像的一个或多个虚拟平面的虚拟三维空间相对于配置在上述虚拟三维空间内的视点进行透视变换后显示在显示画面上；图像配置步骤，将图像粘贴到第1虚拟平面上，在上述虚拟三维空间内进行配置以使该第1虚拟平面的正面对着上述视点，同时在选择了上述第1虚拟平面的一部分区域时将粘贴在上述第1虚拟平面的所选择区域上的图像粘贴到与上述第1虚拟平面不同的第2虚拟平面上，使该第2虚拟平面在上述虚拟三维空间内位于比上述第1虚拟平面更靠近上述视点的位置，在将配置了上述第1、第2虚拟平面的上述虚拟三维空间进行透视变换时，上述第2虚拟平面被配置在在小于上述第1虚拟平面的整体大小的上述显示画面上进行显示的位置，以使其正面对着上述视点。An image display method of the present invention is characterized in that it includes: a display step, after performing perspective transformation on the virtual three-dimensional space configured with one or more virtual planes pasted with images relative to the viewpoint arranged in the above-mentioned virtual three-dimensional space Displayed on the display screen; the image configuration step is to paste the image on the first virtual plane, and configure it in the above-mentioned virtual three-dimensional space so that the front of the first virtual plane faces the above-mentioned viewpoint. Paste the image pasted on the selected area of the above-mentioned first virtual plane to a second virtual plane different from the above-mentioned first virtual plane, so that the second virtual plane is located at a relatively high position in the above-mentioned virtual three-dimensional space. The above-mentioned first virtual plane is closer to the above-mentioned viewpoint, and when perspective transformation is performed on the above-mentioned virtual three-dimensional space in which the above-mentioned first and second virtual planes are arranged, the above-mentioned second virtual plane is arranged at a position smaller than that of the above-mentioned first virtual plane. The display position on the above-mentioned display screen of the overall size is such that it faces the above-mentioned viewpoint.

按照这种结构的图像显示装置，可以实现能够进行很容易地确认全体画面与选择画面的位置关系的画面显示的图像显示装置。According to the image display device configured in this way, it is possible to realize an image display device capable of performing screen display for easily checking the positional relationship between the entire screen and the selected screen.

本发明的一种图像显示方法，其特征在于，包括：图像配置步骤，将图像粘贴到第1虚拟平面上，并将该第1虚拟平面配置到虚拟三维空间内，同时，在选择了上述第1虚拟平面的一部分区域时，将粘贴在上述第1虚拟平面的选择的区域上的图像粘贴到与上述第1虚拟平面不同的第2虚拟平面上，并将该第2虚拟平面在上述虚拟三维空间内配置为其正面对着基本上和上述第1虚拟平面的正面相同的方向；眺望视点位置计算步骤，计算在上述虚拟三维空间内可以看到上述第1和第2虚拟平面的全体的眺望视点位置；眺望显示步骤，将配置了多个虚拟平面的虚拟三维空间相对于配置在上述眺望视点位置的视点进行透视变换后进行显示。An image display method of the present invention is characterized in that it includes: an image configuration step, pasting the image on the first virtual plane, and disposing the first virtual plane into the virtual three-dimensional space, and at the same time, after the above-mentioned first virtual plane is selected 1 In the case of a part of the virtual plane, the image pasted on the selected area of the first virtual plane is pasted on a second virtual plane different from the first virtual plane, and the second virtual plane is placed on the virtual three-dimensional plane Arranging in the space such that the front is facing substantially the same direction as the front of the first virtual plane; the view viewpoint position calculation step is to calculate the overall view of the first and second virtual planes that can be seen in the virtual three-dimensional space The view point position; view display step is to display the virtual three-dimensional space in which a plurality of virtual planes are arranged after perspective transformation with respect to the view point arranged at the view point position.

按照这种结构的图像显示装置，可以俯瞰全体画面和选择画面的全体，从而可以实现能够很容易地确认全体画面与选择画面的位置关系的图像显示装置。According to the image display device configured in this way, it is possible to overlook the whole of the whole screen and the selection screen, so that the positional relationship between the whole screen and the selection screen can be easily confirmed.

本发明的图像显示方法的特征在于：在上述的图像显示方法中，在上述图像配置步骤中，对粘贴在上述第2虚拟平面上的图像进行获得透视效果的处理。The image display method of the present invention is characterized in that in the above image display method, in the image arranging step, the image pasted on the second virtual plane is processed to obtain a perspective effect.

按照这种结构的图像显示装置，可以更容易地确认在选择画面的背后显示的全体画面。According to the image display device configured in this way, it is possible to more easily confirm the entire screen displayed behind the selection screen.

本发明的图像显示方法的特征在于：在上述的图像显示方法中，粘贴在上述第1虚拟平面上的图像是包含多个频道画面图像的多频道显示图像，在上述第1虚拟平面中选择粘贴了上述多个频道画面图像中的1个或多个频道画面图像的图像的区域。The image display method of the present invention is characterized in that in the image display method above, the image pasted on the first virtual plane is a multi-channel display image including a plurality of channel screen images, and the image pasted on the first virtual plane is selected and pasted on the first virtual plane. The image area of one or more channel screen images among the above-mentioned plurality of channel screen images is defined.

按照这种结构的图像显示装置，可以充分发挥三维视觉效果，从而可以实现能够进行很容易确认多频道画面与选择画面的位置关系的画面显示的图像显示装置。According to the image display device configured in this way, the three-dimensional visual effect can be sufficiently exerted, and an image display device capable of displaying a screen that can easily confirm the positional relationship between the multi-channel screen and the selection screen can be realized.

本发明的图像显示方法的特征在于：在上述的图像显示方法中，具有频道选择频度存储步骤，存储在多频道显示画面上显示的多个频道的各自的选择频度；和配置决定步骤，根据在多频道显示画面上显示的多个频道的各自的选择频度来决定粘贴在上述第1虚拟平面上的多频道显示画面的多个频道画面图像的配置。The image display method of the present invention is characterized in that: in the above-mentioned image display method, there is a channel selection frequency storage step for storing respective selection frequencies of a plurality of channels displayed on the multi-channel display screen; and an arrangement determination step, The arrangement of the plurality of channel screen images pasted on the multi-channel display screen on the first virtual plane is determined according to the respective selection frequencies of the plurality of channels displayed on the multi-channel display screen.

按照这种结构的图像显示装置，可以按与选择频度相应的频道图像配置进行多频道画面显示，从而可以实现在使用多频道显示的频道选择操作中非常方便的图像显示装置。According to the image display device configured in this way, multi-channel screen display can be performed according to the channel image arrangement corresponding to the frequency of selection, thereby realizing an image display device which is very convenient for channel selection operation using multi-channel display.

本发明的图像显示方法的特征在于：在上述的图像显示方法中，具有配置信息存储步骤，存储各虚拟平面在虚拟三维空间内的配置信息和粘贴在各虚拟平面上的图像在虚拟平面上的配置信息；和图像配置再现步骤，使用该配置信息存储步骤中存储的配置信息来再现上述各虚拟平面在虚拟三维空间内的配置和粘贴在各虚拟平面上的图像在该虚拟平面上的配置。The image display method of the present invention is characterized in that: in the above image display method, there is a configuration information storing step of storing the configuration information of each virtual plane in the virtual three-dimensional space and the position of the image pasted on each virtual plane on the virtual plane. configuration information; and an image configuration reproducing step of reproducing the configuration of each virtual plane in the virtual three-dimensional space and the configuration of the image pasted on each virtual plane on the virtual plane using the configuration information stored in the configuration information storing step.

按照这种结构的图像显示装置，可以再现以前的显示，从而可以确认全体图像与选择图像的关系。According to the image display device configured in this way, the previous display can be reproduced, so that the relationship between the entire image and the selected image can be confirmed.

本发明的图像显示方法的特征在于：在上述的图像显示方法中，具有按指定的时间间隔顺序硅区域而选择上述第1虚拟平面的一部分区域和解除选择的区域选择单元。The image display method of the present invention is characterized in that in the image display method described above, there is an area selection unit for selecting and deselecting a part of the first virtual plane in order of silicon areas at predetermined time intervals.

按照这种结构的图像显示装置，可以实现能够顺序自动地放大全体画面的一部分的图像显示装置。According to the image display device configured in this way, an image display device capable of sequentially and automatically enlarging a part of the entire screen can be realized.

本发明的图像显示方法的特征在于：在上述图像配置步骤中，在将上述第2虚拟平面配置到上述虚拟三维空间内的上述位置时，根据粘贴在上述第2虚拟平面上的图像，在上述第2虚拟平面上进行特定的动画动作后配置到上述虚拟三维空间内的上述位置。The image display method of the present invention is characterized in that in the image arranging step, when arranging the second virtual plane at the position in the virtual three-dimensional space, the After performing a specific animation action on the second virtual plane, it is arranged at the above-mentioned position in the above-mentioned virtual three-dimensional space.

按照这种结构的图像显示装置，利用选择画面显示时的画面的动画动作，可以实现用户能够识别关于选择画面的附加的信息的图像显示装置。According to the image display device configured in this way, it is possible to realize an image display device in which the user can recognize additional information on the selection screen by using the animation motion of the screen when the selection screen is displayed.

附图说明Description of drawings

图1是本发明实施例1的图像显示处理系统的结构图。FIG. 1 is a structural diagram of an image display processing system according to Embodiment 1 of the present invention.

图2是表示本发明实施例1的图像显示处理系统的解像度变换和合成方法的例子的图。图2(a)是解像度变换和合成前的原来的图像，图2(b)是表示维持图2(a)的各图像的纵横比的进行间抽合成时的例子的图，图2(c)是改变图2(a)的各图像的纵横比而进行间抽合成时的例子的图。Fig. 2 is a diagram showing an example of a resolution conversion and synthesis method of the image display processing system according to Embodiment 1 of the present invention. Fig. 2(a) is the original image before resolution conversion and synthesis, Fig. 2(b) is a diagram showing an example of thinning and compositing while maintaining the aspect ratio of each image in Fig. 2(a), Fig. 2(c ) is a diagram of an example when the aspect ratio of each image in FIG. 2( a ) is changed to perform thinning synthesis.

图3是表示本发明实施例1的图像显示处理系统的画面显示的和与各画面显示对应的解像度变换和合成方法的例子的图。图3(a)是表示用户不注意画面上的特定的图像而均等地观看时的画面显示例的图，图3(b)是表示在画面上的1～4的图像中1为最大的视窗尺寸时的画面显示例的图，图3(c)是表示在画面上的1～4的图像中1的图像的重叠位于最前面时的画面显示例图，图3(d)是表示图3(a)时的解像度变换和合成方法的例子的图，图3(e)是表示图3(b)或图3(c)时的解像度变换和合成方法的例子的图。3 is a diagram showing an example of screen displays in the image display processing system according to Embodiment 1 of the present invention and a resolution conversion and composition method corresponding to each screen display. Fig. 3(a) is a diagram showing an example of screen display when the user does not pay attention to a specific image on the screen and views it uniformly, and Fig. 3(b) shows a window in which 1 is the largest among images 1 to 4 on the screen Figure 3(c) is a diagram showing an example of screen display when the image of 1 to 4 on the screen is superimposed on the front, and Figure 3(d) is a diagram showing an example of screen display in Figure 3 Figure 3 (e) is a diagram showing an example of the resolution conversion and synthesis method in Figure 3 (b) or Figure 3 (c).

图4是本发明实施例2的图像显示处理系统的结构图。Fig. 4 is a structural diagram of an image display processing system according to Embodiment 2 of the present invention.

图5是本发明实施例3的图像显示处理系统的结构图。Fig. 5 is a structural diagram of an image display processing system according to Embodiment 3 of the present invention.

图6是表示本发明实施例3的图像显示处理系统附加的标题的例子的图。Fig. 6 is a diagram showing an example of headers added by the image display processing system according to Embodiment 3 of the present invention.

图7是本发明实施例4的图像显示处理系统的结构图。Fig. 7 is a structural diagram of an image display processing system according to Embodiment 4 of the present invention.

图8是本发明实施例5的图像显示处理系统的结构图。Fig. 8 is a structural diagram of an image display processing system according to Embodiment 5 of the present invention.

图9是表示本发明实施例5的图像显示处理系统的画面显示的例子和与各画面显示对应的解像度变换和合成方法的例子的图，图9(a)是在画面上的图像1～4中图像1、4大而均等、图像2、3小而均等时的画面显示例，图9(b)是在画面上的图像1～4中图像1大、图像2、4小而均等、图像3位于背后时的画面显示例，图9(c)是表示图9(a)时的各图像的解像度变换和合成方法的例子的图，图9(d)是表示图9(b)时的各图像的解像度变换和合成方法的例子的图。Fig. 9 is a diagram showing an example of screen display of the image display processing system according to Embodiment 5 of the present invention and an example of a resolution conversion and synthesis method corresponding to each screen display, and Fig. 9(a) shows images 1 to 4 on the screen The screen display example when the images 1 and 4 are large and equal, and the images 2 and 3 are small and equal. Figure 9(b) shows that among the images 1 to 4 on the screen, the image 1 is large, the images 2 and 4 are small and equal, and the image 3 An example of the screen display when it is located behind, Fig. 9(c) is a diagram showing an example of the resolution conversion and synthesis method of each image in Fig. 9(a), Fig. 9(d) is a diagram showing an example A diagram of an example of the resolution conversion and synthesis method of each image.

图10是表示本发明实施例6的图像显示装置的结构的图。Fig. 10 is a diagram showing the configuration of an image display device according to Embodiment 6 of the present invention.

图11是表示本发明实施例6的图像显示装置中多频道画面显示的三维处理的图像的图。Fig. 11 is a diagram showing a three-dimensionally processed image displayed on a multi-channel screen in the image display device according to Embodiment 6 of the present invention.

图12是表示本发明实施例6的图像显示装置中虚拟三维空间内的图像配置和显示画面的具体例的图，图12(a)是表示在多频道画面显示中多频道显示频道1～16的节目画面时的图像平面与视点的关系的图，图12(b)是表示图12(a)的情况在显示器画面上显示的多频道画面显示的图。Fig. 12 is a diagram showing a specific example of image arrangement and display screen in a virtual three-dimensional space in the image display device according to Embodiment 6 of the present invention, and Fig. 12(a) shows that channels 1 to 16 are displayed in a multi-channel screen in multi-channel display. Figure 12(b) is a diagram showing the multi-channel picture displayed on the monitor screen in the case of Figure 12(a).

图13是表示本发明实施例6的图像显示装置中虚拟三维空间内的图像配置和显示画面的具体例的图，图13(a)是表示在多频道画面显示中选择“左上”的区域(包含频道1、2、5、6的画面的区域)进行显示时的虚拟平面601及602与视点604的关系的图，图13(b)是表示  在显示器画面上显示的多频道画面显示的图。13 is a diagram showing a specific example of the image arrangement and display screen in the virtual three-dimensional space in the image display device according to Embodiment 6 of the present invention, and FIG. 13 (b) is a diagram showing the multi-channel screen displayed on the display screen. .

图14是表示本发明实施例6的图像显示装置中虚拟三维空间内的图像配置和显示画面的具体例的图，图14(a)是表示在图13(b)所示的多频道画面显示中选择“左下”的区域(包含频道5的画面的区域)进行显示时的虚拟平面601、602及603与视点604的关系的图，图14(b)是表示在显示器画面上显示的画面显示的图。Fig. 14 is a diagram showing a specific example of an image arrangement and a display screen in a virtual three-dimensional space in an image display device according to Embodiment 6 of the present invention, and Fig. 14(a) shows a multi-channel screen display shown in Fig. 13(b) Figure 14(b) shows the screen display displayed on the monitor screen diagram.

图15是表示对配置在眺望视点位置的视点进行透视变换的本发明的图像显示装置的显示画面的一例的图。FIG. 15 is a diagram showing an example of a display screen of an image display device according to the present invention that performs perspective conversion on a viewpoint arranged at a viewing viewpoint position.

图16是表示本发明实施例7的图像显示装置的结构的图。Fig. 16 is a diagram showing the configuration of an image display device according to Embodiment 7 of the present invention.

图17是表示本发明实施例8的图像显示装置的结构的图。Fig. 17 is a diagram showing the configuration of an image display device according to Embodiment 8 of the present invention.

图18是表示本发明实施例8的图像显示装置中带动画动作的意义的例子的图。Fig. 18 is a diagram showing an example of the meaning of animated motion in the image display device according to the eighth embodiment of the present invention.

图19是用于说明先有的利用三维视觉效果的图像显示装置中的多频道画面显示的三维处理的图。FIG. 19 is a diagram for explaining three-dimensional processing of multi-channel screen display in a conventional image display device utilizing three-dimensional visual effects.

图20是表示为了使用多频道画面显示进行频道选择而使用的遥控装置的输入键的结构的一例的图。FIG. 20 is a diagram showing an example of a structure of an input key of a remote control device used to select a channel using a multi-channel screen display.

图21是表示先有的利用三维视觉效果的图像显示装置的显示图像的一例的图，图21(a)是表示配置为4×4的矩阵状的多频道画面的显示的图，图21(b)是表示如图21(a)所示的那样在显示多频道显示画面的状态顺序按下“左上”和“选择”键时氢的显示器画面的图，图21(c)是表示在显示图21(b)的多频道画面显示的状态按下“左下”的键时切换的显示画面的例子的图。Fig. 21 is a diagram showing an example of a display image of a conventional image display device using a three-dimensional visual effect, and Fig. 21(a) is a diagram showing a display of a multi-channel screen arranged in a 4×4 matrix, and Fig. 21( b) is a diagram showing the display screen of hydrogen when the "upper left" and "select" keys are pressed in sequence in the state of displaying the multi-channel display screen as shown in Figure 21 (a), and Figure 21 (c) shows A diagram of an example of a display screen switched when the "lower left" key is pressed in the state of multi-channel screen display in FIG. 21( b ).

具体实施方式Detailed ways

下面，参照附图说明本发明的实施例。这里所示的实施例仅仅是一例，不一定必须限定该实施例。Embodiments of the present invention will be described below with reference to the drawings. The embodiment shown here is just an example, and it is not necessarily limited to this embodiment.

实施例1.Example 1.

下面，参照附图说明本发明实施例1的图像显示处理系统。Next, an image display processing system according to Embodiment 1 of the present invention will be described with reference to the drawings.

图1是本发明实施例1的图像显示处理系统的全体结构图。在图1中，本实施例的图像显示处理系统是设置了接收多个图像信号源101(在本实施例中，是2个模拟系统、2个数字系统，共计4个系统)的图像输入的图像输入部100、向显示画面201进行应显示的图像输出的图像显示部200和将图像输入部100与图像显示部200连接的传输线路300的图像显示处理系统。FIG. 1 is an overall configuration diagram of an image display processing system according to Embodiment 1 of the present invention. In Fig. 1, the image display processing system of this embodiment is set to receive image input from a plurality of image signal sources 101 (in this embodiment, 2 analog systems, 2 digital systems, a total of 4 systems) An image display processing system of the image input unit 100 , the image display unit 200 outputting an image to be displayed to the display screen 201 , and the transmission line 300 connecting the image input unit 100 and the image display unit 200 .

将多个图像合成为一副而输出的图像输入部100由将模拟图像信号变换为数字图像信号的A/D变换器102、对数字图像信号根据需要将多个个图像变换为由解像度变换和合成方法控制部106指定的解像度的解像度变换部103、根据需要将上述解像度变换后的多个图像利用由上述解像度变换和合成方法控制部106指定的方法合成为一副图像的合成部104、通过传输线路300向图像显示部200发送合成后的数字图像信号并通过传输线路300从图像显示部200接收解像度和合成方法信息信号的收发部105和根据从图像显示部200接收的解像度和合成方法信息信号控制解像度变换和合成方法的解像度变换和合成方法控制部106构成。The image input unit 100 that synthesizes a plurality of images into one and outputs them is converted by an A/D converter 102 that converts an analog image signal into a digital image signal. The resolution conversion unit 103 of the resolution specified by the synthesis method control unit 106, and the synthesis unit 104 that synthesizes the plurality of images after the above-mentioned resolution conversion into one image by the method specified by the above-mentioned resolution conversion and synthesis method control unit 106 as required, The transmission line 300 transmits the synthesized digital image signal to the image display unit 200 and receives the resolution and synthesis method information signal from the image display unit 200 through the transmission line 300. The resolution conversion and synthesis method control unit 106 is constituted by the signal controlling the resolution conversion and synthesis method.

将所接收的合成图像分离为各图像进行显示的图像显示部200由通过传输线路300从图像输入部100接收合成图像的数字图像信号并通过传输线路300向图像输入部100发送解像度和合成方法信息信号的收发部202、根据从图像输入部100接收的合成图像分离为原来的4个系统的图像的分离部203、在用户独立地对4个系统的图像进行的显示操作的任意的显示状态将上述分离后的4个系统的各图像同时显示在上述画面201上的显示控制部204、取得多个各图像的显示状态的状态取得部205和根据从状态取得部205取得的显示状态决定解像度和合成方法信息信号的解像度和合成方法决定部206构成。作为这种结构的图像显示部200的例子，有视窗系统库的OS执行的PC的图形系统。画面201是与PC连接的显示器，作为例子，有CRT、LCD、仰视显示器等。The image display unit 200 that separates the received combined image into individual images for display receives the digital image signal of the combined image from the image input unit 100 through the transmission line 300 and transmits the resolution and combination method information to the image input unit 100 through the transmission line 300 The signal transmitting and receiving unit 202, the separating unit 203 that separates the synthesized image received from the image input unit 100 into the original four-system images, and the four-system images are displayed in any display state in which the user independently performs display operations on the four-system images. The display control unit 204 that simultaneously displays the images of the four separated systems on the above-mentioned screen 201, the status acquisition unit 205 that acquires the display status of a plurality of images, and determines the resolution and resolution based on the display status acquired from the status acquisition unit 205. The resolution of the synthesis method information signal and the determination unit 206 are composed of the synthesis method. As an example of the image display unit 200 having such a configuration, there is a graphics system of a PC executed by an OS of a Windows system library. The screen 201 is a display connected to the PC, and examples include CRT, LCD, and head-up displays.

传输线路300连接在图像输入部100与图像显示部200之间，传输合成图像的图像信号与解像度和合成方法信息信号。The transmission line 300 is connected between the image input unit 100 and the image display unit 200 , and transmits an image signal, a resolution, and a synthesis method information signal of a synthesized image.

下面，说明实施例1的图像显示处理系统的动作。Next, the operation of the image display processing system of the first embodiment will be described.

首先，图像信号源101向图像输入部100发送模拟信号或数字信号。作为模拟的图像信号源的例子，有NTSC制式的录像机、DVD播放机、光盘、电视调谐器等，作为数字的图像信号源的例子，有PC用数字TV接收端口、PC用MPEG译码器端口、PC用视频接收端口等。First, the image signal source 101 transmits an analog signal or a digital signal to the image input unit 100 . Examples of analog image signal sources include NTSC video recorders, DVD players, optical discs, and TV tuners. Examples of digital image signal sources include digital TV receiving ports for PCs and MPEG decoder ports for PCs. , PC video receiving port, etc.

在从图像信号源101接收的信号是模拟图像信号时，A/D变换器102将模拟图像信号采样并向解像度变换部103传送数字的图像信号。如果图像信号源101是NTSC或PAL等制式的格式时，就进而进行NTSC/PAL译码处理等。作为输出的数字的图像信号形式的例子，有8位Y/C、16位Y/C、24位RGB等。When the signal received from the image signal source 101 is an analog image signal, the A/D converter 102 samples the analog image signal and sends the digital image signal to the resolution conversion unit 103 . If the image signal source 101 is in the format of NTSC or PAL, etc., NTSC/PAL decoding processing and the like are further performed. Examples of the output digital image signal format include 8-bit Y/C, 16-bit Y/C, 24-bit RGB, and the like.

并且，解像度变换部103发送所接收的数字图像信号。合成部104将所接收的4个系统的数字图像信号数据分别进行帧同步处理，同时合成为一副图像，并将合成的数字图像信号向收发部105发送。收发部105将由合成部104合成后的数字图像信号数据通过传输线路300向收发部202传送。收发部202将所接收的数字图像信号数据向分离部203传送，分离部203将所接收的数字图像信号分离为原来的4个图像。并且，显示控制部204独立地将这4个图像进行重叠到通常的PC的电脑图像上的处理，并驱动用于显示该图像的画面201。Then, the resolution conversion unit 103 transmits the received digital image signal. The synthesizing unit 104 performs frame synchronization processing on the received digital image signal data of the four systems, synchronously synthesizes one image, and transmits the synthesized digital image signal to the transmitting and receiving unit 105 . The transmitting and receiving unit 105 transmits the digital image signal data synthesized by the combining unit 104 to the transmitting and receiving unit 202 through the transmission line 300 . The transceiver unit 202 transmits the received digital image signal data to the separation unit 203 , and the separation unit 203 separates the received digital image signal into four original images. Then, the display control unit 204 independently superimposes these four images on a computer image of a normal PC, and drives the screen 201 for displaying the images.

状态取得部205是由PC执行的OS的功能，从显示控制部204取得在画面201上显示的各图像的视窗的尺寸、重叠及显示时间等的显示状态，并根据上述显示状态决定各图像的显示优先度。并且，解像度和合成方法决定部206根据所决定的上述显示优先度，利用软件计算并决定各图像的解像度变换中的解像度和各图像的合成方法，并将解像度和合成方法信息信号向收发部202和分离部203传送。收发部202通过传输线路300向收发部105传送所接收的解像度和合成方法信息信号。收发部105接收解像度和合成方法信息信号，并向解像度变换和合成方法控制部106传输。解像度变换和合成方法控制部106将所接收的解像度变换和合成方法信息信号中的4个系统的图像的解像度变换信息分别向解像度变换部103传输，同时，将指示4个图像的图像的合成模式的合成方法信息信号向合成部104传输。The status acquisition unit 205 is a function of the OS executed by the PC, and acquires the display status of each image displayed on the screen 201 from the display control unit 204, such as the window size, overlapping, and display time, and determines the status of each image based on the display status. Show priority. And, the resolution and composition method determination unit 206 calculates and determines the resolution and the composition method of each image in the resolution conversion of each image by using software based on the above-mentioned determined display priority, and sends the resolution and composition method information signal to the transmitting and receiving unit 202. and the separating unit 203 to transmit. The transceiver unit 202 transmits the received resolution and synthesis method information signal to the transceiver unit 105 through the transmission line 300 . The transceiver unit 105 receives the resolution and synthesis method information signal, and transmits it to the resolution conversion and synthesis method control unit 106 . The resolution conversion and synthesis method control unit 106 transmits the resolution conversion information of the images of the four systems in the received resolution conversion and synthesis method information signal to the resolution conversion unit 103, and at the same time, indicates the synthesis mode of the images of the four images. The synthesis method information signal of is transmitted to the synthesis unit 104.

解像度变换部103对所接收的数字图像信号根据解像度变换和合成方法控制部106的解像度变换信号进行解像度的变换，并发送解像度变换后的数字图像信号。制式，也进行用于防止图像畸变的滤波处理。作为解像度变换的例子，预先准备了将纵横分别间抽为1/2、1/4、3/4的变换、将纵维持为1/1而将横间抽为1/2、1/4、3/4的变换、将横维持为1/1而将纵间抽为1/2、1/4、3/4的变换等多个变换模式，对于滤波处理，使用分配给各变换模式的适当的滤波系数。The resolution conversion unit 103 converts the resolution of the received digital image signal according to the resolution conversion signal of the resolution conversion and synthesis method control unit 106, and transmits the digital image signal after the resolution conversion. system, filter processing for preventing image distortion is also performed. As an example of resolution conversion, the conversion of vertical and horizontal decimation to 1/2, 1/4, and 3/4, respectively, and horizontal decimation to 1/2, 1/4, and 3/4 conversion, and multiple conversion modes such as 1/1 horizontal and vertical thinning 1/2, 1/4, 3/4, etc., for filtering processing, use the appropriate filter coefficient.

并且，合成部104使由解像度变换部103进行了解像度变换的4个系统的图像分别首先帧同步、按由解像度变换和合成方法控制部106的合成方法信号指定的模式合成为一副图像，并向收发部105传送，从而通过传输线路300向收发部202传输。In addition, the synthesizing unit 104 synthesizes the images of the four systems whose resolutions have been converted by the resolution converting unit 103 into one image in a frame-synchronized manner according to the pattern specified by the synthesis method signal of the resolution conversion and synthesis method control unit 106, and The data is transmitted to the transmitting and receiving unit 105 , and then transmitted to the transmitting and receiving unit 202 through the transmission line 300 .

收发部105是将由合成部104合成后的数字图像信号数据向传输线路300发送或将从传输线路300接收的解像度和合成方法信息信号向解像度变换和合成方法控制部106传输的通信接口，作为例子，有作为PC的图形系统的图像输入端口的标准规格的VIP(VideoInterface Port)或PC内部的PCI/AGP总线、LAN/因特网等网络的接口等。The transceiver unit 105 is a communication interface that transmits the digital image signal data synthesized by the synthesis unit 104 to the transmission line 300 or transmits the resolution and synthesis method information signal received from the transmission line 300 to the resolution conversion and synthesis method control unit 106, as an example. , there is a VIP (Video Interface Port) of the standard specification as the image input port of the graphics system of the PC or the interface of the PCI/AGP bus, LAN/Internet and other networks inside the PC.

收发部202接收从传输线路300传输来的数字图像信号数据，并向分离部203传输。分离部203将从收发部202输入的合成数字图像信号分离为原来的4个图像。这时，根据解像度和合成方法决定部206的解像度和合成方法信息决定在合成图像上的各图像的坐标等，从而进行适当的分离动作。显示控制部204将这4个图像独立地叠加到通常的PC的电脑图像上，为了显示该图像而驱动画面201。分离部203和显示控制部204起PC的图形芯片内部的功能。The transceiver unit 202 receives the digital image signal data transmitted from the transmission line 300 and transmits it to the separation unit 203 . The separation unit 203 separates the synthesized digital image signal input from the transmission and reception unit 202 into four original images. At this time, the coordinates of each image on the combined image are determined based on the resolution and combining method information of the resolution and combining method determining unit 206, and an appropriate separation operation is performed. The display control unit 204 superimposes these four images independently on a normal PC computer image, and drives the screen 201 to display the image. The separation unit 203 and the display control unit 204 function inside the graphics chip of the PC.

在本发明的图像处理系统中，根据在画面上显示的各图像的显示优先度来决定显示优先度，并变换各图像的解像度，但是，各图像的显示优先度根据各图像的显示尺寸、显示的重叠状态、显示的可视面积、显示是否已聚焦的状态、显示时间的长度、显示的顺序以及显示的形式来决定。In the image processing system of the present invention, the display priority is determined based on the display priority of each image displayed on the screen, and the resolution of each image is converted. However, the display priority of each image depends on the display size, display It is determined by the overlapping state of the display, the visible area of the display, the state of whether the display is focused, the length of the display time, the order of the display, and the form of the display.

这里，所谓显示优先度，就是用户对各图像的关心度，即根据用户想看各图像的程度而决定的应显示的图像的顺序，按照该顺序来调整显示图像的品质(大小、画质等)。Here, the so-called display priority refers to the user's degree of concern for each image, that is, the order of the images to be displayed is determined according to the degree to which the user wants to see each image, and the quality (size, quality, etc.) of the displayed image is adjusted according to this order. ).

下面，参照图2说明在本发明实施例1的图像显示处理系统中根据上述解像度变换而得到的合成方法的例子。Next, an example of a synthesis method obtained by the above-mentioned resolution conversion in the image display processing system according to Embodiment 1 of the present invention will be described with reference to FIG. 2 .

在图2中，图2(a)是在显示画面上显示的原来的图像，图2(b)是将图2(a)的各图像的纵横比固定而进行间抽合成时的例子，图2(c)是改变图2(a)的各图像的纵横比而进行间抽合成时的例子。In FIG. 2, FIG. 2(a) is the original image displayed on the display screen, and FIG. 2(b) is an example when the aspect ratio of each image in FIG. 2(a) is fixed and thinning is performed. 2(c) is an example in which the aspect ratio of each image in FIG. 2(a) is changed to perform thinning synthesis.

如图2(b)所示，维持图2(a)的各图像的纵横比进行间抽而合成时，在图像显示部200中可以直接使用所分离的各图像，但是，用于在合成画面上将形成间隙，所以，传输线路300的使用效率将降低。另一方面，如图2(c)所示，进行不维持图2(a)的各图像的纵横比的间抽合成时，传输线路300的使用效率良好，但是，在图像显示部200中进行各图像的分离处理或显示控制处理时必须进行纵横比的修正。As shown in FIG. 2( b ), when the aspect ratio of each image in FIG. 2( a ) is maintained for thinning and compositing, the separated images can be directly used in the image display unit 200. A gap will be formed, so the use efficiency of the transmission line 300 will be reduced. On the other hand, as shown in FIG. 2( c ), when the thinning synthesis that does not maintain the aspect ratio of each image in FIG. 2( a ) is performed, the use efficiency of the transmission line 300 is good. Correction of the aspect ratio is necessary for separation processing of each image or display control processing.

下面，使用图3说明在本发明实施例1的图像显示处理系统中解像度和合成方法决定部206根据在画面201上的显示和取得该显示状态的状态取得部205的信息计算各图像的解像度和合成方法的例子。Next, in the image display processing system according to Embodiment 1 of the present invention, the resolution and synthesis method determination unit 206 calculates the resolution and synthesis method of each image based on the display on the screen 201 and the information of the state acquisition unit 205 which acquires the display state. Examples of synthetic methods.

图3(a)、图3(b)、图3(c)是在画面上1～4的各图像的显示例。图3(d)、图3(e)是与图3(a)、图3(b)、图3(c)对应的图像的解像度变换和合成方法的例子。3( a ), FIG. 3( b ), and FIG. 3( c ) are display examples of the images 1 to 4 on the screen. FIG. 3( d ) and FIG. 3( e ) are examples of image resolution conversion and synthesis methods corresponding to FIG. 3( a ), FIG. 3( b ), and FIG. 3( c ).

在图3(a)中，是判定用户不注意特定的图像而均等地观看从而如图3(d)所示的那样决定解像度和合成方法的例子。在图3(b)中，是判定最大视窗尺寸的1的图像最受用户注目从而如图3(e)所示的那样维持纵横比不变来决定解像度和合成方法的例子。在图3(c)中，是判定重叠在最前面的视窗1的图像最受用户注目同样如图3(e)所示的那样来决定解像度和合成方法的例子。In FIG. 3( a ), it is determined that the user does not pay attention to a specific image and views it uniformly, and determines the resolution and composition method as shown in FIG. 3( d ). In FIG. 3( b ), it is determined that the image with a maximum window size of 1 is the most attractive to the user, and the resolution and composition method are determined while maintaining the aspect ratio as shown in FIG. 3( e ). In FIG. 3( c ), it is determined that the image of the window 1 superimposed on the front is the most attractive to the user, and the resolution and composition method are determined as shown in FIG. 3( e ).

下面，说明在上述结构的图像显示处理系统中如图3(a)和图3(b)所示的那样用户操作在画面上显示的图像时的动作的例子。Next, an example of operation when the user operates an image displayed on the screen as shown in FIGS. 3( a ) and 3 ( b ) in the image display processing system configured as described above will be described.

为了简单起见，这里假定4个系统的输入图像和合成后的图像的尺寸相同。现在，显示控制部204动作以使在画面201上各图像成为图3(a)所示的那样的显示状态。状态取得部205取得各图像的显示尺寸相等并且不重叠的状态，所以，解像度和合成方法决定部206指示将各图像的解像度维持着纵横比而分别将纵横缩小为1/2，并如图3(d)所示的那样合成为一副图像。该指示向图像输入部100的解像度变换和合成方法控制部106传输。各图像的解像度变换部103指示将各图像的解像度维持着纵横比而将纵横分别缩小为1/2，所以，在使用1/2间抽用的滤波系数进行滤波处理后，进行间抽处理。在合成部104中，将均等地缩小为1/2的图像按照图3(d)的模式进行合成并输出。在图像显示部200的分离部203中，由于通过解像度和合成方法决定部206已知道通过传输线路300传送来的图像是如图3(d)所示的那样合成的，所以，可以将各图像在适当的区域进行分离处理，并向显示控制部204输出。For simplicity, it is assumed here that the input images and the synthesized images of the four systems are of the same size. Now, the display control unit 204 operates so that each image is displayed on the screen 201 as shown in FIG. 3( a ). The state acquisition unit 205 acquires the state that the display sizes of the images are equal and do not overlap each other, so the resolution and synthesis method determination unit 206 instructs to maintain the aspect ratio of the resolution of each image and reduce the vertical and horizontal dimensions to 1/2 respectively, as shown in FIG. 3 As shown in (d), it is synthesized into an image. This instruction is transmitted to the resolution conversion and synthesis method control unit 106 of the image input unit 100 . The resolution conversion unit 103 of each image instructs to reduce the resolution of each image to 1/2 while maintaining the aspect ratio, so the thinning process is performed after filtering using the filter coefficient for 1/2 thinning. In the synthesizing unit 104, the images uniformly reduced to 1/2 are synthesized according to the pattern of FIG. 3(d) and output. In the separation unit 203 of the image display unit 200, since the resolution and synthesis method determination unit 206 knows that the images transmitted through the transmission line 300 are synthesized as shown in FIG. Separation processing is performed on an appropriate area and output to the display control unit 204 .

这里，假定用户操作显示控制部204使各图像在画面201上成为图3(b)所示的那样的显示状态。状态取得部205取得图3(b)的1的图像用比其他3个图像大的视窗进行显示的状态。解像度和合成方法假定部206根据由状态取得部205取得的各图像的视窗尺寸信息，指示图3(b)的1的图像的解像度维持着纵横比而将纵横分别缩小为3/4，而其他3个图像的解像度维持着纵横比而将纵横分别缩小为1/4，从而如图3(e)所示的那样合成为一副图像。该指示向图像输入部100的解像度变换和合成方法控制部106。各图像的解像度变换部103中与图3(b)的1的图像对应的图像的解像度变换部103指示将图像的解像度维持着纵横比而将纵横分别缩小为3/4，所以，在使用3/4间抽用的滤波系数进行滤波处理后，进行间抽处理。另外，与其他3个图像对应的解像度变换部103指示将各自的图像的解像度维持着纵横比而将纵横分别缩小为1/4，所以，在使用1/4间抽用的滤波系数进行滤波处理后，进行间抽处理。在合成部104中，将变换为不同的解像度的图像按图3(e)所示的那样进行合成并输出。在图像显示部20的分离部203中，由于通过解像度和合成方法决定部206已知道通过传输线路300传送来的图像是如图3(e)所示的那样合成的，所以，可以将各图像在适当的区域进行分离处理，并向显示控制部204输出。Here, it is assumed that the user operates the display control unit 204 so that each image is displayed on the screen 201 as shown in FIG. 3( b ). The status acquiring unit 205 acquires a status in which the image 1 in FIG. 3( b ) is displayed in a larger window than the other three images. The resolution and composition method assumption unit 206, based on the window size information of each image acquired by the state acquisition unit 205, instructs that the resolution of the image 1 in FIG. The resolutions of the three images are reduced to 1/4 while maintaining the aspect ratio, and are synthesized into one image as shown in FIG. 3( e ). This instruction is sent to the resolution conversion and synthesis method control unit 106 of the image input unit 100 . Among the resolution conversion units 103 of the images, the resolution conversion unit 103 of the image corresponding to the image 1 in FIG. The filter coefficients used for /4 thinning are subjected to filtering processing, and then thinning processing is performed. In addition, the resolution converting unit 103 corresponding to the other three images instructs to reduce the vertical and horizontal resolutions to 1/4 while maintaining the aspect ratio of the respective images. Then, perform thinning processing. In the synthesizing unit 104, the images converted into different resolutions are synthesized as shown in FIG. 3(e) and output. In the separation unit 203 of the image display unit 20, since the resolution and synthesis method determination unit 206 knows that the images transmitted through the transmission line 300 are synthesized as shown in FIG. Separation processing is performed on an appropriate area and output to the display control unit 204 .

如上所述，按照本发明实施例1的图像显示处理系统，在使多个图像信号源的图像在同一画面上混合显示的图像显示处理系统中，设置有接收多个图像信号源的图像的输入的图像输入部、向显示画面进行应显示的图像的输出的图像显示部和将上述图像输入部和上述图像显示部连接的传输线路；上述图像输入部具有根据通过上述传输线路从上述图像显示部接收的解像度和合成方法信息信号控制上述多个图像信号源的各图像的解像度变换和合成方法的解像度变换和合成方法控制部、根据需要将多个各图像变换为由上述解像度变换和合成方法控制部指定的解像度的解像度变换部和根据需要将上述解像度变换后的多个图像利用由上述解像度变换和合成方法控制部指定的方法合成为一副图像的合成部；上述图像显示部具有将从上述图像输入部接收的合成图像分离为原来的多个各图像的分离部、将上述分离后的多个图像同时显示在上述画面上的显示控制部、取得多个各图像的显示状态的状态取得部和根据取得的显示状态决定解像度和合成方法信息信号并向上述分离部和上述图像输入部输出的解像度和合成方法决定部，利用这样的结构来决定各图像的显示优先度，根据上述显示优先度变换各图像的解像度变换中的解像度，同时使传输的图像数据的总量维持为与传输线路的能力一致而进行显示，所以，使用传输能力有限的传输线路也可以进行有效的图像传输和显示。另外，由于是将多个图像合成为一副图像后进行传输的，所以，与通常只具有1个图像输入端口的PC的图形系统的亲和性高。As described above, according to the image display processing system of Embodiment 1 of the present invention, in the image display processing system that allows images from multiple image signal sources to be mixed and displayed on the same screen, an input device for receiving images from multiple image signal sources is provided. an image input unit, an image display unit that outputs an image to be displayed on a display screen, and a transmission line connecting the image input unit and the image display unit; The received resolution and synthesis method information signal controls the resolution conversion and synthesis method control section of each image of the above-mentioned plurality of image signal sources, and converts a plurality of each image into a picture controlled by the above-mentioned resolution conversion and synthesis method as needed. The resolution conversion part of the resolution specified by the part and the synthesis part that synthesizes a plurality of images after the above-mentioned resolution conversion into one image according to the method specified by the above-mentioned resolution conversion and synthesis method control part; the above-mentioned image display part has The composite image received by the image input unit is separated into a plurality of original images, a display control unit is used to simultaneously display the separated images on the screen, and a state acquisition unit is configured to acquire the display status of each image. and the resolution and synthesis method determination unit that determines the resolution and synthesis method information signal based on the obtained display state and outputs the information signal to the separation unit and the image input unit, and uses such a structure to determine the display priority of each image. By changing the resolution of each image during the resolution conversion and displaying while maintaining the total amount of transmitted image data in accordance with the capacity of the transmission line, effective image transmission and display can be performed even using a transmission line with limited transmission capacity. In addition, since multiple images are synthesized into one image and transmitted, it has a high affinity with the graphics system of a PC that generally has only one image input port.

实施例2.Example 2.

下面，说明实施例2的图像显示处理系统。Next, the image display processing system of Embodiment 2 will be described.

图4是本发明实施例2的图像显示处理系统的全体结构图。在图4中，207是操作输入部，由用户进行操作输入。Fig. 4 is an overall configuration diagram of an image display processing system according to Embodiment 2 of the present invention. In FIG. 4, 207 is an operation input part, and a user performs an operation input.

在图4中，对于和图1相同或相当的结构要素使用相同的符号，并省略其说明。In FIG. 4 , the same reference numerals are used for the same or corresponding components as those in FIG. 1 , and description thereof will be omitted.

下面，说明实施例2的图像显示处理系统的动作。Next, the operation of the image display processing system of the second embodiment will be described.

在图像显示部200中，在画面上显示的多个图像中用户想使所希望的图像成为高画质时，就将用于变换各图像的解像度的操作输入操作输入部207。并且，解像度和合成方法决定部206根据输入的操作决定解像度和合成方法，并将解像度和合成方法信息信号向分离部203和收发部202传输。In the image display unit 200 , when the user wants to increase the image quality of a desired image among a plurality of images displayed on the screen, the user inputs an operation for changing the resolution of each image to the operation input unit 207 . Furthermore, the resolution and composition method determination unit 206 determines the resolution and the composition method according to the input operation, and transmits the resolution and composition method information signal to the separation unit 203 and the transceiver unit 202 .

用于实施例2与实施例1几乎相同，所以，省略其共同部分的说明。Since Example 2 is almost the same as Example 1, description of the common parts will be omitted.

如上所述，按照实施例2的图像显示处理系统，在使多个图像信号源的图像在同一画面上混合显示的图像显示处理系统中，设置有接收多个图像信号源的图像的输入的图像输入部、向显示画面进行应显示的图像的输出的图像显示部和将上述图像输入部和上述图像显示部连接的传输线路；上述图像输入部具有根据通过上述传输线路从上述图像显示部接收的解像度和合成方法信息信号控制上述多个图像信号源的各图像的解像度变换和合成方法的解像度变换和合成方法控制部、根据需要将多个各图像变换为由上述解像度变换和合成方法控制部指定的解像度的解像度变换部和根据需要将上述解像度变换后的多个图像利用由上述解像度变换和合成方法控制部指定的方法合成为一副图像的合成部；上述图像显示部具有将从上述图像输入部接收的合成图像分离为原来的多个各图像的分离部、用户进行操作输入的操作输入部、使上述分离后的多个图像同时显示在上述画面上的显示控制部和利用上述输入的操作决定解像度和合成方法信息信号并向上述分离部和上述图像输入部输出的解像度和合成方法决定部，通过利用这样的结构，用户输入用于使所希望的图像显示为高画质的操作，可以成为与用户的希望相应的显示画面。As described above, according to the image display processing system of Embodiment 2, in the image display processing system for displaying images from a plurality of image signal sources in a mixed manner on the same screen, an image display system that receives input images from a plurality of image signal sources is provided. An input unit, an image display unit that outputs an image to be displayed on a display screen, and a transmission line connecting the image input unit and the image display unit; The resolution and synthesis method information signal controls the resolution conversion and synthesis method control section of each image of the above-mentioned plurality of image signal sources, and converts a plurality of each image as required by the above-mentioned resolution conversion and synthesis method control section. The resolution conversion part of the resolution of the above-mentioned resolution and the synthesis part that synthesizes a plurality of images after the above-mentioned resolution conversion into one image according to the method specified by the above-mentioned resolution conversion and synthesis method control part; the above-mentioned image display part has input from the above-mentioned image The combined image received by the unit is separated into a plurality of original images by a separation unit, an operation input unit is operated by a user, a display control unit is used to simultaneously display the separated plurality of images on the screen, and an operation using the input is performed. The resolution and synthesis method determination unit that determines the resolution and synthesis method information signal and outputs it to the separation unit and the image input unit can use such a configuration to allow the user to input an operation for displaying a desired image with high image quality. It becomes a display screen according to the user's wish.

实施例3.Example 3.

下面，说明实施例3的图像显示处理系统。图5是本发明实施例3的图像显示处理系统的全体结构图。在图5中，107是标题附加部，根据所接收的解像度和合成方法信息信号按一定的格式生成解像度和合成方法信号，并附加到所接收的数字图像信号的消隐数据部分。208是标题分析部，从所接收的带标题的数字图像信号中仅解释标题部分，从而取出合成的图像的各图像的解像度和合成方法信息。Next, the image display processing system of Embodiment 3 will be described. Fig. 5 is an overall configuration diagram of an image display processing system according to Embodiment 3 of the present invention. In FIG. 5 , 107 is a header appending unit, which generates a resolution and synthesis method signal in a certain format based on the received resolution and synthesis method information signal, and adds it to the blanking data portion of the received digital image signal. 208 is a header analysis unit that interprets only the header part from the received digital image signal with headers, and extracts the resolution and synthesis method information of each image to be synthesized.

在图5中，对于和图1相同或相当的结构要素使用相同的符号，并省略其说明。In FIG. 5 , the same reference numerals are used for the same or corresponding constituent elements as in FIG. 1 , and description thereof will be omitted.

图6是本发明实施例3的图像显示处理系统的标题附加部107附加的标题400的一例。如图6所示，在标题400中包含了各图像的纵横尺寸、在合成后的图像上各图像的最左上的点坐标信息，与各图像连续地排列在一起。FIG. 6 is an example of a title 400 added by the title adding unit 107 of the image display processing system according to Embodiment 3 of the present invention. As shown in FIG. 6 , the header 400 includes the vertical and horizontal dimensions of each image and the coordinate information of the uppermost left point of each image on the synthesized image, and is continuously arranged with each image.

下面，说明实施例3的图像显示处理系统的动作。Next, the operation of the image display processing system of the third embodiment will be described.

在图像输入部100中，标题附加部107根据从解像度变换和合成方法控制部106通过合成部104接收的解像度和合成方法信息信号按一定的格式生成解像度和合成方法信号，并将标题400附加到从合成部104接收的数字图像信号的消隐数据部分，并向收发部105输出。In the image input unit 100, the header adding unit 107 generates a resolution and combining method signal in a certain format based on the resolution and combining method information signal received from the resolution converting and combining method control unit 106 through the combining unit 104, and adds the header 400 to the image input unit 100. The data portion of the digital image signal received from the combining unit 104 is blanked and output to the transmitting and receiving unit 105 .

在图像显示部200中，标题分析部208从所接收的带标题400的数字图像信号中仅解释标题400部分，取出合成的图像的各图像的解像度和合成方法信息，并向分离部203输出。分离部203根据所接收的解像度和合成方法信息进行各图像的适当的分离动作，另一方面，接收带标题的数字图像信号，但是，用于标题附加在消隐数据部分，所以，不会对原来的图像有任何影响。In the image display unit 200 , the header analysis unit 208 interprets only the header 400 part from the received digital image signal with the header 400 , extracts the resolution and synthesis method information of each image of the synthesized image, and outputs it to the separation unit 203 . Separation unit 203 performs appropriate separation of each image based on the received resolution and synthesis method information. On the other hand, it receives a digital image signal with a header. The original image has no effect.

与实施例1不同的是，在图像显示部200中取消了从解像度和合成方法决定部206向分离部203输出的解像度和合成方法信息信号、在图像输入部100中将从图像显示部200通过传输线路300接收的解像度变换和合成方法信息信号向标题附加部107传输以及在图像显示部200中将收发部202的合成的图像的数字图像信号向标题分析部208输出并将分析结果向分离部203输出等。The difference from Embodiment 1 is that in the image display unit 200, the resolution and synthesis method information signal output from the resolution and synthesis method determination unit 206 to the separation unit 203 is cancelled, and in the image input unit 100, the information signal from the image display unit 200 is passed. The resolution conversion and synthesis method information signal received by the transmission line 300 is transmitted to the header addition unit 107, and the digital image signal of the synthesized image of the image display unit 202 is output to the header analysis unit 208 in the image display unit 200, and the analysis result is sent to the separation unit. 203 output, etc.

本实施例3以附加到实施例1上的形式实施的，所以，对于和实施例1共同的部分省略其说明。Embodiment 3 is implemented in addition to Embodiment 1, and therefore descriptions of parts common to Embodiment 1 are omitted.

如上所述，按照本发明实施例3的图像显示处理系统，在实施例1所述的图像显示处理系统中，在上述图像输入部中将解像度变换和合成方法信息作为标题附加到上述合成后的图像数据上，在上述图像显示部中解读附加了上述标题的合成图像的标题，并根据上述解读的信息分离上述合成图像，所以，图像输入部在变更多个图像的解像度和合成方法的同时将该解像度和合成方法信息附加到合成后的数字图像信号上并向图像显示部传输，在图像显示部解读所附加的解像度和合成方法信息的同时可以进行适当的各图像的切换区域控制，所以，解释在传输线路这发生图像数据的传输延迟，也可以按可靠的时刻进行图像输入部和图像显示部的控制。As described above, according to the image display processing system according to the third embodiment of the present invention, in the image display processing system according to the first embodiment, in the image input section, information on the resolution conversion and synthesis method is added as a header to the synthesized image. On the image data, the title of the synthesized image to which the title is added is interpreted by the image display unit, and the synthesized image is separated based on the information of the interpretation, so that the image input unit changes the resolution and the synthesis method of a plurality of images at the same time. The resolution and synthesis method information are added to the synthesized digital image signal and transmitted to the image display unit, and the image display unit can perform appropriate switching area control for each image while interpreting the added resolution and synthesis method information. , explaining that the transmission delay of image data occurs in the transmission line, and the control of the image input unit and the image display unit can also be performed at a reliable time.

实施例4.Example 4.

下面，说明实施例4的图像显示处理系统。Next, the image display processing system of Embodiment 4 will be described.

图7是本发明实施例4的图像显示处理系统的全体结构图。在图7中，108是压缩部，压缩合成的图像。209是解压部，将压缩的合成图像解压。Fig. 7 is an overall configuration diagram of an image display processing system according to Embodiment 4 of the present invention. In FIG. 7, 108 is a compression part which compresses the combined image. 209 is a decompression unit that decompresses the compressed composite image.

在图7中，对于和图1相同或相当的结构要素使用相同的符号，并省略其说明。In FIG. 7 , the same reference numerals are used for the same or corresponding components as those in FIG. 1 , and description thereof will be omitted.

下面，说明实施例4的图像显示处理系统的动作。Next, the operation of the image display processing system of the fourth embodiment will be described.

在图像输入部100中，压缩部108使用MPEG这样的图像数据压缩技术将从合成部104接收的合成图像的数字图像信号压缩，并将压缩数据向收发部105输出。在图像显示部200中，解压部209将从收发部202接收的压缩数据解压，并向分离部203输出。本实施例4是以附加到实施例1上的形式进行实施的，所以，对于和实施例1共同的部分省略其说明。In the image input unit 100 , the compression unit 108 compresses the digital image signal of the synthesized image received from the synthesis unit 104 using an image data compression technique such as MPEG, and outputs the compressed data to the transmission and reception unit 105 . In the image display unit 200 , the decompression unit 209 decompresses the compressed data received from the transmission and reception unit 202 and outputs it to the separation unit 203 . Embodiment 4 is implemented in addition to Embodiment 1, and therefore descriptions of parts common to Embodiment 1 are omitted.

如上所述，按照本发明实施例4的图像显示处理系统，在实施例1～实施例3的任一实施例所述的图像显示处理系统中，上述图像输入部进而具有将上述合成图像压缩的压缩部，上述图像显示部进而具有将从上述图像输入部接收的压缩过的合成图像解压的解压部，利用这样的结构，对一副图像将合成图像进行压缩、传输和解压，所以，如果合成图像的纵横尺寸相同，就可以削减合成图像的总数据量，从而可以进行有效的传输，另外，如果合成图像的总数据量相同，在进行解像度变换时就可以维持高的解像度，从而可以传输解像度更高的图像。As described above, according to the image display processing system according to Embodiment 4 of the present invention, in the image display processing system according to any one of Embodiments 1 to 3, the image input unit further has a function for compressing the composite image. The compression unit, the above-mentioned image display unit further has a decompression unit for decompressing the compressed composite image received from the above-mentioned image input unit. With such a structure, the composite image is compressed, transmitted and decompressed for one image. Therefore, if the composite If the vertical and horizontal dimensions of the images are the same, the total data volume of the synthesized images can be reduced, enabling efficient transmission. In addition, if the total data volume of the synthesized images is the same, a high resolution can be maintained during resolution conversion, so that the resolution can be transmitted. higher image.

实施例5.Example 5.

下面，说明实施例5的图像显示处理系统。Next, the image display processing system of Embodiment 5 will be described.

图8是本发明实施例5的图像显示处理系统的全体结构图。在图8中，210是三维计算部，计算在画面201上进行各图像的虚拟三维显示所需要的参量。211是三维显示处理部，按照三维计算部210计算的参量对各图像进行三维处理。Fig. 8 is an overall configuration diagram of an image display processing system according to Embodiment 5 of the present invention. In FIG. 8 , 210 is a three-dimensional calculation unit that calculates parameters required for virtual three-dimensional display of each image on the screen 201 . 211 is a three-dimensional display processing unit, which performs three-dimensional processing on each image according to the parameters calculated by the three-dimensional calculation unit 210 .

在图8中，对于和图1相同或相当的结构要素使用相同的符号，并省略其说明。In FIG. 8 , the same reference numerals are used for the same or corresponding components as those in FIG. 1 , and description thereof will be omitted.

下面，说明实施例5的图像显示处理系统的动作。Next, the operation of the image display processing system of the fifth embodiment will be described.

在图像显示部200中，三维(3D)计算部210计算各图像在画面210上的虚拟3D显示所需要的参量，从分离部203接收的各图像的图像数据由3D显示处理部211按照上述3D计算部210计算的测量进行3D处理，并向显示控制部204输出。状态取得部205从3D计算部210取得各图像的显示状态，并向解像度和合成方法决定部206传输。In the image display unit 200, the three-dimensional (3D) calculation unit 210 calculates the parameters required for the virtual 3D display of each image on the screen 210, and the image data of each image received from the separation unit 203 is processed by the 3D display processing unit 211 according to the above-mentioned 3D display. The measurements calculated by the calculation unit 210 are processed in 3D and output to the display control unit 204 . The status acquisition unit 205 acquires the display status of each image from the 3D calculation unit 210 and transmits the display status to the resolution and composition method determination unit 206 .

图9是在本发明实施例5的图像显示处理系统中各图像在画面201上的虚拟三维显示和解像度和合成方法决定部206根据取得其显示状态的状态取得部205的信息计算各图像的解像度和合成方法的例子。在图9中，图9(a)、图9(b)是画面显示的例子，图9(c)、图9(d)分别是与图9(a)、图9(b)对应的各图像的解像度变换和合成方法的例子。Fig. 9 is the virtual three-dimensional display of each image on the screen 201 in the image display processing system according to Embodiment 5 of the present invention, and the resolution and synthesis method determination unit 206 calculates the resolution of each image according to the information obtained by the state acquisition unit 205 which acquires its display state and examples of synthetic methods. In Fig. 9, Fig. 9(a) and Fig. 9(b) are examples of screen display, and Fig. 9(c) and Fig. 9(d) are respectively corresponding to Fig. 9(a) and Fig. 9(b). Examples of image resolution conversion and compositing methods.

图9(a)是各图像在虚拟三维空间内自动地围绕着中心旋转时某一瞬间的画面201的例子。图像“1”、“4”大，并以相等的大小显示，图像“2”、“3”小，并以相等的大小显示。解像度和合成方法决定部206在状态取得部205取得该显示状态时，就推断图像“1”、“4”比图像“2”、“3”的注目度高，从而决定图像“1”、“4”如图9(c)所示的那样变换为比较高的解像度进行合成，而图像“2”、“3”变换为比较低的解像度进行合成。FIG. 9( a ) is an example of a screen 201 at a certain moment when each image automatically rotates around the center in the virtual three-dimensional space. Images "1", "4" are large and displayed in equal size, and images "2", "3" are small and displayed in equal size. When the state acquisition unit 205 acquires the display state, the resolution and synthesis method determination unit 206 infers that the images “1” and “4” are more attention-grabbing than the images “2” and “3”, and determines the images “1” and “3”. 4" is converted to a relatively high resolution and synthesized as shown in FIG. 9(c), while images "2" and "3" are converted to a relatively low resolution and synthesized.

在该画面显示中，各图像的显示状态是纵长横短，所以，在纵方向就不进行间抽，而仅在横方向进行间抽。In this screen display, since each image is displayed vertically and horizontally, thinning is not performed in the vertical direction, and thinning is performed only in the horizontal direction.

其次，假定各图像在虚拟三维空间内围绕轴中心旋转而如图9(b)所示的那样在画面201上显示。图像“1”大而图像“2”、“4”小并以相等的大小显示。图像“3”隐藏在背后不显示。解像度和合成方法决定部206在状态取得部205取得该显示状态时就推断图像“1”的注目度比图像“2”、“4”高，由于图像“3”不在画面201上显示，所以，判定图像“3”的数据不需要，从而决定图像“1”变换为高解像度进行合成，而图像“2”、“4”变换为比较低的解像度进行合成。Next, it is assumed that each image is displayed on the screen 201 as shown in FIG. 9( b ) while being rotated around the axis in the virtual three-dimensional space. Image "1" is large and images "2", "4" are small and displayed in equal size. The image "3" is hidden behind and not displayed. When the state acquisition unit 205 acquires the display state, the resolution and composition method determination unit 206 infers that the image “1” has a higher degree of attention than the images “2” and “4”. Since the image “3” is not displayed on the screen 201, It is determined that the data of the image "3" is unnecessary, and thus it is determined that the image "1" is converted into a high resolution for synthesis, and the images "2" and "4" are converted into a relatively low resolution for synthesis.

本实施例5是以附加到实施例1上的形式实施的，所以，对于和实施例1共同的部分省略其说明。Embodiment 5 is implemented in addition to Embodiment 1, and therefore descriptions of parts common to Embodiment 1 are omitted.

如上所述，按照本发明实施例5的图像显示处理系统，在实施例1～实施例4的任一实施例所述的图像显示处理系统中，上述图像显示部进而具有计算多个各图像在画面上的虚拟三维显示所需要的参量的三维计算部和对上述分离的多个各图像按照由三维计算部计算的参量进行三维处理和显示的三维显示部，上述状态取得部从上述三维计算部取得多个各图像的显示状态，所以，使用传输能力有限的传输线路也可以进行有效的图像传输和虚拟三维显示。另外，由于将多个图像合成为一副图像后进行传输，所以，在PC的图形系统通常只具有1个图像输入端口的图形芯片进行3D显示处理时，将结构组织从任意的区域分离并粘贴到虚拟三维画面上的方式与PC的图形系统的亲和性高。As mentioned above, according to the image display processing system according to Embodiment 5 of the present invention, in the image display processing system according to any one of Embodiment 1 to Embodiment 4, the image display unit further has A three-dimensional calculation unit for parameters required for virtual three-dimensional display on the screen, and a three-dimensional display unit for performing three-dimensional processing and display on the plurality of separated images according to the parameters calculated by the three-dimensional calculation unit. Since a plurality of display states of each image are obtained, effective image transmission and virtual three-dimensional display can be performed even using a transmission line with limited transmission capacity. In addition, since multiple images are synthesized into one image and then transmitted, when the graphics chip of the PC graphics system generally has only one image input port for 3D display processing, the structural organization is separated from an arbitrary area and pasted The method to go onto the virtual three-dimensional screen has a high affinity with the graphics system of the PC.

实施例6.Example 6.

下面，说明实施例6的图像显示装置。Next, an image display device according to Embodiment 6 will be described.

图10是表示实施例6的图像显示装置的结构的图。FIG. 10 is a diagram showing the configuration of an image display device according to Embodiment 6. FIG.

实施例6的图像显示装置构成可以进行多频道显示的电视接收装置，和先有例所示的一样，可以将多个频道的节目画面并列在显示器显示画面上进行显示。The image display device of the sixth embodiment constitutes a television receiving device capable of multi-channel display, and can display program images of a plurality of channels in parallel on the display screen of the monitor, as in the prior example.

在图10中，501是接收用户的操作的操作部、502是显示图像的显示部、503是进行多个频道显示画面的配置控制的多频道配置控制部、504是多频道调谐器控制部、505是具有多个调谐器并按照多频道调谐器控制部504的指示选择各频道的调谐部、506是根据多频道配置控制部503的信息将各频道显示画面配置到虚拟三维空间内进行阴影处理和视点移动处理等从而进行用于可在2维的显示部502上进行显示的透视变换的三维处理部。In FIG. 10 , 501 is an operation unit for receiving user operations, 502 is a display unit for displaying images, 503 is a multi-channel arrangement control unit for controlling the arrangement of a plurality of channel display screens, 504 is a multi-channel tuner control unit, 505 is a tuner unit that has a plurality of tuners and selects each channel according to the instruction of the multi-channel tuner control unit 504, and 506 is arranging the display screens of each channel in a virtual three-dimensional space according to the information of the multi-channel tuner control unit 503 for shadow processing A three-dimensional processing unit that performs perspective transformation for display on the two-dimensional display unit 502 by performing viewpoint shift processing and the like.

下面，说明实施例6的图像显示装置的各部分的动作。Next, the operation of each part of the image display device of the sixth embodiment will be described.

操作部501由例如图20所示的遥控装置和遥控装置的操作信号接收单元构成，接收在多频道画面显示中的块的选择、解除操作、从别的角度向视点的切换操作、或在不使用多频道画面的画面上的频道选择操作等用户对图像显示装置的操作，并向多频道配置控制部503传输。The operation unit 501 is composed of, for example, a remote control device and an operation signal receiving unit of the remote control device shown in FIG. User operations on the image display device, such as channel selection operations on the screen using the multi-channel screen, are transmitted to the multi-channel arrangement control unit 503 .

显示部502将由三维处理部506处理过的图像在画面上显示。The display unit 502 displays the image processed by the three-dimensional processing unit 506 on the screen.

多频道配置控制部503根据操作部501接收的操作输入选择影在显示部502内显示的频道并将选择频道信息通知多频道调谐器控制部504，同时向三维处理部506输出多个频道显示图像在虚拟三维空间内的配置信息和视点位置信息。The multi-channel configuration control unit 503 selects the channel to be displayed on the display unit 502 according to the operation input received by the operation unit 501, and notifies the multi-channel tuner control unit 504 of the selected channel information, and simultaneously outputs a plurality of channel display images to the three-dimensional processing unit 506. Configuration information and viewpoint position information in the virtual three-dimensional space.

多频道调谐器控制部504从多频道配置控制部503接收选择频道信息，并进行调谐部505的控制，用以接收由选择频道信息表示的频道。The multi-channel tuner control unit 504 receives the selected channel information from the multi-channel configuration control unit 503, and controls the tuner unit 505 to receive the channel indicated by the selected channel information.

调谐部505具有多个调谐器，按照多频道调谐器控制部504的指示选择各频道。The tuner unit 505 has a plurality of tuners, and selects each channel according to an instruction from the multi-channel tuner control unit 504 .

三维处理部506根据从多频道配置控制部503传输来的频道画面配置信息将各频道画面配置到虚拟三维空间内，在进行阴影处理和视点移动处理等后进行用于可以在2维的显示部502上进行显示的透视变换。The three-dimensional processing unit 506 arranges each channel screen in a virtual three-dimensional space according to the channel screen configuration information transmitted from the multi-channel configuration control unit 503, and performs shadow processing and viewpoint movement processing for the display unit that can display in two dimensions. 502 to perform perspective transformation for display.

图11是表示实施例6的图像显示装置中多频道画面显示的三维处理的图像的图，在图11中，601是第1虚拟平面、602是第2虚拟平面、603是第3虚拟平面、604是视点。三维处理部506在本实施例的图像显示装置中选择在画面上显示的图像的一部分进行放大显示时，如在先有例中所示的三维处理那样不是使视点相对于配置在虚拟三维空间内的虚拟平面的位置学虚拟三维空间内移动，而是如图11所示的那样作成仅粘贴了粘贴到第1虚拟平面中所选择的区域上的图像的第2虚拟平面，不使该第2虚拟平面在虚拟三维空间内比第1虚拟平面更靠近视点的位置，这样，便只有所选择的图像才利用在虚拟三维空间内靠近视点而进行显示的三维视觉效果进行图像显示。11 is a diagram showing a three-dimensionally processed image displayed on a multi-channel screen in the image display device of Embodiment 6. In FIG. 11, 601 is a first virtual plane, 602 is a second virtual plane, 603 is a third virtual plane, 604 is a viewpoint. When the three-dimensional processing unit 506 selects a part of the image displayed on the screen for enlarged display in the image display device of this embodiment, it does not place the viewpoint relative to the virtual three-dimensional space as in the three-dimensional processing shown in the conventional example. The position of the virtual plane moves within the virtual three-dimensional space, but as shown in FIG. The virtual plane is located closer to the viewpoint in the virtual three-dimensional space than the first virtual plane, so that only the selected image is image-displayed with a three-dimensional visual effect displayed near the viewpoint in the virtual three-dimensional space.

下面，说明实施例6的图像显示装置的具体的画面显示动作。Next, a specific screen display operation of the image display device of the sixth embodiment will be described.

在用户按下图20所示的遥控装置的“多画面显示”的输入键时，作为应在显示部502内显示的频道，多频道配置控制部503就选择例如频道1～频道16，并将选择的频道通知多频道调谐器控制部504。多频道调谐器控制部504就从多频道配置控制部503接收选择频道信息，进行调谐部505的控制，用以接收由选择频道信息表示的频道(频道1～频道16)。三维处理部506根据从多频道配置控制部503供给的频道画面配置信息将从调谐部505输入的各频道画面以4×4的矩阵状粘贴到第1虚拟平面601上，配置到虚拟三维空间内，相对于配置在虚拟平面601的正面的视点604进行透视变换。显示部502将由三维处理部506进行了透视变换的图像显示在显示器画面上。图12(a)是表示在多频道画面显示中进行多频道显示频道1～频道16的节目画面时虚拟平面601与视点604的关系的图，图12(b)是表示这时显示在显示器画面上的多频道画面显示的图。设置在图20的遥控装置上的“左上”、“右上”、“左下”、“右下”的输入键是表示将显示器画面分割为“左上”、“右上”、“左下”、“右下”的4个区域时的各位置，在显示图12(b)所示的多频道显示画面的状态按下“左上”的键时，就选择显示器画面的左上部分(包含频道1、2、5、6的画面的部分)，在显示器画面上就使例如该部分的颜色改变等，来表示选择了该部分。并且，在该状态按下了遥控装置的“选择”键时，三维处理部506就根据从多频道配置控制部503供给的频道画面配置信息将粘贴在第1虚拟平面601中选择的区域上的图像(频道1、2、5、6的节目画面)以2×2的矩阵状粘贴到新的第2虚拟平面602上，视点604的位置保持不变，使第2虚拟平面602在虚拟三维空间内位于比第1虚拟平面601更靠近视点604的位置，将配置了第1、第2虚拟平面的虚拟三维空间进行透视变换时，第2虚拟平面602配置在比第1虚拟平面601全体的大小小的显示位置，其正面(粘贴了图像的面)对着视点604，在该状态将虚拟三维空间全体相对于视点604进行透视变换。在第1虚拟平面601的选择的区域粘贴了图像的地方采用拔白、涂黑或背景色显示等。显示部502将由三维处理部506进行了透视变换的图像显示在显示器画面上。图13(a)是表示在多频道画面显示中选择“左上”的区域(包含频道1、2、5、6的画面的区域)进行显示时的虚拟平面601、602与视点604的关系的图，图13(b)是表示在显示器画面上显示的多频道画面显示的图。通过将第2虚拟平面602在虚拟三维空间内如上述那样配置并进行透视变换，在显示器画面上，粘贴在第1虚拟平面601中选择的区域上的图像就放大显示在第1虚拟平面601的前面，另外，在第2虚拟平面602的周围显示配置在后面的第1虚拟平面601的一部分。这样，在放大显示所选择的画面时，通过在显示器画面上显示多频道画面的全体像的一部分，用户便可很容易地确认多频道画面与选择画面的位置关系。此外，如图13(b)所示，在显示多频道显示画面的状态按下了“左下”的键时，就选择在显示器画面中显示在前面的2×2的矩阵状的多频道画面显示的左下部分(频道5的画面)，在按下“选择”键时，三维处理部506就根据从多频道配置控制部503供给的频道画面配置信息将粘贴在第2虚拟平面602中选择的区域上的图像(频道5的节目画面)粘贴到新的第3虚拟平面603上，视点604的位置保持不变，使第3虚拟平面603在虚拟三维空间内位于比第2虚拟平面602更靠近视点604的位置，在将配置了第1、第2、第3虚拟平面的虚拟三维空间进行透视变换时，第3虚拟平面603配置到显示在比第2虚拟平面602全体的带小的显示画面上的位置，其正面(粘贴了图像的面)对着视点604，在该状态将虚拟三维空间全体相对于视点604进行透视变换。第2虚拟平面602的选择的区域粘贴了图像的地方进行拔白、涂黑或背景色显示等。显示部502将由三维处理部506进行了透视变换的图像显示在显示器画面上。图14(a)是表示在图13(b)所示的多频道画面显示中选择“左下”的区域(包含频道5的画面的区域)进行显示时的虚拟平面601、602、603与视点604的关系的图，图14(b)是表示这时显示在显示器画面上的画面显示的图。When the user presses the input key of "multi-screen display" of the remote control device shown in FIG. The selected channel is notified to the multi-channel tuner control unit 504 . The multi-channel tuner control unit 504 receives the selected channel information from the multi-channel configuration control unit 503, and controls the tuner unit 505 to receive the channels (channel 1 to channel 16) indicated by the selected channel information. The three-dimensional processing unit 506 pastes each channel screen input from the tuner unit 505 in a 4×4 matrix on the first virtual plane 601 based on the channel screen arrangement information supplied from the multi-channel arrangement control unit 503, and arranges them in the virtual three-dimensional space , perspective transformation is performed with respect to the viewpoint 604 arranged on the front side of the virtual plane 601 . The display unit 502 displays the perspective-transformed image by the three-dimensional processing unit 506 on the display screen. Fig. 12(a) is a diagram showing the relationship between the virtual plane 601 and the viewpoint 604 when performing multi-channel display of the program screens of channels 1 to 16 in the multi-channel screen display, and Fig. Figure on the multi-channel screen display. The input keys of "upper left", "upper right", "lower left" and "lower right" arranged on the remote control device of Fig. 20 represent that the display screen is divided into "upper left", "upper right", "lower left" and "lower right". When pressing the "upper left" key in the state of displaying the multi-channel display screen shown in Figure 12 (b), the upper left part of the display screen (including channels 1, 2, and 5) will be selected. , 6), on the display screen, for example, the color of the part is changed to show that the part is selected. And, when the "Select" key of the remote control device is pressed in this state, the three-dimensional processing unit 506 pastes the channel screen layout information on the selected area on the first virtual plane 601 based on the channel screen layout information supplied from the multi-channel layout control unit 503. The images (program pictures of channels 1, 2, 5, and 6) are pasted on the new second virtual plane 602 in a matrix of 2×2, and the position of the viewpoint 604 remains unchanged, so that the second virtual plane 602 is in the virtual three-dimensional space. The interior is located closer to the viewpoint 604 than the first virtual plane 601, and when perspective transformation is performed on the virtual three-dimensional space in which the first and second virtual planes are arranged, the second virtual plane 602 is arranged at a size smaller than the entire first virtual plane 601. In the small display position, the front (the surface on which the image is pasted) faces the viewpoint 604 , and in this state, the entire virtual three-dimensional space is subjected to perspective transformation with respect to the viewpoint 604 . The place where the image is pasted on the selected area of the first virtual plane 601 is displayed in white, black, or background color. The display unit 502 displays the perspective-transformed image by the three-dimensional processing unit 506 on the display screen. Fig. 13(a) is a diagram showing the relationship between virtual planes 601, 602 and viewpoint 604 when an area "upper left" (area including screens of channels 1, 2, 5, and 6) is selected and displayed in multi-channel screen display , FIG. 13(b) is a diagram showing a multi-channel screen display displayed on a monitor screen. By arranging the second virtual plane 602 in the virtual three-dimensional space as described above and performing perspective transformation, the image pasted on the area selected on the first virtual plane 601 is enlarged and displayed on the first virtual plane 601 on the display screen. On the front side, part of the first virtual plane 601 placed behind is displayed around the second virtual plane 602 . Thus, by displaying a part of the overall image of the multi-channel screen on the display screen when the selected screen is enlarged and displayed, the user can easily confirm the positional relationship between the multi-channel screen and the selected screen. In addition, as shown in FIG. 13(b), when the "lower left" key is pressed while the multi-channel display screen is displayed, the 2×2 matrix-like multi-channel screen displayed in front of the display screen is selected. When the “Select” key is pressed, the three-dimensional processing unit 506 will paste the area selected in the second virtual plane 602 according to the channel screen configuration information supplied from the multi-channel configuration control unit 503. The image (program picture of channel 5) on the above is pasted on the new third virtual plane 603, and the position of the viewpoint 604 remains unchanged, so that the third virtual plane 603 is located closer to the viewpoint than the second virtual plane 602 in the virtual three-dimensional space At the position of 604, when perspective transformation is performed on the virtual three-dimensional space in which the first, second, and third virtual planes are arranged, the third virtual plane 603 is placed on a display screen smaller than the entire second virtual plane 602. , the front side (the surface on which the image is pasted) faces the viewpoint 604 , and the entire virtual three-dimensional space is perspective-transformed with respect to the viewpoint 604 in this state. In the selected area of the second virtual plane 602, the pasted image is whitened, blackened, displayed with a background color, or the like. The display unit 502 displays the perspective-transformed image by the three-dimensional processing unit 506 on the display screen. Fig. 14(a) shows virtual planes 601, 602, 603 and viewpoint 604 when the "lower left" area (area including the screen of channel 5) is selected and displayed in the multi-channel screen display shown in Fig. 13(b) Fig. 14(b) is a diagram showing the screen display displayed on the monitor screen at this time.

这样，在实施例6的图像显示装置中，包括显示单元和图像配置单元，显示单元将配置了粘贴图像的单个或多个虚拟平面的虚拟三维空间相对于配置在上述虚拟三维空间内的视点进行透视变换后显示在显示画面上，图像配置单元将图像粘贴到第1虚拟平面上，配置到上述虚拟三维空间内以使该第1虚拟平面的正面对着上述视点，同时在选择了上述第1虚拟平面的一部分区域时将粘贴在上述第1虚拟平面的所选择的区域上的图像粘贴到与上述第1虚拟平面不同的第2虚拟平面上，使该第2虚拟平面在上述虚拟三维空间内是比上述第1虚拟平面更靠近上述视点的位置，在将配置了上述第1、第2虚拟平面的上述虚拟三维空间进行透视变换时，上述第2虚拟平面小于上述第1虚拟平面，并配置在上述显示画面上显示的位置，以使其正面对着上述视点，所以，可以充分发挥三维视觉效果，从而可以进行容易确认多频道画面与选择画面的位置关系的画面显示。In this way, in the image display device of the sixth embodiment, the display unit and the image arrangement unit are included, and the display unit arranges the virtual three-dimensional space of the single or multiple virtual planes on which the pasted images are arranged relative to the viewpoint arranged in the above-mentioned virtual three-dimensional space. Displayed on the display screen after perspective transformation, the image configuration unit pastes the image on the first virtual plane, and arranges it in the above-mentioned virtual three-dimensional space so that the front of the first virtual plane faces the above-mentioned viewpoint. In the case of a part of the virtual plane, the image pasted on the selected region of the first virtual plane is pasted on a second virtual plane different from the first virtual plane so that the second virtual plane is within the virtual three-dimensional space is a position closer to the viewpoint than the first virtual plane, and when perspective transformation is performed on the virtual three-dimensional space in which the first and second virtual planes are arranged, the second virtual plane is smaller than the first virtual plane and arranged The position displayed on the above-mentioned display screen is so that it faces the above-mentioned view point, so that the three-dimensional visual effect can be fully exerted, so that the screen display can easily confirm the positional relationship between the multi-channel screen and the selection screen.

在实施例6中，如果对粘贴到配置在靠近视点侧的虚拟平面上的图像进行获得透过效果的处理，也可以很容易确认显示在选择画面的背后的全体画面。Also in Embodiment 6, if a process of obtaining a see-through effect is performed on the image pasted on the virtual plane disposed on the side closer to the viewpoint, the entire screen displayed behind the selected screen can be easily confirmed.

另外，在实施例6～实施例8中，是将第2虚拟平面在虚拟三维空间内配置在比第1虚拟平面更靠近视点的位置，使其正面(粘贴了图像的面)对着视点，显示将配置了第1、第2虚拟平面的虚拟三维空间相对于配置在这些虚拟平面的正面的视点进行了透视变换的图像，但是，也可以将第2虚拟平面在虚拟三维空间内配置为其正面对着与第1虚拟平面的正面基本上相同的方向，求出在上述虚拟三维空间内可以看到上述第1、第2虚拟平面的全体的眺望视点位置，而显示将配置了第1、第2虚拟平面的虚拟三维空间相对于配置在该眺望视点位置的视点进行了透视变换的图像。In addition, in Embodiment 6 to Embodiment 8, the second virtual plane is arranged at a position closer to the viewpoint than the first virtual plane in the virtual three-dimensional space, so that the front side (the surface on which the image is pasted) faces the viewpoint, An image in which the perspective transformation of the virtual three-dimensional space in which the first and second virtual planes are arranged is displayed with respect to the viewpoint arranged on the front of these virtual planes is displayed. However, the second virtual plane may be arranged in the virtual three-dimensional space as Facing the front in substantially the same direction as the front of the first virtual plane, obtain the viewing viewpoint position where the entirety of the first and second virtual planes can be seen in the virtual three-dimensional space, and display the first and second virtual planes where the first and second virtual planes are arranged. An image obtained by perspective-transforming the virtual three-dimensional space of the second virtual plane with respect to the viewpoint arranged at the viewing viewpoint position.

图15是表示相对于配置在该眺望视点位置的视点进行透视变换的图像显示装置的显示图像的一例的图。在图15所示的例子中，和实施例6的配置一样，将第2虚拟平面在虚拟三维空间内配置在比第1虚拟平面更靠近视点的位置，使其正面(粘贴了图像的面)对着视点，并将配置了第1、第2、第3虚拟平面的虚拟三维空间相对于不是配置在虚拟平面的正面而是配置虚拟平面的斜前方的眺望视点位置的视点进行透视变换后显示在显示器画面上。通过采用进行这样的显示的结构，用户可以俯瞰多频道显示画面和选择画面的全体，从而可以很容易地确认多频道画面与选择画面的位置关系。FIG. 15 is a diagram showing an example of a display image of an image display device that performs perspective conversion with respect to a viewpoint disposed at the viewing viewpoint position. In the example shown in FIG. 15, the second virtual plane is arranged at a position closer to the viewpoint than the first virtual plane in the virtual three-dimensional space in the same way as the arrangement of the sixth embodiment, so that the front side (the surface on which the image is pasted) is arranged. Facing the viewpoint, the virtual three-dimensional space in which the first, second, and third virtual planes are arranged is displayed after being perspective-transformed with respect to a viewpoint at a viewing viewpoint position arranged not on the front of the virtual plane but obliquely in front of the virtual plane on the display screen. By employing such a display configuration, the user can overlook the whole of the multi-channel display screen and the selection screen, and can easily confirm the positional relationship between the multi-channel display screen and the selection screen.

实施例7.Example 7.

下面，说明实施例7的图像显示装置。Next, the image display device of the seventh embodiment will be described.

图16是表示实施例7的图像显示装置的结构的图。FIG. 16 is a diagram showing the configuration of an image display device according to Embodiment 7. FIG.

在图16中，501是接收用户的操作的操作部、502是显示图像的显示部、503是进行多个频道显示图像的配置控制的多频道配置控制部、504是多频道调谐器控制部、505是具有多个调谐器并按照多频道调谐器控制部504的指示选择各频道的调谐部、506是根据多频道配置控制部503的信息将各频道显示图像配置到虚拟三维空间内并在进行阴影处理和视点移动处理等后进行用于可以在2维的显示部502上进行显示的透视变换的三维处理部、507是多频道配置控制存储部。In FIG. 16 , 501 is an operation unit for receiving user operations, 502 is a display unit for displaying images, 503 is a multi-channel arrangement control unit for controlling the arrangement of display images of a plurality of channels, 504 is a multi-channel tuner control unit, 505 is a tuner unit that has a plurality of tuners and selects each channel according to the instruction of the multi-channel tuner control unit 504, and 506 is arranging the display images of each channel in a virtual three-dimensional space according to the information of the multi-channel tuner control unit 503 and performing The three-dimensional processing unit 507 that performs perspective conversion for display on the two-dimensional display unit 502 after shading processing and viewpoint shift processing is a multi-channel arrangement control storage unit.

下面，说明实施例7的图像显示装置的动作。实施例7的图像显示装置的多频道画面显示动作和选择区域的放大显示动作等基本的动作与实施例6的图像显示装置的多频道画面显示动作和选择区域的放大显示动作相同。Next, the operation of the image display device of the seventh embodiment will be described. Basic operations such as the multi-channel screen display operation and the enlarged display operation of the selected area of the image display device of the seventh embodiment are the same as those of the image display device of the sixth embodiment.

多频道配置控制部503根据操作部501接收的操作输入选择影在显示部502内显示的频道，并将选择频道信息通知多频道调谐器控制部504，同时向三维处理部506输出多个频道显示图像在虚拟三维空间内的配置信息和视点位置信息。多频道调谐器控制部504从多频道配置控制部503接收选择频道信息，进行调谐部505的控制，以便接收用选择频道信息表示的频道。调谐部505按照多频道调谐器控制部504的指示选择各频道。三维处理部506根据从多频道配置控制部503供给的频道画面配置信息(虚拟平面在虚拟三维空间内的配置信息、粘贴到虚拟平面上的图像在虚拟平面上的配置信息和视点位置信息)将粘贴了图像的虚拟平面如在实施例6的说明中所述的那样配置到虚拟三维空间内，并将其相对于指定的视点进行透视变换，显示部502将其显示在显示器画面上。The multi-channel configuration control unit 503 selects the channel to be displayed on the display unit 502 according to the operation input received by the operation unit 501, and notifies the multi-channel tuner control unit 504 of the selected channel information, and simultaneously outputs the multi-channel display to the three-dimensional processing unit 506. The configuration information and viewpoint position information of the image in the virtual three-dimensional space. The multi-channel tuner control unit 504 receives the selected channel information from the multi-channel arrangement control unit 503, and controls the tuner unit 505 so as to receive the channel indicated by the selected channel information. The tuner unit 505 selects each channel according to an instruction from the multi-channel tuner control unit 504 . The three-dimensional processing unit 506, based on the channel screen arrangement information supplied from the multi-channel arrangement control unit 503 (the arrangement information of the virtual plane in the virtual three-dimensional space, the arrangement information of the image pasted on the virtual plane on the virtual plane, and the viewpoint position information), The virtual plane on which the image is pasted is placed in the virtual three-dimensional space as described in the sixth embodiment, and is perspective-transformed with respect to a designated viewpoint, and displayed on the display screen by the display unit 502 .

多频道配置控制存储部507由即使切断系统的电源也保持存储内容的存储单元构成，存储关于多频道配置控制部503的多频道配置控制的信息。具体而言，就是存储进行选择区域的放大显示动作时的选择频道信息、虚拟平面在虚拟三维空间内的配置信息、粘贴到虚拟平面上的图像在虚拟平面上的配置信息和视点位置信息等。The multi-channel layout control storage unit 507 is constituted by a storage unit that retains stored content even when the power of the system is turned off, and stores information related to the multi-channel layout control by the multi-channel layout control unit 503 . Specifically, it stores the selected channel information when performing the enlarged display operation of the selected area, the arrangement information of the virtual plane in the virtual three-dimensional space, the arrangement information of the image pasted on the virtual plane on the virtual plane, and the viewpoint position information.

在实施例7的图像显示装置中，在用户使用多频道画面显示进行频道选择时，在例如像图14(b)所示的那样进行放大显示后，通过用户的操作(再按下“选择”键等)或自动地将显示器显示切换为选择频道的全画面显示，但是，在选择频道的全画面显示之后再次使用多频道画面显示进行频道选择时，如果通过按下遥控装置的“多画面显示”的输入键进行多频道画面显示时，就不能很容易地识别迄今所看到的频道画面显示在多频道画面的何处。In the image display device of Embodiment 7, when the user selects a channel using the multi-channel screen display, after the enlarged display is performed, for example, as shown in FIG. key, etc.) or automatically switch the monitor display to the full-screen display of the selected channel, however, when using the multi-channel screen display again for channel selection after the full-screen display of the selected channel, if When the input key of " is used to display the multi-channel screen, it is not easy to recognize where the channel screen seen so far is displayed on the multi-channel screen.

在实施例7的图像显示装置中，在多频道配置控制存储部507中存储了进行选择区域的放大显示动作时的选择频道信息、虚拟平面在虚拟三维空间内的配置信息、粘贴到虚拟平面上的图像在虚拟平面上的配置信息和视点位置信息等。另外，遥控装置具有“返回”等键，相应于该“返回”等键的按下，多频道配置控制部503就从多频道配置控制存储部507中读出此前的选择频道信息、虚拟平面在虚拟三维空间内的配置信息、粘贴到虚拟平面上的图像在虚拟平面上的配置信息和视点位置信息，并将选择频道信息向多频道调谐器控制部504输出，将虚拟平面在虚拟三维空间内的配置信息、粘贴到虚拟平面上的图像在虚拟平面上的配置信息和视点位置信息向三维处理部506输出。多频道调谐器控制部504从多频道配置控制部503接收选择频道信息，进行调谐部505的控制，以便接收用选择频道信息表示的频道。调谐部505按照多频道调谐器控制部504的指示选择各频道。三维处理部506根据从多频道配置控制部503供给的频道画面配置信息(虚拟平面在虚拟三维空间内的配置信息、粘贴到虚拟平面上的图像在虚拟平面上的配置信息和视点位置信息)将粘贴了图像的虚拟平面配置到虚拟三维空间内，并将其相对于指定的视点进行透视变换，显示部502将其显示在显示器画面上。这样，便可再现显示切换到选择频道的全画面显示以前的选择区域的放大显示画面，从而用户可以很容易地识别迄今所看到的频道画面显示在多频道画面的何处。In the image display device of Embodiment 7, the multi-channel configuration control storage unit 507 stores the selected channel information when performing the enlarged display operation of the selected area, the configuration information of the virtual plane in the virtual three-dimensional space, and the information pasted on the virtual plane. The configuration information of the image on the virtual plane and the position information of the viewpoint. In addition, the remote control device has a key such as "return", and when the key such as "return" is pressed, the multi-channel configuration control unit 503 reads the previously selected channel information, the virtual plane in the multi-channel configuration control storage unit 507, and so on. The configuration information in the virtual three-dimensional space, the configuration information and viewpoint position information of the image pasted on the virtual plane on the virtual plane, and the selected channel information is output to the multi-channel tuner control unit 504, and the virtual plane is placed in the virtual three-dimensional space The arrangement information of the image pasted on the virtual plane, the arrangement information of the image pasted on the virtual plane, and the viewpoint position information are output to the three-dimensional processing unit 506 . The multi-channel tuner control unit 504 receives the selected channel information from the multi-channel arrangement control unit 503, and controls the tuner unit 505 so as to receive the channel indicated by the selected channel information. The tuner unit 505 selects each channel according to an instruction from the multi-channel tuner control unit 504 . The three-dimensional processing unit 506, based on the channel screen arrangement information supplied from the multi-channel arrangement control unit 503 (the arrangement information of the virtual plane in the virtual three-dimensional space, the arrangement information of the image pasted on the virtual plane on the virtual plane, and the viewpoint position information), The virtual plane on which the image is pasted is arranged in the virtual three-dimensional space, and is perspective-transformed with respect to a designated viewpoint, and the display unit 502 displays it on the display screen. In this way, the enlarged display screen of the selected area before switching to the full screen display of the selected channel can be reproduced and displayed, so that the user can easily recognize where the channel screen viewed so far is displayed on the multi-channel screen.

这样，在实施例7的图像显示装置，除了实施例6的图像显示装置的结构外，还具有存储虚拟平面在虚拟三维空间内的配置信息和粘贴到虚拟平面上的图像在虚拟平面上的配置信息的多频道配置库存储部，使用该多频道配置控制存储部存储的配置信息，可以再现上述虚拟平面在虚拟三维空间内的配置和粘贴到虚拟平面上的图像在虚拟平面上的配置，所以，可以实现能够再现以前的显示从而可以确认全体图像与选择图像的关系的图像显示装置。In this way, in addition to the structure of the image display device of Embodiment 6, the image display device of Embodiment 7 also has the configuration information of storing the virtual plane in the virtual three-dimensional space and the configuration of the image pasted on the virtual plane on the virtual plane. The multi-channel configuration library storage unit of information can reproduce the configuration of the above-mentioned virtual plane in the virtual three-dimensional space and the configuration of the image pasted on the virtual plane on the virtual plane by using the configuration information stored in the multi-channel configuration control storage unit. Therefore, it is possible to realize an image display device capable of reproducing the previous display and confirming the relationship between the entire image and the selected image.

在上述说明中，在选择频道的全画面显示之后，用户再次使用多频道画面显示进行频道选择时，就再现显示切换为选择频道的全画面显示以前的选择区域的放大显示画面，但是，也可以是多频道配置控制存储部507存储切断图像显示装置的电源之前的选择频道信息、虚拟平面在虚拟三维空间内的配置信息、粘贴到虚拟平面上的图像在虚拟平面上的配置信息和视点位置信息等，而在再次接通电源时多频道配置控制部503自动地或根据用户的操作从多频道配置控制存储部507中读出电源切断之前的选择频道信息、虚拟平面在虚拟三维空间内的配置信息、粘贴到虚拟平面上的图像在虚拟平面上的配置信息和视点位置信息，从而再现显示电源切断之前的显示画面。In the above description, after the full-screen display of the selected channel, when the user uses the multi-channel screen display to select the channel again, the playback display is switched to the enlarged display screen of the selection area before the full-screen display of the selected channel. However, it is also possible The multi-channel configuration control storage unit 507 stores the selected channel information before the power of the image display device is cut off, the configuration information of the virtual plane in the virtual three-dimensional space, the configuration information of the image pasted on the virtual plane on the virtual plane, and the viewpoint position information. etc. When the power is turned on again, the multi-channel configuration control unit 503 reads out the selected channel information and the configuration of the virtual plane in the virtual three-dimensional space from the multi-channel configuration control storage unit 507 automatically or according to the user’s operation. Information, configuration information on the virtual plane of the image pasted on the virtual plane, and viewpoint position information, thereby reproducing the display screen before the display power is cut off.

另外，在实施例7的图像显示装置中，是将选择频道信息和视点位置信息存储到多频道配置控制存储部中，但是，在视点位置固定时就不必存储视点位置信息，另外，在多频道画面显示中的选择频道固定时，就不必存储选择频道信息。In addition, in the image display device of Embodiment 7, the selected channel information and the viewpoint position information are stored in the multi-channel configuration control storage unit, but when the viewpoint position is fixed, it is not necessary to store the viewpoint position information. When the selected channel on the screen display is fixed, it is not necessary to store the selected channel information.

另外，在实施例7的图像显示装置中，是多频道配置控制存储部存储选择频道信息、虚拟平面在虚拟三维空间内的配置信息、粘贴到虚拟平面上的图像在虚拟平面上的配置信息和视点位置信息等，并使用多频道配置控制存储部存储的配置信息再现上述虚拟平面在虚拟三维空间内的配置和粘贴在虚拟平面上的图像在虚拟平面上的配置，但是，也可以是多频道配置控制存储部存储在多频道显示图像中显示的多个频道的选择频度，并根据在多频道显示图像中显示的多个频道的选择频度来决定粘贴在第1虚拟平面上的多频道显示。，12(b)所示的4×4的矩阵状配置的图像，就由多频道配置控制部控制将选择频度最高的频道在图12(b)中配置到显示频道1的位置，而将选择频度其次的频道配置到显示频道2、5、6的位置，从而用以集中配置选择频度高的频道。这样，通过采用可以用与选择频道相应的频道图像配置进行多频道画面显示的结构，在使用多频道显示的频道选择操作中可以实现能够提高用户使用方便性的图像显示装置。In addition, in the image display device of Embodiment 7, the multi-channel layout control storage unit stores the selected channel information, the layout information of the virtual plane in the virtual three-dimensional space, the layout information of the image pasted on the virtual plane on the virtual plane, and Viewpoint position information, etc., and use the configuration information stored in the multi-channel configuration control storage unit to reproduce the configuration of the above-mentioned virtual plane in the virtual three-dimensional space and the configuration of the image pasted on the virtual plane on the virtual plane. However, multi-channel The configuration control storage unit stores the selection frequency of the plurality of channels displayed on the multi-channel display image, and determines the multi-channel to be pasted on the first virtual plane based on the selection frequency of the plurality of channels displayed on the multi-channel display image. show. 12 (b) shows the 4 × 4 matrix-like configuration image, which is controlled by the multi-channel configuration control unit to configure the channel with the highest frequency of selection to the position of display channel 1 in Fig. 12 (b), and place The channel with the second selection frequency is allocated to the positions where channels 2, 5, and 6 are displayed, so as to centrally configure the channels with high selection frequency. Thus, by adopting a structure capable of displaying a multi-channel screen with a channel image arrangement corresponding to a selected channel, an image display device capable of improving user convenience in channel selection operation using multi-channel display can be realized.

实施例8.Example 8.

下面，说明实施例8的图像显示装置。Next, the image display device of the eighth embodiment will be described.

图17是表示实施例8的图像显示装置的结构的图。FIG. 17 is a diagram showing the configuration of an image display device according to Embodiment 8. FIG.

在图17中，501是操作部、502是显示部、503是多频道配置控制部、504是多频道调谐器控制部、505是调谐部、506是三维处理部、507是多频道配置控制存储部、508是动画控制部、509动画存储部。In Fig. 17, 501 is an operation part, 502 is a display part, 503 is a multi-channel configuration control part, 504 is a multi-channel tuner control part, 505 is a tuner part, 506 is a three-dimensional processing part, and 507 is a multi-channel configuration control storage. Section, 508 is animation control section, 509 animation storage section.

在由调谐部505接收的广播信号中包含关于广播节目的各种信息，例如地面波广播/卫星广播的广播种别、单声道广播/立体声广播/双语广播的广播种别、免费节目/收费节目的节目种别、新节目/重播节目的节目种别、视听限制(原始锁定)电平等信息，这些特殊信息供给动画控制部508。另外，从多频道配置控制存储部507向动画控制部508供给过去看过的频道或频道选择频度等统计信息。The broadcast signal received by the tuner 505 includes various information on broadcast programs, such as broadcast types of terrestrial broadcast/satellite broadcast, broadcast types of monaural broadcast/stereo broadcast/bilingual broadcast, free program/pay Information such as the program type of the program, the program type of the new program/rebroadcast program, and the viewing restriction (original lock) level, etc., these specific information are supplied to the animation control unit 508 . In addition, statistical information such as channels viewed in the past and frequency of channel selection are supplied from the multi-channel configuration control storage unit 507 to the animation control unit 508 .

动画存储部509存储实现与关于所选择的频道影在画面上表现的意义对应的动画动作的方式及坐标等数据。图18是表示与影在画面上表现的意义对应的动画动作的例子的图。有从操作部501选择在多频道显示画面上显示的频道中的某一频道的操作输入时，动画控制部508就根据从调谐部505和多频道配置控制存储部507接收的信息判断影表现的意义(“选择的节目是卫星广播”这样的信息或“选择的频道是当天已选择了2次以上的频道”这样信息等)，读出用于进行与在动画存储部509中登录的应表现的意义对应的动画动作的方式及坐标等数据，并将其向三维处理部506传输。三维处理部506在使用动画控制部508的数据进行动画动作后，将粘贴了所选择的频道的图像的虚拟平面配置到由从多频道配置控制部503供给的配置信息所示的虚拟三维空间内的位置。The animation storage unit 509 stores data such as a method and coordinates for realizing an animation operation corresponding to the meaning expressed on the screen with respect to the selected channel shadow. FIG. 18 is a diagram showing an example of animation motion corresponding to the meaning expressed by the shadow on the screen. When there is an operation input to select one of the channels displayed on the multi-channel display screen from the operation unit 501, the animation control unit 508 judges the video performance based on the information received from the tuner unit 505 and the multi-channel configuration control storage unit 507. Meaning (information such as "the selected program is satellite broadcasting" or information such as "the selected channel is a channel that has been selected more than 2 times that day", etc.), read out the corresponding expression for performing registration in the animation storage unit 509 The method and coordinates of the animation action corresponding to the meaning of the animation, and transmit it to the three-dimensional processing unit 506. The 3D processing unit 506 arranges the virtual plane pasted with the image of the selected channel in the virtual 3D space indicated by the arrangement information supplied from the multi-channel arrangement control unit 503 after performing an animation operation using the data of the animation control unit 508 s position.

这样，在实施例8的图像显示装置中，将第2虚拟平面配置到虚拟三维空间内的指定位置时，在根据粘贴到第2虚拟平面上的图像使第2虚拟平面进行特定的动画动作后，就配置到虚拟三维空间内的指定位置，所以，根据选择画面显示时的画面的动画动作，用户便可识别关于选择画面的附加的信息。In this way, in the image display device according to the eighth embodiment, when the second virtual plane is arranged at a specified position in the virtual three-dimensional space, after the second virtual plane is made to perform a specific animation action based on the image pasted on the second virtual plane, , is placed at a designated position in the virtual three-dimensional space, so that the user can recognize additional information on the selected screen based on the animation action of the screen when the selected screen is displayed.

在实施例6～实施例8中，操作部由遥控装置和遥控装置的操作信号接收单元构成，但是，作为操作部，不限于遥控装置，也可以使用本体的操作按钮、鼠标等。另外，造显示部，也可以是内藏的CRT(Cathode Ray Tube)、液晶监视器、PDP(Plasma Display Panel)等任何一种显示装置。或者，也可以变换为NTSC信号等而与外加的显示装置连接。另外，作为调谐部，可以准备与多频道画面上的多个频道1对1地对应的多个调谐器，也可以将1个调谐器分时切换给多个频道，而调谐器现在选择的频道以外的频道用静止画面显示，通过将多个频道画面显示分配给1个调谐器，便可显示比调谐器数多的频道画面。In Embodiments 6 to 8, the operation unit is composed of a remote control device and an operation signal receiving unit of the remote control device. However, the operation unit is not limited to the remote control device, and operation buttons, a mouse, etc. of the main body may also be used. In addition, the display unit can also be any display device such as a built-in CRT (Cathode Ray Tube), a liquid crystal monitor, or a PDP (Plasma Display Panel). Alternatively, it may be converted into an NTSC signal or the like and connected to an external display device. In addition, as a tuner unit, a plurality of tuners corresponding to a plurality of channels on a multi-channel screen may be prepared one-to-one, and one tuner may be time-division switched to a plurality of channels, and the channel currently selected by the tuner The other channels are displayed on a still screen, and by allocating multiple channel screen displays to one tuner, it is possible to display more channel screens than the number of tuners.

另外，在实施例6～实施例8中，是放大显示通过用户的操作输入所选择的画面的，但是，也可以采用具有按指定的时间间隔顺序改变区域来选择上述第1虚拟平面的一部分区域和解除选择的区域选择单元的结构，从而可以按例如频道的选择频度的顺序选择多个频道并自动地进行放大显示。图像选择的顺序不限于频道的选择频度的顺序，可以使用随机数发生单元来决定选择顺序，也可以单纯按频道号码顺序进行选择。In addition, in Embodiments 6 to 8, the screen selected by the user's operation input is enlarged and displayed, but it is also possible to select a part of the first virtual plane with a region that changes sequentially at specified time intervals. With the configuration of the area selection unit for unselecting and deselecting, a plurality of channels can be selected in the order of frequency of channel selection and automatically enlarged and displayed. The order of image selection is not limited to the order of frequency of channel selection, and the selection order may be determined using a random number generator, or may be selected simply in order of channel numbers.

另外，作为在本发明的实施例6～实施例8的图像显示装置中处理的图像源，不限于由上述实施例所示的由调谐器接收的电视节目等广播信号，也可以使用外部图像加的图像输出或电脑的VGA输出等。In addition, as the image source processed in the image display device of Embodiment 6 to Embodiment 8 of the present invention, it is not limited to broadcast signals such as TV programs received by the tuner shown in the above embodiments, and external image adders may also be used. The image output of the computer or the VGA output of the computer, etc.

本发明的图像显示控制方法、图像显示处理系统、图像显示处理装置可以将各种多个图像信号向图像显示装置传输，而用于与电脑的图形系统等的综合处理，可以削减传输的图像数据量而实现与用户的关心度相应的图像显示。The image display control method, image display processing system, and image display processing device of the present invention can transmit various multiple image signals to the image display device, and are used for comprehensive processing with the graphics system of the computer, etc., and can reduce the image data transmitted The amount of image display corresponding to the user's degree of interest is realized.

本发明的图像显示装置在收发像有线电视或数字广播等那样大量的频道而搜索用户所希望的频道的多频道图像显示系统中，可以实现用户容易确认全体画面与选择画面的位置关系的利用了三维视觉效果的画面显示。The image display device of the present invention can realize the utilization that the user can easily confirm the positional relationship between the overall screen and the selection screen in a multi-channel image display system that transmits and receives a large number of channels such as cable TV or digital broadcasting and searches for a channel desired by the user. The screen display of the 3D visual effect.

Claims (24)

1.一种使多个图像信号源的图像混合在同一画面上显示的图像显示控制方法，其特征在于：1. A kind of image display control method that makes the image mixing of a plurality of image signal sources show on the same screen, it is characterized in that: 在图像显示部根据显示在上述画面上的各图像的显示状态决定各图像的显示优先度，并根据上述显示优先度决定是使用将多个图像信号源的图像分别按相等面积进行解像度变换并将经过解像度变换后的该多个图像合成为一个图像的合成方法、还是使用将多个图像信号源的图像分别按不同面积进行解像度变换并将经过解像度变换后的该多个图像合成为一个图像的合成方法，作为各图像的解像度变换中的解像度以及各图像的合成方法；In the image display part, the display priority of each image is determined according to the display state of each image displayed on the above-mentioned screen, and according to the above-mentioned display priority, it is determined whether to use the images of a plurality of image signal sources to convert the resolutions into equal areas and The method of synthesizing the multiple images after the resolution conversion into one image, or using the method of performing resolution conversion on the images of multiple image signal sources according to different areas and synthesizing the multiple images after the resolution conversion into one image Combining method, as the resolution in the resolution conversion of each image and the method of combining each image; 通过传输线路向图像输入部传输上述决定的解像度和合成方法信息；transmit the above-determined resolution and synthesis method information to the image input unit through the transmission line; 在图像输入部根据上述决定的解像度变换各图像的解像度，并根据上述决定的合成方法将上述进行了解像度变换的图像合成为一副图像；In the image input unit, the resolution of each image is converted according to the above-mentioned determined resolution, and the above-mentioned images subjected to the resolution conversion are synthesized into an image according to the above-mentioned determined synthesis method; 通过传输线路传输上述合成的图像；以及transmitting the above synthesized image via a transmission line; and 在上述图像显示部根据上述决定的解像度和合成方法将上述传输来的合成图像分离，并显示上述分离后的各图像。In the image display unit, the transmitted synthesized image is separated according to the determined resolution and synthesis method, and the separated images are displayed. 2.按权利要求1所述的图像显示控制方法，其特征在于：根据上述各图像的显示状态中各图像的显示尺寸的大小来决定上述显示优先度。2. The image display control method according to claim 1, wherein said display priority is determined according to the display size of each image in said display state of each image. 3.按权利要求1所述的图像显示控制方法，其特征在于：根据上述各图像的显示状态中各图像的显示重叠的深度来决定上述显示优先度。3. The image display control method according to claim 1, wherein said display priority is determined according to the depth of display overlap of each image in the display state of said each image. 4.按权利要求1所述的图像显示控制方法，其特征在于：根据上述各图像的显示状态中的各图像显示的可视面积的大小来决定上述显示优先度。4. The image display control method according to claim 1, wherein said display priority is determined according to the size of the visible area of each image displayed in said display state of each image. 5.按权利要求1所述的图像显示控制方法，其特征在于：根据上述各图像的显示状态中各图像的显示是否为已聚焦的状态来决定上述显示优先度。5. The image display control method according to claim 1, wherein said display priority is determined according to whether or not each image is displayed in a focused state among the display states of said respective images. 6.按权利要求1所述的图像显示控制方法，其特征在于：根据上述各图像的显示状态中的各图像的显示时间长度来决定上述显示优先度。6. The image display control method according to claim 1, wherein said display priority is determined based on a display time length of each image in said display state of each image. 7.按权利要求1所述的图像显示控制方法，其特征在于：根据上述各图像的显示状态中各图像的显示顺序来决定上述显示优先度。7. The image display control method according to claim 1, wherein said display priority is determined based on the display order of each image in the display state of said each image. 8.按权利要求1所述的图像显示控制方法，其特征在于：根据上述各图像的显示状态中各图像的显示形式来决定上述显示优先度。8. The image display control method according to claim 1, wherein said display priority is determined according to a display form of each image in said display state of each image. 9.一种使多个图像信号源的图像混合在同一画面上显示的图像显示控制方法，其特征在于：9. An image display control method that enables images from a plurality of image signal sources to be mixed and displayed on the same screen, characterized in that: 在图像显示部根据来自外部的用户操作决定各图像的显示优先度，并根据上述显示优先度决定是使用将多个图像信号源的图像分别按相等面积进行解像度变换并将经过解像度变换后的该多个图像合成为一个图像的合成方法、还是使用将多个图像信号源的图像分别按不同面积进行解像度变换并将经过解像度变换后的该多个图像合成为一个图像的合成方法，作为各图像的解像度变换中的解像度以及各图像的合成方法；In the image display unit, the display priority of each image is determined according to an external user operation, and based on the above-mentioned display priority, it is determined whether to use the image obtained by converting the images of a plurality of image signal sources into equal areas and then converting the resolution. A synthesis method for combining multiple images into one image, or a method for converting the resolutions of images from multiple image signal sources in different areas and combining the multiple images after resolution conversion into one image, as each image The resolution in the resolution conversion and the synthesis method of each image; 通过传输线路向图像输入部传输上述决定的解像度和合成方法信息；transmit the above-determined resolution and synthesis method information to the image input unit through the transmission line; 在图像输入部根据上述决定的解像度变换各图像的解像度；In the image input unit, the resolution of each image is converted according to the resolution determined above; 根据上述决定的合成方法将上述进行了解像度变换的图像合成为一个图像；Combining the above-mentioned images subjected to resolution transformation into one image according to the above-mentioned composite method; 通过传输线路传输上述合成后的图像；以及transmitting the above synthesized image through a transmission line; and 在上述图像显示部，根据上述决定的解像度和合成方法将上述传输来的合成图像分离，并显示上述分离后的各图像。In the image display unit, the transmitted synthesized image is separated based on the determined resolution and synthesis method, and the separated images are displayed. 10.按权利要求1～9的任一权项所述的图像显示控制方法，其特征在于：上述合成方法将根据上述显示优先度进行了解像度变换的各图像的纵横的长宽比固定而进行合成。10. The image display control method according to any one of claims 1 to 9, wherein the synthesis method is performed by fixing the vertical and horizontal aspect ratios of each image whose resolution is transformed according to the display priority synthesis. 11.按权利要求1～9的任一权项所述的图像显示控制方法，其特征在于：上述合成方法使根据上述显示优先度进行了解像度变换的各图像的纵横的长宽比变化地进行合成。11. The image display control method according to any one of claims 1 to 9, wherein the synthesis method is performed by changing the vertical and horizontal aspect ratios of the images whose resolution is transformed according to the display priority. synthesis. 12.按权利要求1所述的图像显示控制方法，其特征在于：在上述图像显示部计算多个各图像在画面上进行虚拟三维显示所需要的参量，并对上述分离后的各图像按照上述计算出的参量进行三维处理并显示。12. The image display control method according to claim 1, characterized in that: in the above-mentioned image display part, a plurality of parameters required for virtual three-dimensional display of each image on the screen are calculated, and each image after the above-mentioned separation is processed according to the above-mentioned The calculated parameters are three-dimensionally processed and displayed. 13.按权利要求12所述的图像显示控制方法，其特征在于，包括：13. The image display control method according to claim 12, characterized in that, comprising: 显示步骤，将配置了粘贴有图像的一个或多个虚拟平面的虚拟三维空间相对于配置在上述虚拟三维空间内的视点进行透视变换后显示在显示画面上；The display step is to display the virtual three-dimensional space configured with one or more virtual planes pasted with images on the display screen after perspective transformation relative to the viewpoint configured in the above-mentioned virtual three-dimensional space; 图像配置步骤，将图像粘贴到第1虚拟平面上，在上述虚拟三维空间内对该第1虚拟平面进行配置以使其正面朝向上述视点，同时在选择了上述第1虚拟平面的一部分区域时将粘贴在上述第1虚拟平面的所选择区域上的图像粘贴到与上述第1虚拟平面不同的第2虚拟平面上，使该第2虚拟平面在上述虚拟三维空间内位于比上述第1虚拟平面更靠近上述视点的位置，在将配置了上述第1、第2虚拟平面的上述虚拟三维空间进行透视变换时，使上述第2虚拟平面小于上述第1虚拟平面的整体大小并配置于在上述显示画面上进行显示的位置，其正面朝向上述视点。The image arranging step is to paste the image on the first virtual plane, arrange the first virtual plane in the virtual three-dimensional space so that its front faces the viewpoint, and when a part of the first virtual plane is selected, place The image pasted on the selected area of the first virtual plane is pasted on a second virtual plane different from the first virtual plane so that the second virtual plane is located closer to the first virtual plane in the virtual three-dimensional space. At a position close to the viewpoint, when performing perspective transformation on the virtual three-dimensional space in which the first and second virtual planes are arranged, the second virtual plane is made smaller than the overall size of the first virtual plane and placed on the display screen The location where the display is made, with its front facing the viewpoint above. 14.按权利要求12所述的图像显示控制方法，其特征在于，包括：14. The image display control method according to claim 12, characterized in that it comprises: 图像配置步骤，将图像粘贴到第1虚拟平面后，将该第1虚拟平面配置到虚拟三维空间内，并在选择了上述第1虚拟平面的一部分区域时，将粘贴在上述第1虚拟平面的所选择区域上的图像粘贴到与上述第1虚拟平面不同的第2虚拟平面上，并使该第2虚拟平面在上述虚拟三维空间内配置为其正面朝向大致和上述第1虚拟平面的正面相同的方向；In the image arrangement step, after pasting the image on the first virtual plane, the first virtual plane is arranged in the virtual three-dimensional space, and when a part of the first virtual plane is selected, the image pasted on the first virtual plane is The image on the selected area is pasted on a second virtual plane different from the first virtual plane, and the second virtual plane is arranged in the virtual three-dimensional space so that its front direction is substantially the same as that of the first virtual plane. the direction of 眺望视点位置计算步骤，计算在上述虚拟三维空间内可看见上述第1和第2虚拟平面的全体的眺望视点位置；A viewing viewpoint position calculation step of calculating a viewing viewpoint position at which the entirety of the first and second virtual planes can be seen in the virtual three-dimensional space; 眺望显示步骤，将配置了多个虚拟平面的虚拟三维空间相对于配置在上述眺望视点位置的视点进行透视变换后进行显示。In the overlook display step, a virtual three-dimensional space in which a plurality of virtual planes are arranged is displayed after performing perspective transformation with respect to a viewpoint arranged at the above-mentioned overlook viewpoint position. 15.按权利要求1～9的任一权项所述的图像显示控制方法，其特征在于：在上述图像输入部将上述合成的图像压缩，在上述图像显示部将上述压缩的合成图像解压。15. The image display control method according to any one of claims 1 to 9, wherein said composite image is compressed by said image input unit, and said compressed composite image is decompressed by said image display unit. 16.按权利要求1～9的任一权项所述的图像显示控制方法，其特征在于：16. The image display control method according to any one of claims 1-9, characterized in that: 在上述图像输入部将解像度变换和合成方法信息作为标题附加到上述合成后的图像数据中；以及adding resolution conversion and combining method information as a header to the combined image data in the above-mentioned image input unit; and 在上述图像显示部解读附加了上述标题的合成图像的标题，并根据上述解读出的信息将上述合成图像分离。The title of the synthesized image to which the title is added is interpreted by the image display unit, and the synthesized image is separated based on the decoded information. 17.一种使多个图像信号源的图像在同一画面上混合显示的图像显示处理系统，其特征在于：17. An image display processing system that enables mixed display of images from multiple image signal sources on the same screen, characterized in that: 设置有接收来自多个图像信号源的图像输入的图像输入部、对显示画面进行应显示的图像输出的图像显示部、以及将上述图像输入部与上述图像显示部连接的传输线路；An image input unit for receiving image input from a plurality of image signal sources, an image display unit for outputting an image to be displayed on a display screen, and a transmission line connecting the image input unit and the image display unit are provided; 其中，上述图像输入部包括：解像度变换·合成方法控制部，根据经由上述传输线路从上述图像显示部接收到的解像度变换·合成方法信息信号来控制上述多个图像信号源的各图像的解像度变换及合成方法；解像度变换部，根据需要将该多个图像中的每一个变换为由上述解像度变换·合成方法控制部指定的解像度；以及合成部，根据需要用由上述解像度变换·合成方法控制部指定的、将多个图像信号源的图像分别按相等面积进行解像度变换并将经过解像度变换后的该多个图像合成为一个图像的合成方法、和将多个图像信号源的图像分别按不同面积进行解像度变换并将经过解像度变换后的该多个图像合成为一个图像的合成方法中的任一种方法，将上述经解像度变换后的多个图像合成为一个图像；Wherein, the above-mentioned image input unit includes: a resolution conversion and synthesis method control unit that controls the resolution conversion of each image of the plurality of image signal sources based on the resolution conversion and synthesis method information signal received from the image display unit via the transmission line. and a synthesis method; the resolution conversion unit converts each of the plurality of images into a resolution specified by the above-mentioned resolution conversion and synthesis method control unit as needed; and the synthesis unit uses the above-mentioned resolution conversion and synthesis method control unit as needed. Specified, the synthesis method of transforming the resolution of images from multiple image signal sources in equal areas and synthesizing the multiple images after resolution conversion into one image, and converting the images of multiple image signal sources into different areas Any one of the synthesis methods of performing resolution conversion and combining the plurality of images after resolution conversion into one image, combining the above-mentioned multiple images after resolution conversion into one image; 上述图像显示部具有将从上述图像输入部接收到的合成图像分离为原来的多个各图像的分离部、将上述分离后的多个图像同时显示在上述画面上的显示控制部、取得多个各图像的显示状态的状态取得部、以及根据取得的显示状态决定解像度·合成方法信息信号并向上述分离部和上述图像输入部输出的解像度·合成方法决定部。The image display unit includes a separation unit that separates the synthesized image received from the image input unit into a plurality of original images, a display control unit that simultaneously displays the separated images on the screen, and acquires a plurality of images. A state acquisition unit for the display state of each image, and a resolution/synthesis method determination unit that determines a resolution/synthesis method information signal based on the acquired display state and outputs it to the separation unit and the image input unit. 18.一种使多个图像信号源的图像在同一画面上混合显示的图像显示处理系统，其特征在于：18. An image display processing system that enables mixed display of images from multiple image signal sources on the same screen, characterized in that: 设置有接收来自多个图像信号源的图像输入的图像输入部、对显示画面进行应显示的图像输出的图像显示部、以及将上述图像输入部与上述图像显示部连接的传输线路；An image input unit for receiving image input from a plurality of image signal sources, an image display unit for outputting an image to be displayed on a display screen, and a transmission line connecting the image input unit and the image display unit are provided; 其中，上述图像输入部包括：解像度变换·合成方法控制部，根据经由上述传输线路从上述图像显示部接收到的解像度变换·合成方法信息信号来控制上述多个图像信号源的各图像的解像度变换及合成方法；解像度变换部，根据需要将该多个图像中的每一个变换为由上述解像度变换·合成方法控制部指定的解像度；以及合成部，根据需要用由上述解像度变换·合成方法控制部指定的、将多个图像信号源的图像分别按相等面积进行解像度变换并将经过解像度变换后的该多个图像合成为一个图像的合成方法、和将多个图像信号源的图像分别按不同面积进行解像度变换并将经过解像度变换后的该多个图像合成为一个图像的合成方法中的任一种方法，将上述经解像度变换后的多个图像合成为一个图像；Wherein, the above-mentioned image input unit includes: a resolution conversion and synthesis method control unit that controls the resolution conversion of each image of the plurality of image signal sources based on the resolution conversion and synthesis method information signal received from the image display unit via the transmission line. and a synthesis method; the resolution conversion unit converts each of the plurality of images into a resolution specified by the above-mentioned resolution conversion and synthesis method control unit as needed; and the synthesis unit uses the above-mentioned resolution conversion and synthesis method control unit as needed. Specified, the synthesis method of transforming the resolution of images from multiple image signal sources in equal areas and synthesizing the multiple images after resolution conversion into one image, and converting the images of multiple image signal sources into different areas Any one of the synthesis methods of performing resolution conversion and combining the plurality of images after resolution conversion into one image, combining the above-mentioned multiple images after resolution conversion into one image; 上述图像显示部具有将从上述图像输入部经上述传输线路接收的到合成图像分离为原来的多个各图像的分离部、用户进行操作输入的操作输入部、使上述分离后的多个图像同时显示在上述画面上的显示控制部、以及通过上述输入的操作决定解像度·合成方法信息信号并向上述分离部和上述图像输入部进行输出的解像度·合成方法决定部。The image display unit has a separating unit for separating the synthesized image received from the image input unit through the transmission line into a plurality of original images, an operation input unit for performing operation input by a user, and simultaneously distributing the separated plurality of images. A display control unit displayed on the screen, and a resolution/synthesis method determination unit that determines a resolution/synthesis method information signal based on the input operation and outputs it to the separation unit and the image input unit. 19.按权利要求17所述的图像显示处理系统，其特征在于：19. The image display processing system according to claim 17, characterized in that: 上述图像显示部还具有计算多个各图像在画面上进行虚拟三维显示所需要的参量的三维计算部和按照由三维计算部计算的参量对上述分离出的多个各图像进行三维处理并显示的三维显示部；The image display unit further includes a three-dimensional calculation unit for calculating parameters required for virtual three-dimensional display of a plurality of images on the screen, and a unit for performing three-dimensional processing and displaying the plurality of separated images according to the parameters calculated by the three-dimensional calculation unit. 3D display unit; 上述状态取得部从上述三维计算部取得多个各图像的显示状态。The state acquisition unit acquires a plurality of display states of each image from the three-dimensional calculation unit. 20.按权利要求19所述的图像显示处理系统，其特征在于，包括：20. The image display processing system according to claim 19, characterized in that it comprises: 显示单元，将配置了粘贴有图像的一个或多个虚拟平面的虚拟三维空间相对于配置在上述虚拟三维空间内的视点进行透视变换后显示在显示画面上；The display unit is configured to display the virtual three-dimensional space configured with one or more virtual planes pasted with images on the display screen after perspective transformation relative to the viewpoint configured in the above-mentioned virtual three-dimensional space; 图像配置单元，将图像粘贴到第1虚拟平面上，在上述虚拟三维空间内对该第1虚拟平面进行配置以使其正面朝向上述视点，同时在选择了上述第1虚拟平面的一部分区域时将粘贴在上述第1虚拟平面的所选择区域上的图像粘贴到与上述第1虚拟平面不同的第2虚拟平面上，使该第2虚拟平面在上述虚拟三维空间内位于比上述第1虚拟平面更靠近上述视点的位置，在将配置了上述第1、第2虚拟平面的上述虚拟三维空间进行透视变换时，使上述第2虚拟平面小于上述第1虚拟平面的整体大小并配置于在上述显示画面上进行显示的位置，其正面朝向上述视点。The image arranging unit pastes the image on the first virtual plane, arranges the first virtual plane in the virtual three-dimensional space so that its front faces the viewpoint, and at the same time, when a part of the first virtual plane is selected, The image pasted on the selected area of the first virtual plane is pasted on a second virtual plane different from the first virtual plane so that the second virtual plane is located closer to the first virtual plane in the virtual three-dimensional space. At a position close to the viewpoint, when performing perspective transformation on the virtual three-dimensional space in which the first and second virtual planes are arranged, the second virtual plane is made smaller than the overall size of the first virtual plane and placed on the display screen The location where the display is made, with its front facing the viewpoint above. 21.按权利要求19所述的图像显示处理系统，其特征在于，包括：21. The image display processing system according to claim 19, characterized in that it comprises: 图像配置单元，将图像粘贴到第1虚拟平面后，将该第1虚拟平面配置到虚拟三维空间内，并在选择了上述第1虚拟平面的一部分区域时，将粘贴在上述第1虚拟平面的所选择区域上的图像粘贴到与上述第1虚拟平面不同的第2虚拟平面上，并使该第2虚拟平面在上述虚拟三维空间内配置为其正面朝向大致和上述第1虚拟平面的正面相同的方向；The image arranging unit, after pasting the image on the first virtual plane, arranges the first virtual plane in the virtual three-dimensional space, and when a part of the first virtual plane is selected, pastes the image on the first virtual plane. The image on the selected area is pasted on a second virtual plane different from the first virtual plane, and the second virtual plane is arranged in the virtual three-dimensional space so that its front direction is substantially the same as that of the first virtual plane. the direction of 眺望视点位置计算单元，计算在上述虚拟三维空间内可看见上述第1和第2虚拟平面的全体的眺望视点位置；a viewing viewpoint position calculation unit that calculates a viewing viewpoint position at which the entirety of the first and second virtual planes can be seen in the virtual three-dimensional space; 眺望显示单元，将配置了多个虚拟平面的虚拟三维空间相对于配置在上述眺望视点位置的视点进行透视变换后进行显示。The view display means performs perspective transformation of a virtual three-dimensional space in which a plurality of virtual planes are arranged with respect to a viewpoint arranged at the above-mentioned view view point position, and then displays it. 22.按权利要求17所述的图像显示处理系统，其特征在于：22. The image display processing system according to claim 17, characterized in that: 上述图像输入部还具有压缩上述合成图像的压缩部；The image input unit further includes a compression unit that compresses the synthesized image; 上述图像显示部还具有将从上述图像输入部接收到的压缩过的合成图像进行解压缩的解压缩部。The image display unit further includes a decompression unit that decompresses the compressed composite image received from the image input unit. 23.按权利要求17或18所述的图像显示处理系统，其特征在于：23. The image display processing system according to claim 17 or 18, characterized in that: 上述图像输入部还具有根据上述解像度·合成方法信息信号生成特定的格式并附加到合成后的图像信号中的标题附加部；The image input unit further includes a header adding unit that generates a specific format based on the resolution/synthesis method information signal and adds it to the synthesized image signal; 上述图像显示部还具有从附加到从上述图像输入部接收到的合成图像信号中的标题中取出解像度·合成方法信息的标题分析部。The image display unit further includes a header analysis unit that extracts resolution and synthesis method information from a header added to the synthesized image signal received from the image input unit. 24.一种在使多个图像信号源的图像在同一画面上混合显示的图像显示系统中使用的、可连接上述多个图像信号源的图像显示处理装置，其特征在于，包括：24. An image display processing device that can be connected to the above-mentioned multiple image signal sources used in an image display system that allows images from multiple image signal sources to be mixed and displayed on the same screen, characterized in that it includes: 根据从上述图像显示部通过传输线路接收到的解像度·合成方法信息信号控制上述多个图像信号源的各图像的解像度变换和合成方法的解像度变换·合成方法控制部、根据需要将多个各图像变换为由上述解像度变换·合成方法控制部指定的解像度的解像度变换部和根据需要用由上述解像度变换·合成方法控制部指定的、对同一画面按等面积进行分割并在该多个分割画面上显示多个图像信号源的图像或者对同一画面按不同面积进行分割并在该多个分割画面上显示多个图像信号源的图像中的任一合成方法，将上述经解像度变换后的多个图像合成为一个图像的合成部。The resolution conversion/synthesis method control unit that controls the resolution conversion and synthesis method of each image of the plurality of image signal sources based on the resolution/synthesis method information signal received from the image display unit through the transmission line, and combines a plurality of each image as necessary. A resolution converting unit that converts to the resolution specified by the above-mentioned resolution converting and combining method control unit and, if necessary, divides the same screen into equal areas and divides the same screen on the plurality of divided screens by using the specified by the above-mentioned resolution converting and combining method controlling unit. Displaying images from multiple image signal sources or dividing the same screen into different areas and displaying images from multiple image signal sources on the multiple split screens, combining the above-mentioned multiple images after resolution conversion Composite section that is composited into one image.
CNB008013624A 1999-07-08 2000-07-10 Video display control method, video display processing system, video display processing device and screen display device Expired - Fee Related CN1212008C (en)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
JP194000/1999 1999-07-08
JP11194000A JP2001022335A (en) 1999-07-08 1999-07-08 Video display control method, video display processing system, video display processing device
JP34219399A JP2001160933A (en) 1999-12-01 1999-12-01 Image display device
JP342193/1999 1999-12-01

Publications (2)

Publication Number Publication Date
CN1317197A CN1317197A (en) 2001-10-10
CN1212008C true CN1212008C (en) 2005-07-20

Family

ID=26508234

Family Applications (1)

Application Number Title Priority Date Filing Date
CNB008013624A Expired - Fee Related CN1212008C (en) 1999-07-08 2000-07-10 Video display control method, video display processing system, video display processing device and screen display device

Country Status (2)

Country Link
CN (1) CN1212008C (en)
WO (1) WO2001005144A1 (en)

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP5197910B2 (en) 2002-09-26 2013-05-15 コーニンクレッカ フィリップス エレクトロニクス エヌ ヴィ Device for receiving digital information signals
CN100466720C (en) * 2005-01-17 2009-03-04 株式会社东芝 Video synthesis device and video synthesis method
JP5158007B2 (en) * 2009-04-28 2013-03-06 ソニー株式会社 Information processing apparatus, information processing method, and program
EP2453650A4 (en) * 2009-07-06 2013-10-16 Sharp Kk Av device
CN101968955B (en) * 2009-07-28 2012-08-22 慧帝科技(深圳)有限公司 Image processing system and image processing method thereof
JP2011182075A (en) * 2010-02-26 2011-09-15 Hitachi Consumer Electronics Co Ltd Image processing apparatus
EP2464115A1 (en) * 2010-12-13 2012-06-13 Thomson Licensing Method and input-output device for rendering at least one of audio, video and computer graphics content and servicing device for delivering at least one of pre-rendered audio, pre-rendered video and pre-rendered computer graphics content
CN103226452B (en) * 2013-02-28 2016-03-30 天脉聚源(北京)传媒科技有限公司 A kind of methods of exhibiting of multimedia file and device
JP2021191320A (en) 2018-09-11 2021-12-16 ソニーグループ株式会社 Surgery support system, display control device, and display control method

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH06105226A (en) * 1992-09-17 1994-04-15 Nec Corp Picture synthesis device
JP3298029B2 (en) * 1993-03-16 2002-07-02 株式会社日立製作所 Video display control method and video display processing system
JP3484531B2 (en) * 1997-04-16 2004-01-06 オムロン株式会社 Image output control device, monitoring system, image output control method, and storage medium
JP3775455B2 (en) * 1997-12-12 2006-05-17 富士ゼロックス株式会社 Conference terminal apparatus and conference related information transmission method

Also Published As

Publication number Publication date
CN1317197A (en) 2001-10-10
WO2001005144A1 (en) 2001-01-18

Similar Documents

Publication Publication Date Title
CN1607819A (en) Image mixing method, and mixed image data generation device
CN1890961B (en) Method and apparatus for controlling overlapping of multiple video signals
CN1150752C (en) System and method for changing program guide format
CN1835574A (en) Apparatus and method for stereoscopic image recording/reproduction and display
CN1860785A (en) Reproducing device, reproducing method, reproducing program, and recording medium
CN1299502C (en) Decoding device and decoding method
CN1905646A (en) Display apparatus and method for controlling the same
CN1578430A (en) Method and apparatus displaying double screen
CN1457593A (en) EPG display device, EPG display method, medium and program
CN1206533A (en) Recording medium for television receiver capable of selectively using browsing information multiplexed in transport stream and method for recording the television receiver
CN1701601A (en) OSD composite image decoding device, decoding method, program, and recording medium
CN1232348A (en) Picture decoding device and recording medium
CN1404685A (en) Multi-window television receiver for simultaneously displaying two video programs and an electronic program guide
CN101047777A (en) Video and audio processing system, video processing apparatus, audio processing apparatus, output apparatus, and method of controlling the system
CN1922879A (en) Display processing device
CN1620121A (en) Display device, two-way communication system and method for using displayed information
CN1212008C (en) Video display control method, video display processing system, video display processing device and screen display device
CN101042849A (en) Information processing apparatus and information processing method
AU2004297844A1 (en) Display device and method of driving the same
CN1649397A (en) Device and method for processing video signal
CN1758755A (en) Transceiver system, transmitter and receiver and information processing method
CN1151559A (en) Information supplying device
CN1160947C (en) Video display
CN1832548A (en) Display apparatus and control method thereof
CN1764256A (en) Audio/video device and method of controlling operation thereof for presenting operating state therein or therebetween as stream of content

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
C17 Cessation of patent right
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20050720