JP2010074238A - Receiver and control method therefor - Google Patents

Abstract

[PROBLEMS] To cut and view a part of a screen (a representative screen specified by a broadcast station or a screen selected by a user) according to the capability and function of a receiving apparatus, Provided are a receiving device capable of appropriately maintaining a multi-channel sound image according to a corner, and a control method thereof.
A receiving device receives a first video accompanied by a plurality of channels of audio, a video output control unit 109 that cuts out a part of the first video and outputs a second video; And an audio output control unit 111 that generates output audio to be output together with the second video. The receiving apparatus determines a combination of input sounds used for synthesizing the output sound from a plurality of channels of the input sound that is the sound of the first video, based on the cutout position of the second video. The output speech is generated by synthesizing the input speech of the combination.
[Selection] Figure 1

Description

  The present invention relates to a receiving apparatus that can cut out and view a part of video accompanying multi-channel audio and a control method thereof.

  High-definition video (2k × 1k: 1920 × 1024 (hereinafter sometimes referred to as HD)) is common in digital broadcasting. Also, in advanced satellite digital broadcasting, there are methods for sending higher resolution (4k × 2k: digital cinema, 8k × 4k: Super Hi-Vision (hereinafter sometimes referred to as SHV)) video and 22.2 channel multi-channel audio. It is being considered.

  In broadcasting such as Super Hi-Vision exceeding the conventional resolution, it is also considered to perform display according to the capability and function of the receiving device. For example, in addition to the case where the entire screen is viewed by down-conversion, a mode in which a representative screen (a part of the SHV screen) designated by the broadcast station or a screen selected by the user is cut out and viewed on the receiver side is being studied. (Hereinafter referred to as trimmed viewing). At this time, it is necessary to appropriately maintain the relationship between the position and angle of view (size) of the representative screen being cut out and viewed and the multi-channel sound image.

  Conventionally, there are the followings for switching sounds according to the screen that the user is viewing. Patent Document 1 discloses a method of detecting which screen a user is viewing in multi-screen display, and switching to and outputting audio corresponding to the screen being viewed. Patent Document 2 discloses a method of obtaining a sound zoom-in effect by weighting and synthesizing a sound source close to a position on a screen designated by a user.

On the other hand, in order to provide a correct sound image in an environment where the listening position is asymmetric with respect to the speaker, the distance between the listener and each speaker is measured by the sound detection means placed in the vicinity of the listener, and the sound field of the listener is measured. There is a sound image position correction device that localizes to a listening position (Patent Document 3).
JP 2000-278626 A JP-A-8-298635 JP 7-75200 A

  Normally, multi-channel audio transmitted together with a high-resolution video is adjusted so that the sound image is optimal when the high-resolution video is displayed at full resolution and viewed at the center position in front of the screen. However, when a part of the screen is cut out and viewed as described above, there is a case where the cutout position is not in the center of the screen. At this time, if the output balance of the multi-channel sound remains the same, there is a problem that a difference between the screen being viewed and the sound image is generated, resulting in a sense of incongruity.

The conventional techniques described above are those that completely switch and output the sound of the screen that the user is viewing in multi-screen display (Patent Document 1), or those that zoom in the sound to the position of the screen specified by the user (Patent Document) 2). Therefore, when the user cuts out a part of the screen for viewing, the multi-channel sound image cannot be corrected to the optimum position. On the other hand, the conventional technique (Patent Document 3) for obtaining an appropriate sound image with respect to the listening position is only the sound correction processing based on the positional relationship between the user and the speaker, and the relationship with the viewing screen is not considered. .

  SUMMARY OF THE INVENTION Accordingly, an object of the present invention is to provide a receiving apparatus capable of obtaining an appropriate multi-channel sound image localization according to a cut out screen when a part of the screen is cut out and viewed, and a control method therefor. .

  In order to achieve the above object, the present invention employs the following configuration.

  The receiving apparatus according to the present invention includes a receiving unit that receives a first video accompanied by a plurality of channels of audio, a video output control unit that cuts out a part of the first video and outputs a second video, Audio output control means for generating output audio to be output together with the second video, based on the cutout position of the second video, a plurality of channels of audio of the first video Further, it comprises a determining means for determining a combination of input sounds to be used for synthesizing the output sounds from the input sounds, and the sound output control means synthesizes the input sounds determined by the determining means to synthesize the output sounds. It is the receiver which produces | generates.

  The control method of the receiving apparatus according to the present invention includes a step of receiving a first video accompanied by a plurality of channels of audio, a step of cutting out a part of the first video and outputting a second video, A step of generating output audio for output together with the second video, wherein the step of generating the output audio is a plurality of audios of the first video based on a cutout position of the second video A step of determining a combination of input sounds used for synthesizing the output sound from the input sounds of the channels; and a step of generating the output sound by synthesizing the determined input sounds. This is a control method of the receiving device.

  According to the present invention, it is possible to realize appropriate multi-channel sound image localization for a cut-out viewing screen even if a part of the screen is cut out for viewing according to the capability or function of the receiving apparatus. Become.

  Hereinafter, an embodiment of an apparatus and a method according to the present invention will be described with reference to the drawings. The embodiment described below is a digital broadcast receiver capable of outputting high-definition broadcast video and audio (video format: 1920 × 1080/60 / i, audio mode: 5.1ch). 4320/60 / p, audio mode: 22.2 ch).

[Example 1]
FIG. 1 is a block diagram of a digital broadcast receiver according to the present invention.

  The antenna 101 receives a digital television broadcast signal in which a plurality of video data, audio data, metadata, and the like are multiplexed and digitally modulated. More specifically, it receives a digital broadcast program of 7680 × 4320/60 / p (with trimming designation) as the video format and 22.2 ch multi-channel stereo digital broadcast program as the audio mode.

  The receiving unit 102 performs demodulation, error correction processing, and the like of the digital television broadcast signal and outputs an MPEG-2 TS (Transport Stream) signal.

The signal separation unit 103 separates video data, audio data, and metadata from the multiplexed MPEG-2 TS signal according to the packet ID of the program selected by the user, and the video reproduction unit 104 and the audio reproduction unit, respectively. 105, and sent to the metadata processing unit 106. The multiplexed MPEG-2 TS signal may include data broadcast (multimedia) data, but the processing unit is not shown in FIG.

  The video playback unit 104 is an ITU-T H.264. H.264 | ISO / IEC14496-10 (MPEG-4 AVC) (hereinafter referred to as H.264) is used to decode video data.

  The audio reproducing unit 105 decodes audio data encoded by MPEG-2 AAC. When multi-channel audio data is included, it is sent to the audio output control unit 111 independently without being synthesized.

  The metadata processing unit 106 extracts information for filtering the MPEG2-TS signal by the signal separation unit 103 from PSI / SI (Program Specific Information / Service Information) data. The metadata processing unit 106 also receives program information used for an electronic program guide and the like, and information such as video format and trimming (cutting position and size) information, audio mode, etc. according to the present invention from the PSI / SI data. Take out.

  Based on the trimming information from the metadata processing unit 106, the display position detection unit 107 obtains the coordinates of which part of the SHV (7680 × 4320) screen is to be cut out and sends it to the video output control unit 109. Further, the display position detection unit 107 determines the coordinates of the front speakers (three locations) of the receiving apparatus capable of outputting 5.1ch as the audio mode from the coordinates of the cut-out screen. The display position detection unit 107 then synthesizes and outputs the sound output of which speaker among the front speakers (11 locations) in the received SHV sound mode (22.2ch) to each of the three front speakers. Or determine the combination.

  The correction data calculation unit 108 obtains an appropriate sound image at the time of viewing the cutout screen from the positional relationship between the speaker position in the receiving apparatus, the speaker position in the original SHV audio mode (22.2 ch), and the viewing position of the cutout screen. Correction data for forming is calculated.

  In the present embodiment, the SHV video corresponds to a first video accompanied by a plurality of channels (22.2 ch), and the receiving unit 102 corresponds to a receiving unit that receives the first video. The video output control unit 109 corresponds to video output control means for cutting out a part of the SHV video and outputting the second video (HD resolution cut-out screen). Also, the audio output control unit 111 corresponds to audio output control means for generating output audio (5.1ch here) for output together with the second video. Further, the display position detection unit 107 corresponds to a determination unit that determines a combination of input voices used for synthesis of output voices from SHV input voices based on the cutout position of the second video.

  Here, the correction data calculation unit 108 will be described in some detail.

FIG. 2 is a configuration example of the correction data calculation unit 108. The correction data calculation unit 108 includes an angle analysis unit 201, a mixed gain data calculation unit 202, a distance analysis unit 203, a gain correction data calculation unit 204, and a delay amount correction data calculation unit 205. The angle analysis unit 201 calculates an angle between the front speaker of the receiving apparatus and the 22.2 ch front speaker output to each of the front speakers. Hereinafter, the front left speaker of this receiving apparatus is abbreviated as TFL, the front center speaker is abbreviated as TFC, the front right speaker is abbreviated as TFR, and the 22.2ch front speaker is abbreviated as a source. Based on the calculated angle, the mixing gain data calculation unit 202 mixes the audio data of each source to be synthesized so that the direction of arrival of the sound felt by the viewer with respect to the screen being cut and viewed is appropriate (gain). ). The distance analysis unit 203 calculates a difference in distance between each 22.2ch source and the front speaker (TFL / TFC / TFR) of the reception apparatus based on the angle calculated by the angle analysis unit 201. The gain correction data calculation unit 204 calculates gain (volume level) correction data of the audio signal of the front speaker (TFL / TFC / TFR) of the receiving apparatus based on the calculated difference in distance. The delay amount correction data calculation unit 205 calculates the delay amount correction data of the audio signal of the front speaker (TFL / TFC / TFR) of the receiving apparatus based on the calculated distance difference information. The gain correction data and the delay amount correction data are determined so that the sound volume perceived by the viewer and the sense of distance to the sound source are appropriate for the screen being cut and viewed.

  Returning to FIG. In FIG. 1, the video output control unit 109 cuts out an HD resolution screen from the SHV screen and sends it to the display unit 110 based on the cut-out screen position information from the display position detection unit 107.

  The display unit 110 is a display device having a resolution capable of displaying HD (1920 × 1080).

  The audio output control unit 111 synthesizes the audio data of the 22.2ch front speaker output from the audio reproduction unit 105 based on the mixed gain data from the correction data analysis unit 108 at a predetermined ratio. Thereafter, the audio output control unit 111 performs gain adjustment and delay amount adjustment according to the gain correction data and the delay amount correction data, and generates audio data of the front speaker (TFL / TFC / TFR) of the present receiving apparatus. The generated audio data is output to each TFL / TFC / TFR speaker 112 via a D / A (Digital-Analog) converter and an amplifier. Details of synthesis, gain adjustment, and delay amount adjustment will be described later.

  FIG. 3 is a diagram illustrating the position of the cut-out viewing screen in the first embodiment. In the first embodiment, an example in which the center portion of the super high-definition screen 301 is cut out (trimmed) with a high-definition resolution 302 is shown.

  FIG. 4 is a configuration example of the audio output control unit 111 according to the first embodiment in which the center portion of the Super Hi-Vision screen is cut out and viewed. Since the center of the screen is cut out, the audio data of the 22.2 ch front center speaker (FC) is output to the front center speaker (TFC) of the receiving apparatus. The front left speaker (TFL) outputs audio data obtained by mixing three sources of 22.2ch front left speaker (FL), front left center speaker (FLc), and front center speaker (FC). The front right speaker (TFR) outputs audio data in which three sources of 22.2ch front right speaker (FR), front right center speaker (FRc), and front center speaker (FC) are mixed.

  FIG. 5 shows a standard speaker arrangement in a 22.2 channel system. The 22.2ch system has a speaker configuration with 11ch on the front, 4ch on the side, 6ch on the rear, 1ch on the top, and 22ch on the low frequency range LFE (Low Frequency Effects). ing. The 5.1ch and 6.1ch / 7.1ch systems can cope with the spread of sound in the front-rear and left-right directions, but it is difficult to express the upper and lower sound images. In the 22.2ch system, the number of speakers in the middle layer, which is the same height as the viewer, is increased to 10 channels, and 9 channels in the upper layer and 3 channels in the lower layer can be arranged to support vertical sound image movement. It has a possible configuration.

In the embodiments of the present specification, front speakers in the 22.2 channel system (one of the audio modes of the SHV broadcast) and the 5.1 channel system (one of the audio modes of the HD broadcast) are described in order to simplify the description. Only the relationship will be described. Descriptions of rear speakers, side speakers, and low-frequency speakers are omitted. Since the first and second embodiments have a configuration in which the central portion is trimmed and viewed in the vertical direction of the screen, only the front speakers in the middle layer in the 22.2 ch system will be described. The description of the upper front speakers (TpFL / TpFC / TpFR in FIG. 5) and the lower front speakers (BtFL / BtFC / BtFR) is omitted.

  Next, the operation of the block according to the present invention will be described using a flowchart.

  FIG. 6 is an example of a processing flow of the metadata processing unit 106.

  In digital broadcasting, various information regarding video, audio, and programs can be embedded and transmitted as various tables in PSI / SI data. For details, refer to the standard (ARIB STD-B10) of “Program arrangement information used for digital broadcasting” issued by the Radio Industries Association (ARIB).

  In this embodiment, it is a super high-definition video (video format of 7680 × 4320/60 / P) using a component descriptor inserted in PMT (Program Map Table) or EIT (Event Information Table), and It transmits that there is trimming information by the broadcasting station. The EIT is a table for sending information related to a program such as program name, broadcast date and time, and program content.

  The component descriptor has a data structure as shown in FIG. 7, and the type of video component or audio component can be indicated in an 8-bit field called component type (component_type) therein.

  FIG. 8 shows the details in the component descriptor. The component types 0x00 to 0xC0 indicate video components that are currently standardized. The video stream assumed in this embodiment is a higher-resolution video format that exceeds the high-definition video, and is not currently defined. In this embodiment, 0xE1 to 0xF3 are assigned as component types indicating the digital cinema or super high-definition video format (FIG. 8).

  In the case of a video format with trimming designation as the component type, trimming (cutout) information is further transmitted. Trimming information can be transmitted using an extended format event descriptor inserted in EIT or the like. The extended format event descriptor has a data structure as shown in FIG. 9, and trimming information is added as one of the item_description_chars therein. As shown in FIG. 10, the trimming size and address are shown in item_description_char, and the value is sent in item_char.

  The description will be made on the premise that digital broadcasting in which such metadata is multiplexed is received.

  In step S602 of FIG. 6, the metadata processing unit 106 extracts component identification information from the component descriptor of the PMT. Next, the metadata processing unit 106 determines whether the received program is a Super Hi-Vision (SHV) video from the component identification information (S603). Here, when the normal high-definition video mode is used instead of the SHV video mode (the component type of FIG. 8 is 0xB2 or the like), the screen is displayed as it is without cutting out a part of the screen (S604).

  If it is determined in step S603 that the mode is the SHV video mode, the metadata processing unit 106 determines whether there is a trimming designation by the broadcast station in step S605. If the video mode has trimming designation (for example, 0xF2 in FIG. 8), the process proceeds to step S606. On the other hand, even if the same SHV video is not specified for trimming, the process proceeds to step S607.

  In step S606, the metadata processing unit 106 extracts trimming information from the EIT extended format event descriptor. FIG. 10 is an example of trimming information in which the trimming size is “1” (representing that the HD resolution is 1920 × 1080) and the upper left (X, Y) address is (−960, +540). In this embodiment, since the coordinates of the center of the screen are (0, 0), the trimming information in FIG. 10 specifies that the center of the SHV screen is trimmed (cut out) with HD resolution. The trimming information extracted in step S606 is sent to the display position detection unit 107 (S610).

  If there is no trimming designation by the broadcast station in step S605, the metadata processing unit 106 determines whether there is a trimming designation by a user operation (S607). Here, as a function of the receiving apparatus, the user can trim and view an arbitrary position, and when the user actually performs trimming and viewing, information on the cutout position and size managed in the receiving apparatus is extracted as trimming information (S608). ), And proceeds to step S610. On the other hand, if there is no trimming designation by the user, the metadata processing unit 106 instructs the video output control unit to down-convert and display the entire screen (S609).

  FIG. 11 is an example of a processing flow of the display position detection unit 107.

  First, in step S1102, the display position detection unit 107 reads the trimming information extracted by the metadata processing unit. Next, the display position detection unit 107 obtains the coordinates of the cut-out screen based on the trimming information as illustrated in FIG. 10 (S1103). The coordinate data of the cutout screen is sent to the video output control unit 109 in FIG. 1 (S1104), and a predetermined position is cut out (in the present embodiment, the central portion of the screen of the SHV is HD resolution) and displayed on the display unit 110. The

  In step S1105, the display position detection unit 107 calculates the position of the front speaker in the 5.1ch system according to the position of the cutout screen.

  FIG. 12 shows the arrangement of front speakers when the central portion of the SHV screen is trimmed and viewed at the viewing position 1201 with HD resolution. As described above, FL, FLc, FC, FRc, and FR represent the front left speaker, the front left center speaker, the front center speaker, the front right center speaker, and the front right speaker, respectively, in the 22.2ch system. . TFL, TFC, and TFR represent front speakers in the 5.1 channel system during trimming viewing. As shown in FIG. 12, in this embodiment, the coordinates of TFL, TFC, and TFR are (−960, 0), (0, 0), and (+960, 0), respectively. Incidentally, the positions of TFL and TFR can be set at arbitrary positions between both ends of the cut-out screen and FL and FR according to the user's sense of spread and the content to be viewed (see FIG. 13). Here, in order to simplify the description, it is assumed that a TFR is installed at the left end of the cut-out screen and a TFR is installed at the right end.

Next, in step S1106 in FIG. 11, the display position detection unit 107 determines whether the y-coordinates of TFL, TFC, and TFR are 0 (zero). Here, when the y coordinate is 0, it is cut out at the exact center height in the vertical direction of the SHV screen as shown in FIG. In this embodiment, since the y coordinate is 0, the process proceeds to step S1107.

  In step S1107, the display position detection unit 107 determines the positional relationship on the x-coordinate of TFL, TFC, TFR and FL, FLc, FC, TRc, FR. In the present embodiment, for example, the position of TFL is determined to be located between FLc and FC.

  In steps S1108 to S1110, the display position detection unit 107 synthesizes sound from any speaker of FL, FLc, FC, TRc, and FR to each of TFL, TFC, and TFR in accordance with the positional relationship determined in step S1107. Decide whether to output. First, the display position detection unit 107 checks whether or not there is a source at the same position as TFL. If there is a source at the same position, the display position detection unit 107 selects it. If there is no source at the same position, the display position detection unit 107 is closest to TFL. N sources (N is an integer of 2 or more) are selected. When N is 3, in this embodiment, a combination of FL, FLc, and FC is selected for TFL. Similarly, a combination of FR, FRc, and FC is selected for TFR. Since the present embodiment cuts out at the center of the screen, the coordinates of TFC and FC coincide with each other, and only FC is selected as the TFC. The rule (algorithm) for determining the combination is not limited to the above example, and any rule may be adopted. For example, it is also preferable to refer to a table in which combinations of sources corresponding to positions (x, y coordinates) of TFL, TFC, and TFR are defined in advance. Further, the number of sources to be combined may be dynamically changed according to the distance between the TFL and the source.

  The display position detection unit 107 calculates correction data using the position information (coordinates) of TFL, TFC, and TFR calculated in step S1105 and the combination information of FL, FLc, FC, TRc, and FR determined in steps S1108 to S1110. The data is output to the unit 108 (S1111).

  Note that steps S1112 to S1122 in FIG. 11 are processing flows when the cutout positions are different. Steps S1113 to S1117 are processing examples when the cutout position changes only in the vertical direction. In that case, two sources of TpFC and BtFC are also used for speech synthesis. Steps S1112 and S1118 to S1122 will be described in another embodiment (embodiment 4).

  FIG. 14 shows an example of a processing flow in the correction data calculation unit 108.

  First, in step S1402, the correction data calculation unit 108 calculates and determines the position information (coordinates) of TFL, TFC, and TFR calculated and determined by the display position detection unit 107, and outputs FL, FLc, FC, TRc, Read FR combination information.

  In step S1403, the correction data calculation unit 108 calculates the angle of each speaker viewed from the viewing position. The viewing position (1201 in FIG. 12) in this embodiment is set to a viewing angle of 100 degrees and viewing distance of 0.75H (H is the vertical size of the screen) in SHV viewing, and a viewing angle of 30 degrees and viewing distance of 3H in HD viewing. This corresponds to the standard viewing parameters for SHV viewing and HD viewing. When viewing at each standard viewing angle, 0.75H for SHV and 3H for HD have the same viewing distance.

  In step S1404, the correction data calculation unit 108 calculates a mixture ratio of FL, FLc, FC, FRc, and FR for each of TFL, TFC, and TFR from the angle between the viewing position calculated in step S1403 and each speaker. In step S1405, the correction data calculation unit 108 outputs the calculated mixing ratio as mixing gain data to the audio output control unit 111 in FIG.

  FIG. 15 is a diagram illustrating an example in which the sound output from the TFL is generated by mixing the sounds of FL, FLc, and FC. The angle between the viewing position and each speaker in this embodiment is a value when the viewing position is a standard viewing position (viewing angle SHV: 100 degrees, HD: 30 degrees). By using the cosine theorem or the like with respect to the angle with each speaker, the speech vectors of FL, FLc, and FC are synthesized to generate a speech vector VTFL in which the speech arrival direction is an angle of TFL. By normalizing with VTFL = 1, it is possible to obtain the mixing ratio of the speech vectors of FL, FLc, and FC. In FIG. 15, a speech vector VTFL is generated from TFL by combining FL output with VFL, FLc output with VFLc, and FC output with VFC. In the case of synthesizing three or more source vectors in two dimensions as in the example of FIG. 15, other constraint conditions (for example, a range of vector magnitudes) may be added as necessary. Here, the magnitude of the vector VFC, which is one decomposition component vector of the combined vector VTFL, can be set to a range in which the direction of the other decomposition vector can be combined by the vector VFLc and the vector VFL.

  FIG. 16 shows an example in which the position of TFL is changed to the FL side with respect to FIG. FIG. 16 shows that the ratio of VFC decreases and the ratio of VFL and VFLc increases as the speech vector mixture ratio of FL, FLc, and FC due to the position of TFL being on the FL side.

  Returning to FIG. 14, the description of the processing flow will be continued.

  In step S1406, the correction data calculation unit 108 calculates the difference in distance between FL, FLc, FC, FRc, FR and TFL, TFC, TFR from the angle of each speaker viewed from the viewing position calculated in step S1403. . FIG. 17 is an example of obtaining a difference in distance between FL and TFL. In the case of the standard viewing position, FL is 50 degrees to the left from the front, and the TFL position in this embodiment is 15 degrees to the left.

The distance between the viewer and the _{FL L} FL, and the distance between the viewer and the TFL and _{L TFL,} because the relationship between the _{L FL · cos50 ° = L TFL} · cos15 ° _{holds, L TFL = L FL × cos50} ° / cos 15 °.

In step S1407, the correction data calculation unit 108 calculates gain correction data based on the distance relationship obtained in step S1406. For example, in FIG. 17, the gain of TFL with respect to FL is set to G (TFL_FL), and the gain of FL is set to G (FL). Since the volume is inversely proportional to the square of the distance, a gain is set so that G (TFL_FL) = G (FL) × (L _TFL ) ² / (L _FL ) ² in order to hear the same volume during trimming viewing. Generate correction data. Further, in this embodiment, gain correction data is similarly calculated for other audio channels (FLc, FC) synthesized and output to TFL, and the total gain correction data of FL, FLc, FC is determined, and the audio output of FIG. The data is sent to the control unit 111 (S1408).

In step S1409, the correction data calculation unit 108 calculates delay amount correction data based on the distance relationship obtained in step S1406. Similar to the description of step S1407, the description will be made with reference to FIG. In FIG. 17, it is assumed that the delay amount of TFL with respect to FL is D (TFL_FL), and the delay amount of FL is D (FL). Since the delay amount is proportional to the distance, D (TFL_FL) = D (FL) × L _TFL / L _{FL in} order to make the sense of distance to the sound source felt by the viewer the same in trimming viewing. The delay amount correction data is generated. Further, in this embodiment, the delay amount correction data is similarly calculated for the other audio channels (FLc, FC) synthesized and output to the TFL, and the total delay amount correction data of FL, FLc, FC is determined. The data is sent to the audio output control unit 111 (S1410).

  Mixed gain correction data, gain correction data in trimming viewing, obtained through the processing of the metadata processing unit 106 (FIG. 6), the display position detection unit 107 (FIG. 11), and the correction data calculation unit 108 (FIG. 14), The delay amount correction data is input to the audio output control unit 111.

  The audio output control unit 111 generates TFL, TFC, and TFR from FL, FLc, FC, FRc, and FR. As an example, a flow for generating a TFL will be described with reference to FIG. First, the audio output control unit 111 synthesizes FL, FLc, and FC at a predetermined mixing ratio based on the mixing gain correction data. Next, the audio output control unit 111 adjusts the gain based on the gain correction data so that the sound volume is substantially the same, and further adjusts the delay amount based on the delay amount correction data so that the sense of distance to the sound source is substantially the same. Data for which these adjustments have been completed is sent to the TFL speaker via D / A and AMP (amplifier). The TFR is the same as the TFL flow except that FC, FRc, and FR are synthesized at a predetermined mixing ratio. In the present embodiment, since the center portion of the screen is cut out and viewed, the relationship of TFC = FC is established, and no special correction is performed with respect to TFC. (In FIG. 4, the correction amount is 0 (zero) through the gain correction unit and the delay amount correction unit.)

  The audio output control unit (FIG. 4) in the present embodiment corrects the arrival direction (angle) of the sound by the mixed gain adjustment unit, and then performs gain correction for adjusting the volume and delay for adjusting the sense of distance to the sound source. It was set as the structure which performs quantity correction | amendment. However, it is possible to correct the gain and the delay amount more accurately by performing the correction of the arrival direction (angle) after the gain correction and the delay amount correction are performed first.

  According to the present embodiment, when the central portion of the super high-definition (SHV) screen is trimmed and viewed at a high-definition (HD) resolution, the direction of arrival, volume, and distance are appropriately corrected for the cut-out viewing screen. Multi-channel audio can be provided.

[Example 2]
Next, a second embodiment according to the present invention will be described.

  FIG. 18 is a diagram illustrating the position of the cut-out viewing screen in the second embodiment. The second embodiment is an example in which a part of the super high-definition screen 1701 is cut out (trimmed) and viewed at a high-definition resolution 1702. The difference from the first embodiment is that the cut-out position in the x-axis direction is not the center of the screen.

  The block configuration (FIG. 1) of the digital broadcast receiving apparatus according to the second embodiment and the processing flow (FIGS. 6, 11, and 14) of the metadata processing unit, the display position detecting unit, and the correction data calculating unit are the same as those of the first embodiment. Are the same.

  Hereinafter, the difference from the first embodiment will be mainly described.

  FIG. 19 shows the positions of the front speakers TFL, TFC, and TFR during trimming viewing in Example 2, and combinations of FL, FLc, FC, FRc, and FR that are synthesized and output to the TFL. In Example 2, FC and FRc audio data are combined and output to TFL. This is because synthesis is based on the sound around the cut-out screen, but FL and FLc may be added at a constant ratio.

  The mixing ratio is obtained based on the angle with each speaker as in the first embodiment. However, in the second embodiment, since the viewing position is not the origin (x, y) = (0, 0), the angle with each speaker is It is necessary to calculate the cut-out position coordinates.

The x coordinate of the viewing position is a, the x coordinate of the right end of the SHV screen is b, the angle with the FL at the origin coordinate is 50 degrees (standard viewing position as in the first embodiment), and the angle with the FL at the viewing position is K degrees. In this case, the angle K can be expressed by the following relational expression.
tanK ° = ((a + b) / b) tan50 °

  In this way, the angle with each speaker at the viewing position can be obtained from the viewing position and the coordinates of the screen edge (FIG. 20).

  FIG. 21 shows combinations of FL, FLc, FC, FRc, and FR that are combined with the TFC and output in the second embodiment. The front center speaker TFC according to the second embodiment outputs FRc and FR audio data in combination. This is because as described above, the sound around the cut-out screen is mainly output.

  FIG. 22 is an example of the audio output control unit 111 according to the second embodiment. Similarly to the first embodiment, the audio data of each of the front speakers TFL, TFC, and TFR at the time of trimming viewing is generated based on the mixed gain data, gain correction data, and delay amount correction data calculated from the cutout screen position. As described with reference to FIG. 19 and FIG. 21, the second embodiment has a configuration in which FC and FRc are combined with TFL and FRc and FR are combined with TFC and output. Also, the TFR is configured to synthesize and output FRc and FR as in the TFC. As can be seen from FIG. 18, in the case of the cutout screen position in the second embodiment, both TFC and TFR are located between two speakers FRc and FR. For this reason, although the audio data of FRc and FR are synthesized for both TFC and TFR, the mixing ratio differs because the angular relationship with each speaker is different. After the synthesis, as in the first embodiment, gain correction for volume adjustment and delay amount correction for distance adjustment are performed and output to front speakers TFL, TFC, and TFR during trimming viewing through D / A and AMP. .

  According to the present embodiment, when a part of the SHV screen (other than the upper and lower center and the left and right center) is trimmed and viewed with HD resolution, the sound arrival direction, sound volume, and sense of distance are appropriate for the clipped viewing screen. It is possible to provide multi-channel audio corrected to the above.

[Example 3]
Next, a third embodiment according to the present invention will be described.

  In the third embodiment, the block configuration of the digital broadcast receiving apparatus (FIG. 1) and the processing flow (FIGS. 6, 11, and 14) of the metadata processing unit, the display position detection unit, and the correction data calculation unit are the same as those of the first embodiment. Basically the same.

  Example 3 is another embodiment of the cut-out screen configuration of Example 2, and is configured to output narration, BGM, etc. from the front center speaker TFC among the audio events of the program regardless of the cut-out screen position. It is an example.

FIG. 23 shows an example of a component descriptor related to a voice mode to which the third embodiment is applied. This is assumed to be described in addition to the component descriptor (FIG. 7) described in the first embodiment and the description about the video component (FIG. 8). In FIG. 23, the component content 0x02 indicates a voice component, and component types 0x00 to 0x09 indicate a currently standardized voice mode. In the third embodiment, for the purpose of explanation, 0x0A to 0x0F are assigned as component types of audio formats of digital cinema and Super Hi-Vision.
The component type 0x0F has an audio mode with audio channel type information. The audio mode with audio channel type information is a mode in which a specific audio channel is assigned for each audio event such as a character, narration, or BGM. In a 22.2ch system or the like, it is assumed that a specific audio event is assigned to a specific audio channel.

  In the case of the audio mode with audio channel type information as the component type, it is necessary to send information on which audio event is transmitted on which audio channel. Similar to the example of transmitting trimming information in the first embodiment, this can be transmitted using an extended format event descriptor inserted in EIT or the like. FIG. 24 is an example in which an audio event is added as one of item_description_char in the extended format event descriptor, and an audio channel corresponding to the audio event is indicated by the item_char.

  Embodiment 3 can be realized by multiplexing and sending such metadata. The processing of the metadata related to the audio component in the digital broadcast receiving apparatus of the third embodiment is similar to the processing (FIG. 6) in the case where there is trimming information in the first embodiment, so the description in this section will be described. Omitted.

  FIG. 25 is an example of the audio output control unit 111 according to the third embodiment. Similarly to the second embodiment, the respective audio data of the front speakers TFL, TFC, and TFR during trimming viewing are generated based on the mixed gain data, gain correction data, and delay amount correction data calculated from the cutout screen position. Further, in the third embodiment, based on the audio channel information corresponding to the audio event transmitted by the extended format event descriptor, the TFC at the time of trimming viewing the narration or BGM audio channel (channel numbers 5 and 6 in FIG. 24). It is a composition to synthesize. (In FIG. 25, indicated as specific ch)

  According to the present embodiment, in addition to the effects of the first and second embodiments, it is possible to stably listen to voices such as narration and BGM that do not normally depend on the cut-out position.

[Example 4]
Next, a fourth embodiment according to the present invention will be described.

  In the embodiments so far, for the sake of simplicity, the case of trimming viewing where there is no offset in the vertical direction of the screen (y coordinate is 0) has been described, but in the fourth embodiment, there is also an offset in the vertical direction of the screen. The case to be cut out will be briefly described.

  FIG. 26 is a diagram illustrating the position of the cut-out viewing screen in the fourth embodiment. In the fourth embodiment, as in the previous embodiments, a part of the super high-definition screen 2501 is clipped and viewed at a high-definition resolution 2502, but the clip position is not centered in both the x-axis direction and the y-axis direction. This is different from the previous embodiments.

  In the case of cut-out viewing as shown in FIG. 26, the combination to be output to the front speakers TFL, TFC, TFL in trimming viewing including not only the middle-layer speakers in the 22.2ch system but also upper and lower speakers is determined.

  The processing from step S1118 to step S1122 in the processing flow (FIG. 11) of the display position detection unit 107 corresponds to this. In Examples 1 to 3 so far, the combination of only FL, FLc, FC, FRc, and FR of the intermediate layer has been determined, but in Example 4, TpFL, TpFC, TpFR, and BtFL of the lower layer are further increased. , BtFC and BtFR are included to determine the combination.

  The processing in the correction data calculation unit 108 after the combination determination and the processing in the audio output control unit 111 are the same as those in the first to third embodiments except that the number of channels to be combined is increased.

  The specific configuration of the present invention has been described with reference to a plurality of embodiments. However, the scope of the present invention is not limited to the above embodiments. For example, the above embodiment has been described by taking the 22.2ch system as the audio mode before clipping and viewing and the 5.1ch system as the sound mode during clipping and viewing, but the present invention can also be applied to other audio mode combinations. It is.

  In the above embodiment, the configuration in which the broadcast wave is received from the antenna 101 has been described as an example. However, the present invention can also be applied to the case where content (program) is received from an IP network such as the Internet. Even in this case, the processing for detecting the display position and controlling the multi-channel audio output based on the position and size is the same.

  Furthermore, in the above-described embodiment, the method of specifying by sending metadata from the broadcasting station and the method of specifying the user by the function of the receiving device have been described as the method for specifying the cutout position of the screen. However, the present invention can be applied even when an application that operates on the receiving apparatus is sent from the broadcasting station and the application controls the cut-out position.

The block diagram which shows the structure of the digital broadcast receiver concerning this invention The block diagram which shows the structure of the correction data calculation part concerning this invention The figure which shows the cutout screen position in Example 1 of this invention The block diagram which shows the structure of the audio | voice output control part concerning Example 1 of this invention. The figure which shows the speaker arrangement of a 22.2ch audio system Flowchart for explaining metadata processing according to the present invention Diagram showing the data structure of component descriptors used in digital broadcasting Example of video component type according to the present invention The figure which shows the data structure of the extended format event descriptor which is operated with digital broadcasting An example of trimming information according to the first embodiment of the present invention The flowchart for demonstrating the display position detection process concerning this invention. The figure which shows the relationship between the cut-out screen position and speaker position concerning Example 1 of this invention. The figure which shows the relationship between the cut-out screen position and speaker position concerning Example 1 of this invention. Flowchart for explaining correction data calculation processing according to the present invention The figure for demonstrating the synthesis | combination process of the audio | voice data output to TFL (front left speaker of a cut-out screen) concerning Example 1 of this invention. The figure for demonstrating the synthesis | combination process of the audio | voice data output to TFL (front left speaker of a cut-out screen) concerning Example 1 of this invention (other example) The figure for demonstrating the distance relationship between TFL (front left speaker of a cut-out screen) and FL (front left speaker of an original screen) concerning Example 1 of this invention. The figure which shows the cutout screen position in Example 2 of this invention The figure for demonstrating the synthesis | combination process of the audio | voice data output to TFL (front left speaker of a cut-out screen) concerning Example 2 of this invention. The figure for demonstrating angle calculation with each speaker in the viewing-and-listening position concerning this invention. The figure for demonstrating the synthetic | combination process of the audio | voice data output to TFC (front center speaker of a cut-out screen) concerning Example 2 of this invention. The block diagram which shows the structure of the audio | voice output control part concerning Example 2 of this invention. Example of audio component type according to the third embodiment of the present invention Example of audio event information according to Embodiment 3 of the present invention The block diagram which shows the structure of the audio | voice output control part concerning Example 3 of this invention. The figure which shows the cutout screen position in Example 4 of this invention

Explanation of symbols

106 Metadata processing unit 107 Display position detection unit 108 Correction data calculation unit 111 Audio output control unit 201 Angle analysis unit 202 Mixed gain data calculation unit 203 Distance analysis unit 204 Gain correction data calculation unit 205 Delay amount correction data calculation unit

Claims (7)

Receiving means for receiving a first video accompanied by a plurality of channels of audio;
Video output control means for cutting out a part of the first video and outputting a second video;
An audio output control means for generating an output audio for output together with the second video;
Based on the cut-out position of the second video, further comprising a determining unit that determines a combination of input audios used for synthesizing the output audio from a plurality of channels of input audio that is the audio of the first video,
The audio output control means generates the output audio by synthesizing the input voice determined by the determining means. The sound image at the viewing position is corrected based on the positional relationship between the speaker position of the input audio, the speaker position of the output audio, and the viewing position of the second video, which is determined according to the cutout position of the second video. Correction data calculating means for calculating correction data for performing,
The receiving apparatus according to claim 1, wherein the sound output control unit generates the output sound using the correction data.   3. The correction data according to claim 2, wherein the correction data includes data for determining a mixing ratio of the input sound used for generation of the output sound as data for correcting a direction of arrival of the sound at the viewing position. Receiver device.   The receiving apparatus according to claim 2, wherein the correction data includes data for determining a gain to be given to the output sound as data for correcting a volume at the viewing position.   5. The correction data according to claim 2, wherein the correction data includes data for determining a delay amount given to the output sound as data for correcting a distance to a sound source at the viewing position. The receiving device described. When a predetermined type of input sound is included in the input sound of the plurality of channels,
The audio output control means synthesizes the predetermined type of input audio with an output audio of a predetermined channel regardless of the cutout position of the second video. The receiving device according to Item 1. Receiving a first video with multiple channels of audio;
Cutting out a portion of the first video and outputting a second video;
Generating output audio for output together with the second video,
Generating the output speech comprises:
Determining a combination of input sounds used for synthesizing the output sound from a plurality of channels of input sound, which is the sound of the first image, based on the cut-out position of the second image;
And synthesizing the determined input speech to generate the output speech.

Images