JP3461055B2 - Audio channel selection synthesis method and apparatus for implementing the method - Google Patents

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an audio channel selection / synthesis method and an apparatus for implementing the method, and more particularly,
Select multiple audio channels from the multi-channel audio channels and select audio channels for each user.
The present invention relates to an audio channel selection / synthesis method for selective synthesis and an apparatus for implementing this method.

[0002]

2. Description of the Related Art Conventionally, in television broadcast programs and video contents, audio channels are two-channel main audio and sub-audio, or right-channel and left-channel stereo. Alternatively, it may be one-channel monaural. When there are two audio channels, the selection method of the main audio or the sub audio is selected as the channel selection method, or the reproduction ratio of both audio channels is determined by the balance volume knob of the television receiver. For now, the only option is to adjust. Generally, when a large number of audio channels are provided for one program, an efficient selection method for selecting a plurality of audio channels from these and synthesizing the selected audio channels with an appropriate synthesizing ratio for reproduction. Has not been developed.

For example, in a baseball relay, a plurality of audio channels of a stadium are provided at the same time. A viewer selects a plurality of favorite audio channels from these audio channels and synthesizes them with an appropriate synthesis ratio. There is no way to select the audio channel to use. Furthermore,
When a plurality of users are watching one video screen, an efficient method for selecting and reproducing different audio channels for each user has not been developed.

[0004]

SUMMARY OF THE INVENTION In the present invention, when a plurality of audio channels are provided for one program, a plurality of audio channels are selected from these channels, and the selected audio channel is appropriately selected. When a plurality of users view one video screen by combining with a combining ratio, a different audio channel is selected and combined for each user to solve the above-mentioned problem, and an audio channel selecting and combining method. An apparatus for performing the method is provided.

[0005]

According to an audio channel selecting / synthesizing method of displaying an image on a screen and synthesizing and reproducing audio of a channel selected from a plurality of audio channels at an arbitrary ratio, Equipped with a plurality of pointers for selecting the audio channel points by associating the indicated audio channel points with the positions on the screen.
Then, display these pointers by superimposing them on the screen separately ,
A voice channel selection / synthesis method for deciding a voice synthesis ratio of a voice channel based on a relative distance between a reference position in the displayed pointer and a selected voice channel point is configured for each different pointer .

Then, in the above audio channel selection / synthesis method, an audio channel selection / synthesis method for operating the size of the pointer is constructed. Also, in the previous audio channel selection and synthesis method, it was selected as the reference position in the pointer.
Sound based on the relative distance between the audio channel points
We constructed a voice channel selection synthesis method that changes the voice synthesis ratio of voice channels. Here, a user setting information for operating a pointer position is generated in an audio channel selection / synthesis device that displays an image on a screen and synthesizes and reproduces audio of a channel selected from a plurality of audio channels at an arbitrary ratio. A user operation control unit 105 for generating a pointer display signal indicating a pointer position to be displayed on the screen based on the user setting information and generating user operation information indicating the set pointer position. The audio channel point selection unit 104 is provided which internally generates the corresponding arrangement relationship of the audio channel points on the screen, and generates audio channel ratio information indicating the audio channel and the audio channel ratio to be selected based on the position of the pointer. A voice channel that is provided and is provided based on the voice synthesis ratio information. Comprising a speech channel selection unit 101 for selecting any of the voice channels from Le, the audio channel selected by audio channel selector 101 comprises a speech synthesis unit 102 for synthesizing the above speech synthesis ratio, uttering synthesized speech A speaker 103 is provided, in which the pointer operation unit, the
User operation control unit, above audio channel point selection
Section, the voice channel selection section, the voice synthesis section, and
We have multiple sets of the above speakers, and these sets are for each
A voice channel selection / synthesis device that operates is constructed.

In the above-mentioned audio channel selection / synthesis device, the pointer operation unit has a structure for changing the shape of the pointer, thereby constructing an audio channel selection / synthesis device. Further, in the above-mentioned voice channel selection / synthesis device, the voice channel point selection unit has a configuration for changing the voice synthesis ratio filter that defines the voice synthesis ratio.

[0008]

EXAMPLES way audio channel selection synthesis of the present invention Oyo
And components of the apparatus will be described with reference to FIG. In FIG. 1, 101 is an audio channel selection unit that selects an arbitrary audio channel from a plurality of provided audio channels, 102 is a voice synthesis unit that synthesizes the audio channels selected by the audio channel selection unit at an arbitrary synthesis ratio,
Reference numeral 103 is a speaker that outputs the synthesized voice. 1
Reference numeral 04 is an audio channel point selection unit that internally generates a corresponding layout relationship of the audio channel points 401 on the screen, and determines the audio channel to be selected based on the position of the pointer, and 105 controls the pointer displayed on the screen. A user operation control unit 107 is user operation information that conveys a pointer position operated by a viewer and parameters. Reference numeral 106 denotes a display that displays an image and a pointer. Reference numeral 108 is audio channel point arrangement information from the center and other center information, 110 is audio synthesis ratio information, 111 is a video signal, 112 is a plurality of audio channels provided, 113 is a pointer display signal, and 114 is an audio signal. Reference numeral 115 is a pointer operation unit,
Reference numeral 6 is a volume for operating parameters, and 117 is a pointer position operation key for operating the position of the pointer. 11
8 is the volume 116 of the pointer operation unit 115 by the user.
And user setting information set by operating the pointer position operation key 117.

Next, the pointer will be described. FIG. 2 is a diagram for explaining the pointer. In FIG. 2, for convenience of explanation, the parameter R will be described as corresponding to the size of the pointer. Reference numeral 201 denotes a screen on which an image is displayed, and 202 denotes a pointer superimposed on the screen. Thirty
1 is a center position which is a reference position in the pointer, and 302 is a size of the pointer determined by the parameter R. As an example, it is assumed that the shape of the pointer 202 is a circle, and the size of the pointer determined by the parameter R is proportional to the radius of the circle. The shape of the pointer 202 may be a polygon such as a quadrangle or another shape such as an ellipse. Also,
It is also possible that the shape is not symmetrical about the center 301. Furthermore, the shape of the pointer 202 may change non-linearly depending on the parameter R.

FIG. 3 is a diagram for explaining the relationship between the screen and the pointer. In FIG. 3, 201 is a screen on which an image is displayed, and the image signal 111 shown in FIG. 1 is displayed. Here, as an example, a baseball relay stadium is displayed. A pointer 202 is also superimposed on the screen. Next, with reference to FIG. 4, a description will be given of a plurality of audio channels provided and a positional relationship on the screen. The corresponding position on the screen corresponding to each audio channel is called an audio channel point. Figure 4
Indicates the positional relationship on the screen 201 of the audio channel points expressed inside the audio channel point selection unit 104. Black dots indicated by 401 on the screen 201 indicate audio channel points. The arrangement position of each audio channel point 401 is transmitted to the audio channel point selection unit 104 as the audio channel point arrangement information in the center information 108. As a result, the corresponding layout relationship of each audio channel point 401 on the screen is generated inside the audio channel point selection unit 104.

As an example, FIG. 4 shows 35 audio channel points 401, which are arranged at equal intervals. These audio channel points 401 may be arranged non-uniformly corresponding to the displayed video.
Here, the audio channel point 401 and each audio channel are arranged corresponding to the contents of the video displayed on the screen 201. This will be described with reference to FIG. 10 showing the relationship between audio channel points and screen contents.
For convenience of explanation, as shown in FIG. 5, the position of the audio channel point 401 is defined by the horizontal axis x and the vertical axis y coordinate, and the position of the audio channel point 401 is indicated by the coordinate (x, y). Lower left audio channel point 40
The coordinates of 1 are (1, 5).

When the relay from the baseball field shown in FIG. 10 is displayed on the screen 201, the voice channel points at coordinates (4, 5) are made to correspond to the voice channels recorded near the home base. Then, the audio channel point of the coordinates (4, 1) is associated with the audio channel of the audio recorded near the scoreboard. The audio channel of the audio corresponding to the position of the video is made to correspond to each of the other audio channel points. Next, a method of selecting an audio channel that the viewer wants to listen from among a plurality of audio channels provided will be described.

The viewer operates the pointer position operation key 117 of the pointer operation unit 115 of FIG. 1 to move the pointer 202 to a position where he / she wants to hear. Then the pointer 2
Pointer volume 116 to determine the size of 02
Is operated to change the value of the parameter R. The position information of the pointer 202 and the parameter R set by the pointer operation unit 115 are transmitted to the user operation control unit 105 as user setting information 118. User operation control unit 105
Transmits the pointer display signal 113 determined by the position information of the pointer and the parameter R to the display 106 for displaying the image and the pointer, and displays the pointer on the screen 201.

The user operation information 107 is also transmitted from the user operation control unit 105 to the audio channel point selection unit 104. The audio channel point selection unit 104
The pointer 202 and the audio channel point 401 are represented as shown in FIG. 6 by the pointer position / size information included in the user operation information 107 and the audio channel point arrangement information in the transmitted center information 108. It Here, the audio channel point 401 is selected according to the position and size of the pointer 202.
In this case, the audio channel points inside the pointer 202 are coordinates (2,3), (3,2), (3,3),
Five audio channel points (3, 4) and (4, 3) are selected.

The audio channel point selection unit 104 is
A voice synthesis ratio filter is generated based on the voice synthesis ratio filter information in the center information 108. FIG. 7 is a diagram for explaining the voice synthesis ratio filter. The vertical axis is the synthesis ratio, and the horizontal axis is the relative distance between the center position 301 of the pointer and the audio channel point 401. R on the horizontal axis,-
R indicates the size of the pointer 202 determined by the parameter R. The synthesis ratio of the audio channel is determined according to the relative distance between the audio channel point 401 and the center position 301 of the pointer.

A method of calculating the composition ratio will be described with reference to FIG. 8 which is the same as FIG. A total of five coordinates (2, 3), (3, 2), (3, selected as shown in FIG.
3), (3, 4) and coordinates (2, 3) existing on a straight line of the audio channel points of (4, 3),
The three audio channel points 401 (3, 3) and (4, 3) will be described. In FIG. 8, three black circles lined up on the horizontal axis represent coordinates (2, 3), (3,
3) and (4, 3) audio channel points are shown. Since these three audio channel points are all inside the pointer 202, each point is located between the relative positions −R to + R on this characteristic, and from this characteristic, the relative position of each channel point is determined. The composite ratio on the vertical axis corresponding to is determined. For example, coordinates (2,
The synthesis ratio of the audio channel point of 3) to the audio channel is determined to be 0.05 from the corresponding point of this characteristic. Similarly, the synthesis ratio of the audio channel points at coordinates (3, 3) is determined to be 0.95, and the synthesis ratio of the audio channel points at coordinates (4, 3) is determined to be 0.30.

Here, the characteristic of the voice synthesis ratio filter is described as a one-dimensional characteristic corresponding to the relative distance between the center position 301 of the pointer 202 and the voice channel point 401, but the plane of the screen 201 is described. It is also possible to use the two-dimensional characteristic corresponding to (x, y). The synthesis ratio of the audio channel determined as described above is displayed as shown in FIG. For example, since the audio channel corresponding to the audio channel point 401 located outside the pointer R is not synthesized, the synthesis ratio is "0".

Next, the synthesis ratio of each voice channel is transmitted to the voice channel selection unit 101 and the voice synthesis unit 102 as the voice synthesis ratio information 110. The voice channel selection unit 101 selects a voice channel with a synthesis ratio other than "0" based on this voice synthesis ratio. Next, the voice synthesizing unit 102 mixes and synthesizes the selected voice channels at a ratio corresponding to each voice synthesizing ratio, and reproduces. Although the above-described embodiments have been described with respect to baseball broadcasts and other live broadcast videos, they are not live broadcast videos but intentionally created images such as dramas, animations, CG, and other non-real world virtual world videos. Can be similarly implemented. In this embodiment, the material in which one image is displayed on the entire screen has been described, but the same applies to a material in which a plurality of images are displayed in one screen as a material. Can be carried out. FIG. 14 shows an example of a multi-screen image. The multi-screen image of FIG. 14 is one in which the images are evenly arranged, and can be similarly applied to the non-uniformly arranged multi-screen image.

Here, in selecting the previous channel, the sound
A parameter F for operating the characteristics of the voice synthesis ratio filter is attached.
Add The operation of the viewer will be described below. The viewer uses the parameter F on the pointer operation unit 115 of FIG.
To operate. The information on the operated parameter is used as the user operation information 107 by the audio channel point selection unit 104.
Be transmitted to. The voice channel point selection unit 104 changes the characteristics of the voice synthesis ratio filter based on the information of this parameter. This changed voice
Each audio channel using a synthesis ratio filter
Determine the composition ratio of .

12 and 13 show a voice synthesis ratio filter which changes according to the parameter F. The voice synthesis ratio filter shown in FIG. 12 is an example in which the synthesis ratio is maximum at the center of the pointer and the synthesis ratio decreases as it approaches the periphery. The reduction rate in the periphery is changed by the parameter F. The voice synthesis ratio filter shown in FIG. 13 is an example in which the position at which the synthesis ratio becomes maximum is changed by the parameter F. The viewer is the parameter R
And one or both of the parameters F are operated and set.

An embodiment of the present invention will be described with reference to FIG .
To do . In FIG. 11, a plurality of viewers simultaneously display the same screen 201.
Shows a voice channel synthesizing / selecting device for viewing, and prepares the pointer operation unit 115 and the speaker 103 for each viewer, and allows each viewer to monopolize them, and each viewer likes while viewing the same screen 201. You can select and listen to the sound of. In this case, the pointer operation unit 115, the user operation control unit 105, the audio channel point selection unit 104, the audio channel selection unit 101, the audio synthesis unit 10
2 and a plurality of audio channel synthesis / selection devices each including a speaker 103, and each user operation control unit 1
The selection operation is performed while displaying the pointer R for each 05 on the same screen 201. The viewer operates his or her pointer operation unit 115 to select the audio channel as in the previous embodiment. The operation procedure to be executed by the viewer is the same as in the previous embodiment.

Finally, another embodiment will be described. In this embodiment, the standard pointer position /
Standard information indicating size information and voice synthesis rate filter information is included. When the particular user operation information 107 is not transmitted from the user operation control unit 105, the audio channel selection unit 101 selects an audio channel point based on this standard information and synthesizes the audio channel. By doing so, the standard pointer position / size information and voice synthesis ratio filter information suitable for the change of the video content are formed to provide the recommended voice synthesis state on the center side.

As described above, for example, when a plurality of audio channels of the stadium are provided at the same time in a baseball relay broadcast, the viewer selects some of the favorite audio channels from the audio channels and selects a desired audio channel from them. It can be combined and viewed with. Further, for example, when it is desired to hear only the sound around the grasshopper near the home base, it can be realized by moving the pointer near the home base and reducing the size of the pointer with the pointer volume. Further, when it is desired to hear the sound of the entire screen evenly, it can be realized by moving the pointer near the center of the screen and adjusting the size of the pointer so as to cover the entire screen. Also, by moving the center of the pointer to the position of the voice that you want to hear and covering the entire screen with the size of the pointer, you can hear the voice that you want to hear with a large synthesis ratio and also hear the voice of the entire screen. it can. As described above, by using the present invention in a baseball relay broadcast or the like, the appeal as a program is enhanced.

[0024]

As described above, according to the present invention, a viewer can easily select an audio channel at a desired position in a video when a large number of audio channels are provided for one program. It is possible to select the audio channel, synthesize the audio channel with an appropriate synthesizing ratio, and view the audio channel. Then, by moving the pointer, it is possible to easily select the sound at an arbitrary position in the video. In addition, by adjusting the volume of the pointer, it is possible to freely zoom in and out on the desired sound in the video. Furthermore, the voice synthesis ratio can be adjusted to a desired ratio by operating the characteristics of the voice synthesis ratio filter.

When a plurality of viewers are watching the same screen at the same time, by preparing a plurality of pointers and a plurality of spikers, each viewer can watch the same screen. Regardless, it is possible to listen to the favorite voice for each viewer. In this way, it is possible to enhance the attractiveness of a program when a plurality of viewers watch one program. Then, by changing the standard pointer position / size information and the voice synthesis ratio filter information transmitted from the center so as to match the contents of the video, the viewer can perform operations on the center side without any operation. The state of voice synthesis to be set can be viewed.

[Brief description of drawings]

FIG. 1 is a diagram illustrating the overall configuration of the present invention.

FIG. 2 is a diagram illustrating a pointer.

FIG. 3 is a diagram illustrating a relationship between a pointer and a screen.

FIG. 4 is a diagram illustrating a relationship between audio channel points and a screen.

FIG. 5 is a diagram illustrating positions of audio channel points.

FIG. 6 is a diagram illustrating the relationship between audio channel points and pointers.

FIG. 7 is a diagram illustrating a voice synthesis ratio filter.

FIG. 8 is a diagram showing a relationship between a voice synthesis ratio filter and voice channel points.

FIG. 9 is a diagram showing a relationship between audio channels and a synthesis ratio.

FIG. 10 is a diagram illustrating a relationship between audio channel points and screen contents.

FIG. 11 is a diagram illustrating an example of using a plurality of pointers.

FIG. 12 is a diagram showing a relationship between a voice synthesis ratio filter and a parameter F.

FIG. 13 is a diagram showing a relationship between a voice synthesis ratio filter and a parameter F.

FIG. 14 is a diagram showing a multi-screen.

[Explanation of symbols]

101 Audio channel selection section 102 voice synthesizer 103 speaker 104 Audio channel point selector 105 user operation control unit 107 user operation information 110 Speech synthesis ratio information 113 Pointer display signal 115 Pointer operation unit 118 user setting information 201 screen 401 audio channel points

─────────────────────────────────────────────────── ─── Continuation of front page (58) Fields surveyed (Int.Cl. ⁷ , DB name) H04N 5/50-5/63 H04N 7/00-7/088 H04H 5/00 H04S 1/00-7 / 00 G10H 1/00-7/08

Claims (6)

(57) [Claims] 1. A voice channel selection / synthesis method for displaying a video on a screen and synthesizing and playing back voices of a channel selected from a plurality of voice channels at an arbitrary ratio, in a voice channel point indicating a voice channel position. And a position on the screen are associated with each other, and a plurality of pointers for selecting an audio channel point are provided, and these pointers are separately superimposed and displayed on the screen. For each different pointer, the reference within the displayed pointer is displayed. A method for selecting and synthesizing a voice channel, characterized in that a voice synthesizing ratio of a voice channel is determined based on a relative distance between a position and a selected voice channel point. 2. The audio channel selection / synthesis method according to claim 1, wherein the size of the pointer is operated. 3. The audio channel selection / synthesis method according to claim 1, wherein the audio channel is based on the relative distance between the reference position in the pointer and the selected audio channel point. A method for selecting and synthesizing voice channels, characterized by changing the voice synthesis ratio of the voice. 4. A user setting information for operating a pointer position in an audio channel selection synthesizing device for displaying a video on a screen and synthesizing and reproducing audio of a channel selected from a plurality of audio channels at an arbitrary ratio. A user operation control unit for generating a pointer display signal indicating a pointer position to be displayed on the screen based on user setting information and generating user operation information indicating the set pointer position. And a voice channel point selection unit for internally generating a corresponding layout relation of the voice channel points on the screen, and generating voice synthesis ratio information indicating a voice channel and a voice synthesis ratio to be selected based on the position of the pointer. However, it is possible to select from multiple audio channels provided based on the audio synthesis ratio information. A voice channel selecting unit for selecting the voice channel of, a voice synthesizing unit for synthesizing the voice channels selected by the voice channel selecting unit at the above voice synthesizing ratio, and a speaker for uttering a synthesized voice, , The pointer operation unit, the user operation control unit,
A plurality of sets of the audio channel point selection unit, the audio channel selection unit, the audio synthesis unit, and the speaker are provided, and each pointer of the plurality of user operation control units
The audio channel selecting / synthesizing device is characterized in that these groups are operated separately while displaying on the same screen . 5. The audio channel selection / synthesis device according to claim 4, wherein the pointer operation unit has a configuration for changing the shape of the pointer. 6. The voice channel selection / synthesis apparatus according to claim 4, wherein the voice channel point selection unit has a configuration for changing a voice synthesis ratio filter that defines a voice synthesis ratio. An audio channel selection / synthesis device characterized in that