JP2009117990A - Information presenting apparatus and information presenting method - Google Patents

Abstract

An amount of information provided to a user is adaptively adjusted by an easy method.
A delay that is output to a display unit other than a first display unit among a plurality of display units arranged in a ring shape by adding a predetermined amount of delay to a video whose playback speed is set to a predetermined speed. Unit 70, a playback speed converting unit 60 that converts the playback speed of the input video based on the given variable, and outputs the converted video to the first display unit and delay unit 70, and a gaze detection that detects the position of the user's gaze A playback speed determining unit 50 that determines a playback speed according to the arrangement position of the display unit at the position of the line of sight detected by the unit 3 and outputs a variable according to the determined playback speed to the playback speed conversion unit 60. Prepared.
[Selection] Figure 2

Description

  The present invention relates to an information presentation apparatus and an information presentation method suitable for presenting information using, for example, a plurality of display devices.

  2. Description of the Related Art Conventionally, when information is to be acquired efficiently from video or the like being played back on a display device or the like, playback or the like is performed in a fast turn. This is because the amount of information that can be acquired within a unit time can be increased by playing it quickly. However, when viewing what has been played back quickly, the user (viewer) often misses necessary information.

  If the information is missed, an operation for rewinding the reproduction position may be performed. However, it is necessary to perform the operation every time the information is missed, which is troublesome. In addition, such an operation may lower the information acquisition efficiency.

  For this reason, in the video to be played, the playback speed is automatically adjusted according to the characteristics of the video, such as reducing the playback speed in scenes with a lot of movement and increasing the playback speed in scenes with a little movement. Yes.

Japanese Patent Application Laid-Open No. 2004-228561 discloses that a video feature is detected in a video including moving images and audio, and the video is played while automatically adjusting the playback speed according to the video feature.
Japanese Patent Laid-Open No. 10-243351

  However, the technique described in Patent Document 1 has a problem that it cannot meet the needs of users who want to increase the video playback speed even in scenes with a lot of movement. In other words, the scene that the user wants to reduce or increase the playback speed of the video differs depending on the state of the user, the user's ability, and the preference. There was a problem that it was not possible to provide information that met various needs.

  In order to optimize the amount of information provided according to the user's condition, ability and preference, it is necessary to first measure the user's condition and ability. For such data measurement, an electroencephalograph, an electrocardiogram, NIRS ( It is necessary to use a large-scale apparatus such as Near-Infrared Spectroscopy. In other words, since the cost is high, it is often difficult to realize the information presentation system.

  In order to acquire the internal state such as the user's state, ability, and preference without using such a device, a method of letting the user self-report these pieces of information is also conceivable. However, if the user performs complicated operations such as key input, the burden on the user increases, which is expected to hinder efficient user information acquisition.

  The present invention has been made in view of this point, and an object thereof is to adaptively adjust the amount of information to be provided to a user with an easy technique.

  According to the present invention, a display unit other than the first display unit among N (natural number) display units arranged in a ring shape by adding a predetermined amount of delay to a video whose playback speed is set to a predetermined speed. A delay unit that outputs to the display unit, a playback speed conversion unit that converts the playback speed of the input video based on a given variable, and outputs to the first display unit and the delay unit, and a line of sight that detects the position of the user's line of sight A playback speed determining unit that determines a playback speed according to the arrangement position of the display unit at the line of sight detected by the detection unit and outputs a variable according to the determined playback speed to the playback speed conversion unit; Is.

  By doing in this way, according to the position of a user's eyes | visual_axis, the reproduction | regeneration speed of an image comes to be adjusted automatically.

  According to the present invention, since the video playback speed increases or decreases according to the position of the user's line of sight, the amount of information provided to the user is adaptively adjusted.

  DESCRIPTION OF EXEMPLARY EMBODIMENTS Hereinafter, a first embodiment of the invention will be described with reference to the accompanying drawings. An example of the system configuration in this embodiment is shown in FIG. The system shown in FIG. 1 has a playback device 1 that plays back images, videos, and the like at a playback speed such as double speed, display devices 2A, 2B, and 2C that display playback videos, and the position of the line of sight L1 of the user U. It is comprised with the gaze detection apparatus 3 (gaze detection part) detected by the position where the user's U gaze is directed. The display devices 2 </ b> A to 2 </ b> C and the line-of-sight detection device 3 are connected to the playback device 1 by a cable 4. Although this example is applied to the case where three display devices are used, the number is not limited to this.

  On the display devices 2A to 2C, images of the same material read from the storage unit 30 in the playback device 1 to be described later are displayed. However, the playback device 1 is provided with a delay unit (not shown). The video displayed on .about.2C has a different delay amount depending on the arrangement position. In the example shown in FIG. 1, three display devices are arranged in a circle, and an image without delay is displayed on the rightmost display device 2 </ b> C when viewed from the user U. The display device 2A displays an image with a delay of D seconds, and the leftmost display device 2B displays an image with a delay of 2D seconds.

  In this example, the amount of delay applied to the video output to the display devices 2A to 2C is calculated based on the position of the line of sight L1 of the user U. FIG. 1 shows an example in which the line of sight L1 of the user U is on the screen of the display device 2A. With the configuration shown in FIG. 1, an image that is D seconds ahead of the image that the user U is gazing is displayed on the display device 2 </ b> C on the right side of the display device 2 </ b> A where the line of sight L <b> 1 of the user U is located. On the display device 2B on the left side of the display device 2A where the line of sight L1 of the user U is located, an image delayed by D seconds from the image viewed by the user U is displayed. The D seconds here are, for example, the number of seconds such as 3 seconds, and can be set to an arbitrary value according to the number of the display devices 2, the information acquisition capability and preference of the user.

  The line-of-sight detection device 3 detects the position of the line of sight L1 of the user U and the movement of the line of sight L1, and sends the detection result to the playback device 1. The line-of-sight detection device 3 is a device that detects the position of the line of sight L1 of the user U, and is disposed at a position where the line of sight L1 of the user U can be easily detected, such as a position facing the user U, for example. In this example, a stationary apparatus is used as the visual inspection apparatus 3, but eye-gaze detection glasses of the type worn by the user U may be used. Or you may make it detect the position of the user's U eyes | visual_axis L1 with the surveillance camera installed in the distance.

  Next, an example of the internal configuration of the system will be described with reference to the block diagram shown in FIG. The playback apparatus 1 includes a video input unit 10, an encoding / decoding processing unit 20, a storage unit 30, a delay amount determination unit 40, a playback speed / playback position determination unit 50 as a playback speed determination unit, and a playback A speed conversion unit 60 and delay units 70A, 70B, and 70C are included. In FIG. 2, the recorded video recorded in the storage unit 30 is indicated by a broken line, the reproduced video reproduced on the display devices 2A to 2C is indicated by a one-dot chain line, and the data is indicated by a solid line.

  The video input unit 10 takes in a video signal into the playback device 1 via an input terminal or the like, and performs a signal level conversion process. The encoding / decoding processing unit 20 performs a process of encoding the video signal input from the video input unit 10 and outputting the encoded video signal to the storage unit 30 as a recorded video. The compressed video data stored in the storage unit 30 is read from the playback position output from the playback speed / playback position determination unit 50, decoded, and output to the playback speed conversion unit 60. It is assumed that the encoding rate uses the same rate as the frame rate of the video input from the video input unit 10, and decoding is performed at a playback speed Vk (unit: double speed) transmitted from the playback speed / playback position determination unit 50. Based on the above. Then, the playback speed conversion unit 60 performs processing for converting the current playback speed V (at that time) into the playback speed Vk output from the playback speed / playback position determination unit 50. The storage unit 30 is configured by, for example, an HDD (Hard Disc Drive), and stores the video encoded by the encoding / decoding processing unit 20.

  The delay amount determination unit 40 performs processing for associating the line-of-sight position of the user U with the arrangement positions of the display devices 2A to 2C based on the detection result input from the line-of-sight detection device 3. Then, with reference to the arrangement position of the display device 2 where the line of sight L1 is located, a delay amount to be allocated to each delay unit 70 is calculated, and the calculated delay amount is sent to the playback speed / playback position determination unit 50 and the delay units 70A to 70C. Send.

  The playback speed / playback position determination unit 50 includes a variable Pinc for increasing the playback speed V and a variable Pdec for decreasing the playback speed V, and the moving direction of the line-of-sight position transmitted from the line-of-sight detection device 3. In accordance with, it is determined which of the variable Pinc and the variable Pdec is to be applied. Then, a variable Vk obtained by multiplying the current playback speed V by the variable Pinc or variable Pdec is transmitted to the encoding / decoding processor 20 and the playback speed converter 60.

  In this example, in the playback speed / playback position determination unit 50, when the line-of-sight position transmitted from the line-of-sight detection device 3 is changing clockwise, the variable Pinc is used to increase the playback speed to the playback speed V at that time. And the variable Vk obtained by multiplying the variable Pinc by the reproduction speed V is output. If the line-of-sight position transmitted from the line-of-sight detection device 3 has changed counterclockwise, the variable Pdec for decreasing the reproduction speed is selected as the reproduction speed V at that time, and the reproduction speed V is set as the variable Pdec. A variable Vk obtained by multiplication is output.

  For example, a numerical value such as 1.5 is used as the variable Pinc, and a numerical value such as 0.5 is used as the variable Pdec. The value of Pinc may be any value as long as it is a value greater than 1, and the value of Pdec may be any value as long as it is a value greater than 0 and less than 1. The reproduction speed determination unit 50 also performs processing for advancing or returning the reproduction position of the video displayed on each display device 2 in accordance with the movement direction of the visual line position transmitted from the visual line detection device 3. Then, the reproduction position adjusted in this way is output to the encoding / decoding processing unit 20 and the reproduction speed conversion unit 60. In this example, when the line-of-sight position transmitted from the line-of-sight detection device 3 is changing clockwise, the reproduction position is advanced by the number of frames calculated by multiplying the variable Vk by the delay amount D, and the line of sight is When the line-of-sight position transmitted from the detection device 3 has changed counterclockwise, the reproduction position is returned by the number of frames calculated by multiplying the variable Vk by the delay amount D. is there. Details of the processing of the delay amount determination unit 40 and the playback speed / playback position determination unit 50 will be described later.

  The playback speed conversion unit 60 includes a video processing unit 61 and an audio processing unit 62. The video processing unit 61 converts the playback speed so that the playback speed V of the video output from the encoding / decoding processing unit 20 becomes the playback speed Vk input from the playback speed / playback position determining unit 50. I do. Then, the video whose playback speed is converted is supplied to the delay unit 70A, the delay unit 70B, and the delay unit 70C. The audio processing unit 62 performs a process of converting the reproduction speed without changing the pitch by a method such as deleting a silent part or a part with continuous audio characteristics from the audio signal. Specific processing of audio playback speed conversion is described in Japanese Patent Laid-Open No. 2000-99097 as an example. Details of the processing of the playback speed conversion unit 60 (video processing unit 61) will be described later.

  The delay units 70 </ b> A to 70 </ b> C delay the video output from the playback speed conversion unit 60 by the delay amount output from the delay amount determination unit 40, and apply the delay to the corresponding display devices 2 </ b> A to 2 </ b> C. Output. The delay unit 70A outputs video to the display device 2A, the delay unit 70B outputs video to the display device 2B, and the delay unit 70C outputs video to the display device 2C.

  Next, a processing example of the delay amount determination unit 40 will be described with reference to the flowchart of FIG. In this example, the delay amount determination unit 40 first sets zero as the delay amount to the delay unit 70 that outputs the video from the display device 2 with the line of sight L1 of the user U to the display device 2 in the half-clockwise position. Allocate a delay of D seconds in the counterclockwise direction from that position.

  In FIG. 3, the delay amount determination unit 40 first determines whether or not the line-of-sight position L1 transmitted from the line-of-sight detection device 3 has changed compared to the line-of-sight position L1 received last time (step S1). If it is determined that the position of the line of sight L1 has not changed, the process ends. If it is determined that the line-of-sight position L1 has changed, the number of screens (the number of display devices 2) is substituted into the variable N, the number is divided by 2 and the numbers after the decimal point are rounded down (ROUNDDOWN). (N / 2)) is substituted for variable i (step S2). Next, based on the line-of-sight information input from the line-of-sight detection device 3, the display device 2 where the line of sight L1 of the user U is located is specified, and the display device 2 (the i-th position clockwise from the specified display device 2) The amount of delay applied to the video output to the first display unit is set to (ROUNDDOWN (N / 2) -i) D (step S3).

  The variable i indicates the distance in the clockwise direction from the display device 2 where the line of sight L1 is located. Then, the calculated delay amount is assigned to the display device 2 identified as i-th in the clockwise direction from the display device 2 where the line of sight L1 is located.

  When this process is finished, a process is performed in which the number obtained by subtracting 1 from i is set as a new i (i ← i−1) (step S4). This is a process for changing the object to which the delay amount is allocated. When there are three display devices 2, i is first N / 2 = 3/2 = 1, and the display device 2 positioned first in the clockwise direction from the display device 2 where the line of sight L1 is positioned is delayed. Subject to quantity allocation. Here, when the process (i ← i−1) is performed, i becomes 0, and the target of delay amount assignment is the 0th in the clockwise direction from the display device 2 where the line of sight L1 is located, that is, the line of sight L1 is positioned. Display device 2 to be used. If the process (i ← i−1) is further performed, i becomes −1. That is, the display device 2 that is positioned first in the clockwise direction from the display device 2 in which the line of sight L1 is positioned, that is, the display device 2 that is positioned first in the counterclockwise direction, is the target of delay amount allocation. .

  When there are three display devices 2, when a delay amount is assigned to the display device 2 positioned −1 (= −N / 2) in the clockwise direction from the display device 2 where the line of sight L1 is positioned. The process ends. Therefore, the process is terminated when the value of i becomes smaller than -N / 2. This determination is performed in the next step S5.

  In step S5, it is determined whether i is smaller than the numerical value obtained by (ROUNDDOWN (-N / 2)). When i becomes a numerical value smaller than (ROUNDDOWN (−N / 2)), the process ends. While it is determined that i is equal to or larger than (ROUNDDOWN (−N / 2)), the process returns to step S3. Processing continues.

  If the processing shown in FIG. 3 is applied when the delay amount D is 3 seconds in the example shown in FIG. 1, the number of display devices 2 = 3 is set as the variable N in step S1, As the variable i, ROUNDDOWN (3/2) = 1 is set. In the next step S3, the line of sight L1 of the user U is located on the display device 2A in FIG. 1, and the display device 2 that is positioned first in the clockwise direction from the display device 2A is the display device 2C. Therefore, a delay amount of (ROUNDDOWN (N / 2) -i) D = (1-1) 3 = 0 is set in the display device 2C.

  In step S4, a number obtained by subtracting 1 from i, that is, i-1 = 0 is set as a new i. In step S5, whether or not the conditional expression i <(ROUNDDOWN (-N / 2)) is satisfied. Judgment is made. Since i is set to 0 in step S3, i = 1> (ROUNDDOWN (−3/2)), and the conditional expression in step S5 is not satisfied. Therefore, it returns to step S3 and a process is continued.

  The display device in which the line of sight L1 of the user U is located, that is, the 0th display device 2 clockwise from the display device 2A is the display device 2A itself, and the image output to the display device 2A is (ROUNDDOWN (N / 2) -i) D delay amount is set. That is, a delay amount of (ROUNDDOWN (3/2) -0) 3 = 1 × 3 = 3 seconds is set in the display device 2A.

  At this stage, i-1 is set as a new i (step S3), and i becomes 0-1 = -1. Even when i is −1, since the conditional expression of i <(ROUNDDOWN (−N / 2)) is not satisfied (step S5), the process returns to step S3 again and the processing is continued. The first display device 2 clockwise from the display device 2A where the user's line of sight L1 is located is the display device 2B located at the first position counterclockwise from the display device 2A. Therefore, a delay amount of (ROUNDDOWN (N / 2) -i) D is set in the video output to the display device 2B. Therefore, a delay amount of (ROUNDDOWN (3/2) − (− 1)) 3 = 2 × 3 = 6 seconds is set in the display device 2B.

  By performing such processing, an image with a delay of 0 seconds is output to the display device 2C located at the right end of FIG. 1, and is located at the center of FIG. 1 and displayed on the display device 2A located at the line of sight L1. A video with a delay of 3 seconds is output, and a video with a delay of 6 seconds is output to the display device 2B located at the left end of FIG. That is, assuming that the video displayed on the display device 2A where the line of sight L1 is located is the current video, the display device 2C on the right side (clockwise direction) of the display device 2A where the line of sight L1 is located is the display device 2A. From the displayed image, a future image advanced by 3 seconds is displayed. Then, on the display device 2B adjacent to the left of the display device 2A (counterclockwise direction), a past video delayed by 3 seconds from the video displayed on the display device 2A is displayed.

  In the delay amount determination unit 40, since the delay amount to be applied to the video displayed on each display device is dynamically assigned based on the position of the display device 2 where the line of sight L1 is located in this way, Even in the case of movement, the above-described past-present-future relationship is maintained. In other words, the display device 2 positioned in the clockwise direction with respect to the display device 2 where the line of sight L1 is positioned displays a future image from the image displayed on the display device 2 where the line of sight L1 is positioned, and is counterclockwise. In the display device 2 positioned in the direction of, a past video is displayed from the video displayed on the display device 2 in which the line of sight L1 is positioned.

  FIG. 4 is a diagram schematically showing the relationship between the position of the line of sight L1 of the user U and the amount of delay added to each video displayed on the display devices 2A to 2C. Also in FIG. 4, the delay amount D is assumed to be 3 seconds as in the example shown in FIG. As shown in FIG. 4A, when the line of sight L1 is on the display device 2A, when the screen with the line of sight L1 is regarded as the current screen, the screen of the display device 2C in the clockwise direction from there is displayed. Displays a future image advanced by 3 seconds, and a past image from 3 seconds ago is displayed on the screen of the display device 2B in the counterclockwise direction.

  Also, as shown in FIG. 4C, when the line of sight L1 is moved clockwise and moved onto the display device 2C, the screen with the line of sight L1 (the screen of the display device 2C) is currently displayed. When viewed as a screen, a future image advanced by 3 seconds is displayed on the screen of the display device 2B in the clockwise direction from there, and the screen of the display device 2A in the counterclockwise direction is displayed 3 seconds before. Past images will be displayed.

  As shown in FIG. 4B, when the line of sight L1 is further moved in the clockwise direction and moved onto the display device 2B, when the screen with the line of sight L1 is regarded as the current screen, the clock is The future image advanced by 3 seconds is displayed on the screen of the display device 2A in the rotating direction, and the past image of 3 seconds ago is displayed on the screen of the display device 2C in the counterclockwise direction. become. That is, no matter where the line of sight L1 of the user U moves, the future image is displayed on the display apparatus adjacent in the clockwise direction around the display apparatus 2 where the line of sight L1 is located, and the counterclockwise direction A past image is displayed on the display device adjacent to the.

  Next, a processing example of the playback speed / playback position determination unit 50 will be described with reference to the flowchart of FIG. First, the playback speed / playback position determination unit 50 determines whether or not the line of sight L1 of the user U remains on any one of the plurality of display devices 2 (step S11). When it is determined that the line of sight L1 remains on one of the display devices 2, a process of advancing the video playback position by Vk × Δt is performed (step S12). Here, Δt refers to the time that has elapsed since this process (routine) was called last time until this process is performed. The routine shown in FIG. 5 is performed every time the line-of-sight information is received from the line-of-sight detection device 3, and Δt (seconds), which is the execution period of the routine, can be set to an arbitrary value. . For example, if the routine is set to be executed once per second, Δt is 1 second.

  Assuming that the frame rate of the video input from the video input unit 10 (see FIG. 1) is 30 fps, the playback speed V at that time is 1 × speed, and Δt is 1 second, V The reproduction position of the video is advanced by x Δt = 1.0 × 1 × 30 = 30 frames. Then, the process proceeds to step S20, and a process for outputting the reproduction speed V and the reproduction position obtained in step S12 is performed.

  If “No” is selected in step S11, that is, if it is determined that the line of sight L1 has moved, it is next determined whether or not the line of sight L1 has changed clockwise (step S13). If the line of sight L1 changes clockwise, “Yes” is selected, and the process proceeds to step S14. In step S14, a value obtained by multiplying the playback speed V at that time by the variable Pinc is substituted into the variable Vk. When Pdec is 1.2 and the reproduction speed V at that time is 1 × speed, the variable Vk is 1.2 (Pdec) × 1 (V) = 1.2 (times speed).

  When it is determined that the line of sight L1 has changed clockwise (step S13), the process of increasing the reproduction speed (step S14) is located in the clockwise direction with respect to the display device 2 where the line of sight L1 is located. This is related to the fact that the display device 2 always displays a future image from the image displayed on the display device 2 where the line of sight L1 is located.

  That is, it is considered that the user U moves the line of sight L1 clockwise when he wants to see a future image rather than the image being viewed. And, it is considered that the user U still has room to acquire information if he wants to see a future video rather than a video currently being viewed. For this reason, in this example, by increasing the reproduction speed in such a case, an information amount corresponding to the information acquisition capability of the user U is presented.

  In step S15, a process of advancing the video playback position by Vk × Δt is performed. That is, Vk × Δt = 1.2 × 1 × 30 = 36 frames are added to the video playback position. Then, a process for further advancing the reproduction position by Vk × D is performed (step S16). Since Vk × D = 1.2 (double speed) × 3 (seconds) × 30 (fps) = 108 frames, processing for advancing the playback position by 108 frames is performed in step S16.

  If “No” is selected in step S13, that is, if it is determined that the line of sight L1 has moved in the counterclockwise direction, the process proceeds to step S17, and the playback speed V at that time is multiplied by the variable Pdec. The value is assigned to the variable Vk. When Pdec is 0.8 and the reproduction speed V at that time is 1 × speed, the variable Vk is 0.8 (Pdec) × 1 (V) = 0.8 (times speed).

  Here, the process of reducing the reproduction speed is performed for the same reason as that for increasing the reproduction speed. In other words, the display device 2 positioned in the counterclockwise direction with respect to the display device 2 in which the line of sight L1 is positioned always displays a past image from the image displayed on the display device 2 in which the line of sight L1 is positioned. This is because it is. The situation in which the user U wants to see past videos is assumed to be when information is overlooked. In such a case, it is assumed that there is no room for user U's information acquisition. Therefore, the reproduction speed is reduced in order to prevent the user U from missing information.

  In step S18, a process of advancing the video playback position by Vk × Δt is performed. That is, Vk × Δt = 0.8 × 1 × 30 = 24 frames are added to the video playback position. Next, processing for returning the reproduction position by Vk × D is performed (step S19). Since Vk × D = 0.8 (double speed) × 3 (seconds) × 30 (fps) = 72 frames, in step S19, a process of returning the playback position by 72 frames is performed. Finally, a process of outputting the reproduction speed Vk and the reproduction position calculated by the processes so far to the encoding processing unit 20 and the reproduction speed conversion unit 60 is performed (step S20).

  The process of advancing the reproduction position by Δt seconds performed in steps S15 and S18 of FIG. 5 is a process of displaying the reproduction position assumed to have advanced during the time interval Δt at which the routine of FIG. This is a process for reflecting in the reproduction position. In step S16 or S19, the process of advancing or returning the playback position by Vk × D is performed on the screen that has been viewed before moving the line of sight to the screen on which the line of sight has moved. This is a process for displaying temporally continuous video.

  Next, a processing example of the playback speed conversion unit 60 will be described with reference to FIG. FIG. 6A shows a state in which frames input to the playback speed conversion unit 60 are arranged in time series from left to right. FIG. 6B shows a state output from the playback speed conversion unit 60. In the same manner, the frames are arranged in chronological order from the left. In FIG. 6, frame numbers f1 to fn (n is a natural number) are assigned to the respective frames.

  The number of frames input to the playback speed conversion unit 60 is obtained by playback speed Vk × block size B. The block size B is calculated by multiplying the time interval T in which the routine of the playback speed conversion unit 60 is performed by the frame rate fr of the video stored in the storage unit 30. For example, when the time interval T for executing the routine of the playback speed converting unit 60 is 1 second and the frame rate fr of the video stored in the storage unit 30 is 30 fps, the block size B is 1 ( T) × 30 (B) = 30 (frame). When the playback speed Vk is 3, the number of frames input to the playback speed conversion unit 60 is 30 × 3 = 90 (frames).

  The number of frames input to the playback speed conversion unit 60 is the number of frames extracted from the storage unit 30 by the encoding / decoding processing unit 20. The encoding / decoding processing unit 20 executes the routine of the reproduction speed Vk input from the reproduction speed / reproduction position determination unit 50, the frame rate fr of the video recorded in the storage unit 30, and the reproduction speed conversion unit 60. The number of frames to be extracted from the storage unit 30 is calculated based on the time interval T. Then, as many frames as the calculated number of frames are extracted from the storage unit 30 and output to the playback speed conversion unit 60.

  FIG. 6A shows an example in which 90 frames of video are input to the playback speed conversion unit 60. The playback speed conversion unit 60 converts the playback speed by thinning out the frames at a constant sampling interval so that the acquired frame is within the block size B. For example, when the block size B is 30, the acquired 90 frames are thinned out in units of 3 frames to perform processing of 30 frames. FIG. 6B shows a frame after being thinned to 30 frames, and the 30 frames that have been thinned are frame numbers f 1 and f 4 in the frame input from the encoding / decoding processing unit 20. , F7, f10... F88. In the example shown in FIG. 6, the reproduction speed is tripled by performing such processing. Since this method can be realized without using a complicated configuration, the size of hardware can be reduced by using this method.

  In the example shown in FIG. 6, the case where the playback speed is converted by thinning out the frames input from the encoding / decoding processing unit 20 at a constant sampling interval is shown. However, the frame rate itself is converted. Thus, the playback speed may be converted. For example, by converting the frame rate of 90 frames shown in FIG. 7A from 30 fps to 90 fps, as shown in FIG. 7B, 90 frames of video having a frame rate of 90 fps are output. It may be. By processing in this way, all of the input frames are output, so that the flicker in the output video is reduced and a high-quality video can be obtained.

  Alternatively, speed conversion may be performed by extracting only frames with a large amount of information from the frames input from the encoding / decoding processing unit 20 and using them as frames for reproduction. A processing example in this case is shown in the flowchart of FIG. It is assumed that the process shown in FIG. 8 is performed at intervals of 1 second (that is, T = 1). First, the encoding / decoding processing unit 20 acquires a frame corresponding to the reproduction speed Vk × block size B from the storage unit 30 (step S21), and then the frame number fx (x is a predetermined number between 1 and n). ), The difference between the pixel values of the pixel of interest and its neighboring pixels is calculated, and then the total number Si of pixels whose pixel value difference with the neighboring pixels is equal to or greater than the threshold Th is calculated (step S22). . That is, the total number Si of pixels described above is calculated in all frames input from the encoding / decoding processing unit 20.

  In step S21, for example, when the playback speed Vk is 1.5 and the block size is 30, 1.5 × 40 = 45 frames are acquired. Therefore, the frame numbers processed in step S22 are f1 to f45. As the threshold value Th used in step S22, for example, a numerical value such as 50 is set.

  The process in step S22 is performed for all the frames acquired in step S21. In step S23, it is determined whether or not the processing for all acquired frames has been completed. If it is determined that the processing has been completed for all the frames, then a frame having a large total number Si of pixels whose difference in pixel values from adjacent pixels is equal to or greater than the threshold Th is extracted by the block size, and the frame number The process of outputting in order is performed (step S24).

  FIG. 9 shows an example when such processing is performed. FIG. 9A shows a state in which 45 frames input to the playback speed conversion unit 60 are arranged from the left in order of increasing frame number. From these 45 frames, a frame having a large Si, which is the total number of pixels whose pixel value difference with the adjacent pixel is equal to or greater than the threshold Th, is extracted by the 30 frame size and arranged in the order of the frame number. This is shown in FIG. 9 (b). FIG. 9B shows that 30 frames output from the playback speed conversion unit 60 are composed of frame numbers f2, f3, f5, f7, f9, f10... F25.

  That is, according to the method shown in FIGS. 8 and 9, it is possible to increase the playback speed (1.5 times in the examples of FIGS. 8 and 9) by extracting only frames with a large amount of information. In addition, according to such processing, it is possible to leave a frame that is highly likely to contain a lot of text information such as telop among input frames. There will be no such thing. Thereby, the user U can acquire information efficiently.

  Next, a process performed between the time when the user U moves the line of sight L1 and the time when the playback speed and playback position of the video displayed on each display device 2 change will be described with a specific example. FIGS. 10A to 10D are diagrams showing the transition of the playback position of the video displayed on each display device 2. Also in FIG. 10, it is assumed that the frame rate of the video is 30 fps and Δt is 1 second. 10 shows an example in which the playback position of the video displayed on each display device 2 changes each time processing is performed in each unit for easy understanding. Only the video read from the calculated reproduction position is displayed on the screen.

  FIG. 10A is a diagram illustrating an initial state before the line of sight L1 of the user U changes. In FIG. 10A, similarly to the example shown in FIG. 1, the display devices 2A to 2C are arranged in a ring shape, and the line of sight L1 of the user U is on the display device 2A located at the center. It is shown. The numbers in parentheses in FIG. 10 indicate the frame numbers in the video. On the display device 2A where the line of sight L1 of the user U is located, an image of the 630th frame is displayed. In addition, an image of the 720th frame is displayed on the display device 2C adjacent in the clockwise direction from there, and the 540th frame is displayed on the display device 2B adjacent in the counterclockwise direction from the display device 2A. Is displayed.

  In this example, since it is assumed that the frame rate of the video is 30 fps, the video displayed on the display device 2C is (720−630) / 30 = 3 seconds ahead of the video displayed on the display device 2A. It will be out. Similarly, the video displayed on the display device 2B is (720−540) / 30 = 6 seconds behind the video displayed on the display device 2A.

  FIG. 10B shows an example in which the user's U line of sight L1 moves on the display device 2C in this state. When the position of the line of sight L1 changes, the change is detected by the delay amount determination unit 40, and the delay amount determination unit 40 determines the delay amount to be applied to the video output to each display device. Since the line of sight L1 of the user U is on the display device 2C, (ROUNDDOWN (N / 2)) is output to the delay unit 2B that outputs the video from the display device 2C to the display device 2B at the i-th position clockwise. -I) A delay amount of D = 0 (seconds) is set (step S3 in FIG. 5).

  In the example shown in FIG. 10, since the number of display devices 2 is 3, N = 3 and i is ROUNDDOWN (N / 2) = 1. Therefore, the display device 2 arranged first in the clockwise direction from the display device 2C where the line of sight L1 is located is the display device 2B. Then, zero is set as the delay amount in the delay unit 2B that outputs the video to the display device 2B.

  Then, delay amounts are sequentially assigned to the delay units 70C and 70A that output video to the display devices 2C and 2A positioned in the clockwise direction from the display device 2B. A delay amount of 3 seconds is assigned to the delay unit 70B that outputs the video to the display device at the 0th position in the clockwise direction from the display device 2B having the line of sight L1, that is, the display device 2B. Then, a delay of 6 seconds is provided to the delay unit 70A that outputs the video from the display device 2B having the line of sight L1 to the display device 2A in the first position in the clockwise direction, that is, in the first counterclockwise direction. An amount is assigned.

  Then, the latest frame (720 frames) in the state of FIG. 10A before the line of sight L1 moves is assigned to the display device 2B in which the delay amount is set to 0, and from 720 frames to 3 seconds × 30 frames = The video of the 630th frame delayed by 90 frames is assigned to the display device 2C. Furthermore, the video of the 540th frame delayed by 6 seconds × 30 frames = 180 frames from 720 frames is allocated to the display device 2A.

  FIG. 10C is a diagram showing a state after the reproduction position of the video displayed on each display device 2 is advanced by Vk × Δt in step S14 or step S17 of FIG. The reproduction speed Vk is calculated in step S13 or step S16 according to the moving direction of the line of sight L1 determined in step S12 of FIG. In the example shown in FIG. 10, since the user's U line of sight L1 changes clockwise, “Yes” is selected in step S12 of FIG. 5, and the process proceeds to step S13. In step S13, the variable Vk is set to a value obtained by Pinc × V. If the variable Pinc is 1.2 and the playback speed V at that time is 1 (double speed), the variable Vk is 1.2.

  Therefore, Vk × Δt is 1.2 (double speed) × 1 (second) × 30 (frame) = 36 frames, and 36 frames are added to the playback position of each video displayed on the display devices 2A to 2C. The In FIG. 10C, the video of the 720 + 36 = 756 frame is assigned to the display device 2B, the video of the 630 + 36 = 666 frame is assigned to the display device 2C, and the 540 + 36 = 576th frame is assigned to the display device 2A. It shows how the video is assigned.

  After the reproduction position has been advanced by Vk × Δt, the reproduction position is further advanced by Vk × D by the process of step S15 in FIG. Since Vk is 1.2 (double speed), D is 3 (seconds), and the frame rate is 30 (fps), Vk × D = 1.2 × 3 × 30 = 108 frames are further added to the playback position. The For this reason, as shown in FIG. 10 (d), an image of 756 + 108 = 858 frames is displayed on the display device 2B, an image of 666 + 108 = 774 frames is displayed on the display device 2C, and the image is displayed on the display device 2A. 576 + 108 = 678 frames of video are displayed.

  FIG. 11 shows changes in the playback position of the video displayed on each display device 2 before and after the line of sight L1 changes. The left half of FIG. 11 shows the display devices 2A to 2C in the initial state before the change of the line of sight L1 shown in FIG. 10A, and the right half of FIG. 11 shows the change of the line of sight L1. The subsequent display devices 2A to 2C are shown. The screen of the display device 2A viewed by the user U before the line of sight L1 is shifted is displayed on the screen of the 630th frame, and the screen of the display device 2C to which the line of sight L1 is shifted is 774 frames. It shows how the eye image is displayed.

  By moving the line of sight L1 clockwise, the reproduction speed is increased, and at the same time, the reproduction position is advanced by the routine call time Δt and the variable Vk × D. On the previous display device 2C, the video of the 774th frame is displayed instead of the video of the 720th frame that was originally displayed. In addition, by performing the above-described processing in the delay amount determination unit 40 and the playback speed / playback position determination unit 50, in the previous display device 2C facing the line of sight L1 or the display device 2A in which the line of sight L1 was present, The playback position of the video advances by V × Δt. In FIG. 11, in the display device 2 </ b> C that faces the line of sight L <b> 1, the frame advances from 720 to 774, and in the display device 2 </ b> A that has the line of sight L <b> 1, the frame advances from 630 to 678. ing.

  Thus, since the video displayed on the screen changes gently before and after the line of sight L1 changes, the user U can move the line of sight to another screen without feeling uncomfortable. It becomes like this. In this example, the case where Δt is 1 second has been described as an example. However, if the time is set to a short time such as 0.1 second, the amount of change in the reproduction position before and after the movement of the line of sight L1 can be suppressed to be small. it can.

  FIG. 12 shows the reproduction of the video displayed on each display device 2 when the line of sight L1 of the user U changes counterclockwise in the state shown in FIG. 10D (= right half of FIG. 11). The change of position is shown. In FIG. 12 (a), an image of the 774th frame is displayed on the display device 2C where the line of sight L1 of the user U is located, and 678 frames are displayed on the display device 2A adjacent in the clockwise direction therefrom. It shows how the eye image is displayed. In addition, it is shown that an image of the 858th frame is displayed on the display device 2B adjacent in the counterclockwise direction from the display device 2C.

  FIG. 10B shows an example in which the user's U line of sight L1 moves on the display device 2A in this state. A change in the position of the line of sight L1 is detected by the delay amount determination unit 40, and the delay amount determination unit 40 determines the delay amount to be applied to the video output to each display device. Since the line of sight L1 of the user U is on the display device 2A, (ROUNDDOWN () is output to the delay unit 2C that outputs video from the display device 2A to the display device 2C at the i (= 1) th position clockwise. N / 2) -i) A delay amount of D = 0 (seconds) is set (step S3 in FIG. 5).

  Then, delay amounts are sequentially assigned to the delay units 70A and 70B that output video to the display devices 2A and 2B positioned in the clockwise direction from the display device 2C. A delay amount of 3 seconds is assigned to the delay unit 70C that outputs video to the display device 2C in the clockwise direction from the display device 2C with the line of sight L1, that is, the display device 2C. Then, the delay unit 70B that outputs the video from the display device 2C having the line of sight L1 to the display device 2B in the first position in the clockwise direction, that is, in the first counterclockwise direction, has a delay of 6 seconds. An amount is assigned.

  Then, the latest frame (858 frames) in the state of FIG. 12A before the line of sight L1 moves is assigned to the display device 2C in which the delay amount is set to 0, and from 858 frames to 3 seconds × 30 frames = 90 The video of the 774th frame delayed by the frame is assigned to the display device 2A. Furthermore, a video of the 678th frame delayed from the 858 frame by 6 seconds × 30 frames = 180 frames is allocated to the display device 2B.

  FIG. 12C is a diagram showing a state after the reproduction position of the video displayed on each display device 2 is advanced by Vk × Δt in step S14 or step S17 of FIG. The reproduction speed Vk is calculated in step S13 or step S16 according to the moving direction of the line of sight L1 determined in step S12 of FIG. In the example shown in FIG. 12, since the line of sight L1 of the user U changes counterclockwise, “No” is selected in step S12 of FIG. 5, and the process proceeds to step S16. In step S16, the variable Vk is set to a value obtained by Pdec × V. The variable Pdec is assumed to be 0.8, and the playback speed V at that time is 1.2 (double speed), so the variable Vk is Pdec × V = 0.8 × 1.2 = 0.96. .

  Therefore, Vk × Δt is 0.96 (double speed) × 1 (second) × 30 (frame) ≈28 frames, and 28 frames are added to the playback position of each video displayed on the display devices 2A to 2C. The In FIG. 10C, the video of the 678 + 28 = 706th frame is assigned to the display device 2B, the video of the 858 + 28 = 886th frame is assigned to the display device 2C, and the 774 + 28 = 802th frame is assigned to the display device 2A. It shows how the video is assigned.

  After the reproduction position has been advanced by Vk × Δt, the reproduction position is further returned by Vk × D by the process of step S15 in FIG. Since Vk is 0.96 (double speed), D is 3 (seconds), and the frame rate is 30 (fps), Vk × D = 0.96 × 3 × 30≈86 frames are returned from the reproduction position. For this reason, as shown in FIG. 12D, the display device 2B displays an image of 706-86 = 620 frames, and the display device 2C displays an image of 886-86 = 800 frames. On the display device 2A, an image of 802-86 = 716 frames is displayed.

  According to the configuration and processing of the present embodiment described above, when the user's U line of sight L1 moves in the clockwise direction, the playback position of the video is advanced, and the user U's line of sight L1 is counterclockwise. When moving to, the video playback position is returned. For this reason, when the user U has missed information because the video playback speed is too fast for the information acquisition capability of the user U, the user U moves the line of sight L1 counterclockwise. By moving to, you can see the past video. In addition, when the user U wants to view a future video from the currently viewed video, the user U moves the line of sight L1 in the clockwise direction so that the video whose playback position has advanced from the currently viewed video. You can see it.

  In this way, even when the user U misses important information such as a telop displayed on the screen, the user U is arranged on the left side in the clockwise direction with respect to the display device 2 being viewed. The information can be confirmed again by moving the line of sight L1 to each display device 2.

  Further, every time the user U moves the line of sight L1, the positional relationship of the past-present-future is reassigned to the position of each display device 2 starting from the position of the line of sight L1 of the user U. Therefore, intuitive and easy-to-understand information can be presented to the user U.

  In addition, when the user's line of sight L1 moves counterclockwise, the video playback speed is reduced, and when the user U's line of sight L1 moves clockwise, the video playback speed is increased. Therefore, the amount of information according to the information acquisition capability of the user U is adaptively selected and provided.

  In other words, when the user U moves the line of sight L1 in the counterclockwise direction and tries to view a past video from the video that was being viewed at that time, it is assumed that information has been missed. it can. In such a case, by reducing the video playback speed, it is possible to give a little margin to the user U's information acquisition. Even when the information is still missing even at the playback speed of the video at the point where the line of sight L1 is moved, if the user U moves the line of sight further in the counterclockwise direction, the playback speed is increased. It will be even slower.

  In addition, when the user U moves the line of sight L1 in the clockwise direction and tries to view a future video from the video that was being viewed at that time, the playback speed of the video is the information acquisition of the user U. It is thought that it has not caught up with ability. In such a case, the amount of information presented can be increased by increasing the video playback speed. If the user U has very high information acquisition capability, the video can be viewed at a considerably high reproduction speed by moving the line of sight L1 in the clockwise direction.

  In this way, the amount of information presented is automatically changed according to the direction and amount of movement of the line of sight L1 of the user U. Therefore, the amount of information presented by the information presentation device is always the amount of the user U. It depends on the information acquisition ability.

  Also, if the user U continues to move his / her line of sight clockwise, the video displayed on each display device 2 will continue to move in the future direction and at the same time the playback speed will increase, and the user U will continue to move his / her line of sight counterclockwise. As a result, the video displayed on each display device 2 goes back to the past and the playback speed becomes slower. Therefore, the user U can adjust the reproduction speed without using a device such as a remote control device.

  In addition, the playback speed / playback position determination unit 50 adds or subtracts the number of frames obtained by multiplying the video playback position by the variable Vk and the delay amount D according to the direction in which the line of sight L1 changes. Thus, no matter how the line of sight L1 of the user U changes, the displayed video does not become discontinuous before and after the change of the line of sight L1.

  In the above-described embodiment, the configuration using three display devices 2 is taken as an example, but the information presentation device may be configured by other numbers such as four or five. FIG. 13 shows an example in which five display devices 2 are used. Similarly to FIG. 10, each stage from the initial state before the user's U line of sight L1 is changed to when the line of sight L1 is changed and the reproduction position of the video displayed on each screen is switched is shown in FIG. ) To (d). Also in FIG. 13, it is assumed that the frame rate of the video is 30 fps, the delay amount D is 3 seconds, and Δt is 1 second. Further, it is assumed that the reproduction speed V at the stage before the line of sight L1 is changed is 1 × speed.

  FIG. 13A is a diagram illustrating an initial state before the line of sight L1 of the user U changes. In FIG. 13A, the display devices 2A to 2E are arranged in a circular shape, and the display devices 2C, 2E, 2D, and 2B are sequentially arranged in the clockwise direction with the display device 2A as a vertex. And the mode that the user's U eyes | visual_axis L1 exists on the display apparatus 2A located in the vertex is shown. Also in FIG. 13, the frame number in the video is shown in parentheses.

  An image of the 540th frame is displayed on the display device 2A where the user's line of sight L1 is located, and an image of the 630th frame is displayed on the display device 2E in the clockwise direction from there. Shows that the image of the 720th frame is displayed, the image of the 360th frame is displayed on the display device 2D, and the image of the 450th frame is displayed on the display device 2B.

  That is, on the display device 2C positioned first in the clockwise direction from the display device 2A where the user's line of sight L1 is located, the image displayed on the display device 2A is (630-540) / An image advanced by 30 = 3 seconds is displayed, and (720−540) / 30 = on the display device 2E positioned second in the clockwise direction than the image displayed on the display device 2A. An image that is 6 seconds ahead is displayed. Further, from the display device 2B positioned first in the counterclockwise direction from the display device 2A where the line of sight L1 of the user U is located, from the video displayed on the display device 2A, (540-450) / An image delayed by 30 = 3 seconds is displayed, and (540-360) / 30 = 6 from the image displayed on the display device 2A on the display device 2D positioned second in the clockwise direction. A video delayed by 2 seconds is displayed.

  FIG. 13B shows an example in which the line of sight L1 of the user U moves on the display device 2E in this state. When the position of the line of sight L1 changes, the change is detected by the delay amount determination unit 40, and the delay amount determination unit 40 determines the delay amount to be applied to the video output to each display device. Since the line of sight L1 of the user U is on the display device 2E, a delay for outputting an image from the display device 2E to the display device 2B at the i (= ROUNDDOWN (5/2) = 2) position clockwise. A delay amount of (ROUNDDOWN (N / 2) −i) D = 0 (seconds) is set in the unit 2B (step S3 in FIG. 3).

  Then, the processes in steps S3 and S4 in FIG. 3 are continued until i <(ROUNDDOWN (−N / 2)), which is the conditional expression in step S5, is satisfied. A delay amount is assigned to each delay unit 70 to be output. As shown in FIG. 13B, a delay amount of 3 seconds is assigned to the delay unit 70 corresponding to the display device 2D that is adjacent to the display device 2B in the clockwise direction, and further in the clockwise direction from there. A delay amount of 6 seconds is assigned to the display device 2E, 9 seconds to the display device 2C, and 12 seconds to the display device 2A.

  Then, the latest frame (720 frames) in the state of FIG. 13A before the line of sight L1 moves is assigned to the display device 2B in which the delay amount is set to 0, and from 720 frames to 3 seconds × 30 frames = 90 The video of the 630th frame delayed by the frame is assigned to the display device 2D, and the video of the 540th frame delayed by 6 seconds × 30 frames = 180 frames from the 720th frame is assigned to the display device 2E. Then, the 450th frame image delayed from 720 frames by 9 seconds × 30 frames = 270 frames is displayed on the display device 2C, and the 360th frame image delayed from 720 frames by 12 seconds × 30 frames = 360 frames is displayed. Assigned to device 2A.

  FIG. 13C is a diagram showing a state in which the number of frames calculated by Vk × Δt is added to the reproduction position on each display device 2 shown in FIG. The reproduction speed Vk is calculated in step S13 or step S16 according to the moving direction of the line of sight L1 determined in step S12 of FIG. In the example shown in FIG. 13, since the user's U line of sight L1 changes clockwise, “Yes” is selected in step S12 of FIG. 5, and the process proceeds to step S13. In step S13, the variable Vk is set to a value obtained by Pinc × V. If the variable Pinc is 1.2 and the playback speed V at that time is 1 (double speed), the variable Vk is 1.2.

  Therefore, Vk × Δt is 1.2 (double speed) × 1 (second) × 30 (frame) = 36 frames, and 36 frames are added to the playback position of each video displayed on the display devices 2A to 2E. Become so. In FIG. 13C, the video of the 720 + 36 = 756th frame is assigned to the display device 2B, the video of the 630 + 36 = 666 frame is assigned to the display device 2D, and the 540 + 36 = 576th frame is assigned to the display device 2E. The image of 450 + 36 = 486 frames is assigned to the display device 2C, and the image of 360 + 36 = 396 frames is assigned to the display device 2A.

  After the playback position has been advanced by Vk × Δt, the playback position is further advanced by Vk × D × n (units). Here, n (unit) represents the distance traveled by the line of sight L1 in terms of the number of display devices 2. In FIG. 13B, the line of sight L1 of the user U has moved from the screen of the display device 2A to the second display device 2E in the clockwise direction as viewed from the display device 2A. 2

  Since Vk is 1.2 (double speed), D is 3 (seconds), and the frame rate is 30 (fps), Vk × D × n = 1.2 × 3 × 30 × 2 = 216 frames corresponds to the playback position. Is further added. For this reason, as shown in FIG. 13D, the video of the 756 + 216 = 972 frame is displayed on the display device 2B, the video of the 666 + 216 = 882 frame is displayed on the display device 2D, and is displayed on the display device 2E. 576 + 216 = 792 frame image is displayed, the 486 + 216 = 702 frame image is displayed on the display device 2C, and the 396 + 216 = 612 frame image is displayed on the display device 2A.

  By performing such processing, even when five display devices 2 are used, assuming that the video displayed on the display device 2 where the line of sight L1 is located is the current image, the image is positioned in the clockwise direction from there. The display device 2 that displays the image of the future than the image that is currently displayed as an image. In addition, the display device 2 positioned in the counterclockwise direction from the display device 2 on which the current image is displayed displays a past video from the video displayed as the current image.

  In addition, in each display device 2 located in the clockwise or counterclockwise direction starting from the display device 2 where the line of sight L1 is located, a delay amount corresponding to the distance from the display device 2 where the line of sight L1 is located is allocated. It is supposed to be. In the example shown in FIG. 13A, the display device 2A where the line of sight L1 is located and the display device 2C which is closest to the clockwise direction are compared with the image displayed on the display device 2A. An image that is advanced by 3 seconds is displayed, and an image that is advanced by 6 seconds from the image displayed on the display device 2A is displayed on the display device 2E that is second closest to the display device 2A in the clockwise direction. It is supposed to be displayed.

  For this reason, when the user U wants to see a video slightly ahead of the video currently being viewed, the user U only has to move the line of sight L1 clockwise by one screen, and watch the video a little further than that. If desired, the line of sight L1 may be moved by two screens in the clockwise direction. On the other hand, if you want to see a video that is a little earlier than the video you are currently viewing, you can move the line of sight L1 counterclockwise by one screen, and you want to see a video that is a little earlier than that. In this case, the line of sight L1 may be moved counterclockwise by two screens. In this way, since the position of the line of sight L1 is the starting point, the distance from there is associated with the amount of delay applied to the video, so the user U can intuitively select and view the video on the desired time axis. Can do.

  In the above-described embodiment, the delay amount determination unit 40 outputs from the display device 2 where the line of sight L1 of the user U is positioned to the display device 2 at a position that is substantially half a circle (a position of ROUNDDOWN (N / 2)). Although the delay amount of the video to be performed is set to zero, the delay amount of the video output to the display device 2 arranged at another position may be set to zero.

  FIG. 14A shows an example in which the delay amount of the video output to the display device 2D adjacent to the display device 2E in which the line of sight L1 of the user U is positioned in the clockwise direction is zero. It is. In FIG. 14B, the delay amount of the video output to the display device 2A positioned second in the counterclockwise direction with respect to the display device 2E where the user's U line of sight L1 is positioned is zero. An example of this is shown.

  In the example shown in FIG. 14A, the line of sight L1 of the user U is positioned on the display device 2E, and a video with a delay amount of zero is output from the display device 2D adjacent thereto in the clockwise direction. It is like that. A delay amount obtained by increasing the delay amount by 3 seconds in the counterclockwise direction starting from the display device 2D is allocated to each display device 2.

  When the playback position of the video without delay is 720 frames, the video of the 720th frame is output to the display device 2D, and the 630th frame is delayed by 3 seconds × 30 frames = 90 frames from the 720 frames. The video is assigned to the display device 2E, and the video of the 540th frame delayed by 6 seconds × 30 frames = 180 frames from 720 frames is assigned to the display device 2C. Then, the 450th frame image delayed by 9 seconds × 30 frames = 270 frames from 720 frames is displayed on the display device 2A, and the 360th frame image delayed by 12 seconds × 30 frames = 360 frames from 720 frames is displayed. It is output to the device 2B.

  In such a configuration, only the display device 2D positioned first in the clockwise direction with respect to the display device 2 where the line of sight L1 of the user U is positioned is the display device 2 where the line of sight L1 of the user U is positioned. Future images will be displayed rather than the displayed images. In the display devices 2C, 2A, and 2B positioned in the counterclockwise direction with respect to the display device 2E where the user's line of sight L1 is positioned, the display device 2 where the user U's line of sight L1 is positioned is displayed. A past video is displayed rather than a video.

  Specifically, an image delayed by 3 seconds from the image output to the display device 2E is displayed on the display device 2C positioned at the first position counterclockwise with respect to the display device 2E positioned at the line of sight L1. A video delayed by 6 seconds from the video output to the display device 2E is output to the display device 2A that is output and positioned at the second position counterclockwise, and is positioned at the third position counterclockwise. The display device 2B outputs an image delayed by 9 seconds from the image output to the display device 2E.

  By performing such processing, in each display device 2 arranged in a circle, more past images are displayed than future images than the image that the user U is viewing. Therefore, for example, even when the user U is a user who easily misses information, the chance of returning to the past video can be increased, so that the user U can more reliably prevent information from being missed.

  In the example shown in FIG. 14B, the line of sight L1 of the user U is located on the display device 2E, and the delay amount is zero on the display device 2A located second in the counterclockwise direction therefrom. Video is output. A delay amount obtained by increasing the delay amount by 3 seconds in the counterclockwise direction starting from the display device 2A is allocated to each display device 2.

  If the playback position of the video to which no delay is added is also 720 frames, the video of the 720th frame is output to the display device 2A, and the 630th frame is delayed by 3 seconds × 30 frames = 90 frames from the 720 frames. Is assigned to the display device 2B, and the 540th frame image obtained by delaying 6 seconds × 30 frames = 180 frames from 720 frames is assigned to the display device 2D. Then, the 450th frame image delayed by 9 seconds × 30 frames = 270 frames from 720 frames is displayed on the display device 2E, and the 360th frame image delayed by 12 seconds × 30 frames = 360 frames from 720 frames is displayed. It is output to the device 2C.

  In such a configuration, the display device 2 in which the line of sight L1 of the user U is located only on the display device 2C that is positioned first counterclockwise with respect to the display device 2 in which the line of sight L1 of the user U is located. The past video is displayed from the video displayed in. In the display devices 2D, 2B, and 2A positioned in the clockwise direction with respect to the display device 2E where the user's line of sight L1 is positioned, the video displayed on the display device 2 where the user U's line of sight L1 is positioned More future images will be displayed.

  Specifically, an image delayed by 3 seconds from the image output to the display device 2E is output to the display device 2D positioned first in the clockwise direction with respect to the display device 2E positioned at the line of sight L1. Then, the display device 2B positioned at the second position in the clockwise direction outputs an image delayed by 6 seconds from the image output to the display device 2E, and the display device 2A positioned at the third position in the clockwise direction. In this case, an image delayed by 9 seconds from the image output to the display device 2E is output.

  By performing such processing, each display device 2 arranged in a circle displays more future images than past images with respect to images viewed by the user U. Therefore, it is possible to meet the needs of users and the like who maximize the information understanding efficiency by making the reproduction speed very fast.

  In the above-described embodiment, the display device 2 where the user's line of sight L1 is located is the starting point, and each display device 2 located in the clockwise direction from there is a display device where the line of sight L1 of the user U is located. The future image is displayed from the image currently displayed at 2, and each display device 2 positioned in the counterclockwise direction has a past image than the image currently displayed on the display device 2 at which the line of sight L1 of the user U is positioned. However, past information may be displayed on each display device located in the clockwise direction, and future images may be displayed on each display device located in the counterclockwise direction. .

  In the above-described embodiment, when the line of sight L1 of the user U stays on a specific screen for a certain period of time, the video playback speed is not changed. A configuration may be adopted in which it is assumed that there is still room for information acquisition and the reproduction speed is increased.

  In the above-described embodiment, the configuration using a plurality of display devices 2 has been described as an example. However, the screen of one display device 2 is divided into a plurality of regions, and each divided region is divided. An image may be output.

It is explanatory drawing which shows the structural example of the system by one embodiment of this invention. It is a block diagram which shows the example of an internal structure of the system by one embodiment of this invention. It is explanatory drawing which shows the example of the relationship between the gaze position by one embodiment of this invention, and the delay amount allocated to each screen. It is explanatory drawing which shows the example of the relationship between the gaze position by one embodiment of this invention, and the delay amount allocated to each screen. It is a flowchart which shows the process example of the reproduction speed / reproduction | regeneration position determination part by one embodiment of this invention. It is explanatory drawing which shows the process example of the reproduction speed conversion part by one embodiment of this invention, (a) shows an input frame, (b) shows an output frame. It is explanatory drawing which shows another example of a process of the reproduction speed conversion part by one embodiment of this invention, (a) shows an input frame, (b) shows an output frame. It is a flowchart which shows the example of a process in the case of leaving the frame with much information by one embodiment of this invention. It is explanatory drawing which shows another example of a process of the reproduction speed conversion part by one embodiment of this invention, (a) shows an input frame, (b) shows an output frame. It is explanatory drawing which shows the example of the transition of the reproduction | regeneration position of the image | video by one embodiment of this invention. It is explanatory drawing which shows the example of the change of the reproduction | regeneration position before and behind the eyes | visual_axis moving by one embodiment of this invention. It is explanatory drawing which shows the example of the transition of the reproduction | regeneration position of the image | video by one embodiment of this invention. It is explanatory drawing which shows the example of the transition of the reproduction | regeneration position of the image | video by other embodiment of this invention. It is explanatory drawing which shows the example of the relationship between the gaze position by other embodiment of this invention, and the delay amount allocated to each screen.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 1 ... Reproduction | regeneration apparatus, 2A-2E ... Display apparatus, 3 ... Eye-gaze detection apparatus, 10 ... Image | video input part, 20 ... Encoding / decoding process part, 30 ... Accumulation part, 40 ... Delay amount determination part, 50 ... Reproduction speed Playback position determination unit, 60 ... playback speed conversion unit, 70A to 70C ... delay unit

Claims (17)

A delay output to a display unit other than the first display unit among N (natural number) display units arranged in a ring shape by adding a predetermined amount of delay to the video whose playback speed is set to a predetermined speed. And
A playback speed converter that converts the playback speed of the input video based on the given variable and outputs the converted video to the first display unit and the delay unit;
The playback speed is determined according to the arrangement position of the display unit at the line-of-sight position detected by the line-of-sight detection unit that detects the position of the user's line of sight, and a variable according to the determined playback speed is set as the playback speed. An information presentation apparatus comprising: a reproduction speed determination unit that outputs to a conversion unit. The information presentation device according to claim 1,
When the first display unit among the N display units is the first display unit, the amount of delay from the display unit adjacent to the first display unit toward the Nth display unit An information presentation apparatus comprising: a delay amount determination unit that sets a delay amount in the delay unit so that the delay time increases. The information presentation device according to claim 2,
When the position of the user's line of sight moves from the display unit where the current line of sight is located to another display unit, the first display is performed based on the position of the display unit where the position of the line of sight has moved. An information presentation device, wherein a display section allocated to a section is changed. In the information presentation device according to claim 3,
The display unit on which the user's line of sight is located is any display unit other than the first display unit between the first display unit and the Nth display unit. Information presentation device. The information presentation device according to claim 4,
The information presentation device, wherein the display unit on which the user's line of sight is located is a display unit that is substantially in the middle between the first display unit and the Nth display unit. The information presentation device according to claim 2,
The playback speed determination unit changes the playback speed of the video according to the moving direction when the position of the user's line of sight moves from the display unit having the current line of sight position to another display unit. Information presentation device. The information presentation device according to claim 6,
The playback speed determination unit outputs a variable for increasing the playback speed of the video to the playback speed conversion unit when the user's line of sight moves in a first direction from the display unit where the current line of sight is located. When the user's line of sight moves in a direction opposite to the first direction, a variable for reducing the playback speed of the video is output to the playback speed conversion unit. . The information presentation device according to claim 2,
The playback speed determination unit changes the playback position of the video according to the moving direction when the user's line-of-sight position moves from a display unit having a current line-of-sight position to another display unit. Information presentation device. The information presentation device according to claim 8,
When the user's line of sight moves in the first direction, the playback speed determination unit determines the amount of the video by the amount calculated based on the playback speed and the delay amount determined by the delay amount determination unit. When the reproduction position is advanced and the user's line of sight moves in a direction opposite to the first direction, only the amount calculated based on the delay amount determined by the delay amount determination unit and the reproduction speed is used. An information presentation device that performs a process of returning the playback position of the video. The information presentation device according to claim 1,
The playback speed determination unit advances the playback position of the video by an amount obtained by integrating the time and playback speed elapsed from the previous processing to the current processing. Presentation device. 3. The information presentation apparatus according to claim 2, wherein when the reproduction speed determination unit determines that the line-of-sight position detected by the line-of-sight detection unit remains on a screen of a predetermined display unit, the reproduction speed determination unit performs the reproduction. An information presentation device characterized by not changing the speed. 3. The information presentation apparatus according to claim 2, wherein when the reproduction speed determination unit determines that the line-of-sight position detected by the line-of-sight detection unit remains on a screen of a predetermined display unit, the reproduction speed determination unit performs the reproduction. A variable for increasing the speed is output to the reproduction speed conversion unit. The information presentation device according to claim 1,
The information presentation device, wherein the reproduction speed conversion unit converts the reproduction speed of the video by thinning out frames constituting the input video at predetermined intervals. The information presentation device according to claim 1,
The information presentation device, wherein the playback speed conversion unit converts the playback speed of the video by changing a frame rate of the input video. The information presentation device according to claim 1,
The playback speed conversion unit calculates the total number of pixels in each frame of the input video that have a pixel value difference equal to or greater than a predetermined value, and the predetermined number of frames in descending order of the calculated total number. An information presentation device that converts the reproduction speed of the video by outputting. The information presentation device according to claim 1,
The information display device, wherein the display unit is each divided area when a screen is divided into a plurality of areas. A procedure in which a predetermined amount of delay is added to a video whose playback speed is set to a predetermined speed, and the video is output to a display unit other than the first display unit among the plurality of display units arranged in a ring shape;
Converting the playback speed of the input video based on the given variable and outputting to the first display unit;
The playback speed is determined according to the arrangement position of the display unit at the line-of-sight position detected by the line-of-sight detection unit that detects the position of the user's line of sight, and a variable according to the determined playback speed is set as the playback speed. An information presentation method comprising: a procedure for outputting to a conversion unit.

Images