JP2004040502A - Information reproducing apparatus, information reproducing method and information reproducing system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To form a thumbnail image in a player based on image data from a server unit and display the thumbnail image. <P>SOLUTION: In a thumbnail forming module 31 of a player 2, a thumbnail maker 35 receives thumbnail video data Dsn fed from a server, and reproduction process is carried out. On the basis of content information Re, thumbnail data, which are divided from thumbnail video data Dsn into two or more scene ranges, is generated sequentially for each scene and stored sequentially by a thumbnail file 38. Then, the thumbnail data of all scenes are displayed by the thumbnail user interface 36. When a desired thumbnail data is appointed, image data, reproduced by a normal reproducing module 21, are displayed on a normal data user interface 26 so that the image data corresponds to the appointed scene range of the thumbnail data. <P>COPYRIGHT: (C)2004,JPO

Description

[0001]
TECHNICAL FIELD OF THE INVENTION
The present invention relates to an information reproducing apparatus, an information reproducing method, and an information reproducing system for reproducing image data supplied from a server device via a network, for example.
[0002]
[Prior art]
Conventionally, in a player capable of so-called streaming reproduction in which compressed image data supplied from a server device via a network is expanded and reproduced in real time, FIG. 12 shows a change in the reproduction position of the conventional player. By clicking the playback icon 125 with a mouse pointer (not shown), the playback data 122 before playback position change shown in FIG. 12A played back and displayed on the user interface 121 is displayed on the horizontal bar representing the current playback position. By clicking the icon 123 with a mouse pointer (not shown) and horizontally dragging the icon 123 to a change position 124 indicated by an arrow, the reproduction data 128 after the change of the reproduction position shown in FIG. 12B is reproduced and displayed on the user interface 121. Was like that.
When the reproduction of the image data is stopped, the stop icon 126 is clicked with a mouse pointer (not shown).
[0003]
Further, as shown in FIG. 13 showing a change in the playback position of the conventional player, when the recording icon 136 is clicked with a mouse pointer (not shown) to download and record the image data from the server device, The accumulated amount is displayed as a hatched area in the movable range 133 of the horizontal bar icon 137. When the reproduction data 132 is reproduced on the user interface 131 by clicking the reproduction icon 135 with a mouse pointer (not shown), the horizontal bar icon 137 is displayed. By clicking 137 with a mouse pointer (not shown) and dragging in the horizontal direction within the movable range 133, the reproduction position of the image data stored only in the movable range 133 is changed.
When the reproduction of the image data is stopped, the stop icon 135 is clicked with a mouse pointer (not shown).
[0004]
Also, on the server device, thumbnail information indicating thumb-sized image information is created at the same time as content creation, and the player extracts the information of the thumbnail image from the server device over the network. Could be displayed. That is, a thumbnail image is created in the server in advance, and the player retrieves the thumbnail image.
[0005]
[Problems to be solved by the invention]
However, in the above-described conventional player, when changing the playback position, the user changes the next playback position by moving the horizontal bar icon, and in this case, the user is provided with the moving image content supplied from the server. Since no information is displayed on the player, there is an inconvenience that the playback position cannot be changed to a desired scene unless the content of the moving image content is grasped to some extent in advance.
[0006]
Further, in the above-described conventional player, the server device has to create and store the information of the thumbnail image, and special processing and configuration for the information are required, so that the processing and configuration of the server device are complicated. There was an inconvenience.
[0007]
In addition, the player recognizes that the information of the thumbnail image is stored in the server device, and further requires a special process and configuration for extracting the information of the thumbnail image from the stored location. In addition, there is a disadvantage that the configuration is complicated.
[0008]
For this reason, existing server devices, such as a real-time server, a quick server, and a streaming server, do not create thumbnail images in normal processing. Therefore, since the player cannot take out the thumbnail image, there is a disadvantage that the player cannot display the thumbnail image.
[0009]
Therefore, the present invention has been made in view of the above points, and an information reproducing apparatus, an information reproducing method, and an information reproducing system that create a thumbnail image in a player based on image data from an existing server device and display the thumbnail image. The task is to provide
[0010]
[Means for Solving the Problems]
The information reproducing apparatus of the present invention performs processing for receiving and reproducing the image data for divided scene data supplied from the server device via the divided scene data transmission protocol, and performs processing for dividing the divided scene data based on content information regarding the image data. Scene data generating means for sequentially generating data of a predetermined range of each divided scene when each of the divided image data is divided into a plurality of scene ranges, and each of the plurality of scenes sequentially generated by the divided scene data generating means. Divided scene data storage means for sequentially storing divided scene data for each range of scenes, divided scene data display means for displaying divided scene data of all scenes stored by the divided scene data storage means, and divided scene data display means When the range of the scene of the arbitrary divided scene data is specified among the displayed divided scene data of all the scenes, the specified So as to correspond to the range of scene scene data, and a control means for controlling to display the image data reproduction process by a conventional data reproducing unit in the normal data display unit.
[0011]
In addition, the information reproducing method of the present invention performs a process of receiving and reproducing image data for divided scene data supplied from a server device via a divided scene data transmission protocol, and performing division based on content information related to image data. When the image data for scene data is divided into a plurality of scene ranges, a divided scene data generating step of sequentially generating data of a predetermined range of each divided scene for each scene range and a divided scene data generating step are sequentially generated. A divided scene data storing step for sequentially storing divided scene data for each range of each scene, a divided scene data displaying step for displaying divided scene data of all scenes stored by the divided scene data storing step, and a divided scene data display The scene range of any of the divided scene data among the divided scene data of all the scenes displayed by the step Control step of controlling the reproduction processing of the normal image data so as to correspond to the range of the scene of the specified divided scene data, and controlling the display processing of the normal image data. is there.
[0012]
Further, the information reproducing system of the present invention performs a process of receiving and reproducing image data for divided scene data supplied from a server device via a divided scene data transmission protocol, and dividing the image data based on content information related to the image data. Divided scene data generating means for sequentially generating data of a predetermined range of each divided scene when the image data for scene data is divided into a plurality of scene ranges for each scene range, and sequentially generated by the divided scene data generating means Divided scene data storage means for sequentially storing divided scene data for each range of each scene, divided scene data display means for displaying divided scene data of all scenes stored by the divided scene data storage means, and divided scene data display When a range of a scene of an arbitrary divided scene data is designated from among the divided scene data of all the scenes displayed by the Control means for controlling the image data reproduced by the normal data reproducing means to be displayed on the normal data display means so as to correspond to the range of the scene of the divided scene data thus generated. The image data supplied from the server device is reproduced and displayed based on the divided scene data thus obtained.
[0013]
Therefore, according to the present invention, the following operations are performed.
In an information reproducing apparatus capable of so-called streaming reproduction, in which compressed image data supplied from a server device over a network is expanded and reproduced in real time, divided scene data is added without adding a function to an existing server device. Create The user selects a scene from the divided scene data and changes the reproduction position.
[0014]
Creation of the divided scene data in the information reproducing apparatus requests the divided scene data image data from the server device for each scene, and every time one still image of the scene is created, the divided scene data image of the next scene is created. The data is sequentially created by requesting data from the server device. When a still image of a scene is selected from the divided scene data, the information reproducing apparatus requests the server apparatus for image data of the scene, and the information reproducing apparatus starts reproduction from the scene.
[0015]
BEST MODE FOR CARRYING OUT THE INVENTION
Hereinafter, an embodiment of the present invention will be described.
Hereinafter, a player that creates a thumbnail image using the proposed method will be specifically described. Here, a protocol for streaming moving image content from the server device to the player via the network and controlling the moving image content by the player is not particularly defined. However, in the following description, RTP (Real-time Transport Protocol RFC1890) / UDP ( The case where User Datagram Protocol (RTSP) and Real Time Streaming Protocol RFC2326 (RTSP) are used will be described.
[0016]
FIG. 1 is a diagram showing streaming in a player who creates thumbnails. Here, streaming means that the player plays back streaming data supplied from the server.
[0017]
In FIG. 1, by requesting normal data 5 from the player 2 to the server 1, the normal data 5 is supplied from the server 1 to the player 2 at a normal data communication speed 6 via a network normal data communication protocol. In 2, by clicking the reproduction icon 10 with a mouse pointer (not shown), an image based on the normal data 5 is displayed on the user interface 3 for normal data.
[0018]
In order to stop the reproduction of the image data, the stop icon 11 is clicked with a mouse pointer (not shown), and when recording the image data, the recording icon 12 is clicked with a mouse pointer (not shown).
[0019]
Here, when the player 2 requests the server 1 for the normal data 5, the player 2 also requests the server 1 for the video data 7 for thumbnails.
[0020]
As a result, the server 2 supplies the thumbnail video data 7 to the player 2 at the thumbnail communication speed 8 via the network for thumbnail data communication. The thumbnail communication speed 8 is set at a higher speed than the normal data communication speed 6, so that the server 1 transmits the thumbnail video data 7 to the player 2 before the normal data 5. As a result, thumbnail data Sn1, Sn2, Sn3, Sn4, and Sn5 are generated in the player 2 based on the video data for thumbnail 7, and the thumbnail data Sn1, Sn2, and Sn3, Sn4, and Sn5 are displayed.
[0021]
Here, when the playback position is changed, the horizontal bar icon 14 is clicked and dragged in the horizontal direction with a mouse pointer (not shown). To the position corresponding to the time at which the selected image is reproduced. As divided data of a scene corresponding to the position of the moved horizontal bar icon 14, thumbnail data Sn1, Sn2, Sn3, Sn4, and Sn5 are displayed on the thumbnail user interface 4 as indicated by 9. By double-clicking any one of the thumbnail data Sn1, Sn2, Sn3, Sn4, and Sn5 with a mouse pointer (not shown), the normal data user interface 3 is shifted from the reproduction position corresponding to the thumbnail data Sn1, Sn2, Sn3, Sn4, and Sn5. An image based on the normal data 5 is displayed above.
[0022]
FIG. 2 is a diagram showing the reproduction time of the normal data and the creation time of the thumbnail data. Here, the reproduction time of the normal data and the creation time of the thumbnail data are schematically shown.
The normal data 5 shown in FIG. 2A includes V1 at time T1, V2 at time T2, V3 at time T3, V4 at time T4, V5 at time T5, V6 at time T6, V7 at time T7, and V8 and T9 at time T8. Like V9 at the time point, V10 at the time point T10, V11 at the time point T11, V12 at the time point T12, V13 at the time point T13, V14 at the time point T14, and V15 at the time point T15, the player 2 continues during the period from the time point T1 to the time point T15. To be played.
[0023]
At this time, the thumbnail scene data shown in FIG. 2B is based on the content information described later, Sn1 at the time T1, Sn2 at the time T4, Sn3 at the time T7, Sn4 at the time T10, and Sn5 at the time T13. Only the leading five-scene divided data obtained by dividing the period at T15 into five scenes is requested from the player 2 to the server 1 as the thumbnail video data 7.
[0024]
As a result, the thumbnail data shown in FIG. 2C is transmitted from the server 1 to the player 2 as shown by Sn1 at the time T1, Sn2 at the time T1-2, Sn3 at the time T2, Sn4 at the time T2-1, and Sn5 at the time T3. Is transmitted as application data 5.
[0025]
Accordingly, in the period from the time point T1 to the time point T15 of the normal data 5 shown in FIG. 2A, V1 at the time point T1, V2 at the time point T2, and V3 at the time point T3 are reproduced by the player 2. It can be seen that Sn1 at time T1, Sn2 at time T1-2, Sn3 at time T2, Sn4 at time T2-1 and Sn5 at time T3 of the thumbnail data shown in FIG. 2C are created.
[0026]
FIG. 3 is a diagram illustrating an example of a thumbnail displaying a scene.
When the horizontal bar icon 14 is clicked and dragged in the horizontal direction with a mouse pointer (not shown), and the moving range of the horizontal bar icon 14 is set to the entire playback time, the time at which the image selected for the entire playback time is played is Move to the corresponding position. The following thumbnail data 9 is displayed as divided data of a scene corresponding to the position of the moved horizontal bar icon 14.
[0027]
In FIG. 3, thumbnail data Sn1 of the first scene at the time “0:01:12”, thumbnail data Sn2 of the second scene at the time “0:03:10”, and “0:10” are displayed on the user interface 4 for thumbnails. : 05 ", thumbnail data Sn3 of the third scene at time" 0:14:40 ", thumbnail data Sn4 of the fifth scene at time" 0:16:20 ", and thumbnail data Sn5 of the fifth scene at time" 0:16:20 ". The thumbnail data 9 is displayed.
[0028]
The user double-clicks the position of the thumbnail data Sn1 of the first scene displayed on the user interface 4 for thumbnails as indicated by 9 with a mouse pointer (not shown) to determine “0” corresponding to the thumbnail data Sn1. : 01: 12 ”, an image based on the normal data 5 is reproduced and displayed on the normal data user interface 3 from the reproduction position of the first scene at the time point.
[0029]
Further, the user double-clicks the position of the thumbnail data Sn2 of the second scene displayed on the user interface 4 for thumbnails as indicated by 9 with a mouse pointer (not shown) to determine the position of the thumbnail data Sn2. An image based on the normal data 5 is reproduced and displayed on the normal data user interface 3 from the reproduction position of the second scene at “0:03:10”.
[0030]
Further, the user double-clicks the position of the thumbnail data Sn3 of the third scene displayed on the user interface 4 for thumbnails as indicated by 9 with a mouse pointer (not shown) to determine the position of the thumbnail data Sn3. The image based on the normal data 5 is reproduced and displayed on the normal data user interface 3 from the reproduction position of the third scene at “0:10:05”.
[0031]
Further, the user double-clicks the position of the thumbnail data Sn4 of the fourth scene displayed on the user interface 4 for thumbnails as indicated by 9 with a mouse pointer (not shown) to determine the position of the thumbnail data Sn4. An image based on the normal data 5 is reproduced and displayed on the normal data user interface 3 from the reproduction position of the fourth scene at “0:14:40”.
[0032]
Also, the user double-clicks the position of the thumbnail data Sn5 of the fifth scene displayed on the user interface 4 for thumbnails as indicated by 9 with a mouse pointer (not shown) to determine the position of the thumbnail data Sn5. From the reproduction position of the fifth scene at “0:16:20”, an image based on the normal data 5 is reproduced and displayed on the normal data user interface 3.
[0033]
FIG. 4 is a block diagram showing a configuration inside the player. Here, although not shown, a controller as control means for controlling the inside of the player is provided inside the player.
In order to create a thumbnail of each scene, the player 2 requests moving image content for thumbnail creation in addition to requesting moving image content for normal reproduction. The inside of the player 2 is roughly divided into a normal reproduction module 21 and a thumbnail creation module 31. Each module is configured as follows.
[0034]
First, the normal reproduction module 21 will be described. The packet receiver 22 receives the packet of the normal video data DV and the packet of the normal audio data DA transmitted from the server 1 by the RTP / UDP protocol, and checks the source ID to check the source ID. Is confirmed whether or not the packet is transmitted from the correct server 1.
[0035]
The depacketizer 23 removes the header portion of the packet of the normal video data DV and the packet of the normal audio data DA, and at the same time, extracts information such as a packet number and a time stamp included in the header portion.
[0036]
The decoder 24 decompresses the compressed and transmitted normal video data DV and normal audio data DA. At this time, in the case of the normal video data DV, data in units of one frame are sequentially created, and in the case of the normal audio data DA, data in units of audio units are sequentially created.
[0037]
The renderer 25 sequentially performs display processing on the decoded normal video data DV supplied from the decoder 24 and displays the same on the user interface 26. In the case of the normal audio data DA, the renderer 25 outputs the data to an audio device such as a speaker. .
[0038]
Next, the thumbnail creation module 31 will be described. The packet receiver 32 receives the packet of the video data for thumbnail Dsn transmitted from the server 1 by the RTP / UDP protocol, and checks the source ID so that the packet of the video data for thumbnail Dsn is transmitted from the correct server 1. Check if there is.
[0039]
The depacketizer 33 removes the header portion of the packet of the thumbnail video data Dsn, and at the same time, extracts information such as a packet number and a time stamp included in the header portion.
[0040]
The decoder 34 decompresses the compressed and transmitted thumbnail video data Dsn. At this time, the decoder 34 creates still image data in frame units in order from the thumbnail video data Dsn. Here, the decoder 34 decodes compressed data compliant with, for example, the Moving Picture Experts Group (MPEG) 4. At this time, the decoder 34 decodes the I picture, P picture, and B picture of a GOP (Group Of Picture). Only still image data of a picture may be extracted.
[0041]
In order to control the creation of a thumbnail image of a divided scene, first, when a divided scene is designated from the thumbnail user interface 36, the thumbnail maker 37 sends an RTSP protocol to the server 1 in order to request data of the divided scene. The content information request command Co is used to transmit the content information Re from the server 1 using the SDP protocol, and thumbnail data is created based on the received content information Re. The thumbnail maker 37 stores the created thumbnail data in the thumbnail file 38.
[0042]
The renderer 35 sequentially performs display processing on the thumbnail data read from the thumbnail file 38 and displays the thumbnail data on the user interface 26.
[0043]
FIG. 5 is a block diagram showing the configuration of the thumbnail maker. FIG. 5 shows the functions of the thumbnail maker.
In FIG. 5, a thumbnail maker 37 includes a content information requesting unit 43 that transmits a request command for content information related to image data to the server 1, a content information receiving unit 44 that receives content information related to image data from the server 1, A position information determining unit 45 that determines whether or not the content information Re received by the receiving unit 44 includes the scene position information I8 of the image data; and overall position information extracted from the content information Re by the position information determining unit 45. A total scene number determination unit 46 that determines a total scene number I5 indicating a range to be divided of all scenes from I4, and scene position information indicating a range to be divided based on the total scene number I5 determined by the whole scene number determination unit 46 And a scene position information creating unit 46 for creating I6.
[0044]
The thumbnail maker 37 outputs a thumbnail creation scene information I7 based on the total number of scenes I5 extracted by the total scene number determination unit 46, and a scene range data request to the content information requesting unit 43. A thumbnail 1 frame creating unit 49 for creating one frame thumbnail data Sn based on scene position information I6 or I8 from the thumbnail video data Dsn supplied from the decoder 34, and a thumbnail 1 frame creating unit. And a thumbnail storage unit 50 for storing the one-frame thumbnail data Sn created by 49 in the thumbnail file 38.
[0045]
The thumbnail maker 37 includes a thumbnail communication speed setting unit 41 for setting the thumbnail communication speed I1 according to the thumbnail transmission protocol, and thumbnail data based on the thumbnail communication speed I1 set by the thumbnail communication speed setting unit 41. And a thumbnail resolution variable unit 42 for supplying resolution information I2 to the content information requesting unit 43 by changing the resolution of the thumbnail image. Here, in the case of a low resolution, for example, H.264 used for a video conference system or a video phone system is used. 261, H .; 263 may be variably set to a multi-step resolution based on a standard such as H.263.
[0046]
The operation of the player thus configured will be described below.
First, the operation of the normal reproduction module 21 will be described.
The packet receiver 22 receives a packet of the normal video data DV and a packet of the normal audio data DA transmitted from the server 1 by the RTP / UDP protocol.
[0047]
Next, the depacketizer 23 removes the header part of the packet of the normal video data DV and the packet of the normal audio data DA, and extracts the actual moving image content data. The decoder 24 decompresses the data of the compressed and transmitted moving image content and decodes the data into data of one frame unit. The renderer 25 performs a display process on the decoded normal video data DV supplied from the decoder 24 in order and displays it on the user interface 26. In the case of the normal audio data DA, the renderer 25 outputs the data to an audio device such as a speaker. .
[0048]
Next, the operation of the thumbnail creation module 31 will be described.
FIG. 6 is a flowchart showing a procedure for creating a thumbnail.
In FIG. 6, in step S1, the server requests content information. Specifically, when the content to be streamed and reproduced is determined by the user's selection on the user interface, in the thumbnail maker 37, the thumbnail 1 frame creation unit 49 supplies the scene range data request information I3 to the content information request unit 43. I do. The content information requesting unit 43 transmits a description (DESCRIBE) method to the server 1 using the RTSP protocol as a request command Co for content information regarding image data. The content information receiving unit 44 receives from the server 1 the content information Re regarding the image data transmitted using the SDP (Session Description Protocol RFC2327) protocol. The content information Re is sent as a response (Response) to the content information request command Co. The content information Re is used as control information in the thumbnail maker 37.
[0049]
FIG. 7 is a diagram illustrating an example of the SDP information. The SDP information is the content information Re sent from the server 1 to the player 2 as a response (Response) of the content information request command Co.
[0050]
In FIG. 7, the SDP information includes a session description (Session description) 71, a time description (Time description) 72, and a media description (Media description) 73.
[0051]
The session description (Session description) 71 includes the following elements. For example, v = protocol version, o = owner / creator and session identifier, s = session name, i = session information, u = session information, u = session information, u = session information, u = The URL is composed of a URL description, e = email address, c = connection information, and the like.
[0052]
In addition, the time description (Time description) 72 includes t = session active time, a = session attribute line (zero or more session attributes), and the like.
[0053]
The media description 73 includes m = media name and transport address, a = session attribute line (zero or more attribute lines), and the like.
[0054]
In step S2, it is determined whether or not the position information of the scene is included in the content information. If the position information is not included, the process proceeds to step S3, and if the position information is included, the process proceeds to step S5. Specifically, in the thumbnail maker 37, the position information determination unit 45 determines whether the content information Re received by the content information reception unit 44 includes the position information I8 of the scene of the image data.
[0055]
FIG. 8 and FIG. 9 are diagrams illustrating examples of the position information included in the SDP information.
For example, as shown in FIG. 8, the scene position information I8 can indicate a temporal position of a scene using an SDP extension header. In FIG. 8, as shown at 81, the description of “a =” is extendable, and the application described after “a =” can be specified by the application. The scene position information 82 can designate the start time-end time of the event.
As shown in FIG. 9, the scene position information 91 can specify only the start time of the event.
[0056]
In step S3, the total number of scenes is determined. Specifically, in the thumbnail maker 37, the total scene number determination unit 46 determines the total scene number I5 indicating the range to be divided of all scenes from the entire position information I4 determined and extracted by the position information determination unit 45. Since the content information includes the entire position information I4 indicating the entire reproduction time of the content in advance, the total number of scenes is determined based on the information. The number of scenes may be calculated from the total playback time by setting the number of scenes per time by the user. For example, if 1 scene / 5 minutes is set and the total playback time is 90 minutes, the total number of scenes is 18 scenes. If the entire reproduction time is not included in the content information, the number of scenes cannot be determined, and thus a thumbnail image cannot be created.
[0057]
In step S4, position information of a scene is created. Specifically, in the thumbnail maker 37, the scene position information creating unit 47 creates scene position information I6 indicating a range to be divided from the total scene number I5 created by the overall scene number determining unit 46. The position information is represented by a range of a scene, and is represented by a start position and an end position. Here, the start position is determined from the total number of scenes, and the start position of the next scene is set as the end time. For example, if the total playback time is 90 minutes and the number of scenes is 18, the range of one scene is 5 minutes, scene 1 is 0 to 5 minutes, scene 2 is 5 to 10 minutes, and scene 3 is 10 to 15 minutes. Become.
[0058]
In step S5, it is determined whether or not there is a scene where a thumbnail has not been created. If there is a scene where a thumbnail has not been created, the process proceeds to step S6, and if there is no scene where no thumbnail has been created, the process ends. Specifically, in the thumbnail maker 37, the thumbnail creation scene determination unit 48 outputs thumbnail creation scene information I7 based on the total scene number I5 determined by the total scene number determination unit 46.
[0059]
In step S6, the server requests data of the range of the scene. Specifically, in the thumbnail maker 37, the thumbnail 1 frame creation unit 49 supplies the content information requesting unit 43 with the scene range data request information I3 having the position information (start time-end time) as the range. The content information requesting unit 43 specifies the time in the range (RANGE) field of the play (PLAY) method as the request command Co of the position information of the scene, and transmits it to the server 1 using the RTSP protocol. When the HTTP 1.1 protocol is used instead of the RTSP protocol, data of a scene range is requested by a GET method. In this case, the range indicates the range of the scene in a data unit (byte). (E.g., start position (byte) -end position (byte))
[0060]
FIG. 10 is a diagram showing an example of an RTSP command requesting data in a range of a scene. The RTSP command is a request command Co for scene range data transmitted from the content information requesting unit 43 to the server 1 by specifying a time using the RTSP protocol. Here, the data in the scene range is transmitted at a higher transmission speed than the normal data. However, in the case of the RTSP protocol, as shown by 103, a scale (Scale: 2) is designated and the data in the scene range is transmitted at a higher speed.
[0061]
In FIG. 10, a play (PLAY) command is transmitted as a scene range data request command 101 from a player 2 of a client (Client) to a server (Server) 1. At this time, as shown by 102, a time in the range of 120 seconds to 130 seconds is designated by npt (normal play time) in the range (RANGE) field. Note that CSeq is a sequential number of a pair of transmission and reception using RTSP, and Session is a header identifier for identifying data of transmission and reception using RTSP.
[0062]
In the thumbnail creation module 31, the packet receiver 32 receives the packet of the thumbnail video data Dsn transmitted from the server 1 by the RTP / UDP protocol, and the depacketizer 33 removes the header portion of the packet of the thumbnail video data Dsn. At the same time, information such as a packet number and a time stamp included in the header portion is extracted. The decoder 34 decompresses the compressed and transmitted thumbnail video data Dsn. At this time, the thumbnail video data Dsn creates data in units of one frame in order and supplies it to the thumbnail maker 37.
[0063]
In step S7, it is determined whether or not one frame has been created. If it can be created, the process proceeds to step S8. If it cannot be created, the process returns to step S5, and the determination and processing of steps S5 to S8 are repeated. Specifically, the thumbnail maker 37 generates one frame of data that becomes one still image of a scene. If one frame of data is not created in the range of the scene, the process returns to step S5. In the thumbnail maker 37, the thumbnail 1 frame creation section 49 creates 1 frame thumbnail data Sn from the thumbnail video data Dsn supplied from the decoder 34 based on the scene position information I6.
[0064]
In step S8, the server requests the server to stop transmitting data. More specifically, in the thumbnail maker 37, the thumbnail 1 frame creation section 49 supplies the scene range data stop information I3 to the server 1.
[0065]
FIG. 11 is a diagram showing an example of an RTSP command for making a data transmission stop request. The RTSP command is a scene range data stop request command Co transmitted from the content information requesting unit 43 to the server 1 using the RTSP protocol.
[0066]
In FIG. 11, as a data transmission stop request command 111, a stop (STOP) command is transmitted from the player 2 of the client (Client) to the server (Server) 1.
[0067]
In step S9, one frame is stored in the thumbnail file, and the process returns to step S5 to repeat the determination and processing in steps S5 to S8. Specifically, in the thumbnail maker 37, the thumbnail file storage unit 50 stores the one-frame thumbnail data Sn of all scenes created by the thumbnail one-frame creation unit 49 in the thumbnail file 38.
[0068]
The thumbnail maker 37 displays a thumbnail image at a predetermined position on the thumbnail user interface 36 as shown in FIG.
[0069]
Next, a case will be described in which the reproduction position is moved by selecting and specifying a thumbnail image created in this manner and displayed on the thumbnail user interface 36.
[0070]
In the player 2, one frame of thumbnail still image for each scene is displayed on the thumbnail user interface. The user can select the next scene to be viewed from among the thumbnail still images of one frame for each scene displayed on the thumbnail user interface 36 and move the reproduction position. For example, when the horizontal bar icon is clicked with the mouse pointer and dragged in the horizontal direction, and the moving range of the horizontal bar icon is set to the entire playback time, an image to be selected for the entire playback time is played. Move to the position corresponding to the time. At this time, when the horizontal bar icon is moved to a position near the center of the moving range of the horizontal bar icon, thumbnail still images of some scenes near the center are extracted from the thumbnail file 38 by the thumbnail maker 37 and the extracted thumbnail images are extracted. Thumbnail still images of some scenes are displayed on the thumbnail user interface 36 by the renderer 35.
[0071]
By moving the cursor of the mouse pointer to the position of the selected image among the thumbnail still images of some displayed scenes and double-clicking, the reproduction position can be moved to the selected scene. The number of thumbnail still images can be set according to the window size of the thumbnail user interface 36 to be displayed, but it is considered appropriate to display about 10 thumbnail images.
[0072]
The specific operation will be described below.
First, in the thumbnail maker 37, the controller (not shown) of the player 2 extracts the position information of the thumbnail still image of one frame of the selected scene from the entire position information I4 extracted by the position information determination unit 45.
[0073]
When the position information of the thumbnail still image of one frame of the selected scene is extracted, a controller (not shown) of the player 2 creates reproduction range information. The reproduction range information is represented by start position information and end position information. The start position is the start position in the position information (start time to end time) of the scene requested by the thumbnail 1 frame creation unit 49 in the thumbnail maker 37. The end position is the content end position.
[0074]
Finally, the controller (not shown) of the player 2 requests the normal video data DV based on the reproduction range information created by the server 1, and the normal video data DV received from the server 1 is subjected to reproduction processing by the normal reproduction module 21. Then, the moving image in the reproduction range is reproduced on the normal data user interface 26.
[0075]
According to the above-described embodiment, in addition to the player 2 downloading the moving image content from the server 1 for normal reproduction, the player 2 downloads divided scene data obtained by dividing the entire content for each scene. By doing so, a thumbnail image based on the divided scene data of each scene can be created and displayed in the player 2.
[0076]
Further, in the player 2, a thumbnail image is continuously arranged and displayed as a one-frame still image for each scene so that the thumbnail image can be selectively designated, so that the playback position can be changed to a scene desired by the user.
[0077]
Also, by installing the thumbnail creation module 31 only with the player 2 without adding a new function to the current server 1, downloading of video data for thumbnails for each scene and display of scene information by thumbnail images can be performed. It can be carried out. As a result, thumbnail images can be displayed for the contents of moving images of all existing servers.
[0078]
The player 2 is configured in detail as follows, and operates as follows.
The compressed and encoded video input supplied from the server 1 via the network is decompressed and decoded, and then converted into an NTSC (National Television System Committee) or PAL (Phase Alteration Line) image. It has a video codec for outputting video to a display, a VRAM (Video Random Access Memory) for storing NTSC or PAL video data, and a graphic engine for drawing graphic images in the VRAM.
[0079]
The player 2 converts an audio input supplied from the server 1 via a network into a predetermined format and outputs the audio to a speaker, and a provider via the Internet via a PSTN (high-speed communication line). And an interface circuit that performs IR (infrared), serial, parallel, and other interfaces.
[0080]
Further, the player 2 includes a graphic engine, an audio codec, a modem, a local bus through which data of the interface circuit passes, a flash memory and a hard disk device (HDD) in which a predetermined program is stored, and an operation of the player 2. A controlling CPU (Central Processing Unit), a memory storing control data for operating the CPU, a host bus passing data of the CPU and the memory, and a bus bridge for exchanging data between a local bus and the host bus And is configured. The server 1 has the same configuration as the player 2.
[0081]
The player 2 configured as described above operates as follows.
When the power is turned on, the CPU exchanges data using the host bus and the local bus, so that an application program of a control unit application stored in the flash memory and the hard disk device (HDD) is started. Content information necessary for setting is received by the modem via, for example, a network. The CPU analyzes the data necessary for the received setting and supplies it to the graphic engine. The graphic engine draws a graphic image in the VRAM and the CPU analyzes the graphic image. The NTSC / PAL codec converts the graphic image into an NTSC or PAL image and processes the graphic image so that it can be supplied to the display of the player 2. Next, when transmitting a request signal of necessary information from the player 2 to the server 1, a request signal of necessary content information is transmitted to the server 1 by the modem, for example, via the Internet.
[0082]
When confirming the validity of the player 2, the CPU of the server 1 confirms whether or not the player 2 to be set is valid, for example, by the presence or absence of a confirmation signal for transmitting a predetermined command.
When the moving image data is transmitted from the server 1 to the player 2, the moving image data is transmitted to the player 2 via, for example, a network.
[0083]
When the player 2 receives the moving image data, the video codec converts the moving image data supplied from the provider via the network into the NTSC or PAL image data. The thumbnail data created by the thumbnail maker 37 is stored in the thumbnail file 38. The thumbnail data is analyzed by the CPU and supplied to the thumbnail user interface 36. When the user selects and specifies a thumbnail image, the moving image data converted by the video codec of the scene corresponding to the selected thumbnail image is stored in the VRAM and then supplied to the graphic engine. The graphic engine draws a graphic image based on the moving image data held in the VRAM and supplies the image to the display.
[0084]
According to the above-described embodiment, when reproducing streaming data supplied from a server, a thumbnail image can be created prior to moving image data to be reproduced. Furthermore, by selecting and specifying a thumbnail image, the reproduction position of the moving image data can be changed.
[0085]
It is needless to say that the present invention is not limited to the above-described embodiment, and various configurations can be adopted without departing from the scope of the present invention.
[0086]
【The invention's effect】
An information reproducing apparatus according to the present invention is an information reproducing apparatus for acquiring image data supplied from a server device via a network and reproducing the image data. Normal data reproducing means for receiving and reproducing data image data; normal data displaying means for displaying normal data image data reproduced by the normal data reproducing means; and divided scene data from the server device. While receiving and reproducing the divided scene data image data supplied via the transmission protocol, the divided scene data image data was divided into a plurality of scene ranges based on the content information on the image data. Divided scenes in which a predetermined range of data of each divided scene is sequentially generated for each range of each scene Data generating means, divided scene data storing means for sequentially storing divided scene data for each range of each scene sequentially generated by the divided scene data generating means, and all scenes stored by the divided scene data storing means. A divided scene data display unit for displaying the divided scene data; and a designated divided scene when a range of a scene of an arbitrary divided scene data among the divided scene data of all the scenes displayed by the divided scene data display unit is designated. Control means for controlling the image data reproduced by the normal data reproducing means to be displayed on the normal data display means so as to correspond to the range of the data scene. Image for divided scene data divided into scenes for the entire content in addition to downloading the image data for the server from the server device By previously downloaded over data, an effect that it is possible to create and display a thumbnail image based on the divided scene data for each scene in the information reproducing apparatus.
[0087]
Further, in the information reproducing apparatus of the present invention, since the divided scene data communication speed according to the divided scene data transmission protocol is higher than the normal data communication speed according to the normal data transmission protocol, the normal data supplied from the server device is used. When the image data for reproduction is reproduced, a thumbnail image based on the divided scene data can be created prior to the image data for normal data to be reproduced.
[0088]
Further, in the information reproducing apparatus of the present invention, in the above-mentioned divided scene data transmission protocol, a request command for content information on the image data is transmitted to the server device, and the content information on the image data is received from the server device. Therefore, there is an effect that information indicating a range of a scene is generated based on the content information and can be used to create a thumbnail image based on the divided scene data.
[0089]
Further, in the information reproducing apparatus of the present invention, in the above, the divided scene data generating means transmits a content information request command for the image data to the server device, and transmits the content information regarding the image data to the server device. A content information receiving unit that receives from the server device, a position information determining unit that determines whether or not the content information received by the content information receiving unit includes positional information of the image data; and An overall scene number determining unit that determines the overall scene number indicating a range to be divided into all scenes when it is determined that the position information is not included, and the overall scene number obtained from the overall scene number determining unit From the scene position information creating unit for creating scene position information indicating the range to be divided from the A divided scene data creating unit for creating divided scene data from the range data of each scene based on the total number of scenes, and all the divided scene data created by the divided scene data creating unit in the divided scene data storage unit. Since it has a divided scene data storage processing unit for performing storage processing, the total number of scenes is determined based on the content information, scene position information is generated from the total number of scenes, and a thumbnail image based on the divided scene data is used using the scene position information. Is produced.
[0090]
Further, in the information reproducing apparatus of the present invention, in the above, the divided scene data generating means includes: a divided scene data communication speed setting unit for setting a divided scene data communication speed according to the divided scene data transmission protocol; A divided scene data resolution variable unit that varies the resolution of the divided scene data based on the divided scene data communication speed set by the speed setting unit and supplies resolution information to the content information requesting unit. When making a request to the server device, the resolution of the divided scene data can be varied to change the communication speed of the divided scene data, and the request can be made to the server device.
[0091]
Further, in the information reproducing apparatus according to the present invention, in the above, the resolution variable section varies the resolution of the divided scene data in a plurality of steps from a standard resolution to a relatively low resolution according to the capacity of all image data. It is possible to request the server device to change the communication speed of the divided scene data in a plurality of stages from the standard communication speed to a relatively high resolution and change the communication speed of the divided scene data from the standard communication speed to a relatively high communication speed in a plurality of stages. It works.
[0092]
Further, the information reproducing method of the present invention is an information reproducing method for acquiring image data supplied from a server device via a network and reproducing the image data by the information reproducing device. And processing for receiving and playing back the divided scene data image data supplied via the CPU, and dividing the divided scene data image data into a plurality of scene ranges based on the content information on the image data. A divided scene data generating step of sequentially generating data of a predetermined range of each divided scene for each range of each scene; and a dividing step of sequentially storing divided scene data of each range of each scene sequentially generated by the divided scene data generating step. A scene data storage step, and division of all scenes stored in the divided scene data storage step A divided scene data display step of displaying plane data; and, when a range of a scene of an arbitrary divided scene data among the divided scene data of all scenes displayed in the divided scene data display step is designated, the designated divided scene data A control step of controlling the reproduction processing of the normal image data so as to correspond to the range of the scene, and a control step of controlling the display processing of the normal image data. A normal data reproduction step for receiving and reproducing the normal data image data supplied via the transmission protocol, and a normal data image reproduced by the normal data reproduction step by the display processing in the control step. A normal data display step of displaying data, so that In addition to downloading the image data for normal data from the server device, the image data for divided scene data obtained by dividing the entire content for each scene is downloaded. This makes it possible to create and display a thumbnail image based on the thumbnail image.
[0093]
Further, in the information reproducing method of the present invention, in the above-described divided scene data transmission protocol, a request command for content information regarding the image data is transmitted to the server device, and content information regarding the image data is received from the server device. Therefore, there is an effect that information indicating a range of a scene is generated based on the content information and can be used to create a thumbnail image based on the divided scene data.
[0094]
Further, in the information reproducing method according to the present invention, in the above, the divided scene data generating step transmits a request command for content information relating to the image data to the server device, and receives content information relating to the image data from the server device. Then, it is determined whether or not the content information received by the content information receiving unit includes the position information of the image data. When the position information determining unit determines that the position information is not included, all scenes are determined. The number of whole scenes indicating the range to be divided is determined, the scene position information indicating the range to be divided is created from the number of whole scenes, and the divided scene data is obtained from the range data of each scene based on the number of whole scenes. Create and store all the divided scene data in the divided scene data storage means. Determining the number of bodies scene, it generates scene position information from the entire scene number, an effect that it is possible to create a thumbnail image based on the divided scene data using the scene position information.
[0095]
Further, an information reproducing system of the present invention includes a server device for supplying image data, a network, and an information reproducing device for acquiring image data supplied from the server device via the network and reproducing the image data. An information reproducing system comprising: a normal data reproducing unit that performs processing for receiving and reproducing image data for normal data supplied from the server device via a normal data transmission protocol; and Normal data display means for displaying the normal data image data reproduced by the normal data reproducing means, and receiving and reproducing the divided scene data image data supplied from the server device via the divided scene data transmission protocol. Processing, and based on the content information on the image data, Divided scene data generating means for sequentially generating data of a predetermined range of each divided scene when each of the divided image data is divided into a plurality of scene ranges, and sequentially generated by the divided scene data generating means. Divided scene data storage means for sequentially storing divided scene data for each scene range; divided scene data display means for displaying divided scene data of all scenes stored by the divided scene data storage means; When the range of the scene of the arbitrary divided scene data is designated from among the divided scene data of all the scenes displayed by the display means, the normal data reproducing means is adapted to correspond to the range of the scene of the designated divided scene data. Control means for controlling the image data subjected to the reproduction processing to be displayed on the normal data display means. Since the image data supplied from the server apparatus is reproduced and displayed based on the divided scene data, the divided scene data generating means is implemented only by the information reproducing apparatus without adding a new function to the server apparatus. Thus, it is possible to download divided scene data for each scene and display a thumbnail image based on the divided scene data. As a result, there is an effect that the thumbnail images can be displayed by the divided scene data even for the moving image contents of all the existing server devices.
[Brief description of the drawings]
FIG. 1 is a diagram showing streaming in a player that performs thumbnail creation applied to the present embodiment.
FIG. 2 is a diagram showing a reproduction time of normal data and a creation time of thumbnail data. FIG. 2A shows normal data, FIG. 2B shows thumbnail scene data, and FIG. 2C shows thumbnail data.
FIG. 3 is a diagram showing an example of a thumbnail displaying a scene.
FIG. 4 is a diagram showing an internal configuration of a player.
FIG. 5 is a block diagram illustrating a configuration of a thumbnail maker.
FIG. 6 is a flowchart showing a procedure for creating a thumbnail.
FIG. 7 is a diagram illustrating an example of SDP information.
FIG. 8 is a diagram illustrating an example of position information included in an SDP.
FIG. 9 is a diagram illustrating an example of position information included in an SDP.
FIG. 10 is a diagram illustrating an example of an RTSP command requesting data in a range of a scene.
FIG. 11 is a diagram illustrating an example of an RTSP command for requesting a data transmission stop;
12A and 12B are diagrams showing a change in a reproduction position of a conventional player, FIG. 12A showing a state before the reproduction position is changed, and FIG.
FIG. 13 is a diagram showing a change in a playback position of a conventional player.
[Explanation of symbols]
1 ... Server 2 ... Player 3 ... Normal data user interface 4 ... Thumbnail user interface 5 ... Normal data 6 ... Normal data communication speed 7 ... Thumbnail video data 8: Thumbnail communication speed, 9: Thumbnail data, 10: Playback icon, 11: Stop icon, 12: Recording icon, 13: Horizontal bar icon, 21: Normal playback module, 22 ... Packet receiver 23 Depacketizer 24 Decoder 25 Renderer 26 User interface for normal data 31 Thumbnail creation module 32 Packet receiver 33 Depacketizer 34 Decoder , 35 ... Renderer, 36 ... Thumbnail user interface, 37 ... Thumbnail maker, 38 ... Thumbnail file, DV ... Normal video data (RTP / UDP), DA ... Audio data (RTP / UDP), Dsn ... Thumbnail video data (RTP / UDP), Co ... Content Information request command (RTSP), Re: Content information (SDP), 41: Thumbnail communication speed setting unit, 42: Thumbnail resolution variable unit, 43: Content information request unit, 44: Content information receiving unit, 45 position information determination unit, 46 total scene number determination unit 47 scene position information creation unit 48 thumbnail creation scene determination unit 49 thumbnail one frame creation unit 50 thumbnail file storage Section, 71: Session description, 72: Time description, 73 ... Deer description, 82 location information ...... scene, 91 position information ...... scene, 101 ...... scene range data request command, 111 ...... data transfer stop request command

Claims (10)

An information reproducing apparatus for acquiring image data supplied from a server device via a network and reproducing the image data,
A normal data reproducing unit that performs processing for receiving and reproducing the normal data image data supplied from the server device via the normal data transmission protocol,
Normal data display means for displaying the normal data image data reproduced by the normal data reproduction means,
The server device receives and reproduces the divided scene data image data supplied from the server device via the divided scene data transmission protocol, and generates a plurality of the divided scene data image data based on the content information on the image data. Divided scene data generating means for sequentially generating data of a predetermined range of each divided scene when divided into a range of scenes for each scene range,
Divided scene data storage means for sequentially storing divided scene data for each range of each scene sequentially generated by the divided scene data generation means,
Divided scene data display means for displaying divided scene data of all scenes stored by the divided scene data storage means,
When specifying the range of the scene of the arbitrary divided scene data among the divided scene data of all the scenes displayed by the above-mentioned divided scene data display means, the normal range is set so as to correspond to the range of the scene of the specified divided scene data. Control means for controlling the image data reproduced by the data reproducing means to be displayed on the normal data display means. 2. The information reproducing apparatus according to claim 1, wherein a divided scene data communication speed according to the divided scene data transmission protocol is higher than a normal data communication speed according to the normal data transmission protocol. 2. The information reproducing apparatus according to claim 1, wherein in the divided scene data transmission protocol, a request command for content information related to the image data is transmitted to the server device, and content information related to the image data is received from the server device. apparatus. The divided scene data generating means includes:
A content information requesting unit that transmits a request command for content information regarding the image data to the server device,
A content information receiving unit that receives content information related to the image data from the server device,
A position information determining unit that determines whether or not the position information of the image data is included in the content information received by the content information receiving unit;
When the position information determination unit determines that the position information is not included, the entire scene number determination unit determines the total scene number indicating the range to be divided of all scenes,
A scene position information creating unit that creates scene position information indicating a range to be divided from the overall scene number obtained from the overall scene number determination unit,
A divided scene data creating unit that creates divided scene data from the range data of each scene based on the overall scene number determined by the overall scene number determining unit;
2. The information reproducing apparatus according to claim 1, further comprising: a divided scene data storage processing unit that stores all divided scene data created by the divided scene data creation unit in the divided scene data storage unit. The divided scene data generating means includes:
A division scene data communication speed setting unit for setting a division scene data communication speed according to the division scene data transmission protocol;
A split scene data resolution changing unit that changes resolution of the split scene data based on the split scene data communication speed set by the split scene data communication speed setting unit and supplies resolution information to the content information requesting unit. 3. The information reproducing apparatus according to claim 2, wherein: 6. The information reproducing apparatus according to claim 5, wherein the resolution changing unit changes the resolution from a standard resolution to a relatively low resolution in a plurality of steps according to the capacity of all image data. In an information reproducing method of acquiring image data supplied from a server device via a network and reproducing the image data by an information reproducing device,
The server device receives and reproduces the divided scene data image data supplied from the server device via the divided scene data transmission protocol, and generates a plurality of the divided scene data image data based on the content information on the image data. A divided scene data generating step of sequentially generating data of a predetermined range of each divided scene when divided into a range of scenes for each range of each scene;
A divided scene data storing step of sequentially storing divided scene data for each range of each scene sequentially generated by the divided scene data generating step;
A divided scene data display step of displaying divided scene data of all scenes stored by the divided scene data storage step;
When the range of the scene of the arbitrary divided scene data is designated from among the divided scene data of all the scenes displayed in the above-mentioned divided scene data display step, the normal image is displayed so as to correspond to the range of the scene of the designated divided scene data. A control step of controlling data reproduction processing and controlling the display processing of the normal image data;
A normal data reproducing step of performing a process of receiving and reproducing normal data image data supplied from the server device via a normal data transmission protocol by the reproducing process in the control step;
A normal data display step of displaying the normal data image data reproduced by the normal data reproduction step by the display processing in the control step;
An information reproducing method comprising: 8. The information reproducing apparatus according to claim 7, wherein in the divided scene data transmission protocol, a request command for content information related to the image data is transmitted to the server device, and content information related to the image data is received from the server device. Method. The divided scene data generating step includes:
Transmitting a request command for content information regarding the image data to the server device,
Receiving content information on the image data from the server device,
Determine whether or not the position information of the image data is included in the content information received by the content information receiving unit,
When it is determined that the position information is not included by the position information determination unit, determine the total number of scenes indicating the range to be divided of all scenes,
Create scene position information indicating the range to be divided from the total number of scenes,
Create divided scene data from the range data of each scene based on the total number of scenes,
8. The information reproducing method according to claim 7, wherein said divided scene data is stored in said divided scene data storage means. An information reproducing system including a server device that supplies image data, a network, and an information reproducing device that acquires image data supplied from the server device via the network and reproduces the image data.
The information reproducing apparatus includes:
A normal data reproducing unit that performs processing for receiving and reproducing the normal data image data supplied from the server device via the normal data transmission protocol,
Normal data display means for displaying the normal data image data reproduced by the normal data reproduction means,
The server device receives and reproduces the divided scene data image data supplied from the server device via the divided scene data transmission protocol, and generates a plurality of the divided scene data image data based on the content information on the image data. Divided scene data generating means for sequentially generating data of a predetermined range of each divided scene when divided into a range of scenes for each scene range,
Divided scene data storage means for sequentially storing divided scene data for each range of each scene sequentially generated by the divided scene data generation means,
Divided scene data display means for displaying divided scene data of all scenes stored by the divided scene data storage means,
When specifying the range of the scene of the arbitrary divided scene data among the divided scene data of all the scenes displayed by the above-mentioned divided scene data display means, the normal range is set so as to correspond to the range of the scene of the specified divided scene data. Control means for controlling the image data reproduced by the data reproduction means to be displayed on the normal data display means, and supplied from the server device based on the divided scene data generated only by the information reproduction device. A system for reproducing and displaying the obtained image data.

Images