JP3663960B2 - Information processing apparatus and information processing method - Google Patents

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention relates to an information processing apparatus. And information processing method In particular, clients can share mark information given to (multi-window) presentations composed of media mixes including streaming media, such as audio, video, still images, animations, texts, graphics, etc. provided by the server Information processing apparatus And information processing method About.
[0002]
[Prior art]
Traditionally, you can mark a digital document, write a personal note, annotate it, and write it to the author in the same way as writing a note or marking a printed document. A feedback system has been proposed. In the future, as networking progresses and multimedia documents become more widespread, such support technology for editing actions on digital documents will become very important in situations where collaborative work on networks is performed.
[0003]
Annotating a document composed of pages such as a presentation using a so-called OHP (overhead projector) is disclosed in Japanese Patent Laid-Open No. 5-189431. This is a system for annotating a document that does not include streaming media such as text, graphics, and images without compromising the integrity of the original document. Annotation is a technology that is possible only with digital documents, writing to another layer and not editing the original document. However, no method for annotating streaming media is disclosed.
[0004]
Japanese Patent Application Laid-Open No. 7-182282 discloses means for adding a comment to a document shared on a plurality of computers. This is because when a common image is displayed on a plurality of computers connected to the network, the user can make an attachment on the image, and the attachment data is stored in a location different from the image data. Is. The annotation is also displayed on other computers on the network.
[0005]
This technology also provides an improved electronic conference system. A plurality of members participating in the conference can see at a glance the other member's interaction (notes, annotations, questions, etc.) to which part of the image it was added.
[0006]
Furthermore, a multimedia information processing apparatus is proposed in Japanese Patent Application No. 10-264828 by the present applicant. According to this technology, mark information having a time width can be given to a presentation including audio and moving images, and communication on a network via a presentation having a time axis is possible.
[0007]
Now, consider creating a presentation and making it available to many people. At this time, unless the target person to be disclosed is narrowly limited, it is natural to think that the conditions for viewing the presentation are different depending on the target person.
[0008]
For example, if the presentation includes a broadband (large capacity) information media, there is no problem with an intranet terminal in a company, but it is not appropriate for a terminal with a low speed of 33600 bps. Alternatively, it may be better to prepare a shortened version of the presentation (digest version) and communicate your intentions in less time to someone who has sufficient prior knowledge. Or, even if the original presentation contains audio information, text information is more desirable for people with hearing impairments.
[0009]
As described above, it is desirable to prepare a plurality of presentations having the same meaning content according to the viewing conditions as appropriate viewing conditions depending on the target person who publishes the presentation.
[0010]
[Problems to be solved by the invention]
However, in such a case, there is a problem in that the viewers give supplementary notes and mark information to different presentations, and communication using the supplementary notes and mark information described above cannot be performed.
[0011]
The present invention has been made in view of such a point, and an object thereof is to provide an information processing apparatus that can easily and appropriately share mark information between different presentations created for each viewing condition. And
[0012]
[Means for Solving the Problems]
In the present invention, in order to solve the above problem, in an information processing apparatus that processes information between a server on a network and a plurality of clients, the client combines a plurality of media information in time and space. Information viewing means for reproducing the presentation, and a predetermined mark is designated at least in one of a specific space portion in the presentation by the information viewing means, a point in the time axis direction, or an area having a predetermined width Marking means, first mark information management means for managing mark information of a mark designated by the marking means in a form synchronized with the presentation reproduced by the information viewing means, and the first mark information management means First communication for communicating mark information managed by the mark information management means with the server And the server includes a second communication means for communicating mark information with the client, a presentation information management means for managing a relationship between a plurality of presentations created for the same purpose, and the presentation Mark information conversion means for converting mark information received from the second communication means into mark information for a different presentation associated by the presentation information management means, based on the presentation information managed by the information management means; And second mark information management means for storing and managing the mark information received from the second communication means and / or the mark information converted by the mark information conversion means. An information processing apparatus is provided.
[0013]
According to such an information processing apparatus, one of a plurality of presentations having the same purpose managed by the presentation information management means of the server is reproduced by the information viewing means of the client. When a mark by the marking unit is designated for the reproduced presentation, the first mark information management unit generates the mark information in a form synchronized with the presentation reproducing the mark information of the mark. To the server via the communication means. The mark information received by the second communication means of the server is converted by the mark information conversion means into mark information for a presentation that serves as a reference among different presentations associated by the presentation information management means, and the mark information management means It is managed at. This mark information is converted into mark information for the presentation by the mark information conversion means at the time of reproduction of another presentation and sent to the client, and the first mark information management means at the time of reproduction of the presentation by the information viewing means Mark information is also displayed. Thereby, a mark designated in a certain presentation is reproduced in any presentation created for the same purpose, and can be shared between the presentations.
[0014]
DETAILED DESCRIPTION OF THE INVENTION
Hereinafter, an embodiment of an information processing apparatus according to the present invention will be described with reference to the drawings.
[0015]
FIG. 1 is a diagram illustrating a schematic configuration of an information processing apparatus. The information processing apparatus includes a plurality (n in the illustrated example) of clients C1 to Cn and a server S, and the clients C1 to Cn and the server S are connected via a network.
[0016]
Each of the clients C1 to Cn includes an information viewing unit 1, a marking unit 2, a mark information management unit 3, and a communication unit 4. In FIG. 1, since the functional units of the clients C2 to Cn are the same as those of the client C1, their display is omitted.
[0017]
The information viewing unit 1 is a functional unit that presents multimedia information mainly by combining and reproducing a plurality of pieces of media information in terms of time and space, and the marking unit 2 includes a specific spatial part in the presentation, This is a functional unit for designating a predetermined mark in at least one of a point in the time axis direction or an area having a predetermined width, and the mark information management unit 3 manages the mark information in a form that can be synchronized with the presentation. The communication unit 4 is a functional unit for communicating mark information with the server S.
[0018]
The server S includes a scenario information management unit 5, a media information management unit 6, a communication unit 7, a mark information conversion unit 8, and a mark information management unit 9, of which the scenario information management unit 5 and the media The information management unit 6 constitutes a presentation information management unit.
[0019]
The scenario information management unit 5 manages scenario information describing a playback procedure of multiple media information, and the media information management unit 6 is a functional unit that manages media to be played according to the scenario information, and the presentations that constitute these The information management unit has a function of managing the relationship between a plurality of presentations created for the same purpose as a whole. The communication unit 7 is a functional unit for communicating mark information with the client. The mark information conversion unit 8 presents the mark information received from the communication unit 7 based on the presentation information managed by the presentation information management unit. A function unit that converts mark information for different presentations associated with the information management unit. The mark information management unit 9 stores and manages the received mark information or the mark information converted by the mark information conversion unit 8. Part.
[0020]
Next, the overall flow of use of the information processing apparatus from the client will be described.
FIG. 2 is an explanatory diagram showing the overall flow when the information processing apparatus is used. In FIG. 2, the clients C1 to C3 and the server S are connected via a network. In the example of FIG. 2, the server S is provided with three scenarios “scenario 1”, “scenario 2”, and “scenario 3” as a grouped presentation. Here, “scenario 1”, “scenario 2”, and “scenario 3” are presentations having the same meaning as presentations, that is, presentations created for the same purpose, but are actually different scenarios or different media ( Content) is used. Specifically, the amount of video data in the scenario is reduced for display on a terminal with a low transfer rate, or the audio information is changed to text information of the same content, or the original scenario is shortened. Digest version. Furthermore, individual media such as voice, moving image, and text associated with each of “scenario 1”, “scenario 2”, and “scenario 3” are managed in the same manner.
[0021]
Further, information (mark information M) related to the mark given by the viewer of the scenario of the presentation group P so far is held in association with the presentation group P by the mark information management unit. Details of the management of the mark information will be described later.
[0022]
In order to view the presentation group P, the user accesses the server S and selects a favorite scenario from the “scenario 1”, “scenario 2”, and “scenario 3” for the server S. Here, the access to the server S and the selection of the scenario are performed using a known technique such as a Web (World Wide Web) browser. In the example of FIG. 2, it is assumed that the user of the client C1 has selected “Scenario 1”.
[0023]
In response to a request from the user, the media associated with “Scenario 1” and “Scenario 1” from the server S, that is, each media such as audio, video, and text reproduced as described in “Scenario 1” is transferred to the client C1. Forwarded to At the same time, a control unit (not shown) of the server S converts the mark information M into a description format that can be viewed in “scenario 1” so that the mark information M associated with the presentation group P can be viewed in the client C1 simultaneously with “scenario 1”. The converted mark information M is transferred to the client C1. In the client C1, the presentation and the mark information are reproduced according to the description in the scenario based on the transferred scenario and the mark information, and the user can view it. Furthermore, a mark can be given to the reproduced presentation by the user himself / herself. Scenario reproduction and mark information assignment in the client C1 will be described later. In the present embodiment, the scenario and the individual media associated with the scenario are downloaded as files to the client C1, and then the presentation playback operation is executed by the client C1, but for example, a real network is used. Data may be transferred to the client by a streaming data transfer technique such as that used in the Real System of the company S, and the difference in the transfer method does not hinder the operation of the present invention.
[0024]
The mark information Mc1 given by the user at the client C1 is transferred to the server S and managed in the same manner as the mark information M associated with other presentation groups P on the server S. At this time, the mark information Mc1 is managed after being converted into information independent of “scenario 1” by the mark information conversion unit 8, so even if another user views “scenario 2” from the client C2, for example, Like the reproduction of the presentation group P at the client C1, the mark information M (including Mc1) is transferred, and the mark given at the client C1 can be viewed.
[0025]
Next, for the clients C1, C2, and C3, a stand-alone operation and functional units related to the operation will be described.
FIG. 3 is a block diagram illustrating a configuration example of the information viewing unit on the client side. The information viewing unit 1 includes a media information management unit 11, a playback scenario management unit 12, a visual information playback unit 13, an audio information playback unit 14, a scenario interpretation unit 15, and a playback scenario calculation unit 16. Yes.
[0026]
The media information management unit 11 stores and manages media contents as independent media. This media content is information such as voice, text, still image, moving image, animation obtained from the server S. The playback scenario management unit 12 stores and manages a playback scenario describing a temporal order, a spatial layout, and the like when playing back each medium in a presentation. The visual information reproducing unit 13 has a function of reproducing media such as text, still images, moving images, and animations. The audio information reproducing unit 14 has a function of reproducing audio information. The scenario interpretation unit 15 reads the playback scenario of the corresponding presentation from the playback scenario management unit 12, and the layout information of the window played back by the visual information playback unit 13 and the media played back from the media information management unit 11 at a predetermined execution start time. Get information. The playback scenario calculation unit 16 has a function of playing back the media stored in the media information management unit 11 using the visual information playback unit 13 and the audio information playback unit 14 according to the scenario interpreted by the scenario interpretation unit 15. .
[0027]
With the above configuration, the information viewing unit 1 reads the scenario and media information from the server S, interprets the scenario, and reproduces the multiple media information in a temporal and spatial combination as described in the scenario.
[0028]
FIG. 4 is a diagram showing a description example of the reproduction scenario. The playback scenario roughly includes a header part and a body part. In the header portion, the layout of windows used in the presentation executed based on the reproduction scenario is described for the number of windows (three in FIG. 4). The body part describes which content (media) is to be played back at what timing. Specifically, the body portion has columns for execution start time, window number, media, content ID, and playback time length.
[0029]
As the execution start time, a time at which media playback is started is set. The window number is set to the window number for reproducing the media when the media to be reproduced is video media, and is set to “audio” when the media to be reproduced is audio media. In the medium, an identification name of the medium to be reproduced is set. In the playback time length, in the case of a still image without a time axis, the length of time for displaying the media is described. The playback time length does not need to be described when streaming media with a time axis such as video / animation is played back at normal speed, but the playback media such as double-speed playback / slow playback are usually used. When playback is performed at a speed different from the above speed, it is necessary to describe the total playback time.
[0030]
In the playback scenario, it is possible to start playback of two or more media at the same time by describing two or more media in the media column for the same execution start time.
[0031]
Here, the concept of a presentation playback schedule (score) based on the playback scenario shown in FIG. 4 will be described with reference to FIGS.
FIG. 5 is a diagram showing a score of a presentation, and FIG. 6 is a diagram showing a display example of a multimedia presentation. In FIG. 5, time is taken on the horizontal axis, and space (window number or audio) to be reproduced is taken on the vertical axis, and each rectangle represents each medium. FIG. 6 shows the presentation at time t = tp.
[0032]
According to the score of FIG. 5, at time t = tp, media a is played in window W1, media b is played in window W2, media c is played in window W3, and media d is played in audio. I understand. In FIG. 6, windows W1 to W3 for reproducing the media a to c are displayed on the display screen, and the audio medium d is displayed with an icon I. On the display screen, several marks M1, M2, and M3 given by the user are displayed.
[0033]
Next, a basic media playback operation of the information processing apparatus will be described with reference to FIG.
FIG. 7 is a flowchart showing the flow of a basic multimedia playback operation. This playback operation is started when the “play” button of the presentation is pressed by the user on the display screen shown in FIG.
[0034]
First, the scenario interpretation unit 15 reads the playback scenario of the corresponding presentation from the playback scenario management unit 12 (step S1). Next, the scenario interpretation unit 15 reads the header portion of the playback scenario and acquires window layout information (step S2).
[0035]
Thereafter, the scenario interpretation unit 15 reads the body part of the playback scenario in order from the head, reads the media to be played back at a predetermined execution start time from the media information management unit 11 (step S3), and determines whether or not the taken-out media is audio media. Is detected (step S4). If it is not an audio medium, if the medium is a visual medium, that is, a text, a still image, a moving image, or an animation, the medium is output to the visual information reproducing unit 13 together with layout information of a window for reproducing the medium. To do. The visual information playback unit 13 creates a window based on the input window layout information, and plays back the input media on the window (step S5). On the other hand, when the media read from the media information management unit 11 is an audio medium, the media is output to the audio information reproduction unit 14. The audio information reproduction unit 14 reproduces audio from the speaker based on the input media (step S6).
[0036]
Then, the above process (steps S3 to S6) is executed for the description of the body part, and is repeated until there is no description (step S7).
Next, an operation for associating mark information with media included in a presentation will be described.
[0037]
When the user wants to associate mark information with a specific medium during the presentation, the marking unit 2 is activated by pressing the “mark” button on the display screen shown in FIG. By indicating the desired media of the presentation being played back by the visual information playback unit 13, a mark is given at the indicated position, and the mark information management unit 9 associates the mark information with the scenario in the server S. can do. The audio media can be selected by giving an instruction to the audio media icon (icon I in FIG. 6) in the presentation window.
[0038]
Specifically, a symbol of desired mark information may be selected from a symbol list of mark information that appears by pressing a “mark” button on the screen, and the symbol may be dragged and dropped onto a predetermined medium. Thereby, the mark information about the time of the media is associated. When the mark information is associated with a desired time width of a desired medium, it can be realized by clicking a mark information symbol for a desired time. Note that some marks that can be added on the screen are prepared in advance, but a user can also define a new mark by using the “define” button.
[0039]
A user can add a comment or the like to the mark provided on the medium. For example, when a mouse is right-clicked on a given mark, a pop-up window appears, and text information can be added to the mark information by writing a comment in a text area on the pop-up window.
[0040]
Next, an example of a mark information file that manages mark information in association with a predetermined time of a medium will be described with reference to FIG.
FIG. 8 is a diagram showing an example of the data structure of mark information. In the present embodiment, the mark information is described in a table as shown in the figure. The mark information includes, as attributes, a user name, a scenario name of the presentation to which the mark is attached, a content ID of the medium to which the mark is attached, a position on the medium, a time, a display time of the mark, and a user added. Has comments (character string information). In the present embodiment, the position on the medium to which the mark is given is the (x, y) coordinate value from the upper left of the medium, and the given time is the time from the media playback start time. . The mark information management unit 3 gives the attribute information to the mark given by the marking unit 2. Thereafter, the communication unit 4 establishes a connection with the communication unit 7 of the server S so that data can be transmitted and received according to the communication protocol, and transmits a file for transmission to the communication unit 7. The communication unit 7 receives a file for transmission from the communication unit 4 of a plurality of clients C1, C2, and C3 connected via a network. Details of the mark information processing in the server S will be described later.
[0041]
In this embodiment, when the user gives a mark, the system automatically sends the mark information without the user's knowledge. For example, a mark information transmission button is provided, If the transmission is made only when the user explicitly instructs, it is effective when considering the protection of the user's privacy. In the present embodiment, the user name is transmitted to the server S, but the user name is not necessarily transmitted. For example, when respecting user privacy, the user name may not be transmitted together with the mark information.
[0042]
Next, management of scenario information and mark information in the server S, which is a main part of the present invention, will be described.
As described above, each scenario for presentation is generally composed of a plurality of media such as audio and images. The mark information given by the user is associated with the media included in the scenario. Therefore, in the present embodiment, the scenario to be marked needs to be registered in the server S in advance.
[0043]
FIG. 9 is a diagram showing a flow of processing for scenario information registration in the server. The server administrator registers a scenario to be registered in the server S from the scenario information input unit 10. In the present embodiment, each scenario registered in the server S is recorded as one element of a collection (presentation group) of a plurality of scenarios. A plurality of scenarios created for the same purpose are registered in one presentation group. Specifically, for display on a terminal with a low transfer rate, the video in the scenario has been replaced with one with less data, or the audio information has been replaced with text information of the same content, A shortened version of the scenario (digest version). If you want to register a new scenario in an existing presentation group, you can add it to the presentation group. If not, create a new presentation group and register it there.
[0044]
The scenario describes the file name, content ID, display position, display start time, and display time for each medium. The scenario information management unit 5 reads these attribute values of the scenario input from the scenario information input unit 10 and sends them to the media information management unit 6. In the present embodiment, the media information is described in a table format.
[0045]
FIG. 10 is a diagram for explaining a scenario and media information management method. In FIG. 10, “Presentation Group 1” includes three scenarios. Each scenario holds the relationship between each content ID and media. At the same time, mark information given to the presentation group, which will be described later, is also associated and held.
[0046]
Further, for each presentation group, media information serving as a standard for each scenario belonging to the group is prepared. When managing mark information, which will be described later, in the mark information conversion unit 8, the media information of each scenario is always processed by comparison with standard media information. A standard scenario is selected from a scenario group in a presentation group by a server administrator from a user interface (not shown) (hereinafter, the selected scenario is referred to as a master scenario). In FIG. 10, “scenario 2” is selected as the master scenario.
[0047]
As the master scenario, any registered scenario may be selected, but if the media with the same content ID is, for example, one is a voice and the other is a video, it includes both position information and time information. It is desirable to select a scenario with a video.
[0048]
FIG. 11 shows an example of a registered scenario, FIG. 12 shows a score of a presentation reproduced from the registered scenario, and FIG. 13 shows an example of media information created from the scenario. In these figures, three scenarios “Scenario 1” to “Scenario 3” are shown as examples of scenarios registered in “Presentation Group 1”, and each of “Scenario 1” to “Scenario 3” is two. A scenario created for the same purpose consisting of scenes. Here, “scenario 2” is the master scenario, and is composed of two movies (moving image + audio). “Scenario 1” is a digest version of “Scenario 2” in which the display time of each movie is reduced to ½. In “Scenario 3”, still images are used as substitutes for the respective moving images, and text is used instead of voice. Between the three scenarios, each content ID is associated with two respective scenes. Thus, by managing mark information described later, a plurality of viewers “scenario 1” to “scenario 3” can share the mark information regardless of which scenario is viewed.
[0049]
As described above, the scenario can be viewed by the clients C1, C2, and C3, and the user can mark the media included in the scenario. When marked, the mark information of the client is sent to the server S through the communication unit and managed.
[0050]
Next, an operation for storing the mark information received by the server S will be described.
FIG. 14 is a diagram for explaining the operation of storing mark information in the server. In the present system, the mark information manages the assigned marks not in individual scenarios but in presentation group units.
[0051]
The mark information sent to the server S is sent to the mark information conversion unit 8 through the communication unit 7. The mark information conversion unit 8 first refers to the presentation group to which the scenario belongs by referring to the scenario information management unit 5 based on the scenario name described in the mark information. Further, the mark information conversion unit 8 refers to the media information of the scenario and the master scenario to which the received mark information is added from the media information management unit 6, and based on the attribute information of the content with the same content ID of both. The mark information is converted so as to be associated with the original scenario.
[0052]
As described above, the mark information conversion process is obtained by computing the media information of the master scenario and the media information of the received scenario. Specifically, the display start time, display time, and position information of the attribute value of the mark information are converted.
[0053]
FIG. 15 is a conceptual diagram of conversion of display start time and display time. In FIG. 15, it is assumed that the scenario to which the transmitted mark information is assigned is scenario 1, for example. The display time of the mark information given to scenario 1 is compared with the display time of the media having the same content ID in the master scenario and scenario 1, and similar conversion is performed. For example, when a mark is given to the scenario 1 viewed by the user within 5 to 10 seconds of Movie 1-1 (display time 10 seconds), it is compared with Movie 1 (display time 20 seconds) of scenario 2 which is the master scenario. The display time as mark information is changed to 10 to 20 seconds. Even when the media of the master scenario and the scenario 1 are different, it is not necessary to change the display start time and the display time as long as both have the same display time. Similarly, the position information is also converted by similarity conversion between the master scenario and scenario 1. If the scenario is reproducing audio that does not have position information, for example, the upper left (X = 0, Y = 0) is given as a default value. These mappings are not exactly the same time and position for the content because the media content used in each scenario is different, but it is useful for sharing marks among multiple users. is there.
[0054]
Next, an operation when a scenario is reproduced together with mark information in the clients C1, C2, and C3 will be described. Each client requests the server S for mark information for the scenario during scenario playback. The server S converts the mark information of the presentation group including the scenario from the requested scenario name by using the mark information conversion unit 8 so as to match the scenario reproduced by the client, and transmits it.
[0055]
The conversion process for transmitting the mark information may be performed by performing reverse conversion of conversion when storing the received mark information. However, the processing is different when there is a one-to-many medium.
[0056]
FIG. 16 is an explanatory diagram of conversion processing for transmitting mark information. As shown in the figure, it is assumed that the master scenario is a moving image and the scenario viewed by the viewer is broken down into a still image and sound. In such a case, the still image has both position information and time information described in the scenario, whereas the voice has no position information. In this case, the mark information conversion unit 8 compares the two, selects a still image having both position information and time information, and converts the mark information so that a mark is given to the still image.
[0057]
The client that has received the mark information displays the mark on the presentation reproduction screen at the timing described in the mark information in synchronization with the master scenario by the same operation as the master scenario.
[0058]
Thus, a viewer of a scenario using each client C1, C2, C3 can share mark information even when viewing other presentations belonging to the same presentation group. Therefore, the presentation provider can prepare a plurality of scenarios according to the situation and suitability of the client, and the viewer can communicate with viewers of other scenarios via the mark information. .
[0059]
The present invention is not limited to the above-described embodiment, and various modifications can be made. For example, in the above-described embodiment, one content ID is given to media information for a pair, but a plurality of content IDs may be provided. For example, when the information viewing unit 1 (FIG. 1) has a function of reproducing a moving image / audio in the middle, even a single moving image can be described as a scenario divided into scenes and given a plurality of content IDs. it can. Alternatively, in ASF (Advanced Streaming Format) which is one of streaming media formats, a script can be embedded at an arbitrary position on a time axis such as a moving image. By specifying the content ID in the moving image using such a function, the position on the time axis in the moving image can be specified accurately.
[0060]
FIG. 17 is an explanatory diagram of an example in which a plurality of content IDs are given on the time axis, and FIG. 18 is a diagram showing a scenario example in which a plurality of content IDs are given on the time axis. In FIG. 17, the upper scenario shows the master scenario, the lower scenario shows the digest version, and FIG. 18 shows the digest version scenario. In the digest version, some scenes of the master scenario are used intermittently. An individual content ID is assigned to each scene, so that the mark information can be shared between the digest version viewer and the master scenario viewer. In the scenario of the digest version, one moving image is defined as three media, and describes the start position (delay) of the moving image (Movie1).
[0061]
In the above embodiment, the server S stores only the scenario information and operates without storing the scenario itself. However, the clients C1, C2, and C3 can distribute the scenario from the server S. Also good. At this time, instead of preparing each scenario individually, it is possible to generate and send an appropriate scenario in real time according to a request from the user using a technology such as CGI (Common Gateway Interface). The effect is obtained.
[0062]
【The invention's effect】
As described above, according to the present invention, mark information assigned to a plurality of scenarios for the same presentation can be shared. As a result, the presentation provider can prepare a plurality of scenarios according to the user's environment and the like, and can deal with them in detail, so that the viewer can gain more understanding. Further, since the viewer can share mark information between different scenarios, communication with the entire presentation viewer is possible.
[Brief description of the drawings]
FIG. 1 is a diagram illustrating a schematic configuration of an information processing apparatus.
FIG. 2 is an explanatory diagram showing an overall flow when an information processing apparatus is used.
FIG. 3 is a block diagram illustrating a configuration example of an information viewing unit on a client side.
FIG. 4 is a diagram illustrating a description example of a reproduction scenario.
FIG. 5 is a diagram showing a score of a presentation.
FIG. 6 is a diagram illustrating a display example of a multimedia presentation.
FIG. 7 is a flowchart showing a flow of a basic multimedia playback operation.
FIG. 8 is a diagram illustrating an example of a data structure of mark information.
FIG. 9 is a diagram showing a flow of processing for scenario information registration in the server.
FIG. 10 is a diagram for explaining a scenario and media information management method;
FIG. 11 is a diagram illustrating an example of a scenario to be registered.
FIG. 12 is a diagram showing a score of a presentation reproduced from a registered scenario.
FIG. 13 is a diagram illustrating an example of media information created from a scenario.
FIG. 14 is a diagram for explaining a storing operation of mark information in the server.
FIG. 15 is a conceptual diagram of conversion of display start time and display time.
FIG. 16 is an explanatory diagram of a conversion process for transmitting mark information.
FIG. 17 is an explanatory diagram of an example in which a plurality of content IDs are given on the time axis.
FIG. 18 is a diagram illustrating an example of a scenario in which a plurality of content IDs are given on the time axis.
[Explanation of symbols]
1 Information viewing department
2 Marking part
3 Mark Information Management Department
4 Communication Department
5 Scenario Information Management Department
6 Media Information Management Department
7 Communication Department
8 Mark information converter
9 Mark Information Management Department
10 Scenario information input section
11 Media Information Management Department
12 Playback Scenario Management Department
13 Visual information playback unit
14 Audio information playback unit
15 Scenario interpretation part
16 Playback scenario calculator
C1-Cn client
M1-M3 mark
M, Mc1 mark information
S server

Claims (10)

In an information processing apparatus that processes information between a server on a network and a plurality of clients,
The client
An information viewing means for reproducing a presentation by combining a plurality of media information temporally and spatially,
Marked means for designating a predetermined mark the particular spatial part in the presentation, one point in the time axis direction, or in at least one region having a predetermined width by the information viewing means,
First mark information management means for managing mark information of a mark designated by the marking means in a form synchronized with the presentation reproduced by the information viewing means;
And a first communication means for communicating the mark information of the first mark information management means for managing said server,
The server
A second communication means for communicating mark information with the client;
Presentation information management means for managing the relationship between multiple presentations created for the same purpose;
Mark information conversion means for converting the mark information received from the second communication means into mark information for a different presentation associated by the presentation information management means, based on the presentation information managed by the presentation information management means; ,
And second mark information management means for storing and managing the mark information received from the second communication means and / or the mark information converted by the mark information conversion means. Information processing apparatus.   The plurality of presentations created for the same purpose differ in at least one of the type and contents of media to be reproduced, a temporal and spatial combination of displaying the plurality of media, and display time. 1. An information processing apparatus according to 1. The presentation, and wherein at least the plurality of media storage location and file name is defined as a scenario where the display position is described, the media according to the description of the scenario by the information viewing means is intended to be reproduced The information processing apparatus according to claim 1 or 2.   The first mark information management means generates mark information describing a relationship between the scenario reproduced for the mark designated by the marking means and media information included in the scenario, and the presentation information The management means retains a relationship between a plurality of scenario information created for the same purpose and media information described in each scenario, and the second mark information management means uses the mark information as scenario information and / or The information processing apparatus according to claim 3, wherein the information processing apparatus is managed in association with the media information.   5. The information processing apparatus according to claim 4, wherein the media information includes stream media having a time axis.   The mark information includes at least one of position information and time information, and the mark information conversion means includes at least one of position information and time information of mark information attached to media information reproduced at the time of reproducing a presentation. The information processing apparatus according to claim 3, wherein the information processing apparatus is changed.   When the mark information conversion unit distributes one of the scenarios managed by the presentation information management unit to the client, the mark information conversion unit converts the mark information managed by the mark information management unit into mark information for a presentation based on the scenario. 4. The information processing apparatus according to claim 3, wherein the information processing apparatus performs conversion. An information processing device that processes information with a single server on the network In place
Information viewing means for reproducing a presentation by combining a plurality of media information temporally and spatially;
Marking means for designating a predetermined mark in at least one of a specific space portion in the presentation by the information viewing means, a point in the time axis direction, or an area having a predetermined width;
Mark information management means for managing mark information of a mark designated by the marking means in a form that can be synchronized with the presentation reproduced by the information viewing means;
Communication means for communicating the mark information managed by the mark information management means with the server;
An information processing apparatus comprising: In an information processing apparatus that processes information with a plurality of clients via a network,
Communication means for communicating mark information with the client;
Presentation information management means for managing the relationship between multiple presentations created for the same purpose;
Mark information conversion means for converting the mark information received from the communication means into mark information for different presentations associated with the presentation information management means, based on the presentation information managed by the presentation information management means;
Mark information management means for storing and managing the mark information received from the communication means and / or mark information converted by the mark information conversion means;
  An information processing apparatus comprising: In an information processing method for processing information between a server on a network and a plurality of clients,
The client marking means designates a predetermined mark in at least one of a specific space portion in the presentation, a point in the time axis direction, or an area having a predetermined width, and marks the presentation When,
The mark information management means of the client sending mark information of the mark designated by the marking means to the server;
The server converts the received mark information into mark information for different presentations created by the mark information conversion means for the same purpose;
Transmitting the mark information converted by the mark information conversion means to the client;
And managing so that a plurality of presentations created for the same purpose can be synchronized.

Images