JPH07175909A - Data processing device - Google Patents

Abstract

(57) [Abstract] [Purpose] To provide a data processing device and method capable of making an effective presentation by associating a document with data such as an image, a video and a sound. [Structure] In a data processing device for processing data such as a document, a figure, a video, an audio, etc., while displaying the document file on a monitor display, the figure, the video, etc. are associated with all or a part of the content of the document file. Linking voice data and the like, storing the link information, automatically presenting the document to the display means sequentially on the monitor display, and presenting the associated location in the document file based on the link information. And a presentation control means for simultaneously presenting the associated drawing / video / audio data to the monitor display.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to software that manages and edits data of composite media such as documents, drawings, images and sounds, and displays the data.

[0002]

2. Description of the Related Art In recent years, due to improvements in the CPU performance of personal computers and the increase in storage capacity of hard disks and the like, data such as video (still images, moving images) and audio that has a large data capacity and requires a high transfer rate is also available. It is becoming possible to handle. For video, M for video
Standards for image data compression, such as JPEG for PEG and still images, have also become established, and software and compression boards that comply with this standard have appeared on the market, and a large number of application software dealing with these multimedia have been released. Has been done.

Among these application software, the presentation software is mainly constructed by giving importance to the presentation.

The presentation software is for displaying data such as documents, figures, images and sounds by designating a data presentation method and order, and displaying the data in accordance with the designation. The sheet unit is basically used, and it is usual to arrange the sheets in order and specify the presentation method (effect) for each data in the sheet.

However, according to this method, the function of effectively showing how to show images and sounds is weak. Generally, there is a button for reproducing images and sounds in the sheet, and the operation is started by pressing the button. Most are examples.

[0006] On the other hand, there are softwares for editing and giving presentations centering on images (moving images / still images), but these are basically on a time unit basis, and what kind of presentation method (effect) should be performed at that time. This method is suitable as a method of creating a presentation centered on video, but since it is mainly about video, if you create it by setting in units of time However, there is a drawback that the operation becomes complicated. Therefore, it is not suitable for contents such as documents + images in general presentations.

[0007]

As described above, in the above-mentioned conventional example, there is no method for designating and effectively displaying the data such as the document, the figure, the image and the sound by the simple operation.
In general, the report and the document data for the presentation are often created separately, which causes the work to be performed twice.

Therefore, an object of the present invention is to provide an apparatus and method capable of making an effective presentation by associating a document with data such as an image, a video and a sound.

[0009]

In order to solve the above-mentioned problems, according to the present invention, in a data processing device for holding data such as a document, a drawing, a video and a sound, all or one of the contents in the document file is stored. Means for holding the figure / video / audio data, display means for displaying the data of the document / figure / video / audio, etc. in association with the part, and the document is automatically presented to the display means in order. At the same time, when presenting the associated location, a configuration is provided that includes presentation control means for presenting the associated drawing / video / audio data to the display means at the same time.

Further, according to the present invention, in processing data such as a document, a figure, a video and an audio, a step of storing the figure, the video and the audio data in association with all or a part of the contents in the document file. And a step of automatically and sequentially displaying the document, and a step of simultaneously displaying the associated figure / video / audio data when the associated location of the document is displayed. To use.

[0011]

As a result, when the presentation of the document data is reproduced, the document data is sequentially displayed on the screen, and when the figure, video, and sound data are associated with each other, the associated figure and video are displayed. The sound data can be displayed at the same time as the document, and the data such as figures, images and sounds can be effectively displayed based on the document.

[0012]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS A data processing device according to the present invention will be described below.
The embodiment will be described in detail with reference to the drawings.

First, it is a block diagram showing a hardware configuration for realizing the data processing apparatus of the present invention.

FIG. 11 is a block diagram showing the hardware configuration of the data processing apparatus common to the respective embodiments of the present invention. In the figure, 101 is a central processing unit (CPU) that manages the entire system, 102 is a keyboard, 103 is an input device such as a mouse for performing various operations while looking at an operation screen displayed on a monitor display screen described later, 104 Is an image input device for inputting image data from a video camera, scanner, etc., 105 is an audio input / output device for inputting and outputting an audio signal with a microphone or speaker, 106 is a monitor display for displaying various images, character data, etc.
Reference numeral 107 denotes a printer, and reference numeral 108 denotes a hard disk drive (HDD) as an external storage device which constitutes a main storage device.

Reference numerals 109, 110 and 111 denote a floppy disk drive device and a CD as external storage devices, respectively.
-ROM device, memory card, 112 CPU 101
And I / O interface I / O between each peripheral device.

The above-mentioned devices are the bus lines 113.
And various data and control signals are exchanged under the control of the CPU, and various controls and processes are performed.

In the HDD 108 as a main storage device, a system file, document data, image data, voice data, various tables necessary for processing, etc. are formed.

Note that these tables may be loaded into the CPU 1 during various editing operations to be described later and stored after the editing and various processes are completed.

The various programs, data files, data tables, etc. may be stored in another external storage device or may be prepared in advance in the form of ROM.

Next, the processing, editing, and presentation operations in the data processing device according to the present invention will be described.

1 and 2 are conceptual views of the present invention. In the present embodiment, for simplicity of explanation, a case where the data linked to the document data is video data will be described. Of course, the basic structure is the same for sounds and figures.

The document data shown in FIG. 1 is document data used for a presentation. For example, only a summary part is cut out from the contents created for a report or the like and read into a dedicated editor. Then, link work with various video data is performed on this editor.

That is, the desired symbols of the document data displayed on the monitor display screen, in the figure, the symbols associated with the words "Taro Yamada, Presenter", "Kanto region", "Urban development", etc. The designated operation for associating image data is shown.

The designation operation for performing this link work is
Specifically, it can be performed by designating positions on the screen with a mouse or the like, and dragging and dropping symbol images corresponding to them from the image file.

The "document data + video data" edited in this manner is reproduced as shown in FIG. 2 at the time of presentation.

In the example shown in FIG. 2, when a document sequentially flows from the head to the document display window, a cursor is attached to the position currently displayed in the middle, and when the position is linked to the video data, the upper part is displayed. The image linked in FIG. 1 is displayed in the image display window.

However, various types of display designs on the display shown in FIG. 2, that is, various types of reproduction are conceivable, and are not limited to those shown in FIG. 2, and various types are set according to specifications or preferences. It is possible to

The above is the basic operation, but the specific method and processing operation will be described below in order.

FIG. 3 is a block diagram showing a software configuration of a control and processing system for realizing data processing according to the present invention. As is clear from FIG. 3, mainly a document editor section and a presentation editor are provided. Section, presentation player section, memory document data and video data associated therewith, link information map, presentation form, information table, and data storage section including various information tables such as a presentation operation table I'm running.

As shown in FIG. 2, in the document editor section 1 of the figure, a document display window for displaying a document on the monitor display, a video display window 2 for displaying a video on the monitor display, and a user operation. A link information map 3 for storing link information that links the document data linked by the above and information related to the figure, video, audio, etc., and the figure related to the document data linked by the editor. , Link information of information such as video and audio is stored as a link information map.

FIG. 4 shows the data structure of this link information map. In this link information map, the designation of the character portion that is the target of the link is represented as the portion surrounded by the symbols \ S and \ E, and the path name of the target video data is shown in the next line. As a result, it is possible to store any word or phrase in the document data in a state of being associated with other video data, and at the time of presentation, refer to this link information map to link the document with the video data. You can know the information.

Returning to FIG. 3, the presentation editor section 4 will be described. The presentation editor is
The presentation form window 5 is provided to specify the method for the screen design and display effect (how to show) on the monitor display of the presentation, and there are several typical screen designs (forms) for the presentation. , You can use it, or you can create it yourself using the tool.

In the presentation editor, how to show the video data is specified. The designated result is stored as data in the presentation form information table 6. This is shown in FIG.

In FIG. 5, the presentation form information table 6
The video data to be used and the parameters for designating the display period are described in. TO_NEXT in FIG. 5 is a designation command for continuing to output the video until the start of display of the next video data.

The next TO_INT is a designated command for displaying the linked character from the start to the end.

The next TO_10SEC is a designated command to display for 10 seconds.

In the present embodiment, as for the way of displaying when displaying the video data, only the designation of the display period is described.
Also, the presentation editor section is used to specify the effect of the presentation, such as when the images are overlapped and switched, or when the images are displayed like scrolling up from the bottom, the present invention itself. Since it is not the purpose of the above, further description will be omitted.

Next, the presentation player unit 8 shown in FIG. 3 will be described. The presentation player unit 8 reproduces various data for the above-mentioned linked presentations. The presentation player unit 8 is created by the above-mentioned presentation form information table 6 and the link information map 3. The operation at the time of reproduction is controlled by referring to the presentation operation table 9.

FIG. 6 shows this presentation operation table. The presentation operation table 9 specifies that the video data indicated by the linked path name is displayed between the count value of the number of characters indicated by the start and the count value of the number of characters indicated by the end. There is. Here, the count value of the number of characters is a count value in which characters are sequentially counted from the beginning of the document. That is, here, TO_NEXT, TO_INT, TO_ in the presentation form information table 6
A designated command such as 10SEC is converted into the number of characters.

When TO_NEXT is specified, the document of the link information map is read character by character from the beginning, and along with this, the counter is also incremented by 1 and the link position of the person following the link diagram is indicated by "\ S". Wait for you to come. And when "\ S" comes, the counter value-
The number of characters at the start is set to 2 (2 for the amount of \ S).

Then, when \ S comes next, the counter value-
Let 2 be the number of characters at the end. Further, the path name of the video data at that time is read from the link information map 3 and recorded in the presentation operation table 9. TO_NEX
FIG. 7 is a flowchart of the process when T is designated.
Shown in.

In the figure, the process is started in S1,
In S2, the contents of the link information map 3 and the presentation information table are read, and the presentation operation table 9 is opened.

In step S3, the counter for counting the number of characters in the document data from the beginning is reset, and the flags indicating the start and end of the character string in the link range are reset to reset the entire apparatus.

In S4, the document data of the link information map is read character by character, and the counter is incremented by 1 each time one step is read.

Then, in S5, the counter reaches a predetermined value,
When it is confirmed that the reading of the character is completed,
The process moves to S14 and ends the process.

If the reading of the character is not completed in S5, the process proceeds to S6, it is judged whether or not it is "\" which specifies the linked position of the read character, and it must be "\". For example, without performing special processing, the process returns to S4 to read the next character.

When the character read in S6 is "¥", the process proceeds to S7, another character is read, and the count value of the character number counter is decremented by -2 in S8.

In S9, it is determined whether or not the read character is "S". If it is not "S", no special processing is performed, the process returns to S4, the next character is read, and "S" is read. ], The contents of the flag are checked in S10.

When the content of the flag is "0" in S10, the process proceeds to S11, the count value of the counter is written as the start position of the link designated range, the flag is set to "1", and the process returns to S4. Read next character.

When the content of the flag is "1" in S10, the process proceeds to 12 and the count value of the counter is written as the end position of the link specified range, the flag is set to "1", and the process proceeds to S13. , The path name of the video data is read from the link information map 3 and stored in the presentation operation table 9 as the path name.
Return to step 4 and read the next character.

By repeating the above processing,
Each time “¥ S” comes, the path name of the corresponding video data can be read from the link information map 3 and recorded in the presentation operation table 9.

Similarly, TO_INT is designated as the number of characters at the start when \ S and then at the end when \ E.

In the case of TO_10SEC, 10 / (display time per character) corresponds to the number of characters in 10 seconds, so start at ¥ S, start at, and add the number of characters at 10 seconds. Is specified as the end character count.

In the presentation player unit 8 shown in FIG. 3, the number of characters to be displayed is counted with reference to the presentation operation table 9, and when the count value described in the table is reached, a predetermined value is determined. Perform operations (display and deletion of images).

Finally, the method of designation by the user will be described. FIG. 8 shows a method of designating a link with a video by using the document editor 1, and shows a design of a monitor display screen at the time of designation operation.

Simply open the document and video to be used and, while looking at the monitor display screen, select the portion to be linked in the document using the input means such as a mouse and drag and drop the video there. Complete. This information is registered in the link information map 3.

Next, the method of designation by the user in the presentation editor unit 4 will be described with reference to FIG.

In the presentation editor, the linked parts in the document are highlighted and the effect specification dialog box is displayed by double-clicking on the part. In this dialog box, specify the period to be displayed.

At this time, it is possible to specify the effect of the appearance such that the images are overlapped and switched, or the images are displayed so as to rise from the bottom to the top, but the description thereof is omitted here.

In this presentation editor, these designations are specified by the play button, return button, stop button,
It can be operated using a scroll bar, etc., and can be set up to produce an appropriate presentation effect.

As described above, as described in this embodiment, it is possible for the user to specify by a very simple operation, and by combining the document, the image, the place, and the time, not only the content but also the content can be specified. It is possible to easily create a presentation program having a visual effect.

In this embodiment, video data (still image) other than a document has been described, but a similar method can be used for a moving picture, sound, symbol, or the like.

In addition to displaying the document as characters, a method of synthesizing the voice of the document and outputting it as voice can be considered. At this time, if the corresponding document is set not to be displayed on the screen, it is possible to realize a presentation that combines audio and video data for explaining the document content of the presentation.

FIG. 10 shows a software configuration diagram at this time. In the figure, the difference from the system of FIG. 3 is that the presentation player section 8 is provided with a voice synthesizing section 10, and other configurations are similar to those of FIG.

Even in the case of outputting a document by voice as described above, the method of various designations by the user and the management of internal information are the same, and the presentation player unit 8 only needs to add a unit for performing voice synthesis processing. Can be achieved with.

[0066]

As described above, according to the data processing apparatus of the present invention, a process of linking data such as video / sound to the document at a specified location in the document and associating them with each other to display the document in order. When it hits the designated point with, the linked video and sound data is automatically displayed, so with a simple user-specified operation,
It is possible to realize an effective document + video / sound presentation.

Further, it is also effective in the sense that a document does not have to be duplicated for reports, presentations, etc.

As a result, when the presentation of the document data is reproduced, the document data is sequentially displayed on the screen, and the figure, video, and sound data related to the contents are displayed.
The document can be displayed at the same time as the associated location, and the data such as figures, images, and sounds can be effectively displayed based on the document.

The operation for these settings can be easily specified because only a part (or all) of the document data is linked with the data of the figure, the image and the sound.

Further, according to the present invention, since the contents of the report and the like can be used as they are as the basic document for presentation, there is an advantage that the labor of the work can be eliminated twice similarly to the above.

Also, if the reproduction of the document is output as voice using voice synthesis, there are many effects such as the creation of a more effective presentation with narration.

[Brief description of drawings]

FIG. 1 is a diagram for explaining a link operation between a document and video data.

FIG. 2 is a diagram for explaining a process at the time of playing a presentation.

FIG. 3 is a block diagram showing the configuration of the control and processing system of the data processing device of the present invention.

FIG. 4 is a diagram showing a link information map.

FIG. 5 is a diagram showing a presentation form information table.

FIG. 6 is a diagram showing a presentation operation table.

FIG. 7 is a flowchart showing processing by TO_NEXT designation.

FIG. 8 is a diagram illustrating a user designation method in a document editor.

FIG. 9 is a diagram for explaining a method of designation by a user in the presentation editor.

FIG. 10 is a block diagram showing the configuration of the control and processing system of the data processing device when outputting a document by voice.

FIG. 11 is a block diagram showing a hardware configuration for realizing the data processing device of the present invention.

 ─────────────────────────────────────────────────── ─── Continued Front Page (72) Kenji Hatori Kenji Hatori 3-30-2 Shimomaruko, Ota-ku, Tokyo Canon Inc. (72) Inventor Takashi Aizawa 3-30-2 Shimomaruko, Ota-ku, Tokyo Canon Incorporated (72) Inventor Koji Hatanaka 3-30-2 Shimomaruko, Ota-ku, Tokyo Canon Inc.

Claims (4)

[Claims] 1. A data processing device for holding data such as a document, a figure, a video, a sound, etc., in association with all or a part of contents in a document file,
A means for holding the figure / video / audio data, a display means for displaying the data of the document / figure / video / audio, etc., a document for automatically sequentially presenting the document to the display means, and the associating And a presentation control unit that simultaneously presents the associated drawing / video / audio data to the display unit when presenting the selected location. 2. The method according to claim 1, further comprising a voice presentation unit that automatically presents the document by the presentation control unit, converts the content of the document into voice by voice synthesis, and presents the voice. Characteristic data processing device. 3. A data processing method for processing data such as a document, a figure, a video, a sound, etc., which is associated with all or a part of contents in a document file.
The step of storing the figure / video / audio data, the step of automatically and sequentially displaying the document, and the step of storing the associated figure / video / audio data at the same time when the associated part of the document is displayed. A data processing method comprising the step of displaying. 4. The data processing method according to claim 3, further comprising a step of automatically displaying the document and converting the content of the document into a voice by voice synthesis for presentation.