JP2003015941A - Document data structure, storage medium, and information processing device - Google Patents

Abstract

(57) [Summary] [PROBLEMS] To enable a user to browse a desired digital information file without installing a specific operation program file in a computer in advance and preparing an environment. 1 or 2
The digital information file described above can be handled as a single document regardless of its format, thereby facilitating document management. SOLUTION: One or more digital information files 103 and 104 to be a table real object on a document, a display information file 102 for specifying a structure of the digital information files 103 and 104 and a display state on the document, and a computer And an operation program file 105 for displaying one or more digital information files 103 and 104 on a display of a computer in a display state specified and interpreted by the display information file 102, as a single document. Encapsulate.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a data structure of a document that can be viewed and managed by a computer (digital information processing device), a storage medium storing the data structure of the document, and an information processing device.

[0002]

2. Description of the Related Art In recent years, various types of documents have been created and are in widespread use as information transmission media that can be browsed using a computer (digital information processing device).
Typical formats of such documents are, for example, text, rich text, multimedia, PDF, HT.
There are ML, MHTML, XML, etc. So first,
An overview of these various types of documents, based on their development history.

[Text, Rich Text, Multimedia] Among digital (electronic) documents that can be handled by a computer (digital information processing apparatus), a typical text document expressing text by a character code, There are rich text documents in which a plurality of character fonts can be used in a text document, and multimedia documents in which figures, images, moving images, voices, etc. can be pasted.

Usually, a text document uses a character code common to general computers. Therefore, in a general computer, the operation system is generally provided with an application software called a text editor capable of browsing and editing such a text document.

When information is sent and received by electronic mail, text information can be sent and received to exchange information, and recently, electronic mail software that can send and receive a document expressed in rich text is also available. It is becoming popular.

On the other hand, a multimedia document has
Although there is no uniform format, at present, the office (product name) including Microsoft's word (product name) is widely used, so this office format is treated as if it were a standard format. It is the current situation.

However, when the office format is used for the multimedia document, the user purchases the application software called Microsoft Office, which has a document creation function, just by browsing the multimedia document. You need to install it on your computer.

[PDF] On the other hand, a PDF format developed by Adobe Systems Incorporated is known as a document format compatible with multimedia documents. This format helps reduce the user's disadvantages seen in the word format by distributing the application for browsing the document for free, while paying the application for creating the document.

[0009] However, although the financial burden on the user for viewing the document is eliminated, the user still needs to install the viewing software of Adobe Co., Ltd. in order to view the PDF document.

[HTML] On the other hand, in recent years, information has been transferred to HTML (Hyper Text Markup) due to the spread of the Internet.
It is common to describe information in a language called "Language" and convey information.

The HTML document initially spread widely as a language used in application software called a navigator developed by Netscape Co., Ltd., and contributed to the rapid spread of the Internet.

[0012] After that, Microsoft Corporation incorporated the software called Internet Explorer using the HTML language as standard in Windows (registered trademark), which is an operating system widely manufactured and sold by itself. This gives the user the impression that it is distributed free of charge, and, unlike the PDF file of Adobe, does not require the user to install the browsing software. Currently, Internet Explorer has exploded and is treated as if it were the standard format for browsing the Internet.

However, such an HTML document has a major drawback as a format for creating an ordinary document because of its occurrence. As a method of browsing documents on the Internet, when the information written in HTML is a document, the user's computer visually displays the document according to the HTML tag rule, whereas when the information is an image. Means that the information of the image does not exist in the displayed HTML information. That is, when the information is an image, only the reference destination and the layout information of the image are described in the HTML information, and the browsing software installed in the user's computer has such a description. Based on the arrangement information, the image data is downloaded from the server to the user's computer and displayed. More specifically, the current HTML document includes text information and arrangement information for laying out each information in the document, but for other images and moving images, refer to the reference destination where they are stored. Just by describing it, the actual image information and moving image information are stored in another place.

Therefore, the installer side of the HTML document is
In order to properly display an image or similar contents in a TML document, there is a complexity that an image file or the like has to be arranged at the reference destination described in the HTML information. In addition, the user who is a viewer of the HTML document needs to pay attention to the positions and names of these reference files in order to correctly handle the HTML document. Then, both the installer side and the user side of the HTML document try to save and manage such a reference file itself, which is extremely complicated.

[MHTML] In order to solve these problems, the Internet standard organization RFC defines MHTM.
The L format is a format format in which multimedia contents are stored together with HTML information. According to the MHTML format, a multimedia document including images and the like can be browsed by browsing software compatible with this standard.

However, MHTML has some problems because it extends HTML.

One of them is not to hold image data and the like as normal binary data but to hold as a character code represented by hexadecimal characters (0 to 9 and A to F). This is because the HTML file described in HTML is constructed so that the description content can be viewed with a text editor.

As another problem, since the MHTML document is stored in the same file as the layout information for displaying the image and the like, it is not possible to easily extract only the image or grasp the description content. There is also a problem.

From the above, at the present time, the document locally used in the personal computer is still a word document, and the document on the Internet is HT.
ML documents are used to separate houses.

[XML] On the other hand, in recent years, XML has been used.
A document format called (Extensible Markup Language) that connects the Internet and a local document has also been proposed.

The advantage of XML is that the user can define a portion corresponding to an HTML tag.
The fact that each software maker describes the data including the document in binary in its own format is that it is described in the text format that can be read and understood by a simple text editor using tags. However, XML defines a method of describing data, and a program for interpreting and executing the program, a program execution environment, and a computer (digital information processing device) are required for actual operation. Therefore, in order to display the document described in XML, a program therefor is required, and even when the same document described in XML is displayed, the display contents will be different if the programs are different. Similarly, a computer (digital information processing device)
The behavior also differs depending on the type of the program and the type of program execution environment.

In other words, in XML, even if the formats of data to be processed can be unified, it is not possible to unify the program and the computer (digital information processing device) for executing the formats.

[Multi-Platform Program Environment] Therefore, at present, a multi-platform program environment that is independent of the type of computer (digital information processing device), in other words, the type of operating system is proposed. Typical examples are JAVA of Sun Microsystems and NET concept of Microsoft. As a result, the document is described in the XML format, and the information described in the multi-platform language such as JAVA is processed, so that the type of computer (digital information processing device) (type of operation system)
There is an environment in which documents can be viewed, created, etc. without depending on.

In Japanese Patent Laid-Open No. 2000-353120, X
A combination of the ML format and JAVA is disclosed. The Japanese Patent Laid-Open No. 2000-353120 discloses that an XML document is read and a program described in JAVA is executed based on the read information.

Japanese Patent Application Laid-Open No. 09-134349 discloses that
It describes a data description in XML format and a document defining the program operation according to the data description.

The examples described in these publications are XML.
A program is started based on the description such as, and thereby multimedia contents and documents are displayed. In other words, the concept is to describe data using a descriptor such as XML for a combination of conventional data and an application that executes the data. As a result, data such as a document can be described in a general-purpose manner, and an application program for displaying a document or the like is created by using JAVA or the like, and a document can be browsed by this application program, so that the document can be displayed on different platforms. Can be viewed.

However, there is a problem in that there is no guarantee that it will operate normally if the application program for displaying a document is installed in a computer (digital information processing apparatus) or if the version of the application program is changed. In other words, when a certain document is desired to be stored for a long period of time, it is necessary to store an application program for displaying it, which is extremely complicated.

Furthermore, the document introduced in the above publication has another problem that a plurality of files make up the document. For this, JP-A-1
Japanese Patent Laid-Open No. 1-143906 discloses storing a plurality of WEB page files in a book format, which is apparently displayed in a book-like format. The contents are not managed as one file.

[0029]

At present, electronic documents represented by digital information have become widespread due to the development of computers and the spread of the Internet. In order to create, edit, save, browse, etc. such an electronic document, the following conditions are required. 1. Hardware (computer) that actually executes processing 1. Operation system (OS) that causes a computer to perform processing 3. Software (application software) for reading and displaying document information, editing, etc. 4. Document information (data file) in which document contents are expressed in a defined digital expression, that is, an electronic document cannot be browsed unless these four conditions are met. Of these four conditions, an operating system such as Windows is installed in the computer, and the computer and the operating system have a one-to-one relationship. Therefore, the user installs a typical application program suitable for the computer and operating system on the computer, and creates and browses documents.

Therefore, when creating, editing, saving, browsing, etc. of electronic documents, compatibility between the computer and operating system and the application programs is important. In other words, when trying to browse a certain document, if the viewer has not installed an application program that is the same as or compatible with the application program used by the creator of the document on his / her computer, he / she can browse the document. Is impossible. In this case, even if a document is created and browsed by the same application program, browsing may not be performed normally if the versions are different. Because of this, handling of electronic documents is extremely inconvenient.

Next, as the document format of the electronic document, as described above, text, rich text, PDF, HT
While there are various formats such as ML, MHTML, XML, etc.
It is no exaggeration to say that it is roughly divided into Microsoft office documents and WEB documents viewed with a WEB browser. However, the office document of Microsoft Corporation has a problem that an office application for browsing the document is required. Also, the WEB document is
Since it is a document specialized for the Internet, there is a problem that a single document is composed of multiple files and management is complicated due to the structure in which multiple files existing on the server are called by a browser and displayed. .

Furthermore, in recent years, due to the rapid spread of computers, especially personal computers, and the improvement of their processing capabilities, digital documents handle not only conventional character representations (texts) but also still images, moving images, and voices. Is becoming possible. Therefore, in a personal computer, it is possible to create and view a document form that mixes a plurality of media in which the document form cultivated in the conventional type document and the image cultivated in radio and television are fused. Has become. Documents of such a form have been distributed and distributed through a global network represented by the Internet today. Such digital documents are
Generally called a multimedia document.

Here, since the multimedia document includes a plurality of media, a plurality of application programs are required for viewing and reproducing the media. In other words, in order to browse and play multimedia documents, 1. Application program required for browsing 2. The same creation and viewing environment is required between the creator and the viewer. Multiple files needed to represent a single document 4. There are many problems such as the need to store an application program for browsing in order to browse the stored past documents. Therefore, it is difficult for general users to handle multimedia documents.

An object of the present invention is to make it possible to browse a desired digital information file without installing a specific operation program file in a computer in advance and preparing the environment.

An object of the present invention is to enable one or more digital information files to be handled as a single document regardless of the format, thereby facilitating document management. Is.

[0036]

The invention of a data structure of a document according to claim 1 is a representation entity on the document 1 or 2
The digital information file described above, the display information file that specifies the structure of the digital information file and the display state on the document, the display state that is interpreted and executed by a computer, and is specified based on the display information file An operation program file for displaying one or more digital information files on the display of the computer; and encapsulation means for encapsulating the digital information file, the display information file, and the operation program file as a single document. , Are provided.

Therefore, when the operation program file is interpreted and executed by the computer, one or more digital information files are displayed on the display of the computer according to the display state specified by the display information file. Since the digital information file, the display information file, and the operation program file are encapsulated as a single document by the encapsulating means, if the operation program file is interpreted and executed by the computer, the digital information file can be viewed. Therefore, it is not necessary to separately install only the operation program file on the computer in advance. That is, in order to browse a certain digital information file, it is necessary to install an operation program file suitable for the digital information file in the computer, but in the present invention, since such an operation program file is encapsulated together with the digital information file, It is sufficient for the operating program file to be interpreted and executed by a computer when browsing the digital information file, from the time when it is unknown whether to browse such digital information file or before obtaining such digital information file. It is possible to relieve the user from the complexity of having to pre-install only the operation program file in the computer separately from the digital information file to be browsed. Moreover,
Since the digital information file, the display information file, and the operation program file are encapsulated as a single document by the encapsulating means, their handling and management are extremely easy.

According to a second aspect of the present invention, in the data structure of the document according to the first aspect, the encapsulation means takes in the digital information file, the display information file and the operation program file as a single file. It is realized by the structure.

Therefore, since the digital information file, the display information file, and the operation program file are constructed as a single file, their handling and management become easier.

According to a third aspect of the present invention, in the data structure of the document according to the first or second aspect, the operation program file is generated by the computer according to an access operation to the document by the computer. It includes a startup program that interprets, executes, and starts up.

Therefore, when an access operation to a document is performed, the operating program file is interpreted and executed by the computer by the startup program, and 1 or 2 is set according to the display state specified by the display information file.
The above digital information file is displayed on the computer display.

According to a fourth aspect of the present invention, in the data structure of the document according to the third aspect, the document relates to an icon displayed on the display of the computer so as to be selectable in correspondence with the actual data of the document. The computer includes an icon file, and the activation unit determines that the instruction to select the icon is an operation of accessing the document by the computer.

Therefore, only by selecting and instructing the icon, the access operation to the document is performed, and the operation program file is interpreted and executed by the computer by the startup program in response to this, and 1 or 2 is selected according to the display state specified by the display information file. The above digital information file is displayed on the computer display.

The invention according to claim 5 is the invention as defined in claims 1, 2, and 3.
Or, in the data structure of the document described in 4, there is provided an archive file for storing one or more of the digital information files with an index indicating the storage position, and the operation program file stores the digital information files by the index. Identify.

Therefore, one or more digital information files are specified by the index of the archive file.

The invention according to claim 6 is the same as claims 1, 2, 3
Or, in the data structure of the document described in 4, there is provided an archive file for storing one or more digital information files to which a unique header is attached, and the operation program file specifies the digital information file by the header. To do.

Therefore, one or more digital information files are specified by the header of one or more digital information files.

The invention according to claim 7 is based on claim 1,
In the data structure of the document described in 3, 4, 5 or 6, the display information file is described in a general-purpose data description language.

Therefore, the arrangement information and the like of the digital information file is created for general purpose, the diversification of the file format, etc.
Good adaptability to various changes.

According to an eighth aspect of the present invention, in the data structure of the document according to the seventh aspect, the data description language uses tags as elements for specifying the structure of the digital information file and the display state on the document. Is a language to describe.

Therefore, the tag describes the structure of the digital information file and the display state on the document. As a result, the display information file is structured and the reconstruction thereof becomes easy.

According to a ninth aspect of the invention, in the data structure of the document according to the eighth aspect, the operation program file corresponds to a file format specified by the display information file described by using the tag. It is provided.

Therefore, the file format of the display information file is specified by the tag. As a result, the display information file is structured and the reconstruction thereof becomes easy.

The invention described in claim 10 is the invention as defined in claims 1, 2 and
In the data structure of the document described in 3, 4, 5, 6, 7, 8 or 9, the operation program file is provided with a portion necessary for processing the digital information file as a minimum unit.

Therefore, the capacity required for the operation program file can be reduced.

The invention described in claim 11 is,
In the data structure of the document described in 3, 4, 5, 6, 7, 8, 9 or 10, the operation program file is a digital information display program for making the digital information file viewable on the display of the computer. And a function operation program file for executing a specific function without referring to the digital information.

Therefore, the function operation program file enables execution of a specific function and enables more diverse information expression.

According to a twelfth aspect of the present invention, in the data structure of the document according to the eleventh aspect, the digital information display program includes a file specifying panel for selectively displaying file specifying information for specifying the digital information file. It has a function of displaying and a function of making it possible to browse the digital information file corresponding to the file specific information selected on the display of the computer.

Therefore, when the file specifying information displayed on the file specifying panel is selected, the digital information file specified by the file specifying information is selected, and the file information can be viewed on the display. Become.

According to a thirteenth aspect of the present invention, in the data structure of the document according to the eleventh aspect, the function operation program file has a function of displaying a function panel for selectively displaying the function specifying information for specifying a predetermined function. And a function for executing the predetermined function corresponding to the case where the function specifying information is selected.

Therefore, the display of the function panel indicates that the document contains a special function. When the function specifying information is selected by the operation on the function panel, the function specified by the function specifying information is executed.

According to a fourteenth aspect of the present invention, in the data structure of the document according to the eleventh aspect, the digital information display program has a function of enlarging / reducing a display image based on the digital information file.

Therefore, the display image based on the digital information file can be enlarged or reduced.

According to a fifteenth aspect of the present invention, in the data structure of the document according to the eleventh aspect, the digital information display program has a viewpoint changing function when the display image based on the digital information file is a stereoscopic image. To have.

Therefore, the viewpoint of the stereoscopic image, which is the display image based on the digital information file, can be changed.

According to a sixteenth aspect of the invention, in the data structure of the document according to the eleventh aspect, the digital information display program selects a still image when the display image based on the digital information file is a moving image. It has a function of displaying in the document as much as possible and a function of reproducing the moving image when the still image is selected.

Therefore, the moving image which is a display image based on the digital information file is displayed as a still image, and the original moving image is reproduced by selecting the still image.

According to a seventeenth aspect of the invention, in the data structure of the document according to the eleventh aspect, the digital information display program can instruct the reproduction of the voice information when the digital information file includes the voice information. And a function of displaying the audio information when the reproduction panel issues an instruction to reproduce the audio information.

Therefore, the audio information contained in the digital information file is reproduced according to the operation on the reproduction panel.

According to the eighteenth aspect of the present invention, in the data structure of the document according to the seventeenth aspect, the digital information display program corresponds to the voice information when a reproduction instruction of the voice information is issued by the reproduction panel. It has a function to display text information.

Therefore, in response to the reproduction of the voice information included in the digital information file, the text information corresponding to the voice information is displayed.

The storage medium according to claim 19 is one or more digital information files that are the representation entities on the document, and a display information file that specifies the structure of the digital information file and the display state on the document. An operation program file which is interpreted and executed by a computer and causes the display of the computer to display the one or more digital information files in a display state specified based on the display information file; and the digital information file. A data structure of a document is stored that includes an encapsulation unit that encapsulates the display information file and the operation program file as a single document.

Therefore, when the operation program file is interpreted and executed by the computer, one or more digital information files are displayed on the display of the computer according to the display state specified by the display information file. Since the digital information file, the display information file, and the operation program file are encapsulated as a single document by the encapsulating means, if the operation program file is interpreted and executed by the computer, the digital information file can be viewed. Therefore, it is not necessary to separately install only the operation program file on the computer in advance. That is, in order to browse a certain digital information file, it is necessary to install an operation program file suitable for the digital information file in the computer, but in the present invention, since such an operation program file is encapsulated together with the digital information file, It is sufficient for the operating program file to be interpreted and executed by a computer when browsing the digital information file, from the time when it is unknown whether to browse such digital information file or before obtaining such digital information file. It is possible to relieve the user from the complexity of having to pre-install only the operation program file in the computer separately from the digital information file to be browsed. Moreover,
Since the digital information file, the display information file, and the operation program file are encapsulated as a single document by the encapsulating means, their handling and management are extremely easy.

According to a twentieth aspect of the present invention, in the storage medium according to the nineteenth aspect, the encapsulation means takes in the digital information file, the display information file, and the operation program file as a single file. Is realized by.

Therefore, since the digital information file, the display information file, and the operation program file are constructed as a single file, their handling and management become easier.

According to a twenty-first aspect of the present invention, in the storage medium according to the nineteenth or twentieth aspect, the operation program file is interpreted by the computer in response to an access operation to the document by the computer. It includes a startup program that runs and starts.

Therefore, when the access operation to the document is performed, the operating program file is interpreted and executed by the computer by the startup program, and 1 or 2 is set according to the display state specified by the display information file.
The above digital information file is displayed on the computer display.

According to a twenty-second aspect of the present invention, in the storage medium according to the twenty-first aspect, the document is an icon file relating to icons which are selectably instructable to be displayed on the display of the computer in correspondence with actual data of the document. The activation means determines that the instruction to select the icon is an operation of accessing the document by the computer.

Therefore, an access operation to a document is performed only by selecting an icon, and the operation program file is interpreted and executed by the computer by the startup program, and 1 or 2 is selected according to the display state specified by the display information file. The above digital information file is displayed on the computer display.

The invention described in claim 23 is,
The storage medium described in 0, 21 or 22 is provided with an archive file that stores one or more digital information files with an index indicating the storage location, and the operation program file is the digital information file according to the index. Specify.

Therefore, one or more digital information files are specified by the index of the archive file.

The invention of claim 24 is the same as claims 19 and 2.
The storage medium described in 0, 21 or 22 is provided with an archive file for storing one or more digital information files to which a unique header is attached, and the operation program file stores the digital information file by the header. Identify.

Therefore, one or more digital information files are specified by the header of one or more digital information files.

The invention described in claim 25 is the same as claims 19 and 2.
In the storage medium described in 0, 21, 22, 23, or 24, the display information file is described in a general-purpose data description language.

Therefore, the arrangement information and the like of the digital information file is created for general purpose, and the diversification of the file format, etc.
Good adaptability to various changes.

According to a twenty-sixth aspect of the present invention, in the storage medium according to the twenty-fifth aspect, the data description language describes an element for specifying a structure of the digital information file and a display state on the document by using a tag. Is the language to be used.

Therefore, the tag describes the structure of the digital information file and the display state on the document. As a result, the display information file is structured and the reconstruction thereof becomes easy.

According to a twenty-seventh aspect of the present invention, in the storage medium according to the twenty-sixth aspect, the operation program file is
It is provided so as to correspond to the file format specified by the display information file described using the tag.

Therefore, the file format of the display information file is specified by the tag. As a result, the display information file is structured and the reconstruction thereof becomes easy.

The invention according to claim 28 is the invention according to claims 19 and 2.
In the storage medium described in 0, 21, 22, 23, 24, 25, 26 or 27, the operation program file is
The minimum unit is provided for processing the digital information file.

Therefore, the capacity required for the operation program file can be reduced.

The invention described in claim 29 is claim 1
9, 20, 21, 22, 23, 24, 25, 26, 27
28. In the storage medium according to item 28, the operation program file executes a digital information display program for making the digital information file viewable on the display of the computer and a specific function without referring to the digital information. And a function operation program file for executing.

Therefore, the function operation program file enables the execution of a specific function and enables more diverse information expression.

According to a thirtieth aspect of the present invention, in the storage medium according to the twenty-ninth aspect, the digital information display program displays a file specifying panel for selectively displaying file specifying information for specifying the digital information file. It has a function and a function of making the corresponding digital information file viewable on the display of the computer when the file specifying information is selected.

Therefore, when the file specifying information displayed on the file specifying panel is selected, the digital information file specified by this file specifying information is selected, and the file information can be viewed on the display. Become.

According to a thirty-first aspect of the present invention, in the storage medium according to the twenty-ninth aspect, the function operation program file has a function of displaying a function panel for selectively displaying function specifying information for specifying a predetermined function, A function of executing the predetermined function corresponding to the selection of the function specifying information.

Therefore, the display of the function panel shows that the document contains a special function. When the function specifying information is selected by the operation on the function panel, the function specified by the function specifying information is executed.

According to a thirty-second aspect of the present invention, in the storage medium according to the twenty-ninth aspect, the digital information display program has a function of enlarging / reducing a display image based on the digital information file.

Therefore, the display image based on the digital information file can be enlarged or reduced.

According to a thirty-third aspect of the present invention, in the storage medium according to the twenty-ninth aspect, the digital information display program has a viewpoint changing function when a display image based on the digital information file is a stereoscopic image. .

Therefore, the viewpoint of the stereoscopic image, which is the display image based on the digital information file, can be changed.

According to a thirty-fourth aspect of the present invention, in the storage medium according to the twenty-ninth aspect, the digital information display program can select a still image when the display image based on the digital information file is a moving image. It has a function of displaying in the document and a function of reproducing the moving image when the still image is selected.

Therefore, the moving image which is a display image based on the digital information file is displayed as a still image, and the original moving image is reproduced by selecting the still image.

According to a thirty-fifth aspect of the present invention, in the storage medium according to the twenty-ninth aspect, when the digital information file contains audio information, the digital information display program can instruct reproduction of the audio information. It is provided with a function of displaying a reproduction panel and a function of reproducing the audio information when an instruction to reproduce the audio information is given by the reproduction panel.

Therefore, the audio information contained in the digital information file is reproduced according to the operation on the reproduction panel.

According to a thirty-sixth aspect of the present invention, in the storage medium according to the thirty-fifth aspect, the digital information display program is text information corresponding to the audio information when the reproduction instruction of the audio information is issued by the reproduction panel. It has a function to display.

Therefore, according to the reproduction of the voice information included in the digital information file, the text information corresponding to the voice information is displayed.

The invention of the information processing apparatus according to claim 37,
A computer and a data structure of a document that can be browsed by the computer, wherein the data structure of the document is one or more digital information files that are representational entities on the document, the structure of the digital information file, and the document. A display information file for specifying the above-mentioned display state, and the one or more digital information files are displayed on the display of the computer in a display state which is interpreted and executed by the computer and is specified based on the display information file. An operation program file to be displayed, and encapsulation means for encapsulating the digital information file, the display information file, and the operation program file as a single document.

Therefore, when the operation program file is interpreted and executed by the computer, one or more digital information files are displayed on the display of the computer according to the display state specified by the display information file. Since the digital information file, the display information file, and the operation program file are encapsulated as a single document by the encapsulating means, if the operation program file is interpreted and executed by the computer, the digital information file can be viewed. Therefore, it is not necessary to separately install only the operation program file on the computer in advance. That is, in order to browse a certain digital information file, it is necessary to install an operation program file suitable for the digital information file in the computer, but in the present invention, since such an operation program file is encapsulated together with the digital information file, It is sufficient for the operating program file to be interpreted and executed by a computer when browsing the digital information file, from the time when it is unknown whether to browse such digital information file or before obtaining such digital information file. It is possible to relieve the user from the complexity of having to pre-install only the operation program file in the computer separately from the digital information file to be browsed. Moreover,
Since the digital information file, the display information file, and the operation program file are encapsulated as a single document by the encapsulating means, their handling and management are extremely easy.

According to a thirty-eighth aspect of the present invention, in the information processing apparatus according to the thirty-seventh aspect, the encapsulation means takes in the digital information file, the display information file and the operation program file as a single file. It is realized by the structure.

Therefore, since the digital information file, the display information file, and the operation program file are constructed as a single file, their handling and management become easier.

According to a thirty-ninth aspect of the present invention, in the information processing apparatus according to the thirty-seventh aspect or the thirty-eighth aspect, the operation program file is interpreted by the computer according to an access operation to the document by the computer. , Including a startup program to execute and start.

Therefore, when an access operation to a document is performed, the operating program file is interpreted and executed by the computer by the startup program, and 1 or 2 is set according to the display state specified by the display information file.
The above digital information file is displayed on the computer display.

The invention according to claim 40 is the information processing apparatus according to claim 39, wherein the document is an icon relating to an icon that is selectably instructable to be displayed on the display of the computer in correspondence with the actual data of the document. A file is provided, and the activation means determines that the instruction to select the icon is an operation of accessing the document by the computer.

Therefore, an access operation to a document is performed only by selecting an icon, and in response to this, the operating program file is interpreted and executed by the computer by the startup program, and 1 or 2 depending on the display state specified by the display information file. The above digital information file is displayed on the computer display.

[0116] The invention described in Item 41 is defined by Items 37, 3
The information processing apparatus according to claim 8, 39 or 40, further comprising an archive file for storing one or more of the digital information files with an index indicating a storage position thereof,
The operation program file identifies the digital information file by the index.

Therefore, one or more digital information files are specified by the index of the archive file.

The invention as defined in claim 42 is based on claim 37, 3
The information processing device according to 8, 39 or 40 further comprises an archive file for storing one or more digital information files to which a unique header is attached, and the operation program file includes the digital information file according to the header. Specify.

Therefore, one or more digital information files are specified by the header of one or more digital information files.

The invention of claim 43 is the same as claims 37, 3
In the information processing device described in 8, 39, 40, 41 or 42, the display information file is described in a general-purpose data description language.

Therefore, the arrangement information and the like of the digital information file is created for general purpose, the diversification of the file format, etc.
Good adaptability to various changes.

According to a forty-fourth aspect of the present invention, in the information processing apparatus according to the forty-third aspect, the data description language uses a tag for an element that specifies the structure of the digital information file and the display state on the document. The language to describe.

Therefore, the tag describes the structure of the digital information file and the display state on the document. As a result, the display information file is structured and the reconstruction thereof becomes easy.

According to a forty-fifth aspect of the present invention, in the information processing apparatus according to the forty-fourth aspect, the operation program file is provided corresponding to a file format specified by the display information file described by using the tag. Has been.

Therefore, the file format of the display information file is specified by the tag. As a result, the display information file is structured and the reconstruction thereof becomes easy.

The invention as defined in claim 46 is based on claim 37, 3
In the information processing device described in 8, 39, 40, 41, 42, 43, 44 or 45, the operation program file is provided with a portion necessary for processing the digital information file as a minimum unit.

Therefore, the capacity required for the operation program file can be reduced.

The invention of claim 47 is the same as claims 37, 3
8, 39, 40, 41, 42, 43, 44, 45 or 4
6. In the information processing device according to 6, the operation program file executes a digital information display program for making the digital information file viewable on the display of the computer and a specific function without referring to the digital information. And a function operation program file for executing.

Therefore, the function operation program file enables the execution of a specific function and enables more diverse information expression.

According to a forty-eighth aspect of the present invention, in the information processing apparatus according to the forty-seventh aspect, the digital information display program displays a file specifying panel for selectively displaying file specifying information for specifying the digital information file. And a function of making the digital information file corresponding to the file specific information selectable on the display of the computer.

Therefore, when the file specifying information displayed on the file specifying panel is selected, the digital information file specified by the file specifying information is selected, and the file information can be viewed on the display. Become.

According to a 49th aspect of the present invention, in the information processing apparatus according to the 47th aspect, the function operation program file has a function of displaying a function panel for selectively displaying function specifying information for specifying a predetermined function. , A function of executing the predetermined function corresponding to the case where the function specifying information is selected.

Therefore, the display of the function panel shows that the document contains a special function. When the function specifying information is selected by the operation on the function panel, the function specified by the function specifying information is executed.

According to a fiftieth aspect of the present invention, in the information processing apparatus according to the forty-seventh aspect, the digital information display program has a scaling function of a display image based on the digital information file.

Therefore, the display image based on the digital information file can be enlarged or reduced.

According to a fifty-first aspect of the present invention, in the information processing apparatus according to the forty-seventh aspect, the digital information display program has a viewpoint changing function when a display image based on the digital information file is a stereoscopic image. To do.

Therefore, the viewpoint of the stereoscopic image which is the display image based on the digital information file can be changed.

According to a fifty-second aspect of the present invention, in the information processing apparatus according to the forty-seventh aspect, the digital information display program can select a still image when the display image based on the digital information file is a moving image. And a function of displaying the moving image when the still image is selected.

Therefore, the moving image which is a display image based on the digital information file is displayed as a still image, and the original moving image is reproduced by selecting the still image.

The invention described in Item 53 is the information processing apparatus according to Item 47, wherein the digital information display program can instruct reproduction of the audio information when the digital information file includes audio information. And a function of displaying the audio information when the reproduction panel issues an instruction to reproduce the audio information.

Therefore, the audio information contained in the digital information file is reproduced according to the operation on the reproduction panel.

According to a 54th aspect of the present invention, in the information processing apparatus according to the 53rd aspect, the digital information display program is a text corresponding to the voice information when a reproduction instruction of the voice information is issued by the reproduction panel. It has the function of displaying information.

Therefore, according to the reproduction of the voice information included in the digital information file, the text information corresponding to the voice information is displayed.

[0144]

BEST MODE FOR CARRYING OUT THE INVENTION An embodiment of the present invention will be described with reference to the drawings.

[Data Structure of Document (Encapsulated Document)]
FIG. 1 is a schematic diagram showing a data structure of an encapsulated document which is an encapsulated document.

As shown in FIG. 1, the encapsulated document 101 is a document arrangement information 102 as a display information file showing a display state such as the structure and arrangement of the entire document, and a digital information file showing a text content in the document. Text information 103, other media information 104 as a digital information file representing a still image or a moving image, and a program 105 as a plurality of operation program files for displaying document contents and detecting user operations. Has been done. Each of these pieces of information has a structure of an individual file unit that can be managed by a general personal computer operating system.

Such an encapsulated document 101 is a magnetic storage medium such as a floppy (registered trademark) disk, a hard disk, a magnetic tape, a CD or a CD-RO.
M, CD-R, CD-RW, DVD-ROM, DVD-
It can be stored in various storage media such as an optical storage medium such as RAM, and can be easily carried depending on the type of storage medium. Also, the encapsulated document 101
Can be transmitted via various communication lines such as RAN and the Internet.

FIG. 2 is a schematic diagram showing an example of the data structure of the archive file, and FIG. 3 is a schematic diagram showing an example of another data structure of the archive file.

Each of the files 102, 103, 104 and 105 that form the encapsulated document 101 is stored in one file called an archive file 201, as shown in FIGS. 2 and 3. As a result, the document arrangement information 10
2 (display information file), text information 103 (digital information file), media information 104 (digital information file), and program 105 (operation program file) are encapsulated as a single document. Has been done. Such an archive file 2
The 01 file format generally includes the ZIP format and the LHA format, and these techniques may be used.

Here, the archive file 201 has a file structure for storing a plurality of files 102, 103, 104, 105 as one file (archive file 201). Such an archive file 201 uses a archiver program having a storage function and a decompression function, so that a plurality of files 1 can be stored according to a user's request.
02, 103, 104, and 105 can be handled as one file (archive file 201).

In the archive file 201 illustrated in FIG. 2,
Each file 102, 10 is added to the archive file 201 that stores a plurality of files 102, 103, 104, 105.
Index information indicating which positions in the archive file 201, 3, 104 and 105 are located is added. As a result, it becomes possible to search the positions of the files 102, 103, 104 and 105. In addition, as another embodiment,
Like the archive file 201 illustrated in FIG. 3, the header information is added to each of the files 102, 103, 104, and 105, and the file 102, 10
It is also possible to adopt a method that enables position retrieval of 3, 104, and 105.

As described above, the file structure of the encapsulated document 101 has a plurality of files 102, 103, 104, 10 as shown in FIG.
5 is an index (see FIG. 2) or header (see FIG. 3)
It is an archive file format managed by. In this way, the encapsulated document 101 becomes a plurality of files 102, 103, 1
Since 04 and 105 are encapsulated as one archive file 201, the user can apparently manage and store a plurality of files 102, 103, 104 and 105 as one document.

FIG. 4 is a schematic diagram showing the data structure of a program stored in the encapsulated document 101, and FIG. 5 is a schematic diagram showing the data structure of a display information file that defines information about the extended program included in the program. Is.

The program 105, which is a plurality of operation program files stored in the encapsulated document 101.
Is composed of a basic program 111 and an extension program 112, as shown in FIG.

The basic program 111 is a program that can be called when the encapsulated document 101 is activated, and only one program is common to all encapsulated documents 101. This basic program 111
Includes a startup program (not shown), which is interpreted by the personal computer 301 in response to access to the encapsulated document 101 by the personal computer 301.
It is executed and started.

The extension program 112 is a program added according to the contents included in the encapsulated document 101, and is prepared according to the type of display medium, for example, as shown in FIG. As an example, when the digital information file included in the encapsulated document 101 is only the text information 103, the basic program 111
In addition to the Text P of the extension program 112
The annel program 112a is stored in the encapsulated document 101. When the media information 104, which is a digital information file representing a still image or a moving image, is included in the encapsulated document 101, in addition to the basic program 111, I
image Panel program 112b, Movei
The Panel program 112c and the 3D Panel program 112d are stored in the encapsulated document 101. The basic program 111 includes a startup program (not shown), and the personal computer 301
When the encapsulated document 101 is accessed by the user, or when necessary, the personal computer 301 interprets, executes, and activates.

Here, FIG. 5 shows an example of the extension program reference file 113, and the extension program reference file 113 defines the extension program 112, the tag 114 and the operation 115 corresponding to the extension program 112. Such an extended program reference file 113 is stored in the encapsulated document 101 as the program 105.

Next, the document arrangement information 102 will be described. The document arrangement information 102 is a file that describes the arrangement, display size, files of each medium, etc. of each medium of the encapsulated document 101. In the present embodiment, the description of these pieces of information is described in a general-purpose XML format.

FIG. 6 is a schematic diagram showing an example of the encapsulated document 101 described in XML. XML is
As shown in FIG. 6, an example thereof is a file format in which each element is described by a tag, and a document is described by a collection of elements called tags. In this case, it is possible to have a nested structure in which tags are described in tags.
It is also possible to add attributes to each tag by what is called an attribute that represents the attributes of the tag.

FIG. 7 is a schematic diagram showing a display example of the encapsulated document 101 described in XML as shown in FIG. Encapsulated document 101 as shown in FIG.
Is displayed based on the XML description illustrated in FIG. First, a tag <Document> representing the entire document is described, and the document structure is described in this tag. Then, to describe the title first, <TEXT
The display content when the tag> is used displays the content in the tag when the attribute is omitted.
The following TEXT tag example shows the text information as "Body.TX.
This is an example of reading from a file called "T". Next IMA
The GE tag is a still image called "image.JPG" in X, Y
The layout information is such that the coordinates are displayed in the size designated by WIDTH and HIGH from the starting point.

As described above, the document layout information 102 is the XM
The L format is used to instruct a file and an arrangement.

The document layout information 102 has been described by taking the XML format as an example, but other description languages such as the HTML format may be used, or a unique description format may be used.

Then, the remaining still image, moving image, 3D
The media information 104 representing images, audio information, etc. may be a general-purpose file format, or may be a unique format in the case of special specifications.

As described above, the file structure of the encapsulated document 101 has a plurality of document arrangement information 102 representing the structure of the entire document and a plurality of text information files and image files displayed corresponding to the document arrangement information 102. Media files (text information 103 and media information 104)
And a plurality of programs 105 group.

[Browsing of Encapsulated Document 101, etc.] Here, the basic operation of the encapsulated document 101 from the document activation to the document browsing will be described. Therefore,
For comparison with the encapsulated document 101, the operation of a general personal computer and the conventional document browsing operation will be described.

FIG. 8 is a hardware configuration diagram of a general personal computer 301 (computer).
The personal computer 301 is a CP that processes information.
U302, ROM303 and RAM3 for storing information
04, etc., a primary storage device 305, a secondary storage device 307 such as an HDD 306 (hard disk drive) for storing processing results, etc., and a removable medium 308 such as a CD-ROM for storing, distributing, and obtaining information outside. A network 309 for transmitting information by communication with other external computers, a display 310 for displaying the progress and results of processing to the operator, a keyboard 311 for the operator to input commands and information to the personal computer 301. And a mouse 312 and the like, and transmits / receives data transmitted / received between these units to / from the bus controller 31.
3 is arbitrating and operating.

Generally, a personal computer 301
Then, when the user turns on the power, the CPU 302 causes the ROM
Start the program called loader in 303 and
A program called an operating system, which manages computer hardware and software, is loaded into the RAM 304 from D306, and this operating system is activated. Such an operating system starts a program, reads information, and saves it according to a user's operation. A typical operating system is Windows
s (registered trademark), UNIX (registered trademark) and the like are known. Programs running on these operating systems are called applications.

FIG. 9 is a flowchart showing the flow of a conventional document browsing process using the personal computer 301. As a conventional document browsing process, as shown in FIG. 9, an application program for document browsing is activated (step S101), and a document file conforming to the format of this application program is read from the activated application program (step S101).
102), which is displayed (step S103). In addition, such processing has a mechanism in which when a user selects and starts (for example, double-clicks) a document file with the mouse 312 or the like, an application program associated with the selected document file is started. Is common. In other words, the conventional document file browsing processing method in the personal computer 301 is to read the document data from the application program. Therefore, in order to display and edit the document included in the document file, the application program corresponding to the document is indispensable.

FIG. 10 shows a personal computer 301.
7 is a flowchart showing a flow of a document browsing process of the encapsulated document 101 using the. In the present embodiment, such a personal computer 301 and the encapsulated document 1
An information processing device is configured by 01 and.

The encapsulated document 101 is the text information 1
03 and media information 104, an icon file relating to an icon (not shown) for displaying on the personal computer 301 an icon corresponding to the actual data thereof is included. Therefore, since an icon according to this icon file is displayed on the personal computer 301, when the user selects and activates (double-clicks) the icon corresponding to the substance data of the encapsulated document 101 with the mouse 312 or the like, the encapsulated document is displayed. The basic program 111 stored in the archive format as the archive file 201 in 101 is activated (step S20).
1). After starting, the basic program 111 creates a display window for displaying a document (step S
202). Then, the basic program 111 is the document layout information 10 in the archive file 201 described in XML or the like.
2 is read (step S203).

The basic program 111 is the document layout information 1
After reading 02, the tag structure is analyzed (step S2
04), the extension program 112 corresponding to the tag name as illustrated in FIG.
The attribute described in 02 is passed to each extension program 112 (step S205). Basic program 1
The processing unit 11 performs such processing until the processing is completed for all tags in the document arrangement information 102 stored in the encapsulated document 101 (step S206), whereby the plurality of extension programs 112 described in the document arrangement information 102. Is started in another thread (step S20)
5).

Each extension program 112 analyzes the attributes received from the basic program 111 (step S207), and outputs the necessary text information 103 and media information 104 according to the contents of the attributes from the archive file 201 in the encapsulated document 101. Read (step S208). Then, each extension program 112
Displays the text information 103 and the media information 104 in an area having a size corresponding to the attribute in the window created by the basic program 111 (step S209). By performing such processing, the encapsulated document 101 can display a plurality of text information 103 and media information 104 in a window secured by the basic program 111.

Further, when the expansion program 112 recognizes the occurrence of various events after such display (Y in step S210), it executes the process according to the recognized event (step S211). In this way, the encapsulated document 101 can display the document with a structure that is fundamentally different from the conventional document.

[Description Method of Program 105 Included in Encapsulated Document 101] Next, the encapsulated document 10 will be described.
The description of the program 105 included in 1 will be described.

When writing the program 105, a plurality of methods can be implemented.

The first method is to create the program 105 in the C programming language, which is currently the most popular language,
This is an example of using a native code in a format that can be directly executed by the CPU 302 by a C language compiler. In this case, the basic program 111 is executed in the execution format (Windows
In the EXE format), each extension program 112 is created in the library format (DLL format in Windows), and the document arrangement information 102, digital information files (text information 103 and media information 104) stored in the archive structure, and these The program 105 may be searched by the index or the header, and the searched program 105 may be designated as the basic program 111. However, in this method, the code of the CPU 302 is
Since it is limited to 302 types, it is not a very good method.

The second method is to use an interpreter language such as JAVA language. This is to construct a program with abstract intermediate code without using the execution code, convert the intermediate code into a native code that can be understood by the CPU 302 at the time of execution, and the CPU 302 executes the native code. By using this method, the CPU3
It is possible to use the encapsulated document 101 on a multi-platform regardless of the 02 type.

As described above, in the encapsulated document 101 of this embodiment, the basic program 111 is first activated,
The startup program reads various information from the document arrangement information 102 and operates the extension program 112 that conforms to the information.

As the extension program 112, as described above, a program corresponding to the tag type of the document arrangement information 102 described in XML or the like may be prepared and the extension program 112 may be activated. The extension program 112 may be started according to the types of various digital information files (text information 103, media information 104) from which the tag attribute information is read. For example, in FIG.
As shown in (1), there are a plurality of typical formats of moving images when displaying and reproducing moving image information. Therefore, if one expansion program 112 is created to display all of the plurality of moving images, it becomes a large program. Therefore, in FIG.
As shown in FIG. 1, a plurality of extension programs 112 are prepared according to the file format, and the encapsulated document 10
It suffices to encapsulate the extension program 112 that fits a specific type of file format in the No. 1 program.

[Extension Program 112] FIG. 12 is a schematic diagram showing types of the extension program 112. The extension program 112 is a digital information display program 1 for displaying and reproducing digital information, as illustrated in FIG.
Not only 12A but also a functional operation program 112B that provides a specific function without reading digital information. Alternatively, the digital information display program 112A and the functional operation program 112B in the extension program 112 are the auxiliary programs 1 that assist them.
It may have 12C.

Here, an example of the functions executed by the functional operation program 112B and the auxiliary program 112C will be described.

As an example, it is assumed that the document is longer than the display size of the display 310 of the personal computer 301 and extends over a plurality of pages. In this case, as illustrated in FIG. 13, a page turning button 118 as a function panel described as “next page”, for example.
Should appear on the display 310. As shown in FIG. 14, the tag <PAGE> is described in the document arrangement information 102, and the PAG corresponding to this tag is written.
The function operation program 112B is provided with the function of the extension program 112 called E Button. As a result, the function operation program 112B called PAGE Button is activated, and the page turning button 118 as shown in FIG. 13 appears in the document. When the user presses the button by a method such as clicking the mouse 312, the page turning function is provided. Provided.

Here, when the user presses the button, the extension program 112 determines the detection of an event as shown in the flowchart of FIG. 10 (step S21).
(Y of 0), the corresponding event operation is executed (step S211). The event operation here is a page turning function executed by the function operation program 112B and the auxiliary program 112C.

As another example, the function operation program 112B for displaying the function of displaying the document information such as the number of pages, the date of creation, the total number of words, etc. can be implemented.

Next, as an example of the functions executed by the extension program 112 and the auxiliary program 112C that assists the extension program 112, an example of the moving image reproduction function will be introduced.
In the moving image playback function, since the basic display portion can be used in common with any moving image file format, the basic extension program 11
2 uses the same one, but for the part that depends on the file format of the moving picture, the auxiliary program 1
There is an example of setting to 12C. For example, as shown in FIG. 15, the encoding portion of the file may be the auxiliary program 112C.

Next, a specific example of the extension program 112 will be described.

First, the function of the extension program 112 on the assumption that the encapsulated document 101 includes a plurality of digital information files (text information 103, media information 104) will be described.

The extension program 112 uses the display 3
A file specifying panel (not shown) is displayed at 10. This file specification panel is the encapsulated document 1
This is a panel listing a plurality of digital information files (text information 103, media information 104) included in 01 so that they can be selected and instructed. So, for example, mouse 31
When an arbitrary digital information file (text information 103, media information 104) is selected and instructed by a method such as clicking by 2, the extension program 112 determines event detection (see the flowchart shown in FIG. 10). In step S210, Y), the corresponding event operation is executed (step S211).

As the event operation here, the extension program 112 executes an operation of displaying the digital information file (text information 103, media information 104) selected and instructed on the display 310.

Next, the function of the extension program 112, which is premised on that the encapsulated document 101 includes a still image file as the media information 104, will be described.

As shown in FIG. 16, the extension program 11
2 displays a still image 121 in the document displayed on the display 310. The display area of the still image 121 included in the document on the display 310 is the mouse 31.
When the selection instruction is given by clicking or the like by 2, the extension program 112 determines the detection of an event (Y in step S210) and executes the corresponding event operation (step S2), as shown in the flowchart of FIG.
11).

As an event operation here, the extension program 112 creates and displays a function panel 122 which is another frame for enlargement / reduction display as shown in FIG. The function panel 122 includes an enlarge button 124 and a reduce button 125 together with an enlarged or reduced image 123 of the still image 121.
I will provide a. Therefore, when one of the buttons 124 and 125 is selected and instructed, the extension program 112 executes the enlargement rate or reduction rate change processing in response to the selection instruction.

Expansion program 112 for displaying a still image
By adding such a new function to, the user's visibility can be significantly improved as compared with simply pasting the still image 121 in the document.

The enlargement / reduction function of the extension program 112 can be realized by any well-known enlargement / reduction function.

Next, the function of the extension program 112, which is based on the premise that the stereoscopic image file is included as the media information 104 in the encapsulated document 101, will be described.

As shown in FIG. 17, the extension program 11
2 displays a stereoscopic image 131 in the document displayed on the display 310. The display area of the stereoscopic image 131 included in the document on the display 310 is the mouse 31.
When the selection instruction is given by clicking or the like by 2, the extension program 112 determines the detection of an event (Y in step S210) and executes the corresponding event operation (step S2), as shown in the flowchart of FIG.
11).

As an event operation here, the extension program 112 causes the pop-up frame 13 including the image 132 for enlarging, reducing or displaying the stereoscopic image 131 as it is.
3 is displayed, and a viewpoint changing button 134 for switching the viewpoint is arranged on the pop-up frame 133.
Then, when any of the viewpoint changing buttons 134 is selected and instructed, the extension program 112 switches the viewpoint according to the selected viewpoint changing button 134.

As a result, the visibility of the user can be improved.

Next, the function of the extension program 112, which is based on the premise that the moving picture image file is included as the media information 104 in the encapsulated document 101, will be described.

As shown in FIG. 18, the extension program 11
2 displays a still image 141 defined by one frame of a moving image in the document displayed on the display 310. Then, when the display area of the still image 141 included in the document on the display 310 is selected and instructed by clicking with the mouse 312 or the like, the extension program 11
2, as shown in the flowchart of FIG. 10, the event detection is determined (Y of step S210), and the corresponding event operation is executed (step S211).

As an event operation here, the extension program 112 causes the pop-up frame 14 including the image 142 for enlarging, reducing or displaying the still image 141 as it is.
3 is displayed, and a play button 144, a stop button 145, and a pause button 146 are displayed in the pop-up frame 143.
The operation button 147 consisting of appears. Then, when any of the buttons 144, 145, 146 included in the operation buttons 147 is instructed to be selected by a method such as clicking the mouse 312, the extension program 112 detects the event as shown in the flowchart of FIG. The determination is made (Y of step S210), and the corresponding event operation is executed (step S211).

As the event operation here, the extension program 112 reproduces the image 142 displayed as a still image as the original moving image if the selection instruction is the reproduction button 144, and the selection instruction is issued. If is the stop button 145, the reproduction of the moving image is stopped. If the selection button is the pause button 146, the reproduction of the moving image is displayed as a still image at that time.

Further, the function of the extension program 112, which is premised on that the encapsulated document 101 includes the audio information file as the media information 104, will be described.

As shown in FIG. 19, the extension program 11
2 displays a voice reproduction button 151 as a function panel and a reproduction panel in the document displayed on the display 310. When the display area of the voice reproduction button 151 included in the document on the display 310 is selected and instructed by clicking with the mouse 312 or the like, the extension program 112 determines the event detection as shown in the flowchart of FIG. (Y in step S210), the corresponding event action is executed (step S2).
11).

As an event operation here, the extension program 112 causes the read-aloud information display area 15 to be described later.
A pop-up frame 153 including 2 is displayed, and an operation button 157 including a play button 154, a stop button 155, and a pause button 156 appears on the pop-up frame 153. Then, when any one of the buttons 154, 155, 156 included in the operation button 157 is instructed to be selected by a method such as clicking the mouse 312, the extension program 112 detects the event as shown in the flowchart of FIG. The determination is made (Y in step S210), and the corresponding event action is executed (step S2).
11).

As the event operation here, the extension program 112 reproduces the voice in the voice information file included in the encapsulated document 101 if the selection instruction is the reproduction button 154, and the selection instruction is given. If is the stop button 145, the voice reproduction in the voice information file being reproduced is stopped, and if the selection instruction is the pause button 146, the voice reproduction in the voice information file being reproduced is temporarily stopped. To do.

As another function, the extension program 112, when the reproduction button 154 is selected and instructed to reproduce the sound in the sound information file, displays the visible information in which the reproduced sound is converted to text information and reads out the sound reading information. Area 1
The personal computer 301 is caused to execute the function displayed on 52. Such an operation is performed when the document is browsed by the document browsing apparatus (usually the personal computer 301).
If the speaker for audio playback of is turned off,
This is effective when a person with a hearing loss views a document. Further, such a reading function is provided by the personal computer 301.
The pop-up operation may be automatically performed based on the setting of the speaker or the like, the setting of the assisting function for persons with disabilities, and the like.

Here, the voice information file may have a data structure as voice data obtained by sampling voice, or may be text data.
In the case of text data, when the voice information file is played back, it can be played back by a method of converting the text data into voice data defined by a voice feature amount, for example, using a voice synthesis LSI. Further, when the voice information file is made up of text data, the text data can be used as it is for the text information conversion of the voice performed when the voice in the voice information file is reproduced. On the other hand, when the audio information file is composed of audio data, it is necessary to analyze the audio data and convert it into text information.

As mentioned above, the encapsulation document 10 includes many kinds of extension programs 112 according to the characteristics of various digital information to be displayed or reproduced.
It is possible to prepare for 1. Therefore, by preparing these extension programs 112 as parts of a multimedia document, it is possible to flexibly realize the extension programs 112 corresponding to various media. In this case, since only the necessary extension program 112 needs to be stored in the encapsulated document 101, handling of the encapsulated document 101 becomes extremely light.

FIG. 20 shows the structure of the extension program 112 included in the encapsulated document 101. In the encapsulated document 101 according to the present embodiment, the document arrangement information 102 is read by the basic program 111, and the document arrangement information 102 is read.
The digital information file (text information 1
03, media information 104) is started, and the started extension program 112 displays and reproduces the digital information file (text information 103, media information 104). In addition, each extension program 112 detects a user operation and performs a corresponding operation when the user operation is performed.
In this case, the digital information file (text information 10
3. In the case of the extension program 112 that does not refer to the media information 104), it simply receives a user operation and performs an operation according to the user operation.

As the user operation, it is possible to click the mouse 312 or input the keyboard 311. Mouse 312
In the case of clicking, it is sufficient to judge whether the click position of the mouse 312 is within the display occupation range of each extension program 112, and to perform the operation corresponding to the case where the mouse 312 is clicked within its own display range. Keyboard 311
In the case of input, the cursor position (not shown) that can be moved by the keyboard 311 is the extension program 11
It is only necessary to judge whether or not it is within the display occupancy range of No. 2, and to perform the operation corresponding to the case where the selection instruction is made in the own display range. For example, as shown in FIG. 21, in the case of a document displaying three pieces of digital information (PRG1, PRG2, PRG3), as an example, when the user clicks the mouse 312 in the part marked with X, the PRG2 The extension program 112 detects the click of the mouse 312 and executes the corresponding operation.

As described above, the document format of the encapsulated document 101 in this embodiment is the extension program 1 related to the type of each medium and the type of tag of the display information file.
It is composed of 12 groups, and the minimum configuration is composed of the basic program 111 and the document arrangement information 102. Then, the encapsulated document 101 prepares a digital information file (text information 103, media information 104) according to the information that the user wants to store in the encapsulated document 101, and the extension program 112 that allows the information to be reproduced and displayed. It is established by adding. Then, the encapsulated document 101 according to the present embodiment stores such various files as a single file using the archive format.

[0213]

According to the invention of the data structure of the document described in claim 1, one or more digital information files which are the representation entities on the document, the structure of the digital information file and the display state on the document. A display information file that specifies the display information file and an operation program file that is interpreted and executed by a computer and that displays the one or more digital information files on the display of the computer in a display state specified based on the display information file. ,
Since the digital information file, the display information file, and the operation program file are encapsulated by a single document, the digital information file, the display information file, and the operation program file are encapsulated by the encapsulation means. Since it is encapsulated as a single document by the computer, if the operating program file is interpreted and executed on the computer, the digital information file can be viewed, and only the operating program file must be pre-installed on the computer by itself. The user can be released from the complexity. Also,
Since the digital information file, the display information file, and the operation program file are encapsulated as a single document by the encapsulation means, the handling and management can be extremely facilitated.

The invention according to claim 2 is the data structure of the document according to claim 1, wherein the encapsulating means takes in the digital information file, the display information file and the operation program file as a single file. Since it is realized by the structure having a rectangular structure, it is possible to further facilitate the handling and management of the document including the digital information file, the display information file, and the operation program file.

According to a third aspect of the present invention, in the data structure of the document according to the first or second aspect, the operation program file is generated by the computer according to an access operation to the document by the computer. Since it includes a startup program for interpreting, executing and starting, the operation program file can be automatically executed by the computer by the access operation to the document, and therefore the operation of installing the operation program file on the computer by the document viewer is not required. In addition, the operation can be facilitated and the time required for browsing the document can be shortened.

The invention according to claim 4 relates to an icon displayed in the data structure of the document according to claim 3, wherein the document is displayed in a selectable manner on the display of the computer in correspondence with the actual data of the document. Since the activation means includes an icon file, the activation unit determines that the instruction to select the icon is an access operation to the document by the computer, and thus the access operation to the document can be performed only by instructing the selection of the icon.
A document access operation can be executed by a method similar to a general file access, and the user can be given a sense of unity in operation.

The invention as claimed in claim 5 is as follows.
Or, in the data structure of the document described in 4, there is provided an archive file for storing one or more of the digital information files with an index indicating the storage position, and the operation program file stores the digital information files by the index. Since it is specified, one or more digital information files can be specified by the index included in the archive file.

The invention according to claim 6 is the same as claims 1, 2, and 3.
Or, in the data structure of the document described in 4, there is provided an archive file for storing one or more digital information files to which a unique header is attached, and the operation program file specifies the digital information file by the header. Therefore, one or more digital information files can be specified by the headers of one or more digital information files.

The invention described in claim 7 is the same as in claim 1,
In the data structure of the document described in 3, 4, 5 or 6, since the display information file is described in a general-purpose data description language, it is possible to create the arrangement information of the digital information file in a general-purpose manner. Therefore, it is possible to improve the adaptability to various changes such as diversification of file formats.

According to an eighth aspect of the invention, in the data structure of the document according to the seventh aspect, the data description language uses tags as elements for specifying the structure of the digital information file and the display state on the document. As described above, the tag can describe the structure of the digital information file and the display state on the document by the tag. Therefore, the display information file can be structured and its reconstruction can be facilitated.

According to a ninth aspect of the present invention, in the data structure of the document according to the eighth aspect, the operation program file is associated with a file format specified by the display information file described using the tag. Since the display information file is provided, the file format of the display information file can be specified by the tag. Therefore, the display information file can be structured and its reconstruction can be facilitated.

The invention described in claim 10 is,
In the data structure of the document described in 3, 4, 5, 6, 7, 8 or 9, the operation program file is provided as a minimum unit for processing the digital information file. The capacity required as a program file can be reduced.

The invention described in claim 11 is,
In the data structure of the document described in 3, 4, 5, 6, 7, 8, 9 or 10, the operation program file is a digital information display program for making the digital information file viewable on the display of the computer. And a function operation program file for executing a specific function without referring to the digital information, the function operation program file enables the execution of a specific function, and a more diverse information expression. It can be carried out.

According to a twelfth aspect of the present invention, in the data structure of the document according to the eleventh aspect, the digital information display program includes a file specifying panel for selectively displaying file specifying information for specifying the digital information file. Since it has a function of displaying and a function of making it possible to browse the digital information file corresponding to the file specific information selected on the display of the computer, by providing the file specific panel to the user. , The user can select the digital information file that he / she wants to browse and display it on the display.
Therefore, more diverse document expressions can be provided.

According to a thirteenth aspect of the present invention, in the data structure of the document according to the eleventh aspect, the function operation program file has a function of displaying a function panel for selectively displaying function specifying information for specifying a predetermined function. And a function for executing the predetermined function corresponding to the function specifying information selected, the function specified by the function specifying information selected by the operation on the function panel is executed. Therefore, more diverse document representations can be provided.

According to a fourteenth aspect of the invention, in the data structure of the document according to the eleventh aspect, the digital information display program has a function of enlarging / reducing a display image based on the digital information file. The display image based on the display image can be scaled up and down, and thus a more diverse document representation can be provided.

According to a fifteenth aspect of the present invention, in the data structure of the document according to the eleventh aspect, the digital information display program has a viewpoint changing function when the display image based on the digital information file is a stereoscopic image. Since it is provided, it is possible to change the viewpoint of the stereoscopic image that is the display image based on the digital information file, and thus it is possible to provide a wider variety of document expressions.

According to a sixteenth aspect of the invention, in the data structure of the document according to the eleventh aspect, the digital information display program selects a still image when the display image based on the digital information file is a moving image. Since it has a function of displaying in the document as much as possible and a function of reproducing the moving image when the still image is selected, the moving image which is the display image based on the digital information file is displayed as a still image. In addition, the reproduction of the original moving image can be executed by selecting the still image, and therefore, more various document expressions can be provided.

According to a seventeenth aspect of the invention, in the data structure of the document according to the eleventh aspect, the digital information display program can instruct the reproduction of the voice information when the digital information file contains the voice information. Since it has a function of displaying a reproduction panel and a function of reproducing the audio information when the reproduction information is instructed to be reproduced by the reproduction panel, the digital information is reproduced according to the operation on the reproduction panel. The audio information contained in the file can be played back, thus providing a more diverse document representation.

According to the eighteenth aspect of the present invention, in the data structure of the document according to the seventeenth aspect, the digital information display program corresponds to the voice information when the reproduction panel issues an instruction to reproduce the voice information. Since it has a function of displaying text information, it is possible to display the text information corresponding to the audio information included in the digital information file according to the reproduction of the audio information.
Therefore, it is possible to provide a wider variety of document expressions, and in particular, it is possible to improve the hospitality for the visually impaired.

The storage medium according to claim 19 is one or more digital information files that are representation entities on a document, and a display information file that specifies the structure of the digital information file and the display state on the document. An operation program file which is interpreted and executed by a computer and causes the display of the computer to display the one or more digital information files in a display state specified based on the display information file; and the digital information file. Since the data structure of the document including the display information file and the operation program file is encapsulated as a single document, the digital information file, the display information file and the operation program file are encapsulated. As a single document by means of encryption Therefore, if the operation program file is interpreted and executed on the computer, the digital information file can be browsed, and the user is freed from the complexity of having to pre-install only the operation program file on the computer. You can Further, since the digital information file, the display information file, and the operation program file are encapsulated as a single document by the encapsulating means, it is possible to extremely easily handle and manage them.

According to a twentieth aspect of the present invention, in the storage medium according to the nineteenth aspect, the encapsulation means takes in the digital information file, the display information file and the operation program file as a single file. Since it is realized by, it is possible to further facilitate the handling and management of the document including the digital information file, the display information file, and the operation program file.

According to a twenty-first aspect of the present invention, in the storage medium according to the nineteenth or twentieth aspect, the operation program file is interpreted by the computer according to an access operation to the document by the computer. Since the start program for executing and starting is included, the operation program file can be automatically executed by the computer by the access operation to the document, and therefore the operation for installing the operation program file on the computer by the viewer of the document is unnecessary and the operation is performed. It is possible to facilitate the process and shorten the time required to browse the document.

According to a twenty-second aspect of the invention, in the storage medium according to the twenty-first aspect, the document is an icon file relating to an icon which is selectably instructable to be displayed on the display of the computer in correspondence with the actual data of the document. Since the activation means determines that the instruction to select the icon is the operation of accessing the document by the computer, the operation of accessing the document can be performed only by instructing the selection of the icon. It is possible to execute a document access operation by a method similar to that for other file access, and give the user a sense of unity in operation.

The invention described in claim 23 is the same as claims 19 and 2.
The storage medium described in 0, 21 or 22 is provided with an archive file that stores one or more digital information files with an index indicating the storage location, and the operation program file is the digital information file according to the index. Is specified, one or more digital information files can be specified by the index included in the archive file.

The invention as defined in claim 24 is defined by claim 19 and claim 2.
The storage medium described in 0, 21 or 22 is provided with an archive file for storing one or more digital information files to which a unique header is attached, and the operation program file stores the digital information file by the header. Since it is specified, one or more digital information files can be specified by the header of one or more digital information files.

[0237] The invention as set forth in claim 25 is as follows.
In the storage medium described in 0, 21, 22, 23, or 24, since the display information file is described in a general-purpose data description language, it is possible to create the arrangement information of the digital information file in a general-purpose manner. Therefore, it is possible to improve the adaptability to various changes such as diversification of file formats.

According to a twenty-sixth aspect of the present invention, in the storage medium according to the twenty-fifth aspect, the data description language describes an element for specifying a structure of the digital information file and a display state on the document by using a tag. Because it is a language
The tag can describe the structure of the digital information file and the display state on the document, and thus the display information file can be structured to facilitate its reconstruction.

According to a twenty-seventh aspect of the present invention, in the storage medium according to the twenty-sixth aspect, the operation program file is
Since it is provided corresponding to the file format specified by the display information file described using the tag, the file format of the display information file can be specified by the tag, and therefore the display information file is structured. Can be converted to facilitate the reconstruction.

[0240] The invention of claim 28 is the same as claims 19 and 2.
In the storage medium described in 0, 21, 22, 23, 24, 25, 26 or 27, the operation program file is
Since the portion required for processing the digital information file is provided as the minimum unit, the capacity required as the operation program file can be reduced.

The invention described in claim 29 is the same as claim 1.
9, 20, 21, 22, 23, 24, 25, 26, 27
28. In the storage medium according to item 28, the operation program file executes a digital information display program for making the digital information file viewable on the display of the computer and a specific function without referring to the digital information. Since it includes a function operation program file for performing the operation, a specific function can be executed by the function operation program file, and more diverse information expression can be performed.

According to a thirtieth aspect of the present invention, in the storage medium according to the twenty-ninth aspect, the digital information display program displays a file specifying panel for selectively displaying file specifying information for specifying the digital information file. By providing a file specifying panel to the user, since it has a function and a function of making the digital information file corresponding to the file specifying information selectable on the display of the computer,
The user can select the digital information file he / she desires to view and display it on the display, thus providing a more diverse document representation.

According to a thirty-first aspect of the present invention, in the storage medium according to the twenty-ninth aspect, the function operation program file has a function of displaying a function panel for selectively displaying function specifying information for specifying a predetermined function, And a function of executing the predetermined function corresponding to the selection of the function specifying information. Therefore, the function specified by the function specifying information selected by the operation on the function panel can be executed. Yes, and thus more diverse document representations can be provided.

According to a thirty-second aspect of the invention, in the storage medium according to the twenty-ninth aspect, since the digital information display program has a function of enlarging / reducing a display image based on the digital information file, display based on the digital information file is performed. Images can be scaled, and thus more diverse document representations can be provided.

According to a thirty-third aspect of the present invention, in the storage medium according to the twenty-ninth aspect, the digital information display program has a viewpoint changing function when a display image based on the digital information file is a stereoscopic image. So
It is possible to change the viewpoint of the stereoscopic image that is the display image based on the digital information file, and thus it is possible to provide a wider variety of document expressions.

According to a thirty-fourth aspect of the present invention, in the storage medium according to the twenty-ninth aspect, the digital information display program can select a still image when the display image based on the digital information file is a moving image. Since it has the function of displaying in the document and the function of reproducing the moving image when the still image is selected, the moving image which is a display image based on the digital information file is displayed as a still image. , The original video image can be played back by selecting the still image.
Therefore, more diverse document expressions can be provided.

According to a thirty-fifth aspect of the present invention, in the storage medium according to the twenty-ninth aspect, when the digital information display program contains audio information, the digital information display program can instruct reproduction of the audio information. Since it has a function of displaying a reproduction panel and a function of reproducing the audio information when the reproduction information is instructed to be reproduced by the reproduction panel, a digital information file is created in accordance with an operation on the reproduction panel. The included audio information can be played back, thus providing a wider variety of document representations.

According to a thirty-sixth aspect of the present invention, in the storage medium according to the thirty-fifth aspect, the digital information display program is text information corresponding to the audio information when the reproduction instruction of the audio information is issued by the reproduction panel. Since it has a function of displaying, the text information corresponding to the voice information included in the digital information file can be displayed according to the reproduction of the voice information, thus providing a more diverse document representation. Can, in particular,
Hospitality for the visually impaired can be improved.

The invention of the information processing apparatus according to claim 37,
A computer and a data structure of a document that can be browsed by the computer, wherein the data structure of the document is one or more digital information files that are representational entities on the document, the structure of the digital information file, and the document. A display information file for specifying the above-mentioned display state, and the one or more digital information files are displayed on the display of the computer in a display state which is interpreted and executed by the computer and is specified based on the display information file. Since the operation program file to be displayed and the encapsulation means for encapsulating the digital information file, the display information file, and the operation program file as a single document are included, the digital information file, the display information file, and the operation program File encapsulation hand Since it is encapsulated as a single document by the computer, if the operating program file is interpreted and executed on the computer, the digital information file can be viewed, and only the operating program file must be pre-installed on the computer by itself. The user can be released from the complexity. Further, since the digital information file, the display information file, and the operation program file are encapsulated as a single document by the encapsulating means, it is possible to extremely easily handle and manage them.

According to a thirty-eighth aspect of the present invention, in the information processing apparatus according to the thirty-seventh aspect, the encapsulation means takes in the digital information file, the display information file, and the operation program file as a single file. Since it is realized by the structure, it is possible to further facilitate the handling and management of the document including the digital information file, the display information file, and the operation program file.

According to a thirty-ninth aspect of the present invention, in the information processing apparatus according to the thirty-seventh aspect or the thirty-eighth aspect, the operation program file is interpreted by the computer in response to an access operation to the document by the computer. Since the operation program file is included in the computer, the operation program file can be automatically executed by the computer by the access operation to the document, and therefore the operation of installing the operation program file on the computer by the viewer of the document is unnecessary. It is possible to facilitate the operation and reduce the time required to browse the document.

[0252] The invention described in Item 40 is the information processing apparatus according to Item 39, in which the document is an icon related to an icon displayed on the display of the computer in correspondence with the actual data of the document. Since the activation means includes a file, the activation unit determines that the instruction to select the icon is an operation of accessing the document by the computer, and thus the operation of accessing the document can be performed only by instructing the selection of the icon.
A document access operation can be executed by a method similar to a general file access, and the user can be given a sense of unity in operation.

The invention described in Item 41 is defined by Items 37 and 3.
The information processing apparatus according to claim 8, 39 or 40, further comprising an archive file for storing one or more of the digital information files with an index indicating a storage position thereof,
Since the operation program file specifies the digital information file by the index, one or more digital information files can be specified by the index included in the archive file.

[0254] The invention of claim 42 is based on claims 37, 3
The information processing device according to 8, 39 or 40 further comprises an archive file for storing one or more digital information files to which a unique header is attached, and the operation program file includes the digital information file according to the header. Is specified, the one or more digital information files can be specified by the header of the one or more digital information files.

The invention of claim 43 is the same as claims 37, 3
In the information processing device described in 8, 39, 40, 41, or 42, since the display information file is described in a general-purpose data description language, it is possible to create the arrangement information of the digital information file in a general-purpose manner. Therefore, it is possible to improve the adaptability to various changes such as diversification of file formats.

According to a forty-fourth aspect of the present invention, in the information processing apparatus according to the forty-third aspect, the data description language uses tags as elements for specifying the structure of the digital information file and the display state on the document. Since it is a description language, the structure of the digital information file and the display state on the document can be described by the tag, and thus the display information file can be structured and its reconstruction can be facilitated.

According to a forty-fifth aspect of the present invention, in the information processing apparatus according to the forty-fourth aspect, the operation program file is provided corresponding to a file format specified by the display information file described by using the tag. Therefore, the file format of the display information file can be specified by the tag, and thus the display information file can be structured and its reconstruction can be facilitated.

[0258] The invention of claim 46 is the same as claims 37, 3
In the information processing device described in 8, 39, 40, 41, 42, 43, 44, or 45, since the operation program file is provided with a portion necessary for processing the digital information file as a minimum unit, The capacity required for the operation program file can be reduced.

[0259] The invention of claim 47 is based on claims 37, 3
8, 39, 40, 41, 42, 43, 44, 45 or 4
6. In the information processing device according to 6, the operation program file executes a digital information display program for making the digital information file viewable on the display of the computer and a specific function without referring to the digital information. Since it includes a function operation program file for performing the operation, a specific function can be executed by the function operation program file, and more diverse information expression can be performed.

According to a 48th aspect of the present invention, in the information processing apparatus according to the 47th aspect, the digital information display program displays a file specifying panel for selectively displaying file specifying information for specifying the digital information file. And a function of making the digital information file corresponding to the selected file identification information selectable on the display of the computer, by providing the file identification panel to the user, The user can select the digital information file he / she desires to view and display it on the display, thus providing a more diverse document representation.

According to a 49th aspect of the present invention, in the information processing apparatus according to the 47th aspect, the functional operation program file has a function of displaying a function panel for selectively displaying function specifying information for specifying a predetermined function. , And a function of executing the predetermined function corresponding to the selection of the function specifying information, so that the function specified by the function specifying information selected by the operation on the function panel is executed. Therefore, more diverse document representations can be provided.

According to a fiftieth aspect of the present invention, in the information processing apparatus according to the forty-seventh aspect, since the digital information display program has a function of enlarging / reducing a display image based on the digital information file, it is based on the digital information file. The display image can be scaled up and down, and thus a wider variety of document expressions can be provided.

According to a fifty-first aspect of the present invention, in the information processing apparatus according to the forty-seventh aspect, the digital information display program has a viewpoint changing function when a display image based on the digital information file is a stereoscopic image. Therefore, it is possible to change the viewpoint of the stereoscopic image, which is the display image based on the digital information file, and thus, it is possible to provide more various document expressions.

According to a fifty-second aspect of the invention, in the information processing apparatus of the forty-seventh aspect, the digital information display program can select a still image when the display image based on the digital information file is a moving image. Since it has a function of displaying in the document and a function of reproducing the moving image when the still image is selected,
A moving image that is a display image based on a digital information file can be displayed as a still image, and the original moving image can be reproduced by selecting the still image, thus providing a wider variety of document expressions. can do.

The invention described in Item 53 is the information processing apparatus according to Item 47, wherein the digital information display program can instruct reproduction of the audio information when the digital information file includes audio information. Since it has a function of displaying a reproduction panel and a function of reproducing the audio information when the reproduction information of the audio information is instructed by the reproduction panel, the digital information file is operated according to the operation on the reproduction panel. The audio information contained in can be played, and thus more diverse document representations can be provided.

The invention described in Item 54 is the information processing apparatus according to Item 53, wherein the digital information display program is a text corresponding to the audio information when an instruction to reproduce the audio information is given by the reproduction panel. Since the information display function is provided, the text information corresponding to the voice information included in the digital information file can be displayed according to the reproduction of the voice information, thus providing a more diverse document representation. In particular, it is possible to improve the hospitality for the visually impaired.

[Brief description of drawings]

FIG. 1 is a schematic diagram showing a data structure of an encapsulated document.

FIG. 2 is a schematic diagram showing an example of a data structure of an archive file.

FIG. 3 is a schematic diagram showing an example of another data structure of an archive file.

FIG. 4 is a schematic diagram showing a data structure of a program stored in an encapsulated document.

FIG. 5 is a schematic diagram showing a data structure of an extended program reference file included in a program.

FIG. 6 is a schematic diagram showing an example of an encapsulated document described in XML.

FIG. 7 is a schematic diagram showing a display example of an encapsulated document described in XML as shown in FIG.

FIG. 8 is a hardware configuration diagram of a personal computer (computer).

FIG. 9 is a flowchart showing the flow of a conventional document browsing process performed by a personal computer (computer).

FIG. 10 is a flowchart showing the flow of document browsing processing of an encapsulated document by a personal computer (computer).

FIG. 11 is a schematic diagram showing a file structure of a file that defines a correspondence relationship between media types and extension programs.

FIG. 12 is a schematic diagram showing types of extension programs.

FIG. 13 is a schematic diagram showing a display example in which a page turning button appears.

FIG. 14 is a schematic diagram showing a description example of a functional operation program file.

FIG. 15 is a schematic diagram showing a process of using an auxiliary program for an encoding part of a file.

FIG. 16 is a schematic diagram illustrating a display image enlargement / reduction function by an extension program.

FIG. 17 is a schematic diagram illustrating a viewpoint changing function of a display image which is a stereoscopic image by an extension program.

FIG. 18 is a schematic diagram illustrating a display function of a display image which is a moving image by the extension program as a still image and a reproduction function thereof.

FIG. 19 is a schematic diagram exemplifying a voice reproduction function and a reproduction voice text information conversion function by the extension program.

FIG. 20 is a schematic diagram showing the structure of an extension program included in an encapsulated document.

FIG. 21 shows three pieces of digital information (PRG1, PRG2,
It is a schematic diagram which shows the document display example which is displaying PRG3).

[Explanation of symbols]

102 display information file (document arrangement information) 103 digital information file (text information) 104 digital information file (media information) 105 operation program file 112A digital information display program 112B function operation program 118, 151 function panel (page turning button) 151 playback Panel (sound reproduction button) 201 Archive file 301 Computer (personal computer) 310 Display

   ─────────────────────────────────────────────────── ─── Continued front page    F-term (reference) 5B009 ME26 NA04 NA07 NB01                 5B076 AB09 AB17                 5B082 GA02 GA06

Claims (54)

[Claims] 1. A computer-interpreted and executed one or more digital information files that are representation entities on a document, a display information file that specifies a structure of the digital information file and a display state on the document. And an operation program file for displaying the one or more digital information files on the display of the computer in a display state specified based on the display information file, the digital information file, the display information file, and the operation A data structure of a document, which comprises an encapsulation means for encapsulating a program file as a single document. 2. The data structure of a document according to claim 1, wherein the encapsulation means is realized by a structure in which the digital information file, the display information file, and the operation program file are incorporated as a single file. 3. The operation program file includes a startup program for interpreting, executing and starting the operation program file by the computer according to an access operation to the document by the computer.
Or the data structure of the document described in 2. 4. The document includes an icon file relating to icons selectably displayed on the display of the computer in correspondence with the entity data of the document, and the activation means issues an instruction to select the icon. The data structure of a document according to claim 3, wherein the data structure is determined to be an access operation to the document by the computer. 5. An archive file for storing one or more of the digital information files with an index indicating the storage location thereof, and the operation program file comprises:
The data structure of a document according to claim 1, 2, 3, or 4, wherein the index identifies the digital information file. 6. An archive file for storing one or more digital information files to which a unique header is attached, wherein the operation program file specifies the digital information file by the header.
The data structure of the document described in 2, 3 or 4. 7. The display information file is described in a general-purpose data description language.
The data structure of the document described in 4, 5, or 6. 8. The data structure of a document according to claim 7, wherein the data description language is a language in which elements that specify the structure of the digital information file and the display state on the document are described using tags. 9. The data structure of a document according to claim 8, wherein the operation program file is provided in correspondence with a file format specified by the display information file described using the tag. 10. The operation program file is provided with a portion necessary for processing the digital information file as a minimum unit.
The data structure of the document described in 6, 7, 8 or 9. 11. The operation program file is a digital information display program for making the digital information file viewable on a display of the computer, and a function for executing a unique function without referring to the digital information. The data structure of the document according to claim 1, 2, 3, 4, 5, 6, 7, 8, 9 or 10, including a functional operation program file. 12. The digital information display program,
A function of displaying a file specifying panel for displaying the file specifying information for specifying the digital information file in a selectable manner, and browsing the digital information file corresponding to the case where the file specifying information is selected on the display of the computer. The data structure of the document according to claim 11, further comprising: a function that enables the data. 13. The functional operation program file comprises:
A function of displaying a function panel that selectably displays function specifying information that specifies a predetermined function, and a function of executing the predetermined function corresponding to when the function specifying information is selected. The data structure of the document described in 11. 14. The digital information display program,
The data structure of a document according to claim 11, further comprising a display image scaling function based on the digital information file. 15. The digital information display program,
12. A viewpoint changing function is provided when a display image based on the digital information file is a stereoscopic image.
The data structure of the described document. 16. The digital information display program comprises:
When the display image based on the digital information file is a moving image, a function of displaying the still image in the document in a selectable manner, and a function of playing the moving image when the still image is selected, The data structure of the document according to claim 11, comprising: 17. The digital information display program,
When the digital information file includes audio information, a function of displaying a reproduction panel that enables the reproduction of the audio information and a function of displaying the audio information when the reproduction instruction of the audio information is given by the reproduction panel. The data structure of the document according to claim 11, further comprising a function of reproducing. 18. The digital information display program,
18. The data structure of the document according to claim 17, further comprising a function of displaying text information corresponding to the voice information when the reproduction panel issues a reproduction instruction of the voice information. 19. A computer interprets and executes one or more digital information files that are representation entities on a document, a display information file that specifies a structure of the digital information file and a display state on the document. Is
An operation program file for displaying the one or more digital information files on the display of the computer in a display state specified based on the display information file, the digital information file, the display information file, and the operation program file A storage medium for storing a data structure of a document, which comprises: 20. The storage medium according to claim 19, wherein the encapsulation means is realized by a structure in which the digital information file, the display information file, and the operation program file are incorporated as a single file. 21. The storage medium according to claim 19, wherein the operation program file includes a startup program that causes the computer to interpret, execute, and start the operation program file in accordance with an access operation to the document by the computer. . 22. The document comprises an icon file relating to an icon which is selectably instructable to be displayed on the display of the computer in correspondence with the entity data of the document, and the activation means issues an instruction to select the icon. The storage medium according to claim 21, wherein the storage medium is determined to be an access operation to the document by the computer. 23. An archive file for storing one or more of the digital information files with an index indicating a storage position thereof, and the operation program file specifies the digital information files by the index. , 20, 21 or 22 storage medium. 24. An archive file for storing one or more digital information files having a specific header is attached, and the operation program file specifies the digital information file by the header.
The storage medium according to 9, 20, 21 or 22. 25. The display information file is described in a general-purpose data description language.
The storage medium according to 0, 21, 22, 23, or 24. 26. The data description language is a language that describes, by using tags, an element that specifies a structure of the digital information file and a display state on the document.
The storage medium described. 27. The storage medium according to claim 26, wherein the operation program file is provided corresponding to a file format specified by the display information file described using the tag. 28. The operation program file is provided with a portion necessary for processing the digital information file as a minimum unit.
2, 23, 24, 25, 26 or 27 storage medium. 29. The operation program file is a digital information display program for making the digital information file viewable on the display of the computer, and a function for executing a specific function without referring to the digital information. 20. A functional operation program file is included.
The storage medium according to 6, 27 or 28. 30. The digital information display program,
A function of displaying a file specifying panel for displaying the file specifying information for specifying the digital information file in a selectable manner, and browsing the digital information file corresponding to the case where the file specifying information is selected on the display of the computer. 30. The storage medium of claim 29, comprising a enabling function. 31. The functional operation program file comprises:
A function of displaying a function panel that selectably displays function specifying information that specifies a predetermined function, and a function of executing the predetermined function corresponding to when the function specifying information is selected. 29. The storage medium according to 29. 32. The digital information display program,
30. The storage medium according to claim 29, further comprising a display image scaling function based on the digital information file. 33. The digital information display program,
30. When the display image based on the digital information file is a stereoscopic image, the viewpoint changing function is provided.
The storage medium described. 34. The digital information display program,
When the display image based on the digital information file is a moving image, a function of displaying the still image in the document in a selectable manner, and a function of playing the moving image when the still image is selected, The storage medium according to claim 29, comprising: 35. The digital information display program,
When the digital information file includes audio information, a function of displaying a reproduction panel that enables the reproduction of the audio information and a function of displaying the audio information when the reproduction instruction of the audio information is given by the reproduction panel. 30. The storage medium according to claim 29, further comprising a function of reproducing. 36. The digital information display program,
36. The storage medium according to claim 35, further comprising a function of displaying text information corresponding to the voice information when the reproduction panel issues a reproduction instruction of the voice information. 37. A computer and a data structure of a document that can be browsed by the computer, wherein the data structure of the document is one or more digital information files that are representation entities on the document, and the digital information file. And a display information file that specifies the display state on the document, and the one or more digital information files with the display state that is interpreted and executed by the computer and is specified based on the display information file. An information processing apparatus comprising: an operation program file to be displayed on a display of a computer; and encapsulation means for encapsulating the digital information file, the display information file, and the operation program file as a single document. 38. The information processing apparatus according to claim 37, wherein the encapsulation means is realized by a structure in which the digital information file, the display information file, and the operation program file are incorporated as a single file. 39. The information processing according to claim 37, wherein the operation program file includes a start program for interpreting, executing and starting the operation program file by the computer according to an access operation to the document by the computer. apparatus. 40. The document includes an icon file relating to an icon that is selectably instructable to be displayed on the display of the computer in correspondence with the entity data of the document, and the activation means issues an instruction to select the icon. 40. The information processing apparatus according to claim 39, which is determined to be an access operation to the document by the computer. 41. An archive file for storing one or more digital information files with an index indicating a storage position thereof, wherein the operation program file specifies the digital information files by the index. , 38, 39 or 40. 42. An archive file for storing one or more digital information files to which a unique header is added, wherein the operation program file specifies the digital information file by the header.
The information processing device according to 7, 38, 39, or 40. 43. The display information file is described in a general-purpose data description language.
The information processing device according to 8, 39, 40, 41, or 42. 44. The data description language is a language that describes, by using a tag, an element that specifies a structure of the digital information file and a display state on the document.
The information processing device described. 45. The information processing apparatus according to claim 44, wherein the operation program file is provided in association with a file format specified by the display information file described using the tag. 46. The operation program file is provided with a portion necessary for processing the digital information file as a minimum unit.
The information processing device according to 0, 41, 42, 43, 44, or 45. 47. The operation program file is a digital information display program for making the digital information file viewable on the display of the computer, and a function for executing a specific function without referring to the digital information. Claims 37, 38, 39, 40, 41, 42, 43, 4 including functional operation program files
The information processing device according to 4, 45 or 46. 48. The digital information display program,
A function of displaying a file specifying panel for displaying the file specifying information for specifying the digital information file in a selectable manner, and browsing the digital information file corresponding to the case where the file specifying information is selected on the display of the computer. The information processing apparatus according to claim 47, further comprising a enabling function. 49. The functional operation program file comprises:
A function of displaying a function panel that selectably displays function specifying information that specifies a predetermined function, and a function of executing the predetermined function corresponding to when the function specifying information is selected. 47. The information processing device according to item 47. 50. The digital information display program,
The information processing apparatus according to claim 47, further comprising a display image scaling function based on the digital information file. 51. The digital information display program,
48. A viewpoint changing function is provided when a display image based on the digital information file is a stereoscopic image.
The information processing device described. 52. The digital information display program,
When the display image based on the digital information file is a moving image, a function of displaying the still image in the document in a selectable manner, and a function of playing the moving image when the still image is selected, The information processing apparatus according to claim 47, further comprising: 53. The digital information display program,
When the digital information file includes audio information, a function of displaying a reproduction panel that enables the reproduction of the audio information and a function of displaying the audio information when the reproduction instruction of the audio information is given by the reproduction panel. The information processing apparatus according to claim 47, further comprising a function of reproducing. 54. The digital information display program,
54. The information processing apparatus according to claim 53, further comprising a function of displaying text information corresponding to the voice information when the reproduction panel issues a reproduction instruction of the voice information.