JPH1186017A - Information processing apparatus and method - Google Patents

Abstract

(57) [Problem] To provide an information processing apparatus capable of accurately and efficiently reproducing and displaying a multimedia document including handwritten strokes according to a layout at the time of creation when the multimedia document is displayed in an environment different from that at the time of creation. And a method thereof. A document is created by a document layer unit using a plurality of types of drawing objects.
A handwritten stroke is input from the handwritten stroke layer unit 201 to the created document. Then, based on the contents of the environment variable data unit 208 as the display destination when displaying the document in which the handwritten stroke is input, the handwritten stroke is converted to the handwritten stroke deformation unit 2.
Deform at 06.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an information processing apparatus and method for processing a compound document in which a plurality of types of drawing objects are mixed.

[0002]

2. Description of the Related Art In recent years, multimedia objects (texts, bitmap images, moving images,
Voice, etc.). Applications that create and display multimedia documents (also called compound documents) in which these multimedia objects are mixed have appeared. A typical example of this application is a WWW browser application. In the WWW browser application, a creator of a multimedia document describes an HTML (Hyper Text Markup Language) script for displaying text information and bitmap image information, and stores the script on a server as an HTML file. The remote recipient can use communication means to send H
The TML file is downloaded, the contents are analyzed, and the multimedia object information is laid out and displayed in the application window.

[0003] Some recent portable terminal devices using a pen device can transmit and receive a multimedia document using an electronic mail application, and annotate the document with overwriting by handwriting strokes.・ In some cases, comments and emphasis marks can be added.

[0004]

However, a terminal having an application capable of processing a multimedia document as shown in the above-mentioned conventional example has the following problems. First, there is a problem in that the display layout structure of a multimedia document including overwritten handwritten strokes is not always represented in the layout at the time of creation due to the difference in receiving terminals. This is because the overwriting input using a handwritten stroke may be performed over a text and a bitmap image, or may be performed only on a blank area in a document. Therefore, it is difficult to associate or correspond the input position of the overwritten handwritten stroke with a specific object, and the display layout of a multimedia document realized by the above-described general WWW browser application differs depending on the terminal environment. Under such circumstances, the display layout of the handwritten strokes cannot be accurately and optimally reproduced. That is, the handwritten stroke is displayed at a position shifted from the input position of the handwriting stroke desired by the user, or displayed at a different size.

[0005] On the other hand, as a means for eliminating such misalignment, individual multimedia objects are arranged at the time of creating a multimedia document, and the entire multimedia document is converted into a bitmap image format at the time of storage and transmission of the multimedia document. There is an e-mail application that converts and converts it to. However,
This application has a problem that, instead of being able to reproduce an accurate layout at the time of reproducing and displaying on the receiving terminal, the amount of data during transmission and reception becomes large, and a heavy load is imposed on the network. Also,
On the receiving side, since the multimedia document is a bitmap image, there is also a problem that the editing operation cannot be performed for each multimedia object existing in the multimedia document.

SUMMARY OF THE INVENTION The present invention has been made in view of the above problems, and is intended to display a multimedia document including handwritten strokes in an environment different from that at the time of creation, accurately and efficiently according to the layout at the time of creation. It is an object of the present invention to provide an information processing apparatus and a method thereof that can be reproduced and displayed on a computer.

[0007]

An information processing apparatus according to the present invention for achieving the above object has the following arrangement.
That is, an information processing apparatus that processes a compound document in which a plurality of types of drawing objects are mixed, a creating unit that creates a document using the plurality of types of drawing objects, and an input unit that inputs a handwritten stroke in the document. And a deforming means for deforming the handwritten stroke based on environment setting information of a display destination when a document in which the handwritten stroke is input by the input means is displayed.

Preferably, the deforming means deforms the handwritten stroke based on font information on a text font used for a text object of the document. Preferably, the font information is a point number of a text font.

[0009] Preferably, a drawing object constituting a document created by said creating means and a handwritten stroke input by said input means are stored in association with each other. Preferably, a first display area for displaying a drawing object constituting a document created by the creation means and a second display area for displaying a handwritten stroke input by the input means are displayed. And display control means for controlling

Preferably, the display control means includes:
The second display area is displayed so as to overlap the first display area. Preferably, the background color of the second display area is colorless and transparent. Also, preferably, the drawing object is at least a text, a bitmap,
Including draw figures and animations.

An information processing method according to the present invention for achieving the above object has the following configuration. That is, an information processing method for processing a compound document in which a plurality of types of drawing objects are mixed, a creating step of creating a document using the plurality of types of drawing objects, and an inputting step of inputting a handwritten stroke in the document And a deforming step of deforming the handwritten stroke based on environment setting information of a display destination when a document in which the handwritten stroke is input in the input step is displayed.

A computer readable memory according to the present invention for achieving the above object has the following configuration. That is,
A computer-readable memory storing a program code of information processing for processing a compound document in which a plurality of types of drawing objects are mixed, wherein a program code of a creation step of creating a document using the plurality of types of drawing objects, A program for a transformation step for transforming a handwritten stroke based on program code of an input step of inputting a handwritten stroke in a document and environment setting information of a display destination when displaying the document in which the handwritten stroke is input in the input step And a code.

[0013]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Preferred embodiments of the present invention will be described below in detail with reference to the drawings. (Embodiment 1) FIG. 1 is a block diagram showing a basic configuration of an information processing apparatus according to Embodiment 1 of the present invention.

The CPU 101 is a central processing unit for controlling and calculating the system. The ROM 102 stores programs such as an initialization program required at the time of starting the system. The RAM 103 is an input / output storage device, and temporarily stores a program such as a handwritten stroke information processing program stored in the external storage device 104. The work area in the RAM 103 is used when calculating a program.

A liquid crystal display 105 for displaying the execution status of the program and a digitizer 106 for sending handwritten stroke data into the apparatus are configured as an input / output integrated apparatus. Then, when the handwriting stroke is input to the digitizer 106 using the input pen 107, the locus is displayed on the liquid crystal display 105. The external storage device 104 stores programs such as environment variable data for controlling the activation state of the device and a handwritten stroke information processing program. After these data and programs are transferred to the RAM 103,
It is read and executed by the PU 101. The communication device 108 is a communication device such as a modem for performing data communication using a network connected to the device.

It should be noted that other display devices than the liquid crystal display 105, for example, a CRT or the like can be used.
Next, a functional configuration of the information processing apparatus according to the first embodiment will be described with reference to FIG. FIG. 2 is a diagram illustrating a functional configuration of the information processing apparatus according to the first embodiment of the present invention. In FIG. 2, a handwritten stroke layer unit 2 is provided as a functional configuration for realizing a process of creating and displaying a compound document composed of a plurality of types of drawing objects including handwritten strokes.
01, document layer unit 202, layer display adjustment unit 203, compound document storage unit 204, resize unit 2
05, a handwritten stroke transformation unit 206, a layout analysis unit 207, and an environment variable data unit 208.

The handwriting stroke layer unit 201 converts a handwriting stroke by the input pen 107 into a digitizer 1
06, the coordinate information is obtained. Then, the acquired coordinate information is stored in the handwritten stroke object storage area on the RAM 103 as internal data of the handwritten stroke object. The coordinate information is represented by point sequence data including information indicating coordinates and time information indicating an input order. Further, a handwritten stroke layer window for displaying the handwritten stroke is created.
This window exists as a window whose background color is colorless and transparent.

In the document layer unit 202, a text is created on a document or a bitmap image is pasted. These are RAs as internal data of text objects and bitmap objects, respectively.
The document is stored in the document object storage area on M103. Further, these objects are displayed in a layout by being two-dimensionally arranged on the document layer window.

The layer display adjusting section 203 manages the display of the document layer window and the handwritten stroke layer window. Further, a process of superimposing the handwritten stroke layer window on the document layer window is also performed, and the handwritten stroke object is displayed as if it had been overwritten on the document object.

As described above, by overlaying the two types of layer windows, one composite document in which a plurality of types of drawing objects are composited is created. Then, the compound document storage unit 204 formats and stores the drawing object in each layer window. The layout analysis unit 207 reads necessary data from environment variable data (environment variable data unit 208) stored in the external storage device 104. Then, a display layout method of the document object (text object, bitmap object), and a misregistration correction value are calculated so that the handwritten stroke object does not misalign with the document object.

The resizing unit 205 changes the type of the text font and the font size and enlarges or reduces the bitmap image. In the handwritten stroke transformation unit 206,
The handwritten stroke object is deformed according to the displacement correction value calculated by the layout analysis unit 207. Next, a process of creating a compound document by the above-described components according to the first embodiment will be described with reference to the flowchart of FIG.

FIG. 3 is a flowchart showing the process of creating a compound document according to the first embodiment of the present invention. First, in step S301, a document layer window on which a text or a bitmap image can be arranged is created and displayed on the screen as an active window. The creation method is the API of the existing window system.
(Application Programming Interface) function. Next, step S302
Creates a handwritten stroke layer window in which handwritten strokes can be arranged. When this window is created, its background color is set to be colorless and transparent. The display area and position of the handwritten stroke layer window are the same as the document layer window,
Set to the same position. Then, the handwritten stroke layer window is vertically overlapped with the upper part of the document layer window.

In step S303, it is determined whether termination of the creation process has been instructed. In the initial stage, the creation of the document layer window and the handwritten stroke layer window has not been completed, so the process proceeds to step 304. In step S304, an input selection menu or the like is displayed on the liquid crystal display 105 so that a drawing object to be input can be selected, and the user is caused to select a drawing object to be input. Here, it is determined whether or not a handwritten stroke has been selected. If a handwritten stroke has not been selected (NO in step S304),
If a text or bitmap image has been selected, the process proceeds to step S305.

In step S305, the handwritten stroke layer window overlaid on the document layer window is retracted. The work of saving is to remove the handwritten stroke layer window from the document layer window. Although this processing can be performed by deleting the handwritten stroke layer window, the processing for hiding only the display, that is, the RAM 103
It is desirable to leave the data in the upper work area and to hide only the display of the handwritten stroke layer window. At this point, the handwritten stroke written on the handwritten stroke layer window is not displayed.

Next, in step S306, it is determined whether a text or a bitmap image has been selected. If a text is selected, the process proceeds to step S307, where the text is input using a keyboard or character recognition. At the time of input, the user specifies the position in the document layer window to input. The font for displaying this text is a fixed pitch font. On the other hand, if a bitmap image has been selected, the process proceeds to step S308, where a desired bitmap image is selected and input from bitmap images that have been created by other manual operations.

In step S309, the text data and bitmap data created on the document layer window are stored in the RAM 10
3 in the document object storage area. As the internal data of each of the text object and the bitmap object, in the case of a text object, a text input start coordinate point is stored as internal data along with text attributes such as a character code string of a text, a text font name, and a text color. Also,
In the case of a bitmap object, bitmap image rectangular area coordinates and bitmap image data are stored as internal data. Here, FIG. 4A shows an example of a memory map diagram which is a storage configuration when the internal data of the text object and the bitmap object arranged in the document layer window are stored.

On the other hand, if a handwritten stroke is selected in step S304 (YE in step S304)
S), the process proceeds to step S310, and an operation of restoring the handwritten stroke layer window is performed. In particular,
The non-displayed handwritten stroke layer window is restored from the RAM 103 and overlaid on the document layer window. Next, in step S311, a handwritten stroke input by the input pen 107 is obtained from the digitizer 106 as a set of coordinate data. Then, adjacent coordinate points of the coordinate data are sequentially connected by a straight line, and the drawing is performed to draw the locus of the handwritten stroke on the handwritten stroke layer window. In step S309, the input handwritten stroke is stored in RAM1.
03 in the handwritten stroke object storage area. Here, FIG. 4B shows an example of a memory map diagram which is a storage configuration when the internal data of the handwritten stroke object arranged in the handwritten stroke layer window is stored.

When the end of the work is instructed in step S303, a compound document is formed in step S312. At this point, the contents of the memory map diagrams shown in FIGS. 4A and 4B are stored as a document layer file and a handwritten stroke layer file, respectively. In order to make these files a compound document, an index area indicating a handwritten stroke layer file corresponding to the document layer file is provided,
A handwritten stroke layer file name is described. FIG. 5 shows the state of each stored file. Also,
FIG. 6 is a diagram showing an example of a compound document in which a handwritten stroke layer file is superimposed on a document layer file.

Next, the process of reproducing and displaying a composite document by the above-described components according to the first embodiment will be described with reference to the flowchart of FIG. FIG. 7 is a flowchart showing the process of reproducing and displaying a compound document executed in the first embodiment according to the present invention. The terminal that reproduces and displays the compound document has the same platform as the terminal at the time of creation, and it is assumed that the text font to be used exists in both terminals.

First, in step S701, a document layer file is read from files constituting a compound document. The contents are expanded in the RAM 103. The files constituting the compound document may be read from the external storage device 104, or may be received by a communication device 108 from a remote location via a network line or downloaded. Next, in step S702,
The text font information set in the environment variable data stored in the external storage device 104 of the external storage device 104 of the terminal to be reproduced and displayed is extracted.

In step S703, among the files constituting the read composite document, the entry of the "corresponding handwritten stroke layer file name" in the document layer file (see FIG. 5) is referred to, and the handwritten stroke is added to the composite document to be reproduced and displayed. It is determined whether or not a layer file is included. If a handwritten stroke layer file is not included (N in step S703)
O), and proceed to step S709. On the other hand, when a handwritten stroke layer file is included (step S70)
(YES in 3), the process proceeds to the process of reproducing and displaying the composite document after step S704.

At step S704, the number of font points (nPoint1) of the text font from the text font information extracted at step S702 and the number of font points (nPoint0) of the text object developed on the RAM 103 at step S701.
Compare. As a result of the comparison, nPoint0 = nPoint
If it is t1 (NO in step S704), the flow advances to step S709. On the other hand, nPoint0 ≠ nPoint
If it is 1 (YES in step S704), the flow advances to step S705 to perform a handwritten stroke deformation process.

The details of the handwritten stroke deformation process in step S705 will be described with reference to the flowchart of FIG. FIG. 8 is a flowchart illustrating details of the deformation processing in step S705 executed in the first embodiment according to the present invention. First, in step S801, the font height fcy0 is calculated from the font point number nPoint0.
Calculate (in pixels). In step S802, the font height f is calculated based on the font point number nPoint1.
cy1 (pixel unit) is calculated. Step S803
Then, the height fcy of the font calculated in step S801
0 and the height fc of the font calculated in step S802
The degree of difference in y1 is determined by the vertical scaling factor FRV = fcy1 /
It is obtained as fcy0.

In step S804, the font width fcx0 (pixel unit) is calculated from the font point number nPoint0. In step S805, the font width fcx1 (pixel unit) is calculated from the font point number nPoint1. In step S806, step S806
Font width fcx0 calculated in step 804 and step S
The degree of the difference in the font width fcx1 calculated in 805 is obtained as the horizontal scaling factor FRH = fcx1 / fcx0.

In step S807, a handwritten stroke layer file indicated by "corresponding handwritten stroke file name" described in the document layer file is read, and the handwritten strokes are developed on the RAM 103. For all of the coordinate points constituting the developed handwritten stroke, the X coordinate is set to a new X coordinate X ′ using the horizontal scaling factor FRH obtained in step S806 (X ′ = X
* FRH). Similarly, the Y coordinate is set as a new Y coordinate Y 'using the vertical scaling factor FRV obtained in step S805 (Y = Y * FRV). The handwritten stroke deformed by the above processing is stored in the work area of the RAM 103.

When the handwritten stroke deformation processing in step S705 is completed, in step S706, document layer information is searched to determine whether a bitmap object exists. If no bitmap object exists (NO in step S706),
Proceed to step S708. On the other hand, if a bitmap object exists (YE in step S706)
S), the process proceeds to step S707, and the size of the bitmap object is reduced or enlarged. This reduction or enlargement is performed by using the horizontal
This is performed using a vertical magnification. For example, the width of the bitmap object is bcx0 (pixel unit) and the height is bcy0
(Pixel unit), the width and height of the new bitmap object are respectively bcx1 = bcx
0 * FRH, bcy1 = bcy0 * FRV.

In step S708, nPoint1 which is a text font point at the time of reproduction display is set to be used at the time of text font display. In step S709, a document layer window and a handwritten stroke layer window are created using the newly changed and created object. This creation method is shown in FIG.
The processing is performed in the same manner as in step S301.

Next, processing for arranging each object on the document layer window and the handwritten stroke layer window will be described. (A) of FIG.
This is a layout example when a document layer window is created, and the layout information of the document layer file read into the RAM 103 in step S701 is also such a layout setting value. (A) of FIG.
, The text font height fcy0, the text font width fcx0, and the bitmap image height bcy
0 and the width bcx0 of the bitmap image have been reset in steps S708 and S707, respectively. Therefore, fcy0, fcx0, bcy0, bcx
0 are the values of fcy1 and fcx in FIG.
1, bcy1, and bcx1.

Next, regarding the place where the text and the bitmap image are arranged, the starting coordinates of the text are indicated by (tx0, ty0) in FIG. 9A, and the description in FIG. Then, "Start x coordinate" in the text object information column,
Same as "start y coordinate". Similarly, the start coordinates of the bitmap image are (bx0, by0) and the size of the document layer window is (wx0, wy0), which are the same as the information in FIG. The layout information is also scaled as follows using the vertical / horizontal scale obtained in step S705.

Tx1 = tx0 * FRH, ty1 = ty0 *
FRV, bx1 = bx0 * FRH, by1 = by0 * FR
V, wx1 = wx0 * FRH, wy1 = wy0 * FRV As described above, when a document layer window is created based on these numerical values, it becomes as shown in FIG. 9B (FRH).
<1, FRV <1). Next, a handwritten stroke layer window is created. FIG. 10A shows a layout example when a handwritten stroke layer window is created, and the layout information of the handwritten stroke layer file read into the RAM 103 in step S701 also has such a layout setting value. Assuming that the size at the time of creation is (wx0'.wy0 '), a new window size (wx1', wy1 ') is calculated using the vertical / horizontal scaling factor obtained in step S705. It is assumed that wx1 ′ = wx0 ′ * FRH and wy1 ′ = wy1 * FRV.

FIG. 10B shows an example in which a handwritten stroke transformed in step S705 is drawn in the handwritten stroke layer window whose window size has been changed. Through the above processing, the newly created document layer window and the handwritten stroke layer window are combined and displayed. FIG. 11 is a diagram showing this state. In particular, FIG. 11A shows a layout at the time of creation, and FIG. 11B shows a layout after reproduction and display.

As described above, according to the first embodiment, a handwritten stroke layer window for displaying handwritten strokes and a document layer window for displaying text and bitmap images are prepared. By superimposing and displaying the handwritten stroke layer window on the document layer window while controlling the size, the handwritten stroke can be displayed in the document window at an optimum size.

In the first embodiment, texts and bitmap images are used as objects to be arranged in the document layer file. In addition, draw graphic images (vector graphics such as circles and rectangles not stored as a set of coordinate points),
It is clear that similar processing can be performed even when a drawing object such as a moving image exists. Although the display of the handwritten strokes is realized by drawing in the handwritten stroke layer window superimposed on the document layer window, a configuration in which the display is directly overwritten on the document layer window may be adopted. (Embodiment 2) In the information processing apparatus of Embodiment 2, an example of a method of reproducing and displaying a composite document when the platform is between different platforms will be described. In particular, Embodiment 1
FIG. 8 shows an example in which the handwritten stroke deformation process of step S705 in FIG. 7 is realized by another method.

FIG. 12 is a view showing a font conversion table describing the scaling ratio between fonts, which is stored in the external storage device 104 of the terminal device in advance. In FIG.
Reference numeral 1201 denotes a font type of a text font that may be used when creating a compound document. 120
2 is the number of font points. Reference numeral 1203 denotes a corresponding font. Reference numeral 1204 denotes a corresponding font point number. Reference numeral 1205 denotes a horizontal scaling factor indicating a difference between the font point number 1201 and the font point number 1203 in the horizontal direction. Reference numeral 1206 denotes a vertical scaling factor indicating a difference between the font point number 1201 and the font point number 1203 in the vertical direction. In the fields 1201 and 1203, it is desirable to describe font types that always exist on each platform. Further, a field indicating the platform where the font exists may be added.

Next, the process of reproducing and displaying a composite document according to the second embodiment will be described with reference to the flowchart of FIG. FIG. 13 is a flowchart showing the process of reproducing and displaying a compound document executed in the second embodiment according to the present invention. In FIG. 13, the same processes as those in the flowchart of FIG. 7 are denoted by the same step numbers, and the details are omitted. Step S130
4. In order to simplify the explanation of step S1305, it is assumed that the text font at the time of creating the compound document is A1 font and the number of points is 9 points.

In step S 1304, the font conversion table shown in FIG. 12 is read and expanded on the RAM 103. In step S1305, a handwriting stroke transformation process is performed. Details of the handwritten stroke deformation process in step S1305 will be described with reference to the flowchart in FIG.

FIG. 14 is a flowchart showing details of the handwriting stroke deformation process according to the second embodiment of the present invention. First, in step S1401, it is determined whether the display text font set in the environment variable data in step S702 exists in the 1203 field of the font conversion table. If it does not exist in the font conversion table (NO in step S1401),
Investigate fonts whose vertical / horizontal scaling ratio is close to the same as the text font used in the compound document. In the example of FIG. 12, the A1 font and the font close to 9 points are 8 points of the B2 font. Then, in step S1403, a font type and the number of points close to the display text font are reset in the environment variable data unit 208 to be used for the subsequent text display of the compound document.

On the other hand, if it is determined in step S1401 that a text font for display exists in the font conversion table (YES in step S1401), the flow advances to step S1403. Then, in step S1403,
The horizontal scaling value is stored with reference to the horizontal scaling field of the font conversion table. Next, step S140
At step 4, similarly, the value of the vertical scaling factor is stored with reference to the vertical scaling factor field. In step S1406, a handwriting stroke deformation process is performed according to these vertical / horizontal scaling factors. This deformation processing may be the same as the processing described in step S807 of the first embodiment.

As described above, according to the second embodiment, in addition to the effects described in the first embodiment, by preparing a font conversion table, the handwriting stroke deformation process can be performed in comparison with the first embodiment. It can be executed more efficiently. As described above, according to the first and second embodiments, when a compound document created in one terminal environment is reproduced and displayed in another terminal environment, the environment in which the shape of the overwritten handwritten stroke is displayed. By deforming according to the settings, it is possible to accurately reproduce and display according to the layout at the time of creation without ignoring the environment setting to be reproduced and displayed, and to accurately convey the intended contents of the handwritten stroke.

Further, by providing such a device, it is possible to improve communication efficiency in a remote place. Furthermore, since a standard protocol can be used at the time of transmission, a conventional network system can be used, so that the communication range can be expanded at low cost. In addition, since the handwritten strokes can be stored not as an image but as a set of coordinate points, the communication time can be shortened and the editing operation can be performed on the receiving side.

In general, by mounting the configuration of the present invention in an electronic mail application or a groupware application, the productivity of work can be improved in an environment where a collaboration work is performed. Note that the present invention is applied to a system including a plurality of devices (for example, a host computer, an interface device, a reader, a printer, etc.), but a device including one device (for example, a copying machine, a facsimile machine, etc.). May be applied.

Further, an object of the present invention is to provide a storage medium storing a program code of software for realizing the functions of the above-described embodiments to a system or an apparatus, and to provide a computer (or CPU) of the system or apparatus.
And MPU) read and execute the program code stored in the storage medium.

In this case, the program code itself read from the storage medium realizes the functions of the above-described embodiment, and the storage medium storing the program code constitutes the present invention. As a storage medium for supplying the program code, for example, a floppy disk, a hard disk, an optical disk, a magneto-optical disk,
A CD-ROM, CD-R, magnetic tape, nonvolatile memory card, ROM, or the like can be used.

When the computer executes the readout program code, not only the functions of the above-described embodiment are realized, but also the OS (Operating System) running on the computer based on the instruction of the program code. ) May perform some or all of the actual processing, and the processing may realize the functions of the above-described embodiments.

Further, after the program code read from the storage medium is written in a memory provided in a function expansion board inserted into the computer or a function expansion unit connected to the computer, the program code is read based on the instruction of the program code. It goes without saying that the CPU included in the function expansion board or the function expansion unit performs part or all of the actual processing, and the functions of the above-described embodiments are realized by the processing.

[0056]

As described above, according to the present invention,
When a multimedia document including handwritten strokes is displayed in an environment different from that at the time of creation, an information processing apparatus and method capable of accurately and efficiently reproducing and displaying the layout according to the layout at the time of creation can be provided.

[Brief description of the drawings]

FIG. 1 is a block diagram illustrating a basic configuration of an information processing apparatus according to a first embodiment of the present invention.

FIG. 2 is a diagram illustrating a functional configuration of the information processing apparatus according to the first embodiment of the present invention.

FIG. 3 is a flowchart illustrating a process of creating a compound document according to the first embodiment of the present invention.

FIG. 4 is a diagram showing layout information in a document layer file and a handwritten stroke layer file according to the first embodiment of the present invention.

FIG. 5 is a diagram showing the relationship between a document layer file and a handwritten stroke layer file according to the first embodiment of the present invention.

FIG. 6 is a diagram illustrating an example of a document layer, a handwritten stroke layer, and a compound document according to the first embodiment of the present invention.

FIG. 7 is a flowchart illustrating a process of reproducing and displaying a compound document executed in the first embodiment according to the present invention.

FIG. 8 is a flowchart illustrating details of a modification process in step S705 executed in the first embodiment according to the present invention.

FIG. 9 is a diagram showing a layout at the time of creating and reproducing a document layer file according to the first embodiment of the present invention.

FIG. 10 is a diagram illustrating a layout when a handwritten stroke layer window is created and reproduced according to the first embodiment of the present invention.

FIG. 11 is a diagram illustrating a layout when a handwritten stroke layer file is created and reproduced according to the first embodiment of the present invention.

FIG. 12 is a diagram illustrating a font conversion table according to the second embodiment of the present invention.

FIG. 13 is a flowchart showing a process of reproducing and displaying a compound document executed in the second embodiment according to the present invention.

FIG. 14 is a flowchart illustrating details of a handwritten stroke deformation process according to the second embodiment of the present invention.

[Explanation of symbols]

 101 CPU 102 ROM 103 RAM 104 External storage device 105 Liquid crystal display 106 Digitizer 107 Input pen

Claims (17)

[Claims] 1. An information processing apparatus for processing a compound document in which a plurality of types of drawing objects are mixed, a creating unit for creating a document using the plurality of types of drawing objects, and inputting a handwritten stroke to the document An information processing apparatus comprising: an input unit; and a deforming unit configured to deform the handwritten stroke based on environment setting information of a display destination when a document in which a handwritten stroke is input by the input unit is displayed. 2. The information processing apparatus according to claim 1, wherein the transformation unit transforms the handwritten stroke based on font information on a text font used for a text object of the document. 3. The information processing apparatus according to claim 2, wherein the font information is a point number of a text font. 4. The information processing apparatus according to claim 1, wherein a drawing object constituting a document created by said creating means is associated with a handwritten stroke input by said input means and stored. 5. A display of a first display area for displaying a drawing object constituting a document created by said creating means and a second display area for displaying a handwritten stroke inputted by said input means. The information processing apparatus according to claim 1, further comprising a display control unit configured to control the information processing. 6. The information processing apparatus according to claim 5, wherein the display control unit displays the second display area by superimposing the second display area on the first display area. 7. The information processing apparatus according to claim 5, wherein a background color of the second display area is colorless and transparent. 8. The information processing apparatus according to claim 1, wherein the drawing object includes at least a text, a bitmap, a draw graphic, and a moving image. 9. An information processing method for processing a compound document in which a plurality of types of drawing objects are mixed, wherein a creating step of creating a document using the plurality of types of drawing objects, and inputting a handwritten stroke to the document An information processing method comprising: an input step; and a deformation step of deforming a handwritten stroke based on environment setting information of a display destination when a document in which a handwritten stroke is input in the input step is displayed. 10. The information processing method according to claim 9, wherein the deforming step deforms the handwritten stroke based on font information on a text font used for a text object of the document. 11. The information processing method according to claim 10, wherein the font information is a point number of a text font. 12. The information processing method according to claim 9, wherein a drawing object forming a document created in said creating step is associated with a handwritten stroke input in said input step and stored. 13. A display including a first display area for displaying a drawing object constituting a document created in the creation step and a second display area for displaying a handwritten stroke input in the input step. The information processing method according to claim 9, further comprising: a display control step of controlling the information processing. 14. The information processing method according to claim 13, wherein in the display control step, the second display area is displayed so as to overlap the first display area. 15. The information processing method according to claim 13, wherein a background color of the second display area is colorless and transparent. 16. The information processing method according to claim 9, wherein the drawing object includes at least a text, a bitmap, a draw graphic, and a moving image. 17. A computer-readable memory storing a program code for information processing for processing a compound document in which a plurality of types of drawing objects are mixed, wherein a creation step of creating a document using the plurality of types of drawing objects is performed. A program code, a program code of an input step of inputting a handwritten stroke to the document, and a deformation of the handwritten stroke based on environment setting information of a display destination when a document in which the handwritten stroke is input in the input step is displayed. Computer-readable memory comprising program code for a transformation step.