JP2009289197A - Information processing apparatus, system and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an information processing apparatus which, if a screen is shared at two or more places, causes writes to one text to be reflected as writes to the other corresponding translation on the screen displayed in such a way as to match the languages used. <P>SOLUTION: A storage means of the information processing apparatus stores the position of a target in an image displayed in a first language and the position of a target in an image displayed in a second language that is in a translation relationship with the first language, such that the positions correspond to each other. A write receiving means receives the position of writing to the image displayed in the first language. Using the storage means, a write position calculating means calculates the position of writing to the image displayed in the second language which corresponds to the position of the writing received by the write receiving means. Based on the position calculated by the write position calculating means, an image creation means creates an image such that the writing is made to the image displayed in the second language. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to an information processing apparatus, an information processing system, and an information processing program.

Use technology to share the same screen between multiple PCs using communication lines, hold meetings with people at remote locations, or use a large blackboard and a small PC at hand in the same room There is a technology that facilitates meetings in combination with. In recent years, with the globalization of society and the increasing number of meetings with people in remote locations, this technology has greatly contributed to cost reduction.
However, in the conventional technology, if the languages used by the conference participants are different, sharing the same screen will not deepen the understanding of both parties. Generally, in such a case, there is a method of solving the problem by translating the other into the native language using an automatic translation technique.
At this time, the arrangement and display direction of the word may differ depending on the translated language, and the user interface should be taken into account when the document contains graphics or the user performs operations on the translated information. It was necessary to re-layout.

  As a technique related to this, for example, Patent Document 1 provides a shared workspace for participants to easily connect between conference systems and share information with other conference participants. In shared workspaces, shared workspaces manage sessions between conferencing systems, files used during and as meeting records, reference information for conference-related resources, and conference participants. History information such as file access is managed, and participants can connect to the conference system without being aware of the call address of each conference system by GUI operation, and information such as files related to the conference can be easily accessed from the conference system Is disclosed.

As a technology related to this, for example, in Patent Document 2, it is an object to make it possible to appropriately perform screen layouts of character strings, icons, and the like according to a plurality of languages having different character string description directions. In the information processing apparatus capable of displaying the same information on the image display apparatus with a plurality of different screen layouts, the first type language in which the character string is described from right to left and the character string from the left The second type of language described in the right direction is handled. First, the predetermined display target character string is a character string described in any one of the first type and second type languages. Character string language information indicating whether or not one of a plurality of screen layouts is selected according to the received character string language information, and a predetermined display target character string is selected according to the selected screen layout. Resshi and it is disclosed that displays a sequence and predetermined display target string to the image display device.
JP 2004-171526 A JP 2008-040351 A

In the conventional technique, the operation for the display after the re-layout of the translated sentence can be performed properly, but when the screen is shared at two or more places, the operation on the original sentence (or the translated sentence) is performed on the other translated sentence (or the original sentence). ) Was not reflected in the operation.
In the present invention, when screens are shared at two or more places, writing to one original sentence (or translation sentence) on the screen displayed in accordance with the language corresponds to the other translated sentence (or original sentence). It is an object of the present invention to provide an information processing apparatus, an information processing system, and an information processing program that are reflected as a writing to the above.

The gist of the present invention for achieving the object lies in the inventions of the following items.
According to the first aspect of the present invention, the position of the object in the image displayed in the first language corresponds to the position of the object in the image displayed in the second language that has a translation relationship with the first language. Storing means for storing, write receiving means for receiving the position of writing to the image displayed in the first language, and using the storage means for writing received by the write receiving means A writing position calculating means for calculating a writing position on the image displayed in the second language corresponding to the position; and the second language based on the position calculated by the writing position calculating means. An information processing apparatus comprising image generation means for generating an image in which writing is performed on the image displayed by.

  According to a second aspect of the present invention, there is provided object determining means for determining whether or not the writing is performed on an object displayed in the first language based on the position of writing received by the writing receiving means. And the writing position calculation means uses the storage means to determine whether the writing reception is performed when the object determination means determines that the writing is to be performed on the object displayed in the first language. The information processing apparatus according to claim 1, wherein the position of writing to the object to be displayed is calculated in the second language corresponding to the position of writing received by the means.

  According to a third aspect of the present invention, there is provided an object determining means for determining whether or not the writing is made to the object displayed in the first language based on the position of the writing received by the writing receiving means. The writing position calculating means, when the object determining means determines that it is not writing to the object displayed in the first language, the writing position calculating means receives the writing received by the write receiving means. The information processing apparatus according to claim 1, wherein a writing position for an image to be displayed is calculated in the second language corresponding to the position.

  According to a fourth aspect of the present invention, there is provided write shape recognition means for recognizing the shape of the write based on the write position received by the write receiving means, and the write position calculating means includes the write position calculating means. 2. The information processing apparatus according to claim 1, wherein a position of writing to an image displayed in the calculated second language is adjusted based on a writing shape recognized by a shape recognition unit. It is.

  The invention of claim 5 comprises object judging means for judging whether or not the writing is for a plurality of objects based on the position of writing received by the writing receiving means, and the writing position calculating means comprises If the object determining means determines that the writing is for a plurality of objects, the storage means is used to display in the second language corresponding to the position of the writing received by the writing receiving means. The information processing apparatus according to claim 1, wherein positions for writing to a plurality of objects to be calculated are calculated.

  According to a sixth aspect of the present invention, a first information processing terminal, a second information processing terminal, and an information processing apparatus are connected via a communication line, and the first information processing terminal displays in a first language. Detecting means for detecting the position of writing to the image being written, and position transmitting means for transmitting the writing position detected by the detecting means to the information processing apparatus, wherein the information processing apparatus is in a first language. Object in the image of the second information processing terminal displayed in the second language in translation relation with the position of the object in the image of the first information processing terminal being displayed and the first language Storage means for storing the corresponding positions, position receiving means for receiving the writing position transmitted by the position transmitting means of the first information processing terminal, and using the storage means, the position receiving means By Based on the position calculated by the writing position calculating means, the writing position calculating means for calculating the writing position to the image displayed in the second language corresponding to the received writing position, Image generation means for generating an image written to an image displayed in the second language, and image transmission for transmitting the image generated by the image generation means to the second information processing terminal And the second information processing terminal includes: an image receiving unit that receives an image transmitted by the image transmitting unit of the information processing device; and a display unit that displays the image received by the image receiving unit. It is the information processing system characterized by comprising.

  According to a seventh aspect of the present invention, a first information processing terminal, a second information processing terminal, and an information processing apparatus are connected via a communication line, and the first information processing terminal displays in a first language. Detecting means for detecting the position of writing to the image being written, and position transmitting means for transmitting the writing position detected by the detecting means to the information processing apparatus, wherein the information processing apparatus is in a first language. Object in the image of the second information processing terminal displayed in the second language in translation relation with the position of the object in the image of the first information processing terminal being displayed and the first language Storage means for storing the corresponding positions, position receiving means for receiving the writing position transmitted by the position transmitting means of the first information processing terminal, and using the storage means, the position receiving means By A writing position calculating means for calculating a writing position on the image displayed in the second language corresponding to the received writing position; and a position calculated by the writing position calculating means as the second position. A calculation position transmission means for transmitting to the information processing terminal, wherein the second information processing terminal receives the calculation position transmitted by the calculation position transmission means of the information processing apparatus; and the calculation Based on the calculated position received by the position receiving means, an image generating means for generating an image written on the image displayed in the second language, and the image generated by the image generating means It is an information processing system characterized by comprising display means for displaying.

  According to the eighth aspect of the present invention, there is provided a computer that detects the position of an object in an image displayed in the first language and the object in the image displayed in the second language that has a translation relationship with the first language. A storage means for storing the corresponding position; a write receiving means for receiving the position of writing to the image displayed in the first language; and the storage means for receiving by the write receiving means. Writing position calculating means for calculating a writing position on the image displayed in the second language corresponding to the writing position, and based on the position calculated by the writing position calculating means. An information processing program that functions as an image generation unit that generates an image written in an image displayed in two languages.

  According to the information processing apparatus according to claim 1, when the screen is shared at two or more places, writing to one original sentence (or translated sentence) is supported on the screen displayed in accordance with the language. It can be reflected as a writing to the other translated text (or original text).

  According to the information processing apparatus according to claim 2, even when a portion other than the original sentence (or translated sentence) and a sentence such as a graphic is displayed, the writing to the original sentence (or translated sentence) is reflected on the other. Can do.

  According to the information processing apparatus according to claim 3, even when a portion other than a sentence such as an original sentence (or a translated sentence) and a graphic is displayed, a writing to a part other than a sentence such as a figure is directly reflected in the other. Can be made.

  According to the information processing apparatus of the fourth aspect, writing in the original sentence (or translation sentence) can be reflected in accordance with the application rule of the other language.

  According to the information processing apparatus of the fifth aspect, it is possible to reflect the writing of the original sentence (or the translated sentence) on a plurality of objects on each object of the other language.

  According to the information processing system of claim 6, when the screen is shared between the first information processing terminal and the second information processing terminal, the information processing device displays the screen according to the language. Thus, writing to the original sentence (or translated sentence) of the first information processing terminal can be reflected as writing to the corresponding translated sentence (or original sentence) of the second information processing terminal.

  According to the information processing system of claim 7, when the screen is shared between the first information processing terminal and the second information processing terminal, the load on the information processing apparatus is reduced and the display is performed according to the language. The writing on the original text (or translation) of the first information processing terminal can be reflected as the writing on the corresponding translation text (or original text) of the second information processing terminal on the screen that has been displayed.

  According to the information processing program according to claim 8, when the screen is shared at two or more places, writing to one original sentence (or translation sentence) is supported on the screen displayed according to the language. It can be reflected as a writing to the other translated text (or original text).

Hereinafter, examples of various preferred embodiments for realizing the present invention will be described with reference to the drawings.
FIG. 1 is a conceptual module configuration diagram of a configuration example according to the first embodiment.
The module generally refers to components such as software (computer program) and hardware that can be logically separated. Therefore, the module in the present embodiment indicates not only a module in a computer program but also a module in a hardware configuration. Therefore, the present embodiment also serves as an explanation of a computer program, a system, and a method. However, for the sake of explanation, the words “store”, “store”, and equivalents thereof are used. However, when the embodiment is a computer program, these words are stored in a storage device or stored in memory. It is the control to be stored in the device. In addition, the modules correspond almost one-to-one with the functions. However, in mounting, one module may be composed of one program, or a plurality of modules may be composed of one program. A plurality of programs may be used. The plurality of modules may be executed by one computer, or one module may be executed by a plurality of computers in a distributed or parallel environment. Note that one module may include other modules. Further, hereinafter, “connection” is used not only for physical connection but also for logical connection (data exchange, instruction, reference relationship between data, etc.).
In addition, the system or device is configured by connecting a plurality of computers, hardware, devices, and the like by communication means such as a network (including one-to-one correspondence communication connection), etc., and one computer, hardware, device. The case where it implement | achieves by etc. is also included. “Apparatus” and “system” are used as synonymous terms. The term “predetermined” is used in addition to a predetermined meaning, including the meaning according to the situation / state at that time or the situation / state until then.

In this embodiment, when the screen is shared at two or more places, the original text is displayed on one side, the translated text of the original text is displayed on the other side, and the text displayed on either side is displayed. When writing is performed, writing to the other corresponding sentence is performed. In that case, even if the original text and the translated text have different forms (for example, the writing direction of the character string is different, the word order is different, etc.), writing that has the same meaning as one writing to the other Also do. Hereinafter, the term “sentence” refers to an original sentence or a translated sentence, and the electronic document includes the sentence, and an image of the electronic document displayed on a display or the like is referred to as a display document. An object displayed in the displayed document is called an object. Objects include characters, figures, photographs and the like. An electronic document of language A and an electronic document of language B are in a translation relationship when the electronic document of language A is the original text and the electronic document of language B is a translation of the electronic document of language A or And the case where the electronic document is an original text and the electronic document in language A is a translation of the electronic document in language B.
In the following, explanation will be given mainly with Japanese as the original text and English as the translated text. In addition, the description direction of the Japanese sentence illustrates vertical writing. In addition, the language A is used when referring to either the original language or the translated language, and the language B is used when referring to the other language.

  As shown in FIG. 1, the present embodiment includes a server 110, a client 120, and a client 130, which are connected via a communication line 199, respectively. Note that not only two clients but also more may be connected via the communication line 199. The client 120 displays the original electronic document and writes the displayed document. The client 130 displays the translated electronic document corresponding to the original document, and the client 120 performs the writing performed on the client 130 side. Each module will be described using an example that is reflected in the display document. Alternatively, one of the functions may be dedicated for writing and the other may be a function that only displays the reflection. In this case, for example, the write-only client 120 includes a user information acquisition module 121, a user information transmission module 122, an event collection module 123, and an event transmission module 124. An acquisition module 131, a user information transmission module 132, an event collection module 133, an image reception module 135, and an image display module 136 are included.

  The server 110 includes an event reception module 111, an event conversion module 112, an object determination module 113, a translation module 114, a layout conversion module 115, an image forming module 116, an image transmission module 117, a client information DB 118, and a layout conversion DB 119. .

The event reception module 111 receives the event transmitted by the event transmission module 124 of the client 120 via the communication line 199. The event includes information related to the user of the client 120 (for example, a client identification number and a language used by the client), an original text, a display request for an electronic document, a writing position in a display document in language A, and the like.
The event conversion module 112 converts the event received by the event reception module 111 into data that can be processed by the module in the server 110, and passes the data to each module according to the content of the event. Hereinafter, in order to simplify the description, the case where the data converted by the event conversion module 112 is passed to each module is also described as being passed from the event reception module 111. In other words, in the case of passing directly from the event reception module 111, when passing through the event conversion module 112, the event reception module 111 has received the data converted by the event conversion module 112. May be passed later.

The object determination module 113 determines whether or not the writing is performed on the object of language A based on the writing position received by the event reception module 111. An object of language A is an object to be translated or translated (more specifically, an original sentence or a translated sentence, hereinafter referred to as a translation object). An object other than the language A object means a part other than a sentence such as a figure. That is, conversion is performed for writing to the translation object, and writing to other objects, that is, objects that are not to be translated, such as graphics, is not translated to the display document of the client 130 without performing the conversion. Should be written. For this purpose, the object determination module 113 determines whether or not the position where the writing has been performed is near the language A object. The determination as to whether or not they are close is made, for example, based on whether or not there is an object of language A within a predetermined distance from the position where writing has been performed.
Further, the object determination module 113 may recognize the writing shape based on the writing position received by the event receiving module 111. For example, handwritten writing may be recognized as an underline, a surrounding line, or the like. This recognition may be determined by a transition of the writing drawing direction or the like.
The object determination module 113 may determine whether or not the writing is for a plurality of objects based on the writing position received by the event reception module 111. For example, in the original text, the objects are located adjacent to each other, but in the translated text, they may be located separately at different locations. In such a case, when writing is performed on a plurality of adjacent objects in the original text, it is necessary to search for the corresponding object and separately convert the writing. Therefore, it is determined whether or not the writing is for a plurality of objects. The determination is made, for example, based on whether or not there are a plurality of objects within a predetermined distance from the position where writing is performed.
In addition, the object determination module 113 may determine whether or not the languages used by the two clients match, and if they do not match, the object determination module 113 may cause the translation module 114 to translate them.

  The translation module 114 translates the original text received by the event reception module 111. At that time, the client information DB 118 is used for translation into the language used by the translation destination client. Then, the image forming module 116 generates an image of a document displayed by the client 130 from the translation result, and the image transmission module 117 transmits the image to the image reception module 135 of the client 130.

The layout conversion module 115 uses the layout conversion DB 119 to calculate the writing position in the language B display document corresponding to the writing position received by the event reception module 111. At that time, the layout conversion module 115 may detect the languages of the client 120 and the client 130 using the client information DB 118.
In addition, when the object determination module 113 determines that the layout conversion module 115 is writing to an object in language A, the layout conversion module 115 uses the layout conversion DB 119 to correspond to the writing position received by the event reception module 111. The position of writing to the language B object to be performed may be calculated. When it is determined that the writing is not performed on the language A object, the writing position on the display document of the language B corresponding to the writing position received by the event reception module 111 may be calculated.
In addition, the layout conversion module 115 may adjust the position of writing to the display document in the language B that has already been calculated based on the writing shape recognized by the object determination module 113. For example, if the writing is recognized as a vertical line for Japanese from the shape, the writing position is adjusted so that the corresponding English translation is underlined. This is because the meaning of writing in a language that reflects the writing may be different simply by converting the writing.

Based on the position calculated by the layout conversion module 115, the image forming module 116 generates a display document in which writing is performed on the display document in the language B.
The image transmission module 117 transmits the display document generated by the image forming module 116 to the image reception module 135 of the client 130 via the communication line 199.
The client information DB 118 stores information about the user received by the event reception module 111. Note that the language used by the client may be determined from the type of the original text in the received event.
For example, the client information DB 118 stores a client information table 200 shown in FIG. The client information table 200 includes a client number. A column 201 and a use language column 202 are provided.
Client No. A column 201 indicates a code that can identify the client.
The use language column 202 indicates the language used by the client.

The layout conversion DB 119 stores the position of the object in the display document displayed in the language A in correspondence with the position of the object in the display document displayed in the language B that is a translation of the language A.
For example, the layout conversion DB 119 stores a layout conversion table 300 shown in FIG. The layout conversion table 300 includes a conversion source column 301, a conversion destination column 302, a conversion source region 303, a conversion destination region 304, an in-region origin 305, and an in-region conversion direction 306.
The conversion source column 301 indicates the language in the object that is the conversion source.
The conversion destination column 302 indicates the language in the object that is the conversion destination.

A conversion source area 303 indicates an area of an object that is a conversion source. For example, it may be a set of the upper left coordinates of the area (for example, coordinates in the electronic document or display document, the same applies hereinafter) and the width and height of the area.
A conversion destination area 304 indicates an area of an object that is a conversion destination. For example, it may be a set of the upper left coordinates of the area and the width and height of the area.
An in-region origin 305 indicates the position of the origin for the conversion destination region. For example, one of the four corners of the region.
The in-area conversion direction 306 indicates the description direction of the character string for the conversion destination area. For example, in the case of English, it indicates that the character string is described from the lower right, that is, from the upper left, which is the origin, to the lower right. In the case of vertical writing in Japanese, it indicates that the character string is described from the lower left, that is, from the upper right to the lower left. Japanese horizontal writing is the same as English.

  The layout conversion table 300 may store the origin of the conversion source area and the conversion direction. In addition, the layout conversion table 300 defines one area as a conversion source and a conversion destination so that the conversion source and the conversion destination can be converted bidirectionally. In other words, the first and second lines other than the title line have an opposite relationship. However, the relationship between the two regions may be defined by one line (the language of region 1 and region 2, its position, its origin, and the direction within that region).

The client 120 includes a user information acquisition module 121, a user information transmission module 122, an event collection module 123, an event transmission module 124, an image reception module 125, and an image display module 126.
The user information acquisition module 121 acquires the language used by the user of the client 120 as user information.
The user information transmission module 122 transmits the user information acquired by the user information acquisition module 121 to the event reception module 111 of the server 110 via the communication line 199.
The event collection module 123 detects the writing position for the language A display document.
The event transmission module 124 transmits the write position detected by the event collection module 123 to the event reception module 111 of the server 110 via the communication line 199.
The image receiving module 125 and the image display module 126 are equivalent to an image receiving module 135 and an image display module 136 of the client 130 described later.

The client 130 includes a user information acquisition module 131, a user information transmission module 132, an event collection module 133, an event transmission module 134, an image reception module 135, and an image display module 136.
The user information acquisition module 131, user information transmission module 132, event collection module 133, and event transmission module 134 are the above-described user information acquisition module 121, user information transmission module 122, event collection module 123, and event transmission module 124 of the client 120. It is equivalent.
The image reception module 135 receives the image transmitted by the image transmission module 117 of the server 110 via the communication line 199.
The image display module 136 displays the image received by the image receiving module 135.

FIG. 4 is a flowchart illustrating an example of initialization processing according to the first embodiment. That is, initialization performed in the server 110, which is a different language, but when the same content is displayed on the client 120 and the client 130, processing to be performed first will be described.
In step S <b> 402, the event reception module 111 of the server 110 acquires information about the user from the client 120 and the client 130. Prior to this, the user information acquisition module 121 of the client 120 acquires the language used by the user. For example, the language may be determined based on characters displayed on the screen to be shared, or the language used by the OS of the client 120 may be acquired. Then, the user information transmission module 122 of the client 120 sends such information to its own client number. At the same time, the data is transmitted to the event reception module 111 of the server 110. The client 130 is the same as the client 120.
In step S404, the event reception module 111 of the server 110 sends information about the user to the client number. At the same time, it is stored in the client information DB 118. Specifically, as in the client information table 200 shown in the example of FIG. And the corresponding language to be stored.

FIG. 5 is a flowchart illustrating an example of display processing of an electronic document according to the first embodiment. That is, a process for displaying the display document of the client 120 on the client 130 after translation and layout conversion will be described.
In step S <b> 502, the event reception module 111 of the server 110 receives an electronic document display request from the client 120 or the client 130.
In step S504, the object determination module 113 of the server 110 determines using the client information table 200 whether or not the usage language of the document to be displayed matches the usage language of the client to be displayed. That is, the client numbers of the clients 120 and 130 are changed. It is determined whether or not the use language corresponding to is matched. In this determination, if they match (Yes), the process ends (step S512), and the original text is displayed as it is because it is to be displayed in the same language. In other cases (No), the process proceeds to step S506.

In step S506, the translation module 114 of the server 110 translates the original text of the display document of the client 120. That is, translation is performed from the language used by the client 120 to the language used by the client 130.
In step S508, the layout conversion module 115 of the server 110 performs layout conversion of the object to be displayed, which is the translation result, according to the language of the translation result. Layout conversion uses existing technology in translation. Then, the image forming module 116 forms an image to be displayed by the client 130 based on the layout, and the image transmission module 117 transmits the image to the image receiving module 135 of the client 130 to display the image of the client 130. Module 136 displays the received image. For example, when the document image 710 shown in the example of FIG. 7A is displayed on the client 120 and is shared and displayed on the client 130, the objects 711, 712, and 713 are translated and the objects 721, 722, and 722 are translated. 723 is generated, the layout is converted from the vertical writing of the document image 710 to the horizontal writing of the document image 720, and the image of the document image 720 shown in the example of FIG. 7B is formed. The translation module 114 divides the sentence into objects such as objects 711, 712, and 713 by performing morphological analysis. The translation result is also divided into objects 721, 722, and 723 corresponding to the objects of the morphological analysis results.

  In step S510, the layout conversion module 115 of the server 110 stores the layout result in step S508 in the layout conversion DB 119. Specifically, as in the layout conversion table 300 shown in the example of FIG. 3, the language, position, origin in the region, and conversion direction are stored for the corresponding object. For example, when the conversion destination is Japanese vertical writing, as shown in the example of FIG. 8A, the upper right of the rectangular area of the object 711 is the origin 811 and the direction from the origin to the lower left is the conversion direction 812 (that is, 1 in a row from top to bottom and each row from right to left). Also, in the case of horizontal writing in English, as shown in the example of FIG. 8B, the upper left of the rectangular area of the object 721 is the origin 821, and the direction from the origin to the lower right is the conversion direction 822 (that is, From left to right, each line goes from top to bottom). The intra-region origin 305 and the intra-region conversion direction 306 indicate the state of the conversion destination region 304.

FIG. 6 is a flowchart illustrating a processing example of writing to a display document according to the first embodiment. Here, the processing in the server 110 when a write event occurs in the client 120 will be described.
In step S602, the event reception module 111 receives a write event of the client 120. The write event here includes one write (that is, the position coordinates of the locus from the write start position to the write end).
In step S604, the object determination module 113 determines whether or not the position where writing has started is the position of the object whose layout has been converted. In this determination, if it is the position of the object whose layout has been converted (Yes), the process proceeds to step S608, and otherwise (No), the process proceeds to step S606. Whether or not the position has undergone layout conversion is determined by whether or not the position where writing has started is within a predetermined distance from the conversion source region 303 of the layout conversion table 300 in the layout conversion DB 119.
In step S606, the image forming module 116 performs writing at the same coordinates as the coordinates of the writing source position. That is, equivalent writing is performed at the same position on the client 120 and the client 130.

In step S608, the layout conversion module 115 acquires the conversion destination area, origin, and conversion direction from the layout conversion table 300 in the layout conversion DB 119.
In step S610, the layout conversion module 115 calculates the coordinates of the writing position from the conversion destination information acquired in step S608. That is, the writing position in the client 130 is calculated. More specifically, the affine transformation count for transforming the coordinate meter is obtained so that the origin and the transformation direction of the transformation source region and the transformation destination region coincide. Then, the coordinates of the writing position at the conversion source are affine transformed to obtain the writing position at the conversion destination.
In step S612, the image forming module 116 forms a writing image on the client 130 based on the coordinates of the writing position calculated in step S610.
In step S614, the event reception module 111 waits for reception of the next write event of the client 120.
In step S616, if the write event is not accepted in step S616, it is determined that the process is finished (Yes), and the process proceeds to step S618. Otherwise, the process returns to step S610 to deal with the write event.

An example of writing to a translated sentence corresponding to a written document will be described with reference to FIGS.
First, a case will be described in which translation is performed and converted into a translation destination layout, but writing is not converted as in the present embodiment. As shown in the example of FIG. 9A, the document image 710 is a translation target, and the writing object 911 is written into the object 712. In this case, as shown in the example of FIG. 9B, the translated layout is like objects 721, 722, and 723 of the document image 720, but the write object 921 corresponding to the write object 911 is It is drawn at the same position as the writing object 911 in the document image 710.

  On the other hand, in the present embodiment, as shown in the example of FIG. 10B, the writing object 1021 is drawn on the object 723 corresponding to the object 712. That is, using the layout conversion table 300, it is found that the object 711 and the object 721, the object 712 and the object 723, and the object 713 and the object 722 correspond to each other, and the writing object 1011 is written to the object 712. It is determined from the writing position, and when the object 712 is the conversion source area, the conversion destination area is determined to be the object 723, and the document of the writing object 1011 is determined from the origin and the conversion direction. The coordinates in the image 720 are calculated, and the writing object 1021 is drawn on the document image 720.

With reference to FIG. 11, processing when writing is not for translation is described. That is, since a figure or the like is not a translation target, when writing is performed on the figure or the like, the drawing is performed without conversion to the writing.
FIG. 11A shows a case where the document image 710 includes objects 711, 712, and 713 that are translation targets and a graphic object 1111 that is not a translation target and a writing object 1112 corresponding to the graphic object 1111.
Similarly to the above, translation and layout conversion are performed on the objects 711, 712, and 713, and the objects 721, 722, and 723 are arranged in the document image 720 as shown in the example of FIG. However, since the graphic object 1111 is located at the lower left of the document image 710, the graphic object 1121 is located at the lower left also in the document image 720. That is, with respect to the coordinates of graphics and the like, conversion from a horizontally long document to a vertically long document is performed. For example, an object at the lower left in a horizontally long document is converted so as to have a lower left coordinate in a vertically long document. However, this conversion does not use the layout conversion table 300.
Since the graphic object 1111 within the predetermined distance of the writing object 1112 is not in the layout conversion table 300, it is determined that the writing object 1112 is not writing to the translation target. Then, in the same manner as the graphic object 1111, the writing object 1112 is converted from a horizontally long document to a vertically long document. As a result, the writing object 1122 is drawn under the graphic object 1121.

A case where the shape of writing is recognized and the position of writing is adjusted based on the shape will be described with reference to FIGS.
First, a case where writing conversion is performed without recognizing the writing shape will be described. As shown in the example of FIG. 12A, the writing object 1211 has the writing start position within a predetermined distance from the object 711 and is in the vicinity of the origin. In addition, the writing object 1221 is drawn from the vicinity of the origin of the object 721 also in the document image 720. However, since the writing object 1211 is a right line in vertical writing in Japanese, the writing object 1211 is drawn on the object 721 even though it is written in the meaning of underline in English.

  On the other hand, in the example shown in FIG. 13, the object determination module 113 recognizes that the shape of the writing object 1211 is a line, and the layout conversion module 115 adjusts the writing position. That is, as shown in the example of FIG. 13B, the writing position is adjusted from the writing object 1221 shown in the example of FIG. draw. In other words, if it is found that the shape of writing is a line and that the position is in a predetermined positional relationship with the translation object, the position adjustment of the object is performed after the above-described object position conversion (for example, the translation object For example, parallel movement for the height of.

14 and 15, when one writing is performed on a plurality of objects, and the plurality of objects corresponding to the translation destination are located at separate positions, the writing is also divided into a plurality of parts. Will be described.
First, one writing is performed on a plurality of objects, but a case where one writing is performed also at the translation destination will be described. As shown in the example of FIG. 14A, the writing object 1411 is writing to the objects 711 and 712, but as shown in the example of FIG. 14B, the writing object 1421 is written to the objects 721 and 722. It becomes writing. That is, although the object 711 corresponds to the object 721 and the object 712 corresponds to the object 722, the writing object 1421 surrounds the objects 721 and 722. This is because writing is converted only by the positional relationship of the writing start position with respect to the object.

  On the other hand, in the example shown in FIG. 15, it is determined whether writing is for a plurality of objects. If there are a plurality of objects, it is assumed that the corresponding object at the translation destination is at a distant position. Is drawn as a writing to each object. That is, as shown in the example of FIG. 15B, the writing object 1521 is drawn on the object 721 and the writing object 1522 is drawn on the object 723, respectively. That is, it is determined from the coordinates of the locus of the writing object 1411 that it is writing to the objects 711 and 712, and the objects corresponding to the respective objects are the objects 721 and 723, so the writing object 1411 is converted. Then, the writing object 1521 is drawn on the object 721 and the writing object 1522 is drawn on the object 723, respectively. Note that this processing may be performed for a case in which it is also determined whether or not the corresponding object of the translation destination is at a remote position, and at a remote position.

FIG. 16 is a conceptual module configuration diagram of a configuration example according to the second embodiment. In the present embodiment, the sharing of functions in the first embodiment is different between the server 1610 and the clients 1620 and 1630. In other words, in the first embodiment, the server 110 forms the image of the other party, but in this embodiment, the client of the other party forms an image.
Therefore, the second embodiment includes a server 1610, a client 1620, and a client 1630 as shown in FIG. 2, which are connected via a communication line 1699, respectively. The server 1610 includes an event reception module 1611, an event conversion module 1612, an object determination module 1613, a translation module 1614, a layout conversion module 1615, an event transmission module 1616, a client information DB 1618, and a layout conversion DB 1619. A user information acquisition module 1621, a user information transmission module 1622, an event collection module 1623, an event transmission module 1624, an event reception module 1625, an image formation module 1626, and an image display module 1627 are included. The client 1630 has a configuration equivalent to that of the client 1620. That is, the image forming module 116 of the server 110 of the first embodiment is moved to the clients 120 and 130, an event transmission module 1616 is added to the server 110 instead of the image transmission module 117, and an image reception module is added to the client 120. Instead of 125, an event reception module 1625 is added. The module having the same name as that of the first embodiment performs the same function.
The event transmission module 1616 transmits information regarding the layout to the client 1630 as an event in order to display the layout converted by the layout conversion module 1615 on the client 1630.
The event receiving module 1635 of the client 1630 receives the event, forms an image according to the layout received by the image forming module 1636, and the image display module 1637 displays the image.

  Note that the hardware configuration of the computer (server 110, 1610, client 120, 130, 1620, 1630) on which the program according to the above-described embodiment is executed is a general computer as illustrated in FIG. Specifically, a computer or the like that can be a server or a personal computer. A CPU 1701 that executes programs such as the object determination module 113, the translation module 114, the layout conversion module 115, and the image forming module 116 (in this example, a CPU is used as a calculation unit), a RAM 1702 that stores the programs and data, a book ROM 1703 storing a program for starting a computer, an auxiliary storage device HD 1704 (for example, a hard disk can be used), an input device 1706 for inputting data such as a keyboard and a mouse, a CRT and a liquid crystal display An output device 1705 such as a display, a communication line interface 1707 for connecting to a communication network (for example, a network interface card can be used), and connecting them to exchange data And a bus 1708 for Riosuru. A plurality of these computers may be connected to each other via a network.

Among the above-described embodiments, the computer program is a computer program that reads the computer program, which is software, in the hardware configuration system, and the software and hardware resources cooperate with each other. Is realized.
Note that the hardware configuration shown in FIG. 17 shows one configuration example, and the above-described embodiment is not limited to the configuration shown in FIG. 17, and the modules described in the above-described embodiment can be executed. Any configuration may be used. For example, some modules may be configured by dedicated hardware (for example, ASIC), and some modules may be in an external system and connected by a communication line. A plurality of systems shown in FIG. 5 may be connected to each other via communication lines so as to cooperate with each other. In particular, in addition to personal computers, information appliances, copiers, fax machines, scanners, printers, and multifunction machines (image processing apparatuses having two or more functions of scanners, printers, copiers, fax machines, etc.) Etc. may be incorporated.

In the above embodiment, the translation source language is vertically written in Japanese and the translation destination language is English. However, the present invention is not limited to this, and other combinations may be used. If the writing position is recognized and the writing position is adjusted, an adjustment rule according to the language or the description direction of the language may be stored. Rules may be used.
Further, although an electronic document is illustrated, any document that is shared and displayed among a plurality of clients may be used.

The program described above may be provided by being stored in a recording medium, or the program may be provided by communication means. In that case, for example, the above-described program may be regarded as an invention of a “computer-readable recording medium recording the program”.
The “computer-readable recording medium on which a program is recorded” refers to a computer-readable recording medium on which a program is recorded, which is used for program installation, execution, program distribution, and the like.
The recording medium is, for example, a digital versatile disc (DVD), which is a standard established by the DVD Forum, such as “DVD-R, DVD-RW, DVD-RAM,” and DVD + RW. Standards such as “DVD + R, DVD + RW, etc.”, compact discs (CDs), read-only memory (CD-ROM), CD recordable (CD-R), CD rewritable (CD-RW), etc. MO), flexible disk (FD), magnetic tape, hard disk, read only memory (ROM), electrically erasable and rewritable read only memory (EEPROM), flash memory, random access memory (RAM), etc. It is.
The program or a part of the program may be recorded on the recording medium for storage or distribution. Also, by communication, for example, a local area network (LAN), a metropolitan area network (MAN), a wide area network (WAN), a wired network used for the Internet, an intranet, an extranet, etc., or wireless communication It may be transmitted using a transmission medium such as a network or a combination of these, or may be carried on a carrier wave.
Furthermore, the program may be a part of another program, or may be recorded on a recording medium together with a separate program. Moreover, it may be divided and recorded on a plurality of recording media. Further, it may be recorded in any manner as long as it can be restored, such as compression or encryption.

It is a conceptual module block diagram about the structural example of 1st Embodiment. It is explanatory drawing which shows the example of a data structure of a client information table. It is explanatory drawing which shows the example of a data structure of a layout conversion table. It is a flowchart which shows the example of a process of the initialization by 1st Embodiment. 4 is a flowchart illustrating an example of electronic document display processing according to the first embodiment. It is a flowchart which shows the example of a write-in process to the display document by 1st Embodiment. It is explanatory drawing which shows the example of a display of an original sentence and a translation. It is explanatory drawing which shows the example of the area | region origin and the area | region conversion direction. It is explanatory drawing which shows the example of the writing to the translated sentence corresponding to the document in which writing was performed. It is explanatory drawing which shows the example of the writing to the translated sentence corresponding to the document in which writing was performed. It is explanatory drawing which shows the example of the writing to the translated sentence corresponding to the document in which writing was performed. It is explanatory drawing which shows the example of the writing to the translated sentence corresponding to the document in which writing was performed. It is explanatory drawing which shows the example of the writing to the translated sentence corresponding to the document in which writing was performed. It is explanatory drawing which shows the example of the writing to the translated sentence corresponding to the document in which writing was performed. It is explanatory drawing which shows the example of the writing to the translated sentence corresponding to the document in which writing was performed. It is a conceptual module block diagram about the structural example of 2nd Embodiment. It is a block diagram which shows the hardware structural example of the computer which implement | achieves 1st and 2nd embodiment.

Explanation of symbols

110, 1610 ... Server 111, 1611 ... Event reception module 112, 1612 ... Event conversion module 113, 1613 ... Object determination module 114, 1614 ... Translation module 115, 1615 ... Layout conversion module 116 ... Image forming module 117 ... Image transmission module 118 , 1618 ... Client information DB
119, 1619 ... Layout conversion DB
120, 130, 1620, 1630 ... Client 121, 131, 1621, 1631 ... User information acquisition module 122, 132, 1622, 1632 ... User information transmission module 123, 133, 1623, 1633 ... Event collection module 124, 134, 1624, 1634: Event transmission module 125, 135: Image reception module 126, 136, 1627, 1637 ... Image display module 199, 1699 ... Communication line 1616 ... Event transmission module 1625, 1635 ... Event reception module 1626, 1636 ... Image formation module

Claims (8)

Storage means for storing the position of the object in the image displayed in the first language in association with the position of the object in the image displayed in the second language in translation relation with the first language; ,
Write receiving means for receiving a position of writing to the image displayed in the first language;
Writing position calculating means for calculating the position of writing to the image displayed in the second language corresponding to the position of writing received by the writing receiving means using the storage means;
An image generating means for generating an image in which writing is performed on an image displayed in the second language based on the position calculated by the writing position calculating means. Processing equipment. Subject judging means for judging whether or not the subject is displayed in the first language based on the position of the writing received by the writing receiving means;
If the writing position calculating means determines that the writing is to be performed on the object displayed in the first language by the object determining means, the writing position calculating means uses the storage means by the write receiving means. The information processing apparatus according to claim 1, wherein a position of writing to an object to be displayed in the second language corresponding to the received position of writing is calculated. Subject judging means for judging whether or not the subject is displayed in the first language based on the position of the writing received by the writing receiving means;
The writing position calculating means determines the writing position received by the writing receiving means when the object determining means determines that it is not writing to the object displayed in the first language. The information processing apparatus according to claim 1, wherein a writing position for an image to be displayed is calculated in the corresponding second language. Writing shape recognition means for recognizing the shape of the writing based on the position of writing received by the writing receiving means;
The writing position calculating means adjusts the position of writing to the image displayed in the calculated second language based on the writing shape recognized by the writing shape recognition means. The information processing apparatus according to claim 1. Subject judging means for judging whether or not the writing is for a plurality of subjects based on the position of the writing received by the writing receiving means;
The writing position calculating means corresponds to the writing position received by the writing receiving means using the storage means when the object determining means determines that the writing is for a plurality of objects. The information processing apparatus according to claim 1, wherein positions of writing to a plurality of objects to be displayed in the second language are calculated. The first information processing terminal, the second information processing terminal and the information processing apparatus are connected via a communication line;
The first information processing terminal
Detecting means for detecting a position of writing with respect to the image displayed in the first language;
A position transmitting means for transmitting the position of writing detected by the detecting means to an information processing device;
The information processing apparatus includes:
The second information processing terminal displayed in a second language in translation relation with the position of the object in the image of the first information processing terminal displayed in the first language and the first language Storage means for correspondingly storing the position of the object in the image of
Position receiving means for receiving the write position transmitted by the position transmitting means of the first information processing terminal;
Writing position calculating means for calculating the position of writing to the image displayed in the second language corresponding to the position of writing received by the position receiving means, using the storage means;
Image generating means for generating an image written to the image displayed in the second language based on the position calculated by the writing position calculating means;
Image transmitting means for transmitting the image generated by the image generating means to the second information processing terminal;
The second information processing terminal is
Image receiving means for receiving an image transmitted by the image transmitting means of the information processing apparatus;
An information processing system comprising display means for displaying an image received by the image receiving means. The first information processing terminal, the second information processing terminal and the information processing apparatus are connected via a communication line;
The first information processing terminal
Detecting means for detecting a position of writing with respect to the image displayed in the first language;
A position transmitting means for transmitting the position of writing detected by the detecting means to an information processing device;
The information processing apparatus includes:
The second information processing terminal displayed in a second language in translation relation with the position of the object in the image of the first information processing terminal displayed in the first language and the first language Storage means for correspondingly storing the position of the object in the image of
Position receiving means for receiving the write position transmitted by the position transmitting means of the first information processing terminal;
Writing position calculating means for calculating the position of writing to the image displayed in the second language corresponding to the position of writing received by the position receiving means, using the storage means;
A calculated position transmitting means for transmitting the position calculated by the writing position calculating means to the second information processing terminal;
The second information processing terminal is
Calculated position receiving means for receiving the calculated position transmitted by the calculated position transmitting means of the information processing apparatus;
Image generating means for generating an image written to an image displayed in the second language based on the calculated position received by the calculated position receiving means;
An information processing system comprising display means for displaying an image generated by the image generation means. Computer
Storage means for storing the position of the object in the image displayed in the first language in association with the position of the object in the image displayed in the second language in translation relation with the first language; ,
Write receiving means for receiving a position of writing to the image displayed in the first language;
Writing position calculating means for calculating the position of writing to the image displayed in the second language corresponding to the position of writing received by the writing receiving means using the storage means;
Information that functions as image generation means for generating an image in which writing is performed on an image displayed in the second language based on the position calculated by the writing position calculation means Processing program.

Images