JP4661387B2 - Information processing apparatus, information processing method, and computer program - Google Patents

Description

  The present invention relates to an information processing apparatus, an information processing method, and a computer program. More specifically, the present invention relates to an information processing apparatus, an information processing method, and a computer program having a configuration in which a paper document and electronic data are used in combination.

  In recent years, computerization of document information has been performed in various fields. In addition to inputting text data and image data directly via a PC, for example, processing for reading character information recorded on paper media using OCR (Optical Character Recognition) and storing it in a database as text data, or character information A process of storing image information or the like in a database as image data using a scanner or the like is performed in various fields.

  For example, in the medical field, the digitization of medical records is being promoted. However, at present, many doctors who are medical chart creators directly write diagnosis information, findings, etc. on a medical record sheet as a paper medium. This is because of the legal aspects, the existence of users (doctors) who are unfamiliar with data entry, and the information entered in the chart often draws not only text information but also a figure of the body and internal organs showing the affected area. There are various aspects such as that it is not easy to generate these diagrams on a PC or the like. Under such circumstances, the digitization of medical charts is expected to continue the combined use of a medical chart as a paper medium and an electronic medical chart for a while.

  Under such circumstances, a processing configuration has been proposed in which data such as characters and figures entered by a user such as a doctor on a paper medium is captured as electronic data, and data on the paper medium is also recorded as electronic data. .

  For example, Patent Document 1 discloses a configuration in which the coordinate position information of a pen used by a user is acquired and character information or the like is converted into data using the pen locus as input data. Patent Documents 2 and 3 disclose a configuration in which a user captures the entire paper medium on which character information and the like are entered with a camera and inputs the entry information on the paper medium.

  Further, in Patent Document 4, in addition to a process in which the user captures the entire paper medium on which character information or the like is entered with a camera and inputs the entry information on the paper medium, Discloses a system that enables various processes such as data fetching and calling by projecting and displaying data such as icons recorded on an information processing apparatus such as a PC by a projector and giving instructions by operating a mouse. .

  On the other hand, as a data display or input device, an input display capable of inputting an image from a screen of a liquid crystal pen tablet or a liquid crystal display has been put into practical use in recent years due to technological progress. These devices can be embedded in a desk without taking up space, and record data using a user's pen without using a large-scale facility using a projector-type monitor or projector-type scanner (including a camera). It has become possible to easily obtain the electronic data and present the electronic data. Such a device is not only a fixed device of a desktop type, but also has become smaller and lighter and can be carried.

However, if you use a liquid crystal pen tablet or liquid crystal input display, place a paper document on the display screen of the liquid crystal pen tablet or liquid crystal input display, and try to record text, drawings, etc. on the paper document with a pen or other writing instrument In addition, when trying to read characters on a paper document, the following new problem occurs. (A) Since the display display appears to pass through the document, it is difficult to see.
(B) What is written on the back side of the document appears to be transparent (show-through), making it difficult to see.
Such a problem occurs.
Japanese Patent Laid-Open No. 06-266498 Japanese Patent Application Laid-Open No. 07-168949 JP 09-134442 A JP 09-319556 A

  Opportunities to use both paper media and electronic data together are expected to increase in the future. As described above, by applying a small and lightweight device such as a liquid crystal pen tablet or liquid crystal input display, place a paper document on the display screen of these liquid crystal pen tablet or liquid crystal input display, and record information on the paper document. The process of reading the information displayed on the display together and the process of recording the character on the paper document based on the information displayed on the display are, for example, only the configuration using the electronic medical chart described above. Rather, it is expected to be processing performed in various fields.

  However, in such processing, as described above, a paper document is placed on a liquid crystal pen tablet or a liquid crystal input display, and a character, a drawing, or the like is recorded on the paper document with a writing instrument such as a pen, When trying to read characters on a paper document, display display data and what is written on the back side of the document appear to be transparent (show-through), which causes a problem that it is difficult to see.

  The present invention has been made in view of such problems, and in a configuration in which a paper document and electronic data that can be displayed on a liquid crystal pen tablet or a liquid crystal input display are used in combination, display display data, Information processing apparatus and information processing method capable of solving a problem that it is difficult to see because what is written on the back side of the document is seen through (through-through) and providing a good working environment to the user And a computer program.

The first aspect of the present invention is:
A display control unit for performing output control of display data to the display input device;
A placement object detection unit for detecting the presence or position of the placement object on the display input device;
The display control unit
In the information processing apparatus, the control is performed so that the display information corresponding to the placement position on the display input device is controlled to be display data of uniform color based on the detection information of the figurine detection unit. .

  Furthermore, in one embodiment of the information processing apparatus of the present invention, the display control unit is configured to input a command or call data on an outer peripheral portion of the position of the placement object on the display input device detected by the object detection unit. It is the structure which performs the display process of this input part.

  Furthermore, in one embodiment of the information processing apparatus according to the present invention, the display control unit recognizes, via the placement object, a position corresponding to the position of the placement object on the display input device detected by the object detection unit. The present invention is characterized in that the command input or display processing of the input unit for data call is executed.

  Furthermore, in one embodiment of the information processing apparatus according to the present invention, the display control unit recognizes, via the placement object, a position corresponding to the position of the placement object on the display input device detected by the object detection unit. The present invention is characterized in that it is configured to execute the data display processing that has been made possible.

  Furthermore, in one embodiment of the information processing apparatus of the present invention, the display input device has a sensor function for detecting writing information of a pen for writing information to a paper medium placed on the display input device. The information processing apparatus is configured to execute a process of inputting write information from the display input device and storing the information in a data storage unit.

  Furthermore, in an embodiment of the information processing apparatus according to the present invention, the information processing apparatus further passes the writing information of a pen for performing information writing on the paper medium placed on the display input device via a bent. It has an interface corresponding to a pen for inputting.

Furthermore, the second aspect of the present invention provides
An information processing method,
A detection step of detecting the presence or absence or position of an object placed on the display input device;
Based on the detection information detected in the detection step, a display control step for executing control to display display information corresponding to the placement position on the display input device as display data of uniform color;
There is an information processing method characterized by comprising:

  Furthermore, in an embodiment of the information processing method of the present invention, the information processing method further includes a command input or a data call for an outer peripheral portion of the position of the placed object on the display input device detected in the detection step. And a step of executing display processing of the input unit.

  Furthermore, in an embodiment of the information processing method of the present invention, the information processing method further recognizes a position corresponding to the position of the placement object on the display input device detected in the detection step via the placement object. It has a step of executing a process of displaying an enabled command input or data call input unit.

  Furthermore, in an embodiment of the information processing method of the present invention, the information processing method further recognizes a position corresponding to the position of the placement object on the display input device detected in the detection step via the placement object. The method includes a step of executing the display processing of the enabled data.

  Furthermore, in one embodiment of the information processing method of the present invention, the information processing method further includes detecting writing information of a pen for writing information on a paper medium placed on the display / input device. And a step of inputting write information via the display input device and executing a process of storing the information in a data storage unit.

  Furthermore, a third aspect of the present invention is a computer program that executes information processing on a computer, and detects the presence or position of a placement object placed on a display input device; and the detection step And a display control step for executing control to make display information corresponding to the position of the object on the display input device into display data of uniform color based on the detection information detected in It is in.

  Note that the computer program of the present invention is a recording medium provided in a computer-readable format for a computer system capable of executing various program codes, for example, a recording medium such as a CD, FD, or MO. A computer program that can be provided by a medium or a communication medium such as a network. By providing such a program in a computer-readable format, processing corresponding to the program is realized on the computer system.

  Other objects, features, and advantages of the present invention will become apparent from a more detailed description based on embodiments of the present invention described later and the accompanying drawings. In this specification, the system is a logical set configuration of a plurality of devices, and is not limited to one in which the devices of each configuration are in the same casing.

  According to the configuration of the present invention, the position of a placement object (for example, a paper medium) placed on the display input device is detected, and the display information corresponding to the detected position of the placement object on the display input device is displayed in a uniform color. Since it is configured to execute the control to display data, when placing a paper document on the display and trying to record characters, drawings, etc. with a writing instrument such as a pen on the paper document, characters on the paper document, etc. When trying to read, the display display data and what is written on the back side of the document appear to be transparent (show-through), which solves the problem of difficulty in viewing and provides a good working environment for the user. It becomes possible.

  Further, according to the configuration of the present invention, the display control process executes the command input or the display process of the data calling input unit on the outer peripheral portion of the position of the placement object (for example, paper medium) on the display input device. With this configuration, it is possible to efficiently perform a process in which a user who writes to a paper medium calls related information from a database, and the work efficiency can be improved.

  Details of the information processing apparatus, information processing method, and computer program of the present invention will be described below with reference to the drawings.

  First, with reference to FIG. 1, the configuration and usage of the information processing apparatus of the present invention will be described. The user 100 executes a process of superimposing the paper medium 101 on the display input device 120 placed on the desk and writing a character or a figure using the pen 130.

  The display input device 120 has a data display function such as a liquid crystal display or a liquid crystal tablet, for example, and further has a sensor function for detecting a position where the paper 101 is placed. As an example of the sensor function, a configuration including a scanner function may be used.

  The pen 130 is configured as a pen that can output handwriting information. Alternatively, the display input device 120 has a function of detecting handwriting information of the pen 130. The pen is configured so that it can actually write characters with built-in ink.

  When the handwriting information can be output from the pen 130, the pen 130 is connected to the information processing apparatus 200 such as a PC by wire or wirelessly. The digital pen interface unit 204 of the information processing apparatus 200 communicates with the pen 130 to acquire pen movement information (trajectory) information. The pen 130 can scan the code information recorded in advance on the paper medium 101, and can acquire handwriting information by the code sequence scanned by the pen 130. The code information recorded in advance on the paper medium 101 is recorded on the paper as an invisible code that can be scanned by the scanning process of the pen 130.

  When the display input device 120 has a function of detecting handwriting information of the pen 130, the display device 120 is provided with an input tablet function. The display input device 120 is connected to an information processing apparatus 200 such as a PC by wire or wirelessly. The tablet control unit 203 of the information processing apparatus 200 acquires pen movement information (trajectory) information from the display input device 120.

  As shown in FIG. 1, the display input device 120 is connected to an information processing apparatus 200 that outputs display data for the display input device 120 and executes processing control for detecting a position where the paper 101 is placed. ing. The information processing apparatus 200 is configured by a PC or the like.

  As shown in the figure, the information processing apparatus 200 includes a display control unit 201, a placement object detection unit 202, a tablet control unit 203, a digital pen interface unit 204, a control unit 205, a storage unit 206, and a communication I / F 207. As described above, both the tablet control unit 203 and the digital pen interface unit 204 execute processing for acquiring handwriting information of the pen 130 and may be configured to include either one.

  The display control unit 201 of the information processing apparatus 200 executes display data output control for the display input device 120. The placement object detection unit 202 inputs detection information on the position or presence of the placement object placed on the display input device 120 such as the paper medium 101. The control unit 205 executes processing control and data transfer control of each processing unit. The storage unit 206 functions as a storage unit for display data for the display input device 120 and write data for the paper medium 101 based on handwriting information input from the pen 130 or the display input device 120. The control unit 205 performs input / output control and storage control of these data. The storage unit 206 is further used as a storage area for various processing programs. The communication I / F executes communication processing with the information processing apparatus 250 such as an external server connected to the information processing apparatus 200 via a network.

  A configuration example of the display input device 120 will be described with reference to FIG. The example illustrated in FIG. 2 is a configuration example of the display input device 120 when the display input device 120 is configured to have a function of detecting handwriting information of the pen 130.

  As shown in FIG. 2, the display input device 120 has functional units of a touch sensor 121, a display device 122, and a sensor (scanner) 123. The touch sensor 121 detects handwriting information and a contact position of the pen 130. The detection information is input to the tablet control unit 203 of the information processing apparatus 200 shown in FIG.

  The display input device 122 displays display data output from the display control unit 201 of the information processing apparatus 200 illustrated in FIG. A sensor (scanner) 123 detects a position where the paper 101 or the like is placed. The detection information is input to the placement object detection unit 202 of the information processing apparatus 200 shown in FIG.

  Specific processing in the information processing apparatus 200 of the present invention will be described with reference to FIG. FIG. 3 shows a processing state in which the paper medium 101 is placed on the display input device 120 and the user performs writing using the pen 130. Here, the user is a doctor, the writing information for the medical chart is written on the paper medium 103, and various information recorded in the database is displayed on the display input device 120.

  As described above, when placing a paper document on the display and writing characters, drawings, etc. on the paper document with a pen, or when trying to read characters on a paper document, the display data or the back of the document The problem is that it is difficult to see because the material written on the screen appears transparent (show-through). The information processing apparatus 200 of the present invention detects the area of the paper medium placed on the display input device 120 by the sensor 123 described with reference to FIG. 2, and detects the detection information via the placement object detection unit 202. input.

  Further, the display control unit 201 deletes the display data corresponding to the position of the paper based on the position information of the paper and executes display control set to a uniform color such as black or gray. . FIG. 4 shows a data display configuration on the back side of the paper medium 103. A uniform color display area 301 shown in FIG. 4 shows a display screen of the display input device 120 corresponding to the position where the paper medium is placed. The display control unit 201 stops the display of text data, graphic data, and the like in the uniform color display area 301 and sets the display area as a uniform display color such as black or gray.

  As a result of this display control, it is possible to prevent a phenomenon in which the display display data or what is written on the back side of the document is seen through (paper show) through the paper medium. The process of writing characters, drawings, and the like on a document with a pen and the process of reading characters on a paper document can be performed without any sense of incongruity, as with a paper document placed on a desk.

  Furthermore, other processing configurations executed in the information processing apparatus 200 will be described with reference to FIG. FIG. 5 shows a processing state in which the paper medium 101 is placed on the display input device 120 and the user performs writing using the pen 130, as in FIG. Here, the user is a doctor, the writing information for the medical chart is written on the paper medium 103, and various information recorded in the database is displayed on the display input device 120.

  On the display input device 120, registration information corresponding to a specific patient, for example, X-ray image information of the patient, which is read out from the database by a doctor as a user in advance, is displayed as general display data 321. By placing the paper medium 101 on the display data, as described with reference to FIG. 4, the display data of the placement position of the paper medium 101 is erased and set as a display area such as black or gray. Further, paper medium corresponding display data 322 is displayed around the paper medium 101.

  For example, as shown in FIG. 5, the paper medium correspondence display data 322 is divided into items such as “examination”, “prescription”, “medical history”, and each item has an input unit for command input or data call. Is displayed. For example, input items such as [blood], [blood pressure], and [electrocardiogram] are displayed in the examination item. For example, contact information is displayed and input by bringing the pen 130 into contact with the input portion position of [blood]. 120 is input to the information processing apparatus 200.

  The touch position of the pen 130 is detected by the touch sensor 121 described with reference to FIG. 2, and the detection information is input to the tablet control unit 203 of the information processing apparatus 200 illustrated in FIG. If it is determined that the pen 130 is in contact with the display position of [Blood] in the test item based on this input information, the control unit 205 controls the storage unit 206 shown in FIG. 1 or a network-connected server. The blood information corresponding to the patient designated in advance is read out from the database managed by and is output to the display input device 120 via the display control unit 201. Blood information is displayed in the display area of the general display data 321 of the display input device 120.

  The same applies to the input units arranged in other items such as “prescription” and “medical history”, and by touching each input unit with the pen 130, data corresponding to each input unit is stored from the storage unit or the database. The information is read and displayed in the general display data display area of the display input device 120.

  Next, a configuration example to which a portable display input device is applied will be described with reference to FIG. A display input device 420 illustrated in FIG. 6 is a portable display input device. The portable display / input device 420 is provided with a clip 401 for fixing the paper medium 410, and the position of the paper medium is basically fixed. Therefore, a high-functional sensor function such as a scanner for detecting the paper setting position can be omitted, and a simple sensor for detecting only the presence or absence of paper is installed.

  FIG. 7 shows the sensor 428. Basically, the size of the paper to be loaded is defined, and the sensor 428 detects only whether or not the paper medium 410 is loaded. The detection information is transmitted to an information processing apparatus (not shown) by wire or wireless. The information processing apparatus has the configuration described above with reference to FIG. 1 and displays the paper medium corresponding display data 422 shown in FIG. 6 around the paper medium 410 according to the sensing information.

  The paper-medium display data 422 has the same configuration as described above, and is divided into items such as “examination”, “prescription”, and “medical history”, and each item is used for command input or data call Is displayed. When the pen 130 is brought into contact with these input units, corresponding data is read, and the read data is displayed on the display input device 420. These processes are the same as the process configuration described above.

  Next, referring to FIG. 8 and the subsequent figures, it is possible to view the display data corresponding to the paper medium displayed on the display input device according to the placement of the placed object such as the paper medium through the placed object (paper medium). A configuration example will be described. In the above-described configuration, the paper medium correspondence display data is described as an example of a configuration in which the paper medium correspondence display data 322 shown in FIG. 5 or the paper medium correspondence display data 422 shown in FIG. 6 is displayed around the paper medium. did.

  However, by configuring a paper medium or the like as a placement object as a material having high light transmittance, the data is displayed in the display area at the back position of the paper medium, and the display data is viewed through the placement object (paper medium). It can be. For example, as shown in FIG. 8, the paper medium corresponding display data 422 is displayed via the paper medium 472.

  The display input device 470 detects that the paper medium 472 is placed, and controls to display the paper medium corresponding display data 422 at the paper medium placement position. The user can view the paper medium corresponding display data 422 through the paper medium 472 having a high light transmittance. In this configuration, it is preferable that the paper medium 472 is set in advance into a user writing area and a non-writing area, and the paper medium corresponding display data 422 is displayed in the non-writing area.

  Furthermore, as shown in FIG. 9, the graphic data may be displayed via a paper medium 472. In the example shown in FIG. 9, a picture (schema) showing a body part is displayed as the paper medium correspondence display data 474. The user (doctor) can write diagnostic information such as a tumor and excision, prescription information, and the like with reference to this picture (schema). In addition, by tracing this picture (schema) as a background picture, it is possible to easily record a complicated internal organ configuration on a paper medium.

  The display input device is preferably provided with a dedicated switch that can be turned ON / OFF. For example, in ophthalmology, we examine in darkness, turn on lights, and fill in a medical record. This is to cope with this. Further, it is preferable to detect the ambient brightness and control the amount of light. It has a correspondence table of optimum light quantity corresponding to the ambient brightness, and the value can be changed. For example, a light amount setting means is provided, and when the user manually adjusts and presses the registration button, the ambient brightness and set value at that time are registered in the table. Furthermore, it is good also as a structure which detects the mistake etc. of the character which the user is inputting with the pen, and displays a red blinking pattern in the position. For example, when a doctor writes a prescription, the drug name and dosage are detected and the determined upper limit is exceeded.

  Next, a sequence of one processing example executed by the information processing apparatus of the present invention will be described with reference to the flowchart shown in FIG. Description will be made in association with the configuration of the information processing apparatus shown in FIG.

  First, in step S101, it is detected whether a paper medium is placed on the display input device 120. This detection process is performed by the sensor 123 of the display input device 120 described with reference to FIG. 2, and detection information is input to the placement object detection unit 202. If it is detected in step S102 that the paper medium is placed, the process proceeds to step S103, and display control for setting the display data of the paper medium placement position to a uniform color, for example, black or gray is executed. This control is executed by the display control unit 201 according to the placement position information of the paper medium whose detection information is input to the placement object detection unit 202.

  Next, in step S104, display data corresponding to the paper medium is displayed around the paper medium placement position. This is, for example, the paper medium corresponding display data 322 shown in FIG. This processing is also executed by the display control unit 201 in accordance with the paper medium placement position information whose detection information is input to the placement object detection unit 202.

  Next, in step S105, it is determined whether or not there is an input from the input unit set in the paper medium compatible display data. This is the process described with reference to FIG. 5, and for example, contact information is input from the display input device 120 to the information processing apparatus 200 by bringing the pen 130 into contact with the input portion position of “blood” shown in FIG. 5. Is done. The touch position of the pen 130 is detected by the touch sensor 121 described with reference to FIG. 2, and the detection information is input to the tablet control unit 203 of the information processing apparatus 200 illustrated in FIG.

  If it is determined in step S105 that there is an input from the input unit set in the paper medium compatible display data, the process proceeds to step S106, and the requested content is determined based on the position information of the input unit. In step S107, the determination information is displayed. Based on the data processing, that is, data acquisition, display processing of acquired data, and the like are executed.

  Specifically, for example, when the pen 130 is brought into contact with the [blood] input unit position shown in FIG. 5, the touch position of the pen 130 is detected by the touch sensor 121 described with reference to FIG. 2. The detection information is input to the tablet control unit 203 of the information processing apparatus 200 shown in FIG. 1, and it is determined that the pen 130 has touched the display position of [blood] in the test item. The blood information corresponding to the patient designated in advance is read from the storage unit 206 shown in FIG. 5 or the database managed by the server connected to the network, and is output to the display input device 120 via the display control unit 201. Blood information is displayed in the display area of the general display data 321 of the display input device 120.

  Note that the processing example shown in FIG. 10 is a processing example corresponding to an embodiment of the information processing apparatus of the present invention. For example, in step S104, the processing is described as processing for displaying paper medium correspondence display data around the paper medium. However, as in the example described with reference to FIG. 8, such data may be displayed at the placement position of the paper medium, and the user may view the display data through the paper medium.

[Hardware configuration example]
Finally, a hardware configuration example of an information processing apparatus that performs the above-described processing will be described with reference to FIG. The hardware configuration shown in FIG. 11 is a configuration in which a general computer configuration includes a pen 508 and a display input device 510 having the functions described in the above-described embodiments.

  A CPU (Central Processing Unit) 501 is an OS (Operating System) as well as various processing sequences describing various processing sequences such as display control, paper medium placement position detection, and handwriting information analysis processing with a pen described in the above-described embodiments. It is a control part which performs the process according to a computer program.

  A ROM (Read Only Memory) 502 stores programs used by the CPU 501, calculation parameters, and the like. A RAM (Random Access Memory) 503 stores programs used in the execution of the CPU 501, parameters that change as appropriate during the execution, and the like. These are connected to each other by a host bus 504 including a CPU bus.

  The host bus 504 is connected to an external bus 506 such as a PCI (Peripheral Component Interconnect / Interface) bus via a bridge 505.

  The pen 508 functions as an input device operated by the user, and handwriting information is written or input via the display input device 510. For example, as described with reference to FIG. 2, the display input device 510 has functions of a touch sensor, a display device, and a sensor (scanner).

  An HDD (Hard Disk Drive) 511 includes a hard disk, drives the hard disk, and records or reproduces a program executed by the CPU 501 and information. The hard disk stores, for example, various data such as electronic medical record information, and various computer programs such as a data processing program for executing the processing described above.

  The drive 512 reads data or a program recorded in a removable recording medium 521 such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory, and the data or program is read out from the interface 507 and the external bus 506. , And supplied to the RAM 503 connected via the bridge 505 and the host bus 504. Similarly to the hard disk, the removable recording medium 521 can also serve as a storage unit for various types of computer programs such as various types of data such as electronic medical record information and data processing programs for executing the above-described processing.

  The connection port 514 is a port for connecting the external connection device 522 and has a connection unit such as USB or IEEE1394. The connection port 514 is connected to the CPU 501 and the like via the interface 507, the external bus 506, the bridge 505, the host bus 504, and the like. The communication unit 515 is connected to a network and executes data communication processing with the outside.

  Note that the hardware configuration example of the information processing apparatus illustrated in FIG. 11 is an example of a single apparatus configured by applying a basic PC configuration, and the information processing apparatus of the present invention has the configuration illustrated in FIG. However, the present invention is not limited to this, and any configuration that can execute the processing described in the above-described embodiments may be used.

  The present invention has been described in detail above with reference to specific embodiments. However, it is obvious that those skilled in the art can make modifications and substitutions of the embodiments without departing from the gist of the present invention. In other words, the present invention has been disclosed in the form of exemplification, and should not be interpreted in a limited manner. In order to determine the gist of the present invention, the claims should be taken into consideration.

  The series of processes described in the specification can be executed by hardware, software, or a combined configuration of both. When executing processing by software, the program recording the processing sequence is installed in a memory in a computer incorporated in dedicated hardware and executed, or the program is executed on a general-purpose computer capable of executing various processing. It can be installed and run.

  For example, the program can be recorded in advance on a hard disk or ROM (Read Only Memory) as a recording medium. Alternatively, the program is temporarily or permanently stored on a removable recording medium such as a flexible disk, a CD-ROM (Compact Disc Read Only Memory), an MO (Magneto optical) disk, a DVD (Digital Versatile Disc), a magnetic disk, or a semiconductor memory. It can be stored (recorded). Such a removable recording medium can be provided as so-called package software.

  The program is installed on the computer from the removable recording medium as described above, or is wirelessly transferred from the download site to the computer, or is wired to the computer via a network such as a LAN (Local Area Network) or the Internet. The computer can receive the program transferred in this manner and install it on a recording medium such as a built-in hard disk.

  Note that the various processes described in the specification are not only executed in time series according to the description, but may be executed in parallel or individually according to the processing capability of the apparatus that executes the processes or as necessary. Further, in this specification, the system is a logical set configuration of a plurality of devices, and the devices of each configuration are not limited to being in the same casing.

  As described above, according to the configuration of the present invention, the position of the paper medium placed on the display input device is detected, and the display information corresponding to the detected position of the paper medium on the display input device is uniform. Since the control for color display data is executed, a paper document is placed on the display, and when trying to record characters, drawings, etc. with a pen or other writing tool on the paper document, When trying to read characters, the display data and what is written on the back of the document appear to be transparent (show-through), which solves the problem of difficulty in viewing and provides a good working environment for the user. It becomes possible.

  Furthermore, according to the configuration of the present invention, the display control process is configured to execute the display process of the input unit for command input or data call on the outer periphery of the position of the paper medium on the display input device. A user who writes to a paper medium can efficiently perform processing such as calling related information from a database, thereby improving work efficiency.

It is a figure explaining the structure and utilization aspect of the information processing apparatus of this invention. It is a figure explaining the structural example of a display input device. It is a figure explaining the specific process to which the information processing apparatus of this invention is applied. It is a figure which shows the data display structure of the back surface of the paper medium in a display input device. It is a figure explaining the example of a process which displays paper medium corresponding | compatible display data around a paper medium. It is a figure explaining the structural example to which a portable display input device is applied. FIG. It is a figure explaining the structural example of the display input device provided with the sensor which detects the presence or absence of a paper medium. It is a figure explaining the structural example which enabled it to see through a paper medium the display data corresponding to a paper medium displayed on a display input device according to mounting of a paper medium. It is a figure explaining the structural example which enabled it to see through a paper medium the display data corresponding to a paper medium displayed on a display input device according to mounting of a paper medium. It is a figure which shows the flowchart explaining the sequence of the example of 1 process which the information processing apparatus of this invention performs. It is a figure explaining the hardware structural example of the user terminal which comprises the information notification system of this invention, a management server, and a printing medium output device.

Explanation of symbols

DESCRIPTION OF SYMBOLS 100 User 101 Paper medium 120 Display input device 121 Touch sensor 122 Display device 123 Sensor (scanner)
DESCRIPTION OF SYMBOLS 200 Information processing apparatus 201 Display control part 202 Placed object detection part 203 Tablet control part 204 Digital pen interface part 205 Control part 206 Storage part 207 Communication I / F
250 Information processing device (server)
301 Uniform Color Display Area 321 General Display Data 322 Paper Medium Corresponding Display Data 401 Clip 410 Paper Medium 420 Display Input Device 421 General Data Display Area 422 Paper Medium Corresponding Display Data 428 Sensor 470 Display Input Device 472 Paper Medium 473 Paper Medium Corresponding Display Data 474 Display data for paper medium 501 CPU (Central Processing Unit)
502 ROM (Read-Only-Memory)
503 RAM (Random Access Memory)
504 Host bus 505 Bridge 506 External bus 507 Interface 508 Pen 510 Display input device 511 HDD (Hard Disk Drive)
512 drive 514 connection port 515 communication unit 521 removable recording medium 522 external connection device

Claims (8)

A display control unit for performing output control of display data to the display input device;
A placement object detection unit for detecting the presence or position of the placement object on the display input device;
The display control unit
Based on the detection information of the above- mentioned figurine detection unit, among the displayed images displayed on the display input device, the image portion of the area corresponding to the placement position on the display input device is displayed in a uniform black or gray color. An information processing apparatus having a configuration for executing control to change . The display control unit
Of the displayed display image of the display input device, an input for command input or data call instead of the image portion of the outer peripheral portion of the position of the placement object on the display input device detected by the object detection unit described above the information processing apparatus according to claim 1, characterized in that a configuration for performing display parts. The display input device is:
A sensor function for detecting writing information of a pen for writing information on a paper medium placed on the display input device;
The information processing apparatus includes:
The information processing apparatus according to claim 1, wherein the information processing apparatus is configured to execute a process of inputting write information from the display input device and storing the input information in a data storage unit. The information processing apparatus further includes:
The information processing apparatus according to claim 1, further comprising: a pen-compatible interface for inputting writing information of a pen for writing information to a paper medium placed on the display input device via a vent. . An information processing method,
A detection step of detecting the presence or absence or position of an object placed on the display input device;
Based on the detection information detected in the detection step, among the display images displayed on the display input device, the image portion of the region corresponding to the placement position on the display input device is displayed in a uniform black or gray color A display control step for executing control to change to
An information processing method characterized by comprising: The information processing method further includes:
Of the displayed display image of the display input device , change to the image portion of the outer peripheral portion of the position of the placed object on the display input device detected in the detection step, The information processing method according to claim 5 , further comprising a step of performing display. The information processing method further includes:
Detecting writing information of a pen for writing information to a paper medium placed on the display input device;
Inputting write information via the display input device and executing a process of storing the information in a data storage unit;
The information processing method according to claim 5 , further comprising: A computer program that executes information processing on a computer;
A detection step of detecting the presence or absence or position of an object placed on the display input device;
Based on the detection information detected in the detection step, among the display images displayed on the display input device, the image portion of the region corresponding to the placement position on the display input device is displayed in a uniform black or gray color A display control step for executing control to change to
A computer program characterized by comprising:

Images