JP2009003531A - Electronic pen and program used for it - Google Patents

Abstract

The present invention provides an electronic pen that outputs a predetermined sound in accordance with the entry contents and taps on the electronic pen medium of the electronic pen and a program used therefor.
A user fills in and taps an electronic pen medium with an electronic pen. The electronic pen 80 recognizes the coding pattern address, the page type, and the like by acquiring entry information corresponding to the entry contents on the electronic pen medium and referring to the definition information. Then, the electronic pen 80 recognizes the tap to the area corresponding to the recognized coded pattern address and the like, recognizes the character string based on the entry information according to the tap information, and registers it in association with the coded pattern address. Create information. In addition, the electronic pen 80 outputs a predetermined voice related to the character string registered as registration information in accordance with the tap information. Therefore, the electronic pen 80 can manage the character string and the coded pattern address of the electronic pen medium in which the character string is entered in association with each other, and can output a predetermined voice.
[Selection] Figure 7

Description

  The present invention relates to a technique for processing entry information entered on an electronic pen medium or the like with an electronic pen.

  In recent years, pen-type input devices called “electronic pens” and “digital pens” have appeared (hereinafter referred to as “electronic pens” in this specification). The developed “Anoto pen” is known (see Patent Document 1). Anotopen is used in a pair with dedicated paper (hereinafter also referred to as “dedicated paper”) on which a predetermined dot pattern is printed. In addition to the normal ink-type pen tip, the Anoto pen is equipped with a small camera for reading the dot pattern on the dedicated paper and a data communication unit. When a user writes characters on the special paper with an annotation pen, or puts a check mark on the image designed on the special paper, the small camera displays the dot pattern printed on the special paper as the pen moves. Entry information such as characters and images detected and written by the user is acquired. This entry information is transmitted from the Anotopen by the data communication unit to a terminal device such as a nearby personal computer or mobile phone. The system using this anotopen can be used as an input device in place of the keyboard, and is very easy to use for users who are reluctant to use the personal computer and keyboard described above. Therefore, as a method for digitizing data entered in various business documents, application forms, contracts, etc., a system using an electronic pen is becoming widespread (for example, Patent Document 2).

Japanese translation of PCT publication No. 2003-511761 JP 2004-153612 A

  SUMMARY OF THE INVENTION An object of the present invention is to provide an electronic pen that outputs a predetermined sound in accordance with a predetermined processing result based on an entry content and a tap on the electronic pen medium, and a program used therefor.

  An electronic pen according to the present invention is an electronic pen that processes information written on an electronic pen medium on which a coding pattern that can be recognized by the electronic pen is printed, and identifies a predetermined area on the coding pattern. Information storage means for storing definition information in which the coded pattern address to be associated and the area type of the area on the coded pattern are associated with each other, and entry information corresponding to the entry contents on the electronic pen medium is acquired. An entry information acquisition means, an area recognition means for recognizing the area type by referring to the definition information based on a coded pattern address included in the entry information, and based on the entry information, the area recognition means Tap recognition means for recognizing a tap to an area corresponding to the recognized coded pattern address, and the tap recognition means A character string recognizing means for recognizing a character string made up of one or more characters by recognizing the entry information based on a recognition result by the character string; a character string recognized by the character string recognizing means; and the area recognizing means. Registration information creating means for creating registration information in association with the coding pattern address recognized by the computer.

  According to this configuration, when the user fills in the electronic pen medium with the electronic pen or taps it by tapping, the electronic pen responds to the entry and tap on the electronic pen medium by the entry information acquisition means. Get information to fill in. Then, the area recognizing unit recognizes the area type by referring to the definition information stored in the information storage unit based on the coded pattern address included in the entry information acquired by the entry information acquiring unit. Further, the tap recognition means recognizes a tap to the area corresponding to the coded pattern address recognized by the area recognition means based on the entry information, and the character string recognition means, based on the recognition result by the tap recognition means, A character string composed of one or more characters is recognized by recognizing the entry information. Then, the registration information creating unit creates registration information in which the character string recognized by the character string recognizing unit is associated with the coded pattern address recognized by the area recognizing unit. As described above, the electronic pen recognizes the coded pattern address based on the entry information entered in the electronic pen medium by the user, and based on the tap to the area corresponding to the recognized coded pattern address. Then, the character string is recognized by recognizing the entry information, and registration information in which the recognized character string is associated with the recognized coded pattern address is created. Thereby, the electronic pen can manage the character string and the encoded pattern address of the electronic pen medium in which the character string is written in association with each other.

  Furthermore, in the electronic pen, a process execution area that is an area associated with execution of a process for outputting sound is set on the coded pattern printed on the electronic pen medium, and the electronic pen A voice output unit that outputs voice based on voice data, an output address storage unit that stores a coded pattern address corresponding to the tapped area based on a recognition result by the tap recognition unit, and the output address A character string extraction unit that extracts a corresponding character string from the registration information based on the coded pattern address stored by the storage unit, and a voice that generates voice data based on the character string extracted by the character string extraction unit A sound generating unit that outputs sound based on the sound data generated by the sound data generating unit from the sound output unit; Characterized in that it comprises a power means.

  According to this configuration, when the user taps and taps the area of the medium for the electronic pen with the electronic pen, the output address storage means corresponds to the area tapped with the electronic pen based on the recognition result by the tap recognition means. The encoding pattern address to be stored is stored. Further, the character string extraction means refers to the registration information created by the registration information creation means based on the coded pattern address stored by the output address storage means, and extracts the corresponding character string. The voice data creation means creates voice data based on the character string extracted by the character string extraction means, and the voice output means causes the voice output unit to output voice based on the voice data created by the voice data creation means. . In this way, the electronic pen recognizes the area tapped by the user, extracts the character string registered in association with the recognized area, creates voice data based on the character string, and outputs the voice can do. In other words, it is possible to create voice data and output voice based on a character string entered by the user in an arbitrary area of the electronic pen medium.

  The electronic pen further includes a start / end point specifying means for specifying a data start point and a data end point based on the registration entry information, and the tap recognition means includes the data start point and the data end point. It is preferable to recognize a tap to an area corresponding to the coded pattern address recognized by the area recognition means based on the time and / or distance based on the time.

  According to the electronic pen configured as described above, the start / end point specifying means specifies the data start point and the data end point based on the entry information. Then, the tap recognizing unit recognizes the tap to the area corresponding to the coded pattern address recognized by the area recognizing unit based on the time and / or distance based on the data start point and the data end point. In this way, the tap recognition means determines whether or not the stroke entered by the user is a tap based on the time and / or distance based on the data start point and the data end point. The tap to the area corresponding to the coded pattern address recognized by the recognition means can be distinguished from characters and symbols.

  In another aspect of the present invention, an electronic pen that processes information written on a medium for an electronic pen printed with a coding pattern recognizable by the electronic pen, and identifies a predetermined area on the coding pattern Information storage means for storing definition information in which the coded pattern address to be associated and the area type of the area on the coded pattern are associated with each other, and entry information corresponding to the entry contents on the electronic pen medium is acquired. An entry information acquisition means, an area recognition means for recognizing the area type by referring to the definition information based on a coded pattern address included in the entry information, and based on the entry information, the area recognition means A tap recognition unit for recognizing a tap to an area corresponding to the recognized coded pattern address; and A character string recognizing means for recognizing a medicine name consisting of a character string of two or more characters by recognizing the entry information based on a recognition result, a medicine name recognized by the character string recognizing means, and the area recognition Registration information creating means for creating registration information in association with the coding pattern address recognized by the means.

  According to this configuration, when the user enters a chemical name on the electronic pen medium with the electronic pen or taps the electronic pen with a tap, the electronic pen enters and taps the electronic pen medium by the entry information acquisition means. Get entry information corresponding to. Then, the area recognizing unit recognizes the area type by referring to the definition information stored in the information storage unit based on the coded pattern address included in the entry information acquired by the entry information acquiring unit. Further, the tap recognition means recognizes a tap to the area corresponding to the coded pattern address recognized by the area recognition means based on the entry information. Based on the recognition result by the tap recognizing means, the character string recognizing means recognizes a medicine name composed of a character string of two or more characters by recognizing the entry information. Then, the registration information creating means creates registration information in which the drug name recognized by the character string recognizing means is associated with the coded pattern address recognized by the area recognizing means. As described above, the electronic pen recognizes the coded pattern address based on the entry information entered in the electronic pen medium by the user, and based on the tap to the area corresponding to the recognized coded pattern address. The drug name is recognized by character recognition of the entry information, and registration information in which the recognized drug name is associated with the recognized coded pattern address is created. Thereby, the electronic pen can manage the medicine name and the encoded pattern address of the electronic pen medium in which the medicine name is written in association with each other.

  Further, in the electronic pen, a process execution area that is an area associated with execution of a process of outputting sound is set on the coded pattern printed on the electronic pen medium, and the information storage The means further stores drug information in which the drug name, other drug names, and information on side effects when two drugs are swallowed are associated with each other, and the electronic pen stores voice data. Based on the recognition result by the tap recognition means, the output address storage means for storing the coded pattern address corresponding to the tapped area, and the output address storage means. Character string extraction means for extracting the corresponding drug name from the registration information based on the coded pattern address, and the character string extraction means Referencing the drug information based on the drug name, the drinking information creating means for creating the drinking information of the drug that causes side effects, and the drinking information created by the drinking information creating means, Voice data creating means for creating voice data for presenting a drink of medicine to be produced; and voice output means for outputting voice based on the voice data created by the voice data creating means from the voice output unit. And

  According to this configuration, when the user taps and taps the area of the medium for the electronic pen with the electronic pen, the output address storage means corresponds to the area tapped with the electronic pen based on the recognition result by the tap recognition means. Recognize the coded pattern address. Further, the character string extraction means refers to the registration information created by the registration information creation means based on the coded pattern address stored by the output address storage means, and extracts the corresponding medicine name. Then, the drinking information creation means creates the drinking information of the medicine that causes a side effect with reference to the medicine information stored by the information storage means based on the medicine name extracted by the character string extraction means. Then, the voice data creation means creates voice data that presents the drinking of the medicine that causes side effects based on the drinking information created by the drinking information creation means, and the voice output means A sound based on the created sound data is output from the sound output unit. In this way, the electronic pen recognizes the area tapped by the user, extracts the drug name registered in association with the recognized area, and drinks a drug that causes side effects based on the drug name. The voice data to be presented can be created and voice can be output. In other words, the user can easily confirm the drinking of a drug causing a side effect by voice based on the drug name written in an arbitrary area of the electronic pen medium by a simple operation.

  The electronic pen further includes a start / end point specifying means for specifying a data start point and a data end point based on the registration entry information, and the tap recognition means includes the data start point and the data end point. It is preferable to recognize a tap to an area corresponding to the coded pattern address recognized by the area recognition means based on the time and / or distance based on the time.

  According to the electronic pen configured as described above, the start / end point specifying means specifies the data start point and the data end point based on the entry information. Then, the tap recognizing unit recognizes the tap to the area corresponding to the coded pattern address recognized by the area recognizing unit based on the time and / or distance based on the data start point and the data end point. Thereby, the tap recognizing means determines whether or not the stroke written by the user is a tap based on the time and / or distance based on the data start point and the data end point, and is recognized by the area recognizing means. The tap to the area corresponding to the coded pattern address thus made can be distinguished from characters and symbols.

  The program according to the present invention is a program executed by an electronic pen that processes information entered on an electronic pen medium on which a coded pattern that can be recognized by the electronic pen is printed, Information storage means for storing definition information in which a coded pattern address for identifying a predetermined area in the code pattern and an area type of the area on the coded pattern are associated with each other, corresponding to the contents entered in the electronic pen medium Entry information obtaining means for obtaining entry information, area recognition means for recognizing the area type by referring to the definition information based on a coded pattern address included in the entry information, and the area based on the entry information Tap recognition that recognizes taps to the area corresponding to the coded pattern address recognized by the recognition means A character string recognizing means for recognizing a character string composed of one or more characters by recognizing the entry information based on a recognition result by the tap recognizing means; a character string recognized by the character string recognizing means; Registration information creation means for creating registration information in association with the coding pattern address recognized by the area recognition means; a coding pattern address corresponding to the tapped area based on the tap recognized by the tap recognition means Output address storage means for storing, a character string extraction means for extracting a corresponding character string from the registration information based on the coded pattern address stored by the output address storage means, and a character string extracted by the character string extraction means Based on the voice data created by the voice data creation means, Audio output means for outputting Ku audio from the audio output unit, as is characterized in that to function the electronic pen.

  Alternatively, another program according to the present invention is a program that is executed by an electronic pen that processes information written on a medium for an electronic pen on which a coding pattern that can be recognized by the electronic pen is printed. Information storage means for storing definition information in which a coded pattern address for identifying a predetermined area on a pattern and an area type of the area on the coded pattern are associated with each other, and information entered in the electronic pen medium Entry information acquisition means for acquiring corresponding entry information, area recognition means for recognizing the area type by referring to the definition information based on a coded pattern address included in the entry information, based on the entry information, Recognizing a tap to an area corresponding to the coded pattern address recognized by the area recognition means Based on the recognition result by the tap recognition means, the character string recognition means for recognizing a medicine name consisting of two or more characters by recognizing the entry information, and the character string recognition means A registration information creation unit that creates registration information in which the drug name and the coded pattern address recognized by the area recognition unit are associated, and a code corresponding to the tapped area based on the recognition result by the tap recognition unit Output address storage means for storing an encoded pattern address, character string extraction means for extracting a corresponding medicine name from the registered information based on the coded pattern address stored in the output address storage means, and extraction by the character string extraction means Refer to the drug information based on the name of the drug you created and create a drink information for drugs that cause side effects. Based on the swallowing information created by the swallowing information creating means, sound data creating means for creating sound data that presents the swallowing of a drug that causes side effects, and the sound created by the sound data creating means The electronic pen function is used as voice output means for outputting voice based on data from the voice output unit.

  According to the electronic pen and the program used for the electronic pen according to the present invention, a character string is registered in association with the tapped area or a predetermined voice is received in accordance with the entry content and tap on the electronic pen medium of the electronic pen. Can be output. Moreover, the medicine name registered in association with the area tapped by the user can be extracted, and voice data can be created to output the medicine that presents the drinking of the medicine that causes side effects. In other words, the user can easily confirm the drinking of a drug causing a side effect by a simple operation based on the drug name written in an arbitrary area of the electronic pen medium.

  Preferred embodiments of the present invention will be described below with reference to the drawings.

  As shown in FIGS. 1 and 2, the information processing system according to the present embodiment includes an electronic pen 80, a dedicated paper (medium for electronic pen) 20 (medicine record book 30), and a terminal device 85. Here, FIG. 1 is a diagram schematically showing a usage pattern of the electronic pen 80, and FIG. 2 is a block diagram showing a configuration of the electronic pen 80. A dot pattern (coded pattern) is printed on the dedicated paper 20 (medicine record book 30). The electronic pen 80 includes a pen tip portion 17 similar to a normal ink pen. When a user writes characters on the dedicated paper 20 by the pen tip portion 17 in the same manner as a normal ink pen, the electronic pen 80 The dot pattern printed on the dedicated paper 20 is read locally and continuously along the movement trajectory of the pen tip portion 17, and the coordinates of the local position on the dedicated paper 20 are calculated. Based on the coordinate data and the like, Predetermined processing is executed, such as recognizing the entered character or performing processing according to the tap. Hereinafter, each configuration will be described in detail.

  The terminal device 85 includes, as hardware, an antenna device capable of data communication with the electronic pen 80, a processor such as a CPU, a memory such as ROM and RAM, a speaker, a display, and the like, a PC, a mobile phone, or It is a mobile terminal.

[Dedicated paper]
First, the dedicated paper (electronic pen medium) 20 will be described. The dedicated paper 20 is a paper in which a dot pattern is printed on a sheet of paper, and further, designs, items such as ruled lines and entry frames, words, words, illustrations, and the like are printed thereon. The dot pattern is printed with ink containing carbon that absorbs infrared rays. In addition, the design and the like are printed with ordinary ink that does not contain carbon. The dot pattern and the design may be printed on the paper at the same time, or either one may be printed first.

  FIG. 3 shows an example of the dedicated paper 20 on which a design or the like is printed. The example shown in FIG. 3 is an example of a page (area) of the medicine record book 30. The medicine record book 30 is a page (hereinafter referred to as “entry page”) in which a medicine name is entered by the electronic pen 80 for each hospital or each prescription date as shown in FIGS. 3 (a) and 3 (b). As shown in FIG. 3C, it is used as a cover of the medicine record book 30 and is executed by the electronic pen 80 as a drinking process execution page 33 which is an output process for confirming the drinking of the medicine. It has a page (hereinafter referred to as “process execution page”) in which a predetermined process is associated in advance. A different dot pattern is printed on each page (predetermined area) of the medicine record book 30, and a dot pattern address (coded pattern address) for identifying the dot pattern printed on each page is assigned.

  In the present embodiment, as shown in FIGS. 3A and 3B, the hospital name is printed on the entry page in advance, and the medicine name prescribed for each hospital is entered. On the page on which the hospital name “A hospital” is printed (hereinafter referred to as “A hospital entry page 31”), the dot pattern dress “10.30.20.1” is displayed as shown in FIG. On the assigned page on which the hospital name “B hospital” is printed (hereinafter referred to as “B hospital entry page 32”), as shown in FIG. 3B, the dot pattern address “10.30.20. 2 ”is assigned. Also, the dot pattern address “10.30.20.9” is assigned to the drinking process execution page 33 as shown in FIG.

  The user enters the medicine name prescribed at the hospital in the medicine record book 30 by using the electronic pen 80 without being aware of the dot pattern. For example, when going to hospital A and hospital B, the user enters the name of the medicine prescribed at hospital A on the hospital A entry page 31 as shown on the left side of FIG. Further, as shown on the right side of FIG. 4A, the user enters the name of the medicine prescribed at the B hospital on the B hospital entry page 32.

  Further, when the user wants to confirm the drinking of medicines prescribed at a plurality of hospitals, the user uses the electronic pen 80 and the page on which the corresponding hospital name is printed and the drinking process are associated with each other. Is tapped (tap on the dedicated paper (medium 20 for electronic pen 20) of the pen tip portion 17 of the electronic pen 80). For example, when the user wants to confirm the combination of the medicine prescribed at Hospital A and the medicine prescribed at Hospital B, the user can enter the A hospital entry page 31, the B hospital entry page 32, and the B hospital entry page 32, as shown in FIG. Tap the drinking process execution page 33 in order (the * mark represents a tap).

[Dot pattern]
Next, a dot pattern (coded pattern) will be described. FIG. 5 is a diagram for explaining the relationship between dots of a dot pattern printed on the medicine record book 30 (dedicated paper 20) and values to which the dots are converted. As shown in FIG. 5, each dot of the dot pattern is associated with a predetermined value depending on its position. That is, each dot is associated with a value of 0 to 3 depending on which direction the top, bottom, left, or right is shifted from the reference position of the grid (intersection of the vertical and horizontal lines). The value of each dot can be further converted into a first bit value for the X coordinate and a second bit value for the Y coordinate. The position coordinates on the dedicated paper 20 are determined by the combination of information thus associated.

  FIG. 6A shows an arrangement of a certain dot pattern. As shown in FIG. 6A, 6 × 6 dots are arranged in a range of about 2 mm in length and width so that a unique pattern can be obtained regardless of where 6 × 6 dots are taken on the dedicated paper 20. ing. The dot pattern formed by these 36 dots has position coordinates (for example, where the dot pattern is located on the dedicated paper 20) and a dot pattern address (coding) unique to each dedicated paper 20. Pattern address). FIG. 6B is a diagram in which each dot shown in FIG. 6A is converted into a value associated with the regularity shown in FIG. 5 according to the shift direction from the reference position of the lattice. This conversion is performed by the electronic pen 80 that captures a dot pattern image.

[Electronic pen]
Next, the electronic pen 80 will be described. As shown in FIG. 2, the electronic pen 80 includes a processor 11, a memory 12, a data communication unit 13, a battery 14, an LED 15, a camera 16, a pressure sensor 18, a speaker (audio output unit) 19, and a clock 22. . The electronic pen 80 has an ink cartridge (not shown) as a component similar to a normal ink pen.

  The battery 14 is for supplying electric power to each component in the electronic pen 80. For example, the power of the electronic pen 80 itself is turned on / off by detaching a cap (not shown) of the electronic pen 80. May be. The clock 22 transmits the current time (time stamp) and supplies it to the processor 11. The pressure sensor 18 detects the pressure applied to the pen tip portion 17 when the user writes characters or the like on the medicine record book 30 (dedicated paper 20) with the electronic pen 80, that is, the writing pressure, and supplies the pressure to the processor 11. .

  The processor 11 switches the LED 15 and the camera 16 on and off based on the writing pressure data given from the pressure sensor 18. That is, when a user writes a character or the like on the medicine record book 30 with the electronic pen 80, a pen pressure is applied to the pen tip portion 17, and when the pressure sensor 18 detects a writing pressure exceeding a predetermined value, the processor 11 determines that the user has started entry in the medicine record book 30 and activates the LED 15 and the camera 16.

  The LED 15 is attached in the vicinity of the pen tip of the electronic pen 80, and irradiates infrared rays toward the vicinity (region 15a) of the pen tip portion 17 on the medicine record book 30 (see FIG. 1). The region 15 a is slightly shifted from the position where the pen tip portion 17 contacts the medicine record book 30. The camera 16 captures a dot pattern in the area 15 a illuminated by the LED 15 and supplies image data of the dot pattern to the processor 11. Here, since carbon absorbs infrared rays, the infrared rays irradiated by the LED 15 are absorbed by the carbon contained in the dots at the dot portions. Therefore, the dot portion has a small amount of infrared reflection, and the portion other than the dot has a large amount of infrared reflection. Therefore, the area of the dot containing carbon and the other area can be distinguished from the difference in the amount of reflected infrared light by photographing with the camera 16. Even if a ruled line, a frame, or the like is printed in the photographing region, the dot pattern can be recognized because the ink of the ruled line, the frame, etc. does not contain carbon. Note that the imaging area of the camera 16 is a range including a size of about 2 mm × about 2 mm as shown in FIG. 6A, and the imaging of the camera 16 is performed about 50 to 100 times per second.

  While the user performs an entry in the medicine record book 30, the processor 11 uses the dot pattern of the image data supplied by the camera 16 to calculate the stroke X corresponding to the entry by the user on the medicine record book 30. Y coordinates (also simply referred to as “coordinate data”) are continuously calculated. That is, the processor 11 converts the image data of the dot pattern as shown in FIG. 6A supplied by the camera 16 into the data array shown in FIG. 6B, and further converts the X coordinate bit value · Y The coordinate bit value is converted, X and Y coordinate data is calculated from the data array by a predetermined calculation method, and a dot pattern address (coded pattern address) that is a unique identifier for each page of the medicine record book 30 is calculated. calculate. The processor 11 acquires time information from the clock 22 that transmits the current time (time stamp), associates the time information with the pen pressure data, the dot pattern address, and the X and Y coordinate data, and fills in these information. Obtain as information. Further, the processor 11 executes a predetermined process based on the entry information. Here, the 6 × 6 dot pattern in one sheet of dedicated paper (electronic pen medium) 20 does not overlap in the medicine record book 30, so the user fills in the necessary items with the electronic pen 80. When the user taps or taps, the area of the medicine record book 30 corresponding to the entry or tap can be specified from the coordinate data.

  The memory 12 stores entry information in time series by the processor 11. Although details will be described later, the memory 12 stores definition information and medicine information in advance. Further, the memory 12 stores registration information created by a registration information creating means 66 described later. The memory 12 temporarily stores the drinking information created by the drinking information creating means 70 described later. The capacity of the memory 12 can be, for example, about 1 Mbyte to 2 Gbyte.

  The speaker 19 reproduces and outputs voice data corresponding to the entry in the medicine record book 30 and the tap according to the output instruction from the processor 11.

  The data communication unit 13 wirelessly transmits predetermined data in the memory 12 supplied by the processor 11 to a terminal device 85 in the vicinity. Transmission by the data communication unit 13 is preferably performed by wireless transmission using Bluetooth (registered trademark). Note that data transmission from the data communication unit 13 to the terminal device 85 may be performed by other methods such as wired transmission using a USB cable or data transmission by contact with a terminal.

  Here, functions of the electronic pen 80 will be described with reference to FIG. FIG. 7 is a functional block diagram showing the main configuration of the electronic pen 80. The electronic pen 80 performs a predetermined process by executing a dedicated application based on the entry information such as the acquired X and Y coordinate data.

  As shown in FIG. 7, the electronic pen 80 functionally includes an information storage unit 60, entry information acquisition unit 61, area recognition unit 62, start / end point identification unit 63, tap recognition unit 64, and user area setting unit 65. Character string recognition means 66, registration information creation means 67, output address storage means 68, prescription drug name extraction means 69, drinking information creation means 70, voice data creation means 71, voice output means 72, and data communication means 73. . The information storage unit 60 is physically configured by the memory 12 such as a ROM or a RAM, and the entry information acquisition unit 61 is configured by the camera 16, the clock 22, the processor 11, and the like. Also, area recognition means 62, start / end point identification means 63, tap recognition means 64, user area setting means 65, character string recognition means 66, registration information creation means 67, output address storage means 68, prescription drug name extraction means 69, The drinking information creation means 70 and the sound data creation means 71 are incorporated in a processor 11 such as a CPU. The audio output means 72 is constituted by the speaker 19 and the processor 11 and the like, and the data communication means 73 is constituted by the data communication unit 13 such as an antenna and the processor 11 and the like.

  As shown in FIG. 8, the information storage unit 60 stores definition information in which dot pattern addresses, page types, and page names are associated with each other. For example, the page type “entry page” and the page name “A hospital entry page” are stored in association with the dot pattern address “10.30.20.1”, and the dot pattern address “10.30.20.2” is stored. The page type “entry page” and the page name “B hospital entry page” are stored in association with each other, and the page type “processing execution page” and the page name “drink” are associated with the dot pattern address “10.30.20.9”. “Adjustment processing execution page” is stored. The process execution page is a page associated with a predetermined process executed by the electronic pen 80, and the drinking process execution page 33 is a process execution page associated with an output process for informing the medicine of drinking. is there.

  Further, as shown in FIG. 9, the information storage unit 60 stores drug information in which basic drug names, indications / effects, swallowing drug names, side effects, and risk levels are associated with each other. The name of the basic drug is the name of the basic drug that is the basis for referring to drinking, and the efficacy and effect are the efficacy and effect of the basic drug. The drinking chemical name is the name of the drinking chemical that is taken together with the basic chemical. A side effect is a side effect that occurs when a basic drug and a swallowing drug are taken together. The risk level is obtained by quantifying the risk level to the human body according to the side effect, and is expressed by a numerical value from “0” to “10” in the present embodiment. For example, in relation to the basic drug name "Rabbit", when taking the effect and efficacy "sterilize the causative bacteria causing inflammation" and the swallowing drug name "Mutasco Tablets" and Ragbit and Mutasco Tablets together Memorized side effects such as loss of appetite etc. and risk of side effects of “2”, and another side-effect drug “Kipsadine” and side effects “Angiitis” that occur when taking Rugbit and Kipsazine together The risk of side effects “6” is stored.

  Further, the information storage means 60 stores the entry information acquired by the entry information acquisition means 61 in time series. The information storage unit 60 stores registration information (see FIG. 11) created by a registration information creation unit 66 (to be described later) and temporarily stores drinking information created by the drinking information creation unit 70. .

  The entry information acquisition means 61 is means for acquiring entry information corresponding to the entry contents on the dedicated paper (electronic pen medium) 20 using the electronic pen 80 by the user. The entry information acquisition unit 61 converts the dot pattern image data as shown in FIG. 6A supplied by the camera 16 into a data array as shown in FIG. The data is further converted into an X-coordinate bit value / Y-coordinate bit value, X and Y coordinate data is calculated from the data array by a predetermined calculation method, and dots set for each page of the medicine record book 30 The pattern address is calculated. The entry information acquisition means 61 acquires time information from the clock 22 that transmits the current time (time stamp), associates the time information with the pen pressure data, the dot pattern address, and the X and Y coordinate data, and Information is acquired as entry information, stored in the information storage means 60, and transmitted to the area recognition means 62. The entry information includes information to be acquired when a tap (light tap on the medicine record book 30 of the pen tip portion 17 of the electronic pen 80), characters, symbols, pictures, and the like are entered. The entry information acquired by tapping is called tap information. The time information included in the tap information is called a tap time.

  The area recognition means 62 recognizes the page type by referring to the definition information (see FIG. 8) stored in the information storage means 60 based on the dot pattern address included in the entry information. Further, the area recognizing means 62 refers to the registration information (see FIG. 11) based on the coordinate data included in the entry information, and if the corresponding user area is registered, the user of the user area Recognize the area ID. That is, the area recognizing means 62 recognizes the dot pattern address, the page type, and the user area ID associated with the page of the medicine record book 30 in which characters and the like are entered with the electronic pen 80. When the area recognized by the area recognition unit 62 is a process execution page, the electronic pen 80 executes a predetermined process associated with the process execution page, such as a drinking output process or a data transmission process. When the area recognized by the area recognition unit 62 is an entry page, the area recognition unit 62 temporarily stores the recognized information in the information storage unit 60 and transmits the information to the start / end point identification unit 63.

  The start / end point specifying unit 63 specifies the data start point and the data end point of the stroke included in the entry information acquired by the entry information acquisition unit 61 and transmits them to the tap recognition unit 64. Specifically, the start / end point specifying unit 63 specifies the coordinate data indicating the position coordinates of the data start point and the data end point, and the entry time. The tap recognition means 64 is a stroke entered in the medicine record book 30 by the user based on the time at the data start point and the data end point specified by the start / end point specification means 63 and / or the movement distance between the two points. Is determined to be a tap, and the tap to the page corresponding to the dot pattern address, page type, and user area ID recognized by the area recognition means 62 is recognized and temporarily stored in the information storage means 60. , To the user area setting means 65. At this time, the user information associated with the dot pattern address “10.30.20.1” is not registered in the registration information, and the area recognition unit 62 recognizes only the dot pattern address and the page type. Will be.

  Specifically, there are three methods for determining whether or not the stroke entered on the dedicated paper (electronic pen medium) 20 by the user is a tap. As a first method, the tap recognition unit 64 calculates the difference between the entry time of the data end point and the entry time of the data start point, and the difference is less than a predetermined time (for example, 0.2 seconds). In some cases, it is determined that the stroke is a tap. As another second method, the tap recognizing unit 64 calculates a movement distance (length of a written line) between the data start point and the data end point based on the coordinate data, and the movement distance is calculated in advance. You may make it determine with a stroke being a tap when it is less than the predetermined distance set. Alternatively, as a third method, conditions may be attached to both the time and the moving distance at the data start point and the data end point to determine whether or not the stroke is a tap.

  When the tap recognition unit 64 recognizes the tap on the entry page, the user area setting unit 65 uses the entry stroke stored in the medicine record book 30 by the user based on the entry information stored in the information storage unit 60. The position information on the record book 30 is calculated and set as a user area. Specifically, the user area setting means 65 fills in the medicine record book 30 based on the maximum and minimum values of the X position and the maximum and minimum values of the Y position based on the X and Y information included in the entry information. An area including a stroke is calculated, and a user area ID is assigned as coordinate data of the user area, and is associated with the entry information. As shown in FIG. 10, the data (xn, yn), Hn, and Wn constituting the coordinate data are the coordinates of the vertex V (xn, yn) of each page on the dot pattern and the height in the Y-axis direction ( Height), meaning the width in the X-axis direction (Width). Further, when the user area setting unit 65 determines that the entry information to be set as the user area is not stored in the information storage unit 60, the tap information transmitted by the tap recognition unit 64 is sent to the output address storage unit 68. introduce.

  The character string recognition unit 66 executes character recognition processing by HWR (Hand Writing Recognition), OCR (Optical Character Recognition), or the like based on the entry information associated with the user area set by the user area setting unit 65. Then, the entry stroke on the entry page is recognized as a character string. Note that the electronic pen 80 is preliminarily equipped with a character recognition engine capable of executing character recognition processing by HWR, OCR, or the like.

  The registration information creating unit 67 includes a character string recognized by the character string recognizing unit 66, a user area ID and coordinate data of the user area set by the user area setting unit 65 corresponding to the character string, and an area recognizing unit. Registration information that associates the dot pattern address recognized by 62 is created and stored in the information storage means 60. That is, as shown in FIG. 11, the registration information corresponds to the dot pattern address, the coordinate data of the user area, and the prescription drug name (character string) entered on the entry page by the user using the electronic pen 80. Information.

  For example, when the user enters the medicine name “Ragbit” prescribed by the hospital A in the hospital A entry page 31 of the dot pattern address “10.30.20.1” using the electronic pen 80, the area recognition means The dot pattern address “10.30.20.1” recognized by 62, the user area ID “A01” of the user area set by the user area setting means 65, and the coordinate data “(x1, y1), H1, W1” ”And the prescription drug name“ Ragbit ”recognized by the character string recognition unit 66 are stored in the information storage unit 60. Similarly, the dot pattern address “10.30.20.1”, the user area ID “A02”, the coordinate data “(x2, y2), H2, W2”, and the prescription drug name “Clarby” are stored in association with each other. Is done. Further, when the user enters the medicine name “Mutasco Tablet” prescribed by Hospital B on the Hospital B entry page 32 of the dot pattern address “10.30.20.2” using the electronic pen 80, the dot pattern An address “10.30.20.2”, a user area ID “B01”, coordinate data “(x4, y4), H4, W4”, and a prescription drug name “Mutasco Tablet” are stored in association with each other. According to this registered information, it can be seen that the prescription drug name “Ragbit” and the prescription drug name “Cullaby” are written on the same page because the dot pattern addresses are the same. On the other hand, since the prescription drug name “Mutasco Tablet” has a different dot pattern address, it can be seen that the prescription drug name “Rugbit” and the prescription drug name “Clarby” are entered on a different page.

  When the tap information recognized by the tap recognition unit 64 is transmitted from the user area setting unit 65, the output address storage unit 68 temporarily stores the dot pattern address included in the tap information in the information storage unit 60 as an output address. Memorize.

  When the area recognized by the area recognizing unit 62 is the drinking process execution page 33, the prescription drug name extracting unit 69 temporarily stores the dot pattern address stored in the information storage unit 60 by the output address storage unit 68. Based on the above, referring to the registration information (see FIG. 11) stored in the information storage means 60, all prescription drug names (character strings) registered in association with the dot pattern address are extracted. That is, the prescription drug name extraction unit 69 extracts all prescription drug names that are preliminarily entered in the entry page tapped with the electronic pen 80 and registered as registration information. Then, the prescription drug name extraction unit 69 transmits the extracted prescription drug name to the swallow information creation unit 70.

  The drinking information creation means 70 refers to the medicine information (see FIG. 9) stored in the information storage means 60 based on the prescription medicine name (character string) extracted by the prescription medicine name extraction means 69. It creates drinking information that associates drug names, side effects caused by taking these drugs together, and the risk of side effects. That is, as shown in FIG. 12, the drinking information is information in which the first medicine name, the second medicine name, the side effect, and the risk level are associated with each other. For example, if the prescription drug name extracted by the prescription drug name extraction means 69 includes the prescription drug name “Rabbit” and the prescription drug name “Mutasco Tablet”, the drinking information creation means 70 is based on “Ragbit”. By referring to the drug information as the drug name, it can be seen that “Mutasco Tablets” is included in the swallowed drug name and causes a side effect “loss of appetite, etc.” of risk “2”. Therefore, the swallowing information creation means 70 corresponds to the swallowing information with the first drug name “Rabbit”, the second drug name “Mutasco Tablet”, the side effect “loss of appetite”, and the risk “2”. I'm wearing it. The drinking information creation means 70 temporarily stores the created drinking information in the information storage means 60 and transmits it to the voice data creation means 71.

  The voice data creation means 71 creates voice data that presents a drink of a medicine that causes a side effect by executing a voice synthesis process based on the drink information created by the drink information creation means 70, This is transmitted to the output means 72. For example, voice data is generated that outputs a voice saying “If you take ragbit and Mutasco tablets at the same time, there is a risk of side effects such as loss of appetite”. The electronic pen 80 is assumed to be equipped with a speech synthesis engine capable of executing speech synthesis processing in advance.

  The voice output unit 72 causes the voice output unit (speaker) 19 to reproduce and output the voice data created by the voice data creation unit 71.

  The data communication unit 73 transmits / receives data to / from the terminal device 85. For example, the data communication unit 73 is used for downloading a dedicated application or drug information to be installed in the electronic pen 80, and displays the drinking information created by the drinking information creation unit 70 on the display of the terminal device 85. Therefore, the voice data created by the voice data creation means 71 may be used to transmit drinking information or voice data to the terminal device 85 in order to output the voice data from the speaker of the terminal device 85.

  The electronic pen 80 includes the above-described units by installing a dedicated application.

[Dedicated application]
Next, the dedicated application 55 will be described with reference to FIG. FIG. 13 shows a module configuration of the dedicated application 55. The dedicated application 55 executes a predetermined process based on entry information which is digital data corresponding to the contents entered in the medicine record book 30 (dedicated paper 20) using the electronic pen 80 by the user. The electronic pen 80 is installed in advance by downloading or the like. The dedicated application 55 is associated with the dedicated paper 20 in principle. That is, if the type of the dedicated paper 20 is different, the dedicated application for processing the data written in each dedicated paper 20 is different depending on the type. However, the correspondence between the dedicated paper 20 and the dedicated application is not necessarily one-to-one, and data may be processed by associating one dedicated application 55 with a plurality of types of dedicated paper 20. Further, data may be processed by associating a single type of dedicated paper 20 with a plurality of dedicated applications.

  As shown in FIG. 13, the dedicated application 55 includes an information storage module 301, an entry information acquisition module 302, an area recognition module 303, a start / end point identification module 304, a tap recognition module 305, a user area setting module 306, and a character string recognition module. 307, a registration information creation module 308, an output address storage module 309, a prescription drug name extraction module 310, a drinking information creation module 311, a voice data creation module 312, a voice output module 313, and a data communication module 314.

  The information storage module 301 provides the information storage means 60 with definition information (see FIG. 8) in which a dot pattern address, page type, and page name are associated with each other, a basic medicine name, an efficacy / effect, and a drink. In addition to having a function of storing medicine information (see FIG. 9) in which the name of a combined medicine, a side effect, and a risk level are associated with each other, entry information acquired by the entry information acquisition module 302 for the information storage unit 60; The information storage means 60 is stored in the electronic pen 80 having a function of storing the registration information created by the registration information creation module 307 (see FIG. 11) and the drinking information created by the drinking information creation module 311 (see FIG. 12). Is a module that configures

  The entry information acquisition module 302 creates a dot pattern in the vicinity of the pen tip 17 locally by the camera 16 while the entry is performed on the dedicated paper (electronic pen medium) 20 by the user using the electronic pen 80. In addition to continuously capturing images and continuously acquiring entry information (including tap information) corresponding to the entry strokes in the medicine record book 30 based on the image data, the information is transmitted to the area recognition means 62 and information storage means 60 This is a module that makes the electronic pen 80 constitute the entry information acquisition means 61.

  The area recognition module 303 refers to the definition information (see FIG. 8) stored in the information storage unit 60 based on the dot pattern address included in the entry information acquired by the execution of the entry information acquisition module 302. In addition to recognizing the page type, by referring to the registration information (see FIG. 11) based on the coordinate data included in the entry information, the corresponding user area ID is recognized, and the recognized area is the entry page. In this case, the area recognizing unit 62 has a function of temporarily storing the recognized information in the information storage unit 60 and transmitting it to the start / end point specifying unit 63, and makes the electronic pen 80 configure the area recognizing unit 62. .

  The start / end point specifying module 304 specifies the coordinate data and the entry time of each of the stroke data start point and data end point included in the entry information acquired by the execution of the entry information acquisition module 302, and sends them to the tap recognition means 64. This module has a function of transmitting, and causes the electronic pen 80 to configure the start / end point specifying means 63.

  The tap recognition module 305 is entered in the medicine record book 30 by the user based on the time at the data start point and the data end point specified by the execution of the start / end point specification module 304 and / or the movement distance between the two points. It is determined whether or not the stroke is a tap, and the tap to the page corresponding to the dot pattern address, page type and user area ID recognized by the area recognition module 303 is recognized and temporarily stored in the information storage means 60. In addition, this module has a function of transmitting to the user area setting unit 65 and causes the electronic pen 80 to configure the tap recognition unit 64. As described above, as a method for determining whether or not the entry information is tap information, the stroke is performed when the time from the entry time at the data start point to the entry time at the data end point is less than a preset predetermined time, as described above. And a method of determining that the stroke is a tap when the movement distance between the data start point and the data end point is less than a predetermined distance set in advance. (Second method) may be adopted, and conditions may be set for both the time of the data start point and the data end point and the movement distance between the two points (third method). .

  When the tap on the entry page is recognized by the execution of the tap recognition module 305, the user area setting module 306 is based on the entry information stored in the information storage unit 60 and the entry stroke to the medicine record book 30 by the user. In addition to the function of calculating the area containing the user area as coordinate data of the user area, assigning the user area ID and associating with the entry information, the information storage means 60 does not store entry information to be set as the user area. In this case, this is a module that has a function of transmitting the tap information transmitted by the tap recognition means 64 to the output address storage means 68 and causes the electronic pen 80 to configure the user area setting means 65.

  The character string recognition module 307 executes the character recognition process based on the entry information associated with the user area set by the execution of the user area setting module 306, thereby converting the stroke entered in the medicine record book 30 into the character This module has a function of recognizing as a column, and causes the electronic pen 80 to configure the character string recognition means 66.

  The registration information creation module 308 includes a character string recognized by the execution of the character string recognition module 307, the user area ID and coordinate data of the user area set by the execution of the user area setting means module 306, and the area recognition module 303. This module has a function of creating registration information in association with the dot pattern address recognized by execution and storing it in the information storage means 60, and is a module that configures the registration information creation means 67 in the electronic pen 80.

  When the tap information recognized by the execution of the tap recognition module 305 is transmitted by the execution of the user area setting module 306, the output address storage module 309 uses the dot pattern address included in the tap information as an output address. This module has a function of temporarily storing in the storage unit 60 and makes the electronic pen 80 configure the output address storage unit 68.

  When the area recognized by the execution of the area recognition module 303 is the drinking process execution page 33, the prescription drug name extraction module 310 stores the dot pattern stored in the information storage means 60 by the execution of the output address storage module 309. Based on the address, the registered information stored in the information storage means 60 is referred to, all prescription drug names registered in association with the dot pattern address are extracted, and the prescription drug name is created by swallowing information. This module has a function of transmitting to the means 70 and causes the electronic pen 80 to configure the prescription drug name extracting means 69.

  The drinking information creation module 311 refers to the drug information stored in the information storage unit 60 based on the prescription drug name (character string) extracted by the execution of the prescription drug name extraction module 310, thereby While creating swallowing information (see FIG. 12) in which the names of medicines, side effects caused by taking these medicines together and the risk of side effects are associated with each other, the information storage means 60 temporarily stores them. The module has a function of transmitting to the voice data creation means 71 and causes the electronic pen 80 to configure the drinking information creation means 70.

  The voice data creation module 312 executes voice synthesis processing based on the drinking information created by the execution of the drinking information creation module 311, thereby creating voice data that presents the drinking of the medicine that causes side effects. This is a module that has a function of transmitting to the voice output means 72 and causes the electronic pen 80 to constitute the voice data creation means 71.

  The voice output module 313 has a function of causing the voice output unit (speaker) 19 to output the voice data created by the execution of the voice data creation module 312 as a voice. This is a module to be configured.

  The data communication module 314 has a function of transmitting / receiving data to / from the terminal device 85, and is a module that configures the data communication unit 73 in the electronic pen 80.

[Registration process flow by this information processing system]
Next, a drinking process flow performed by the information processing system of the present embodiment will be described with reference to FIGS. 4, 14, and 15. 14 and 15 are flowcharts of the drinking process in the electronic pen 80. FIG. First, with reference to FIG. 4A and FIG. 14, a prescription drug registration process flow in the drinking process flow will be described.

  The user enters the medicine name (character string) on the entry page of the medicine record book 30 (electronic pen medium 20) using the pen tip portion 17 of the electronic pen 80. For example, when going to hospital A, as shown in the left side of FIG. 4A, the user uses the electronic pen 80 to name the medicine name “Ragbit” prescribed in the A hospital on the A hospital entry page 31. , Fill in “Cullaby” and “Bukosbang”. At this time, the user indicates the end of entry of one medicine name by tapping after entering one medicine name.

  The user enters the first medicine name “Ragbit” on the A hospital entry page 31 by the pen tip 17 of the electronic pen 80. Then, the electronic pen 80 acquires coordinate data, dot pattern address, time information, and writing pressure data corresponding to the entry contents on the entry page as entry information by the entry information obtaining unit 61 and stores them in the information storage unit 60. This is transmitted to the area recognition means 62 (step S1). Subsequently, the area recognition unit 62 responds by referring to the definition information stored in the information storage unit 60 based on the dot pattern address (“10.30.20.1”) included in the entry information. When the corresponding user area is registered by recognizing the page type (“entry page”) and referring to the registration information based on the coordinate data included in the entry information, the user area of the user area ID is recognized (step S2).

  When the recognized area is an entry page, the area recognition means 62 temporarily stores the recognized information in the information storage means 60 and transmits it to the start / end point identification means 63 (step S3; entry page). Then, the start / end point specifying unit 63 specifies the coordinate data and the entry time at the data start point and the data end point of the stroke included in the entry information acquired by the entry information acquisition unit 61 and transmits them to the tap recognition unit 64. (Step S4). Subsequently, the tap recognizing unit 64 goes to the page corresponding to the dot pattern address and page type recognized by the area recognizing unit 62 based on the time at the data start point and the data end point and / or the movement distance between the two points. Is recognized (step S5). When a tap is not recognized by the tap recognition means 64 (step S5; No), it returns to step S1 and repeats the process of step S1-S5.

  When the user finishes entering the first medicine name “Ragbit” on the A hospital entry page 31 and taps on the A hospital entry page 31, the processes of steps S1 to S5 are repeated in the same manner as described above, and tap recognition is performed. When the tap is recognized by the means 64 (step S5; Yes), the tap recognition means 64 transmits the tap information to the user area setting means 65. Then, the user area setting unit 65 determines whether or not entry information to be set as a user area is stored in the information storage unit 60, and when the entry information is stored in the information storage unit 60 (step S6; Yes) Based on the entry information, the position information on the A hospital entry page 31 of the entry stroke to the A hospital entry page 31 of the medicine record book 30 by the user is calculated, and the area of the area containing the entry stroke is calculated. The coordinate data “(x1, y1), H1, W1” is calculated, and the user area ID “A01” is assigned as the user area to associate with the entry information (step S7).

  On the other hand, the character string recognizing unit 66 executes the character recognition process based on the entry information associated with the user area set by the user area setting unit 65 and enters the name of the prescription medicine entered in the hospital A entry page 31. (Character string) Character recognition of “rag bit” is performed (step S8). Subsequently, the registration information creating unit 66 recognizes the prescription drug name “Ragbit” recognized by the character string recognition unit 65 and the user area ID “user bit ID” corresponding to the drug name set by the user area setting unit 65. A01 ”and coordinate data“ (x1, y1), H1, W1 ”and the dot pattern address“ 10.30.20.1 ”recognized by the area recognition means 62 are created, and registration information is created. The information is stored in the information storage means 60 (step S9). When the registration information is already stored in the information storage unit 60, the registration information creation unit 66 associates the drug name recognized by the character string recognition unit 65 with the dot pattern address specified by the area recognition unit 62. The registration information is updated by adding the added information.

  Subsequently, when the next entry information is acquired by the entry information acquisition means 61 (step S10; Yes), the processing is repeated from step S2. For example, when the user enters and taps the second medicine name “Cullaby” on the hospital A entry page 31, the above steps are repeated, and the registration information creation means 67 causes the second medicine name “Cullaby”. ”, The user area ID“ A02 ”of the user area, the coordinate data“ (x2, y2), H2, W2 ”, and the dot pattern address“ 10.30.20.1 ”are created. The registration information stored in the information storage means 60 is additionally updated. Furthermore, the registration information includes the third medicine name “Bukosbang” entered on the A hospital entry page 31, the user area user area ID “A03”, and the coordinate data “(x3, y3), H3, W3”. And the dot pattern address “10.30.20.1” are added and updated.

  Furthermore, when an entry as shown on the right side of FIG. 4A is made on the hospital B entry page 32, the first medicine name “Mutasco Tablet” prescribed by the hospital B and the user area ID “user area ID” “ B01 ”and coordinate data“ (x4, y4), H4, W4 ”and the dot pattern address“ 10.30.20.2 ”of the B hospital entry page 32 are associated with each other, and registration information is added. Updated. In addition, the registration information includes the second medicine name “Kifusarol” prescribed at Hospital B, the user area ID “B02” of the user area and the coordinate data “(x5, y5), H5, W5”, Information associated with the dot pattern address “10.30.20.2” of the hospital B entry page 32 is added and updated.

  In step S10, when the next entry information is not acquired by the entry information acquisition unit 61 for a predetermined time or longer (for example, 2 seconds) (step S10; No), the electronic pen 80 ends the registration process (a drinking process). . The electronic pen 80 may output a beep sound when creating registration information and / or at the end of the drinking process.

  In this way, the electronic pen 80 creates registration information in which all drug names entered on the entry page, user area coordinate data, and dot pattern addresses are associated with each other. In other words, the user can register the medicine name by filling in the entry page with the medicine name prescribed by the hospital that he visits.

[Output processing flow by this information processing system]
Next, the output process flow of the drinking information in the drinking process flow of the information processing system according to the present embodiment will be described with reference to FIG. 4B, FIG. 14 and FIG.

  When the user wants to confirm the drinking of medicines prescribed at a plurality of hospitals, the medicine name prescribed at the hospital is registered in the memory 12 of the electronic pen 80 by the registration process described above, and then the pen of the electronic pen 80 is used. The tip 17 is used to tap the medicine record book 30. For example, when the user wants to confirm the combination of the medicine prescribed at Hospital A and the medicine prescribed at Hospital B, the user can enter A hospital entry page 31 and B hospital entry page 32 as shown in FIG. And the output process execution page 33 is tapped in order (★ mark represents a tap).

  The user first taps the A hospital entry page 31 with the pen tip portion 17 of the electronic pen 80. Then, the electronic pen 80 repeats the processes of steps S1 to S6 in the same manner as the registration process flow described above. When the tap recognizing means 64 of the electronic pen 80 recognizes the tap (step S5; Yes) and transmits it to the user area setting means 65, the user area setting means 65 stores the entry information to be set as the user area in the information storage means 60. It is determined whether or not entry information is stored in the information storage unit 60 (step S6; No), and the tap information (entry information) is transmitted to the output address storage unit 68. (Step S6; No). Then, the output address storage unit 68 temporarily stores the dot pattern address “10.30.20.1” included in the tap information in the information storage unit 60 as the first output address (step S11).

  Then, when the user taps the B hospital entry page 32 by the pen tip portion 17 of the electronic pen 80 following the tap to the A hospital entry page 31, the electronic pen 80 returns to the B hospital entry page 32 as the next entry information. Tap information corresponding to the tap is acquired (step S10; Yes), and the processes of steps S2 to S6 and S11 are repeated as described above. That is, the output address storage unit 68 temporarily stores the dot pattern address “10.30.20.2” corresponding to the hospital B entry page 32 as the second output address in the information storage unit 60 (step S11). .

  Further, when the user taps the drinking process execution page 33 with the pen tip portion 17 of the electronic pen 80 following the tap to the hospital B entry page 32, the electronic pen 80 displays the drinking process execution page as the next entry information. Tap information corresponding to the tap to 33 is acquired (step S10; Yes), and the processing of steps S2 to S3 is repeated as described above. Since the area recognized by the area recognizing unit 62 in step S3 is the swallowing process execution page 33 (step S3; process execution page), the prescription drug name extracting unit 69 receives the output address from the output address storage unit 68. It is determined whether or not the information is stored in the information storage unit 60, and the first and second output addresses are stored in the information storage unit 60 (step S12; Yes). Based on the output address, the information storage unit 60 Referring to the registration information stored in (see FIG. 11), all prescription drug names registered in association with the dot pattern address of the output address are extracted (step S13). Then, the prescription drug name extraction unit 69 transmits the extracted prescription drug name to the drinking information creation unit 70. If the output address is not stored in the information storage unit 60 in step S12, the electronic pen 80 ends the process.

  More specifically, the prescription drug name extraction unit 69 uses the registered information based on the dot pattern address “10.30.20.1” of the temporarily stored output address to determine the drug names “Ragbit”, “Clullaby”, and “Bukosbang”. Is extracted. The prescription drug name extraction means 69 extracts the drug names “Mutasco Tablets” and “Kifusalol” from the registration information based on the dot pattern address “10.30.20.2”.

  Next, the drinking information creation means 70 creates a combination of two medicine names based on the transmitted prescription medicine name. Then, by referring to the drug information (see FIG. 9) stored in the information storage means 60 for each combination, two drug names, side effects caused by taking these drugs together, and the risk of side effects The drinking information (see FIG. 12) in which the degree is associated is created (step S14). For example, for the combination of the drug name “Rabbit” and “Mutasco Tablet” extracted by the prescription drug name extraction means 69, the information of “Rugbit” is referred to from the basic drug name of the drug information, and the name of the drinking drug “Mutasco” The side effect “loss of appetite” and the risk “2” corresponding to “tablet” are extracted. Then, the drinking information associated with the two drug names “Rabbit” and “Mutasco Tablet” is created and temporarily stored in the information storage means 60. Drinking information is created in the same manner for other combinations. By referring to the drug information, for the combination of two drugs that do not have a drug name corresponding to the name of the medicine to be swallowed, it may be possible to create swallowing information such as “no side effect information” or create swallowing information. You may make it not. In the present embodiment, description will be made assuming that drinking information such as “no side effect information” is created.

  Furthermore, the drinking information creation means 70 determines whether or not there is drinking information that causes a side effect, and if there is a drinking with side effects, temporarily stores it in the information storage means 60 and creates voice data. This is transmitted to the means (step S15; yes). When it is determined that there is no drinking that causes side effects (step S15; No), the output process is terminated. On the other hand, if it is determined that there is a swallow that causes a side effect (step S15; Yes), the voice data creation means 71 executes a speech synthesis process based on the swallow information created by the swallow information creation means 70. Thus, voice data that presents a drink that causes side effects is created (step S16).

  For example, voice data that outputs a voice saying “If you take Ragbit and Mutasco together, there is a risk of side effects such as loss of appetite” is created. Then, the voice output means 72 sends to the voice output unit 19 voice data presenting a sip that causes a side effect with a high degree of risk, "If you take Rugbit and Mutasco Tablet together, there is a risk of side effects such as loss of appetite". Audio is output (step S17). Then, the electronic pen 80 ends the drinking information output process.

  In this way, the user uses the electronic pen 80 to enter the name of the prescription medicine on the entry page of the medicine record book 30 (electronic pen medium 20), and the entry page of the medicine record book 30 and the drinking process when necessary. By tapping the execution page 33, it can be easily confirmed by voice whether or not there is a side effect in the drinking of medicines prescribed from a plurality of hospitals.

[Operational effects of this information processing system]
According to this information processing system, the prescription medicine name (character string) entered in the medicine record book 30 (electronic pen medium 20) with the electronic pen 80 is registered in the memory 12, and in response to a tap on the medicine record book 30 Different voices based on registered prescription drug names can be output. Therefore, for example, the names of medicines prescribed at a plurality of hospitals are filled in each entry page of the medicine record book 30 with the electronic pen 80, and the medicines can be swallowed according to the tap on the entry page and the process execution page. The voice to be presented can be easily output. In other words, the user does not need to check each drug using a drug encyclopedia or the Internet as in the past, but only with the same effort as filling in a normal drug record book, not only records of prescription drugs, but also drugs. You can check the drinking. Therefore, it is possible to easily confirm the drinking of medicine even by a user who does not have time to search for a medicine encyclopedia and resists the use of a personal computer or the Internet.

  The present invention is not limited to the above embodiment.

  For example, although the clock 22 of the electronic pen 80 transmits the current time (see FIG. 2), the clock 22 may transmit the entry time that starts from 0 and elapses during the entry of the stroke. In this case, the processor 11 acquires the elapsed time (entry time) transmitted by the clock 22 as time information during stroke entry, and the time information, writing pressure data, dot pattern address, and X and Y coordinates. Correlate with data and get it as entry information.

  In the above embodiment, the information storage unit 60 stores the definition information (see FIG. 8) and the registration information (see FIG. 11) separately, but for the dot pattern address, the page type and the page name are stored. The user area ID and coordinate data of the user area and the prescription drug name may be stored in association with each other, and the data structure of these information can be arbitrarily set. In addition, information items and data structures included in the medicine information (see FIG. 9) can be arbitrarily set. For example, the chemical formula of the basic drug can be included.

  In the above embodiment, when the tap is recognized by the character string recognizing means 65 and the tap recognizing means 64, the character recognition is executed based on the entry information stored in the information storage means 60. The invention is not limited to this. Character recognition is sequentially performed based on the entered information and temporarily stored in the information storage means 60. When the tap is recognized, the temporarily stored characters are stored. It can be configured to be collectively recognized as a series of character strings.

  Moreover, in the said embodiment, the output address memory | storage means 68 memorize | stores the dot pattern address recognized by the area recognition means 62 in the information storage means 60 as an output address, and the prescription medicine name extraction means 69 refers registration information. Then, all prescription drug names stored in association with the dot pattern address are extracted, but the present invention is not limited to this, and the output address storage means 68 is an area recognition means. The user area recognized by 62 is stored in the information storage means 60 as an output user area, and the prescription drug name extraction means 69 refers to the registration information and stores each one stored in association with the user area. It is good also as extracting a prescription medicine name.

  Moreover, in the said embodiment, based on the dot pattern address of the entry page tapped by the user, all the prescription medicine names prescribed from two hospitals are extracted and the combination of two medicines is created, and a side effect is produced. However, the present invention is not limited to this, and the two drugs whose side effect risk is equal to or higher than a predetermined value in step S15 described above are output. It is good also as judging the drinking and outputting the audio | voice which shows only the drinking whose the danger level is more than predetermined value. Moreover, you may make it also show the numerical value of a danger level. Alternatively, based on the user area set at the position tapped by the user, only the name of the prescription drug intended by the user is extracted to create a combination of the two drugs, and the two drugs causing side effects It is good also as outputting the audio | voice which shows all the drinking. In addition, the number of hospitals, the number of medicines to be combined, and information items to be notified can be arbitrarily set.

  In the above-described embodiment, only two medicine names and the fact that these medicines are poorly swallowed are presented by voice. However, the present invention is not limited to this. It is also possible to present the degree together.

  In the above embodiment, one hospital is associated with one entry page. However, the present invention is not limited to this, and one hospital may be associated with an entry area that is a part of one entry page. In other words, hospitals may be associated with areas instead of pages.

  Moreover, in the said embodiment, the example of the drinking process was shown as a predetermined process matched with the chemical | medical agent record book 30. FIG. However, the present invention is not limited to this, and the medicine record book 30 may be associated with output processing to a speaker attached to the terminal device 85, a display, a printer, or the like. In this case, the user can confirm the drinking of medicines prescribed at a plurality of hospitals by outputting sound from a speaker attached to the terminal device 85, or displaying or printing a list or the like.

  In the above embodiment, the medicine name entered on the entry page with the electronic pen 80 is registered, and in response to a tap on the entry page and the process execution page, a sound for presenting a medicine drink is output. The present invention is not limited to this, and the character string to be registered and the voice to be output can be arbitrarily set. For example, color information in which the basic color, other colors, and colors generated when these colors are mixed are stored in the information storage unit 60 of the electronic pen 80, and the name of the color is stored. It can be configured to fill in the entry page, and to output a sound presenting the name of the color generated when any of a plurality of colors are selected by tapping and the colors are mixed. Alternatively, chemical experiment information in which a basic chemical name, another chemical name, and a phenomenon that occurs when these chemicals are mixed is stored in the information storage unit 60 of the electronic pen 80. In addition, enter the chemical name on the entry page, select any multiple chemical names by tapping, and output sound that indicates the phenomenon that occurs when these chemicals are mixed. Can do. Further, the design does not have to be as shown in FIG. 3, and the design and arrangement of the entry page, entry area, process execution page, and process execution area may be changed as appropriate.

  Further, property information (pen information or pen owner information) regarding the pen itself or its owner may be held in the electronic pen 80 so that it can be referred to from the terminal device 85, or property information. May be transmitted to the terminal device 85 together with the entry information. The pen information includes battery level, pen ID, pen manufacturer number, pen software version, subscription provider ID, free memory capacity, and the like. Pen owner information includes nationality, language, time zone, email address, name, address, fax / phone number, mobile phone number, and the like.

  In the above embodiment, the dot is ink containing carbon that absorbs infrared rays, and the LED 15 of the electronic pen 80 is an LED that irradiates infrared rays. However, it is not limited to this. For example, the dot is ink that emits light of a predetermined wavelength by light of a predetermined wavelength, the LED 15 of the electronic pen 80 is irradiated with light that emits the ink of the dot, and the region of the wavelength that the ink of the dot is emitted by the camera 16 is set. By detecting, the dot pattern may be read by the electronic pen 80. If the dot pattern can be read by the camera 16, the ink type of the dot, the irradiation light of the LED 15, etc. are limited to those shown in the above embodiment. I can't. Further, as long as the position coordinates in the medicine record book 30 (dedicated paper 20) can be specified, another coded pattern such as a two-dimensional code pattern may be used instead of the dot pattern.

  The present invention is an electronic pen that can output a voice based on a character string written on a medium for an electronic pen in response to a tap, in various fields such as a healthcare field, a design field, and an education field. Can be used.

It is a figure which shows the usage pattern of an electronic pen typically. It is a block diagram which shows the structure of the electronic pen in embodiment. It is an example of the medicine record book in an embodiment. It is a figure which shows the usage condition of the electronic pen in embodiment. It is a figure explaining the expression method of the information by the dot pattern printed on the exclusive paper. (A) shows a dot pattern typically, and (b) is a figure showing an example of information corresponding to it. It is a functional block diagram which shows the main structures of an electronic pen. It is a figure which shows the data structure of definition information typically. It is a figure which shows the data structure of chemical | medical agent information typically. It is a figure explaining coordinate data. It is a figure which shows the data structure of registration information typically. It is a figure which shows the data structure of drinking information typically. It is a module block diagram of a dedicated application in the embodiment. It is a flowchart of the drinking process in embodiment. It is a flowchart of the drinking process in embodiment.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 11 ... Processor, 12 ... Memory, 13 ... Data communication unit, 14 ... Battery, 15 ... LED, 16 ... Camera, 18 ... Pressure sensor, 19 ... Speaker, 20 ... Dedicated paper (medium for electronic pens), 22 ... Clock, 30 ... medicine record book, 55 ... dedicated application, 60 ... information storage means, 61 ... entry information acquisition means, 62 ... area recognition means, 63 ... start / end point identification means, 64 ... tap recognition means, 65 ... user area recognition means , 66 ... Character string recognition means, 67 ... Registration information creation means, 68 ... Output address storage means, 69 ... Prescription drug name extraction means, 70 ... Drinking information creation means, 71 ... Audio data creation means, 72 ... Voice output means 73 ... Data communication means, 80 ... Electronic pen, 85 ... Terminal device

Claims (7)

An electronic pen for processing information written on an electronic pen medium on which a coded pattern recognizable by the electronic pen is printed,
Information storage means for storing definition information in which a coding pattern address for identifying a predetermined area on the coding pattern is associated with an area type of the area on the coding pattern;
Entry information acquisition means for acquiring entry information corresponding to the entry contents on the electronic pen medium;
Area recognition means for recognizing the area type by referring to the definition information based on a coded pattern address included in the entry information;
Tap recognition means for recognizing a tap to an area corresponding to the coded pattern address recognized by the area recognition means based on the entry information;
A character string recognizing unit that recognizes a character string composed of one or more characters by recognizing the entry information based on a recognition result by the tap recognizing unit;
An electronic pen comprising: registration information creating means for creating registration information in which the character string recognized by the character string recognizing means and the encoded pattern address recognized by the area recognizing means are associated with each other. On the coded pattern printed on the electronic pen medium, a process execution area that is an area associated with execution of a process of outputting sound is set.
The electronic pen is
An audio output unit that outputs audio based on audio data;
An output address storage means for storing a coded pattern address corresponding to the tapped area based on a recognition result by the tap recognition means;
A character string extraction means for extracting a corresponding character string from the registration information based on the coded pattern address stored by the output address storage means;
Voice data creation means for creating voice data based on the character string extracted by the character string extraction means;
The electronic pen according to claim 1, further comprising: a voice output unit that outputs a voice based on the voice data created by the voice data creation unit from the voice output unit. An electronic pen for processing information written on an electronic pen medium on which a coded pattern recognizable by the electronic pen is printed,
Information storage means for storing definition information in which a coding pattern address for identifying a predetermined area on the coding pattern is associated with an area type of the area on the coding pattern;
Entry information acquisition means for acquiring entry information corresponding to the entry contents on the electronic pen medium;
Area recognition means for recognizing the area type by referring to the definition information based on a coded pattern address included in the entry information;
Tap recognition means for recognizing a tap to an area corresponding to the coded pattern address recognized by the area recognition means based on the entry information;
Character string recognition means for recognizing a medicine name consisting of a character string of two or more characters by recognizing the entry information based on a recognition result by the tap recognition means;
An electronic pen comprising: registration information creating means for creating registration information in which the drug name recognized by the character string recognition means is associated with the coded pattern address recognized by the area recognition means. On the coded pattern printed on the electronic pen medium, a process execution area that is an area associated with execution of a process of outputting sound is set.
The information storage means further stores medicine information in which the medicine name, other medicine names, and information on side effects when two medicines are swallowed are associated with each other,
The electronic pen is
An audio output unit that outputs audio based on audio data;
An output address storage means for storing a coded pattern address corresponding to the tapped area based on a recognition result by the tap recognition means;
Based on the coded pattern address stored by the output address storage means, a character string extraction means for extracting a corresponding medicine name from the registration information;
Referencing the drug information based on the drug name extracted by the character string extraction means, to create a drinking information creation means for creating the drinking information of the drug causing side effects;
Based on the swallow information created by the swallow information creating means, sound data creating means for creating sound data presenting a swallow of a drug that causes side effects;
The electronic pen according to claim 3, further comprising: a voice output unit that outputs a voice based on the voice data created by the voice data creation unit from the voice output unit. A start / end point specifying means for specifying a data start point and a data end point based on the entry information;
The tap recognition means recognizes a tap to an area corresponding to a coded pattern address recognized by the area recognition means based on a time and / or distance based on the start point and the data end point. Item 5. The electronic pen according to any one of Items 1 to 4. A program executed by an electronic pen for processing information written on an electronic pen medium on which a coded pattern recognizable by the electronic pen is printed,
Information storage means for storing definition information in which a coding pattern address for identifying a predetermined area on the coding pattern is associated with an area type of the area on the coding pattern;
Entry information acquisition means for acquiring entry information corresponding to the entry contents on the electronic pen medium;
Area recognition means for recognizing the area type by referring to the definition information based on a coded pattern address included in the entry information;
Tap recognition means for recognizing a tap to an area corresponding to the coded pattern address recognized by the area recognition means based on the entry information;
Character string recognition means for recognizing a character string composed of one or more characters by character recognition of the entry information based on a recognition result by the tap recognition means;
Registration information creation means for creating registration information in which the character string recognized by the character string recognition means and the encoded pattern address recognized by the area recognition means are associated with each other;
Based on the tap recognized by the tap recognition means, output address storage means for storing a coded pattern address corresponding to the tapped area;
A character string extraction means for extracting a corresponding character string from the registration information based on the coded pattern address stored in the output address storage means;
Voice data creation means for creating voice data based on the character string extracted by the character string extraction means;
A program for causing the electronic pen to function as voice output means for outputting voice based on voice data created by the voice data creation means from the voice output unit. A program executed by an electronic pen for processing information written on an electronic pen medium on which a coded pattern recognizable by the electronic pen is printed,
Information storage means for storing definition information in which a coding pattern address for identifying a predetermined area on the coding pattern is associated with an area type of the area on the coding pattern;
Entry information acquisition means for acquiring entry information corresponding to the entry contents on the electronic pen medium;
Area recognition means for recognizing the area type by referring to the definition information based on a coded pattern address included in the entry information;
Tap recognition means for recognizing a tap to an area corresponding to the coded pattern address recognized by the area recognition means based on the entry information;
Character string recognition means for recognizing a medicine name consisting of a character string of two or more characters by character recognition of the entry information based on a recognition result by the tap recognition means;
Registration information creation means for creating registration information in which the drug name recognized by the character string recognition means is associated with the coded pattern address recognized by the area recognition means;
Output address storage means for storing a coded pattern address corresponding to the tapped area based on a recognition result by the tap recognition means;
Character string extraction means for extracting a corresponding medicine name from the registration information based on the coded pattern address stored by the output address storage means,
Referencing the drug information based on the drug name extracted by the character string extraction means, creating a drinking information creation means for creating the drinking information of the drug that causes side effects,
Voice data creation means for creating voice data for presenting a drink of a medicine that causes side effects based on the drinking information created by the drinking information creation means;
A program for causing the electronic pen to function as voice output means for outputting voice based on voice data created by the voice data creation means from the voice output unit.

Images