JP2021079008A - Biological information processing device and control method of the same - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a biometric information processing apparatus capable of efficiently converting information written by hand on a predetermined form into data and a control method thereof. A biometric information processing apparatus acquires an image of an entry form having a predetermined format used for measuring biometric information using a device carried by a subject. When converting the contents entered in the entry form into data, the biometric information processing apparatus superimposes the input screen on the image of the entry form so that the entry field of the image of the entry form can be visually recognized from the input screen. [Selection diagram] Fig. 5

Description

The present invention relates to a biometric information processing device and a control method thereof.

The electrocardiogram may be measured continuously for a long period of time for the purpose of grasping transient symptoms that are difficult to find by the electrocardiogram measurement of several tens of seconds, which is generally performed at the time of hospital visit. For example, in Holta electrocardiography, a Holta electrocardiograph is carried by a patient to measure an electrocardiogram continuously for, for example, 24 hours in daily life.

When measuring (recording) biological information using a device carried by a subject such as a Holta electrocardiograph, an entry form (behavior record card) for recording the patient's behavior and subjective symptoms during measurement with time. ) May be used (Non-Patent Document 1). Since the contents of the action record card are useful information when referring to or interpreting the measurement data, it is desirable to handle it in association with the measurement data.

However, since the action record card is a handwritten form, it is difficult to handle it as it is in association with the measurement data. Therefore, conventionally, the action record card is converted into image data by an image reader connected to the biometric information processing device, and the contents of the action record card are input (posted) on the input screen displayed on the biometric information processing device. By doing so, the contents of the action record card were converted into data.

"Holter ECG", [online], [Search on July 8, 1st year of Reiwa], Internet <URL: http://www.setagayaku-hokencenter.or.jp/thorough/heart.html>

In the method of converting to image data, the contents (time and behavior or subjective symptom) of the behavior record card cannot be utilized as data. In addition, when re-entering (posting) the contents of the action record card into the biometric information processing device while visually checking the contents, it takes time and effort, and mistakes are likely to occur at the time of posting.

The present invention has been made in view of such problems of the prior art. An object of the present invention is a biometric information processing apparatus capable of efficiently converting information handwritten on a predetermined entry form used for measurement of biometric information using a device carried by a subject into data. The purpose is to provide a control method.

The above-mentioned purpose is to obtain an image of an entry form having a predetermined format, which is used for measuring biometric information using a device carried by the subject, and to convert the contents entered in the entry form into data. The control means has a control means for displaying the input screen for the purpose on the display device, and the control means superimposes the input screen on the image of the entry form so that the entry field of the image of the entry form can be visually recognized from the input screen. It is achieved by a biometric information processing device characterized by.

With such a configuration, according to the present invention, it is possible to efficiently convert the information handwritten on a predetermined entry form used for the measurement of biological information using the device carried by the subject into data. A biometric information processing apparatus and a control method thereof can be provided.

It is a block diagram which shows the functional structure example of the general-purpose computer which can carry out the biometric information processing apparatus which concerns on embodiment. It is a flowchart about the measurement data reading process which concerns on embodiment. It is a figure which shows an example of the action record card. It is a figure which shows an example of GUI (input screen) for transcription of the action record card. It is a figure which shows an example of the state which superposed the input screen on the image of the action record card.

Hereinafter, the present invention will be described in detail with reference to the accompanying drawings, based on its exemplary embodiments. The following embodiments do not limit the invention according to the claims. Further, although a plurality of features are described in the embodiment, not all of them are essential to the invention, and the plurality of features may be arbitrarily combined. Further, in the attached drawings, the same or similar configurations are designated by the same reference numbers, and duplicate explanations are omitted.

The biometric information processing apparatus of the present embodiment corresponds to the time used during Holta electrocardiography, which is an example of an entry form having a predetermined format used for measuring biometric information using a device carried by the subject. The contents of the action record card for entering the event (behavior and subjective symptoms) to be performed shall be converted into data. However, the present invention does not depend on the device carried by the subject or the type of entry form, and is used for the measurement of biometric information using any device carried by the subject, and any entry having a predetermined format. Can target paper. Here, having a predetermined form means that an entry field is defined according to the information to be entered, and an entry form having a predetermined form generally means information to be entered and its entry. Columns mean pre-printed paper.

FIG. 1 is a block diagram showing a functional configuration example of a general-purpose computer 100 capable of functioning as a biometric information processing device according to the present embodiment. The CPU 1, which functions as a control unit, reads, for example, a program stored in the storage device 10 into the RAM 3 and executes it to realize each function of the device. The storage device 10 is a hard disk drive (HDD), a solid state drive (SSD), or the like, and stores basic software (OS), device drivers, applications, and the like. GUI (graphical user interface) data for displaying a menu screen and the like, user setting data, application initial setting data, and the like are also stored in the storage device 10.

The ROM 2 stores programs such as a bootstrap loader, firmware, and various setting information necessary for starting a computer. ROM 2 may be at least partially rewritable.

The RAM 3 is used as an area for developing a program executed by the CPU 1 and a temporary storage area for variables, data, and the like. The memory card 4 may be another device, here a recording medium used for recording electrocardiographic data in a Holter electrocardiograph.

The display unit 6 is a dot matrix type display device, and is typically a liquid crystal display (LCD) or an organic EL display. Although FIG. 2 shows a configuration in which the display unit 6 is built in the device, it may be connected as an external device. Further, the display unit 6 may be composed of both an internal display and an external display.

The operation unit 8 is a device for a user to input an instruction to the device, and is typically one or more of input devices such as a keyboard, a pointing device (mouse or the like), and a contact sensing device (touch panel or the like). The keyboard may be a hardware keyboard or a software keyboard. The touch panel may be provided on the display unit 6 or may be in the form of a touch pad as is often seen in notebook computers.

The communication interface (I / F) 20 is one or more communication interfaces for performing data communication with an external device 21 such as an automatic analysis device or an image reading device 22. The communication I / F20 has a configuration compliant with wired and / or wireless communication standards such as Ethernet (registered trademark), IEEE802.11x, and USB.

The image reading device 22 is a device capable of converting an action recording card into image data and outputting it. For example, a scanner, a digital camera, or any electronic device having a function thereof and capable of communicating with a general-purpose computer 100 through a communication I / F20. It may be a device (eg, a smart phone). Further, although the image reading device 22 is described as an external device in FIG. 1, the general-purpose computer 100 may be provided.

The general-purpose computer 100 may be, for example, a terminal that transmits electrocardiographic data measured by a Holta electrocardiograph to an external automatic analysis device together with patient information, request contents, and information written on an action record card. In this case, the user of the terminal is a doctor (doctor in charge) who examines the patient, or a medical staff who requests automatic analysis according to the instruction of the doctor in charge.

For example, the user can read the action recording card returned from the patient together with the Holta electrocardiograph by the image reading device 22 and save it as image data. The image data is saved in association with the measurement data corresponding to the action recording card. For example, the user stores the measurement data taken out from the Holter electrocardiograph and recorded in the memory card 4 installed in the card slot 5 in the storage device 10. After that, the action recording card is read by the image reading device 22, and the image data of the action recording card is saved in the same place (for example, a folder) as the measurement data, so that the action recording card and the measurement data can be saved in association with each other. ..

Here, it is assumed that the measurement data is stored from the memory card 4 to the storage device 10 through the electrocardiographic data management application. In this case, the management application associates the measurement data with the image data of the action record card.

(Measurement data reading process)
Next, the operation of reading the electrocardiographic data in the biometric information processing apparatus of the present embodiment will be described with reference to the flowchart shown in FIG. This operation is realized by the CPU 1 of the general-purpose computer 100 executing an electrocardiographic data management application on the OS. For example, when a display instruction (for example, selection of an "open" command) on a screen for specifying electrocardiographic data to be read is input through the operation unit 8, the CPU 1 displays a selection window for selecting a data file to be read on the display unit 6. Display it. When the memory card 4 is installed in the card slot 5, the selection window displays the data file recorded in the memory card 4 in the initial state.

In S200, the CPU 1 waits for the detection of a data acquisition instruction (for example, a "read" GUI button pressing operation) through the operation unit 8. When the data acquisition instruction is detected, the CPU 1 in S202 reads the data file selected in the selection window through the card slot 5 and saves it in a predetermined position of the storage device 10. The CPU 1 can specify the storage position based on, for example, the patient ID input to the management application. If the memory card 4 contains a data file that satisfies predetermined conditions such as having a specific name, it is necessary to select or acquire the data file, such as automatically reading the data file. It may be a configuration that does not.

In S204, the CPU 1 asks the user how to read the action record card. Here, it is assumed that either (1) scanning with a scanner or (2) importing from a data file can be selected as the reading method, but the reading method is not limited to this. The CPU 1 proceeds to S208 when reading is selected by the scanner, and proceeds to S212 when acquisition from a data file is selected.

In S208, the CPU 1 prompts the user to set the action recording card in the image reading device 22, and waits for the detection of the reading start instruction. For example, when a read start instruction is detected through the operation unit 8, the CPU 1 advances the process to S210.
In S210, the CPU 1 controls the image reading device 22 to execute the reading operation. The CPU 1 sets the setting values (resolution, reading range, number of gradations, etc.) suitable for reading the action recording card in the image reading device 22, and then executes reading. The set value can be stored in advance in, for example, ROM 2. The CPU 1 acquires image data from the image reading device 22 through the communication I / F 20 and stores it in the RAM 3. When the reading is completed, the CPU 1 advances the process to S214.

On the other hand, in S212, the CPU 1 acquires an image file from the external device 21. For example, the CPU 1 communicates with an image pickup device such as a digital camera or a smartphone as an external device 21 through a communication I / F20, and acquires a data file storing image data of an action recording card. Alternatively, the CPU 1 may acquire the image data of the action recording card from the data file already read in the storage device 10 instead of the external device 21. The CPU 1 extracts image data from the acquired data file, decodes it as necessary, and then stores it in the RAM 3. When the acquisition of the image data is completed, the CPU 1 advances the process to S214.

In S214, the CPU 1 applies display processing to the image data stored in the RAM 3 as necessary, and then displays the image data at a predetermined position on the display unit 6. The display processing may be, for example, geometric transformation processing, scaling, resolution conversion, gradation number conversion, and the like, but is not limited thereto. Moreover, the processing for display is not indispensable.

In S216, the CPU 1 causes the display unit 6 to display the GUI (input screen) for posting the action recording card. The input screen is a GUI for converting the contents written on the action record card into data. Here, the CPU 1 superimposes and displays the input screen on the image of the action recording card. At this time, the CPU 1 makes the input screen semi-transparent by reducing the opacity to a value smaller than 100% (completely opaque) so that the handwritten input content in the image of the action recording card can be visually recognized through the input screen. To. As will be described later, the input screen is designed so that the individual input fields correspond to the individual entry fields of the action record card when superimposed on the image of the action record card. Therefore, the user can easily and accurately convert the input contents of the action record card into data by inputting the transparent handwritten input contents into the input field at the same position by using the operation unit 8.

In S218, the CPU 1 waits for the detection of the input completion instruction through the operation unit 8. When the input completion instruction is detected, the CPU 1 advances the process to S220.
In S220, the CPU 1 generates a data file (behavior record data file) in which the contents input to the input screen are converted into data in a predetermined format and stored. Then, the CPU 1 saves the action record data file in association with the measurement data saved in S202. For example, the CPU 1 associates the action record data file with the measurement data by saving the action record data file in the same folder as the measurement data saved in S202, or by saving at least a part of the action record data file with a common file name. be able to.

FIG. 3 is a diagram showing an example of an action record card. The action record card 300 has a configuration in which a time column 310, an action column 320, a symptomatological column 330, and a memo column 340 are arranged in a horizontal direction. The top of each column is the heading section 350A, not an entry column. The entry field 350B is composed of a plurality of lines, and each line is composed of a time entry field 351, a plurality of check entry fields 352, and a memo entry field 353. Each of the plurality of check entry fields 352 corresponds to one of a plurality of predetermined actions and a plurality of symptoms. The subject wears a Holta electrocardiograph and takes an action corresponding to a plurality of predetermined actions during the period of measuring the electrocardiogram, or a symptomatology corresponding to one of the multiple symptoms. When you become aware of it, enter the time in the time entry field 351 and enter a check mark (○, check mark, etc.) in the corresponding check entry field 352. Also, write down the points you noticed in the memo field. In the example of FIG. 3, the check mark 354 indicates that the drug was taken at 1:00 pm, and the check mark 355 indicates that the patient became aware of shortness of breath at 8:30 pm.

FIG. 4 is a diagram showing an example of a GUI (input screen) for posting an action record card. The input screen 400 shown in FIG. 4 is in a state of being independently displayed on the display unit 6, and is not semi-transparent.

Similar to the action record card 300, the input screen 400 has a configuration in which the time field 410, the action field 420, the symptomat field 430, and the memo field 440 are arranged in the horizontal direction. The top of each column is the heading section 450A, not an entry column. The entry field 450B is composed of a plurality of lines, and each line is composed of a time input field 451, a plurality of check fields 452, and a memo input field 453. Each of the plurality of check fields 452 corresponds to one of a plurality of predetermined actions and a plurality of symptoms.

The time input field 451 has day, hour, and minute input fields, and it is assumed that the operation unit 8 mainly uses a keyboard to directly input a value. Of course, it may be configured so that the value can be input only by operating the mouse using a pull-down menu generally used in GUI.

It is assumed that the plurality of check fields 452 are mainly clicked by the mouse of the operation unit 8. A mark indicating that the check has been made is displayed in the clicked check field 452. The check field 452 is a toggle field in which the input state is switched between the first state and the second state each time the operation is performed. Here, the mark is displayed when the mark is clicked without the mark (first state), and the mark is deleted when the mark is displayed (second state).
It is assumed that the memo input field 453 is used to directly input a comment mainly by using the keyboard of the operation unit 8.

When the general-purpose computer 100 is, for example, a tablet computer and the operation unit 8 is a touch panel provided on the display unit 6, a tap operation can be used instead of the click operation. A software keyboard can be used to input values.

FIG. 5 shows an example of a state in which the input screen shown in FIG. 4 is superimposed and displayed on the image of the action recording card shown in FIG. When performing superimposed display, the CPU 1 reduces the opacity of the input screen to make it translucent.

The display position and size of the image of the action recording card displayed on the display unit 6 are set in advance. The image data of the action recording card acquired by scanning or from the image file is displayed at a predetermined display position after the size is adjusted as necessary in the display process in S214.

In addition, the format of the action record card (layout of entry fields and size of individual entry fields) can be known in advance. Therefore, the input screen, which is the GUI for posting the action record card, is designed so that each input field is located corresponding to each entry field in the image of the action record card when it is superimposed and displayed on the image of the action record card. Has been done. In other words, the input screen so that the input items can be transcribed by inputting the input items of the action record card that can be visually recognized through a certain input field (and the surrounding area) into the input fields. The position and size of each input field of, and the display position are defined.

The display position of the input screen may be adjusted by recognizing the position of the specific pattern included in the action record card from the image of the action record card. For example, the action record card shown in FIG. 3 has a clock pictogram printed on the heading of the time entry field 310 and a pencil pictogram printed on the heading of the memo entry field. Therefore, the CPU 1 can detect the positions of these pictograms in the image of the action recording card and determine the display position of the input screen with reference to the detected positions.

For example, in the acquired image of the action record card, the edge of the action record card may be cut off or a margin may be present in the periphery due to the paper setting at the time of scanning or the framing at the time of shooting. Therefore, when the display position of the input screen is fixed, the correspondence between the position of the input field and the entry field in the image of the action record card may be broken. Therefore, when the CPU 1 superimposes and displays the input screen in S216, the position of these pictograms in the image of the action recording card is detected, and the display position of the input screen is determined based on the detected position. It is possible to more accurately align the input screen with respect to the image of.

As described above, the input screen is designed to have a layout similar to that of the entry field of the action record card, at least in terms of the position and size of the input field. It should be noted that the "similar" layout does not have to be exactly the same, for example, the size of the input field may be smaller or larger than the corresponding entry field on the action record card. When the input screen is superimposed on the image of the action record card, the size and position of the input field can be determined within a range in which the correspondence between the input field of the input screen and the entry field of the action record card is not broken.

When the input screen is superimposed and displayed, the CPU 1 may also display a GUI for adjusting the opacity of the input screen, which is shown as a slider 554 in FIG. When the operation of the slider 554 through the operation unit 8 is detected, the CPU 1 adjusts the opacity of the input screen according to the position of the slider. As a result, the user can adjust the visibility of the image of the action recording card through the input screen. For example, by setting the opacity to 0%, the superimposed display of the input screen can be substantially temporarily stopped, and the contents of the action record card can be confirmed in detail.

FIG. 5 shows a state in which a part of the entry contents of the entry field 350B of the action record card is transferred to the input screen. The date and time are entered in the time input field 551, and the check field 552 is clicked to display a mark. A comment is posted in the memo input field 553.

When the CPU 1 detects an operation of the completion button 555 (or a selection operation of a completion command included in a menu item (not shown)) through the operation unit 8, the content input to the input screen at that time is predetermined. Generate a data file (action record data file) stored as format data. Further, when the operation of the cancel button 556 through the operation unit 8 (or the selection operation of the cancel command included in the menu item (not shown)) is detected, the CPU 1 ends the posting process without generating the action record data file. To do.

Here, the configuration for posting the action record card when reading the measurement data has been described. However, the posting of the action record card can be executed at any time. In this case, the operation from S204 of FIG. 2 may be executed, and in S220, the action record data file may be saved in association with the measurement data selected by the user.

As described above, according to the present embodiment, the input screen for posting is made semi-transparent and superimposed on the image of the completed entry form. Therefore, it is possible to provide a biometric information processing apparatus capable of efficiently converting the information handwritten on the entry form into data and a control method thereof.

(Other embodiments)
The above embodiment relates to the transcription of an action record card used for Holta electrocardiography. However, the present invention is similarly applicable to the transcription of other types of entry forms that are handwritten.

In the above-described embodiment, the entire input screen to be superimposed and displayed on the image of the entry form is semi-transparent, but if the entry contents of the entry form can be seen from the superimposed display input screen, the entire input screen is displayed. Does not have to be translucent. That is, it suffices if the entry field of the image on the entry form can be visually recognized from the superimposed input screen. For example, only the area corresponding to the entry field of the entry form may be translucent or completely transparent (opacity 0%), and the other areas may be opaque or translucent.

Moreover, the input screen may be transparent. In this case as well, the input field on the input screen is invisible but exists, so input is possible. The input content is not transparent (it may be translucent or opaque) so that the input content for the input field can be confirmed. Further, the outer edge of the input screen and the outer edge of the input field may be semi-transparent or opaque, and the other areas may be transparent so that the transparent input screens can be seen to be superimposed.

The present invention can also be implemented as a program that causes a computer to execute the operation of FIG. 2 described in the above-described embodiment, or as a computer-readable recording medium that stores the program. Further, the present invention is not limited to the contents of the above-described embodiment, and various modifications and modifications can be made without departing from the spirit and scope of the invention. Therefore, a claim is attached to make the scope of the invention public.

100 ... general-purpose computer, 300 ... action record card, 400 ... input screen

Claims (13)

An acquisition means for acquiring an image of an entry form having a predetermined format, which is used for measuring biometric information using a device carried by the subject, and
It has a control means for displaying an input screen for converting the contents entered in the entry form into data on a display device.
The control means is a biometric information processing device that superimposes and displays the input screen on the image of the entry form so that the entry field of the image of the entry form can be visually recognized from the input screen. The biometric information processing apparatus according to claim 1, wherein the control means reduces the opacity of the input screen and superimposes the display on the image of the entry form. The entry form has a plurality of entry fields and has a plurality of entry fields.
The input screen has a plurality of input fields corresponding to the plurality of input fields.
The biometric information processing device according to claim 1 or 2. The control means according to claim 1 to 3, wherein the input screen is superimposed and displayed so that the positions of the plurality of input fields included in the input screen and the plurality of entry fields included in the entry form correspond to each other. The biometric information processing apparatus according to any one of the following items. The bio-information processing apparatus according to claim 3, wherein the control means reduces the opacity of the plurality of input fields in the input screen and superimposes the display on an image of the entry form. The bio-information processing apparatus according to any one of claims 1 to 4, wherein the control means reduces the opacity of the entire input screen and superimposes the display on the image of the entry form. The item according to any one of claims 1 to 6, wherein the input field of the input screen corresponding to the check entry field of the entry form is a toggle field in which the input state is switched each time the operation is performed. Biometric information processing device. The biometric information processing apparatus according to claim 7, wherein the check entry field corresponds to one of a plurality of predetermined actions or symptoms. From claim 1, the control means detects a specific pattern included in an image of the entry form, and determines a display position of the input screen with reference to a position where the specific pattern is detected. 8. The biometric information processing apparatus according to any one of 8. The biometric information according to any one of claims 1 to 9, wherein the control means further displays a user interface for adjusting the opacity of the superposed input screen on the display device. Processing equipment. The biometric information according to any one of claims 1 to 10, wherein the control means stores the content input to the input screen in association with the biometric information measured by the device. Processing equipment. The acquisition process is to acquire an image of an entry form having a predetermined format, which is used for measuring biometric information using a device carried by the subject.
The control means has a control step of displaying an input screen for converting the contents entered in the entry form into data on the display device.
In the control step, the control means of the biometric information processing apparatus is characterized in that the input screen is superimposed and displayed on the image of the entry form so that the entry field of the image of the entry form can be visually recognized from the input screen. Control method. A program that causes a computer to function as each means included in the biometric information processing apparatus according to any one of claims 1 to 11.

Images