JP2022006564A - Electronic record recording support device and electronic record recording support method - Google Patents

Abstract

[Problem] To provide an electronic findings record recording support device and an electronic findings record recording support method that can support the recording of autopsy findings in an electronic findings record. [Solution] An electronic findings record recording support device 300 supports the recording of finding information related to a body part in an electronic findings record. The electronic findings record recording support device 300 includes a terminal connection unit 320 that connects to a terminal device having a voice input function and an image display function, an information acquisition unit that acquires body part information and identification information based on voice recognition processing when body part information indicating a body part and identification information identifying the body part are input by voice on a terminal device displaying a human body diagram, a position identification unit that identifies the position of the body part on the human body diagram based on the acquired body part information, and an input screen control unit 340 that functions as a display control unit that displays the identification information at the position of the identified body part on the human body diagram. [Selected Figure] FIG.

Description

The present invention relates to an electronic record recording support device and an electronic record recording support method that support input of finding information regarding a plurality of body parts into an electronic record.

In recent years, electronic medical records (findings) have become widespread in the field of medical care. Normally, an electronic medical record displays a screen in which information items to be input and input fields are arranged on a display interface such as a liquid crystal display. Then, the electronic medical record receives input of information from the medical staff via a manual input interface such as a keyboard and a mouse, and records the input information in a referenceable state.

At general hospitals, etc., multiple medical staff record and refer to medical records. Therefore, a technique has been proposed that enables access to one electronic medical record from a plurality of terminal devices (see, for example, Patent Document 1).

The technique described in Patent Document 1 (hereinafter referred to as "conventional technique") is such that while an electronic medical record of a patient is being edited on one of the terminal devices, the electronic medical record of the patient cannot be edited on the other terminal device. At the same time, the terminal device that allows editing is switched based on a predetermined rule. According to such a conventional technique, it is possible to efficiently record finding information in an electronic medical record by a plurality of medical professionals.

Japanese Unexamined Patent Publication No. 2014-13577

By the way, it is desired to digitize the findings for recording autopsy findings not only in the field of medical care but also in the fields of forensic anatomy and pathological anatomy.

However, it is difficult for the surgeon performing the autopsy to use the manual input interface. In many cases, multiple surgeons perform an autopsy on one subject at the same time, such as one performing an autopsy on the head and the other performing an autopsy on the abdomen. Therefore, the above-mentioned prior art is not suitable for recording autopsy findings in electronic findings (hereinafter referred to as "electronic findings").

An object of the present invention is to provide an electronic finding recording support device and an electronic finding recording support method capable of supporting the recording work of autopsy findings in electronic findings.

The electronic record recording support device according to one aspect of the present invention is
It is an electronic finding recording support device that supports the recording of finding information about body parts in electronic findings.
A terminal connection unit that connects to a terminal device that has a voice input function and an image display function,
When the body part information indicating the body part and the identification information for identifying the body part are input by voice in the terminal device displaying the human body diagram, the body part information and the said body part information are based on the voice recognition process. The information acquisition unit that acquires identification information, and
Based on the acquired body part information, a position specifying part that specifies the position of the body part in the human body diagram, and
In the human body diagram, a display control unit that displays the identification information at the position of the specified body part, and
To prepare for.

The method for supporting the recording of electronic findings according to one aspect of the present invention is as follows.
It is an electronic finding recording support method that supports the recording of finding information on body parts in electronic findings.
Connect to a terminal device that has a voice input function and an image display function,
When the body part information indicating the body part and the identification information for identifying the body part are input by voice in the terminal device displaying the human body diagram, the body part information and the said body part information are based on the voice recognition process. Get the identification information,
Based on the acquired body part information, the position of the body part in the human body diagram is specified, and the position of the body part is specified.
In the human body diagram, the identification information is displayed at the position of the specified body part.

According to the present disclosure, it is possible to support the work of recording autopsy findings in electronic findings.

The figure which shows an example of the outline of the system which uses the electronic findings recording support apparatus which concerns on one Embodiment of this invention. The figure which shows an example of the structure of the electronic findings recording support apparatus which concerns on this embodiment. The figure which shows an example of the content of the findings structure data in this embodiment. The figure which shows an example of the contents of the command data in this embodiment The figure which shows an example of the content of the pronunciation dictionary data in this embodiment. The figure which shows an example of the contents of the terminal state management table in this embodiment. The figure which shows an example of the work start screen of the electronic findings in this embodiment. A flowchart showing an example of the operation of the electronic record recording support device according to the present embodiment. The figure which shows the 1st example of the finding input screen in this embodiment The figure which shows the 2nd example of the finding input screen in this embodiment The figure which shows the 3rd example of the finding input screen in this embodiment The figure which shows the 4th example of the finding input screen in this embodiment The figure which shows the 5th example of the findings input screen in this embodiment The figure which shows an example of the content of the findings information data in this embodiment. The figure which shows an example of the autopsy record in this embodiment The figure which shows the 6th example of the finding input screen in this embodiment The figure which shows an example of the content of the human body diagram information in this embodiment.

Hereinafter, an embodiment of the present invention will be described in detail with reference to the drawings.

<System overview>
First, an outline of the electronic record system in which the electronic record recording support device according to the present embodiment is used will be described. In this embodiment, the electronic finding system is a system for recording autopsy findings in a forensic anatomy.

FIG. 1 is a diagram showing an example of an outline of an electronic finding recording system in which the electronic finding recording support device according to the present embodiment is used.

As shown in FIG. ₁ , the electronic findings system 100 includes first and _second terminal devices 2001 and 2002 arranged inside the dissection chamber 110, and electronic findings arranged outside the dissection chamber 110. It has a recording support device 300.

The first terminal device 2001 ₁ includes a first terminal control device 210 ₁ , a first headset 220 ₁ equipped with a microphone, and a first display device 230 ₁ equipped with a liquid crystal display.

The first headset 220 ₁ and the first display device 230 ₁ are each communicably connected to the first terminal control device 210 ₁ . That is, the _first terminal device 2001 is a terminal device having a voice input function and an image display function. The first headset 220 ₁ is worn on the head of a first user 130 ₁ who is a surgeon who dissects a subject 120. The first display device 230 ₁ is used by this first user 130 ₁ .

Further, the second terminal device 2002 is also the same as the _first terminal device 2001 _{1 including the second terminal control device 210 2 ,} the second headset 220 ₂ , and the second display device 230 ₂ . It is composed. The second headset 220 ₂ is worn on the head of a second user 130 ₂ who is another surgeon who dissects the subject 120. The second display device 230 ₂ is used by this second user 130 ₂ .

The electronic record recording support device 300 is communicably connected to each of the first terminal control device 210 ₁ and the second terminal control device 210 ₂ , and is communicably connected to the first terminal device 2001 ₁ and the _second terminal device 2002. A user interface for electronic records is realized for each of the above. That is, the electronic finding recording support device 300 causes each terminal device 200 to display the finding input screen, presents the finding information, and accepts the input of the finding information into the electronic finding.

More specifically, the electronic record recording support device 300 enables hands-free input of finding information by voice, and further, the first and second users 130 ₁ and 130 ₂ simultaneously input the finding information. Make it possible.

<Device configuration>
Next, the configuration of the electronic record recording support device 300 will be described.

FIG. 2 is a diagram showing an example of the configuration of the electronic record recording support device 300.

In FIG. 2, the electronic record recording support device 300 includes an information storage unit 310 (functioning as a “human body diagram information storage unit” of the present invention), a terminal connection unit 320, a voice recognition analysis unit 330, and an input screen control unit 340 (this). It has an "information acquisition unit", a "position specifying unit" and a "display control unit" of the present invention), and an information recording unit 350 (functions as a "memory control unit" of the present invention).

The information storage unit 310 stores in advance various information for realizing a user interface for electronic findings. More specifically, the information storage unit 310 stores the voice recognition dictionary 311, the finding composition information 312, the finding information data 313, and the human figure information 314.

The speech recognition dictionary 311 is information used in speech recognition processing for converting speech data into text data, such as an acoustic model, a pronunciation dictionary, and a language model. The acoustic model is a data of the stochastic correspondence between the feature amount of the voice and the phonetic symbol. The pronunciation dictionary describes a plurality of text sequences as a candidate group of speech recognition results by speech recognition processing. The language model is a data of the appearance probability and the connection probability for each of the text sequences described in the pronunciation dictionary.

It is desirable that the pronunciation dictionary and language model correspond to the recording format of medical technical terms and findings. Further, it is desirable that the acoustic model includes an acoustic model customized for each user by learning and an acoustic model for an unspecified user. Further, it is desirable that the pronunciation dictionary and the language model are prepared for each display screen and each screen mode, which will be described later.

The findings composition information 312 is information necessary for constructing a user interface for electronic findings. The finding structure information 312 includes, for example, finding structure data, command data, pronunciation dictionary data, and a terminal state management table.

The findings structure data is data that describes the structure of electronic findings. The command data is data that describes a command received from the user. The pronunciation dictionary data is data that describes the character string displayed in the electronic findings in association with the reading thereof. The terminal state management table is information that identifies each terminal device 200 and describes the state of each terminal device 200. The finding structure data, the command data, and the pronunciation dictionary data are information prepared in advance, whereas the terminal state management table is information generated and changed according to the state of the electronic finding system 100. ..

FIG. 3 is a diagram showing an example of the contents of the findings structure data.

As shown in FIG. 3, in the finding structure data 410, the item name 412 belonging to the part name and the input field type 413 of the item name 412 are described for each part name 411.

The part name 411 is the name of the body part. The site name 411 is a name of a range of subjects, such as "heart", which one surgeon pays attention to at one time when performing an autopsy. In the present embodiment, the names of various kinds of information, such as "basic information", which one surgeon pays attention to at one time when performing an autopsy, are also treated as the site name 411.

The item name 412 is the name of the object for which the finding information should be recorded, which corresponds to the part name 411.

The input field type 413 is a type of input method of the finding information corresponding to the item name 412.

The finding structure data 410 includes information such as position, size, font, and color when the part name 411, the item name 412, and the item name 412 are displayed on the finding input screen. You may go out. Further, the finding structure data 410 may include information regarding the memory storage location of the input finding information for each of the item names 412.

FIG. 4 is a diagram showing an example of the contents of the command data.

As shown in FIG. 4, the command data 420 describes the command 422 for each screen mode 421.

The screen mode 421 is a type of operation accepted by the screen of the electronic findings. In the present embodiment, the screen mode 421 includes at least a "selection mode" and an "input mode". The selection mode is a mode that accepts an operation of selecting a part name or an item name displayed on the screen. The input mode is a mode for accepting an information input operation in the input field corresponding to the item name displayed on the screen. It is desirable that the input mode is further divided into a mode for inputting a free sentence and a mode for inputting a numerical value.

The command 422 is a command word received from the user on the finding input screen. In the present embodiment, the command 422 is an input start command for starting input to the input field, various editing commands for editing the contents described in the input field, and stopping input to the input field. Includes an input stop command to do.

FIG. 5 is a diagram showing an example of the contents of the pronunciation dictionary data.

As shown in FIG. 5, the pronunciation dictionary data 430 describes a reading 432 for each character string 431. The character string 431 is a character string of words and phrases that the electronic record system 100 accepts voice input on the record input screen, and includes a part name 411, an item name 412, and a command 422 (see FIGS. 3 and 4).

It is assumed that the information having the same content as the pronunciation dictionary data 430 is included in the pronunciation dictionary of the above-mentioned speech recognition dictionary 311. Alternatively, the pronunciation dictionary data 430 may be shared by the voice recognition dictionary 311 and the finding structure information 312.

FIG. 6 is a diagram showing an example of the contents of the terminal state management table.

As shown in FIG. 6, the terminal state management table 440 describes the state of each state item 441 for each of the first terminal device 442 and the second terminal device 443.

The status item 441 includes a terminal ID, a user name, and a work-in-progress record No. , Display screen, working status, and selected item. The terminal ID is identification information of the terminal device 200. The terminal ID may be a set of a microphone ID and a display ID. The user name is identification information of a user who uses the terminal device 200. The work-in-progress record No. is identification information of the finding information data that is the target of input or editing work in the terminal device 200. The display screen is the identification information of the screen displayed by the terminal device 200. The working state is the screen mode 421 (see FIG. 4) set in the terminal device 200.

The terminal ID is described by the input screen control unit 340 based on the automatic detection function of the communication network or the user operation when the terminal device 200 is connected to the electronic record recording support device 300, for example. User name and work findings No. Is described by the input screen control unit 340, for example, based on the user operation on the work start screen of the electronic findings. Further, the display screen, the working state, and the selected item are sequentially updated by the input screen control unit 340 in response to various user operations on the finding input screen, for example.

The contents of the finding information data 313 in FIG. 2 will be described later.

The terminal connection unit 320 of FIG. ₂ is communicably connected to each of the _first and second terminal devices 2001 and 2002. Then, the terminal connection unit 320 relays information between the _first and _second terminal devices 2001 and 2002, respectively, and the voice recognition analysis unit 330, the input screen control unit 340, and the information recording unit 350. I do.

In the voice recognition analysis unit 330, whether or not the part name 411 (see FIG. 3) was input by voice and whether the finding information was input by voice by the voice recognition process using the voice recognition dictionary 310 for each terminal device 200. Whether or not it is determined. Although not shown, the voice recognition analysis unit 330 includes an acoustic analysis unit that converts the voice of the speaker into compact data, and a recognition decoder that analyzes the converted data and converts it into text. Then, when the part name or the finding information is input by voice, the voice recognition analysis unit 330 outputs the text information of the part name or the finding information to the input screen control unit 340. The voice recognition analysis unit 330 similarly determines the presence / absence of voice input and outputs the determination result for the item name 412 (see FIG. 3) and the command 422 (see FIG. 4).

The voice recognition analysis unit 330 may switch the acoustic model, pronunciation dictionary, and language model to be used based on the terminal state management table 440 (see FIG. 6), or may narrow down the words and phrases to be recognized. good.

The input screen control unit 340 generates and displays a finding input screen including a list of part names of a plurality of body parts for each terminal device. Then, when any part name is input by voice in any terminal device 200, the input screen control unit 340 for each part for inputting the corresponding finding information on the finding record input screen of the terminal device 200. Display the screen. Further, the input screen control unit 340 outputs the text information of the input finding information to the information recording unit 350 in association with the part name and the item name to be input.

However, the input screen control unit 340 corresponds to the corresponding part name displayed on the other terminal device 200 while the screen for each part is displayed on the one terminal device 200. Impossible notification information indicating that information cannot be entered is given. Further, the input screen control unit 340 does not display the corresponding site-specific screen on the other terminal device 200 while the site-specific screen is displayed on the one terminal device 200.

The input screen control unit 340 sequentially reflects the display screen, the working state, and the selected item in each terminal device 200 in the terminal state management table 440 (see FIG. 6).

When the text information of the finding information is input from the input screen control unit 340, the information recording unit 350 associates the text information of the input finding information with the corresponding part name and item name, and the finding information data 313. Is stored in the information storage unit 310.

The combination of the above-mentioned finding structure data 410 (see FIG. 3) and the finding information data 313 constitutes an electronic finding. That is, the information recording unit 350 records the finding information input by the user in the electronic finding.

Although not shown, the electronic record recording support device 300 includes, for example, a CPU (Central Processing Unit), a storage medium such as a ROM (Read Only Memory) containing a control program, and a working memory such as a RAM (Random Access Memory). And has a communication circuit. In this case, the functions of the above-mentioned parts are realized by the CPU executing the control program.

Such an electronic finding recording support device 300 enables each terminal device 200 to voicely input finding information for each item via a site-specific screen prepared for each body part. Further, the electronic finding recording support device 300 does not display the screen for each part on the other terminal device 200 while the screen for each part is displayed on the terminal device 200, and the corresponding finding information is voiced. It is possible to notify the user of the other terminal device 200 that the input cannot be performed.

<Operation of the device>
Next, the operation of the electronic record recording support device 300 will be described by exemplifying the screen state of the electronic record.

First, the input screen control unit 340 generates a work start screen for electronic findings for each terminal device 200 and displays it on the terminal device 200. Then, the input screen control unit 340 accepts the setting of the target of the work of inputting or editing the finding information and the setting of the user who performs the work for each terminal device 200.

FIG. 7 is a diagram showing an example of a work start screen of electronic findings.

As shown in FIG. 7, the work start screen 510 has a finding selection area 511 and a user selection area 512. The finding selection area 511 displays a list of existing finding information data, and the user can perform an operation of selecting the finding information data to be started or an operation of starting the creation of new finding information data. accept. The user selection area 512 displays a list of user names, and accepts from the user an operation of selecting a user name of a user who starts work or an operation of registering a new user name.

For example, the first user 130 ₁ selects the finding information data “0000019” and the user name “TARO” on the work start screen 510 displayed on the _first terminal device 2001. Further, the second user 130 ₂ selects the finding information data “0000019” and the user name “HANAKO” on the work start screen 510 displayed on the _second terminal device 2002.

The electronic record recording support device 300 performs the operation described below for each terminal device 200 each time the record information data and the user name are selected on the work start screen 510.

FIG. 8 is a flowchart showing an example of the operation of the electronic record recording support device 300.

In step S1010, the input screen control unit 340 generates a finding input screen of the selected finding information data and displays it on the terminal device 200 in which the selection is made. At this time, the input screen control unit 340 registers the selected user name for the selected terminal device 200 and sets the selection mode. These registrations and settings are performed using the terminal state management table 440 (see FIG. 6).

FIG. 9 is a diagram showing an example of a finding input screen.

As shown in FIG. 9, the finding input screen 600 has a site selection area 610, a finding input area (site-specific screen) 620, a command display area 630, and a voice recognition operation area 640.

The site selection area 610 is an area for displaying a list of site names 411 (see FIG. 3) of a plurality of body parts as a plurality of site name tabs 611.

The finding input area (screen for each part) 620 is an area for displaying a list of a plurality of item names 412 (see FIG. 3) corresponding to the part name 411 of the body part as a plurality of item name buttons 621 for one body part. Is. Further, the finding input area 620 is an area in which the input field corresponding to the input field type 413 (see FIG. 3) corresponding to each item name 412 is displayed as the input area 622 in association with the item name button 621.

The finding input screen 600 is drawn so that each finding input area 620 can be seen as a sheet having the corresponding part name tab 611 at the upper end.

The command display area 630 displays a list of readings of the command 422 (see FIG. 4) according to the screen mode 421.

The voice recognition operation area 640 performs operations related to voice recognition such as registration of a word to be recognized and editing of a user profile to edit the voice recognition dictionary 311 and start and stop of microphone volume and voice recognition. This is the area to accept.

The input screen control unit 340 displays, for example, a finding input screen 600 including a finding input area 620 for basic information as an initial state.

In step S1020 of FIG. 8, the voice recognition analysis unit 330 determines whether or not there is a voice input of the displayed part name in the terminal device 200 in the selection mode. Such a determination is made based on, for example, the finding structure data 410 (see FIG. 3), the pronunciation dictionary data 430 (see FIG. 5), and the terminal state management table 440 (see FIG. 6).

Here, the part name to be determined is displayed as the part name tab 611 in the part selection area 610 of the finding record input screen 600. Therefore, the user can select a desired part name and input it to the terminal device 200 by voice as if selecting one from the displayed plurality of part name tabs 611 and reading it aloud.

The voice recognition analysis unit 330 advances the process to step S1030 when there is a voice input of the part name in the selection mode (S1020: YES). Further, when there is no voice input of the part name in the selection mode (S1020: NO), the voice recognition analysis unit 330 advances the process to step S1060 described later.

In step S1030, the input screen control unit 340 determines whether or not the finding input screen 600 including the finding input area 620 for the voice-input site name is displayed in the other terminal device 200. Such a determination is made, for example, based on the terminal state management table 440 (see FIG. 6).

When the corresponding finding input screen 600 is not displayed on the other terminal device 200 (S1030: NO), the input screen control unit 340 advances the process to step S1040. Further, when the corresponding finding input screen 600 is displayed on the other terminal device 200 (S1030: YES), the input screen control unit 340 advances the process to the subsequent step S1060.

In step S1040, the input screen control unit 340 receives a finding input screen 600 including a list of item names corresponding to the input part names for the terminal device 200 in which the voice is input, that is, the input part name. The finding input area 620 corresponding to is displayed.

FIG. 10 is a diagram showing an example of a finding input screen when the content is switched to the content corresponding to the part name of the “heart”, and corresponds to FIG. 9. The parts corresponding to FIG. 9 are designated by the same reference numerals, and the description thereof will be omitted.

For example, it is assumed that the "heart" is voice-input in the _first terminal device 2001 while the selection mode is in effect while the heart finding input area 620 is not displayed in the _second terminal device 2002. In this case, as shown in FIG. 10, the input screen control unit 340 causes the finding input screen 600 displayed on the _first terminal device 2001 to display the finding input area 620 of the heart.

As described above, the finding input area 620 is displayed like a sheet with the part name tab 611. With such a display form, the finding input screen 600 can indicate to the user which body part (part name) the finding input area 620 is for.

Further, in FIGS. 9 and 10, the screen mode is the selection mode. Therefore, a list of readings of the command 422 (see FIG. 4) in the selection mode is displayed in any command display area 630.

Depending on the body part, if there are many item name buttons 621 and input areas 622, all item name buttons 621 and input areas 622 may not be displayed at once. Therefore, the commands include commands for scrolling the screen. As a result, the finding input area 620 substantially displays a list of the item name buttons 621 and the input area 622 for all the necessary items even when the item name button 621 and the input area 622 are large. It is possible.

In step S1050 of FIG. 8, the input screen control unit 340 displays the non-notification information about the body part targeted for display in step S1040 in the other terminal device 200.

FIG. 11 is a diagram showing an example of a finding input screen on which the disapproval notification information is displayed, and corresponds to FIGS. 9 and 10. The parts corresponding to FIGS. 9 and 10 are designated by the same reference numerals, and the description thereof will be omitted.

For example, it is assumed that the _first terminal device 2001 displays a heart finding input area 620 (see FIG. 10). In this case, the display form of the part name tab 611 of the "heart" of the finding input screen 600 displayed on the _second terminal device 2002 is different from that of the other part name tab 611. That is, the non-notification information is a display form of the part name tab 611 different from the other part name tabs 611. As such a different display form, for example, a change in character color, font, or background color can be adopted.

By displaying such non-notification information, the second user is inputting the heart finding information by the first user, so that the _second terminal device 2002 waits until the input operation is completed. You can intuitively recognize that you cannot enter heart finding information.

In step S1060 of FIG. 8, the voice recognition analysis unit 330 determines whether or not the terminal device 200 in the selection mode has voice input of the displayed item name and subsequently has voice input of the input start command. do. Such a determination is based on, for example, finding record structure data 410 (see FIG. 3), command data 420 (see FIG. 4), pronunciation dictionary data 430 (see FIG. 5), and terminal state management table 440 (see FIG. 6). Will be done.

Here, the item name to be determined is displayed as the item name button 621 in the finding input area 620 of the finding record input screen 600. Therefore, the user can select a desired item name and input it to the terminal device 200 by voice as if selecting one of the displayed plurality of item name buttons 621 and reading it aloud.

For example, assume that the heart finding input area 620 is displayed (see FIG. 10). In this case, the item names 412 (see FIG. 3) such as "cardiac removed blood volume" and "cardiac removed blood properties" and the command 422 (see FIG. 4) "start input" are the targets of the determination.

When there is a voice input of the item name and the input start command (S1060: YES), the voice recognition analysis unit 330 advances the process to step S1070. Further, when there is no voice input of the item name and the input start command (S1060: NO), the voice recognition analysis unit 330 advances the process to step S1080 described later.

In step S1070, the input screen control unit 340 switches the screen mode of the terminal device 200 in which the item name and the input start command are input by voice to the input mode, and sets the input item as the selected item. ..

FIG. 12 is a diagram showing changes in the findings input screen when “input start” is input by voice following “cardiac excision blood properties” on the findings input screen shown in FIG. 10, and corresponds to FIG. 10. Is what you do. The parts corresponding to FIG. 10 are designated by the same reference numerals, and the description thereof will be omitted.

As shown in FIG. 12, the input screen control unit 340 imparts selection notification information indicating that selection is being made to the item name button 621 corresponding to the voice-input "cardiac removed blood property". As the selection notification information, for example, a display form of the item name button 621 different from the other item name buttons 621 is used. As such a different display form, a line type, a button color, a button shape, a character color, or a character style of a button border can be adopted.

Further, the input screen control unit 340 causes the command display area 630 to display a list of readings of the command 422 (see FIG. 4) in the input mode.

In step S1080 of FIG. 8, the voice recognition analysis unit 330 determines whether or not there is a voice input for a phrase other than the command displayed in the command display area 630 in the terminal device 200 in the input mode. Such a determination is made based on, for example, command data 420 (see FIG. 4), pronunciation dictionary data 430 (see FIG. 5), and terminal state management table 440 (see FIG. 6).

When there is a voice input for a phrase other than a command (S1080: YES), the voice recognition analysis unit 330 advances the process to step S1090. Further, when there is no voice input for words and phrases other than the command (S1080: NO), the voice recognition analysis unit 330 advances the process to step S1100 described later.

In step S1090, the input screen control unit 340 displays the text information of the voice-input phrase in the input area 622 (see FIG. 12) corresponding to the selected item name button 621. Further, the information recording unit 350 records the text data of the input phrase together with the original voice data in the electronic record as the finding information about the item corresponding to the selected item name button 621. That is, the information recording unit 350 adds the input information to the finding information data 313.

FIG. 13 is a diagram showing an example of a finding record input screen when finding information is input in the finding input area corresponding to the part name of “whole body”, and corresponds to FIGS. 9 to 12. The parts corresponding to FIGS. 9 to 12 are designated by the same reference numerals, and the description thereof will be omitted.

As shown in FIG. 13, the voice-input findings information is displayed as text in each input area 622 of the findings input area 620. The text information is displayed in real time, for example, each time the voice recognition result of each phrase is obtained. As a result, the user can perform the voice input operation while sequentially confirming whether or not the content spoken by the user is correctly input.

The input screen control unit 340 may provide completion notification information indicating that to the part name tab 611 of the body part in which all the necessary finding information has been recorded. As the completion notification information, it is possible to adopt a display form of the part name tab 611 different from the other part name tab 611 by changing the character color, the font, the background color, or the like.

That is, the input screen control unit 340 is capable of voice input, a body part where voice input is not possible because another user is performing an input operation, a body part where voice input is possible but the recording of finding information is not completed, and voice input is possible. Each of the body parts for which the recording of the finding information has not been completed is displayed in an identifiable manner.

In step S1100 of FIG. 8, the voice recognition analysis unit 330 determines whether or not there is a voice input of the input stop command in the terminal device 200 in the input mode. Such a determination is made based on, for example, command data 420 (see FIG. 4), pronunciation dictionary data 430 (see FIG. 5), and terminal state management table 440 (see FIG. 6).

When there is a voice input of the input stop command (S1100: YES), the voice recognition analysis unit 330 advances the process to step S1110. Further, when there is no voice input of the input stop command (S1100: NO), the voice recognition analysis unit 330 advances the process to step S1120 described later.

In step S1110, the input screen control unit 340 switches the screen mode of the terminal device 200 in which the voice input of the input stop command is received to the selection mode. Such a setting is made using the terminal state management table 440 (see FIG. 6).

In step S1120, the voice recognition analysis unit 330 determines whether or not there is a voice input of a command (other command) other than the input start command in the selection mode and the input stop command in the input mode, such as an edit command. Such a determination is made based on, for example, command data 420 (see FIG. 4), pronunciation dictionary data 430 (see FIG. 5), and terminal state management table 440 (see FIG. 6).

When there is a voice input of another command (S1120: YES), the voice recognition analysis unit 330 advances the process to step S1130. Further, when there is no voice input of another command (S1120: NO), the voice recognition analysis unit 330 advances the process to step S1140 described later.

In step S1130, the input screen control unit 340 performs processing according to the command input by voice. Such processing includes, for example, scrolling the screen, adding an item, inputting information indicating that the input of finding information is unnecessary, editing the input finding information, deleting the input finding information, and the like. ..

In step S1140, the input screen control unit 340 determines whether or not there is an instruction to end the voice input process of the finding information. Such an instruction is given, for example, by pressing the end button by the user.

If the input screen control unit 340 is not instructed to end the process (S1140: NO), the input screen control unit 340 returns the process to step S1020. Further, when the input screen control unit 340 is instructed to end the process (S1140: YES), the input screen control unit 340 ends a series of processes.

Due to such an operation, the electronic record recording support device 300 receives voice input of information and commands for each terminal device 200 according to the display state and operation progress, and also receives exclusive voice for each body part. The input interface can be realized in a form that is easy for the user to use.

When the voice input is not accepted without displaying the impossible notification information for the part name of the body part during the input work in the other terminal device 200, the user cannot immediately identify the reason. It can be confusing.

In this respect, the electronic finding recording support device 300 displays the non-notification information, and does not display the corresponding part selection area 610 for the body part during the input work in the other terminal device 200. In this case, the user can recognize that the exclusive control of the input operation is working before the useless utterance of the part name or the item name is performed.

As a result, each user can promptly select the part name of the other body part other than the body part during the input work by the other user, and proceed with the work. That is, the electronic findings recording support device 300 can appropriately support the work of a plurality of users to record the findings information regarding a plurality of body parts in the electronic findings by voice.

FIG. 14 is a diagram showing an example of the contents of the finding information data 313 generated by the information recording unit 350. Here, an example in which the finding information data 313 is described in XML (eXtensible Markup Language) and includes the finding structure data 410 (see FIG. 3) and the pronunciation dictionary data 430 (see FIG. 5). show.

As shown in FIG. 14, in the finding information data 313, the reading of the item name is described by the attribute "spoken", and the notation on the finding input screen of the item name is described by the attribute "label". .. Further, the finding information data 313 describes the text information of the input finding information by the attribute "data", and describes the initial state of the finding information by the attribute "initial". Further, in the finding information data 313, the input field type is described by the attribute "type", and the data name of the input and recorded voice data is described by the attribute "voicefile". When the input field type is an option, the finding information data 313 includes a description about the attributes "spoken" and "label" of each option, and which option is selected by the attribute "select". Describe (that is, finding information).

For example, when the information recording unit 350 generates an electronic finding for a new object, the finding information data 313 is generated without describing the values in the attributes of "data", "voicefile", and "select". .. Then, each time the finding information is input, the information recording unit 350 adds voice data of the finding information, text information, and information indicating which option is selected to the corresponding portion of the information recording unit 350. go.

By generating such finding information data 313, not only the finding information is reflected in the electronic finding, but also the original voice data is output by voice, and whether or not the voice input is performed accurately is performed later. It is also possible to check from.

For example, the input screen control unit 340 accepts not only voice input but also input and edit operations of finding information by a manual input interface such as a keyboard and a mouse. Then, when a predetermined operation such as a click operation is performed on the displayed item name button 621, the input screen control unit 340 acquires the corresponding voice data based on the finding information data 313. Audio is output via the loudspeaker.

As a result, the user who input the finding information by voice or the operator who manages the information of the electronic finding can confirm the actual spoken voice and edit the recorded finding information as appropriate.

The information recording unit 350 may receive a predetermined operation from the user, convert the contents of the finding information data 313 into document data, create an autopsy record, and display or print the information according to the predetermined operation. ..

FIG. 15 is a diagram showing an example of an autopsy record.

As shown in FIG. 15, in the autopsy record 710, an item name is described for each site name, and further, the recorded finding information is described in association with each item name. The autopsy record 710 can be used, for example, as an autopsy record unit of a certificate.

It is desirable that the autopsy findings in the forensic anatomy present the user in a visually easy-to-understand format as to which body part of the human body the autopsy findings are about. Therefore, the autopsy findings include identification information (for example, a number) for identifying the body part corresponding to the autopsy findings, the human body diagram is displayed, and the identification information is located at the position of the body part on the human body diagram. Is conceivable to display. Conventionally, a user manually inputs identification information for identifying a body part in an autopsy finding, identifies a position of a body part corresponding to the autopsy finding in a human body diagram, and manually inputs the identification information at the specified position. In this case, the work of inputting the identification information is complicated, and there is a problem that different identification information may be erroneously input between the autopsy findings and the human body chart.

Therefore, in the present embodiment, the finding information is input by voice for a certain body part on the finding input screen, and the finding information includes the body part information indicating the body part and the identification information for identifying the body part. If so, the electronic record recording support device 300 identifies the position of the body part on the human body diagram based on the body part information, and performs a process of displaying the identification information at the specified position. As a result, the user simply speaks the finding information including the body part information and the identification information (that is, causes the electronic finding recording support device 300 to perform voice recognition), and the same identification information is used for both the autopsy findings and the human body diagram. Can be entered. Therefore, the work of inputting the identification information is complicated, and it is possible to solve the conventional problem that different identification information may be erroneously input between the autopsy findings and the human body diagram.

Hereinafter, with reference to FIGS. 16 and 17, a specific process of specifying the position of the body part in the human body diagram based on the body part information included in the finding information and displaying the identification information at the specified position will be described.

FIG. 16 is a diagram showing an example of a finding input screen including a human body diagram. As shown in FIG. 16, the finding input area (site-specific screen) 620 of the finding input screen 600 is for one body part (in the example shown in FIG. 16, “injured neck and above”) of the body part. This is an area for displaying a list of a plurality of item names 412 (“damage 01” and “damage 02” in the example shown in FIG. 16) corresponding to the site name 411 as a plurality of item name buttons 621a and 621b. Further, the finding input area 620 displays the input field corresponding to the input field type 413 (see FIG. 3) corresponding to each item name 412 as the input areas 622a and 622b in association with the item name buttons 621a and 621b. It is an area.

Further, the finding input area 620 is a human body diagram 800 schematically showing a human body related to one body part (“injured neck and above” in the example shown in FIG. 16) on the right side of the input areas 622a and 622b. indicate. In the human body diagram 800, the right side view of the human body is displayed on the left side, and the left side view of the human body is displayed on the right side. For example, four types of human figures are prepared as human figures that can be displayed in the finding input area 620, and among the four types of human figures, they are selected by voice input while the findings input screen 600 is being displayed. A human figure related to the body part is displayed.

The human figure 800 is included in the human figure information 314 stored in the information storage unit 310. FIG. 17 is a diagram showing an example of the contents of the human body diagram information 314. As shown in FIG. 17, the human body diagram information 314 includes a human body diagram (not shown), body part information indicating a body part (part name), reading information indicating how to read the body part, and a body in the human body diagram. The position information indicating the position of the part (X position, Y position) and the identification information for identifying the body part by, for example, a number or an alphabet are included in association with each other. Here, the X position indicates the position of the body part in the left-right direction of the human body diagram 800 of FIG. Further, the Y position indicates the position of the body part in the vertical direction of the human body diagram 800 of FIG.

For example, when the body part (site name) is the "left neck", the X position of the "left neck" in the human figure 800 is 307 by referring to the human figure information 314, and the "left neck". It can be specified that the Y position of is 67. Further, when the body part (site name) is the "sternum part", it can be specified that the X position of the "sternum part" in the human body diagram 800 is 372 and the Y position of the "sternum part" is 92. can.

In the finding input screen 600 shown in FIG. 16, after the displayed item name (for example, "damage 01") is followed by the voice input of the input start command, the input screen control unit 340 is voice-input. The textual information of the phrase (finding information, for example, "damage to the base of the nose No. 13 is found") is displayed in the input area 622a corresponding to the selected item name button 621a.

Further, the input screen control unit 340 includes body part information indicating a body part (for example, "nose root") and identification information for identifying the body part (for example, 13) from the voice-input findings information. To get.

In addition, the input screen control unit 340 does not say that the voice-input finding information is "damage to the nose root of No. 13", but "damage to the nose root of No. 13" and "no. 13 of the nose root". Even if it is indicated by different expressions such as "damage is found", "damage is found at the base of the nose 13" or "damage is found at the left ear of the nose root 13", the body part is found in the information of the findings. (For example, "nose base") and identification information (for example, 13) for identifying the body part are acquired. When the voice-input finding information is "damage is found in the nose root 13th left auricle", that is, the identification information between the two body part information (for example, "nose root" and "left auricle"). When is sandwiched, the input screen control unit 340 acquires the previously voice-input "nose base" as body part information.

Next, the input screen control unit 340 determines the position of the body part in the human body diagram 800 based on the acquired body part information (“nose root portion”) and the human body diagram information 314 stored in the information storage unit 310. The position indicated by reference numeral 810) is specified. Then, the input screen control unit 340 displays the identification information (“13”) at the position of the specified body part in the human body diagram 800.

Finally, in the human body diagram information 314 stored in the information storage unit 310, the information recording unit 350 includes the human body diagram 800, body part information (“nose base”), reading information, position information, and finding information. The identification information (“13”) acquired via voice input is associated and stored. As a result, when the human figure 800 is redisplayed on the finding input screen 600, the input screen control unit 340 corresponds to the position of the body part in the human figure 800 where the identification information exists in the human figure information 314. Identification information can be displayed.

Further, in the finding input screen 600 shown in FIG. 16, after the input start command is input by voice following the displayed item name (for example, "damage 02"), the input screen control unit 340 inputs voice. The text information of the phrase (finding information, for example, "Bleeding is observed in the left pinna of No. 5") is displayed in the input area 622b corresponding to the selected item name button 621b.

Further, the input screen control unit 340 includes body part information indicating the body part (for example, "left auricle") and identification information for identifying the body part (for example, 5) from the voice-input findings information. And get.

In the input screen control unit 340, the voice-input findings information is not "Bleeding is observed in the left auricle No. 5", but "Bleeding is observed in the left auricle No. 5" and "Left No. 5". Even if it is indicated by different expressions such as "Bleeding is observed in the auricle", "Bleeding is observed in the left auricle No. 5" or "Bleeding is observed in the nose base of the left auricle No. 5", it is included in the findings information. From, body part information indicating a body part (for example, "left pinna") and identification information for identifying the body part (for example, 5) are acquired. When the voice-input finding information is "bleeding is observed in the left auricle No. 5 nose root", that is, the identification information between the two body part information (for example, "left auricle" and "nose root"). When is sandwiched, the input screen control unit 340 acquires the previously voice-input "left pinna" as body part information.

Next, the input screen control unit 340 determines the position of the body part in the human body diagram 800 based on the acquired body part information (“left auricle”) and the human body diagram information 314 stored in the information storage unit 310. (Position indicated by reference numeral 820) is specified. Then, the input screen control unit 340 displays the identification information (“5”) at the position of the specified body part in the human body diagram 800.

Finally, in the human body diagram information 314 stored in the information storage unit 310, the information recording unit 350 includes the human body diagram 800, body part information (“left auricle”), reading information, position information, and finding information. The identification information (“5”) acquired via the voice input of the above is stored in association with the identification information (“5”). As a result, when the human figure 800 is redisplayed on the finding input screen 600, the input screen control unit 340 corresponds to the position of the body part in the human figure 800 where the identification information exists in the human figure information 314. Identification information can be displayed.

Although the input screen control unit 340 has described an example of acquiring body part information indicating a body part and identification information for identifying the body part from the voice-input findings information, the body part information and the body part information and the identification information for identifying the body part have been described. The method of acquiring the identification information is not limited to this. For example, when the human figure 800 is displayed on the finding input screen 600, the human figure selection comment for selecting the human figure 800 is followed by body part information (for example, "outside left side of frontal region") and identification information ("" 4 ”) When there is a voice input, the input screen control unit 340 acquires the voice-input body part information and the identification information. Then, the input screen control unit 340 is based on the acquired body part information and the human body diagram information 314 stored in the information storage unit 310, and is the body part (“the outside of the left side of the frontal region”) in the human body diagram 800. The position (position indicated by reference numeral 830) is specified. Then, the input screen control unit 340 displays a cursor indicated by a round circle at the position of the specified body part in the human body diagram 800, and displays the identification information (“4”) in the cursor. As a result, the user can easily check whether or not the identification information displayed on the human figure 800 is displayed in the cursor, and thus whether or not the identification information is included in the finding information and input by voice. Can be grasped.

<Effect of this embodiment>
As described above, the electronic record recording support device 300 according to the present embodiment voices the finding information for each item via the site-specific screens prepared for each body part in each of the plurality of terminal devices 200. input. Further, the electronic finding recording support device 300 does not display the screen for each part on the other terminal device 200 while the screen for each part is displayed on the terminal device 200, and the corresponding finding information is voiced. Notify the user of the other terminal device 200 that the input cannot be performed.

As a result, it is difficult for the electronic record recording support device 300 to use the manual input interface, and it is necessary for a plurality of users to input finding information about a plurality of body parts at the same time. Also, it is possible to support the work of recording the finding information in the electronic findings. That is, the electronic findings recording support device 300 can support, for example, the work of recording the autopsy findings in the electronic findings.

<Modified example of this embodiment>
In the embodiment described above, the case where the electronic finding recording support device 300 is applied to a system for recording autopsy findings in a forensic anatomy has been described, but the present invention is not limited thereto. The electronic finding recording support device 300 can be applied to various systems that allow a plurality of users to simultaneously input finding information about a plurality of body parts, such as an electronic medical record for emergency lifesaving.

Further, the part name, the item name, and the command are not limited to the above examples. Further, the processing related to the item name and the command is not always necessary when it is not necessary to record the finding information subdivided for each item name.

Moreover, the unit of the body part is not limited to the above-mentioned example. The body part may be a range of a set of information that one user pays attention to at one time when recording the finding information, and may be changed according to the purpose of the electronic finding.

Further, the arrangement and display form of each information on the finding input screen 600 (see FIGS. 9 to 13) is not limited to the above example. The input screen control unit 340 may arrange, for example, the site selection area 610 on the left side, the lower side, or the right side of the finding input area 620.

Further, the data format of the finding information data is not limited to the above example. The finding information data may be in another data format such as RTF (Rich Text Format) format, TEX format, and plain text format.

Further, the terminal connection unit 320 may communicate with each of the headset 220 and the display device 230 individually. In this case, the electronic finding recording support device 300 needs to set the correspondence between the headset 220 and the display device 230 in, for example, the input screen control unit 340.

Further, the configuration of the terminal device 200 is not limited to the above example. The terminal device 200 may be, for example, a personal computer including a microphone and a liquid crystal display.

Further, the number of terminal devices 200 connected to the electronic record recording support device 300 may be three or more. In this case, the input screen control unit 340 cannot be used for the corresponding part name displayed on all the other terminal devices 200 while the screen for each part is displayed on the 200 of the terminal device. Give notification information. Further, the input screen control unit 340 does not display the corresponding site-specific screen on all the other terminal devices 200 while the site-specific screen is displayed on the 200 of any terminal device.

Further, a part of the configuration of the electronic record recording support device 300 may be separated from other parts of the configuration of the electronic record recording support device 300 by being arranged on a server or the like on the network. In this case, each of these parts needs to be provided with a communication unit for communicating with each other.

Further, a part or all of the configuration of the electronic record recording support device 300 may be integrally configured with any of the terminal devices 200.

INDUSTRIAL APPLICABILITY The present invention is useful as an electronic finding recording support device and an electronic finding recording support method capable of supporting the recording work of autopsy findings in electronic findings.

100 Electronic finding system 200 Terminal device 210 Terminal control device 220 Headset 230 Display device 300 Electronic finding recording support device 310 Information storage unit 311 Voice recognition dictionary 312 Finding configuration information 313 Finding information data 314 Human figure information 320 Terminal connection Unit 330 Voice recognition analysis unit 340 Input screen control unit 350 Information recording unit

Claims (5)

It is an electronic finding recording support device that supports the recording of finding information about body parts in electronic findings.
A terminal connection unit that connects to a terminal device that has a voice input function and an image display function,
When the body part information indicating the body part and the identification information for identifying the body part are input by voice in the terminal device displaying the human body diagram, the body part information and the said body part information are based on the voice recognition process. The information acquisition unit that acquires identification information, and
Based on the acquired body part information, a position specifying part that specifies the position of the body part in the human body diagram, and
In the human body diagram, a display control unit that displays the identification information at the position of the specified body part, and
Electronic findings recording support device equipped with. When the finding information is input by voice, the information acquisition unit acquires the body part information and the identification information included in the finding information based on the voice recognition process.
The electronic finding recording support device according to claim 1. The human body diagram information storage unit for storing the human body diagram information including the human body diagram, the body part information, and the position information indicating the position of the body part in the human body diagram in association with each other is provided.
The position specifying unit identifies the position of the body part in the human body diagram based on the body part information acquired by the information acquisition unit and the human body diagram information.
The electronic finding recording support device according to claim 1 or 2. The human body diagram information includes a storage control unit that stores the human body diagram, the body part information, the position information, and the identification information acquired by the information acquisition unit in association with each other.
The electronic finding recording support device according to claim 3. It is an electronic finding recording support method that supports the recording of finding information on body parts in electronic findings.
Connect to a terminal device that has a voice input function and an image display function,
When the body part information indicating the body part and the identification information for identifying the body part are input by voice in the terminal device displaying the human body diagram, the body part information and the said body part information are based on the voice recognition process. Get the identification information,
Based on the acquired body part information, the position of the body part in the human body diagram is specified, and the position of the body part is specified.
In the human body diagram, the identification information is displayed at the position of the specified body part.
Electronic findings recording support method.

Images