CN101727674A - Method for marking picture in file, and method for reproducing mark of picture in file - Google Patents

Abstract

The invention discloses a method for labeling and reproducing pictures in a document, and belongs to the related field of electronic medical record informatization. The method for picture labeling in the document of the present invention is: set up a picture library table and a picture labeling symbol library; After the user logs in to the system, select the document to be labelled; the system transfers the picture in the selected document into the drawing labeling window, Label the picture with the label symbol and picture label position; finally, the system stores the label parameters as additional attributes of the picture label object. The method for reproducing and annotating pictures in the document of the present invention is as follows: after the user logs in to the system, the user selects the document to be reproduced and marked; the system transfers the picture in the selected document into the drawing and marking window, and then transfers the additional attributes of the picture label object and the user login information Dynamically generate classes for labeled pictures to reproduce picture labeling information. The invention greatly reduces the storage capacity of document data, and at the same time, can realize full-text search and analysis for picture labeling information.

Description

A Method for Image Annotation and Reproduction Annotation in Documents

Technical field:

The invention relates to an image processing method, in particular to a method for annotating and reproducing an image in a document, and belongs to the related field of electronic medical record informatization.

Background technique:

At present, in the process of implementing the existing electronic medical record system in the hospital. Most of the existing electronic medical record information systems mainly include document electronic medical record data and multimedia electronic medical record data other than text. For text electronic medical record data, certain data format files such as XML format can be used to store. However, for multimedia data such as pictures in electronic medical records, most of them are stored in the original multimedia format. Such as GIF, BMP and other formats. When the actual clinician writes the medical record, the doctor is often used to make detailed annotations for the current patient's condition on some medical pictures inserted in the medical record. Then, many existing electronic medical record systems provide a picture editor to allow doctors to edit and generate a new picture on the original picture and put it into the electronic medical record document.

However, according to the existing implementation. When a patient's medical records are labeled multiple times, a lot of image data in the intermediate process will be generated for the annotation information of multimedia pictures, and as the doctor's intervention increases and the number of medical record review processing increases, many pictures will be generated, which will increase the media storage. Moreover, a new picture medium is generated for each annotation, which will lead to difficulties in the application and analysis of electronic medical record data in the future, and it is impossible to perform effective full-text search and analysis on the picture medium that has formed a multimedia format.

Invention content:

The purpose of the present invention is to provide a method for labeling and reproducing pictures in a document, which can be applied to the existing electronic medical record system of a hospital, and can provide doctors with a continuous labeling process and method for medical pictures in the medical record document. In this way, the problems existing in the processing of medical image annotation in the existing electronic medical records can be changed, and the annotations on the images by doctors can form effective XML format data that can be searched and analyzed in full text.

A method for annotating pictures in a document, the steps of which are:

1) Establish a picture library table for storing the index of pictures in the picture library;

2) Establishing a picture labeling symbol library for storing picture labeling symbols;

3) The user selects the document to be marked after logging in to the system;

4) the system transfers the pictures in the selected document into the drawing annotation window through the picture library table;

5) The system goes to the picture annotation symbol library to obtain the annotation symbol selected by the user;

6) The system calls the selected labeling symbol to label the picture according to the picture labeling position selected by the user;

7) The system stores the annotation parameters as additional attributes of the image label object.

The fields of the picture library table include: picture code, picture name, applicable business department, picture format, and picture storage path.

The attribute information of the image annotation symbol library includes: symbol code, symbol name, symbol meaning, annotation symbol drawing type, and symbol drawing parameters.

The drawing type of the annotation symbol includes: circle, rectangle, straight line; the implementation method of the drawing parameter of the symbol is: at first select the drawing function in the java.awt.Graphics class of Java according to the drawing type of the selected annotation symbol, and then the drawing function according to The coordinate parameters for drawing graphics, and the drawing symbols are dynamically generated at runtime.

The method that the system transfers the picture in the selected document into the drawing annotation window is: through the incoming original picture URL parameter, utilize the URLConnection object to obtain the data stream of the original picture, and the program declares the java.awt.image.BufferedImage class object, Load the original picture data stream into the BufferedImage object instance, and call the getGraphics method of the BufferedImage object to obtain the picture drawing interface class object.

The labeling parameters include: labeling person, time, location, labeling symbol, labeling comment, and labeling operation; the operation types of the labeling operation include: delete, modify, and increase; the labeling parameters are saved in the Image file of the document XML format file Label object attached attribute data.

A method for reproducing and annotating pictures in a document, the steps of which are as follows:

1) After the user logs in to the system, he selects the document to be reproduced and marked;

2) the system transfers the pictures in the selected document into the drawing annotation window through the picture library table; the picture library table is an index for storing pictures in the picture library;

3) The system transfers the additional attributes of the image tag object and the user login information to the dynamic generation class of the tagged image;

4) Annotated image dynamic generation class determines the drawing range according to the received data, and reproduces the image annotation information.

After step 2) of the method, the system first judges whether the attachment attribute of the selected image tag object is empty, and if it is empty, it prompts that it is an unlabeled image; if the additional attribute is not empty, then proceed to step 3).

In step 3) of the method, the system provides the user with an option to view annotations, and transfers the annotations selected by the user to the dynamic generation class of the annotation picture; the annotations include: personal annotations, everyone, and left. Trace inspection, neat inspection.

The dynamic generation class of the labeled picture determines the drawing range according to the received data, and the method for reproducing the picture label information is:

1) Determine the drawing range according to the drawing parameters of the annotation;

2) According to the incoming annotation viewing method, it is determined to filter the annotation data display accordingly;

3) According to the incoming annotation symbol type, the system goes to the image annotation symbol library to obtain the annotation symbol drawing parameters to draw the annotation symbol; the image annotation symbol library is used to store the image annotation symbols;

4) Call the drawing function in the Graphics interface to draw the corresponding label symbol graphics at the corresponding coordinate position according to the incoming label coordinate position;

5) According to the incoming annotation text and the coordinate position of the corresponding annotation symbol, call the corresponding graphic function drawRoundRect in the Graphics interface to draw the annotation information box, and then call drawString to draw the incoming annotation text into the annotation box area;

6) Call the encode in the com.sun.image.codec.jpeg.JPEGImageEncoder JPEG image encoding tool class to encode the image instance into the corresponding http format data stream and return it to reproduce the image annotation information.

Advantage and positive effect of the present invention:

Through the creation of the present invention, the following effects are achieved for the existing hospital electronic medical record information system:

1) It can further expand the scope of informatization of hospital electronic medical records, and can informatize medical image media other than text in medical records. Through the present invention, different doctors and different approval levels can realize the labeling of hierarchical medical record information for medical pictures. Let users visually display the patient's condition information of relevant parts when writing and browsing medical records.

2) For the picture labeling of medical records, the electronic medical record data adopts the separation method of picture template and picture labeling information, so that the electronic medical record data can be recorded and edited for each doctor's labeling information every time, and at the same time, there is no need to use the intermediate process Medical image storage greatly reduces the amount of medical record data storage.

3) In addition, through the process and method for labeling of the present invention, the labeling information of all picture media can also be stored in XML format data that can be structured and analyzed, and the electronic medical record can also realize full-text search and analysis for picture labeling information .

4) Through the present invention, doctors can check and process the marking of medical picture media individually in the process of writing electronic medical records. And you can customize your own picture annotation symbol dictionary. Each annotation in the medical record writing process can be viewed, retrieved and edited, and the annotation results in each review process can be viewed and displayed neatly.

Description of drawings:

Figure 1. Schematic diagram of medical image labeling process;

Figure 2. Schematic diagram of the medical picture reproduction labeling method.

Detailed ways:

The present invention includes two parts: picture labeling and reproduction labeling, and the technical solution of the present invention will now be described in detail in conjunction with the accompanying drawings.

1. A method for annotating pictures in a document:

(1) Establish the basic system dictionary:

Raw medical image library:

First of all, a medical picture library table should be established in the electronic medical record system database. This table contains fields such as image code, image name, applicable business department, image format, and image storage path. In this dictionary table, each business department of the corresponding hospital can maintain the medical pictures that they need to use in the process of writing medical records. This table only stores the index of the picture library, and the picture medium can be placed on the corresponding file server.

图片标注符号库：

Image annotation symbol library:

When annotating pictures in medical record writing, doctors are used to using some customary special symbols to generate symbol marks at the clicked picture positions. Therefore, we analyze and summarize common symbols used by doctors in advance to form a symbol annotation library dictionary. The symbol library includes symbol encoding, symbol name, symbol meaning, dimension symbol drawing type, and symbol drawing parameters.

The key among these properties is the symbol drawing parameter, which mainly records the relative trajectory coordinate parameters of the symbol drawing coordinates. Because for the common special symbols, we can use the drawing functions in Java's java.awt.Graphics class to dynamically generate drawing symbols at runtime according to the coordinate parameters of drawing graphics.

For the drawing function, distinguish the drawing types of label symbols, and several common types such as circle, rectangle, and line. In this way, when marking, the program distinguishes the selected type of marking during compilation, and calls drawing functions in different java.awt.Graphics classes to draw marking symbols according to different types of symbols selected for marking.

(2) Business application processing process, as shown in Fig. 1 .

1) The doctor logs in and selects the patient to write the medical record document: First, the doctor who writes the medical record logs in to the electronic medical record system according to the user name and password assigned by the corresponding electronic medical record system user management. The system will list the list of patients currently in charge of the doctor, and the doctor can select a patient's electronic medical record file to enter the corresponding writing. For example, click on the patient in bed No. 2 to enter the writing of the admission record medical record document.

2) Identify and judge the graphic elements in the medical record document: when entering the writing work area of a certain medical record document, the system recognizes the graphic element of the <Image> tag type in the page according to the page element Html tag in the current document, and obtains the The label corresponds to the attribute value of the graphic element. Use the URLConnection object to obtain the data stream of the original image through the incoming original image URL parameter. The program declares the java.awt.image.BufferedImage class object and loads the original image data stream into the BufferedImage object instance.

3) Obtain the image drawing interface class object by calling the getGraphics method of the BufferedImage object just declared;

4) Select the annotation symbol: the optional annotation symbol can be listed from the annotation tool bar; through the input annotation symbol type, the system obtains the annotation symbol drawing parameters from the annotation symbol dictionary table.

5) Select the location of the marked picture: the marking tool generates a marked symbol at the corresponding position, and at the same time extends from the marked position to the edge of the original picture to generate a marked comment message box; according to the incoming marked coordinate position, the program sets by calling the drawing function in the Graphics interface such as setColor Color, fillRect fills a rectangle, drawLine draws a straight line, drawRoundRect draws a rectangle, drawOval draws an ellipse (can be adjusted to a circle) and draws the corresponding label symbol graphics at the corresponding coordinate position.

6) Edit annotation text: the user can modify and delete the corresponding annotation information in the annotation information column list. Through the incoming annotation text and the coordinate position of the corresponding annotation symbol, the program calls the drawing function drawRoundRect in the corresponding Graphics interface to draw the annotation information box, and then calls drawString to draw the incoming annotation text into the annotation box area.

7) When the doctor finishes labeling, the system will automatically generate the current labeling data parameters: such as labeling person, time, location, labeling symbol, labeling comment, labeling operation (if it is an operation to label someone else, record the operation type: delete, modify, add) . Pass these parameters to the service class CreateImage for dynamically annotated image generation, and the service will return the Http format object stream of the newly generated image and display it at the position of the Image object tag on the current document page.

8) When the medical record document is saved, the corresponding picture annotation information is saved in the XML format data of the medical record document as an additional attribute of the Image tag object; and the original picture is not modified. In this way, the data generated by the image and the annotation can be stored separately.

2. A method for reproducing and annotating pictures in a document, the process of which is shown in Figure 2:

1) The doctor logs in and selects the patient to write the medical record document: First, the doctor who writes the medical record logs in to the electronic medical record system according to the user name and password assigned by the corresponding electronic medical record system user management. The system will list the list of patients currently in charge of the doctor, and the doctor can select a patient's electronic medical record file to enter the corresponding writing. For example, click on the patient in bed No. 2 to enter the writing of the admission record medical record document.

2) Identify and judge the graphic elements in the medical record document: when entering the writing work area of a certain medical record document, the system recognizes the graphic element of the <Image> tag type in the page according to the page element Html tag in the current document, and obtains the The label corresponds to the attribute value of the graphic element. Use the URLConnection object to obtain the data stream of the original image through the incoming original image URL parameter. The program declares the java.awt.image.BufferedImage class object and loads the original image data stream into the BufferedImage object instance.

3) Obtain the image drawing interface class object by calling the getGraphics method of the BufferedImage object just declared;

4) Judging whether it has been marked: the program needs to judge the label of the found Image object. If the label data information is empty, it means that it has not been marked. If it is non-empty, it means that the picture has been marked.

5) If the picture has been tagged, the program calls the class CreateImage to dynamically generate the tagged image, and the current registrant, tagged view mode (personal tagged view, everyone tagged view, traced view, tidy view; the default is tidy view), current The annotation attribute parameter string corresponding to the Image object is passed to the annotation image dynamic generation class.

6) Determine the drawing range: when drawing dynamic annotation information, the program determines the drawing range according to the incoming annotation drawing parameters (such as the X, Y coordinate values of the drawing annotation point, all annotation symbols, annotation person, annotation time, annotation annotation), according to The incoming annotation viewing method determines whether to filter the annotation data accordingly for the current person's annotation, the owner's annotation, the left annotation, or the tidy annotation display. If there are traces, it is also necessary to distinguish whether to delete or add, and use red for deletion and green lines for addition to distinguish and draw.

7) Dynamic drawing of annotation symbols: through the input annotation symbol type, the system goes to the annotation symbol dictionary table to obtain the annotation symbol drawing parameters. At the same time, according to the coordinate position of the incoming annotation, the program draws the corresponding coordinate position by calling the drawing function in the Graphics interface such as setColor to set the color, fillRect to fill the rectangle, drawLine to draw a line, drawRoundRect to draw a rectangle, and drawOval to draw an ellipse (can be adjusted to a circle). callout symbol graphics.

8) Dynamic drawing of annotations: through the incoming annotation text and the coordinate position of the corresponding annotation symbol, the program calls the drawing function drawRoundRect in the corresponding Graphics interface to draw the annotation information box, and then calls drawString to draw the incoming annotation text to the annotation within the frame area.

9) Dynamically generate image objects: when all annotation information is drawn. At this time, call the encode in the com.sun.image.codec.jpeg.JPEGImageEncoder JPEG image encoding tool class to encode the image instance into the corresponding http format data stream and return it.

3. Application of independent storage of marked data:

1) Full-text retrieval of image annotation: In the application process of scientific research retrieval and analysis in the later stage of electronic medical records, the program can use the DOM object to locate the corresponding Image object. In the annotation parameter string of the corresponding Image object, the annotation symbol is certain symbols, and the annotation text appears those words Full-text search and analysis.

Claims (10)

1. A method for annotating pictures in a document, the steps of which are: 1) Establish a picture library table for storing the index of pictures in the picture library; 2) Establishing a picture labeling symbol library for storing picture labeling symbols; 3) The user selects the document to be marked after logging in to the system; 4) the system transfers the pictures in the selected document into the drawing annotation window through the picture library table; 5) The system obtains the annotation symbol selected by the user from the image annotation symbol library; 6) The system calls the selected labeling symbol to label the picture according to the picture labeling position selected by the user; 7) The system stores the annotation parameters as additional attributes of the image label object. 2. The method according to claim 1, wherein the fields of the picture library table include: picture code, picture name, applicable business department, picture format, and picture storage path. 3. The method according to claim 1, characterized in that the attribute information of the image annotation symbol library includes: symbol code, symbol name, symbol meaning, annotation symbol drawing type, and symbol drawing parameters. 4. method as claimed in claim 3, it is characterized in that described annotation symbol drawing type comprises: circle, rectangle, straight line; The realization method of described symbol drawing parameter is: at first select Java's according to selected annotation symbol drawing type The drawing function in the java.awt.Graphics class, and then the drawing function dynamically generates the drawing symbol at runtime according to the coordinate parameters of the drawn figure. 5. method as claimed in claim 1, it is characterized in that the method that described system transfers the picture in the selected document into drawing annotation window is: by the original picture URL parameter of importing, utilize URLConnection object to obtain the data of original picture Stream, the program declares the java.awt.image.BufferedImage class object, loads the original image data stream into the BufferedImage object instance, and calls the getGraphics method of the BufferedImage object to obtain the image drawing interface class object. 6. The method according to claim 1, wherein the labeling parameters include: labeling person, time, location, labeling symbol, labeling note, labeling operation; the operation types of the labeling operation include: delete, modify, add ; The labeling parameters are stored in the additional attribute data of the Image tag object of the document in XML format. 7. A method for reproducing and annotating pictures in a document, the steps of which are: 1) After the user logs in to the system, he selects the document to be reproduced and marked; 2) the system transfers the pictures in the selected document into the drawing annotation window through the picture library table; the picture library table is an index for storing pictures in the picture library; 3) The system transfers the additional attributes of the image tag object and the user login information to the dynamic generation class of the tagged image; 4) Annotated image dynamic generation class determines the drawing range according to the received data, and reproduces the image annotation information. 8. The method as claimed in claim 7, characterized in that after step 2), the system first judges whether the attachment property of the selected picture label object is empty, if it is empty then the prompt is an unmarked picture; if the additional property is not empty , then proceed to step 3). 9. The method as claimed in claim 8, characterized in that in the step 3), the system provides the user to select the annotation viewing mode, and the annotation viewing mode selected by the user is passed to the dynamic generation class of the annotation picture; the annotation viewing The methods include: individual mark view, all mark view, mark view, and clean view. 10. The method according to claim 9, wherein the dynamic generation class of the marked picture determines the drawing range according to the received data, and the method for reproducing the picture marked information is: 1) Determine the drawing range according to the drawing parameters of the annotation; 2) According to the incoming annotation viewing method, it is determined to filter the annotation data display accordingly; 3) According to the incoming annotation symbol type, the system goes to the image annotation symbol library to obtain the annotation symbol drawing parameters to draw the annotation symbol; the image annotation symbol library is used to store the image annotation symbols; 4) Call the drawing function in the Graphics interface to draw the corresponding label symbol graphics at the corresponding coordinate position according to the incoming label coordinate position; 5) Call the drawing function drawRoundRect in the corresponding Graphics interface to draw the annotation information box according to the incoming annotation text and the coordinate position of the corresponding annotation symbol, and then call drawString to draw the incoming annotation text into the annotation box area; 6) Call the encode in the com.sun.image.codec.jpeg.JPEGImageEncoder JPEG image encoding tool class to encode the image instance into the corresponding http format data stream and return it to reproduce the image annotation information.

Images