CN106175826A - Ultrasonographic display device and the method for display ultrasonoscopy - Google Patents

Abstract

Provided are an ultrasonic image display device and a method for displaying an ultrasonic image, the ultrasonic image display device comprising: an image processor that acquires corresponding ultrasonic data at multiple time points, and based on the relationship between the corresponding ultrasonic data at the multiple time points Correspondence to obtain the first information; a display, displaying a screen image including a diagnostic image showing the first information, wherein the corresponding ultrasound data represents an object including at least one target at the plurality of different time points, the first The information represents changes in the at least one target during the plurality of points in time.

Description

Ultrasonic image display device and method for displaying ultrasonic images

This application claims the benefit of U.S. Provisional Patent Application No. 62/043,773, filed August 29, 2014, with the United States Patent and Trademark Office, and 10-2014-0141201, filed October 17, 2014, with the Korean Intellectual Property Office Korean Patent Application No., the disclosure of which is hereby incorporated by reference in its entirety.

technical field

One or more embodiments of the present invention relate to an ultrasonic image display device and a method of displaying an ultrasonic image, and more particularly, to an ultrasonic image by which a change over time of an object included in a subject is easily diagnosed A display device and a method for displaying ultrasound images.

Background technique

An ultrasonic diagnostic apparatus transmits an ultrasonic signal generated by a transducer of a probe to a subject, and receives information on an echo signal reflected from the subject, thereby obtaining an image of a part of the interior of the subject. Specifically, ultrasonic diagnostic apparatuses are used for medical purposes such as observation of the inside of a subject, detection of foreign matter inside the subject, and diagnosis of damage to the subject. Compared with X-ray equipment, such ultrasonic diagnostic equipment has various advantages, including stability, real-time display, and safety (due to no exposure to radiation sources), therefore, ultrasonic diagnostic equipment is often used together with other image diagnostic equipment .

There is a need for an ultrasonic image display device and a method of displaying an ultrasonic image by which ultrasonic data acquired by an ultrasonic diagnostic device can be efficiently displayed.

Contents of the invention

One or more embodiments of the present invention include an ultrasound image display apparatus and a method of displaying an ultrasound image, by which changes in an object over time can be easily diagnosed. Specifically, one or more exemplary embodiments include an ultrasound image display device and a method of displaying an ultrasound image, by which a user can easily observe a subsequent Changes in time point objects.

Additional aspects will be set forth in part in the description which follows, and in part will be obvious from the description, or may be learned by practice of the described embodiments.

According to one or more embodiments of the present invention, an ultrasound image display device includes an image processor and a display, the image processor acquires corresponding ultrasound data at multiple time points, and based on the corresponding data at the multiple time points Correspondence between ultrasound data to obtain first information, wherein the corresponding acoustic data represents an object including at least one target at a plurality of different time points, and the first information represents the at least one target at the plurality of different time points change of points; the display displays a screen image including a diagnostic image showing the first information.

The diagnostic image may be an ultrasound image displayed such that states of the at least one object at the plurality of different time points can be distinguished from each other.

The corresponding ultrasound data at the plurality of time points may include first ultrasound data obtained by scanning the subject at a first time point and second ultrasound data obtained by scanning the subject at a second time point.

The diagnostic image may be an ultrasound image that superimposes a first object image depicting the at least one object based on the first ultrasound data and a second object image depicting the at least one object based on the second ultrasound data. the at least one target.

The first target image and the second target image may be distinguished from each other when displayed in the diagnostic image.

Differences between the first object image and the second object image can be highlighted in the diagnostic image.

The image processor may obtain a first size of the at least one object based on the first ultrasound data, and obtain a second size of the at least one object based on the second ultrasound data.

The display may further display at least one selected from size information of the first size, size information of the second size, and information indicating a size change of the at least one object obtained based on the first size and the second size.

The display may also display display information about the size change of the at least one object over time at a plurality of different time points.

The image processor may acquire second registration data by transforming the second ultrasound data into alignment with the first ultrasound data, and the screen image may further include a first image based on the first ultrasound data and a first image based on the second registration data. Two images.

The image processor may respectively segment a plurality of independent regions included in the first ultrasound data and a plurality of independent regions included in the second ultrasound data, and respectively detect a plurality of independent regions included in the first ultrasound data A reference point for each and each of the plurality of independent regions included in the second ultrasound data, combining the first reference point of the plurality of reference points included in the first ultrasound data with the reference point included in the second ultrasound data A second reference point of the plurality of reference points is matched, and image registration is performed on the first ultrasound data and the second ultrasound data based on the matching between the first reference point and the second reference point.

The image processor may match the first reference point with the second reference point by using an Iterative Closest Point (ICP) algorithm.

The image processor may detect volume information about each of the plurality of independent regions and match the first reference point with the second reference point based on the volume information.

The image processor may match the first reference point with the second reference point by applying a weight to each of the plurality of reference points based on the volume information.

The image processor may perform image registration for the first ultrasound image and the second ultrasound image by using at least one of mutual information, correlation coefficient, image ratio consistency, and division intensity consistency.

The image processor may perform image registration on the first ultrasound data and the second ultrasound data by Random Sample Consistency (RANSAC).

The image processor may respectively segment a plurality of independent regions included in the first ultrasonic data and a plurality of independent regions included in the second ultrasonic data, and divide each of the independent regions included in the first ultrasonic data and the second ultrasonic data into At least one of the plurality of independent regions in is detected as at least one target region as an independent region with respect to the at least one target.

The image processor may detect a size of each of the plurality of independent regions, and detect a target region based on the size.

The subject may be an ovary, and the at least one target may include a follicle to which ovulation is induced among a plurality of follicles contained in the ovary.

The object may be a part of the abdomen including the uterus, and the at least one target may include at least one tumor arising in at least a part of the uterus or outside the uterus.

The ultrasound image display apparatus may further include a memory storing corresponding ultrasound data of the plurality of time points.

The screen image may include corresponding ultrasonic images of a plurality of time points obtained based on the corresponding ultrasonic data of the plurality of time points, and the corresponding ultrasonic images of the plurality of time points may be arranged in an order of time points at which the object is scanned.

The first information may represent a change in at least one selected from the size, position and number of the at least one target at the plurality of different points in time.

The image screen may further include target change numerical information digitally representing a change in at least one selected from among size, position, and number of the at least one target.

The target variation numerical information may include a value of at least one selected from area, volume, major axis length, minor axis length, radius, diameter, and circumference representing the size of the at least one target.

The target change value information may include a change in value of at least one selected from area, volume, major axis length, minor axis length, radius, diameter, and circumference of the at least one target.

The image processor may acquire corresponding ultrasound images of a plurality of time points based on the corresponding ultrasound data of the plurality of time points, and set a weight to each of the corresponding ultrasound images of the plurality of time points. The diagnosis image may be an image in which respective ultrasonic images of the plurality of time points respectively set with weights are displayed overlapping each other.

The ultrasound image display apparatus may further include a communicator that receives the corresponding ultrasound data of the plurality of time points from an external source.

According to one or more embodiments of the present invention, a method for displaying an ultrasound image includes: acquiring corresponding ultrasound data at multiple time points, wherein the ultrasound data represent at least one an object of a target; acquiring first information representing a change of the at least one target at the different time points based on correspondence between corresponding ultrasound data at the plurality of time points; displaying a diagnostic image including showing the first information screen image.

Description of drawings

These and/or other aspects will become apparent and easier to understand from the following description of embodiments in conjunction with the accompanying drawings, in which:

FIG. 1 is a block diagram showing the configuration of an ultrasonic diagnostic apparatus according to an embodiment of the present invention;

2 is a block diagram showing the configuration of a wireless probe according to an embodiment;

3 is a cross-sectional view of an object to be diagnosed in an embodiment of the present invention;

Figure 4A shows an example of a normal ovary;

Figure 4B shows an example of a polycystic ovary;

5A is a block diagram of an ultrasound image display device according to an embodiment;

5B is a block diagram of an ultrasound image display device according to another embodiment;

Figure 6 shows an example of ultrasound data acquired by an ultrasound image display device according to some embodiments;

Figure 7 shows an ultrasound image acquired from the ultrasound data of Figure 6;

FIG. 8 illustrates image registration performed by an image processor of an ultrasound image display device according to some embodiments;

FIG. 9 shows a diagnostic image acquired by an image processor of an ultrasound image display device according to some embodiments;

FIG. 10 shows a diagnostic image acquired by an image processor of an ultrasound image display device according to some embodiments;

FIG. 11 shows a screen of a display of an ultrasound image display device according to some embodiments;

Fig. 12 and Fig. 13 show the process of the image processor of the ultrasonic image display device according to the embodiment to obtain the diagnostic image through image registration;

Figures 14 to 17 illustrate image registration performed by using the Iterative Closest Point (ICP) algorithm;

18 shows ultrasonic data processing for image registration performed by an image processor of an ultrasonic image display device according to an embodiment;

FIG. 19A shows a screen image displayed by an ultrasound image display device according to an embodiment;

FIG. 19B shows a screen image displayed by the ultrasound image display device according to the embodiment;

FIG. 20A shows a screen image displayed by the ultrasound image display device according to the embodiment;

FIG. 20B shows a screen image displayed by the ultrasound image display device according to the embodiment;

FIG. 21A shows a screen image displayed by the ultrasound image display device according to the embodiment;

FIG. 21B shows a screen image displayed by the ultrasound image display device according to the embodiment;

FIG. 22 shows screen images displayed by the ultrasound image display device according to the embodiment;

FIG. 23 is a flowchart of an ultrasound image display method according to an embodiment.

detailed description

All terms used herein including descriptive terms or technical terms should be interpreted as having meanings that are obvious to those of ordinary skill in the art. However, these terms may have different meanings according to intentions of those of ordinary skill in the art, precedents, or appearance of new technologies. In addition, some terms may be arbitrarily selected by the applicant, and in this case, the meanings of the selected terms will be described in detail in the detailed description of the present invention. Therefore, the terms used herein should be defined based on the meaning of the terms as well as the description of the entire specification.

When a component "comprises" or "includes" an element, unless there is a specific description to the contrary, the component does not exclude other elements, but may also include other elements. Also, terms such as '...unit', '...module', etc. refer to a unit that performs at least one function or operation, and the unit may be implemented as hardware, software, or a combination of hardware and software.

Throughout the specification, "ultrasound image" refers to an image of a subject obtained using ultrasound. Furthermore, a "subject" may be a person, an animal, or a part of a person or an animal. For example, an object can be an organ (eg, liver, heart, uterus, brain, chest, or abdomen), a blood vessel, or a combination thereof. Also, the object may be a phantom. A phantom refers to a substance having approximately the same density, effective atomic number, and volume as an organ.

Throughout this specification, a "user" may be, but is not limited to, a medical professional such as a physician, nurse, medical laboratory technician or medical imaging specialist or a technician repairing medical equipment.

Embodiments of the present invention will now be described more fully hereinafter with reference to the accompanying drawings, in which illustrative embodiments of the invention are shown.

FIG. 1 is a block diagram showing the configuration of an ultrasonic diagnostic apparatus 1000 according to an embodiment of the present invention. Referring to FIG. 1 , an ultrasonic diagnostic apparatus 1000 may include a probe 20 , an ultrasonic transceiver 100 , an image processor 200 , a communicator 300 , a memory 400 , an input device 500 , and a controller 600 , which may be connected to each other via a bus 700 .

The ultrasonic diagnostic apparatus 1000 may be a cart-type apparatus or a portable apparatus. Examples of portable diagnostic ultrasound devices may include, but are not limited to, picture archiving and communication system (PACS) viewers, smartphones, laptop computers, personal digital assistants (PDAs), and tablet PCs.

The probe 20 transmits ultrasonic waves to the object 10 in response to a driving signal applied by the ultrasonic transceiver 100 and receives echo signals reflected by the object 10 . Probe 20 includes a plurality of transducers that oscillate in response to electrical signals and generate acoustic energy (ie, ultrasound waves). In addition, the probe 20 may be wired or wirelessly connected to the main body of the ultrasonic diagnostic apparatus 1000 .

The transmitter 110 provides the drive signal to the probe 20 . The transmitter 110 includes a pulse generation unit 112 , a transmission delay 114 and a pulser 116 . The pulse generator 112 generates pulses for forming transmission ultrasonic waves based on a predetermined pulse repetition frequency (PRF), and the transmission delay unit 114 delays the pulses by a delay time necessary to determine transmission directivity. The delayed pulses respectively correspond to the plurality of piezoelectric vibrators included in the probe 20 . The pulser 116 applies the drive signal (or drive pulse) to the probe 20 based on the timing corresponding to each pulse that has been delayed.

The receiver 120 generates ultrasound data by processing echo signals received from the probe 20 . Receiver 120 may include amplifier 122 , analog-to-digital converter (ADC) 124 , receive delay 126 and summer 128 . The amplifier 122 amplifies the echo signal in each channel, and the ADC 124 performs analog-to-digital conversion on the amplified echo signal. The reception delayer 126 delays the digital echo signal output by the ADC 124 for a delay time necessary to determine reception directivity, and the summer 128 generates ultrasonic data by summing the echo signals processed by the reception delayer 126 . Furthermore, according to an embodiment of the present invention, the receiver 120 may not include the amplifier 122 . In other words, amplifier 122 may be omitted if the sensitivity of probe 20 or the ability of ADC 124 to process bits is increased.

The image processor 200 generates an ultrasound image by performing scan conversion on ultrasound data generated by the ultrasound transceiver 100, and displays the ultrasound image. Ultrasound images can be not only gray-scale ultrasound images obtained by scanning the subject in amplitude (A) mode, brightness (B) mode, and motion (M) mode, but also Doppler showing the motion of the subject through the Doppler effect image. The Doppler image may be a blood flow Doppler image (also called a color Doppler image) showing the flow of blood, a tissue Doppler image showing the motion of tissue, or a motion speed of an object in a waveform. Spectral Doppler image.

The B-mode processor 212 extracts B-mode components from the ultrasound data and processes the B-mode components. The image generator 220 may generate an ultrasound image indicating signal strength in brightness based on the extracted B-mode component.

Similarly, the Doppler processor 214 may extract Doppler components from the ultrasound data, and the image generator 220 may generate a Doppler image indicating motion of the object in color or waveform based on the extracted Doppler components.

According to an embodiment of the present invention, the image generator 220 may generate a three-dimensional (3D) ultrasound image by performing volume rendering on volume data, and may also generate an elasticity image by imaging deformation of an object due to pressure. Also, the image generator 220 may display various additional information in the ultrasound image by using text and graphics. In addition, the generated ultrasound images may be stored in the memory 400 .

The display 230 displays the generated ultrasound image. The display 230 can display not only an ultrasound image but also various information processed by the ultrasound diagnostic apparatus 1000 on a screen image via a graphical user interface (GUI). Furthermore, according to an embodiment of the present invention, the ultrasonic diagnostic apparatus 1000 may include two or more displays 230 .

The communicator 300 is connected to the network 30 in a wired or wireless manner to communicate with an external device or server. The communicator 300 can exchange data with a hospital server connected to the communicator 300 or other medical devices in the hospital through the PACS. Also, the communicator 300 may perform data communication according to the Digital Imaging and Communications in Medicine (DICOM) standard.

The communicator 300 can transmit or receive data related to the diagnosis of the subject (such as ultrasound images of the subject, ultrasound data, and Doppler data) through the network 30, and can also transmit or receive data generated by other medical equipment such as computed tomography (CT). ) equipment, magnetic resonance imaging (MRI) equipment, or X-ray equipment) captured medical images. In addition, the communicator 300 may receive information about a patient's diagnosis history or medical schedule from a server, and diagnose the patient using the received information. In addition, the communicator 300 may perform data communication not only with a server or a medical device of a hospital, but also with a doctor or a patient's portable terminal.

The communicator 300 may be wired or wirelessly connected to the network 30 to exchange data with the server 32 , the medical device 34 or the portable terminal 36 . The communication module 300 may include one or more components for communicating with external devices. For example, communicators 300 may include short-range communicators 310 , wired communicators 320 , and mobile communicators 330 .

The short-range communicator 310 refers to a module for local area communication within a predetermined distance. Examples of local area communication technologies according to embodiments of the present invention may include, but are not limited to, Wireless LAN, Wi-Fi, Bluetooth, ZigBee, Wi-Fi Direct (WFD), Ultra Wideband (UWB), Infrared Data Association (IrDA) , Bluetooth Low Energy (BLE) and Near Field Communication (NFC).

The wired communicator 320 refers to a module for communicating using electrical or optical signals. Examples of wired communication techniques according to embodiments of the present invention may include communicating over a pair of twisted pair cables, coaxial cables, fiber optic cables, and Ethernet cables.

The mobile communicator 330 transmits a wireless signal to or receives a wireless signal from at least one selected among a base station, an external terminal and a server on a mobile communication network. The wireless signal may be a voice call signal, a video call signal, or various types of data for sending and receiving text/multimedia messages.

The memory 400 stores various data processed by the ultrasonic diagnostic apparatus 1000 . For example, the memory 400 may store medical data related to the diagnosis of a subject, such as input or output ultrasound data and ultrasound images, and may also store algorithms or programs to be executed in the ultrasound diagnostic apparatus 1000 .

The memory 400 may be any of various storage media (eg, flash memory, hard drive, EEPROM, etc.). Also, the ultrasonic diagnostic apparatus 1000 may utilize a web storage or a cloud server that performs the storage function of the memory 400 online.

The input device 500 refers to a data by which a user inputs data for controlling the ultrasonic diagnostic apparatus 1000 . The input device 500 may include hardware components such as a keyboard, a mouse, a touch pad, a touch screen, and a scroll wheel switch. However, embodiments of the present invention are not limited thereto, and the input device 500 may also include various other input units (including an electrocardiogram (ECG) measurement module, a respiration measurement module, a speech recognition sensor, a gesture recognition sensor, a fingerprint recognition sensor, an iris recognition sensor , depth sensor, distance sensor, etc.) any other input unit.

The controller 600 may control all operations of the ultrasonic diagnostic apparatus 1000 . In other words, the controller 600 may control operations of the probe 20 , the ultrasound transceiver 100 , the image processor 200 , the communicator 300 , the memory 400 and the input device 500 shown in FIG. 1 .

All or part of the probe 20, ultrasound transceiver 100, image processor 200, communicator 300, memory 400, input device 500, and controller 600 may be implemented as software modules. However, the embodiments of the present invention are not limited thereto, and some of the above components may be implemented as hardware modules. Also, at least one selected from the ultrasonic transceiver 100 , the image processor 200 , and the communicator 300 may be included in the controller 600 . However, embodiments of the present invention are not limited thereto.

FIG. 2 is a block diagram showing the configuration of a wireless probe 2000 according to the embodiment. As described above with reference to FIG. 1 , the wireless probe 2000 may include a plurality of transducers, and according to an embodiment of the present invention, the wireless probe 2000 may include some or all components of the ultrasound transceiver 100 shown in FIG. 1 .

The wireless probe 2000 according to the embodiment shown in FIG. 2 includes a transmitter 2100 , a transducer 2200 and a receiver 2300 . Since their descriptions are given above with reference to FIG. 1 , their detailed descriptions will be omitted here. Furthermore, according to an embodiment of the present invention, the wireless probe 2000 may optionally include a receiving delay unit 2330 and a summing unit 2340 .

The wireless probe 2000 may transmit ultrasound signals to the subject 10, receive echo signals from the subject 10, generate ultrasound data, and wirelessly transmit the ultrasound data to the ultrasound diagnostic apparatus 1000 shown in FIG. 1 .

An ultrasonic image display device according to an embodiment of the present invention includes a device capable of processing, generating and/or displaying an ultrasonic image by using ultrasonic data acquired by at least one selected from the ultrasonic diagnostic device 1000 of FIG. 1 and the wireless probe 200 of FIG. 2 . All medical imaging equipment.

An ultrasonic image display apparatus according to an embodiment of the present invention displays a first ultrasonic image including dimensions representing at least one object included in the object by using ultrasonic data acquired by performing an ultrasonic scan on the object. , first information of a change in at least one of selected one of location and quantity.

The object used here is the part of the body that needs to be examined related to gynecological diseases, so it may be part of a woman's lower abdomen. In particular, the subject may be an ovary comprising at least one follicle. Alternatively, the subject may be a uterus comprising at least one tumor or a portion of a woman's lower abdomen comprising at least one tumor. Alternatively, the subject may be a specific body part or a specific organ comprising at least one abnormal tissue.

The monitoring of obstetrics and gynecology diseases for at least one target included in the object needs to be performed several times. Specifically, it is necessary to scan the object multiple times at multiple time points and observe how much the object changes within the time period including the multiple time points. For example, in order to cure polycystic ovary syndrome, changes within the ovaries need to be monitored at prescribed intervals over a predetermined period of time. As another example, when the uterus has a tumor such as a fibroid, the user needs to observe changes in the uterus at prescribed time intervals and determine whether to treat the tumor. In addition, when there is abnormal tissue that needs to be monitored, the user needs to observe changes in the abnormal tissue at prescribed time intervals and determine whether to treat the abnormal tissue.

Fig. 3 is a sectional view of an object to be diagnosed in the embodiment of the present invention.

Referring to FIG. 3, the uterus 310 is located in the woman's lower abdomen. The ovaries 330 are connected to the uterus 310 through the fallopian tubes 320 included in the uterus 310 . The ovary 330 includes a plurality of follicles and expels one enlarged follicle from the plurality of follicles according to the ovulation cycle (ovulation). However, if the enlarged follicle fails to exit the ovary and remains in the ovary, a cyst (cyst) develops. When ovulation does not occur, periods may be irregular, leading to infertility. Therefore, in order to determine whether the ovary set as a subject and the ovulation of the ovary are normal, it is necessary to observe the ovary at a plurality of different time points. In this case, the object is an ovary, and the target may be at least one follicle included in the ovary.

Tumors (such as fibroids), abnormal tissues, etc. may be generated in the uterus 310 . Such tumors or abnormal tissues may not require actions such as emergency surgery in contrast to cancerous tissues which are malignant tumors. However, such tumors or abnormal tissues may turn into female disorders (eg, infertility), and therefore, monitoring is necessary to see how the tumor or abnormal tissues change at subsequent time points.

Specifically, fibroids may develop in body parts adjacent to the uterus 310, including submucosal fibroids 341 in the uterine cavity inside the uterus 310, myenteric fibroids 342 outside the uterine cavity, and myomas in the uterine cavity. 310 Submucosal fibroids 343 develop on the outer serosa. In this case, the object may be the lower abdomen including the uterus 310, and the target may be a specific fibroid.

As described above, when at least one target included in an object needs to be monitored over time or changes over time of the at least one target need to be observed, the ultrasonic image display device according to an embodiment of the present invention enables the user to view A change in a target is easily determined and diagnosed at a point in time, thereby increasing user's convenience. An ultrasound image display apparatus according to an embodiment of the present invention will now be described in detail with reference to FIGS. 4A to 22 .

A case where the object is an ovary including at least one follicle and the follicle included in the ovary is targeted will now be described as an example. Specifically, the ultrasonic diagnostic apparatus 1000 of FIG. 1 can obtain ultrasonic data about the ovary by scanning an object (ie, the ovary), and the user can diagnose the ovary based on the obtained ultrasonic data.

An example of a normal ovary 40 is shown in FIG. 4A .

Referring to FIG. 4A, a normal ovary 40 includes a large number of primordial follicles (not shown). When the menstrual cycle begins, multiple primordial follicles in a mass of primordial follicles begin to grow. In human case, about 6-12 primordial follicles start to grow. Only one follicle among the plurality of primordial follicles is selected as the dominant follicle 41, and the dominant follicle 41 grows completely and is then discharged.

Polycystic ovary syndrome (PCOS) is a condition in which more than the normal number of follicles develop in the ovary, or the follicles do not grow enough to expel their eggs even when many do. PCOS can cause infertility. For example, a human may have PCOS when the subject is a human and at least 12 follicles (each having a size of 2-9 mm) develop within the human ovary.

An example of a polycystic ovary 50 is shown in FIG. 4B .

Referring to FIG. 4B , compared with the normal ovary 40 of FIG. 4A , the polycystic ovary 50 includes a plurality of growing follicles 51 . In polycystic ovaries 50 , cysts 52 may form from unovulated follicles.

In the case of PCOS, ovulation can be induced by administering drugs to the patient so that only one of the plurality of growing follicles 51 is discharged. Follicles against which ovulation is induced will be referred to as selected follicles hereinafter. The selected follicle may be at least one of the plurality of growing follicles 51 . Diagnosis of normal growth of selected follicles during ovulation induction may be necessary.

In order to diagnose whether a selected follicle is growing normally, the size of the selected follicle needs to be monitored over time. Hereinafter the part of the subject that needs to be monitored over time (eg selected follicles) will be referred to as a target. Therefore, at least one follicle comprised in the ovary will now be referred to as at least one target.

FIG. 5A is a block diagram of an ultrasound image display device 3000 according to an embodiment. The ultrasonic image display apparatus 3000 of FIG. 5A may be included in the ultrasonic diagnostic apparatus 1000 of FIG. 1 . Alternatively, the ultrasonic image display device 3000 of FIG. 5A may be included in a medical device 34 or a portable terminal 36 connected to the ultrasonic diagnostic device 100 through the network 30 . The ultrasound image display device 3000 may be any imaging device capable of acquiring, processing and displaying ultrasound images. Therefore, although not individually described, the above description is applicable to various components included in the ultrasound image display apparatus 3000 of FIG. 5A .

Referring to FIG. 5A , an ultrasound image display apparatus 3000 includes an image processor 3100 and a display 3200 .

The image processor 3100 acquires various ultrasound data at a plurality of time points representing an object including at least one target at a plurality of different time points. The image processor 3100 also acquires first information representing changes of the at least one target at the plurality of different time points based on correspondence (correspondence) between various ultrasound data acquired at the plurality of time points . The first information may include information representing a change in at least one selected from the size, position, and number of the at least one object at the plurality of different points in time.

Specifically, the image processor 3100 acquires various ultrasonic data corresponding to multiple time points by scanning an object including at least one target at multiple different time points, respectively. The image processor 3100 also acquires images representing the size, location, and number of the at least one object selected from the plurality of different time points by performing image registration associated with the various ultrasound data at the plurality of different time points. The first information of at least one change. The object can be an ovary and the target can be a follicle. In particular, the target may be a follicle that needs to be monitored over time, eg, the follicles selected above.

For example, since the patient suffers from PCOS, the follicles targeted for ovulation induction are set as targets, and it is necessary to monitor whether the selected follicles grow normally during the ovulation cycle. In the above-described example, the image sensor 3100 acquires first information representing a change in a target within a predetermined time period in an ovulation cycle.

Specifically, the first information may be an ultrasound image representing a change in the state of the target (including changes in the size, position and number of the target). When the first information is an ultrasound image, the first information may be a first ultrasound image. Specifically, the first information may be a first ultrasound image acquired by performing image registration on various ultrasound data at multiple time points.

The first information may include numerical values numerically representing changes in size, position, and number of objects. In particular, the first information may be a numerical value representing a change in the target, wherein the change in the target is obtained by registering the image through the various ultrasound data at the multiple time points obtained by performing image registration.

The display 3200 displays a screen image including a diagnostic image showing first information. The diagnostic image is acquired based on the registration image obtained by performing image registration on the various ultrasound data of the plurality of time points, thus, meaning that the user can visually recognize the ultrasound image of the first information. Specifically, the diagnostic image may be an ultrasound image displayed such that states of the at least one object at the plurality of time points can be distinguished from each other. The diagnostic image showing the first information will be described in detail later with reference to FIGS. 10 and 11 .

An exemplary case will now be described in which the various ultrasound data at the plurality of time points acquired by the image processor 3100 include first ultrasound data and second ultrasound data, the first ultrasound data being obtained by scanning the subject at the first time point Acquiring, second ultrasound data is acquired by scanning the subject at a second point in time. In other words, an exemplary case will now be described in which first information is acquired using various ultrasound data respectively acquired by scanning a subject at a first time point and a second time point (different from the first time point).

Specifically, the diagnostic image displayed on the display 3200 may be an ultrasound image in which the first target image of the at least one target based on the first ultrasound data and the at least one target based on the second ultrasound data A second ultrasound target image of a target is displayed superimposed.

FIG. 5B is a block diagram of an ultrasound image display device 3050 according to another embodiment. Compared with the ultrasound image display apparatus 3000 of FIG. 5A , the ultrasound image display apparatus 3050 of FIG. 5B may further include a communicator 3300 and a memory 3400 . Components included in the ultrasound image display apparatus 3050 may be connected to each other through a bus 3500 .

The communicator 3300 may receive various ultrasound data at multiple time points from an external source. Specifically, when the ultrasonic image display device 3050 does not acquire various ultrasonic data at multiple time points through ultrasonic scanning, the ultrasonic image display device 3050 may receive data from an external ultrasonic diagnostic device (not shown) by scanning objects at different time points. Various ultrasound data were acquired at multiple time points.

Specifically, the communicator 3300 may receive the first ultrasound data and the second ultrasound data. The communicator 3300 may receive the first ultrasound data and the second ultrasound data simultaneously or not. The communicator 3300 may receive the first ultrasound data and the second ultrasound data from the ultrasound diagnostic apparatus 1000 of FIG. 1 or the server 32 .

The memory 3400 may store at least one ultrasound data selected from the first ultrasound data and the second ultrasound data.

Each of the first and second ultrasound data may refer to multidimensional data formed of discrete image elements, such as pixels in a two-dimensional (2D) image and voxels in a three-dimensional (3D) image. Each of the first ultrasound data and the second ultrasound data may be volume data formed of voxels. Each voxel may correspond to a voxel value, which may be brightness and/or color information.

FIG. 6 shows an example of ultrasound data acquired by an ultrasound image display device according to some embodiments. In FIG. 6 , reference numerals 62 , 64 , and 66 respectively denote sagittal, coronal, and axial views intersecting each other. In FIG. 6, the axial direction indicates the direction in which the ultrasonic signal is transmitted relative to the transducer of the ultrasonic probe 20 in FIG. scan plane) direction of motion.

A case will now be described as an example in which the ultrasound image display device according to the embodiment of the present invention is the ultrasound image display device 3050 of FIG. 5B .

FIG. 7 shows an ultrasound image acquired from ultrasound data as in FIG. 6 .

Referring to FIG. 7, a plurality of ultrasound images 72, 74, 76, and 78 may be acquired from ultrasound data as volume data. The ultrasound images 72 , 74 , and 76 may be cross-sectional images obtained by imaging sections included in volume data, and the ultrasound image 78 is a 3D ultrasound image obtained by volume rendering the volume data. For example, ultrasound images 72, 74, and 76 may represent sagittal 62, coronal 64, and axial 66 images of FIG. 6, respectively.

A 3D ultrasound image 78 acquired from ultrasound data on the ovary shows multiple follicles or cysts in spherical shape. In the 3D ultrasound image 78 , the largest follicle image 71 among the plurality of follicle images that are spherical in shape may be an image of a selected follicle, an ovulation-induced polycystic ovary.

The round dark areas in the ultrasound images 72, 74 and 76 may be images of follicles or cysts due to the low brightness of follicle or cyst regions in the ultrasound data. The largest follicle image 71 in each of the ultrasound images 72, 74, and 76 may be a cross-sectional image of the selected follicle.

In order to diagnose whether a selected follicle is growing normally, individual ultrasound data obtained by scanning the subject at different time points can be used. However, since the object is scanned at different points in time, the position of the probe 20 for scanning the object of FIG. 1 may change. Therefore, the respective ultrasound data acquired at different time points are acquired in different coordinate systems, and therefore, the coordinate systems of the respective ultrasound data are different. There may be an outlier that exists in one of the respective ultrasound data acquired at different time points but does not exist in the other ultrasound data. The size of the follicles may change over time. These factors may make it difficult to diagnose whether selected follicles are growing normally by using ultrasound data. The ultrasonic image display devices 3000 and 3050 according to the embodiments of the present invention overcome the difficulties in diagnosis, therefore, the first information is obtained by image registration of each ultrasonic data at multiple time points, and the first information is displayed, thereby Users can easily determine changes in targets and easily diagnose objects.

FIG. 8 illustrates image registration performed by an image processor of an ultrasound image display device according to some embodiments.

Referring to FIG. 8, the first ultrasound data 4000 may include a plurality of first individual areas SA1, and the second ultrasound data 5000 may include a plurality of second individual areas SA2. First ultrasound data 4000 is obtained by scanning the object at a first point in time, and second ultrasound data 5000 is obtained by scanning the object at a second point in time different from the first point in time. Although FIG. 8 shows that the first ultrasound data 4000 and the second ultrasound data 5000 are 2D data, this is an example for convenience of explanation and description. Each of the first ultrasound data 4000 and the second ultrasound data 5000 may be volume data.

Each of the first individual area SA1 and the second individual area SA2 may be a voxel group having a voxel value varying within a predetermined range. When the ultrasound data 4000, 5000 is data about ovaries, areas of follicles or cysts within the ultrasound data 4000, 5000 have low brightness, and therefore, voxels corresponding to the ultrasound data 4000, 5000 may have low voxel values. Each of the first and second individual areas SA1 and SA2 may be a voxel group having a voxel value smaller than a threshold. In other words, each of the first separate area SA1 and the second separate area SA2 may be a voxel group corresponding to a follicle or a cyst.

One of the first individual areas SA1 of the first ultrasound data 4000 may be the first target area 4010 , and one of the second individual areas SA2 of the second ultrasound data 5000 may be the second target area 5010 . Each of the first target area 4010 and the second target area 5010 is an independent area of the target to be monitored for changes over time. Specifically, the first target area 4010 represents the state of the predetermined target at the first time point, and the second target area 5010 represents the state of the predetermined target at the second time point. The target may be a selected follicle for which ovulation is induced from among the follicles included in the polycystic ovary 50 of Figure 4B. The target to be monitored may be at least one follicle, however, for convenience of explanation, FIG. 8 and the drawings described below show a case where one follicle (specifically, one selected follicle) is targeted.

Since the first ultrasound data 4000 and the second ultrasound data 5000 are acquired by scanning the subject at different times, the first ultrasound data 4000 and the second ultrasound data 5000 are acquired in different coordinate systems. This is because the position of the probe 20 scanning the object of FIG. 1 may change due to scanning the object at different times.

The image processor 3100 of FIG. 5B performs image registration on the first ultrasound data 4000 and the second ultrasound data 5000 . Image registration is the process of transforming the first ultrasound data 4000 and the second ultrasound data 5000 into one coordinate system. The image processor 3100 may obtain the second registration data 5100 by transforming the second ultrasound data 5000 , thereby registering the second ultrasound data 5000 with the first ultrasound data 4000 . On the other hand, the image processor 3100 may obtain first registration data (not shown) by transforming the first ultrasound data 4000 , thereby registering the first ultrasound data 4000 with the second ultrasound data 5000 . A case where the second ultrasound data 5000 is transformed to be registered with the first ultrasound data 4000 will now be described as an example. Image registration can be performed by various image processing techniques. For example, the image processor 3100 may obtain the second registration data 5100 by fixing the first ultrasound data 4000 and spatially registering the second ultrasound data 5000 into alignment with the first ultrasound data 4000 . Alternatively, the image processor 3100 may obtain the second registration data 5100 by fixing the first ultrasound data 4000 on the second ultrasound data 5000 and performing linear transformations such as translation and rotation.

When registering the first ultrasound data 4000 and the second ultrasound data 5000, at least one pair of individual areas SA1 and SA2 among the first individual area SA1 and the second individual area SA2 may be registered. Specifically, the first target area 4010 and the second target area 5010 may be registered. In other words, the first target area 4010 and the second target area 5010 may overlap each other.

The first target area 4010 may be the largest in the first independent area SA1, and the second target area 5010 may also be the largest in the second independent area SA2. Optionally, the target areas 4010 and 5010 may be a pair of independent areas SA1 and SA2 with the largest volume change among multiple pairs of registered first independent areas SA1 and second independent areas SA2 .

FIG. 9 shows a diagnostic image 6000 acquired by an image processor of an ultrasound image display device according to some embodiments.

Referring to FIGS. 8 and 9 , a diagnostic image 6000 is acquired based on the registered first ultrasound data 4000 and second ultrasound data 5000 . Diagnostic image 6000 may be a volume-rendered image obtained based on first ultrasound data 4000 and second registration data 5100 . Optionally, the diagnostic image 6000 may be a cross-sectional image acquired from the first ultrasound data 4000 and the second registration data 5100 .

Specifically, the diagnostic image 6000 represents first information on changes in at least one selected from the size, position, and number of at least one object at the plurality of different time points.

Specifically, diagnostic image 6000 may include a plurality of images S1 in pairs of registered independent areas SA1 and SA2. Each of the plurality of images S1 may be a pair of images of registered separate areas SA1 and SA2. The image processor may perform image processing to display the image S1 distinguishably. Alternatively, the image processor may perform image processing so as to distinguishably display the first and second individual areas SA1 and SA2 as a pair of registered individual areas SA1 and SA2. For example, the plurality of images S1 of the paired registration-independent areas SA1 and SA2 in the diagnostic image 6000 may be distinguished by outlines, colors, patterns, and the like.

Specifically, the diagnostic image 6000 may include a first target image 4020 and a second target image 5020 . In the diagnostic image 6000, the first object image 4020 and the second object image 5020 may overlap each other. The first object image 4020 is an image of the object based on the first ultrasound data 4000 . In other words, the first target image 4020 may be an image of the target based on the voxel values of the first target region 4010 . Similarly, second object image 5020 is an image of the object based on second ultrasound data 5000 . In other words, the second target image 5020 may be an image of the target based on the voxel values of the second target region 5010 .

Referring to FIG. 9, as described above, in the diagnosis image 6000, the first target image 4020 corresponding to the state of the target (including a specific follicle in the ovary) at the first point in time corresponds to the state of the target at the second point in time. The corresponding second target image 5020 is registered and overlaid. Therefore, the user can easily recognize the change of the object between the first time point and the second time point from the diagnosis image 6000 . Although a 2D diagnostic image is shown in FIG. 9 and the drawings described below, a 3D diagnostic image may be used.

The image processor may perform image processing so that the first object image 4020 and the second object image 5020 may be displayed differently in the diagnosis image 6000 . For example, in the diagnostic image 6000, the first target image 4020 and the second target image 5020 may be distinguished from each other by different colors, different types of contour lines, or different types of patterns.

Optionally, the image processor may perform image processing to emphasize differences between the first object image 4020 and the second object image 5020 in the diagnostic image 6000 . For example, a portion of diagnostic image 6000 corresponding to the difference may be highlighted using a color different from that of other portions.

In this way, the ultrasonic image display apparatus according to some embodiments enables the user to intuitively and easily recognize changes in objects over time. Therefore, a user can easily recognize a change over time of an object or a change over time of an object included in an object. When the target is a follicle for ovulation induction included in a polycystic ovary, the ultrasonic image display device according to some embodiments allows the user to easily recognize the change in size of the selected follicle over time, thereby easily diagnosing whether the selected follicle Grow normally over time.

Fig. 10 shows a diagnostic image 6001 acquired by an image processor of an ultrasound image display device according to some embodiments.

Referring to FIGS. 8 and 10 , the image processor may acquire a first size of the object based on the first ultrasound data 4000 and a second size of the object based on the second ultrasound data 5000 . Specifically, the first size and the second size of the target may be acquired based on the first target area 4010 and the second target area 5010 respectively. The first size can be at least one selected from the volume, major axis length, minor axis length, radius, diameter, and cross-sectional area of the first target area 4010, and the second size can be selected from the volume, major axis At least one selected from length, minor axis length, radius, diameter, and cross-sectional area.

The display 3200 of FIG. 5B may display a diagnosis image 6001 in which the first object image 4021 and the second object image 5021 are overlapped and displayed, and may also display size information 6030 of the object. The size information 6030 of the object may include a first size and a second size. The size information 6030 may also include information on changes in the size of the object over time. For example, the information on the change in size of the object over time may be a difference between the first size and the second size or a rate of change in size based on the first size and the second size.

FIG. 11 shows a screen 3201 of a display of an ultrasound image display device according to an embodiment.

Referring to FIGS. 8 and 11 , the first image 4003 and the second image 5003 may be displayed on the screen 3201 of the display together with the diagnosis image 6003 . In the diagnostic image 6003, the first target image 4023 and the second target image 5023 overlap each other. The first image 4003 and the second image 5003 are acquired based on respective registered ultrasound data at multiple time points (specifically, based on the first ultrasound data 4000 and the second registration data 5100), and the first image 4003 and the second The second image 5003 is each ultrasound image at multiple time points displayed in the same coordinate system. Specifically, the first image 4003 includes a first target image 4022 as an image based on the first ultrasound data 4000 , and the second image 5003 includes a second target image 5022 as an image based on the second registration data 5100 . The first image 4003 may be obtained by volume rendering of the first ultrasound data 4000 and the second image 5003 may be obtained by volume rendering of the second registration data 5100 . Optionally, the first image 4003 may be a cross-sectional view of a section including the first target region 4010 in the first ultrasound data 4000, and the second image 5003 may be a cross-sectional view including the second target region 5010 in the second registration data 5100. A cross-sectional view of a section. Each of the respective sections of the second target area 5010 in the first target area 4010 and the second registration data 5100 may be a section of an image obtained by registering the first ultrasound data 4000 and the second ultrasound data 5000 .

As shown in FIG. 11 , the first image 4003 and the second image 5003 may be simultaneously displayed on the screen 3201 . Optionally, the first image 4003 and the second image 5003 may be sequentially displayed on the screen 3201 . When the first ultrasound data 4000 is obtained by scanning the subject at a first time point and the second ultrasound data 5000 is obtained by scanning the subject at a second time point after the first time point, the first image 4003 may be displayed first, and then may be A second image 5003 is displayed.

As such, the ultrasound image display apparatus according to some embodiments allows a user to intuitively and easily recognize a change of an object over time by displaying a diagnostic image obtained by registering first and second ultrasound data.

Fig. 12 and Fig. 13 show the process of acquiring diagnostic images by the image processor of the ultrasonic image display device according to the embodiment through image registration.

Referring to FIG. 12, the image processor 3100 of FIG. 5B may respectively detect a plurality of independent regions 1a-5a and a plurality of independent regions 1b-7b by dividing the first ultrasound data 7000 and the second ultrasound data 8000, respectively. Although FIG. 12 shows that the first ultrasound data 7000 and the second ultrasound data 8000 are 2D data, this is an example for convenience of explanation and description. Each of the first ultrasound data 7000 and the second ultrasound data 8000 may be volume data.

The first ultrasound data 7000 may include a plurality of individual regions 1a-5a, and the second ultrasound data 8000 may include a plurality of individual regions 1b-7b. Each of the individual regions 1a-5a and 1b-7b may be a group of pixels or voxels corresponding to a follicle or a cyst. The image processor may divide the first ultrasound data 7000 and the second ultrasound data 8000 based on a pixel value of a pixel or a voxel value of a voxel. Each of the individual regions 1a-5a and 1b-7b may be a region formed of a voxel group having a voxel value varying within a predetermined range. The image processor may mark the individual regions 1a-5a in the first ultrasound data 7000 and the individual regions 1b-7b in the second ultrasound data 8000 to distinguish the individual regions 1a-5a from the individual regions 1b-7b.

The image processor 3100 may perform image registration on the first ultrasound data and the second ultrasound data through a random sampling consensus (RANSAC) algorithm. RANSAC is a method of randomly selecting various sample data and then selecting various sample data that achieves maximum consistency from the randomly selected various sample data. Outliers can be removed by RANSAC. Outliers may be present in the first ultrasound data but not in the second ultrasound data, or in the second ultrasound data but not in the first ultrasound data. In FIG. 12, the isolated region 7b of the second ultrasound data 8000 corresponds to an outlier. Outliers can reduce the accuracy of image registration. Therefore, the accuracy of image registration can be improved by removing outliers via RANSAC.

In addition to outliers, the image processor may detect reference points 11a-15a for individual regions 1a-5a included in the first ultrasound data 7000, and detect reference points 11b-6b for individual regions 1b-6b included in the second ultrasound data 8000. Reference points 11b-16b. The reference points 11a-15a and 11b-16b may be centroid points or mean points of the individual regions 1a-5a and 1b-6b, respectively.

The image processor may acquire volume information for each of the individual regions 1a-5a and 1b-6b. For example, the volume information may include at least one of volume, major axis length, minor axis length, shape, etc. of each of the individual regions 1a-5a and 1b-6b.

12 and 13, the image processor can register the first ultrasound data 7000 and the second ultrasound data 8000, thereby obtaining second registration data 8100, wherein, in the second registration data 8100, the second ultrasound data 8000 is transformed to register with the first ultrasound data 7000. The second registration data 8100 may be obtained based on matching between the first reference points 11 a - 15 a included in the first ultrasound data 7000 and the second reference points 11 b - 16 b included in the second ultrasound data 8000 .

The image processor may obtain a diagnostic image 9000 based on the first ultrasound data 7000 and the second registration data 8100 . In the diagnosis image 9000, the first object image 9100 and the second object image 9200 may overlap each other. Since the above descriptions about the diagnostic image are all applicable to the diagnostic image 9000 , they will not be repeated here.

The image processor may detect the target region 2a from the plurality of independent regions 1a-5a of the first ultrasound data 7000 and detect the target region 5b from the plurality of independent regions 1b-7b of the second ultrasound data 8000, respectively, wherein the target The area 2a and the target area 5b are independent areas of the target. The respective target regions 2 a and 5 b of the first and second ultrasound data 7000 and 8000 may correspond to the first and second target regions 4010 and 5010 of FIG. 8 , respectively. Therefore, since the above descriptions about the first target area 4010 and the second target area 5010 are all applicable to the target areas 2a and 5b, details are not repeated here.

The target regions 2a and 5b may be detected based on volume information about each of the individual regions 1a-5a and 1b-6b. For example, the target areas 2a and 5b may be detected based on the shapes of the individual areas 1a-5a and 1b-6b and the volumes of the individual areas 1a-5a and 1b-6b. Optionally, the target areas 2a and 5b may be detected after image registration is completed.

The image processor may perform image registration on the first ultrasound data 7000 and the second ultrasound data 8000 by using an iterative closest point (ICP) algorithm.

Figures 14-17 illustrate image registration performed using ICP.

Referring to FIG. 14 , the image processor may detect the closest reference point to each of the reference points 11a-15a of the first ultrasound data 7000 from the reference points 11b-16b of the second ultrasound data 8000, and use the detected closest reference point Match with reference points 11a-15a.

The reference points 11a, 12a, 13a, and 15a of the first ultrasound data 7000 can be matched with the nearest reference point 11b among the reference points 11b-16b of the second ultrasound data 8000, and the reference point 14a of the first ultrasound data 7000 can be matched with The closest reference point 15b among the reference points 11b-16b of the second ultrasound data 8000 is matched.

When matching each of the reference points 11a-15a of the first ultrasound data 7000 with one of the reference points 11b-16b of the second ultrasound data 8000, the image processor may base the distance between the reference points and the reference point The volume information between them is used to perform matching. The image processor may match the reference points by applying a weight to each of the plurality of reference points based on the volume information. For example, the weight applied to a reference point of the second ultrasound data having volume information similar to that of the reference point of the first ultrasound data may be greater than that applied to other reference points. On the other hand, a weight applied to a reference point of the second ultrasound data having volume information dissimilar to that of the reference point of the first ultrasound data may be smaller than weights applied to other reference points. In other words, different weights can be applied to multiple reference points. Weights respectively applied to the reference points may be determined based on individual information on individual regions corresponding to the reference points.

The image processor may transform the second ultrasound data based on the matching result. For example, the image processor may obtain a translation and/or a rotation of the second ultrasound data based on the matching result, and thus may perform a linear transformation on the second ultrasound data.

FIG. 15 shows reference points 11 a - 15 a of the first ultrasound data 7000 and reference points 11 b - 16 b of the second ultrasound data 8000 that have been obtained by transforming according to the matching results shown in FIG. 14 .

Referring to FIG. 15 , the image processor may match a reference point closest to the reference points 11a-15a of the first ultrasound data 7000 among the reference points 11b-16b of the second ultrasound data 8000 with each of the reference points 11a-15a .

The reference points 11a and 12a of the first ultrasound data 7000 can be matched with the reference point 11b of the second ultrasound data 8000, the reference points 13a and 15a of the first ultrasound data 7000 can be matched with the reference point 12b of the second ultrasound data 8000, The reference point 14a of the first ultrasound data 7000 may be matched with the reference point 15b of the second ultrasound data 8000 .

The image processor may transform the second ultrasound data 800 again based on the matching result.

FIG. 16 shows reference points 11 a - 15 a of the first ultrasound data 7000 and reference points 11 b - 16 b of the second ultrasound data 8000 that have been obtained by transforming according to the matching results shown in FIG. 15 .

Referring to FIG. 16 , the image processor may again compare the reference points closest to the reference points 11a-15a of the first ultrasound data 7000 among the reference points 11b-16b of the second ultrasound data 8000 with each of the reference points 11a-15a. match. The reference points 11a, 12a, 13a, 14a, and 15a of the first ultrasound data 7000 may be matched with the reference points 11b, 15b, 12b, 16b, and 13b of the second ultrasound data 8000, respectively. The image processor can transform the second ultrasound data again according to the matching result.

FIG. 17 shows reference points 11 a - 15 a of the first ultrasound data 7000 and reference points 11 b - 16 b of the second ultrasound data 8000 that have been obtained by transforming according to the matching results shown in FIG. 16 .

Referring to FIG. 17 , each of the reference points 11 a - 15 a of the first ultrasound data 7000 coincides with one of the reference points 11 b - 16 b of the second ultrasound data 8000 . Therefore, the image registration of the first ultrasound data and the second ultrasound data is completed.

Referring back to FIG. 13 , after the image registration is completed, the image processor can detect the target region 2a from the plurality of independent regions 1a-5a of the first ultrasound data 7000 and detect the target region 2a from the plurality of independent regions 1a-5a of the second registration data 8100, respectively. Independent area 1b-7b detection target area 5b. The target regions 2a and 5b may be detected based on volume information about each of the individual regions 1a-5a and 1b-6b. For example, the target areas 2a and 5b may be detected based on at least one selected from the shape, volume, or volume change of the individual areas 1a-5a and 1b-6b.

FIG. 18 shows ultrasound data processing for image registration performed by the image processor of the ultrasound image display device according to the embodiment.

Referring to FIG. 18 , in order to register the first ultrasound data 7000 and the second ultrasound data 8000 , the image processor may obtain second ultrasound data sets 8000 , 8001 , 8002 , and 8003 by performing various transformations on the second ultrasound data 8000 . The second ultrasound data sets 8000 , 8001 , 8002 and 8003 may be obtained by spatially transforming or linearly transforming the second ultrasound data 8000 . The image processor may perform image registration on the first ultrasound data 7000 and the transformed second ultrasound data included in each of the second ultrasound data sets 8000 , 8001 , 8002 , and 8003 by using ICP.

When the first ultrasound data 7000 and the second ultrasound data 8000 are largely misaligned, errors may occur during reference point matching via ICP, thus reducing the accuracy of image registration. Therefore, when various transformations are performed on the second ultrasound data 8000 and then registered with the first ultrasound data 7000, the accuracy of image registration can be improved.

In this way, the image processor may perform image registration on the first ultrasound data and the second ultrasound data through the ICP. The image processor may perform image registration on the first ultrasound data by various image registration methods other than ICP. For example, image registration can be performed using mutual information, correlation coefficients, image ratio consistency, or partition strength consistency.

19A and 19B illustrate screen images displayed by the ultrasound image display device according to the embodiment. Specifically, FIG. 19A shows a screen image 1901 displayed on the display 3200 of FIG. 5B. FIG. 19B shows screen image 1950 displayed on display 3200 of FIG. 5B.

The image processor 3100 may generate respective ultrasound images of multiple time points based on various ultrasound data of multiple time points. 19A and 19B show a case of using ultrasound data acquired by scanning a subject at three different time points (first time point, second time point, and third time point).

Specifically, referring to FIG. 19A , the image processor 3100 obtains a first image 1910 by using the first ultrasound data obtained by scanning the subject at a first time point, and by using the second ultrasound data obtained by scanning the subject at a second time point. The second image 1911 is acquired using ultrasound data, and the third image 1912 is acquired by using third ultrasound data acquired by scanning the subject at a third time point. The image processor 3100 may acquire at least one diagnostic image including the first information, ie, the diagnostic images 1941 and 1942 , by performing image registration on the first ultrasound data, the second ultrasound data, and the third ultrasound data.

A screen image 1901 displayed on the display 3200 may include ultrasound images 1910, 1911, and 1912 respectively acquired based on corresponding ultrasound data at a plurality of time points. The respective ultrasound images 1910, 1911, and 1912 may be arranged in ascending or descending order of a plurality of time points at which the subject is scanned. Specifically, the time points may be arranged on the axis 1920 of the screen image 1901, and the images may be arranged on the other axis 1921 thereof.

Referring to FIG. 19A , a first image 1910 acquired by scanning an object on July 1, 2014 (a first time point) includes an object area 1931 representing an object. A second image 1911 obtained by scanning the object on July 11, 2014 (the second point in time) includes a target area 1932 representing the target. A third image 1912 obtained by scanning the object on July 21, 2014 (third point in time) includes a target area 1933 representing the target. As shown in FIG. 19A , a first image 1910 , a second image 1911 , and a third image 1912 may be arranged on a first row of a screen image 1901 . A diagnostic image 1941 obtained by registering the first image 1910 and the second image 1911 and a diagnostic image 1942 obtained by registering the second image 1911 and the third image 1912 may be arranged in the second row of the screen image 1901 superior.

A user can easily determine a change of an object between two different time points of the screen image 1901 .

The same description of FIG. 19B as that given above with reference to FIG. 19A will not be repeated here.

Referring to FIG. 19B , the image processor 3100 may generate a diagnostic image 1960 showing a change in a state of a target at a first time point, a second time point, and a third time point.

Specifically, the image processor 3100 may perform image registration on the first image 1910, the second image 1911 and the third image 1912, and obtain the registered first image 1910, the second image 1911 and the third image 1912 The diagnostic images 1960 are superimposed on each other and displayed.

Therefore, in the diagnostic image 1960 included in the screen image 1950, the first object area 1943 corresponding to the first object area 1931 representing the object at the first time point, and the first object area 1943 representing the object at the second time point A second object area 1944 corresponding to the two object areas 1932 and a third object area 1945 corresponding to a third object area 1933 representing an object at a third time point are overlapped with each other and displayed. The user can easily determine the change of the target over time through the screen image 1950 .

Fig. 20A shows a screen image displayed by the ultrasound image display device according to the embodiment. Specifically, FIG. 20A shows a screen image displayed on the display 3200. Referring to FIG.

The image processor 3100 may acquire respective ultrasound images of multiple time points based on the respective registered ultrasound data of the multiple time points, and set a weight to each of the respective ultrasound images of the multiple time points. The weight is a value applied to the ultrasound image at the corresponding time point, so that the corresponding ultrasound image is more or less prominently displayed on the diagnostic image. The weight can be set by the user or the image processor 3100 . The diagnosis image 6003 may be an image in which respective ultrasonic images at a plurality of time points weighted by applying respective weights to the respective ultrasonic images at a plurality of time points are superimposed on each other and displayed. 20A and 20B show a case where the user sets weights.

Specifically, FIG. 20A shows a user interface (UI) image 2010 for setting weights to be applied to the first image 4003 and the second image 5003, respectively. FIG. 20B shows a UI image 2050 for setting weights to be applied to the first image 4003 and the second image 5003 at the same time.

Referring to FIG. 20A , the UI image 2010 may include a first menu 2011 for setting a first weight applied to the first image 4003 and a second menu 2012 for setting a second weight applied to the second image 5003 .

The first menu 2011 may include a cursor 2014 for setting a weight within a settable weight range (eg, from -1 to 1), and the second menu 2012 may include a settable weight range (eg, from -1 to 1) Cursor 2015 for setting weights. When the weight is set to the lower limit (for example, -1), the image to which the weight is to be applied is displayed with the lightest luminance within the diagnosis image 6003 . When the weight is set to the upper limit (for example, 1), the image to which the weight is to be applied is displayed with the deepest brightness within the diagnostic image 6003 . When the weight is set to an intermediate value within the settable weight range, the image to which the weight is to be applied is displayed in the diagnostic image 6003 with the same brightness as that of an unweighted image.

Specifically, the first weight applied to the first image 4003 is 0 and the second weight applied to the second image 5003 is 0, the diagnostic image 6003 can be displayed as the same as the diagnostic image 6001 of FIG. 10 and the diagnostic image of FIG. 11 6003 is the same. When the first weight applied to the first image 4003 is -1 and the second weight applied to the second image 5003 is 1, within the diagnostic image 6003, the first target image 4023 may be displayed with a lighter color, the second The second target image 5023 may be displayed with a darker color. When the first weight applied to the first image 4003 is 1 and the second weight applied to the second image 5003 is 1, both the first object image 4023 and the second object image 5023 can be displayed in the darkest color within the diagnosis image 6003 . When the first weight applied to the first image 4003 is -1 and the second weight applied to the second image 5003 is -1, both the first target image 4023 and the second target image 5023 can be the lightest in the diagnostic image 6003 color display.

Referring to FIG. 20B , the UI image 2050 may include a third menu 2060 for setting weights applied to the first image 4003 and the second image 5003 at one time.

The third menu 2060 may include a cursor 2063 for setting a weight.

For example, in the third menu 2060, when the cursor 2063 moves to the weight W1 applied to the first image 4003, the weight W1 applied to the first image 4003 increases, and the weight W2 applied to the second image 5003 decreases. Then, in the diagnosis image 6003 , the first target image 4023 may be displayed with a darker brightness than the second target image 5023 , and the second target image 5023 may be displayed with a lighter color than the first target image 4023 .

As another example, in the third menu 2060, when the cursor 2063 is set at 0 (the middle between the first weight W1 and the second weight W2), the first target image 4023 and the second target image 5023 may be displayed are the same degree of brightness, therefore, the diagnostic image 6003 can be displayed the same as the diagnostic image 6001 in FIG. 10 and the diagnostic image 6003 in FIG. 11 .

As another example, in the third menu 2060, when the cursor 2063 moves to the weight W2 applied to the second image 5003, the weight of the second image 5003 increases, and the first weight W1 applied to the first image 4003 decreases . Then, in the diagnostic image 6003 , the first target image 4023 may be displayed with a lighter color than the second target image 5023 , and the second target image 5023 may be displayed with a darker color than the first target image 4023 .

As described above, according to the user's intention with the weight setting, an object image at a specific time point may be displayed more clearly than object images at other time points. Therefore, a diagnostic image conforming to the user's intention can be output.

21A and 21B show other screen images displayed by the ultrasound image display device according to the embodiment.

Referring to FIG. 21A , the screen image 2110 displayed on the display 3200 may further include target change numerical value information representing a change in at least one selected from the size, position, and number of at least one target in numerical values. Specifically, the object change value information may include a value of at least one selected from area, volume, major axis length, minor axis length, radius, diameter, and circumference representing the size of the at least one object. The target change value information described with reference to FIGS. 21A and 21B may be the more detailed version of the size information 6030 of FIG. 10 .

Specifically, FIG. 21A shows a screen image 2110 displaying goal change value information about a goal included in an object, the state of which has changed between multiple points in time. FIG. 21B shows a screen image 2160 on which target change value information about all individual targets included in an object is displayed.

A recognition indicator (for example, TG1 , TG2 , or TG3 ) for recognizing a target associated with at least one target is displayed on the first image 4003 , the second image 5003 , and the third image 6003 included in the screen image 2110 . Specifically, as shown in screen image 2110, a recognition indicator (eg, TG1) indicating a target may be tagged to the same target (eg, 4022 ) included in first image 4003, second image 5003, and diagnostic image 6003. , 5022, 4023 and 5023).

In the first image 4003 and the second image 5003 included in the screen image 2110 displayed on the display 3200, information 2111 and information 2112 indicating time points at which the first image 4003 and the second image 5003 are acquired, respectively, may be displayed.

Referring to FIG. 21A , a screen image 2110 may include target change value information 2120 . The target change value information 2120 may display only target change value information on a target whose state has changed (eg, a selected follicle), and may not display information on a target whose state has not changed. Specifically, during the first time point t1 corresponding to the first image 4003 and the second time point t2 corresponding to the second image 5003, when the state change only occurs between the selected follicles 4022 and 5022 and the other follicles When the status is not changed, the target change value information 2120 may only display information about the target TG1 (the target whose status has changed). The target change numerical information 2120 may include a change 2123 in a value of at least one selected from area, volume, major axis length, minor axis length, radius, diameter, and circumference representing the size of at least one target (eg, TG1 ). (△)).

Specifically, FIG. 21A shows that the target change value information 2120 includes the (TG1(t1)) major axis and minor axis length 2121 of the target 4022 at the first time point t1, and the target 5022 (TG1) at the second time point t2. (t2)) and the change 2123 between the first time point t1 and the second time point t2 (eg, TG1(Δ)).

FIG. 21B shows a screen image 2160 on which target change value information about all individual targets included in an object is displayed.

Referring to FIG. 21B , a screen image 2160 may include target change value information 2170 on all individual targets included in an object. Specifically, as shown in FIG. 21B , the target change value information 2170 may include information indicating the size of all individual targets (for example, TG1, TG2, and TG3 ) included in the object scanned by ultrasound. A time point t1 and a second time point t2 have dimensions.

Specifically, in the object change numerical value information 2170, size information on each of a plurality of individual objects included in the object may be displayed in a list form.

FIG. 22 shows a screen image 2210 displayed by the ultrasound image display device according to the embodiment. In the description of the screen image 2210 of FIG. 22 , the repeated description of the screen image 2110 given above with reference to FIG. 21A is omitted.

The image processor 3100 of FIG. 5B may generate state change information 2250 representing state changes of all independent objects included in the object based on respective ultrasound data of a plurality of time points. The display 3200 of FIG. 5B may display a screen image 2210 including the generated state change information 2250 .

Specifically, referring to FIG. 22 , the screen image 2210 may include state change information 2250 representing a state change of an individual target (eg, a follicle) included in an object between a first time point t1 and a second time point t2 . Specifically, the state change information 2250 may include information 2251 about a newly generated object between the first time point t1 and the second time point t2, information about objects that disappear between the first time point t1 and the second time point t2 Information 2252 of targets, information 2253 about targets changed between the first point in time t1 and the second point in time t2 , and information 2254 about targets not changed between the first point in time t1 and the second point in time t2 .

Referring to FIG. 22, the independent targets TG1, TG2 and TG3 are included in the first image 4003 at the first time point t1, and the target TG3 at the position 2213 on the first image 4003 has disappeared at the second time point t2, and the target TG4 has appeared at position 2212 of the second image 5003 . Between the first point in time t1 and the second point in time t2, the target TG2 has not changed and the target TG1 has changed. The state change information 2250 includes information representing a change between objects included in the object between the first time point t1 and the second time point t2.

From the state change information 2250, the user can easily determine the change of the object between a plurality of different time points.

FIG. 23 is a flowchart of an ultrasound image display method 2300 according to an embodiment. The ultrasound image display method 2300 may be performed by the ultrasound image display apparatuses 3000 and 3050 according to the embodiments of the present invention described above with reference to FIGS. 1 to 22 . Operations included in the ultrasound image display method 2300 are the same as those of the ultrasound image display devices 3000 and 3050 , and the technical spirit of the ultrasound image display method 2300 is the same as that of the ultrasound display devices 3000 and 3050 . Therefore, the same description as that of the ultrasound image display method 2300 given with reference to FIGS. 1-22 is not repeated here.

Referring to FIG. 23 , in operation S2310, corresponding ultrasound data representing an object including at least one target at a plurality of different time points is acquired for a plurality of different time points. Specifically, in operation S2310, corresponding ultrasound data at multiple time points are acquired by scanning the object including at least one target at the multiple different time points. Operation 2310 may be performed by the image processor 3100 . It has been described in FIG. 8 that the corresponding ultrasound data at a plurality of time points acquired by the image processor 3100 includes the first ultrasound data acquired by scanning the object at the first time point and the ultrasound data acquired by scanning the object at the second time point. Exemplary scenarios for second ultrasound data.

In operation S2320, first information representing changes of the at least one target at the plurality of different time points is acquired based on the acquired corresponding ultrasound data of the plurality of time points. In particular, changes in at least one selected from representing the size, position and number of the at least one target at the plurality of different time points are obtained by performing image registration on the corresponding ultrasound data at the plurality of different time points the first message. Operation 2320 may be performed by the image processor 3100 .

In operation S2330, a screen image including a diagnostic image showing first information is displayed. Operation S2330 may be performed by the display 3200 .

Referring back to FIG. 1 , the probe 20 may scan the subject at different times. A subject may include polycystic ovaries. The ultrasonic transceiver 100 may acquire first ultrasonic data and second ultrasonic data by processing echo signals received from the probe 20 at different times, respectively.

First ultrasound data is acquired by scanning the subject at a first point in time, and second ultrasound data is acquired by scanning the subject at a second point in time. The second point in time may be several days after the first point in time.

Referring back to FIGS. 1 and 5B, when the ultrasonic image display device 3050 is included in the ultrasonic diagnostic apparatus 1000 in FIG. 2 Ultrasound data. The ultrasound image display apparatus 3050 may store at least one selected from the first ultrasound data and the second ultrasound data in the memory 3400 .

When the ultrasonic image display device 3000 is the medical device 34 or the portable terminal 36 connected to the ultrasonic diagnostic device 1000 of FIG. ultrasound data and second ultrasound data. The communicator 3300 may receive the first ultrasound data and the second ultrasound data simultaneously or asynchronously. The memory 3400 may store at least one selected from the first ultrasound data and the second ultrasound data.

As described above, in the ultrasound image display apparatus and the ultrasound image display method according to the exemplary embodiments of the present inventive concept, when a subject needs to be observed at time intervals, a user can easily observe a change in a subject at a subsequent time point. Specifically, in the ultrasonic image display device and the ultrasonic image display method according to the exemplary embodiments of the present inventive concept, when a target included in an object needs to be monitored at multiple time points in order to diagnose or cure obstetrics and gynecology When a disease such as fibroids or uterine fibroids is included in at least one follicle of the ovary, the user can easily visually recognize changes in objects. The above-described exemplary embodiments can be written as computer programs, and can be executed in general-purpose digital computers that execute the programs using a computer-readable recording medium.

Examples of the computer-readable recording medium include magnetic storage media (eg, ROM, floppy disk, hard disk, etc.), optical recording media (eg, CD-ROM or DVD), and the like.

The exemplary embodiments should be considered in a descriptive sense only and not for purposes of limitation. Descriptions of features or aspects within each embodiment should typically be considered as available for other similar features or aspects in other embodiments.

While the invention has been particularly shown and described with reference to exemplary embodiments of the invention, it will be understood by those skilled in the art that changes may be made without departing from the spirit and scope of the invention as defined by the following claims. Various changes in form and detail.

Claims (15)

1. a Ultrasonographic display device, including:

Image processor, obtains the corresponding ultrasound data of multiple time point, and based on the plurality of time point Corresponding ultrasound data between correspondence obtain the first information, wherein, described corresponding ultrasound data table Showing the object including at least one target in multiple different time points, the first information represents the plurality of Change at least one target described in different time points；

Display, display includes illustrating the screen picture of the diagnostic image of the first information.

Ultrasonographic display device the most according to claim 1, wherein, diagnostic image is displayed as Enable the ultrasonic figure that at least one target described is distinguished from each other out in the state of the plurality of different time points Picture.

Ultrasonographic display device the most according to claim 1,

Wherein, the corresponding ultrasound data at the plurality of time point includes by very first time spot scan pair As the first ultrasound data obtained with by the second ultrasound data obtained at the second time point sweep object, Wherein, diagnostic image is to show first object image and the ultrasonoscopy of the second target image, institute overlappingly State first object image and describe at least one target described, described second target figure based on the first ultrasound data As showing at least one target described based on the second ultrasound data.

Ultrasonographic display device the most according to claim 3, wherein, described first object image Can be distinguished from each other out when display is in diagnostic image with the second target image.

Ultrasonographic display device the most according to claim 3, wherein, in diagnostic image, prominent Go out the difference between described first object image and the second target image.

Ultrasonographic display device the most according to claim 3,

Wherein, image processor obtains the first size of at least one target described based on the first ultrasound data, And the second size of at least one target is obtained based on the second ultrasound data,

Wherein, display also show from the dimension information of first size, the dimension information of the second size and In the information of change in size based at least one target described in the expression that first size and the second size obtain At least one selected.

Ultrasonographic display device the most according to claim 1, wherein, described object is ovary, At least one target described includes the follicle that the induction ovulation in multiple follicles that ovary is comprised is targeted.

Ultrasonographic display device the most according to claim 1, wherein,

Described object is a part for the abdominal part including uterus,

At least one target described is included in intrauterine or at least the one of extra-uterine at least some of middle generation Individual tumor.

Ultrasonographic display device the most according to claim 1, wherein,

Screen picture includes corresponding ultrasound data based on the plurality of time point and multiple time points of obtaining Corresponding ultrasonoscopy,

The order cloth of time point when the corresponding ultrasonoscopy of the plurality of time point is scanned according to object Put.

Ultrasonographic display device the most according to claim 1, wherein, the first information represent from The size of at least one target described, position and the quantity of the plurality of different time points selects at least The change of one.

11. Ultrasonographic display devices according to claim 1, wherein, picture screen also includes Object variations numerical information, described object variations numerical information is numerically from least one target described Size, position and quantity in select the change of at least one.

12. Ultrasonographic display devices according to claim 1, wherein, object variations numerical value is believed Breath comprise from represent the described area of size of at least one target, volume, long axis length, minor axis length, The value of at least one selected in radius, diameter and girth.

13. Ultrasonographic display devices according to claim 1, wherein,

Image processor corresponding ultrasound data based on the plurality of time point obtains the corresponding of multiple time points Ultrasonoscopy, and to each weight that arranges in the corresponding ultrasonoscopy of the plurality of time point, and produce Diagnostic image, described diagnostic image is that to be provided with each of the plurality of time point of weight respectively ultrasonic The image that image shows overlapping one another.

14. Ultrasonographic display devices according to claim 1, also include receiving institute from external source State the communicator of the corresponding ultrasound data of multiple time point.

15. 1 kinds of methods showing ultrasonoscopy, described method includes:

Obtaining the corresponding ultrasound data of multiple time point, wherein, described corresponding ultrasound data represents multiple The object including at least one target of different time points；

Correspondence between corresponding ultrasound data based on the plurality of time point obtains and represents the plurality of The first information of the change of at least one target described of different time points；

Display includes illustrating the screen picture of the diagnostic image of the first information.