JP2018117738A - Ultrasonic diagnostic apparatus and display method - Google Patents

Abstract

A frozen ultrasonic image continues to be displayed in a blank period that occurs when operating conditions are changed. This caused boredom or stress in the examiner. Based on a final image generated and displayed under a first operating condition before change, an animated visual effect image (VE image) that changes with time is generated. The VE image is displayed in the blank period. The animation process is, for example, a process of gradually changing the position, a process of gradually changing the luminance, or a process of gradually changing the form. Before the first image generated under the changed second operating condition is displayed, control for forcibly terminating the display of the VE image is executed. [Selection] Figure 7

Description

  The present invention relates to an ultrasonic diagnostic apparatus, and more particularly to display control when an operating condition is changed.

  Ultrasound diagnostic apparatuses are used in the medical field. The ultrasonic diagnostic apparatus is an apparatus that forms an ultrasonic image based on a reception signal obtained by transmitting / receiving ultrasonic waves to / from a subject. As operation modes provided in the ultrasonic diagnostic apparatus, B mode, M mode, CFM mode, PW mode, CW mode, and the like are known. As an ultrasonic beam electronic scanning method, a linear scanning method, a sector scanning method, a convex scanning method, and the like are known.

  In a general ultrasonic diagnostic apparatus, when basic operation conditions such as an operation mode and a scanning method are changed, transmission / reception of ultrasonic waves is automatically stopped (a freeze state is automatically formed), and then After the setting that matches the new operating conditions is completed, the transmission / reception of the ultrasonic wave is automatically resumed, and the display of the moving image is resumed accordingly (see, for example, Patent Document 1).

  Specifically, when changing the operating conditions, for example, recalculation of a parameter group consisting of tens, hundreds or thousands of parameters, setting of the parameter group to the register group, reading of the parameter group from the register group, etc. A series of processes is required. Until such a series of processing is completed, the transmission / reception is temporarily stopped, that is, the operation of each processing module in the apparatus is temporarily stopped. With this as a background, after the last frame of the ultrasound image (moving image) formed under the operating condition before the change is displayed, the ultrasound image (moving image) formed under the operating condition after the change By the time the first frame is displayed, a “blank period” in which the ultrasonic image is not updated or a new ultrasonic image cannot be displayed inevitably occurs. Such a blank period is, for example, an indefinite period of several hundred milliseconds to several seconds, and typically the blank period is 2 to 3 seconds.

JP 2003-265469 A JP 2006-95279 A

  The ultrasonic image (still image) that is continuously displayed in the blank period is the last frame in the moving image that is created and displayed under the previous operating conditions. The image is an image representing a living tissue when the probe is in contact with the surface of the living body, and an image representing a simple multiple reflected wave when the probe is left in the air. In any case, the still image is usually an image that does not need to be observed by an examiner (physician, laboratory technician, etc.). For the inspector, the blank period is a response waiting period. In the blank period, the examiner's awareness is directed to the next examination under new operating conditions, and the currently displayed still image is a past image that is no longer of interest. Due to the fact that such a still image is continuously displayed without any change, a sense that the examiner is forced to wait is generated. The waiting time felt by the inspector feels longer than the actual waiting time. That is, the inspector tends to feel bored or stressed.

  On the other hand, during the blank period, it is also possible to display a black image while hiding the ultrasonic image. However, even in such a case, the displayed contents are still monotonous as usual, and such a countermeasure does not contribute to a feeling of boredom or stress in the examiner.

  Patent Document 2 describes fade-in and fade-out as medical image display techniques. However, they are used instead of instantaneous replacement of two images. Patent Document 2 does not disclose any proposal for improving an examiner's psychology or impression in a blank period that inevitably occurs when operating conditions are changed.

  An object of the present invention is to eliminate or alleviate an examiner's boredom or stress that occurs when changing operating conditions. Alternatively, an object of the present invention is to make an inspector feel a short blank period that occurs when operating conditions are changed.

  The ultrasonic diagnostic apparatus according to the present invention interrupts transmission / reception according to the first operating condition before the change and changes to the second operating condition after the change when there is a change in operating condition that requires interruption of transmission / reception. Operation control means for resuming transmission / reception after preparation for transmission / reception is completed, and basic image included in the ultrasonic image formed under the first operation condition when the operation condition is changed And a visual effect image generating means for generating a visual effect image that changes over time, and a display that controls the visual effect image to be displayed within a blank period that occurs when the operating condition is changed And control means.

  According to the above configuration, the visual effect image is generated based on the basic image, and the visual effect image is displayed within the blank period. Here, the visual effect image is an image intended for visual effect or a VE-processed image. The blank period is a period required for changing the operating condition, and is between the time of displaying the final image under the first operating condition and the time of displaying the first image under the second operating condition. It is a period. Since the visual effect image is a dynamically changing image, a visual change or fun is brought about by the examiner, and the impression that is forced to wait is eliminated or alleviated. That is, when the still image that does not change with time is continuously viewed, the examiner tends to feel bored or stressed. However, according to the above configuration, such bored feeling or stress can be prevented from being generated. Even if boredom or stress occurs, the level can be kept low. Since the visual effect image is created based on the basic image, that is, the visual effect image is an image that inherits the contents or properties of the basic image, in the examiner (and the subject) who viewed the image. It is possible to reduce the possibility of an uncomfortable feeling.

  The visual effect image is displayed in all or part of the blank period. Visual effect images may be displayed in the middle of the blank period, but if the visual effect image is displayed from the beginning of the blank period (seamlessly after the final image), image display interruptions and flickering can be avoided. it can. When the blank period is an indefinite period, it is required to perform display control so that the display of the visual effect image is completed before the display of the ultrasonic image created under the second operating condition is started. It is also possible to perform display control so that the display of the ultrasonic image created under the second operating condition is started after the display of the visual effect image is completed.

  One or a plurality of images (one or a plurality of frames) in a moving image (frame sequence) created under the first operating condition are set as a basic image. A part of the frame (for example, a tomographic image area) can be used as a basic image. In the embodiment, the final image displayed last under the first operating condition is the basic image. If the image content changes naturally and smoothly at the start of the display of the visual effect image, there will be no abrupt sensation in the viewer of the image.

  In the embodiment, the visual effect image generation unit generates the visual effect image by an animation process based on the basic image. Each frame constituting the visual effect image is directly or indirectly generated from the basic image. In the embodiment, a plurality of types of processing are prepared as the animation processing, and a processing to be actually used is selected from the plurality of types of processing. The animation process includes a process of gradually changing the position, a process of gradually changing the luminance, and a process of gradually changing the form. A plurality of processes may be combined. If a visual effect image that suddenly changes in time and greatly changes in content is used, there is a possibility that an unnecessary visual impact or annoying stimulus may be given to the observer. Therefore, it is desirable to employ an image that gradually changes with time as the visual effect image. In the embodiment, the type of visual effect, the display period of the visual effect image, the change speed of the visual effect image, and the like are determined manually or automatically.

  The ultrasonic diagnostic apparatus according to the embodiment includes a graphic image generating unit that generates a first graphic image based on the first operating condition and generates a second graphic image based on the second operating condition. The first graphic image is displayed together with the ultrasonic image formed under the first operating condition, and the second graphic image is formed under the second operating condition. The display control means ends the display of the visual effect image before the start of the display of the second graphic image. According to this configuration, it is possible to avoid a situation in which the visual effect image is displayed together with the second graphic image. Each of the first graphic image and the second graphic image is a part of the display image, and is a non-ultrasonic image having characters, symbols, figures, icons, etc., or a super image as a main image. It is a sub image combined with a sound wave image.

  In the embodiment, the second graphic image is displayed from the start of display of the ultrasonic image formed under the second operation condition or displayed before the display, and the display control unit is configured to display the second graphic image. Means for forcibly terminating the display of the visual effect image at a reference time prior to the start of display of the second graphic image. According to this configuration, it is possible to reliably prevent the occurrence of a situation in which the visual effect image is displayed together with the second graphic image. The reference time is, for example, the timing at which a signal indicating completion of change is generated, the timing at which a second graphic image generation command is output, the timing at which a transmission / reception wave restart command is output, and the like.

  The display method according to the present invention interrupts transmission / reception according to the first operating condition before the change and changes the operating condition that requires interruption of transmission / reception, and transmits / receives the wave according to the second operating condition after change. Resuming the transmission / reception after the preparation for performing is completed, displaying the first ultrasonic image created under the first operating condition, and creating under the second operating condition A step of displaying the second ultrasonic image, and a temporally changing visual effect after the first ultrasonic image is displayed and before the second ultrasonic image is displayed. And a step of displaying an image.

  The visual effect image is displayed in a period (waiting time for the examiner) after the display of the first ultrasonic image and before the display of the second ultrasonic image, thereby improving visual mediocrity. To do. The visual effect image is generated in real time on the basis of a live image created under the first operating condition, and is generated in advance or in real time on the basis of an ultrasonic image acquired in the past, or an artificial image It is generated in advance as an animation or a pseudo ultrasonic image. In the embodiment, the visual effect image inheriting the content or property of the ultrasonic image created under the first operating condition with emphasis on the natural transition of the image content at the start of display of the visual effect image Is generated.

  According to the present invention, it is possible to eliminate or alleviate an inspector's bored feeling or stress that occurs when operating conditions are changed. Or according to this invention, the blank period which arises in the case of a change of operating conditions can be made to feel short on the impression in an examiner.

1 is a block diagram showing an embodiment of an ultrasonic diagnostic apparatus according to the present invention. It is a timing chart which shows normal operation. It is a figure which shows normal control. It is a timing chart which shows the operation | movement accompanied by forced termination. It is a figure which shows the control accompanied by forced termination. It is a timing chart which shows a modification. It is a figure which shows the 1st example of an animation process. It is a figure which shows the 2nd example of an animation process. It is a figure which shows the 1st modification about the 2nd example of an animation process. It is a figure which shows the 2nd modification about the 2nd example of an animation process. It is a figure which shows the 3rd example of an animation process. It is a figure which shows the 4th example of an animation process. It is a figure which shows the 5th example of an animation process. It is a figure which shows the operating condition change accompanying layout change (display format). It is a figure which shows the animation process with respect to both of 2 images. It is a figure which shows the animation process with respect to one of 2 images. It is a figure which shows the 1st example of an animation table. It is a figure which shows the 2nd example of an animation table. It is a figure which shows the 3rd example of an animation table. It is a figure which shows the 1st example of UI for animation type selection. It is a figure which shows the 2nd example of UI for animation type selection. It is a figure which shows the 1st example of UI for animation period selection. It is a figure which shows the 2nd example of UI for animation period selection. It is a figure which shows the 3rd example of UI for animation period selection. 3 is a flowchart illustrating an operation example of the configuration illustrated in FIG. 1. It is a figure which shows the modification of an animation process.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

  FIG. 1 is a block diagram showing an embodiment of an ultrasonic diagnostic apparatus according to the present invention. This ultrasonic diagnostic apparatus is an apparatus that is installed in a medical institution such as a hospital and forms an ultrasonic image based on a reception signal obtained by transmitting / receiving ultrasonic waves to / from a living body. This ultrasonic diagnostic apparatus has various operation modes such as B mode, M mode, CFM mode, PW Doppler mode, CW Doppler mode, elast imaging mode, harmonic imaging mode, and three-dimensional image display mode. The ultrasonic diagnostic apparatus is compatible with a linear scanning method, a sector scanning method, a convex scanning method, and the like, and a scanning method that is actually used is selected from these scanning methods. Furthermore, in this ultrasonic diagnostic apparatus, it is possible to select one screen display, two screen display, four screen display, or the like.

  In FIG. 1, the ultrasonic diagnostic apparatus includes an apparatus main body 8 and a probe 10. The apparatus main body 8 includes a front end (FE) unit 12, a back end (BE) unit 20, a display processing unit 44, and a control unit 52.

  The probe 10 is a portable handset that is detachably connected to the apparatus body 8. In the present embodiment, the probe 10 has an array transducer composed of a plurality of transducer elements arranged one-dimensionally along a straight line or a curve. An ultrasonic beam is formed by the array transducer, and the ultrasonic beam is electronically scanned. Thereby, a beam scanning surface as an observation surface is formed. A three-dimensional data capture space may be formed by two-dimensional scanning with an ultrasonic beam, and volume data may be obtained from the space.

  The FE unit 12 will be described. The transmission / reception circuit 14 is an electronic circuit that functions as a transmission beam former and a reception beam former. At the time of transmission, the transmission / reception circuit 14 outputs a plurality of transmission signals in parallel to the array transducer. As a result, a transmission beam is formed. At the time of reception, when a reflected wave from the living body is received by the array transducer, a plurality of reception signals are output in parallel from the array transducer to the transmission / reception circuit 14. The transmission / reception circuit 14 converts each of the plurality of reception signals into a digital signal and then delay-adds the plurality of digital reception signals (phased addition), thereby generating beam data. A plurality of beam data arranged in the electronic scanning direction are acquired per one beam scanning plane. They constitute a received frame. Each beam data is composed of a plurality of echo data arranged in the depth direction.

  The transmission / reception controller 16 is constituted by a processor or the like, which controls transmission / reception of ultrasonic waves under the control of a main controller 54 described later. When controlling transmission / reception, the parameter group stored in the register group 18 is referred to. The main controller 54 writes a new parameter group necessary for ultrasonic transmission / reception control to the register group 18 when the operating condition is changed.

  Next, the BE unit 20 will be described. The beam data processing circuit 24 is an electronic circuit that processes individual beam data. Specifically, the beam data processing circuit 24 has a plurality of data processing functions corresponding to a plurality of operation modes, and includes, for example, a quadrature detection circuit, an amplitude calculation circuit, a logarithmic conversion circuit, a filter circuit, a correlation circuit, and the like. . The processed beam data is sent to the coordinate converter 26. The coordinate converter 26 is an electronic circuit including a digital scan converter (DSC). The DSC has a coordinate conversion function, an interpolation function, a frame rate adjustment function, and the like. The coordinate conversion function is a function that converts, for example, rθ coordinates (polar coordinates) into xy coordinates (orthogonal coordinates). For example, when the B mode is selected, the coordinate converter 26 forms a tomographic image (B mode image) from the received frame. Ultrasonic image data is sent to the display processor 46 via the image processor 30. The image processor 30 is a circuit that executes gradation correction, gamma correction, color processing, and the like.

  In the illustrated configuration example, the coordinate converter 26 has a frame memory (FM) 28 that functions as a work memory or the like. Further, the image processor 30 has two FMs 32 and 34 that function as output buffers and the like. Further, in the illustrated configuration example, a cine memory 29 is provided in front of the coordinate converter 26, and a cine memory 36 is connected to the image processor 30. The cine memories 29 and 36 each have a ring buffer structure, and store a frame sequence from the latest frame over the past certain time. In a state where transmission / reception is paused (freeze state), it is possible to read out and reproduce the frame sequence stored in the cine memories 29 and 36 as necessary. In the BE unit 20, one or a plurality of ultrasonic images corresponding to the selected operation mode and the like are formed.

  The BE unit 20 in this embodiment includes a visual effect (VE) image generation unit 40. The VE image generation unit 40 generates a VE image as a dynamic image that changes with time. The VE image generation unit 40 is configured by a processor or the like. The VE image is a dynamic image generated by an animation process based on an ultrasonic image (basic image) in the present embodiment. A VE image is generated and displayed so as to fill all or part of the blank period that occurs when operating conditions are changed, particularly to eliminate or alleviate boredom or stress in the inspector.

  More specifically, when a basic operating condition change (an operating condition change that interrupts transmission / reception) that cannot maintain real-time processing occurs, rather than a minor operating condition change such as gain change, recalculation of parameters, parameter It is necessary to reset the group (that is, preparation for transmission / reception and image formation under the following operating conditions). The period required for this is a blank period. The time between the display of the last frame (final image) created according to the first operation condition before the change and the display time of the first frame (first image) created according to the second operation condition after the change is new. This is a period during which an ultrasonic image cannot be displayed, which is a blank period. The blank period is a waiting time that is essentially useless for the inspector. Therefore, an artificial moving image or animation generated and displayed in order to eliminate visual monotony or incompatibility in the blank period is a VE image.

  In the present embodiment, a VE image composed of a plurality of frames is generated by an animation process based on the final frame created under the first operating condition before the change. The VE image is displayed seamlessly following the last frame. The display of the VE image ends before the first frame created under the changed second operating condition is displayed. Actually, the display of the VE image is controlled before the graphic image according to the second operation condition is displayed.

  The BE unit 20 has a register group 42. The main controller 54 resets a new parameter group for the register group 42 when the operating condition is changed. A parameter group stored in the register group 42 is referred to by each configuration in the BE unit 20.

  Next, the display processing unit 44 will be described. The display processor 46 has an image composition function. Specifically, during normal operation, the display processor 46 composes a display image by combining an ultrasonic image as a main image and a graphic image as a sub image. In the blank period, the display processor 46 composes a display image by synthesizing the VE image as the main image and the graphic image as the sub image. However, the first graphic image according to the first operating condition before the change may constitute the display image alone in a part in the blank period, and the change may be made in another part in the blank period. The second graphic image according to the later second operating condition may constitute a display image by itself. Display image data is output to the display 50.

  The display processing unit 44 has a register group 48. The main controller 54 resets a new parameter group for the register group 48 when the operating condition is changed. The display processor 46 refers to the parameter group stored in the register group 48. The display 50 is a main display configured by a liquid crystal display, an organic EL display, or the like. Further, a sub-display may be provided.

  Next, the control unit 52 will be described. The main controller 54 includes a processor that manages and controls the operations of the components shown in FIG. An operation panel 60 is connected to the main controller 54. The operation panel 60 is an input device having a keyboard, trackball, switch, encoder, and the like. The graphic image generator 56 is a processor that generates a graphic image in which operating conditions are reflected. A graphic image is a sub-image that is combined with an ultrasound image, and includes various objects such as text, graphics, icons, and thumbnails. Specifically, the graphic image includes examination information (date and time, facility name, etc.), subject information (name, sex, etc.), information indicating operating conditions (transmission frequency, gain value, etc.), various figures (body marks) , Frames, scales, icons, etc.). The graphic image is also regenerated along with the change of the operating condition. When the graphic image generator 56 generates a new graphic image, it outputs the image data to the display processor 46. Thereby, the image data is overwritten on the memory in the display processor. However, the graphic image generator 56 may be configured to repeatedly output graphic image data at regular intervals.

  The storage unit 58 includes a semiconductor memory, a hard disk, and the like. The storage unit 58 stores data that is referred to when the main controller 54 performs operation control. Specifically, the storage unit 58 stores preset data, and stores one or more tables that define animation processing conditions.

  The configuration shown in FIG. 1 is an example. For example, the image processor 30 or the display processor 46 may function as the VE image generation unit 40. The main controller 54 and the graphic image generator 56 may be realized as functions of a program executed by the CPU. The VE image generation unit 40 may be realized as a function of a program executed by the CPU. The BE unit 20, the display processing unit 44, the control unit 52, the display device 50, and the operation panel 60 may be configured as a tablet terminal device. When such a configuration is adopted, the tablet terminal device and the FE unit 12 are connected wirelessly and by wire. When such a configuration is employed, all the functions of the BE unit 20, the display processing unit 44, and the control unit 52 can be realized by a CPU and a program.

  FIG. 2 shows a normal operation of the configuration shown in FIG. 1 as a timing chart. The content shown in FIG. 2 is merely an example, and the content may vary depending on the specific configuration of the ultrasonic diagnostic apparatus.

  (A) has shown the flame | frame row | line which comprises the ultrasonic image (US image) as a moving image. Specifically, a first frame sequence according to the first operation condition and a second frame sequence according to the second operation condition are shown. The horizontal axis is the time axis. Each element (rectangle) in the figure indicates a frame (instantaneous image). (B) shows a frame sequence 70 constituting a VE image as a moving image. (C) shows the update timing of the graphic image (G image). Specifically, reference numeral 78 represents the updated frame. However, for convenience of explanation, in FIG. 2, individual graphic image frames combined with individual frames constituting the US image and the VE image are represented by broken lines. (D) shows a frame sequence constituting the display image.

  As shown in FIG. 2, the US image frame 62 and the G image frame 64 are combined to form a display image frame 66. The display image frame is displayed. This process is repeated. When an operation condition change that requires interruption of transmission / reception occurs, an operation condition change process is started at T10. As a result, the display period L10 according to the first operating condition ends. Reference numeral 68 denotes a final frame (final US image frame) created according to the first operating condition, and is displayed at the end of the display period L10. In a period L20 following the last frame 68, a frame sequence 70 that forms a VE image is generated. The frame sequence 70 is generated by processing the final frame 68 as a basis. In that case, as indicated by reference numeral 72, individual frames constituting the frame sequence 70 may be directly generated from the final frame 68. Alternatively, as indicated by reference numeral 74, the first frame is generated based on the final frame 68, and then the second frame is generated based on the first frame. Column 70 may be generated. In the display period L12, the frame sequence 76 including the VE image is displayed. In the display period L12, the display of the first G image is maintained.

  In the display period L14, the VE image is not displayed and only the first G image is displayed. When the change of the operating condition is completed at T12, the G image is updated as indicated by reference numeral 78. That is, the first G image is switched to the second G image. In the illustrated example, only the second G image is displayed in advance in the display period L16. After the preparation for operating under the second operating condition is completed, transmission / reception of ultrasonic waves is resumed. In the display period L18, the second US image is displayed together with the second G image. Reference numeral 80 indicates the first frame in the frame sequence according to the second operating condition. A period between when the last frame 68 is displayed and when the first frame 80 is displayed corresponds to a blank period. In the blank period, the VE image is displayed for a certain period immediately after the last frame 68 is displayed. Since the VE image is an animation-processed dynamically changing image, the examiner is not bored or stressed during the blank period, and even if it occurs, the degree can be kept low.

  FIG. 3 shows a control process (contents of control by the main control unit) during the normal operation. The control process shown in FIG. 3 is also merely an example, and it may vary depending on the specific configuration of the ultrasonic diagnostic apparatus. The horizontal axis is the time axis, and the vertical axis indicates the change rate (change rate from the basic image) in the animation processing.

  When the operating condition is changed by the user at T14, the operating condition changing process is started at T10. Specifically, transmission / reception is stopped at T16, and animation processing for visual effects is started at T18. The period up to T18 is the display period L22 of the US image (first US image) before the change. The subsequent period is a VE image display period L26. In the illustrated example, a VE image is generated and displayed according to a function selected from the functions 82, 84, and 86 within the display period L26. The functions 82, 84, and 86 are functions that define time change of the change rate, respectively. The function 82 is a linear function, and the functions 84 and 86 are both nonlinear functions. At the end of the display period L26, the slope of the rate of change in the functions 84 and 86 is smaller than the slope of the rate of change in the linear function 82.

  The end point T20 of the animation process for the visual effect is the end of the VE image display period L26. In the illustrated example, when the change of the operating condition is completed at T12, a second G image drawing command is first issued at T22. Thereby, the G image is updated at T24. When preparation is complete, a command to resume transmission and reception is issued. Specifically, for example, a transmission / reception restart command is issued simultaneously with the drawing command or when the drawing is completed. The period before T24 is the display period L24 of the pre-change G image (first G image), and the period after T24 is the display period L30 of the post-change G image (second G image). At T26, display of the changed US image (second US image) is started. The period after T26 is the second US image display period L28.

  In the above control example, the display start of the second G image precedes the display start of the second US image, but the display of both images may be started simultaneously. At least when the second G image starts to be displayed and when the second US image starts to be displayed, the VE image is displayed so that the display of the VE image ends before the first occurrence. Be controlled. Normally, the time length of the blank period is indefinite, and specifically, the time length of the blank period varies depending on the amount of parameters to be recalculated and reset. The VE image display period may be set in advance as the same period as the typical time length for the blank period or as a period slightly shorter than the typical time length. Or you may make it set a VE image display period adaptively according to a condition. In any case, it is desirable to control the VE image display to end (or forcibly end) before the display of the second G image and the second US image is started.

  The forced termination will be described with reference to FIGS. FIG. 4 is a diagram illustrating an operation involving forced termination. FIG. 5 is a diagram showing a control process with forced termination. 4 and 5, the same reference numerals are given to the same elements as those shown in FIGS. 2 and 3, and the description thereof is omitted.

  In FIG. 4, when a change completion T12A occurs before the end of the VE image generation period L20, an interrupt process for forcibly terminating the VE image display is executed. That is, generation and display of the frames 90 and 92 constituting the VE image are prohibited after T12A. In other words, one or more black frames are generated. As indicated by reference numeral 78, the G image is updated after T12A. Thereby, only the first G image is displayed in the display period L14, and only the second G image is displayed in the subsequent display period L16. Incidentally, the code | symbol 96 has shown the display of the black frame. In the display period L18, the second US image is displayed together with the second G image.

  In the control process shown in FIG. 5, after the change completion T12A, a command for forcibly terminating the generation and display of the VE image is issued at T22. At subsequent T23, a drawing command for the second G image is output. T22 and T23 may be simultaneous, or T23 may be present before T22. At T24, the G image is updated. Incidentally, T20A indicates the end (scheduled end) of the VE image display period. The forced termination control is executed when the change completion T12A occurs before the scheduled end T20A. This special control can surely avoid the problem that the VE image is displayed together with the second G image (display of a plurality of incompatible images). In other words, the forced termination control condition is determined so as to avoid such a problem.

  If this forced termination is assumed, it is better to select the function 86 than the function 82 from the viewpoint of reducing the change in the image content at the forced termination. This is because the function 86 has a small change rate gradient at the end of the VE image display period. However, when the time length of the blank period can be predicted in advance, the VE image display period may be adaptively determined according to the time length.

  FIG. 6 shows a modification of the operation example shown in FIG. In FIG. 6, the same elements as those shown in FIG. 2 are denoted by the same reference numerals, and the description thereof is omitted.

  The last frame 68 is an image displayed last in the display period L10 of the first US image. Subsequent to the output of the final frame 68, in a period L32, one or a plurality of frames stored (formed and not displayed) stored in a buffer (frame memory or the like) in the apparatus main body are output. In the illustrated example, two frames 100 are output. The two frames 100 are a frame sequence following the final frame 68, and the three frames are arranged on the time axis, and their contents are almost the same. Following these frames 100, a frame sequence 102 forming a VE image is generated and displayed. In the illustrated modification, a VE image is generated based on the final frame 68, but a VE image may be generated based on the frame 100, or a VE image may be generated based on the final frame 68 and the frame 100. May be.

  In the display period L12A within the blank period, the frame 100 is first displayed, and subsequently, the frame sequence 102 constituting the VE image is displayed. The period L30 is a period combining the period L32 and the period L34. The period L32 is a period during which one or a plurality of frames accumulated in the apparatus main body is extracted, and the period L34 is a period during which a VE image is generated and output. Note that the first G image is continuously displayed over the periods L10 to L14. In the period L16 and the period L18, the second G image is continuously displayed.

  In this modification, although the display start of the VE image is slightly delayed from the display time of the final frame 68, the two frames 100 created under the first operating condition are displayed in the time gap. There is no sudden change in the image content. Also in the modified example, since the monotony is relieved by displaying the VE image, it is possible to obtain the same effect as the operation example shown in FIG. Also in this modification, it is desirable to apply the forced termination control described above.

  Next, a specific example of animation processing will be described with reference to FIGS. After the process of changing the operating condition is started at T10, the final display frame 104 created under the first operating condition is displayed at T30. After that, when the operation condition change is completed in T12 from T32 to T40, the top display frame 114 created under the second operation condition is displayed in T42. The final display frame 104 is an image generated by combining the ultrasonic image frame 108 and the graphic image (graphic image frame) 106. All or part of the ultrasonic image frame 108 is a target of animation processing. In the illustrated example, an image portion having a sector shape is an entity of the ultrasonic image frame 108, and this is a basic image. A target image described below is generated by copying or processing the basic image. The head display frame 114 is an image generated by combining the ultrasonic image frame 116, the ultrasonic image frame 118, and the graphic image (graphic image frame) 120. In the illustrated example, the ultrasound image frames 108 and 116 are black and white B-mode images, respectively, and the ultrasound image frame 118 is a color blood flow image.

  In the first example shown in FIG. 7, the VE image is generated by animation processing that gradually changes the display position of the target image that is the target of the animation processing within the display frame.

  The first example will be specifically described. In the VE image display period L36, a display frame sequence including a VE frame sequence is displayed. The display frame sequence includes the illustrated display frames 110A, 110B, and 110C. The display frame 110A includes a target image 112A and a graphic image 106. As indicated by reference numeral 111, the display position of the target image 112A is shifted to the right from the original position. The right end portion of the target image 112A protrudes from the display frame 110A, which is a non-display portion. The display position of the graphic image 106 is unchanged. In a portion where the graphic image 106 and the target image 112A overlap, for example, the graphic image 106 is preferentially displayed (on the front side as viewed from the observer). In the display frame 110B, the target image 112B is displayed at a position shifted further to the right. In the display frame 110C, the entire target image 112C is in a frame-out state. In the display frames 110B and 11C, the graphic image display is maintained. The moving speed of the target image may be constant, but it may be changed with time. A display area of the target image may be separately defined in the frame. The target image may be moved in another direction (for example, downward).

  According to the first example, when switching from the last frame to the VE image, the image content changes smoothly and naturally. During the VE image display period, the target image moves continuously in a specific direction and then finally moves. It will disappear. The observer feels the impression that the previous operating condition has ended when the target image disappears. Or the impression that the time of disappearance is the beginning of the blank period is memorized. As a result, it is possible to expect an effect that makes the observer feel the waiting time on the impression much shorter than the actual waiting time. In other words, boredom or stress that has conventionally occurred in the observer during the blank period is eliminated or alleviated.

  FIG. 8 shows a second example of animation processing. In FIG. 8, the same elements as those shown in FIG. 7 are denoted by the same reference numerals, and the description thereof is omitted. The same applies to FIGS. 11 to 13 described later.

  In the second example shown in FIG. 8, a VE image is generated by an animation process that gradually decreases the luminance of each pixel in the target image. Specifically, in the VE image display period L36, a display frame sequence including a VE frame sequence is displayed. The display frame sequence includes the illustrated display frames 122A, 122B, and 122C. The display of the graphic image 106 is maintained in the entire display frame sequence. The target image 124A in the display frame 122A is displayed at the same position as the basic image 108, but the luminance of the target image 124A is lower than the luminance of the basic image 108. The luminance of the target image 124B in the display frame 122B is lower than the luminance of the target image 124A. The luminance of the target image 124C in the display frame 122C is zero (or the lowest level), and the target image 124C has disappeared. The speed of the luminance change may be constant, but it may be changed with time.

  According to the second example, the image content smoothly and naturally changes when switching from the last frame to the VE image, and the luminance of the target image is gradually decreased during the VE image display period, and finally disappears. It will be. Therefore, as in the first example, boredom or stress that has conventionally occurred in the observer during the blank period is eliminated or alleviated.

  Several modifications of the second example will be described. FIG. 9 shows a first modification. In the first modification, as in the second example shown in FIG. 8, the luminance of the target images 124A, 124B, and 124C is continuously reduced as time elapses. Along with the continuous reduction of the luminance, the luminance of the graphic images 106A, 106B, and 106C is continuously reduced. In the display frame 122C, both the target image 124C and the graphic image 106 have disappeared.

  FIG. 10 shows a second modification. In the second modification, as in the second example shown in FIG. 8, the luminance of the target images 124A, 124B, and 124C is continuously reduced as time elapses. On the other hand, the graphic image is erased at the first time of the VE image display period L36 (see reference numeral 106D). Also according to the first modification and the second modification, it is possible to expect the same effects as those of the second example shown in FIG.

  FIG. 11 shows a third example of the animation process. In this third example, the form of the target image is gradually reduced, and in particular, the missing part of the target image increases from left to right as in the case of erasing by a moving virtual bar.

  Specifically, in the VE image display period L36, a display frame sequence including a VE frame sequence is displayed. The display frame sequence includes the illustrated display frames 126A, 126B, and 126C. The display of the graphic image 106 is maintained in the entire display frame sequence. The target image 128A in the display frame 126A corresponds to an image obtained by deleting the left end portion of the basic image 108, and the target image 128B in the display frame 126B corresponds to an image obtained by applying further deletion to the basic image 108. To do. In the display frame 126C, the target image is completely lost. The erasing speed may be constant or the speed may be changed with time.

  According to the third example, the image content smoothly and naturally changes when switching from the last frame to the VE image, and the display area of the target image gradually decreases with the passage of time in the VE image display period. Therefore, the target image is lost. Therefore, similarly to the first example and the second example, boredom or stress that has conventionally occurred in the observer during the blank period is eliminated or alleviated.

  FIG. 12 shows a fourth example of animation processing. As in the third example, the fourth example gradually decreases the form of the target image, and in particular, gradually increases the missing portion from the center of the target image to the periphery.

  Specifically, in the VE image display period L36, a display frame sequence including a VE frame sequence is displayed. The display frame sequence includes the illustrated display frames 132A, 132B, and 132C. The display of the graphic image 106 is maintained in the entire display frame sequence. The target image 134A in the display frame 132A has a missing portion 136A having a relatively small extent. The target image 134B in the display frame 132B has a missing portion 136B having a relatively large spread. As time passes, the missing portion 136C covers the entire target image, and the target image disappears completely at that time. Also in the fourth example, the erasing speed may be constant, or the speed may be changed with time. The missing portion may be generated by overwriting the mask image.

  FIG. 13 shows a fifth example of animation processing. In the fifth example, as in the third and fourth examples, the form of the target image is gradually reduced. In particular, the missing portion is gradually increased from the lower part to the upper part of the target image. Specifically, the lower portion of the target image 140A in the display frame 138A is partially disappeared, and the portion other than the upper portion of the target image 140B in the display frame 138B is disappeared. In the display frame 138C, the target image is completely lost. Instead of increasing the missing area, it may be possible to gradually reduce the target image while maintaining its shape. Further, as a modified example of the fifth example, as another animation process for making the observer recognize transmission stop, an animation process that gives an impression that the ultrasonic wave gradually disappears to the observer can be considered. This will be described later with reference to FIG.

  According to the fourth example and the fifth example, boredom or stress that has conventionally occurred in the observer during the blank period is eliminated or alleviated. In particular, in the fifth example, the impression that the ultrasonic power range is gradually reduced and finally the ultrasonic power becomes zero is remembered, so that it is easy to recognize the situation where transmission / reception is stopped. In the process of restarting the display of the ultrasonic image, an animation process for gradually increasing the display range may be applied. This can be pointed out in other examples as well, and if the animation process at the time of erasure is associated with the animation process at the time of resumption, a sudden change in display content can be avoided and a visually friendly display can be realized. Since ultrasonic diagnosis is generally performed in a dark room, gradual change in the amount of light gives a sense of security to the subject (patient).

  However, in order to shorten the examination time, it is desirable to give priority to the early restart of the display of the ultrasonic image. In order to reduce the burden on the processor during the blank period, it is desirable to adopt simple and effective animation processing. The above first to fifth examples meet such a requirement. It should be noted that a modification in which an ultrasonic image as a live image is not a basic image but a past ultrasonic image is a basic image is also conceivable. For example, a visual effect image may be generated by reproducing and processing a frame sequence on a cine memory. Furthermore, a modification in which an animation as an artificial moving image different from the ultrasonic image is prepared and displayed following the last frame is also conceivable. According to the processing examples shown in FIGS. 7 to 13, since the final frame is the basic image, the transition from the final frame to the visual effect image is smooth and natural. The effect can be sufficiently exerted.

  FIG. 14 shows a display layout change accompanying an operation condition change. Under the first operating condition, the one-screen display 150 is executed, and under the second operating condition, the two-screen display 152 is executed. In such a case, for example, the first example shown in FIG. 7 may be selected as the animation process. Reference numeral 158 represents movement of the target image. In the illustrated example, a B-mode image is displayed on the one-screen display 150, and a B-mode image 154 and a Doppler waveform 156 according to the PW mode are displayed on the two-screen display 152. It is desirable to configure so that an appropriate animation processing type is selected according to the layout change mode.

  FIG. 15 shows a case where the two-screen display is maintained when the operating condition is changed. A plurality of ultrasonic images displayed simultaneously are all updated. Specifically, two ultrasonic images 158 are displayed under the first operating condition, and two visual effect images 160 are displayed in the subsequent visual effect image display period. Thereafter, two ultrasound images 162 are displayed under the second operating condition. When the display layout is maintained and a plurality of ultrasonic images are updated, it is desirable to apply the same animation process to the ultrasonic images at the same time. Needless to say, an entire erasing process or the like over a plurality of ultrasonic images may be applied.

  FIG. 16 shows a case where the two-screen display is maintained when the operating condition is changed. However, of the two ultrasonic images displayed simultaneously, the right ultrasonic image is updated, but the still image display state is maintained for the left ultrasonic image. Specifically, the moving image and the still image 164 are displayed under the first operating condition, and the visual effect image and the still image 166 are displayed in the subsequent visual effect image display period. The second example shown in FIG. 8 is selected as the animation process. Thereafter, two ultrasound images 168 are displayed under the second operating condition. Since animation processing is applied to the ultrasonic image to be updated, conversely, since animation processing is not applied to the ultrasonic image to be maintained, it is intuitive whether it is an update target or not. Can be recognized.

  Next, some specific examples of the table referred to by the main controller shown in FIG. 1 will be described. In the table 170 shown in FIG. 17, the type and speed of animation processing as visual effects are associated with each diagnostic subject. When the diagnosis subject is determined, the type and speed are automatically determined from the diagnosis subject.

  In the table 172 shown in FIG. 18, animation processing periods as visual effects are associated with each diagnosis subject. When the diagnosis subject is determined, the period is automatically determined from the diagnosis subject. Other information may be used instead of or together with the diagnostic subject. For example, the type, period, etc. may be automatically determined according to the display layout change mode. When the blank period can be predicted from the number of parameters recalculated when the operation is changed, the amount of calculation, and the like, the animation period may be automatically set according to the blank period.

  In the table 174 shown in FIG. 19, the type of animation processing as a visual effect is associated with each operation mode change type. According to this, the type of animation processing is automatically determined according to the operation mode change type. It is desirable to prepare various tables and select the table to be used according to the situation. You may comprise so that the content of each table can be corrected by the user. Alternatively, it is possible to register animation processing conditions as part of the preset data.

  Next, some specific examples of the user interface (UI) used when selecting the animation processing condition will be described with reference to FIGS. Each UI is merely an example. The UI is displayed on the screen of the display in the ultrasonic diagnostic apparatus. The UI may be displayed on a display with a touch panel.

  FIG. 20 shows a UI 176 for selecting an animation type by the user. In the illustrated example, the UI 176 includes three symbols 178, 180, and 182. Symbol 178 represents a slide (change in position), symbol 180 represents a wipe (erase-type change in shape), and symbol 182 represents a feed-out (change in luminance). Individual symbols 178, 180, and 182 may be configured as moving images. Check boxes are provided in association with the individual symbols 178, 180, and 182.

  FIG. 21 also shows a UI 184 that performs the same function as described above. In the illustrated example, the UI 184 includes three character strings 186, 188, and 190 representing three types.

  FIG. 22 shows a UI 192 for designating the animation period (time length of the visual effect image) by the user. A number is entered in box 194 by the user, or a number is selected by the user from a pull-down menu.

  FIG. 23 shows another UI 196 for specifying the animation period by the user. It includes three numbers 200, 202 and 204 representing three specific periods. An animation period is selected by the user by selecting any check box. Note that the period until the target image disappears may be determined as the animation period, or may be determined as the animation period including the time during which the target image disappears.

  FIG. 24 shows still another UI 206 for user-designating an animation period. It includes three character strings 208, 210, and 212 that distinguish large, medium, and small. A UI for allowing the user to select a speed may be displayed. In addition, a UI for selecting a function that defines the rate of change may be displayed.

  FIG. 25 is a flowchart showing an operation example and control example of the apparatus shown in FIG. This process is started by a start instruction from the user (input to the operation panel) or satisfaction of a start condition (probe mounting or switching, optional device mounting, etc.). In S10, it is determined whether or not to end this process. For example, the present process is terminated when a termination instruction from the user or a termination condition is satisfied. In S12, it is determined whether or not there has been an operation condition change that requires a transmission / reception interruption. If there is such an operating condition change, it is determined in S14 whether a visual effect is necessary (whether display of a visual effect image is necessary). For example, when the user has selected whether or not it is necessary in advance, the user selection result is referred to in S14. Whether or not to provide a visual effect may be automatically determined according to a parameter amount to be updated (for example, a calculation amount), a type of display layout change, a type of operation condition change, and the like. For example, the necessity of the visual effect may be determined based on whether the calculation amount exceeds a threshold value. In that case, the threshold value may be set adaptively. In S16, a visual effect period (animation period) or a visual effect speed (animation speed) is set. In that case, a user's pre-selection result may be referred. Alternatively, the period or speed may be automatically determined by referring to the preset data. In S18, a visual effect type (animation type) is selected. In that case, a user's pre-selection result may be referred. Alternatively, the type may be automatically determined by referring to preset data. In S20, a frame constituting the visual effect image is generated and displayed. In that case, animation processing based on the basic image is applied. One visual effect image frame is created for each execution of step S20. In that case, the elapsed time or the frame number is referred to as necessary. Further, the change rate specified by the function is referred to as necessary. In S22, it is determined whether or not the condition for forcibly terminating the display of the visual effect image is satisfied. If the forcible termination condition is satisfied, the display of the visual effect image is terminated and S10 is executed. In S24, it is determined whether or not the present is within the display period (animation period) of the visual effect image. If it is within the period, the steps after S20 are repeatedly executed.

  According to the above-described embodiment, the temporally changing visual effect image derived from the basic image is displayed following the display of the final image under the previous operating condition, so that there is a feeling of boredom or stress in the blank period. Does not occur. Even if boredom or stress occurs, the degree can be kept low. In particular, since the final image and the visual effect image are displayed seamlessly, there is no sudden feeling at the time of image switching.

  FIG. 26 shows a modification of the animation process. This animation process provides a VE image that feels that transmission has stopped, as in the fifth example of the animation process. Specifically, the frame sequence from the frame indicated by (A) to the frame indicated by (H) is displayed as a VE image. In the illustrated example, reference numeral 200 indicates a sound source (wave source). This corresponds to the transmission / reception origin (vertex of the sector image) in the probe. Reference numeral 202 denotes an ultrasonic wavefront or an arrival area. In the first half of the animation process, the image grows deeper, and in the second half, the disappearance area of the image increases deeper, that is, the image gradually decreases. The VE image shown in FIG. 26 is generated based on an ultrasonic image. However, it is possible to generate the VE image as a CG image. The CG image includes a graphic indicating the sound source 200 and a graphic indicating the wavefront 202. According to the VE image shown in FIG. 26, it is possible to naturally recognize the situation of the stop of transmission while giving the viewer visual interest.

10 probe, 12 front end (FE) unit, 20 back end (BE) unit, 40 visual effect (VE) image generation unit, 44 display processing unit, 52 control unit, 56 graphic image generator.

Claims (10)

When there is a change in operating conditions that requires a transmission / reception interruption, the transmission / reception according to the first operating condition before the change is interrupted, and after preparations for transmitting / receiving waves according to the second operating condition after the change are completed, Operation control means for resuming transmission and reception; and
Visual effect image generating means for generating a temporally changing visual effect image based on a basic image included in an ultrasonic image formed under the first operating condition when the operating condition is changed When,
Display control means for controlling the visual effect image to be displayed within a blank period that occurs when the operating condition is changed;
An ultrasonic diagnostic apparatus comprising: The apparatus of claim 1.
The visual effect image is displayed subsequent to the final image displayed under the first operating condition;
An ultrasonic diagnostic apparatus. The apparatus of claim 2.
The base image includes the final image;
An ultrasonic diagnostic apparatus. The apparatus of claim 1.
The visual effect image generating means generates the visual effect image by an animation process based on the basic image;
An ultrasonic diagnostic apparatus. The apparatus of claim 4.
A plurality of types of processing are prepared as the animation processing,
A process to be actually used is selected from the plurality of types of processes.
An ultrasonic diagnostic apparatus. The apparatus of claim 4.
The animation process includes at least one of a process for gradually changing the position, a process for gradually changing the luminance, and a process for gradually changing the form.
An ultrasonic diagnostic apparatus. The apparatus of claim 1.
Graphic image generating means for generating a first graphic image based on the first operating condition and generating a second graphic image based on the second operating condition;
The first graphic image is displayed together with an ultrasound image formed under the first operating condition;
The second graphic image is displayed together with an ultrasound image formed under the second operating condition;
The display control means ends the display of the visual effect image before the start of display of the second graphic image;
An ultrasonic diagnostic apparatus. The apparatus of claim 7.
The second graphic image is displayed from the start of display of an ultrasonic image formed under the second operating condition or is displayed before that,
The display control means includes means for forcibly ending the display of the visual effect image at a reference time before the display start time of the second graphic image.
An ultrasonic diagnostic apparatus. The apparatus of claim 1.
Means for varying the display period of the visual effect image;
An ultrasonic diagnostic apparatus. A display method in an ultrasonic diagnostic apparatus,
When there is a change in operating conditions that requires a transmission / reception interruption, the transmission / reception according to the first operating condition before the change is interrupted, and after preparations for transmitting / receiving waves according to the second operating condition after the change are completed, Resuming transmission and reception; and
Displaying a first ultrasound image formed under the first operating condition;
Displaying a second ultrasound image formed under the second operating condition;
Displaying a temporally changing visual effect image that has been subjected to an animation process after displaying the first ultrasound image and before displaying the second ultrasound image;
A display method comprising: