JP5061306B2 - Client device, server device, and volume data transmission system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To display a high-quality image as much as possible when there are restrictions on an available transmission band obtained from a network side and a display request time that a user specifies. <P>SOLUTION: A client device includes: a transmission protocol determination section 201b which selects one of a file transmission type image transmission system and a partial transmission type image transmission system; a transmission request block determination section 201e which predicts a time needed to transmit volume data to be displayed when the partial transmission type image transmission system is selected, and determines maximum resolution for transmission and display within the predicted time; and a partial transmission block requesting/reception section 201f which requests a server device to transmit all of selected volume data when the file transmission type image transmission system is selected, and requests the server device to transmit volume data having the determined resolution to be displayed when the partial transmission type image transmission system is selected. <P>COPYRIGHT: (C)2010,JPO&amp;INPIT

Description

  The present invention is a technique for displaying a plurality of thumbnails (reduced images) within a user's requested time when medical volume data (three-dimensional image data) such as CT or MRI is used on a network. About.

  Conventionally, an encoding method using three-dimensional wavelet transform is known as compression of medical volume data. As an example, in JPEG 2000, which is an international standard for still image coding, studies on coding of three-dimensional volume data are in progress.

As a volume data transmission method, in addition to simple file transmission, a part of the above three-dimensional wavelet transform encoded file is transmitted and decoded on the receiving side, whereby a partial three-dimensional wavelet is transmitted. An image can be reproduced by reproducing the conversion coefficient and inversely transforming it. However, when only the wavelet transform coefficient corresponding to the low frequency component is sent, an image with a low resolution is reproduced. Further, when only a wavelet transform coefficient corresponding to a part of the image is sent spatially, a part of the image is reproduced.
Schelkens, P.M. Munteanu, A.M. Tzannes, A.M. Brislawn, C.I. “JPEG2000. Part 10. Volumetric data encoding”, Proceedings of IEEE International Symposium on Circuits and Systems, pp. 3874-3877, May. 2006.

  Since medical volume data acquired by CT and MRI has a huge amount of data, a delay occurs when they are used on the network. Even if encoding for compressing the amount of data is performed, it takes a lot of time to send all the data. Even if hierarchical coding is used to make hierarchies related to image quality, it is generally automatic if the volume data file to be sent, the number of images contained in it, and the quality hierarchy (resolution, etc.) to be transmitted are determined under the restriction of transmission bandwidth. The time required for data transmission and display is determined. When considering a medical application, it is considered that there is a display time for satisfying a request of a doctor who is a user of an image transmission apparatus. Even if the user specifies the display request time, the request may not be satisfied.

  The present invention has been made in view of such circumstances, and displays as high-quality images as possible under the conditions that there are restrictions on the available transmission band acquired from the network side and the display request time specified by the user. An object of the present invention is to provide a client device, a server device, and a volume data transmission system.

  (1) In order to achieve the above object, the present invention takes the following measures. That is, in the client device of the present invention, the client device requests the server device to transmit the volume data recorded on the recording medium, and the server device transmits the requested volume data to the client device. A client device applied to a volume data transmission system, a file selection unit for selecting volume data for which transmission is requested, and a predetermined standard as a method for acquiring the selected volume data from the server device A transmission protocol determination unit for selecting either a file transmission type image transmission method for transmitting all of the selected volume data or a partial transmission type image transmission method for transmitting a part of the selected volume data, The transmission protocol determination unit is the partial transmission type When an image transmission method is selected, a transmission request block determining unit that predicts a time required for transmitting volume data to be displayed and determines a maximum resolution that can be transmitted and displayed within the predicted time, and determines the transmission protocol. When the unit selects the file transmission type image transmission method, a request for transmitting all of the selected volume data is made to the server device, while the transmission protocol determination unit is configured to transmit the partial transmission type image transmission method. A transmission request unit that makes a request to the server device to transmit volume data to be displayed having the determined resolution.

  With this configuration, in the initial display of the thumbnail screen of the volume data display device, it is possible to display a thumbnail image with the highest possible resolution within the display request time set by the user.

  (2) In the client device of the present invention, the transmission protocol determination unit predicts a time required to transmit all of the selected volume data, and transmits all of the selected volume data within a requested time. When it is possible, the file transmission type image transmission method is selected, and when the selected volume data cannot be transmitted within the required time, the partial transmission type image transmission method is selected. Yes.

  With this configuration, it is possible to display thumbnail images with the highest possible resolution within the display request time set by the user.

  (3) Further, in the client device of the present invention, the transmission request block determination unit, when a region of interest (ROI) is set in the selected volume data, the volume included in the region of interest The transmission hierarchy is determined so that data is transmitted with higher resolution or higher bit accuracy than volume data not included in the region of interest.

  With this configuration, when the ROI is set in the volume data, the image in the ROI can be displayed with higher resolution.

  (4) Further, in the client device of the present invention, the transmission request block determination unit determines only volume data required for initial display among the selected volume data as a request target.

  With this configuration, there is no need to transmit an encoding block for an image that is not displayed at the time of initial display, and conversely, for an image to be displayed, more encoding blocks can be transmitted within the display request time. Higher resolution display is possible.

  (5) Further, in the client device of the present invention, the transmission request block determination unit makes a determination to request volume data required after initial display at the minimum resolution among the selected volume data. Yes.

  With this configuration, after the initial display, for example, even when a screen scroll operation is performed, thumbnails (volume data) with the lowest resolution can be instantaneously displayed for images other than the initial display image. As a result, it is possible to reduce the stress caused by the user being on standby.

  (6) In the client device of the present invention, after the transmission request block determination unit requests the minimum resolution volume data, the minimum resolution volume data in the background in response to a request from the user interface unit. It is characterized by making a decision to request the same volume data at a higher resolution.

  With this configuration, an image with a low resolution is initially displayed, but an image with a high resolution can be gradually displayed. As a result, it is possible to reduce the stress caused by the user being on standby.

  (7) Further, in the client device of the present invention, the transmission request unit measures a time when the selected volume data is transmitted / received to / from the server device, and the transmission request block determination unit Based on the measured time, the time required for transmitting the volume data to be displayed is predicted.

  With this configuration, since the transmission time measured in advance can be used, it is possible to quickly estimate the transmission time in the transmission request block determination unit.

  (8) Further, the server device of the present invention reads volume data from the recording medium in response to a request from the client device according to any one of claims 1 to 7, and stores the requested volume data. Either the file transmission type image transmission method for transmitting all or the partial transmission type image transmission method for transmitting a part of the requested volume data is used to transmit all or part of the volume data to the client device. It is a feature.

  With this configuration, in the initial display of the thumbnail screen of the volume data display device, it is possible to display a thumbnail image with the highest possible resolution within the display request time set by the user.

  (9) Further, the volume data transmission system of the present invention is characterized by comprising the client device according to any one of claims 1 to 7 and the server device according to claim 8.

  With this configuration, in the initial display of the thumbnail screen of the volume data display device, it is possible to display a thumbnail image with the highest possible resolution within the display request time set by the user.

  According to the present invention, in the initial display of the thumbnail screen of the volume data display device, it is possible to display a thumbnail image with the highest possible resolution within the display request time set by the user.

  In the present embodiment, in consideration of security and reliability, a medical-dedicated network in which the network side secures a transmission band necessary for transmission when an application starts communication is assumed. In this network, there is a possibility that the network bandwidth that can be used every time is different, but it is assumed that information on the transmission bandwidth that can be used almost in real time can be acquired from the network side.

  FIG. 1 is a diagram showing a schematic configuration of a volume data transmission system according to the present embodiment. The server device 100 and the client device 200 are connected via the network N. The server device 100 includes an encoding unit 101, a storage medium 102, and a server transmission unit 103. The client device 200 includes a client transmission unit 201, a decryption unit 202, and a display unit 203. The display unit 203 includes a user interface unit. The encoding unit 101 of the server apparatus 100 performs three-dimensional wavelet transform encoding on the volume data.

(3D wavelet transform)
Volume data is considered to be a plurality of sets of two-dimensional images (xy planar images: slice images). The direction in which slice images overlap is the z direction. In the three-dimensional wavelet transform, it is assumed that the xy direction wavelet transform shown in FIG. 2 and the z direction wavelet transform shown in FIG. 3 are performed on the volume data. In the three-dimensional wavelet transform coding, as shown in FIG. 4, the transform coefficients in the subband block subjected to the three-dimensional wavelet transform are divided into small-area rectangular parallelepiped blocks that are coding units. This rectangular parallelepiped block is called a coding block. For each coding block, a code is generated by entropy coding and the amount of information is compressed.

  A code corresponding to the low frequency subband in the xy direction is transmitted and decoded to reproduce the transform coefficient in the low frequency subband in the xy direction. By performing inverse wavelet transform on this in the z direction, an image including only the low frequency of xy, that is, an image having a low resolution is reproduced. As shown in FIG. 5, this can be used as a thumbnail (reduced image).

  By transmitting not only the lowest frequency component but also a higher frequency component, and similarly performing inverse wavelet transform in the z direction, and further performing inverse wavelet transform in the xy direction together with the low frequency component, further resolution is achieved. High thumbnails can be obtained.

(User interface of display device)
FIG. 6 shows a general user interface of a volume data display device such as CT and MRI. There is a screen that displays a plurality of images simultaneously on one screen, and this screen is called a thumbnail screen. Here, it is assumed that thumbnails are displayed as display images. As a general operation of the user, the range of the displayed thumbnail is changed by scrolling, or the image is enlarged by designating a specific thumbnail. Here, it is an object of the present invention to set a display request time required by a user in advance at the initial display of a thumbnail screen and complete the display of a thumbnail screen with a resolution as high as possible within that time. .

  As an image transmission method, a file transfer type image transmission method and a partial transmission type image transmission method are adaptively switched and used.

(File transfer type image transmission system)
In the file transfer type image transmission method, after all the code files of the target volume data are transferred, the code files are decoded, and the images are reproduced and displayed. In a general image system, this type of transmission display is performed. Since the transmission process and the decoding process can be separated, the implementation is simple. However, since the reproduction / display of the image is not performed until the transfer of the reproduction file is completed, it takes time until the display when the file size is large. In the volume data subjected to the above-described three-dimensional wavelet transform, all the CT images of the specific examination are collected into one file, so that one file size is large. For this reason, when the file transfer type image transmission method is used, it takes time for transmission, and it takes time to display.

  As described above, the file transfer type image transmission method can be used when a sufficient transmission band can be obtained or when a required display time is sufficiently long.

(Partial transmission type image transmission system)
In the partial transmission type image transmission system, only the necessary partial data in the file is transmitted instead of transmitting all the files stored in the server. Since only the partial data necessary for displaying the resolution and the portion to be displayed can be extracted and transmitted from the file stored in the server, the data transmission amount is reduced. .

  In the middle of the transmission before the transmission of all data requested by the user is completed, decoding is performed using only the data received by the client, thereby reproducing an image having a quality lower than the desired quality (resolution). it can. By repeating this reproduction process at certain time intervals, the received data increases at the timing of each reproduction process, so that it seems to the user that the quality of the image is hierarchically improved. Even if a low-quality image is displayed without waiting for a long time, the user's stress on the waiting time is reduced compared to a case where nothing is displayed until the final image quality is reached.

  As described above, the partial transmission type image transmission method is effective when a sufficient transmission band cannot be obtained or when the time required for thumbnail display is short.

  FIG. 7 is a block diagram showing a schematic configuration of the volume data transmission system according to the present embodiment. As shown in FIG. 7, the server transmission unit 103 includes a file information transmission unit 103a, a file transfer transmission unit 103b, a partial transmission block transmission unit 103c, and a block extraction unit 103d. The client transmission unit 201 includes a file selection unit 201a, a transmission protocol determination unit 201b, a parameter prediction / storage unit 201c, a file transfer request / reception unit 201d, a transmission request block determination unit 201e, and a partial transmission block request / reception unit 201f. It has. Hereinafter, a characteristic configuration of the volume data transmission system according to the present embodiment will be described.

(Transmission protocol determination unit 201b)
The transmission protocol determination unit 201b adaptively switches between the file transfer type image transmission method and the partial transmission type image transmission method, and enables the initial display of the image within the time requested by the user. In the present invention, it is determined whether the file transfer type or the partial transmission type should be transmitted before transmission.

First, the time required for transmission / display time in the file transfer type is estimated, and if it is shorter than the initial display request time specified by the user, transmission / display is performed in the file transfer type image transmission method. If it is longer than the time, transmission and display are performed by the partial transmission type image transmission method. In estimating the transmission / display time, it is assumed that the file transfer type image transmission processing is modeled and configured by the following processing.
(1) Transmission processing that is not direct image data transmission, such as command communication between server and client, etc. (2) Transmission processing of encoded image data (3) Decoding processing (4) Display processing Based on the above modeling, By this, the time (Ttotal) required to end transmission display in the usable transmission band is predicted before transmission.

Ttotal = Toh + Ttrans + Tdec + Tdisp (*)
here,
Toh: Overhead such as command communication
Ttrans: Time required for transmission of code data
= Total data amount / usable transmission bandwidth (Wa)
Tdec: Decoding time
Tdisp: display processing time.

The total data amount is collected in advance by the server that stores the files, and the information on the total data amount is transmitted from the server to the client before the client performs this time estimation process. The usable transmission band (Wa) is a transmission band of a transmission path actually acquired in the on-demand network, and is acquired before performing this time estimation (adaptive switching determination of the image transmission method). Although the decoding time (Tdec) varies greatly depending on the performance of the client, basically, the decoding time increases as the total data amount increases, so that it can be expected that the decoding time will also increase. Regarding the display time (Tdisp), this also varies greatly depending on the performance of the client (performance related to display hardware such as a video board and a display), but it can be expected to be very short compared to other times. In addition, overhead (Toh) such as command communication is considered to depend on the communication environment, the performance of the server, and the client. After the transmission time is estimated as described above, the display request time (Treq) of the user and Ttotal are compared to determine the transmission / display protocol.
If Treq ≥ Ttotal, file transfer type image transmission method
Partial transmission type image transmission system if Treq <Ttotal

  FIG. 8 shows the relationship between the Ttotal graph and the image transmission method. If Ttotal is a function of the available bandwidth, and the points that are plotted with the actually obtained available transmission bandwidth Wa and the user's display request time Treq are on that function, file transfer type image transmission Use the partial transmission type image transmission method if it is below.

  The time (Ttrans) required to transmit the code data can be estimated if the transmission band and the amount of data to be transmitted are known, but the actual throughput may be slightly different from the designated transmission band value. This issue will be discussed in the next section. Also, it is necessary to accurately estimate the time other than Ttrans.

(Parameter prediction / storage unit 201c)
The adaptive image transmission method as described above requires highly accurate estimation of the transmission time. In general, the transmission time and the transmission band are inversely related, but the actual throughput may be slightly different from the designated transmission band. Therefore, the transmission time is obtained in advance using dummy data under some conditions, and when the image is actually transmitted, the transmission time is predicted by nonlinear prediction based on this information.

  Nonlinear prediction is performed by the Marquardt method using the following equation as a prediction equation. The Marquardt method is a compromise between the steepest descent method and the Gauss-Newton method. When the estimated variable is far from the solution and the influence of nonlinearity is large, the steepest descent method is estimated. -It is an estimation method that is Newton's method of estimation.

ここで、Transはデータの伝送時間、Ｗはオンデマンド型ネットワークで設定された伝送帯域、Ｌは伝送するデータ量、Ａ，Ｂ，…，Ｅは定数である。ＷとしてＷ１，Ｗ２，…，ＷＭ（ｂｉｔ／ｓｅｃ）のＭ種類、ＬとしてＬ１，Ｌ２，…，ＬＮ（バイト）のＮ種類の計Ｍ×Ｎ種類の条件において、それぞれ複数回ずつ伝送を行ない、サンプルデータを取得する。これらのサンプルデータから、非線形予測によりＡ，Ｂ，…，Ｅを決定する。これにより、求まった定数により伝送時間を予測することができる。

Here, Trans is the data transmission time, W is the transmission band set in the on-demand network, L is the amount of data to be transmitted, and A, B,..., E are constants. Transmission is performed a plurality of times under the conditions of M types of W1, W2,..., WM (bit / sec) as W and N types of L1, L2,. Get sample data. From these sample data, A, B,..., E are determined by nonlinear prediction. As a result, the transmission time can be predicted from the obtained constant.

  However, here, it is assumed that the transmission band of the network is stationary. In other words, it is assumed that the transmission characteristics of the network are almost equal between the preliminary measurement and the actual data transmission. This assumption often does not hold in a general Internet environment where various communication connections are established in response to individual requests. On the other hand, in consideration of security and reliability, all communication connections are managed in a medical-dedicated network where the network side secures the necessary transmission bandwidth when the application starts communication. .

  In other words, once the bandwidth can be secured, it can be considered that the state of the transmission bandwidth is almost steady unless it is subsequently influenced by other communications such as an interruption request. When the core network becomes complicated and passes through a network with a large number of core routers, the route may differ depending on the timing at which the connection is established. Can be calculated automatically.

  Furthermore, the time taken for actual transmission is fed back, and the parameters are updated with the information, thereby improving the prediction accuracy.

(Transmission request block determination unit 201e)
(1) Determination of transmission layer In the partial transmission type, not all image file data is transmitted, but only low frequency components necessary for thumbnail display are transmitted. Here, when the initial display time is determined by the user, a method of determining an image with the maximum resolution that can be transmitted and displayed within that time is shown. Specifically, the thumbnail transmission time at each resolution is estimated, and the maximum resolution among the resolutions of thumbnails that can be transmitted and displayed within the requested time is determined. To estimate the thumbnail transmission time at each resolution, the same time estimation method as in the previous section is used. At this time, instead of the total data amount (Wa), the code data amount necessary for decoding the image of each layer (resolution) is used. This amount of data is stored in advance in the server, and before the client performs this time estimation process (thumbnail resolution determination process), information on the data amount of each layer is transmitted from the server to the client.

For example, an estimated time for transmission display of a thumbnail of resolution 64 pixels × 64 pixels is Ttotal64, an estimated time of transmission display of a thumbnail of resolution 128 pixels × 128 pixels is Ttotal128, and an estimated time of transmission display of a thumbnail of resolution 256 pixels × 256 pixels Let Ttotal256 be the following inequality:
Ttotal64 <Ttotal128 <Ttotal256
An image whose estimated transmission display time is shorter than the initial image display time Treqg requested by the user and whose thumbnail resolution is large is set as an initial display image. This selection is shown in FIG.

(2) Transmission of only display target images The number of images that can be displayed on the thumbnail display screen at a time is limited (about 10 to 20 and so on), and it is generally impossible to display all images of volume data. Therefore, only a coding block necessary for reproducing an image displayed at the time of initial display is set as a transmission block. There is no need to send coding blocks for images that are not displayed at the time of initial display. Conversely, for images to be displayed, more coding blocks can be sent within the display request time and display at a higher resolution. Is possible.

(3) Transmission of images not subject to initial display However, if information on images that are not displayed at the time of initial display is not sent at all, the user performs a scroll operation after initial display and tries to view thumbnails of other images. At that time, no image can be displayed, and a new encoded block must be transmitted from the server. As a result, the thumbnail display is delayed, which may cause stress to the user. Therefore, only the lowest frequency subbands of all the images are sent even for images that are not initially displayed.

  Using this lowest frequency subband, a thumbnail image with the lowest resolution is created for images that are not initially displayed. Thereby, even when a scroll operation is performed after the initial display, thumbnails with the lowest resolution can be displayed instantaneously for images other than the initial display image, and the stress on the user can be kept low. When the scroll operation is performed, the lowest resolution thumbnail is displayed, and at the same time, transmission of a higher frequency component of the new display target image is started in the background, transmission / decoding is completed, and the higher resolution thumbnail is displayed. As soon as it is created, the high-resolution thumbnail is displayed.

(4) ROI Transmission Hierarchy Determination As shown in FIG. 10, a region of interest (ROI) may be set in an image. In this case, ROI position information is recorded as header information of the encoded file. From this information, it can be calculated which coding block corresponds to the ROI. FIG. 11 shows a conceptual diagram of a coding block corresponding to ROI. Since the image in the ROI has all the frequency components, actually, the coding blocks corresponding to the ROI exist in all the subbands.

  The hierarchy to be transmitted is controlled depending on whether the encoded block is included in the ROI or not. The maximum resolution that can be transmitted to the ROI is obtained from the code amount information of each coding block that is known in advance within the range where the transmission / display ends at the display request time, and the low resolution component of the area other than the ROI in the remaining time Is transmitted.

(File transmission)
FIG. 12 shows a conceptual diagram of file transfer type image transmission processing. The file transfer request / reception unit 201d of the client device 200 issues a file transfer request to the server device 100, and the file transfer transmission unit 103b of the server device 100 transmits a corresponding file.

(Partial transmission)
FIG. 13 shows a conceptual diagram of partial transmission processing. The transmission request block determined by the transmission request block determination unit 201e is requested to be transmitted from the partial transmission block request / reception unit 201f of the client device 200 to the partial transmission block transmission unit 103c of the server device 100. In the server apparatus 100, based on the received request, the block extraction unit 103d extracts the requested encoded block from the storage medium 102. Header information is added to the extracted encoded block so that the position of the encoded block in the wavelet transform coefficient region can be identified, and the partial transmission block transmission unit 103c sends the header block information to the partial transmission block request / reception unit 201f of the client device 200. Send to. The partial transmission block request / reception unit 201 f of the client device 200 receives the encoded blocks and transfers them to the decoding unit 202. The decoding unit 202 decodes the wavelet transform coefficient, arranges it at an appropriate coefficient position in the wavelet transform coefficient area based on the header information, performs inverse transform, and reproduces the image.

  If the coding block is small, request processing, extraction processing, header addition, and transmission / reception must be performed for a large number of coding blocks, which may increase the processing load. Therefore, the processing amount can be reduced by combining a plurality of encoded blocks into one transmission unit and performing the processing as the minimum unit for performing the above processing.

  FIG. 14 is a flowchart showing the operation of the volume data transmission system according to this embodiment. First, the file selection unit 201a and the file information transmission unit 103a shown in FIG. 7 designate an image file including volume data (step S1). Next, the transmission protocol determination unit 201b and the parameter prediction / storage unit 201c predict the time required to transmit the designated image file (step S2). Then, it is determined whether or not the image file can be transmitted within “request time” requested by the user (step S3). If it is determined that the image file can be transmitted within the requested time, the file transfer transmitting unit 103b and the file transfer request / reception unit 201d request and transfer the image file by the file transfer type image transmission method. (Step S4). In the client device 200, the received image file is decoded by the decoding unit 202 (step S5), and the image file (volume data) is displayed on the display unit 203 (step S6).

  On the other hand, if it is determined in step S3 that the image file cannot be transmitted within the required time, it is determined whether ROI is set in the volume data (step S7). If ROI is set in the volume data, the transmission request block determination unit 201e determines ROI and non-ROI transmission layers (step S8). On the other hand, if the ROI is not set in the volume data in step S7, the transmission request block determining unit 201e determines the transmission layer (step S9), and the partial transmission block transmitting unit 103c and the partial transmission block request / reception. The unit 201f requests and transfers an image file by the partial transmission type image transmission method (step S10). In the client device 200, the received image file is partially decoded by the decoding unit 202 (step S11), and the image file (volume data) is displayed on the display unit 203 (step S6).

  As described above, according to the present embodiment, in the initial display of the thumbnail screen of the volume data display device, it is possible to display a thumbnail image with the highest possible resolution within the display request time set by the user. Further, when the ROI is set, it is possible to display an image in the ROI with higher resolution. Furthermore, scrolling after the initial display of the thumbnail screen can be performed at high speed by transmitting the lowest resolution image of an image other than the image displayed at the initial display of the thumbnail screen.

It is a figure which shows schematic structure of the volume data transmission system which concerns on this embodiment. It is a figure which shows the mode of the wavelet transformation of xy direction. It is a figure which shows the mode of the wavelet transformation of az direction. It is a figure which shows a mode that the transform coefficient in the subband block by which the three-dimensional wavelet transform was carried out is divided | segmented into the rectangular block of the small area | region which is an encoding unit. It is a figure which shows a mode that the image containing only the low frequency of xy is reproduced | regenerated by carrying out the inverse wavelet transform to the z direction of the conversion factor in the low frequency subband of xy direction. It is a figure which shows the general user interface of volume data display apparatuses, such as CT and MRI. It is a block diagram which shows schematic structure of the volume data transmission system which concerns on this embodiment. It is a figure which shows the relationship between the graph of Ttotal, and selection of an image transmission system. It is a figure which shows a mode that the estimated transmission display time is shorter than the initial image display time Treqg, and the thumbnail resolution among them is used as the initial display image. It is a figure which shows a mode that the attention area (Region Of Interest: ROI) is set to the image. It is a figure which shows the concept of the encoding block corresponding to ROI. It is a figure which shows the concept of a process of file transfer type image transmission. It is a figure which shows the concept of the process of partial transmission. It is a flowchart which shows operation | movement of the volume data transmission system which concerns on this embodiment.

Explanation of symbols

DESCRIPTION OF SYMBOLS 100 Server apparatus 101 Encoding part 102 Storage medium 103 Server transmission part 103a File information transmission part 103b File transfer transmission part 103c Partial transmission block transmission part 103d Block extraction part 200 Client apparatus 201 Client transmission part 201a File selection part 201b Transmission protocol determination part 201c Parameter prediction / storage unit 201d File transfer request / reception unit 201e Transmission request block determination unit 201f Partial transmission block request / reception unit 202 Decoding unit 203 Display unit

Claims (8)

Client applied to a volume data transmission system in which a client device requests transmission of volume data recorded on a recording medium to a server device, and the server device transmits the requested volume data to the client device A device,
A file selector for selecting volume data to be transmitted;
As a method for acquiring the selected volume data from the server device, a file transmission type image transmission method for transmitting all of the selected volume data based on a predetermined standard or one of the selected volume data. A transmission protocol determination unit for selecting one of the partial transmission type image transmission methods for transmitting the unit;
When the transmission protocol determination unit selects the partial transmission type image transmission method, the transmission time predicts the time required to transmit the volume data to be displayed, and determines the maximum resolution that can be transmitted and displayed within the predicted time. A request block determination unit;
When the transmission protocol determination unit selects the file transmission type image transmission method, the transmission protocol determination unit requests the server device to transmit all of the selected volume data, while the transmission protocol determination unit performs the partial transmission. A transmission request unit for requesting the server device to transmit volume data to be displayed having the determined resolution when the selected type image transmission method is selected ,
The transmission request block determination unit determines only the volume data required for initial display among the selected volume data as a request target . Client applied to a volume data transmission system in which a client device requests transmission of volume data recorded on a recording medium to a server device, and the server device transmits the requested volume data to the client device A device,
A file selector for selecting volume data to be transmitted;
As a method for acquiring the selected volume data from the server device, a file transmission type image transmission method for transmitting all of the selected volume data based on a predetermined standard or one of the selected volume data. A transmission protocol determination unit for selecting one of the partial transmission type image transmission methods for transmitting the unit;
When the transmission protocol determination unit selects the partial transmission type image transmission method, the transmission time predicts the time required to transmit the volume data to be displayed, and determines the maximum resolution that can be transmitted and displayed within the predicted time. A request block determination unit;
When the transmission protocol determination unit selects the file transmission type image transmission method, the transmission protocol determination unit requests the server device to transmit all of the selected volume data, while the transmission protocol determination unit performs the partial transmission. A transmission request unit for requesting the server device to transmit volume data to be displayed having the determined resolution when the selected type image transmission method is selected ,
The transmission request block determination unit determines a request for volume data required after initial display from the selected volume data at a minimum resolution . The transmission protocol determining unit predicts a time required to transmit all of the selected volume data, and when the selected volume data can be transmitted within a requested time, the file transmission type image transmission 3. The client device according to claim 1, wherein the partial transmission type image transmission method is selected when not all of the selected volume data can be transmitted within a requested time while the method is selected. . When the region of interest (ROI) is set in the selected volume data, the transmission request block determination unit determines that the volume data included in the region of interest is not included in the region of interest. 4. The client device according to claim 1, wherein a transmission layer is determined so that transmission is performed with higher resolution or higher bit accuracy. The transmission request block determination unit requests the volume data having the lowest resolution after requesting the volume data having the lowest resolution and requests the same volume data as the volume data having the lowest resolution in the background in response to a request from the user interface unit. The client device according to claim 2, wherein: The transmission request unit measures a time when the selected volume data is transmitted to and received from the server device;
6. The client according to claim 1, wherein the transmission request block determination unit predicts a time required for transmitting the volume data to be displayed based on the measured time. apparatus. 7. A file transmission type image transmission method or request for reading volume data from the recording medium and transmitting all of the requested volume data in response to a request from the client device according to claim 1. A server apparatus that transmits all or part of volume data to the client apparatus in one of the partial transmission type image transmission systems for transmitting a part of the volume data. A client device according to any one of claims 1 to 6 ;
A volume data transmission system comprising the server device according to claim 7 .

Images