CN115394453B - Intelligent management system and method based on medical scientific research data in cloud computing environment - Google Patents

Abstract

The invention belongs to the technical field of scientific research data management, and particularly relates to an intelligent management system and method for medical scientific research data in a cloud computing environment. The system comprises a data downloading control end and a local database, wherein the data downloading control end is connected with a data demand end, a retrieval system, a data pushing system, a data downloading tool and an authentication key management system; the retrieval system and the data pushing system are respectively connected with a local database; the data downloading control terminal is further connected to the source data storage terminal through the cloud downloading node pool. The invention further provides a method for retrieving, downloading and storing data by using the system. The invention has the advantages of improving the downloading and using efficiency of data, reducing the downloading time and the waste of network resources and ensuring the data security, and has good application prospect in the field.

Description

Intelligent management system and method for medical scientific research data based on cloud computing environment

technical field

The invention belongs to the technical field of scientific research data management, and in particular relates to an intelligent management system and method for medical scientific research data based on a cloud computing environment.

Background technique

With the increase of scientific and technological exchanges at home and abroad, the sharing of international scientific research data has also become an increasing trend year by year. With the wide application of information technology in various fields. At present, the download volume of a public scientific research dataset often reaches tens to hundreds of terabytes.

The traditional method of downloading scientific research data is to purchase a long-term proprietary operator network, and then conduct on-site debugging by the operator's technicians. This method is expensive, inflexible, requires a long time for network deployment, and network resources cannot meet scientific research needs. Perform real-time monitoring and intelligent adjustments. And because scientific research projects are independent of each other, there are often repeated configurations of download environments and repeated downloads of data, resulting in a waste of time and network resources.

Based on the above reasons, sharing scientific research data within a certain range is a promising idea. However, inconsistencies in data management methods between different scientific research projects, and inconsistent database permissions purchased by different research groups have caused problems such as difficulties in sharing scientific research data and poor data sharing security. Therefore, there is an urgent need in this field for a system for unified management of retrieval, download and sharing of scientific research data to overcome difficulties in scientific research data sharing.

Contents of the invention

Aiming at the problems of the prior art, the present invention provides an intelligent management system and method for medical scientific research data based on a cloud computing environment, with the purpose of realizing efficient and safe scientific research data sharing and reducing the time and network resources used for downloading data.

An intelligent management system for medical scientific research data based on a cloud computing environment, which includes a data download control terminal and a local database. The data download control terminal is connected to a data demand terminal, a retrieval system, a data push system, a data download tool key management system; the retrieval system and the data push system are respectively connected to the local database; the data download control end is also connected to the source data storage end through the cloud download node pool;

in,

The data demand terminal is used to send the user's data usage requirements to the data download control terminal;

The retrieval system is used to retrieve the local database according to the data use requirements;

The data push system is used to transfer the source data downloaded in the cloud download node pool to the local database;

The data download tool and the authentication key management system are used to encapsulate the requirement of downloading data from the source data storage terminal in the data usage requirement.

Preferably, the data download control terminal is used for:

1) Call the retrieval system according to the data usage requirements;

2) When the retrieval system retrieves successfully, it returns the retrieval result to the data demand side;

Or, when the retrieval system fails to retrieve, push the data usage requirements to the data download tool and authentication key management system;

3) The download container environment obtained after invoking the data download tool and the authentication key management system package is distributed to the cloud node servers in different geographical regions in the cloud download node pool, and receives the connection duration obtained from the test of each cloud node server;

4) Match the best download cloud node server and the best download network speed according to the user's planned download data time and the connection time of each cloud node server;

5) Push the matching cloud node server and download directory information to the data push system.

Preferably, there are at least two data download control terminals, and a user authentication system is set between the data demand terminal and the data download control terminal, and the user authentication system is used for security authentication of users.

Preferably, the data usage requirements include at least one of the following information: data set name, scientific research data type, system environment information required for scientific research data, download data source address, specified download tool and authentication key in the scientific research data set , Whether the downloaded data is public or specify the time point when the user discloses and plans to use the downloaded data.

Preferably, the data push system transfers the source data downloaded from the cloud download node pool to a corresponding type of database according to the type of scientific research data.

Preferably, the data push system sets the open permission range of the downloaded data according to whether the downloaded data is disclosed or the information disclosed by a designated user.

Preferably, the data download tool and the authentication key management system encapsulate the data usage requirements through container technology.

Preferably, the local databases include medical electronic case databases, medical imaging databases and genomics databases.

The present invention also provides an intelligent management method for medical scientific research data based on a cloud computing environment, which uses the above-mentioned intelligent management system for medical scientific research data based on a cloud computing environment to download and store data, and specifically includes the following steps:

Step 1, the data demand end is used to send the user's data usage demand to the data download control end;

Step 2, the data download control terminal invokes the retrieval system to retrieve the local database according to the data use requirements;

Step 3, when the retrieval system fails to retrieve, push the data usage requirement to the data download tool and authentication key management system;

Step 4, the data download tool and the authentication key management system encapsulate the data usage requirements;

Step 5, the data download control terminal distributes the encapsulation results of the data usage requirements to the cloud node servers in different geographic regions in the cloud download node pool, and tests the connection duration of each cloud node server;

Step 6, the data download control terminal matches the best download cloud node server and the best download network speed according to the user's planned download data time and the connection duration of each cloud node server;

Step 7: Push the matched cloud node server and download directory information to the data push system, and the data push system transfers the downloaded source data from the cloud node server and its download directory to a local database.

The present invention also provides an intelligent management method for medical scientific research data based on a cloud computing environment, which uses the above-mentioned intelligent management system for medical scientific research data based on a cloud computing environment to perform data retrieval, and specifically includes the following steps:

Step A, the data demand end is used to send the user's data usage demand to the data download control end;

Step B, the data download control terminal invokes the retrieval system to retrieve the local database according to the data usage requirements;

Step C, when the retrieval system successfully retrieves, return the retrieval result to the data demand side.

The system of the invention uniformly stores and retrieves scientific research data downloaded by users within a certain range, avoids repeated downloading of the same scientific research data set, and improves the use efficiency of scientific research data. In a preferred solution, the present invention can also achieve: 1. Through the link automatic selection function, the optimal transfer download server can be automatically matched according to the download link address and user data plan usage time, thereby improving the download speed of scientific research data At the same time, it also reduces the cost of cloud network bandwidth usage. 2. By encapsulating the download environment, download tool and key, the automatic deployment of the download environment is realized, so as to realize the repeatable download of the same data set, reduce the workload of operation and maintenance personnel, and improve the download efficiency. 3. Through the access authority setting of scientific research data, the control of user access data is realized to prevent the leakage of scientific research data.

It can be seen that the present invention has the advantages of improving data download and use efficiency, reducing download time and waste of network resources, and ensuring data security, and has a good application prospect in this field.

Apparently, according to the above content of the present invention, according to common technical knowledge and conventional means in this field, without departing from the above basic technical idea of the present invention, other various forms of modification, replacement or change can also be made.

The above-mentioned content of the present invention will be further described in detail below through specific implementation in the form of examples. However, this should not be construed as limiting the scope of the above-mentioned subject matter of the present invention to the following examples. All technologies realized based on the above contents of the present invention belong to the scope of the present invention.

Description of drawings

Fig. 1 is a schematic flow chart of Embodiment 1 of the present invention.

Detailed ways

It should be noted that the algorithms for the steps of data collection, transmission, storage and processing not specifically described in the embodiments, as well as the hardware structures and circuit connections not specifically described can be realized by the disclosed content of the prior art.

Embodiment 1 An intelligent management system and method based on medical scientific research data in a cloud computing environment

The system structure of the present embodiment is shown in Figure 1, and specifically includes a data download control terminal, a data demand terminal, a retrieval system, a data push system, a data download tool and an authentication key management system, and a local database. The data download control terminals are respectively Connect with data demand side, retrieval system, data push system, data download tool and authentication key management system. The retrieval system and the data push system are respectively connected to the local database. A user authentication system is set between the data demand end and the data download control end.

Among them, there may be multiple data demand ends (data demand end A, data demand end B, and data demand end C shown in FIG. 1 ), corresponding to different users. The local database can be provided with multiple sub-databases according to data types. In this embodiment, the local database includes a medical electronic case database, a medical imaging database and a genomics database.

The data download control terminal is also connected to the source data storage terminal through the cloud download node pool. The cloud download node pool consists of multiple cloud node servers (cloud node 1, cloud node 2, and cloud node 3 shown in Figure 1). The scientific research data downloaded in this embodiment comes from the source data storage terminal.

所示。具体的：Using the above system, the process of retrieval, download and storage of scientific research data can be realized, and the steps are as shown in step ①-step in Figure 1

shown. specific:

Step 1: After passing the security authentication of the user authentication system, the user at the data demand end submits a data usage demand to the "data download control end" (step ①). The "data download control terminal" calls the "retrieval system" to retrieve the required data from the "medical electronic case database", "medical imaging database" and "genomics database" respectively (step ②). After the retrieval is successful, the retrieval result is returned to the "data demand end" (step ⑨)

Step 2: If the demand data of the "data demand end" user is not retrieved by the system. You need to fill in (or upload) the following download information in the data usage requirements: dataset name, scientific research data type, system environment information required for scientific research data, download data source address (or upload the specified download tool and authentication password in the scientific research data set) Key), set whether the downloaded data is public or specify the user to make it public, and the time point when the downloaded data is planned to be used. The data download control terminal sends the above information to the data download tool and authentication key management system (step ④), encapsulates the relevant requirements through container technology, and adds them to the user's data list page to be downloaded.

Step 3: The data download control terminal invokes the encapsulated download container environment (step ⑤), and distributes it to cloud node servers in different geographic regions in the cloud download node pool (step ⑥), and each cloud node server tests to the source data storage The terminal downloads the connection time and feeds back the result of the connection time to the data download control terminal (step ⑦). The data download control end matches the best cloud node server and the best download network speed according to the user's planned download data time and the download speed of each cloud node server. Generate a temporary data storage directory under the node server, and start data download (step ⑧).

Step 4: The data download control terminal pushes the best cloud node server information and download directory information to the "data push system" (step ⑩).

Step 5: After the data push system downloads the data from the download directory of the specified cloud node server, delete the downloaded data on the cloud node server, and transfer the downloaded data to different types of scientific research databases according to the type of scientific research data filled in by the user. Update the data list in the retrieval system, and set the open permission range of the downloaded data according to whether the downloaded data filled in by the user is public or the designated user is public (step ⑪).

Step 6: After the download of scientific research data is completed, the user retrieves and downloads the data through the method of "Step 1".

It can be seen from the above embodiments that the present invention provides an intelligent management system for scientific research data and methods for data retrieval, download and storage using the system. The system can share locally stored data and avoid repeated downloads of data; by encapsulating the download environment, download tools and keys, the automatic deployment of the download environment is realized, reducing the workload of operation and maintenance personnel and improving download efficiency; Rights management to ensure the security of data sharing. Therefore, the system and method provided by the present invention have good application prospects in scientific research data management.

Claims (9)

1. An intelligent management system based on medical scientific research data under cloud computing environment, which is characterized in that: the system comprises a data downloading control end and a local database, wherein the data downloading control end is connected with a data demand end, a retrieval system, a data pushing system, a data downloading tool and an authentication key management system; the retrieval system and the data pushing system are respectively connected with a local database; the data downloading control terminal is also connected to the source data storage terminal through a cloud downloading node pool;

wherein,

the data demand end is used for sending data use demands of users to the data download control end;

the retrieval system is used for retrieving the local database according to the data use requirement;

the data pushing system is used for transferring the source data downloaded from the cloud downloading node pool to a local database;

the data downloading tool and the authentication key management system are used for packaging the data use requirement which needs to be downloaded from the source data storage end;

the data download control terminal is used for:

1) Calling a retrieval system according to the data use requirement;

2) When the retrieval system is successful in retrieval, returning a retrieval result to the data demand end;

or, when the retrieval system is unsuccessful, pushing the data use requirement to the data downloading tool and the authentication key management system;

3) Calling the download container environment obtained after the data download tool and the authentication key management system are packaged to distribute to cloud node servers in different geographic areas in a cloud download node pool, and receiving connection duration obtained by testing of each cloud node server;

4) Matching the optimal downloading cloud node server and the optimal downloading network speed according to the data using time planned by the user and the connection duration of each cloud node server;

5) And pushing the matched cloud node server and the downloading directory information to the data pushing system.

2. The intelligent management system based on medical research data in cloud computing environment according to claim 1, characterized in that: the number of the data downloading control terminals is at least two, and a user authentication system is arranged between the data demand terminal and the data downloading control terminal and is used for carrying out safety authentication on a user.

3. The intelligent management system based on medical research data in cloud computing environment according to claim 1, characterized in that: the data usage requirement includes at least one of the following information: the name of the data set, the type of the scientific research data, system environment information required by the scientific research data, a source address of the downloaded data, a downloading tool and an authentication key appointed in the scientific research data set, whether the downloaded data is public or an appointed user is public, and a time point when the downloaded data is planned to be used.

4. The intelligent management system based on medical research data in cloud computing environment according to claim 3, characterized in that: and the data pushing system is used for transferring the source data downloaded from the cloud downloading node pool to the database of the corresponding type according to the scientific research data type information.

5. The intelligent management system based on medical research data in cloud computing environment according to claim 3, characterized in that: and the data push system sets the open authority range of the downloaded data according to the information about whether the downloaded data is disclosed or the information about the disclosure of the appointed user.

6. The intelligent management system based on medical research data in cloud computing environment according to claim 1, characterized in that: and the data downloading tool and the authentication key management system package the data use requirement through a container technology.

7. The intelligent management system based on medical research data in cloud computing environment according to claim 1, characterized in that: the local database includes a medical electronic case database, a medical image database, and a genomics database.

8. An intelligent management method based on medical scientific research data in a cloud computing environment is characterized by comprising the following steps: the intelligent management system based on medical scientific research data in the cloud computing environment is applied to download and store the data, and comprises the following steps:

step 1, the data demand end is used for sending data use demands of users to the data download control end;

step 2, the data download control terminal calls the retrieval system and retrieves a local database according to the data use requirement;

step 3, when the retrieval system is unsuccessful in retrieval, pushing data use requirements to the data downloading tool and the authentication key management system;

step 4, the data downloading tool and the authentication key management system package the data use requirement;

step 5, the data downloading control terminal distributes the encapsulation result of the data use requirement to cloud node servers in different geographic area areas in a cloud downloading node pool, and tests the connection duration of each cloud node server;

step 6, the data downloading control terminal matches the optimal downloading cloud node server and the optimal downloading network speed according to the data downloading time used by the user plan and the connection duration of each cloud node server;

and 7, pushing the matched cloud node server and the download directory information to the data pushing system, and transferring the source data downloaded from the cloud node server and the download directory thereof to a local database by the data pushing system.

9. An intelligent management method based on medical scientific research data in a cloud computing environment is characterized by comprising the following steps: the method is used for retrieving data by applying the intelligent management system based on medical scientific research data in the cloud computing environment according to any one of claims 1 to 7, and specifically comprises the following steps:

step A, the data demand end is used for sending data use demands of users to the data download control end;

b, the data downloading control terminal calls the retrieval system and retrieves a local database according to the data use requirement;

and C, when the retrieval system is successful in retrieval, returning the retrieval result to the data demand end.

Images