CN107728939A - I O scheduling method, apparatus, equipment and storage medium based on Linux - Google Patents

Abstract

The invention discloses a Linux-based IO scheduling method, which includes the following steps: monitoring the read operation in the queue through the first process; if the first process monitors the read cache operation, sending data back to the second process to start writing message to cause the second process to start writing the data back to disk. Applying the technical solution provided by the embodiment of the present invention, when there is a read cache operation, it indicates that the data is read in the cache. In this case, the second process starts the operation of writing data back to the disk without affecting the read performance. At the same time, the data in the cache can be written back to the disk in time, reducing the probability of data loss. The invention also discloses a Linux-based IO scheduling device, equipment and storage medium, which have corresponding technical effects.

Description

IO scheduling method, device, equipment and storage medium based on Linux

technical field

The invention relates to the field of computer application technology, in particular to a Linux-based IO scheduling method, device, equipment and storage medium.

Background technique

With the rapid development of computer technology, various application systems based on Linux are gradually increasing. Most Linux systems use the IO scheduling algorithm to reorder the disk IO operations of the process, and the fair and effective implementation of the IO scheduling algorithm has a great impact on the improvement of the performance of the Linux system.

Currently, in the Linux system, the commonly used IO scheduling method is the AS (Anticipatory, anticipation) algorithm. The algorithm is to read the data from the cache first when the data needs to be read. When there is no data to be read in the cache, the IO operation is performed to read the disk; when the data needs to be written, the data to be written is written first. In the cache, when the free memory is lower than the threshold, the data is written back to the disk.

This method has certain disadvantages. After data is written into the cache, if the memory is free after waiting for a long time and still not lower than the threshold, the data cannot be written back to the disk, which may lead to data loss, that is, the probability of data loss is high.

Contents of the invention

The purpose of the present invention is to provide a Linux-based IO scheduling method, device, equipment, and storage medium, so as to write data back into a disk in time and reduce the probability of data loss.

In order to solve the above technical problems, the present invention provides the following technical solutions:

A Linux-based IO scheduling method, comprising:

Monitor the read operations in the queue through the first process;

If the first process monitors the read cache operation, it sends a data write-back start message to the second process, so that the second process starts an operation of writing data back to the disk.

In a specific embodiment of the present invention, it also includes:

If the first process detects a disk read operation, it sends a data write-back pause message to the second process, so that the second process suspends the operation of writing data back to the disk.

In a specific embodiment of the present invention, it also includes:

If the first process does not detect any read operation, then send the data write-back start message to the second process, so that the second process starts an operation of writing data back to the disk.

In a specific implementation manner of the present invention, before the first process monitors the read operation in the queue, it also includes:

The first process is started when a set time interval is reached.

In a specific implementation manner of the present invention, the monitoring of the read operation in the queue by the first process includes:

Within the preset monitoring duration, the first process monitors the read operations in the queue.

A Linux-based IO scheduling device, comprising:

A monitoring module, configured to monitor the read operations in the queue through the first process;

The first message sending module is configured to send a data write-back start message to the second process when the first process detects a read cache operation, so that the second process starts an operation of writing data back to the disk.

In a specific embodiment of the present invention, it also includes:

The second message sending module is configured to send a data write-back pause message to the second process when the first process detects a disk read operation, so that the second process suspends the operation of writing data back to the disk.

In a specific implementation manner of the present invention, the first message sending module is also used for:

When the first process does not detect any read operation, send the data write-back start message to the second process, so that the second process starts an operation of writing data back to the disk.

A Linux-based IO scheduling device, including:

memory for storing computer programs;

The processor is configured to implement the steps of the above Linux-based IO scheduling method when executing the computer program.

A computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the steps of the above-mentioned Linux-based IO scheduling method are implemented.

Applying the technical solution provided by the embodiment of the present invention, the first process monitors the read operation in the queue, and if the first process monitors the read cache operation, it sends a data write-back start message to the second process, so that the second process starts The operation of writing data back to disk. When there is a read cache operation, it indicates that the data is read in the cache. In this case, the second process starts the operation of writing the data back to the disk, which will not affect the read performance, and at the same time, the data in the cache can be written back in time disk, reducing the probability of data loss.

Description of drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the following will briefly introduce the drawings that need to be used in the description of the embodiments or the prior art. Obviously, the accompanying drawings in the following description are only These are some embodiments of the present invention. Those skilled in the art can also obtain other drawings based on these drawings without creative work.

Fig. 1 is a kind of implementation flowchart of the IO scheduling method based on Linux in the embodiment of the present invention;

Fig. 2 is another implementation flowchart of the IO scheduling method based on Linux in the embodiment of the present invention;

Fig. 3 is the schematic diagram of the IO scheduling process based on Linux in the embodiment of the present invention;

4 is a schematic structural diagram of a Linux-based IO scheduling device in an embodiment of the present invention;

FIG. 5 is a schematic structural diagram of a Linux-based IO scheduling device in an embodiment of the present invention.

detailed description

In order to enable those skilled in the art to better understand the solution of the present invention, the present invention will be further described in detail below in conjunction with the accompanying drawings and specific embodiments. Apparently, the described embodiments are only some of the embodiments of the present invention, but not all of them. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

Referring to Fig. 1, it is an implementation flowchart of a Linux-based IO scheduling method provided by an embodiment of the present invention, the method may include the following steps:

S110: Monitor the read operation in the queue by the first process.

In practical applications, users or other systems can read and write data in the Linux system. Requests for read or write operations can be placed in their respective queues. In the embodiment of the present invention, the read operation in the queue may be monitored by the first process.

S120: If the first process monitors the read cache operation, send a data write-back start message to the second process, so that the second process starts an operation of writing data back to the disk.

In the Linux system, if there is target data to be read in the cache, the target data can be directly read from the cache, and the operation of directly reading the target data from the cache can be called a read cache operation. In the process of the first process monitoring the read operation in the queue, if the first process monitors the read cache operation, it indicates that the current read operation is an operation of reading data from the cache, and does not involve the operation of reading data from the disk. In this case, the first process can communicate with the second process, and send a data write-back start message to the second process, and after receiving the data write-back start message, the second process can start the operation of writing data back to the disk.

Because the data is read in the cache at this time, the read performance will not be affected when the second process writes the data back to the disk, and the second process can write the data in the cache back to the disk as soon as possible. , to reduce the probability of data loss when data is written back.

Applying the method provided by the embodiment of the present invention, the first process monitors the read operation in the queue, and if the first process monitors the read cache operation, then sends a data write-back start message to the second process, so that the second process starts the data Operations written back to disk. When there is a read cache operation, it indicates that the data is read in the cache. In this case, the second process starts the operation of writing the data back to the disk, which will not affect the read performance, and at the same time, the data in the cache can be written back in time disk, reducing the probability of data loss.

In one embodiment of the present invention, as shown in Figure 2, the method may also include the following steps:

S130: If the first process detects a disk read operation, send a data write-back pause message to the second process, so that the second process suspends the operation of writing data back to the disk.

In practical applications, if there is no target data to be read in the cache, the target data may be directly read from the disk, and the operation of directly reading the target data from the disk may be called a disk read operation. In the process of the first process listening to the read operation in the queue, if the first process monitors the read disk operation, it indicates that the current read operation is an operation of reading data from the disk. In this case, the first process can communicate with The second process communicates and sends a data write-back suspend message to the second process. After receiving the data write-back suspend message, the second process can suspend the operation of writing data back to the disk.

During the process of reading data from the disk, if the second process still performs the operation of writing data back to the disk, the read performance and write performance will be affected, and the probability of data loss during data write-back will also increase. Applying the method provided by the embodiment of the present invention, when the first process monitors the disk read operation, it sends a data write-back pause message to the second process, and the second process suspends the operation of writing data back to the disk, which can avoid affecting the read performance and Write performance, reducing the probability of data loss when data is written back.

In another embodiment of the present invention, as shown in Figure 2, the method may also include the following steps:

S140: If the first process does not detect any read operation, send a data write-back start message to the second process, so that the second process starts an operation of writing data back to the disk.

In practical applications, there may not be any read operations in the current queue, that is, neither read cache operations nor disk read operations. When the first process does not monitor any read operation, the first process can communicate with the second process and send a data write-back start message to the second process, and the second process can start data write-back after receiving the data write-back start message operation to disk. In this way, the data in the cache can be written back to the disk in time, reducing the probability of data loss when the data is written back.

In one embodiment of the present invention, before step S110, the method may further include the following steps:

The first process is started when a set time interval is reached.

In the embodiment of the present invention, a certain time interval may be set, and when the set time interval is reached, the first process is started, and the read operation in the queue is monitored by the first process.

The time interval can be set and adjusted according to actual conditions, for example, set to 1 second, 1 minute, etc., which is not limited in this embodiment of the present invention.

In one embodiment of the present invention, step S110 may include the following steps:

Within the preset monitoring duration, the first process monitors the read operations in the queue.

In the embodiment of the present invention, a certain listening duration can be set. Within the preset monitoring duration, the first process monitors the read operations in the queue.

The monitoring duration can be set and adjusted according to the actual situation or the above time interval, for example, 1 millisecond, 1 second, 1 minute, etc., which is not limited in the embodiment of the present invention.

For ease of understanding, the technical solution provided by the embodiment of the present invention will be specifically described by taking the IO scheduling process shown in FIG. 3 as an example.

(1) The first process P1 started is responsible for monitoring the read operations in the queue at time T, and the second process P2 is responsible for data write-back. The time interval from Tn to Tn+1 can be set according to actual conditions, and can be 1 millisecond, 1 second, or 1 minute. n=0, 1, 2, 3, . . .

(2) When P1 listens to the read cache operation, it notifies P2 to write data back to the disk; when P1 listens to the disk read operation, it notifies P2 to suspend the operation of writing data back to the disk.

(3) During the time period T0-T1: P1 detects that only the read cache operation is performed, and notifies P2 to start the operation of writing data back to the disk.

(4) During the time period T1-T2: P1 detects that the system performs read cache and data write-back operations.

(5) During the time period from T2 to T3: P1 detects that the system has performed a disk read operation, and informs P2 to suspend the operation of writing data back to the disk.

(6) During the time period T3-T4: P1 detects that the system does not perform any read operation, and informs P2 to start the operation of writing data back to the disk.

By applying the method provided by the embodiment of the present invention, the read performance and the integrity of the written data can be improved. By monitoring the read operation, the data write-back time is controlled to ensure that the read performance is not affected, and at the same time, the data can be written back to the disk in time to reduce the probability of data loss.

Corresponding to the above method embodiment, the embodiment of the present invention also provides a Linux-based IO scheduling device, a Linux-based IO scheduling device described below and a Linux-based IO scheduling method described above can be mutually Corresponding reference.

Referring to Figure 4, the device can include the following modules:

A monitoring module 410, configured to monitor the read operations in the queue through the first process;

The first message sending module 420 is configured to send a data write-back start message to the second process when the first process detects the read cache operation, so that the second process starts the operation of writing data back to the disk.

Applying the device provided by the embodiment of the present invention, the first process monitors the read operation in the queue, and if the first process monitors the read cache operation, it sends a data write-back start message to the second process, so that the second process starts the data Operations written back to disk. When there is a read cache operation, it indicates that the data is read in the cache. In this case, the second process starts the operation of writing the data back to the disk, which will not affect the read performance, and at the same time, the data in the cache can be written back in time disk, reducing the probability of data loss.

In a specific embodiment of the present invention, it also includes:

The second message sending module is configured to send a data write-back suspension message to the second process when the first process detects a disk read operation, so that the second process suspends the operation of writing data back to the disk.

In a specific implementation manner of the present invention, the first message sending module 420 is also used for:

When the first process does not monitor any read operation, a data write-back start message is sent to the second process, so that the second process starts an operation of writing data back to the disk.

In a specific embodiment of the present invention, it also includes a process starting module, which is used for:

Before the read operation in the queue is monitored by the first process, the first process is started when a set time interval is reached.

In a specific implementation manner of the present invention, the monitoring module 410 is specifically used for:

Within the preset monitoring duration, the first process monitors the read operations in the queue.

Corresponding to the above method embodiment, the embodiment of the present invention also provides a Linux-based IO scheduling device, a Linux-based IO scheduling device described below and a Linux-based IO scheduling method described above can interact with each other Corresponding reference.

Referring to Figure 5, the device includes:

memory 510, for storing computer programs;

The processor 520 is configured to implement the steps of the above Linux-based IO scheduling method when executing the computer program.

Corresponding to the above method embodiment, the embodiment of the present invention also provides a computer-readable storage medium, a computer-readable storage medium described below and a Linux-based IO scheduling method described above can be referred to each other .

A computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the steps of the above-mentioned Linux-based IO scheduling method are implemented.

Each embodiment in this specification is described in a progressive manner, each embodiment focuses on the difference from other embodiments, and the same or similar parts of each embodiment can be referred to each other. As for the device disclosed in the embodiment, since it corresponds to the method disclosed in the embodiment, the description is relatively simple, and for the related part, please refer to the description of the method part.

Professionals can further realize that the units and algorithm steps of the examples described in conjunction with the embodiments disclosed herein can be implemented by electronic hardware, computer software or a combination of the two. In order to clearly illustrate the possible For interchangeability, in the above description, the composition and steps of each example have been generally described according to their functions. Whether these functions are executed by hardware or software depends on the specific application and design constraints of the technical solution. Skilled artisans may use different methods to implement the described functions for each specific application, but such implementation should not be regarded as exceeding the scope of the present invention.

The steps of the methods or algorithms described in connection with the embodiments disclosed herein may be directly implemented by hardware, software modules executed by a processor, or a combination of both. Software modules can be placed in random access memory (RAM), internal memory, read-only memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, registers, hard disk, removable disk, CD-ROM, or any other Any other known storage medium.

In this paper, specific examples are used to illustrate the principles and implementation methods of the present invention, and the descriptions of the above embodiments are only used to help understand the technical solutions and core ideas of the present invention. It should be pointed out that for those skilled in the art, without departing from the principle of the present invention, some improvements and modifications can be made to the present invention, and these improvements and modifications also fall within the protection scope of the claims of the present invention.

Claims (10)

1. A Linux-based IO scheduling method, characterized in that, comprising: Monitor the read operations in the queue through the first process; If the first process monitors the read cache operation, it sends a data write-back start message to the second process, so that the second process starts an operation of writing data back to the disk. 2. The method according to claim 1, further comprising: If the first process detects a disk read operation, it sends a data write-back suspend message to the second process, so that the second process suspends the operation of writing data back to the disk. 3. The method according to claim 2, further comprising: If the first process does not detect any read operation, then send the data write-back start message to the second process, so that the second process starts an operation of writing data back to the disk. 4. The method according to any one of claims 1 to 3, further comprising: before the first process monitors the read operation in the queue: The first process is started when a set time interval is reached. 5. The method according to claim 4, wherein said monitoring the read operation in the queue by the first process comprises: Within the preset monitoring duration, the first process monitors the read operations in the queue. 6. A Linux-based IO scheduling device, characterized in that, comprising: A monitoring module, configured to monitor the read operations in the queue through the first process; The first message sending module is configured to send a data write-back start message to the second process when the first process detects a read cache operation, so that the second process starts an operation of writing data back to the disk. 7. The device according to claim 6, further comprising: The second message sending module is configured to send a data write-back pause message to the second process when the first process detects a disk read operation, so that the second process suspends the operation of writing data back to the disk. 8. The device according to claim 7, wherein the first message sending module is further configured to: When the first process does not detect any read operation, send the data write-back start message to the second process, so that the second process starts an operation of writing data back to the disk. 9. A Linux-based IO scheduling device, characterized in that, comprising: memory for storing computer programs; The processor is configured to implement the steps of the Linux-based IO scheduling method according to any one of claims 1 to 5 when executing the computer program. 10. A computer-readable storage medium, characterized in that a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the method based on any one of claims 1 to 5 is implemented. The steps of the Linux IO scheduling method.