CN1296850C - Partition lease method for cluster system resource management - Google Patents

Abstract

The invention relates to the technical field of computer systems, and an effective method for managing cluster system node resources is partition leasing. The cluster nodes are divided into several different partitions and managed independently with their own strategies. When resources in one partition are not enough, partition cooperation can be realized under certain rules, that is, node resources of other partitions can be rented. This is a partition leasing method for cluster system resource management. The specific steps for implementing this method are: a) establishing a partition information file named pools; b) starting and initializing the partition resource manager according to the pools file; c) starting and initializing the rental bulletin board according to the pools file.

Description

A Partition Leasing Method for Cluster System Resource Management

technical field

The invention relates to the technical field of computer systems, in particular to a partition leasing method for cluster system resource management.

technical background

A cluster is a computer system composed of many PCs or workstations (workstations) connected through a high-speed network. The PCs or workstations that make up the cluster are called nodes. Each node in the cluster is a computer that can be used independently, with its own hardware and software resources. How to make full and reasonable use of various resources of the cluster is one of the important issues in the application and management of the cluster system. To make full and reasonable use of cluster resources, it is necessary to effectively manage node resources in the cluster. However, due to the dispersion and independence of nodes in the cluster, the diversity of node resources and the dynamic nature of node resources in the process of use, it brings great difficulties to cluster resource management. In addition, as the size of the cluster continues to increase, the centralized management of cluster system resources greatly affects the scalability of the cluster system; moreover, the diverse needs of users for cluster resources also require flexible management of cluster node resources.

A general node resource management method is shown in FIG. 1 , all nodes periodically report resources to the cluster resource manager, and the cluster resource manager centrally manages them. This method is simple and easy to implement, but it cannot well meet the above-mentioned cluster resource management requirements.

Contents of the invention

The purpose of the present invention is to provide a partition leasing method for cluster system resource management.

Partition management is used to divide the cluster nodes into several non-overlapping partitions, which are managed independently with their own resource management strategies, and with the help of lease bulletin boards, resources between partitions are leased and used (as shown in Figure 2).

The partition information of cluster nodes is determined by a partition configuration file, which can be dynamically managed by modifying this configuration file.

Each partition has its own partition resource manager, which is managed independently of each other, and the nodes in the partitions do not overlap.

In this method, there is only one rental bulletin board, and the rental information and initialization information of the rental bulletin board are provided by the partition configuration file. The leasing bulletin board records the dynamic resource information of the leasing node. When leasing a node, you need to query the leasing bulletin board first, and apply for leasing to the corresponding partition resource manager according to the query result.

A partition leasing method for cluster system resource management, using partition management, dividing the cluster nodes into several non-overlapping partitions, using their own resource management strategies to manage independently, and with the help of the leasing bulletin board, realizing resource sharing between partitions For lease use, the specific implementation steps are as follows:

a) Create a partition configuration file named pools;

b) Start and initialize the partition resource manager according to the pools file;

c) Start and initialize the rental bulletin board according to the pools file;

In this method, there is one rental bulletin board and multiple partition resource managers, and its working steps are as follows:

a) The partition resource manager waits to accept resource requests. If a request arrives, determine whether it is a request from the partition or a lease request? If it is a rental request, go to step g,

b) Determine whether the request meets the permission requirements? If not satisfied, go to step j,

c) Determine whether the partition meets the requested resource requirements? If not satisfied, go to step e,

d) Allocate resources to the request, go to step a,

e) Ask if there is a viable rental resource on the rental bulletin board? If not, go to step j,

f) Request resource lease from other partitions specified by the lease bulletin board, go to step a,

g) Determine whether the lease request satisfies the user rights of the partition? If not satisfied, go to step j,

h) Determine whether the rentable resources of this partition meet the resource requirements of the rent request? If not satisfied, go to step j,

i) Allocate resources to the lease request, go to step a,

j) Reject the request, go to step a.

In the above-mentioned partition leasing method for cluster system resource management, partition information of cluster nodes is determined by a partition configuration file named pools.

The partition leasing method for cluster system resource management can dynamically manage partition information by modifying partition configuration files.

In the partition leasing method for cluster system resource management, each partition has its own resource manager and is managed independently of each other, and the nodes in the partitions do not overlap.

According to the partition leasing method for cluster system resource management, there is only one leasing bulletin board in the system, and the leasing information and the initialization information of the leasing bulletin board are provided by the partition configuration file.

In the partition leasing method for cluster system resource management, the leasing bulletin board records the dynamic resource information of the leasing node. When leasing a node, the leasing bulletin board needs to be queried first, and the lease is applied to the corresponding partition resource manager according to the query result.

Description of drawings

FIG. 1 is a structural diagram of a general method for cluster resource management.

Fig. 2 is a structural diagram of cluster system resource management realized by using the partition leasing method in the present invention.

Fig. 3 is a working flowchart of the partition resource manager of the present invention.

Detailed ways

Above-mentioned three accompanying drawings can better illustrate idea, realization and advantage of the present invention:

In Fig. 1, a centralized cluster resource management method is shown, that is, all nodes are managed centrally by a cluster resource manager. Among them, 1 is the cluster resource manager, and 2 is the node.

Figure 2 is a structural diagram of the partition leasing method for cluster resource management; in Figure 2, all cluster nodes are divided into several partitions, and the partitions negotiate with each other and request to lease node resources with the help of bulletin boards. Among them, 3 is the rental bulletin board, and 4 represents a partition, including partition resource managers and nodes. 5 means another partition, including partition explorer and node. This figure can clearly illustrate the intention of the present invention. By comparing with FIG. 1, the advantages of the present invention can be appreciated.

Fig. 3 is a flowchart of the partition resource manager. It visually expresses the main flow of resource request and lease processing. The steps are as follows:

a) The partition resource manager waits to accept resource requests. If a request comes, determine whether it is a request for the local partition or a lease request? If it is a rental request, go to step g,

b) Determine whether the request meets the permission requirements? If not satisfied, go to step j,

c) Determine whether the partition meets the requested resource requirements? If not satisfied, go to step e,

d) Allocate resources to the request, go to step a,

e) Ask if there is a viable rental resource on the rental bulletin board? If not, go to step j,

f) Request resource lease from other partitions specified by the lease bulletin board. Go to step a,

g) Determine whether the lease request satisfies the user rights of the partition? If not satisfied, go to step j,

h) Determine whether the rentable resources of this partition meet the resource requirements of the rent request? If not satisfied, go to step j,

i) Allocate resources to the lease request, go to step a,

j) Reject the request, go to step a.

Specific implementation method

A) Partition management

Partition management is an effective way to organize and manage clusters. Using partitions to make the partitions independent of each other can effectively organize resources, which is the basis for enhancing the scalability of the cluster system (see Figure 2), and also provides convenience for flexible management and use of the cluster.

In the cluster system, there is a configuration file about node partitions, named pools (each partition is called a node pool pool). According to this file, the cluster system organizes partitions, deploys partition resource managers and lease bulletin boards in each partition, and initializes their information according to the contents of the pools file. By manually modifying this file or modifying the cluster partition information through commands, the partitions can be organized flexibly to achieve the flexibility of cluster resource management; various attributes and permissions can be added to the partitions to realize the diversification of cluster applications and management. The format of the pools file is as follows, keywords and content are separated by colons.

●Name: The name of the pool, which must be a string composed only of uppercase letters (A-Z), lowercase letters (a-z), numbers (0-9) and underscores (_), and its maximum length does not exceed the constant MAXPOOlNAMELEN (maximum partition name length).

●Size: The size of the pool, that is, the number of nodes contained in the pool. Note: size must match the number of nodes in nodelist.

●Nodelist: the node set of the pool, giving the node names of all the nodes belonging to the pool, separated by ",". Note: The same node can only appear in one partition.

● Leaselist: A list of nodes that can lend resources. Note: The lending node set must be a subset of nodelist.

RMD_name: the host name of the node where the resource manager in this pool is located

RMD_port: the port number that the partition manager listens to

●Property: The property of the pool, defined by the user, is any string

●Users: Give the users/groups who have permission to use the pool, or the users/groups who have no permission to use the pool.

Authorized users/groups are described in the following form:

+|username|@groupname|{, username|, @groupname}

Users/groups without permissions are described in the following form:

-|-username|-@groupname|{,-username|,-@groupname}

in:

|: means "or"

{...}: Indicates that the content inside the brackets is "repeated 0 or more times"

+: (a plus sign) indicates that all users have permissions

-: (a minus sign) indicates that all users have no permissions

username: Indicates the login name of a user

groupname: Indicates the group name of a certain group.

Remotely deploy partitions according to the node name and listening port number of the partition resource manager in the pools file; collect and manage resource information of all nodes in each partition according to the list of nodes managed by each partition; according to the attributes and usage permissions of each partition Manage each partition. Start and initialize the lease bulletin board according to the pools file, and the lease bulletin board obtains the leased node information from the leaselist domain. Therefore, a partition leasing method for cluster system resource management, its specific implementation steps are as follows:

a) Create a partition information file named pools;

b) Start and initialize the partition resource manager according to the pools file;

c) Start and initialize the rental bulletin board according to the pools file.

In this method, the program responsible for resource management, authority management and concession resource management in the partition is called a partition resource manager, which exists in the system in the form of a background service process. When it starts, it depends on the pools file. After starting, its workflow is detailed in Figure 3 and the description of Figure 3.

B) Lease

After the node partition is independent, some applications may need to use resources across regions. In this case, resources from other partitions need to be rented. A node partition is a node pool (pool). The idle pool can lend resources, and the resource shortage pool can rent resources. In this method, the program that manages the leasing information of each partition is the leasing bulletin board, which exists in the system in the form of a background service process, and manages the node information that each partition can lend resources. It is obtained from the pools configuration file during initialization Initial information, and dynamically refresh leased resource information during operation.

Leasing between resources is negotiated by the respective partition resource managers with the help of the leasing bulletin board. When a certain partition needs to rent resources, first query the lending bulletin board for the nodes that can lend resources, and then apply for the leased resources to the corresponding partition resource manager. When the applicant satisfies the resource lease authority (user authority, enough lendable resources), the partition resource manager will lend the resources (see Figure 3).

When the application that leased the resource is completed, the resource is automatically released. When the load of the partition that lent resources is too heavy, the system administrator can check the resource lending status of this partition, and reclaim resources by stopping the application or migrating the application.

An advantage of the present invention is that the partitioning method can effectively manage resources and adapt to the diversity of heterogeneous cluster resources. Homogeneous nodes can be managed in a partition, making cluster resource management organized and clear.

Another advantage of the present invention is that each partition can implement its own different management strategies, adapting to the diversity and flexibility of users. Also, each partition has different permission control, which is more convenient for users to use and manage.

Another advantage of the present invention is that the method of renting resources by partition subtly solves the problem of using resources across regions, so that even after the nodes are partitioned, there is a way to combine node resources for use as a whole.

Claims (6)

1, a kind of subregion leasing method of Network of Workstation resource management, it is characterized in that, adopt partition management, cluster nodes is belonged to several nonoverlapping subregions, adopt policy in resource management separately to manage alone, and under the help of leasing bulletin board, realize the use of leasing of by stages resource, its concrete implementation step is as follows:

A) set up the zone configuration file that is called pools;

B) according to pools file start and initialization partition resource manager;

C) lease bulletin board according to pools file start and initialization;

Have one in this method and lease bulletin board and a plurality of partition resource manager, its job step is as follows:

Is a) partition resource manager waited for and is accepted resource request, as request comes, judges that it is the request of this subregion, or lease request? as be lease request, change step g,

B) do you judge that asking to satisfy authority requires? as not satisfying, change step j,

C) do you judge that subregion satisfies requested resource and requires? as not satisfying, change step e,

D) give the request Resources allocation, change step a,

E) bulletin board is leased in inquiry the feasible resource of leasing? if no, change step j,

F) lease by the subregion request resource of leasing the bulletin board appointment to other, change step a,

G) do you judge that lease request satisfies this subregion user right? as not satisfying, change step j,

Can h) do you judge that this subregion lease the resource requirement that resource satisfies lease request? as not satisfying, change step j,

I) give the lease request Resources allocation, change step a,

J) step a is changeed in refusal request.

2, the subregion leasing method of a kind of Network of Workstation resource management as claimed in claim 1 is characterized in that, the partition information of cluster nodes is by the zone configuration file decision of a pools by name.

3, the subregion leasing method of a kind of Network of Workstation resource management as claimed in claim 1 or 2 is characterized in that, can come the dynamic management partition information by revising the zone configuration file.

4, the subregion leasing method of a kind of Network of Workstation resource management as claimed in claim 1 is characterized in that, each subregion has explorer separately, separate management, and node is not overlapping in the subregion.

5, the subregion leasing method of a kind of Network of Workstation resource management as claimed in claim 1 is characterized in that, has only one to lease bulletin board in the system, and lease information, the initialization information of leasing bulletin board are provided by the zone configuration file.

6, the subregion leasing method of a kind of Network of Workstation resource management as claimed in claim 1, it is characterized in that, lease bulletin board and writing down the dynamic resource information of leasing node, need inquiry earlier to lease bulletin board when leasing node, lease to corresponding partition resource manager application according to Query Result.

Images