[go: up one dir, main page]

CN109240993A - Metadata management method and storage server - Google Patents

Metadata management method and storage server Download PDF

Info

Publication number
CN109240993A
CN109240993A CN201810819598.5A CN201810819598A CN109240993A CN 109240993 A CN109240993 A CN 109240993A CN 201810819598 A CN201810819598 A CN 201810819598A CN 109240993 A CN109240993 A CN 109240993A
Authority
CN
China
Prior art keywords
metadata
storage server
disk
brush
total amount
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201810819598.5A
Other languages
Chinese (zh)
Inventor
刘丹
陈玉强
朱斌
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Zhengzhou Yunhai Information Technology Co Ltd
Original Assignee
Zhengzhou Yunhai Information Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Zhengzhou Yunhai Information Technology Co Ltd filed Critical Zhengzhou Yunhai Information Technology Co Ltd
Priority to CN201810819598.5A priority Critical patent/CN109240993A/en
Publication of CN109240993A publication Critical patent/CN109240993A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0628Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0655Vertical data movement, i.e. input-output transfer; data movement between one or more hosts and one or more storage devices
    • G06F3/0659Command handling arrangements, e.g. command buffers, queues, command scheduling
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0628Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0638Organizing or formatting or addressing of data
    • G06F3/0643Management of files
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0668Interfaces specially adapted for storage systems adopting a particular infrastructure
    • G06F3/067Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0668Interfaces specially adapted for storage systems adopting a particular infrastructure
    • G06F3/0671In-line storage system
    • G06F3/0673Single storage device
    • G06F3/0674Disk device
    • G06F3/0676Magnetic disk device

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The embodiment of the present application discloses a kind of metadata management method and storage server, and the metadata of every kind of business datum is stored to the disk into storage server for storage server to be unified.The embodiment of the present application method includes: that storage server determines that the total amount of the first metadata is greater than preset threshold, and the total amount of first metadata is the summation of the metadata of every kind of business datum in the memory of the storage server;The storage server determines that first metadata is the metadata of the disk to lower brush into the storage server;First metadata is stored the disk into the storage server by the storage server.

Description

Metadata management method and storage server
Technical field
This application involves electronic technology more particularly to a kind of metadata management method and storage servers.
Background technique
Metadata (Metadata), also known as broker data, relaying data, for data (the data about for describing data Data), the information of data attribute is mainly described, for supporting such as instruction storage location, historical data, resource lookup and file The functions such as record.Business datum is described by metadata, and the metadata of description business datum is managed, and may be implemented pair Effective management of business datum.
Currently, the metadata of business datum is continuously increased, file with the increase of type of service and the increase of portfolio The memory of system is unable to satisfy the demand of a large amount of business.Therefore, distributed pipes are carried out for the metadata of every kind of business datum Reason needs a metadata management module for the metadata of every kind of business datum, passes through each metadata management module The metadata of every kind of business datum is detected, then by brush under the metadata of the business datum in the disk into file system.
But it needs in such a way that the metadata to every kind of business datum carries out distributed management for every kind of business number According to data allocations one metadata management modules the metadata of the type business datum is managed, i.e., lower brush to magnetic The operation of disk can not unify to be managed collectively the metadata of every kind of business datum, and every kind of metadata management module is to it The mode of the metadata of the business datum managed is different, therefore, limitation by way of distributed management metadata compared with Greatly, versatility is poor.
Summary of the invention
The embodiment of the present application provides a kind of metadata management method and storage server, unified for storage server The metadata of every kind of business datum is stored to the disk into storage server.
In a first aspect, the embodiment of the present application provides a kind of metadata management method, which comprises
Storage server determines that the total amount of the first metadata is greater than preset threshold, and the total amount of first metadata is described The summation of the metadata of every kind of business datum in the memory of storage server;
The storage server determines that first metadata is the member of the disk to lower brush into the storage server Data;
First metadata is stored the disk into the storage server by the storage server.
In a kind of possible implementation, the storage server stores first metadata to the storage service After disk in device, the method also includes:
The storage server determines that the total amount of the second metadata is greater than preset threshold, and the total amount of second metadata is In the memory of the storage server in addition to first metadata, the summation of the metadata of every kind of business datum;
The storage server determines that second metadata is the metadata to lower brush to disk;
The storage server generates the second metadata brush task, second metadata according to second metadata Brush task is used to indicate the storage server for brush under second metadata to the disk;
The second metadata brush task is added in plate to be brushed queue the storage server.
In alternatively possible implementation, the storage server the second metadata brush task is added to be brushed After in disk queue, the method also includes:
The storage server determines that first metadata stores successfully in the disk;
The storage server executes the second metadata brush task.
In alternatively possible implementation, first metadata is stored to the storage and is taken by the storage server After being engaged in the disk in device, the method also includes:
The storage server determines that the access count of the metadata list item of first metadata is zero;
The storage server updates the access address of first metadata;
The storage server deletes first metadata in the memory.
Second aspect, the embodiment of the present application provide a kind of storage server, and the storage server includes:
First determination unit, for determine the first metadata total amount be greater than preset threshold, first metadata it is total Amount is the summation of the metadata of every kind of business datum in the memory of the storage server;
Second determination unit, for determining that first metadata is the disk to lower brush into the storage server Metadata;
Storage unit, for first metadata to be stored to the disk into the storage server.
In a kind of possible implementation, first determination unit is also used to:
Determine that the total amount of the second metadata is greater than preset threshold, the total amount of second metadata is the storage server Memory in addition to first metadata, the summation of the metadata of every kind of business datum;
Second determination unit is also used to:
Determine that second metadata is the metadata to lower brush to disk;
The storage server further include:
Generation unit, for generating the second metadata brush task, second metadata according to second metadata Brush task is used to indicate the storage server for brush under second metadata to the disk;
Adding unit, for the second metadata brush task to be added in plate to be brushed queue.
In alternatively possible implementation, the storage server further include:
Third determination unit, for determining that first metadata stores successfully in the disk;
Execution unit, for executing the second metadata brush task.
In alternatively possible implementation, the storage server further include:
4th determination unit, for determining that the access count of metadata list item of first metadata is zero;
Updating unit, for updating the access address of first metadata;
Unit is deleted, for deleting first metadata in the memory.
The third aspect, the embodiment of the present application provide a kind of storage server, and the storage server includes:
Processor, memory, input-output equipment and bus;
The processor, memory, input-output equipment are connected with the bus respectively, and meter is stored in the memory The instruction of calculation machine;
The processor is when executing the computer instruction in the memory, for realizing any reality of such as first aspect Existing mode.
Fourth aspect, the embodiment of the present application provide a kind of computer program product comprising instruction, which is characterized in that when it When running on computers, so that the computer executes the implementation as described in any in first aspect.
5th aspect, the embodiment of the present application provide a kind of computer readable storage medium, which is characterized in that including instructing, When described instruction is run on computers, so that computer executes the implementation as described in any one of first aspect.
As can be seen from the above technical solutions, the embodiment of the present application has the advantage that
As can be seen from the above technical solutions, storage server determines that the total amount of the first metadata is greater than preset threshold, wherein The total amount of first metadata is the summation of the metadata of every kind of business datum in the memory of the storage server;Then storage clothes Business device can determine that first metadata is the metadata of the disk to lower brush into the storage server;Storage server can be with First metadata is stored into the disk into storage server.Therefore, by the technical solution of the application, storage server can The metadata of every kind of business datum is stored into the disk into storage server with unified, and is directed to first number of every kind of business datum According to way to manage it is identical, the management of the metadata suitable for different types of business datum.Therefore, pass through the technology of the application The versatility that scheme carries out the mode of the metadata of unified management multiple business data is stronger.
Detailed description of the invention
Fig. 1 is one of the embodiment of the present application application scenarios system framework schematic diagram;
Fig. 2 is one embodiment schematic diagram of the metadata management method in the embodiment of the present application;
Fig. 3 is another embodiment schematic diagram of the metadata management method in the embodiment of the present application;
Fig. 4 is a structural schematic diagram of the storage server in the embodiment of the present application;
Fig. 5 is another structural schematic diagram of the storage server in the embodiment of the present application.
Specific embodiment
The embodiment of the present application provides a kind of metadata management method and storage server, unified for storage server The metadata of every kind of business datum is stored to the disk into storage server.
Referring to Fig. 1, Fig. 1 is one of the embodiment of the present application application scenarios system framework schematic diagram, wherein storage clothes The storage and management for data of the device for carrying out data caused by different business and required calling to host equipment of being engaged in, Wherein, data include business datum and metadata.With the increase of type of service and the increase of business datum, business datum Metadata is also constantly increasing, and metadata is stored by the memory of storage server can no longer meet a large amount of business need Ask, therefore, storage server by host equipment carry out different business generation business datum metadata stored to In memory, when the metadata total amount in memory is more than certain predetermined threshold value, storage server can be by the member of the business datum Data store the disk into storage server.Host equipment is for executing different business.
It is described in detail below from method of the angle of storage server to the metadata management of the application, please refers to figure 2, one embodiment of the method for metadata management includes: in the embodiment of the present application
201, storage server determines that the total amount of the first metadata is greater than preset threshold.
Storage server is during host equipment is continually performed different business, for first number of different business data Increase during execution business according to also with host equipment, then storage server can monitor in storage server at this time Memory the first metadata total amount, wherein the total amount of first metadata be the storage server memory in every kind The summation of the metadata of business datum.In the memory of storage server, when the total amount of the first metadata is rising to its total amount When greater than preset threshold, storage server can determine that the total amount of the first metadata is greater than preset threshold.
202, storage server determines that the first metadata is the metadata of the disk to lower brush into the storage server.
When storage server has determined that the total amount of the first metadata is greater than preset threshold, storage server can determine first Metadata is the metadata to lower brush to disk.
203, storage server stores first metadata in the disk into the storage server.
Storage server can brush the first metadata into disk according under preset mode.
In the embodiment of the present application, storage server determines that the total amount of the first metadata is greater than preset threshold, wherein this first The total amount of metadata is the summation of the metadata of every kind of business datum in the memory of the storage server;Then storage server can To determine that first metadata is the metadata of the disk to lower brush into the storage server;Storage server can by this One metadata stores the disk into storage server.Therefore, by the technical solution of the application, storage server can be unified The metadata of every kind of business datum is stored into the disk into storage server, and the pipe of the metadata for every kind of business datum Reason mode is identical, the management of the metadata suitable for different types of business datum.Therefore, by the technical solution of the application into The versatility of the mode of the metadata of row unified management multiple business data is stronger.
In the embodiment of the present application, the first metadata is carried out in disk of the lower brush to storage server in storage server In the process, if storage server detects that the total amount of the second metadata in storage server is greater than preset threshold, at this point, Storage server can generate the second metadata brush task according to second metadata, then appoint the second metadata brush Business is added in plate to be brushed queue, successfully stores the first metadata to the disk of the storage server to storage server, The second metadata brush task is executed again, i.e., stores the second metadata into disk;Wherein, the second metadata is storage clothes It is engaged in the memory of device in addition to the first metadata, the metadata of every kind of business datum;Specifically herein without limitation.In subsequent reality It applies in example, is only successfully stored to before disk with storage server by the first metadata, the total amount of the second metadata is not up to It is illustrated in case where preset threshold.
In the embodiment of the present application, storage server stores the first metadata to the disk of storage server, storage Server can update the access address of the first metadata according to the access count of the metadata list item of the first metadata;Below The embodiment is discussed in detail by Fig. 3, referring to Fig. 3, in the embodiment of the present application metadata management method another reality Applying example includes:
301, the total amount of the first metadata in the memory of storage server detection storage server.
Host equipment can generate the metadata of business datum and business datum, needle during executing different business To the metadata of different business datums, storage server can be during host equipment execution business constantly in detection Deposit the total amount of the first metadata of middle storage, wherein the total amount of first metadata is every in the memory of the storage server The summation of the metadata of kind business datum.
302, storage server judges whether the total amount of the first metadata is greater than preset threshold, if so, thening follow the steps 303;If it is not, thening follow the steps 308.
The total amount of the metadata of every kind of business datum can be added to obtain the first metadata by storage server, then store Server may determine that whether the total amount of the first metadata is greater than preset threshold, if it does, so storage server executes step Rapid 303;If it is not, storage server executes step 308.
303, storage server determines that the first metadata is the metadata to lower brush into the disk of storage server.
If storage server determines that the total amount of the first metadata is greater than preset threshold, storage server can be determined First metadata is the metadata to lower brush into the disk of storage server.
304, storage server stores the first metadata into the disk of the storage server.
Storage server can store the first metadata into the disk of storage server according to preset mode.
305, storage server determines that the access count of the metadata list item of first metadata is zero.
Since storage server stores the first metadata to disk, first in the memory of storage server yuan number According to being discharged, and update the access address of the first metadata;And it needs to read and write data in view of user at this time Consistency, so being determined in the technical solution of the application by the access count of the metadata list item of the first metadata of setting Update the first metadata of access address and recycling of the first metadata.So storage server can detecte the first metadata The access count of metadata list item illustrates storage server when storage server determines when being counted as zero of the metadata list item The access address of first metadata can be updated.
It should be noted that the first metadata includes the metadata of multiple business datums, so the member of the first metadata Data table items are also corresponding with multiple metadata list items, so determining some in multiple metadata list item in storage server Or the access count of multiple metadata list items, when being zero, it is corresponding can to update this part metadata list item for storage server at this time Metadata access address.
306, storage server updates the access address of first metadata in disk.
When storage server has determined that the access count of metadata list item is zero, at this time storage server can update this Access address of one metadata in disk.
307, storage server deletes the first metadata in the memory of storage server.
The access address of first metadata is updated to store the corresponding magnetic of the first metadata in disk by storage server After disk address, storage server can be deleted the first metadata in memory, to discharge the memory of storage server, be made Obtaining preferentially metadata can be written in the memory of storage server when storage server re-writes metadata, and data are write The writing rate entered into memory is fast more than the speed of write-in disk, therefore, can be improved and member is written in storage server early period The performance of data.
It should be noted that host equipment is when accessing metadata, it is preferential to access the stored in memory of storage server Data visit again the data in plate to be brushed queue if access is unsuccessful, finally, if in memory and plate to be brushed queue all When access is less than corresponding data, the data of the disk in storage server are just accessed at this time, and the data for accessing disk can be with It is accessed by the metadata address of update.
308, storage server executes other operations.
Storage server is if it is determined that the total amount of the first metadata is not more than preset threshold, then storage server can be after Metadata in continuous detection memory, or other operations are executed, specific the application is without limitation.
In the embodiment of the present application, storage server determines that the total amount of the first metadata is greater than preset threshold, wherein this first The total amount of metadata is the summation of the metadata of every kind of business datum in the memory of the storage server;Then storage server can To determine that first metadata is the metadata of the disk to lower brush into the storage server;Storage server can by this One metadata stores the disk into storage server.Therefore, by the technical solution of the application, storage server can be unified The metadata of every kind of business datum is stored into the disk into storage server, and the pipe of the metadata for every kind of business datum Reason mode is identical, the management of the metadata suitable for different types of business datum.Therefore, by the technical solution of the application into The versatility of the mode of the metadata of row unified management multiple business data is stronger.
It is above-mentioned that the application metadata management method is described, the storage server of the application is carried out below detailed It introduces, referring to Fig. 4, wherein, generation unit 404, adding unit 405, third determination unit 406, execution unit the 407, the 4th Determination unit 408, updating unit 409 and deletion unit 410 are selectable unit, the one of storage server in the embodiment of the present application A embodiment includes:
First determination unit 401, for determine the first metadata total amount be greater than preset threshold, first metadata it is total Amount is the summation of the metadata of every kind of business datum in the memory of the storage server;
Second determination unit 402, for determining that first metadata is the disk to lower brush into the storage server Metadata;
Storage unit 403, for first metadata to be stored to the disk into the storage server.
In the present embodiment, which is also used to:
Determine that the total amount of the second metadata is greater than preset threshold, the total amount of second metadata is the interior of the storage server It deposits in addition to first metadata, the summation of the metadata of every kind of business datum;
Second determination unit 402 is also used to:
Determine that second metadata is the metadata to lower brush to disk;
The storage server further include:
Generation unit 404, for generating the second metadata brush task, the second metadata brush according to second metadata Disk task is used to indicate the storage server for brush under second metadata to the disk;
Adding unit 405, for the second metadata brush task to be added in plate to be brushed queue.
In the present embodiment, the storage server further include:
Third determination unit 406, for determining that first metadata stores successfully in the disk;
Execution unit 407, for executing the second metadata brush task.
In the present embodiment, the storage server further include:
4th determination unit 408, for determining that the access count of metadata list item of first metadata is zero;
Updating unit 409, for updating the access address of first metadata;
Unit 410 is deleted, for deleting first metadata in the memory.
In the embodiment of the present application, the first determination unit 401 determines that the total amount of the first metadata is greater than preset threshold, wherein The total amount of first metadata is the summation of the metadata of every kind of business datum in the memory of the storage server;Then second really Order member 402 can determine that first metadata is the metadata of the disk to lower brush into the storage server;Storage unit First metadata can be stored the disk into storage server by 403.Therefore, pass through the technical solution of the application, storage Unit 403 can be unified to store the metadata of every kind of business datum into the disk into storage server, and be directed to every kind of business The way to manage of the metadata of data is identical, the management of the metadata suitable for different types of business datum.Therefore, pass through this The versatility that the technical solution of application carries out the mode of the metadata of unified management multiple business data is stronger.
The application also provides a kind of storage server 500, referring to Fig. 5, storage server 500 1 in the embodiment of the present application A embodiment includes:
Processor 501, memory 502, input-output equipment 503 and bus 504;
The processor 501, memory 502, input-output equipment 503 are connected with bus 504 respectively, in the memory 502 It is stored with computer instruction;
The processor 501 is used to determine that the total amount of the first metadata to be greater than preset threshold, and the total amount of first metadata is The summation of the metadata of every kind of business datum in the memory of the storage server;Determine that first metadata is to deposit to lower brush to this Store up the metadata of the disk in server;First metadata is stored to the disk into the storage server.
In a kind of possible implementation, which is also used to:
Determine that the total amount of the second metadata is greater than preset threshold, the total amount of second metadata is the interior of the storage server It deposits in addition to first metadata, the summation of the metadata of every kind of business datum;
Determine that second metadata is the metadata to lower brush to disk;
The second metadata brush task is generated according to second metadata, which is used to indicate this Storage server will brush under second metadata to the disk;
The second metadata brush task is added in plate to be brushed queue.
In alternatively possible implementation, which is also used to:
Determine that first metadata stores successfully in the disk;
Execute the second metadata brush task.
In alternatively possible implementation, which is also used to:
The access count for determining the metadata list item of first metadata is zero;
Update the access address of first metadata;
Delete first metadata in the memory.
It is apparent to those skilled in the art that for convenience and simplicity of description, the system of foregoing description, The specific work process of device and unit, can refer to corresponding processes in the foregoing method embodiment, and details are not described herein.
In several embodiments provided herein, it should be understood that disclosed system, device and method can be with It realizes by another way.For example, the apparatus embodiments described above are merely exemplary, for example, the unit It divides, only a kind of logical function partition, there may be another division manner in actual implementation, such as multiple units or components It can be combined or can be integrated into another system, or some features can be ignored or not executed.Another point, it is shown or The mutual coupling, direct-coupling or communication connection discussed can be through some interfaces, the indirect coupling of device or unit It closes or communicates to connect, can be electrical property, mechanical or other forms.
The unit as illustrated by the separation member may or may not be physically separated, aobvious as unit The component shown may or may not be physical unit, it can and it is in one place, or may be distributed over multiple In network unit.It can select some or all of unit therein according to the actual needs to realize the mesh of this embodiment scheme 's.
It, can also be in addition, each functional unit in each embodiment of the application can integrate in one processing unit It is that each unit physically exists alone, can also be integrated in one unit with two or more units.Above-mentioned integrated list Member both can take the form of hardware realization, can also realize in the form of software functional units.
If the integrated unit is realized in the form of SFU software functional unit and sells or use as independent product When, it can store in a computer readable storage medium.Based on this understanding, the technical solution of the application is substantially The all or part of the part that contributes to existing technology or the technical solution can be in the form of software products in other words It embodies, which is stored in a storage medium, including some instructions are used so that a computer Equipment (can be personal computer, server or the network equipment etc.) executes the complete of each embodiment the method for the application Portion or part steps.And storage medium above-mentioned includes: USB flash disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), magnetic or disk etc. are various can store journey The medium of sequence code.
The above, above embodiments are only to illustrate the technical solution of the application, rather than its limitations;Although referring to before Embodiment is stated the application is described in detail, those skilled in the art should understand that: it still can be to preceding Technical solution documented by each embodiment is stated to modify or equivalent replacement of some of the technical features;And these It modifies or replaces, the spirit and scope of each embodiment technical solution of the application that it does not separate the essence of the corresponding technical solution.

Claims (10)

1. a kind of metadata management method, which is characterized in that the described method includes:
Storage server determines that the total amount of the first metadata is greater than preset threshold, and the total amount of first metadata is the storage The summation of the metadata of every kind of business datum in the memory of server;
The storage server determines that first metadata is the metadata of the disk to lower brush into the storage server;
First metadata is stored the disk into the storage server by the storage server.
2. the method according to claim 1, wherein the storage server by first metadata store to After disk in the storage server, the method also includes:
The storage server determines that the total amount of the second metadata is greater than preset threshold, and the total amount of second metadata is described In the memory of storage server in addition to first metadata, the summation of the metadata of every kind of business datum;
The storage server determines that second metadata is the metadata to lower brush to disk;
The storage server generates the second metadata brush task, the second metadata brush according to second metadata Task is used to indicate the storage server for brush under second metadata to the disk;
The second metadata brush task is added in plate to be brushed queue the storage server.
3. according to the method described in claim 2, it is characterized in that, the storage server appoints the second metadata brush After business is added in plate to be brushed queue, the method also includes:
The storage server determines that first metadata stores successfully in the disk;
The storage server executes the second metadata brush task.
4. method according to any one of claims 1 to 3, which is characterized in that the storage server is by described After one metadata stores the disk into the storage server, the method also includes:
The storage server determines that the access count of the metadata list item of first metadata is zero;
The storage server updates the access address of first metadata;
The storage server deletes first metadata in the memory.
5. a kind of storage server, which is characterized in that the storage server includes:
First determination unit, for determining that the total amount of the first metadata is greater than preset threshold, the total amount of first metadata is The summation of the metadata of every kind of business datum in the memory of the storage server;
Second determination unit, for determining that first metadata is first number of the disk to lower brush into the storage server According to;
Storage unit, for first metadata to be stored to the disk into the storage server.
6. storage server according to claim 5, which is characterized in that first determination unit is also used to:
Determine that the total amount of the second metadata is greater than preset threshold, the total amount of second metadata is the interior of the storage server It deposits in addition to first metadata, the summation of the metadata of every kind of business datum;
Second determination unit is also used to:
Determine that second metadata is the metadata to lower brush to disk;
The storage server further include:
Generation unit, for generating the second metadata brush task, the second metadata brush according to second metadata Task is used to indicate the storage server for brush under second metadata to the disk;
Adding unit, for the second metadata brush task to be added in plate to be brushed queue.
7. storage server according to claim 6, which is characterized in that the storage server further include:
Third determination unit, for determining that first metadata stores successfully in the disk;
Execution unit, for executing the second metadata brush task.
8. the storage server according to any one of claim 5 to 7, which is characterized in that the storage server is also Include:
4th determination unit, for determining that the access count of metadata list item of first metadata is zero;
Updating unit, for updating the access address of first metadata;
Unit is deleted, for deleting first metadata in the memory.
9. a kind of computer program product comprising instruction, which is characterized in that when run on a computer, so that the meter Calculation machine executes method according to any one of claims 1 to 4.
10. a kind of computer readable storage medium, which is characterized in that including instruction, when described instruction is run on computers, So that computer executes method according to any one of claims 1 to 4.
CN201810819598.5A 2018-07-24 2018-07-24 Metadata management method and storage server Pending CN109240993A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810819598.5A CN109240993A (en) 2018-07-24 2018-07-24 Metadata management method and storage server

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810819598.5A CN109240993A (en) 2018-07-24 2018-07-24 Metadata management method and storage server

Publications (1)

Publication Number Publication Date
CN109240993A true CN109240993A (en) 2019-01-18

Family

ID=65073015

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810819598.5A Pending CN109240993A (en) 2018-07-24 2018-07-24 Metadata management method and storage server

Country Status (1)

Country Link
CN (1) CN109240993A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115904646A (en) * 2021-09-30 2023-04-04 北京金山云网络技术有限公司 Request processing method, device, electronic device and storage medium

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7849091B1 (en) * 2006-01-25 2010-12-07 At&T Intellectual Property Ii, L.P. Meta-data indexing for XPath location steps
CN102938001A (en) * 2012-12-10 2013-02-20 曙光信息产业(北京)有限公司 Data loading device and data loading method
CN104809237A (en) * 2015-05-12 2015-07-29 百度在线网络技术(北京)有限公司 LSM-tree (The Log-Structured Merge-Tree) index optimization method and LSM-tree index optimization system
CN105094711A (en) * 2015-09-22 2015-11-25 浪潮(北京)电子信息产业有限公司 Method and device for achieving copy-on-write file system
CN106648442A (en) * 2015-10-29 2017-05-10 阿里巴巴集团控股有限公司 Metadata node internal memory mirroring method and device
CN107122364A (en) * 2016-02-25 2017-09-01 华为技术有限公司 Data manipulation method and data management server
CN107992432A (en) * 2017-11-28 2018-05-04 福建中金在线信息科技有限公司 The method and terminal device of a kind of data buffer storage

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7849091B1 (en) * 2006-01-25 2010-12-07 At&T Intellectual Property Ii, L.P. Meta-data indexing for XPath location steps
CN102938001A (en) * 2012-12-10 2013-02-20 曙光信息产业(北京)有限公司 Data loading device and data loading method
CN104809237A (en) * 2015-05-12 2015-07-29 百度在线网络技术(北京)有限公司 LSM-tree (The Log-Structured Merge-Tree) index optimization method and LSM-tree index optimization system
CN105094711A (en) * 2015-09-22 2015-11-25 浪潮(北京)电子信息产业有限公司 Method and device for achieving copy-on-write file system
CN106648442A (en) * 2015-10-29 2017-05-10 阿里巴巴集团控股有限公司 Metadata node internal memory mirroring method and device
CN107122364A (en) * 2016-02-25 2017-09-01 华为技术有限公司 Data manipulation method and data management server
CN107992432A (en) * 2017-11-28 2018-05-04 福建中金在线信息科技有限公司 The method and terminal device of a kind of data buffer storage

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
T. MAHMOOD: "Ensuring Cache Reliability and Energy Scaling at Near-Threshold Voltage With Macho", 《IEEE TRANSACTIONS ON COMPUTERS》 *
王江涛: "闪存数据库:现状、技术与展望", 《计算机学报》 *
王继成: "《大数据时代高校信息化战略与实践》", 31 May 2016, 东北大学出版社 *

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115904646A (en) * 2021-09-30 2023-04-04 北京金山云网络技术有限公司 Request processing method, device, electronic device and storage medium

Similar Documents

Publication Publication Date Title
CN114022148B (en) Transaction conflict detection method, device, equipment and storage medium based on block chain
CN110737682A (en) cache operation method, device, storage medium and electronic equipment
US20210096981A1 (en) Identifying differences in resource usage across different versions of a software application
CN112559522A (en) Data storage method and device, query method, electronic device and readable medium
CN108255620A (en) A kind of business logic processing method, apparatus, service server and system
CN111831752B (en) Distributed database space arrangement method, device, equipment and storage medium
CN110858122B (en) Method and device for storing data
CN104423982A (en) Request processing method and device
CN108984104A (en) Method and apparatus for cache management
CN112596949A (en) High-efficiency SSD (solid State disk) deleted data recovery method and system
CN109086141A (en) EMS memory management process and device and computer readable storage medium
CN107832446A (en) A kind of searching method and computing device of configuration item information
CN102542036B (en) Use the table optimized
CN111399753A (en) Method and device for writing pictures
JP2021515299A (en) A system for chronological out-of-place updates, a method for chronological out-of-place updates, and a computer program for chronological out-of-place updates.
CN106815232A (en) Catalog management method, apparatus and system
CN110022341A (en) A kind of data transmission method and relevant device
CN109240993A (en) Metadata management method and storage server
CN107515724A (en) For the method and apparatus for the input and output for reproducing storage system
CN109857519A (en) The processing method and relevant apparatus of virtual disk
CN114153732A (en) Failure scenario test method, device, electronic device and storage medium
CN105278877A (en) Object storage method and device
CN113760446A (en) Resource scheduling method, apparatus, device and medium
CN109976945A (en) A kind of method and device of Log backup
US20230004991A1 (en) Methods and systems for identifying breakpoints in variable impact on model results

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20190118

RJ01 Rejection of invention patent application after publication