CN109240993A - Metadata management method and storage server - Google Patents
Metadata management method and storage server Download PDFInfo
- Publication number
- CN109240993A CN109240993A CN201810819598.5A CN201810819598A CN109240993A CN 109240993 A CN109240993 A CN 109240993A CN 201810819598 A CN201810819598 A CN 201810819598A CN 109240993 A CN109240993 A CN 109240993A
- Authority
- CN
- China
- Prior art keywords
- metadata
- storage server
- disk
- brush
- total amount
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0655—Vertical data movement, i.e. input-output transfer; data movement between one or more hosts and one or more storage devices
- G06F3/0659—Command handling arrangements, e.g. command buffers, queues, command scheduling
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0638—Organizing or formatting or addressing of data
- G06F3/0643—Management of files
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
- G06F3/067—Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
- G06F3/0671—In-line storage system
- G06F3/0673—Single storage device
- G06F3/0674—Disk device
- G06F3/0676—Magnetic disk device
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The embodiment of the present application discloses a kind of metadata management method and storage server, and the metadata of every kind of business datum is stored to the disk into storage server for storage server to be unified.The embodiment of the present application method includes: that storage server determines that the total amount of the first metadata is greater than preset threshold, and the total amount of first metadata is the summation of the metadata of every kind of business datum in the memory of the storage server;The storage server determines that first metadata is the metadata of the disk to lower brush into the storage server;First metadata is stored the disk into the storage server by the storage server.
Description
Technical field
This application involves electronic technology more particularly to a kind of metadata management method and storage servers.
Background technique
Metadata (Metadata), also known as broker data, relaying data, for data (the data about for describing data
Data), the information of data attribute is mainly described, for supporting such as instruction storage location, historical data, resource lookup and file
The functions such as record.Business datum is described by metadata, and the metadata of description business datum is managed, and may be implemented pair
Effective management of business datum.
Currently, the metadata of business datum is continuously increased, file with the increase of type of service and the increase of portfolio
The memory of system is unable to satisfy the demand of a large amount of business.Therefore, distributed pipes are carried out for the metadata of every kind of business datum
Reason needs a metadata management module for the metadata of every kind of business datum, passes through each metadata management module
The metadata of every kind of business datum is detected, then by brush under the metadata of the business datum in the disk into file system.
But it needs in such a way that the metadata to every kind of business datum carries out distributed management for every kind of business number
According to data allocations one metadata management modules the metadata of the type business datum is managed, i.e., lower brush to magnetic
The operation of disk can not unify to be managed collectively the metadata of every kind of business datum, and every kind of metadata management module is to it
The mode of the metadata of the business datum managed is different, therefore, limitation by way of distributed management metadata compared with
Greatly, versatility is poor.
Summary of the invention
The embodiment of the present application provides a kind of metadata management method and storage server, unified for storage server
The metadata of every kind of business datum is stored to the disk into storage server.
In a first aspect, the embodiment of the present application provides a kind of metadata management method, which comprises
Storage server determines that the total amount of the first metadata is greater than preset threshold, and the total amount of first metadata is described
The summation of the metadata of every kind of business datum in the memory of storage server;
The storage server determines that first metadata is the member of the disk to lower brush into the storage server
Data;
First metadata is stored the disk into the storage server by the storage server.
In a kind of possible implementation, the storage server stores first metadata to the storage service
After disk in device, the method also includes:
The storage server determines that the total amount of the second metadata is greater than preset threshold, and the total amount of second metadata is
In the memory of the storage server in addition to first metadata, the summation of the metadata of every kind of business datum;
The storage server determines that second metadata is the metadata to lower brush to disk;
The storage server generates the second metadata brush task, second metadata according to second metadata
Brush task is used to indicate the storage server for brush under second metadata to the disk;
The second metadata brush task is added in plate to be brushed queue the storage server.
In alternatively possible implementation, the storage server the second metadata brush task is added to be brushed
After in disk queue, the method also includes:
The storage server determines that first metadata stores successfully in the disk;
The storage server executes the second metadata brush task.
In alternatively possible implementation, first metadata is stored to the storage and is taken by the storage server
After being engaged in the disk in device, the method also includes:
The storage server determines that the access count of the metadata list item of first metadata is zero;
The storage server updates the access address of first metadata;
The storage server deletes first metadata in the memory.
Second aspect, the embodiment of the present application provide a kind of storage server, and the storage server includes:
First determination unit, for determine the first metadata total amount be greater than preset threshold, first metadata it is total
Amount is the summation of the metadata of every kind of business datum in the memory of the storage server;
Second determination unit, for determining that first metadata is the disk to lower brush into the storage server
Metadata;
Storage unit, for first metadata to be stored to the disk into the storage server.
In a kind of possible implementation, first determination unit is also used to:
Determine that the total amount of the second metadata is greater than preset threshold, the total amount of second metadata is the storage server
Memory in addition to first metadata, the summation of the metadata of every kind of business datum;
Second determination unit is also used to:
Determine that second metadata is the metadata to lower brush to disk;
The storage server further include:
Generation unit, for generating the second metadata brush task, second metadata according to second metadata
Brush task is used to indicate the storage server for brush under second metadata to the disk;
Adding unit, for the second metadata brush task to be added in plate to be brushed queue.
In alternatively possible implementation, the storage server further include:
Third determination unit, for determining that first metadata stores successfully in the disk;
Execution unit, for executing the second metadata brush task.
In alternatively possible implementation, the storage server further include:
4th determination unit, for determining that the access count of metadata list item of first metadata is zero;
Updating unit, for updating the access address of first metadata;
Unit is deleted, for deleting first metadata in the memory.
The third aspect, the embodiment of the present application provide a kind of storage server, and the storage server includes:
Processor, memory, input-output equipment and bus;
The processor, memory, input-output equipment are connected with the bus respectively, and meter is stored in the memory
The instruction of calculation machine;
The processor is when executing the computer instruction in the memory, for realizing any reality of such as first aspect
Existing mode.
Fourth aspect, the embodiment of the present application provide a kind of computer program product comprising instruction, which is characterized in that when it
When running on computers, so that the computer executes the implementation as described in any in first aspect.
5th aspect, the embodiment of the present application provide a kind of computer readable storage medium, which is characterized in that including instructing,
When described instruction is run on computers, so that computer executes the implementation as described in any one of first aspect.
As can be seen from the above technical solutions, the embodiment of the present application has the advantage that
As can be seen from the above technical solutions, storage server determines that the total amount of the first metadata is greater than preset threshold, wherein
The total amount of first metadata is the summation of the metadata of every kind of business datum in the memory of the storage server;Then storage clothes
Business device can determine that first metadata is the metadata of the disk to lower brush into the storage server;Storage server can be with
First metadata is stored into the disk into storage server.Therefore, by the technical solution of the application, storage server can
The metadata of every kind of business datum is stored into the disk into storage server with unified, and is directed to first number of every kind of business datum
According to way to manage it is identical, the management of the metadata suitable for different types of business datum.Therefore, pass through the technology of the application
The versatility that scheme carries out the mode of the metadata of unified management multiple business data is stronger.
Detailed description of the invention
Fig. 1 is one of the embodiment of the present application application scenarios system framework schematic diagram;
Fig. 2 is one embodiment schematic diagram of the metadata management method in the embodiment of the present application;
Fig. 3 is another embodiment schematic diagram of the metadata management method in the embodiment of the present application;
Fig. 4 is a structural schematic diagram of the storage server in the embodiment of the present application;
Fig. 5 is another structural schematic diagram of the storage server in the embodiment of the present application.
Specific embodiment
The embodiment of the present application provides a kind of metadata management method and storage server, unified for storage server
The metadata of every kind of business datum is stored to the disk into storage server.
Referring to Fig. 1, Fig. 1 is one of the embodiment of the present application application scenarios system framework schematic diagram, wherein storage clothes
The storage and management for data of the device for carrying out data caused by different business and required calling to host equipment of being engaged in,
Wherein, data include business datum and metadata.With the increase of type of service and the increase of business datum, business datum
Metadata is also constantly increasing, and metadata is stored by the memory of storage server can no longer meet a large amount of business need
Ask, therefore, storage server by host equipment carry out different business generation business datum metadata stored to
In memory, when the metadata total amount in memory is more than certain predetermined threshold value, storage server can be by the member of the business datum
Data store the disk into storage server.Host equipment is for executing different business.
It is described in detail below from method of the angle of storage server to the metadata management of the application, please refers to figure
2, one embodiment of the method for metadata management includes: in the embodiment of the present application
201, storage server determines that the total amount of the first metadata is greater than preset threshold.
Storage server is during host equipment is continually performed different business, for first number of different business data
Increase during execution business according to also with host equipment, then storage server can monitor in storage server at this time
Memory the first metadata total amount, wherein the total amount of first metadata be the storage server memory in every kind
The summation of the metadata of business datum.In the memory of storage server, when the total amount of the first metadata is rising to its total amount
When greater than preset threshold, storage server can determine that the total amount of the first metadata is greater than preset threshold.
202, storage server determines that the first metadata is the metadata of the disk to lower brush into the storage server.
When storage server has determined that the total amount of the first metadata is greater than preset threshold, storage server can determine first
Metadata is the metadata to lower brush to disk.
203, storage server stores first metadata in the disk into the storage server.
Storage server can brush the first metadata into disk according under preset mode.
In the embodiment of the present application, storage server determines that the total amount of the first metadata is greater than preset threshold, wherein this first
The total amount of metadata is the summation of the metadata of every kind of business datum in the memory of the storage server;Then storage server can
To determine that first metadata is the metadata of the disk to lower brush into the storage server;Storage server can by this
One metadata stores the disk into storage server.Therefore, by the technical solution of the application, storage server can be unified
The metadata of every kind of business datum is stored into the disk into storage server, and the pipe of the metadata for every kind of business datum
Reason mode is identical, the management of the metadata suitable for different types of business datum.Therefore, by the technical solution of the application into
The versatility of the mode of the metadata of row unified management multiple business data is stronger.
In the embodiment of the present application, the first metadata is carried out in disk of the lower brush to storage server in storage server
In the process, if storage server detects that the total amount of the second metadata in storage server is greater than preset threshold, at this point,
Storage server can generate the second metadata brush task according to second metadata, then appoint the second metadata brush
Business is added in plate to be brushed queue, successfully stores the first metadata to the disk of the storage server to storage server,
The second metadata brush task is executed again, i.e., stores the second metadata into disk;Wherein, the second metadata is storage clothes
It is engaged in the memory of device in addition to the first metadata, the metadata of every kind of business datum;Specifically herein without limitation.In subsequent reality
It applies in example, is only successfully stored to before disk with storage server by the first metadata, the total amount of the second metadata is not up to
It is illustrated in case where preset threshold.
In the embodiment of the present application, storage server stores the first metadata to the disk of storage server, storage
Server can update the access address of the first metadata according to the access count of the metadata list item of the first metadata;Below
The embodiment is discussed in detail by Fig. 3, referring to Fig. 3, in the embodiment of the present application metadata management method another reality
Applying example includes:
301, the total amount of the first metadata in the memory of storage server detection storage server.
Host equipment can generate the metadata of business datum and business datum, needle during executing different business
To the metadata of different business datums, storage server can be during host equipment execution business constantly in detection
Deposit the total amount of the first metadata of middle storage, wherein the total amount of first metadata is every in the memory of the storage server
The summation of the metadata of kind business datum.
302, storage server judges whether the total amount of the first metadata is greater than preset threshold, if so, thening follow the steps
303;If it is not, thening follow the steps 308.
The total amount of the metadata of every kind of business datum can be added to obtain the first metadata by storage server, then store
Server may determine that whether the total amount of the first metadata is greater than preset threshold, if it does, so storage server executes step
Rapid 303;If it is not, storage server executes step 308.
303, storage server determines that the first metadata is the metadata to lower brush into the disk of storage server.
If storage server determines that the total amount of the first metadata is greater than preset threshold, storage server can be determined
First metadata is the metadata to lower brush into the disk of storage server.
304, storage server stores the first metadata into the disk of the storage server.
Storage server can store the first metadata into the disk of storage server according to preset mode.
305, storage server determines that the access count of the metadata list item of first metadata is zero.
Since storage server stores the first metadata to disk, first in the memory of storage server yuan number
According to being discharged, and update the access address of the first metadata;And it needs to read and write data in view of user at this time
Consistency, so being determined in the technical solution of the application by the access count of the metadata list item of the first metadata of setting
Update the first metadata of access address and recycling of the first metadata.So storage server can detecte the first metadata
The access count of metadata list item illustrates storage server when storage server determines when being counted as zero of the metadata list item
The access address of first metadata can be updated.
It should be noted that the first metadata includes the metadata of multiple business datums, so the member of the first metadata
Data table items are also corresponding with multiple metadata list items, so determining some in multiple metadata list item in storage server
Or the access count of multiple metadata list items, when being zero, it is corresponding can to update this part metadata list item for storage server at this time
Metadata access address.
306, storage server updates the access address of first metadata in disk.
When storage server has determined that the access count of metadata list item is zero, at this time storage server can update this
Access address of one metadata in disk.
307, storage server deletes the first metadata in the memory of storage server.
The access address of first metadata is updated to store the corresponding magnetic of the first metadata in disk by storage server
After disk address, storage server can be deleted the first metadata in memory, to discharge the memory of storage server, be made
Obtaining preferentially metadata can be written in the memory of storage server when storage server re-writes metadata, and data are write
The writing rate entered into memory is fast more than the speed of write-in disk, therefore, can be improved and member is written in storage server early period
The performance of data.
It should be noted that host equipment is when accessing metadata, it is preferential to access the stored in memory of storage server
Data visit again the data in plate to be brushed queue if access is unsuccessful, finally, if in memory and plate to be brushed queue all
When access is less than corresponding data, the data of the disk in storage server are just accessed at this time, and the data for accessing disk can be with
It is accessed by the metadata address of update.
308, storage server executes other operations.
Storage server is if it is determined that the total amount of the first metadata is not more than preset threshold, then storage server can be after
Metadata in continuous detection memory, or other operations are executed, specific the application is without limitation.
In the embodiment of the present application, storage server determines that the total amount of the first metadata is greater than preset threshold, wherein this first
The total amount of metadata is the summation of the metadata of every kind of business datum in the memory of the storage server;Then storage server can
To determine that first metadata is the metadata of the disk to lower brush into the storage server;Storage server can by this
One metadata stores the disk into storage server.Therefore, by the technical solution of the application, storage server can be unified
The metadata of every kind of business datum is stored into the disk into storage server, and the pipe of the metadata for every kind of business datum
Reason mode is identical, the management of the metadata suitable for different types of business datum.Therefore, by the technical solution of the application into
The versatility of the mode of the metadata of row unified management multiple business data is stronger.
It is above-mentioned that the application metadata management method is described, the storage server of the application is carried out below detailed
It introduces, referring to Fig. 4, wherein, generation unit 404, adding unit 405, third determination unit 406, execution unit the 407, the 4th
Determination unit 408, updating unit 409 and deletion unit 410 are selectable unit, the one of storage server in the embodiment of the present application
A embodiment includes:
First determination unit 401, for determine the first metadata total amount be greater than preset threshold, first metadata it is total
Amount is the summation of the metadata of every kind of business datum in the memory of the storage server;
Second determination unit 402, for determining that first metadata is the disk to lower brush into the storage server
Metadata;
Storage unit 403, for first metadata to be stored to the disk into the storage server.
In the present embodiment, which is also used to:
Determine that the total amount of the second metadata is greater than preset threshold, the total amount of second metadata is the interior of the storage server
It deposits in addition to first metadata, the summation of the metadata of every kind of business datum;
Second determination unit 402 is also used to:
Determine that second metadata is the metadata to lower brush to disk;
The storage server further include:
Generation unit 404, for generating the second metadata brush task, the second metadata brush according to second metadata
Disk task is used to indicate the storage server for brush under second metadata to the disk;
Adding unit 405, for the second metadata brush task to be added in plate to be brushed queue.
In the present embodiment, the storage server further include:
Third determination unit 406, for determining that first metadata stores successfully in the disk;
Execution unit 407, for executing the second metadata brush task.
In the present embodiment, the storage server further include:
4th determination unit 408, for determining that the access count of metadata list item of first metadata is zero;
Updating unit 409, for updating the access address of first metadata;
Unit 410 is deleted, for deleting first metadata in the memory.
In the embodiment of the present application, the first determination unit 401 determines that the total amount of the first metadata is greater than preset threshold, wherein
The total amount of first metadata is the summation of the metadata of every kind of business datum in the memory of the storage server;Then second really
Order member 402 can determine that first metadata is the metadata of the disk to lower brush into the storage server;Storage unit
First metadata can be stored the disk into storage server by 403.Therefore, pass through the technical solution of the application, storage
Unit 403 can be unified to store the metadata of every kind of business datum into the disk into storage server, and be directed to every kind of business
The way to manage of the metadata of data is identical, the management of the metadata suitable for different types of business datum.Therefore, pass through this
The versatility that the technical solution of application carries out the mode of the metadata of unified management multiple business data is stronger.
The application also provides a kind of storage server 500, referring to Fig. 5, storage server 500 1 in the embodiment of the present application
A embodiment includes:
Processor 501, memory 502, input-output equipment 503 and bus 504;
The processor 501, memory 502, input-output equipment 503 are connected with bus 504 respectively, in the memory 502
It is stored with computer instruction;
The processor 501 is used to determine that the total amount of the first metadata to be greater than preset threshold, and the total amount of first metadata is
The summation of the metadata of every kind of business datum in the memory of the storage server;Determine that first metadata is to deposit to lower brush to this
Store up the metadata of the disk in server;First metadata is stored to the disk into the storage server.
In a kind of possible implementation, which is also used to:
Determine that the total amount of the second metadata is greater than preset threshold, the total amount of second metadata is the interior of the storage server
It deposits in addition to first metadata, the summation of the metadata of every kind of business datum;
Determine that second metadata is the metadata to lower brush to disk;
The second metadata brush task is generated according to second metadata, which is used to indicate this
Storage server will brush under second metadata to the disk;
The second metadata brush task is added in plate to be brushed queue.
In alternatively possible implementation, which is also used to:
Determine that first metadata stores successfully in the disk;
Execute the second metadata brush task.
In alternatively possible implementation, which is also used to:
The access count for determining the metadata list item of first metadata is zero;
Update the access address of first metadata;
Delete first metadata in the memory.
It is apparent to those skilled in the art that for convenience and simplicity of description, the system of foregoing description,
The specific work process of device and unit, can refer to corresponding processes in the foregoing method embodiment, and details are not described herein.
In several embodiments provided herein, it should be understood that disclosed system, device and method can be with
It realizes by another way.For example, the apparatus embodiments described above are merely exemplary, for example, the unit
It divides, only a kind of logical function partition, there may be another division manner in actual implementation, such as multiple units or components
It can be combined or can be integrated into another system, or some features can be ignored or not executed.Another point, it is shown or
The mutual coupling, direct-coupling or communication connection discussed can be through some interfaces, the indirect coupling of device or unit
It closes or communicates to connect, can be electrical property, mechanical or other forms.
The unit as illustrated by the separation member may or may not be physically separated, aobvious as unit
The component shown may or may not be physical unit, it can and it is in one place, or may be distributed over multiple
In network unit.It can select some or all of unit therein according to the actual needs to realize the mesh of this embodiment scheme
's.
It, can also be in addition, each functional unit in each embodiment of the application can integrate in one processing unit
It is that each unit physically exists alone, can also be integrated in one unit with two or more units.Above-mentioned integrated list
Member both can take the form of hardware realization, can also realize in the form of software functional units.
If the integrated unit is realized in the form of SFU software functional unit and sells or use as independent product
When, it can store in a computer readable storage medium.Based on this understanding, the technical solution of the application is substantially
The all or part of the part that contributes to existing technology or the technical solution can be in the form of software products in other words
It embodies, which is stored in a storage medium, including some instructions are used so that a computer
Equipment (can be personal computer, server or the network equipment etc.) executes the complete of each embodiment the method for the application
Portion or part steps.And storage medium above-mentioned includes: USB flash disk, mobile hard disk, read-only memory (ROM, Read-Only
Memory), random access memory (RAM, Random Access Memory), magnetic or disk etc. are various can store journey
The medium of sequence code.
The above, above embodiments are only to illustrate the technical solution of the application, rather than its limitations;Although referring to before
Embodiment is stated the application is described in detail, those skilled in the art should understand that: it still can be to preceding
Technical solution documented by each embodiment is stated to modify or equivalent replacement of some of the technical features;And these
It modifies or replaces, the spirit and scope of each embodiment technical solution of the application that it does not separate the essence of the corresponding technical solution.
Claims (10)
1. a kind of metadata management method, which is characterized in that the described method includes:
Storage server determines that the total amount of the first metadata is greater than preset threshold, and the total amount of first metadata is the storage
The summation of the metadata of every kind of business datum in the memory of server;
The storage server determines that first metadata is the metadata of the disk to lower brush into the storage server;
First metadata is stored the disk into the storage server by the storage server.
2. the method according to claim 1, wherein the storage server by first metadata store to
After disk in the storage server, the method also includes:
The storage server determines that the total amount of the second metadata is greater than preset threshold, and the total amount of second metadata is described
In the memory of storage server in addition to first metadata, the summation of the metadata of every kind of business datum;
The storage server determines that second metadata is the metadata to lower brush to disk;
The storage server generates the second metadata brush task, the second metadata brush according to second metadata
Task is used to indicate the storage server for brush under second metadata to the disk;
The second metadata brush task is added in plate to be brushed queue the storage server.
3. according to the method described in claim 2, it is characterized in that, the storage server appoints the second metadata brush
After business is added in plate to be brushed queue, the method also includes:
The storage server determines that first metadata stores successfully in the disk;
The storage server executes the second metadata brush task.
4. method according to any one of claims 1 to 3, which is characterized in that the storage server is by described
After one metadata stores the disk into the storage server, the method also includes:
The storage server determines that the access count of the metadata list item of first metadata is zero;
The storage server updates the access address of first metadata;
The storage server deletes first metadata in the memory.
5. a kind of storage server, which is characterized in that the storage server includes:
First determination unit, for determining that the total amount of the first metadata is greater than preset threshold, the total amount of first metadata is
The summation of the metadata of every kind of business datum in the memory of the storage server;
Second determination unit, for determining that first metadata is first number of the disk to lower brush into the storage server
According to;
Storage unit, for first metadata to be stored to the disk into the storage server.
6. storage server according to claim 5, which is characterized in that first determination unit is also used to:
Determine that the total amount of the second metadata is greater than preset threshold, the total amount of second metadata is the interior of the storage server
It deposits in addition to first metadata, the summation of the metadata of every kind of business datum;
Second determination unit is also used to:
Determine that second metadata is the metadata to lower brush to disk;
The storage server further include:
Generation unit, for generating the second metadata brush task, the second metadata brush according to second metadata
Task is used to indicate the storage server for brush under second metadata to the disk;
Adding unit, for the second metadata brush task to be added in plate to be brushed queue.
7. storage server according to claim 6, which is characterized in that the storage server further include:
Third determination unit, for determining that first metadata stores successfully in the disk;
Execution unit, for executing the second metadata brush task.
8. the storage server according to any one of claim 5 to 7, which is characterized in that the storage server is also
Include:
4th determination unit, for determining that the access count of metadata list item of first metadata is zero;
Updating unit, for updating the access address of first metadata;
Unit is deleted, for deleting first metadata in the memory.
9. a kind of computer program product comprising instruction, which is characterized in that when run on a computer, so that the meter
Calculation machine executes method according to any one of claims 1 to 4.
10. a kind of computer readable storage medium, which is characterized in that including instruction, when described instruction is run on computers,
So that computer executes method according to any one of claims 1 to 4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810819598.5A CN109240993A (en) | 2018-07-24 | 2018-07-24 | Metadata management method and storage server |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810819598.5A CN109240993A (en) | 2018-07-24 | 2018-07-24 | Metadata management method and storage server |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109240993A true CN109240993A (en) | 2019-01-18 |
Family
ID=65073015
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810819598.5A Pending CN109240993A (en) | 2018-07-24 | 2018-07-24 | Metadata management method and storage server |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109240993A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115904646A (en) * | 2021-09-30 | 2023-04-04 | 北京金山云网络技术有限公司 | Request processing method, device, electronic device and storage medium |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7849091B1 (en) * | 2006-01-25 | 2010-12-07 | At&T Intellectual Property Ii, L.P. | Meta-data indexing for XPath location steps |
| CN102938001A (en) * | 2012-12-10 | 2013-02-20 | 曙光信息产业(北京)有限公司 | Data loading device and data loading method |
| CN104809237A (en) * | 2015-05-12 | 2015-07-29 | 百度在线网络技术(北京)有限公司 | LSM-tree (The Log-Structured Merge-Tree) index optimization method and LSM-tree index optimization system |
| CN105094711A (en) * | 2015-09-22 | 2015-11-25 | 浪潮(北京)电子信息产业有限公司 | Method and device for achieving copy-on-write file system |
| CN106648442A (en) * | 2015-10-29 | 2017-05-10 | 阿里巴巴集团控股有限公司 | Metadata node internal memory mirroring method and device |
| CN107122364A (en) * | 2016-02-25 | 2017-09-01 | 华为技术有限公司 | Data manipulation method and data management server |
| CN107992432A (en) * | 2017-11-28 | 2018-05-04 | 福建中金在线信息科技有限公司 | The method and terminal device of a kind of data buffer storage |
-
2018
- 2018-07-24 CN CN201810819598.5A patent/CN109240993A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7849091B1 (en) * | 2006-01-25 | 2010-12-07 | At&T Intellectual Property Ii, L.P. | Meta-data indexing for XPath location steps |
| CN102938001A (en) * | 2012-12-10 | 2013-02-20 | 曙光信息产业(北京)有限公司 | Data loading device and data loading method |
| CN104809237A (en) * | 2015-05-12 | 2015-07-29 | 百度在线网络技术(北京)有限公司 | LSM-tree (The Log-Structured Merge-Tree) index optimization method and LSM-tree index optimization system |
| CN105094711A (en) * | 2015-09-22 | 2015-11-25 | 浪潮(北京)电子信息产业有限公司 | Method and device for achieving copy-on-write file system |
| CN106648442A (en) * | 2015-10-29 | 2017-05-10 | 阿里巴巴集团控股有限公司 | Metadata node internal memory mirroring method and device |
| CN107122364A (en) * | 2016-02-25 | 2017-09-01 | 华为技术有限公司 | Data manipulation method and data management server |
| CN107992432A (en) * | 2017-11-28 | 2018-05-04 | 福建中金在线信息科技有限公司 | The method and terminal device of a kind of data buffer storage |
Non-Patent Citations (3)
| Title |
|---|
| T. MAHMOOD: "Ensuring Cache Reliability and Energy Scaling at Near-Threshold Voltage With Macho", 《IEEE TRANSACTIONS ON COMPUTERS》 * |
| 王江涛: "闪存数据库:现状、技术与展望", 《计算机学报》 * |
| 王继成: "《大数据时代高校信息化战略与实践》", 31 May 2016, 东北大学出版社 * |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115904646A (en) * | 2021-09-30 | 2023-04-04 | 北京金山云网络技术有限公司 | Request processing method, device, electronic device and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN114022148B (en) | Transaction conflict detection method, device, equipment and storage medium based on block chain | |
| CN110737682A (en) | cache operation method, device, storage medium and electronic equipment | |
| US20210096981A1 (en) | Identifying differences in resource usage across different versions of a software application | |
| CN112559522A (en) | Data storage method and device, query method, electronic device and readable medium | |
| CN108255620A (en) | A kind of business logic processing method, apparatus, service server and system | |
| CN111831752B (en) | Distributed database space arrangement method, device, equipment and storage medium | |
| CN110858122B (en) | Method and device for storing data | |
| CN104423982A (en) | Request processing method and device | |
| CN108984104A (en) | Method and apparatus for cache management | |
| CN112596949A (en) | High-efficiency SSD (solid State disk) deleted data recovery method and system | |
| CN109086141A (en) | EMS memory management process and device and computer readable storage medium | |
| CN107832446A (en) | A kind of searching method and computing device of configuration item information | |
| CN102542036B (en) | Use the table optimized | |
| CN111399753A (en) | Method and device for writing pictures | |
| JP2021515299A (en) | A system for chronological out-of-place updates, a method for chronological out-of-place updates, and a computer program for chronological out-of-place updates. | |
| CN106815232A (en) | Catalog management method, apparatus and system | |
| CN110022341A (en) | A kind of data transmission method and relevant device | |
| CN109240993A (en) | Metadata management method and storage server | |
| CN107515724A (en) | For the method and apparatus for the input and output for reproducing storage system | |
| CN109857519A (en) | The processing method and relevant apparatus of virtual disk | |
| CN114153732A (en) | Failure scenario test method, device, electronic device and storage medium | |
| CN105278877A (en) | Object storage method and device | |
| CN113760446A (en) | Resource scheduling method, apparatus, device and medium | |
| CN109976945A (en) | A kind of method and device of Log backup | |
| US20230004991A1 (en) | Methods and systems for identifying breakpoints in variable impact on model results |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190118 |
|
| RJ01 | Rejection of invention patent application after publication |