CN111046009A - Log storage method and device - Google Patents
Log storage method and device Download PDFInfo
- Publication number
- CN111046009A CN111046009A CN201911094101.9A CN201911094101A CN111046009A CN 111046009 A CN111046009 A CN 111046009A CN 201911094101 A CN201911094101 A CN 201911094101A CN 111046009 A CN111046009 A CN 111046009A
- Authority
- CN
- China
- Prior art keywords
- log
- platform
- storage
- management
- query
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/18—File system types
- G06F16/1805—Append-only file systems, e.g. using logs or journals to store data
- G06F16/1815—Journaling file systems
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/18—File system types
- G06F16/182—Distributed file systems
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/18—File system types
- G06F16/185—Hierarchical storage management [HSM] systems, e.g. file migration or policies thereof
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Debugging And Monitoring (AREA)
Abstract
The application provides a log storage method and a device, wherein the method is applied to a management level platform in a distributed log management system, the distributed log management system further comprises at least one lower level platform, and the method comprises the following steps: receiving a log sent by the connected network equipment; determining whether to store the received log in a grading way according to the set log storage mode; if yes, distributing a lower platform for each log, and sending the log to the distributed lower platforms for storage; and if not, locally storing the log. By applying the method, the phenomenon of the overfill of the disks of the management level platform and the lower level platform can be effectively avoided, and various performances of the management level platform and the lower level platform are improved.
Description
Technical Field
The present application relates to the field of data processing technologies, and in particular, to a log storage method and apparatus.
Background
The log is information for recording problems and events generated during the operation of hardware, software, systems and the like in the network equipment, and a user can effectively master the operation condition of the network equipment or locate the reason of error occurrence by counting and analyzing the log, or search traces left by an attacker when the attacker is attacked.
The traditional log storage system adopts a centralized storage server to store logs generated by all network equipment, and the logs are continuously generated along with the operation of the network equipment, so that the storage space of a disk on the storage server is continuously consumed, and indexes such as performance, reliability, safety and the like of the storage server are tested.
Disclosure of Invention
In view of this, the present application provides a log storage method and apparatus, so as to solve the problem in the prior art that the storage space of a disk on a storage server is continuously consumed and various performance indexes of the storage server are affected when a centralized storage server is used to store logs generated by all network devices.
Specifically, the method is realized through the following technical scheme:
according to a first aspect of embodiments of the present application, there is provided a log storage method, where the method is applied to a management-level platform in a distributed log management system, where the distributed log management system further includes at least one lower-level platform, and the method includes:
receiving a log sent by the connected network equipment;
determining whether to store the received log in a grading way according to the set log storage mode;
if yes, distributing a lower platform for each log, and sending the log to the distributed lower platforms for storage; and if not, locally storing the log.
Optionally, the allocating a lower platform to each log includes:
traversing a local log storage path when the set log distribution condition is met;
distributing a lower platform for the traversed log;
after sending the log to the assigned lower platform for storage, the method further comprises:
and deleting the sent log from the local log storage path.
Optionally, the method further includes:
receiving a log query request sent by a client;
determining whether to perform hierarchical query according to the log storage mode;
if so, sending the log query request to at least one subordinate platform so that the subordinate platform locally queries a log matched with the log query request; and if not, locally inquiring the log matched with the log inquiry request.
Optionally, the method further includes:
receiving a log query result sent by the lower platform, wherein the log query result comprises log information of a log which is queried by the lower platform and matched with the log query request;
and reporting the log query result to the client for display.
Optionally, the log storage mode includes:
a load sharing distribution mode, or a load sharing non-distribution mode.
According to a second aspect of embodiments of the present application, there is provided a log storage apparatus, which is applied to a management-level platform in a distributed log management system, the distributed log management system further including at least one lower-level platform, the apparatus including:
the log receiving module is used for receiving logs sent by the connected network equipment;
the first determining module is used for determining whether to store the received logs in a grading way according to the set log storage mode;
the log distribution module is used for distributing a lower platform for each log and sending the log to the distributed lower platform for storage if the received logs are determined to be stored in a grading way;
and the log storage module is used for locally storing the received logs if the received logs are determined not to be stored in a grading way.
Optionally, the log distributing module includes:
the traversing submodule is used for traversing the local log storage path when the set log distribution condition is met;
the distribution submodule is used for distributing a lower platform for the traversed log;
the device further comprises:
and the log deleting module is used for deleting the sent log from the local log storage path.
Optionally, the apparatus further comprises:
the request receiving module is used for receiving a log query request sent by a client;
the second determining module is used for determining whether to carry out hierarchical query according to the log storage mode;
the request issuing module is used for issuing the log query request to at least one subordinate platform if the hierarchical query is determined to be carried out, so that the subordinate platform locally queries the log matched with the log query request;
and the query module is used for locally querying the logs matched with the log query request if the hierarchical query is determined not to be performed.
Optionally, the apparatus further comprises:
the result receiving module is used for receiving a log query result sent by the lower platform, wherein the log query result comprises log information of a log which is queried by the lower platform and matched with the log query request;
and the result reporting module is used for reporting the log query result to the client for display.
Optionally, the log storage mode includes:
a load sharing distribution mode, or a load sharing non-distribution mode.
According to the method, after the management platform receives the log sent by the connected network equipment, the log can be sent to the lower platform to be stored, and can also be stored locally, so that distributed storage of the log can be realized, the phenomenon that the management platform and the lower platform are full of disks is effectively avoided, and various performances of the management platform and the lower platform are improved.
Drawings
Fig. 1 is a schematic structural diagram of a distributed log management system in which a log storage method is implemented according to an embodiment of the present application;
FIG. 2 is a flowchart of an embodiment of a log storage method according to an exemplary embodiment of the present application;
FIG. 3 is a flowchart illustrating an implementation of step 203 according to an exemplary embodiment of the present application;
FIG. 4 is a flowchart illustrating an implementation of a log query process according to an exemplary embodiment of the present application;
fig. 5 is a hardware structure diagram of a server in which the log storage device of the present application is located.
Fig. 6 is a block diagram of an embodiment of a log storage device according to an exemplary embodiment of the present application.
Detailed Description
Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, like numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present application. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present application, as detailed in the appended claims.
The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the application. As used in this application and the appended claims, the singular forms "a", "an", and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It should also be understood that the term "and/or" as used herein refers to and encompasses any and all possible combinations of one or more of the associated listed items.
It is to be understood that although the terms first, second, third, etc. may be used herein to describe various information, such information should not be limited to these terms. These terms are only used to distinguish one type of information from another. For example, first information may also be referred to as second information, and similarly, second information may also be referred to as first information, without departing from the scope of the present application. The word "if" as used herein may be interpreted as "at … …" or "when … …" or "in response to a determination", depending on the context.
Referring to fig. 1, a schematic structural diagram of a distributed log management system for implementing a log storage method according to an embodiment of the present application is shown.
As shown in FIG. 1, the distributed log management system 100 comprises log management platforms 101-104 and a network 105. The network 105 is used for providing communication links between the log management platforms 101 to 104, and may include a wireless link, a wired link, or an optical fiber cable, which is not limited in this application. The log management platforms 101-104 may be hardware supporting services such as log storage, analysis, management, and the like, including but not limited to desktop computers, servers, server clusters, and the like.
In practical application, a user can set one of the log management platforms 101 to 104 as a management platform according to factors such as performance, service type, and the number of connected network devices, and the other platforms are subordinate platforms of the management platform. For example, the log management platform 101 is set as a management-level platform, and the log management platforms 102 to 104 are set as lower-level platforms.
It will be understood that the number of networks and devices in fig. 1 is merely illustrative. The distributed log management system architecture 100 may include any number of networks and devices, as desired, and is not limited in this application.
Thus, the description of the system architecture shown in fig. 1 is completed.
For the convenience of understanding, two log storage modes involved in the embodiment of the present application are described in conjunction with the system architecture illustrated in fig. 1, and as an example, the following two log storage modes are set for the management-level platform:
(1) load sharing distribution mode
In the load sharing distribution mode, all network devices (e.g., firewalls, terminal devices, routers, etc.) are connected to the management level platform, that is, all network devices uniformly send generated logs to the management level platform. And under the load sharing and distributing mode, the management platform can distribute the received logs to the lower platform for storage, and the management platform does not store the logs.
In addition, in the load sharing distribution mode, the management level platform may also synchronize device information (e.g., IP address, serial number, etc.) of the connected network devices to each lower level platform.
(2) Load sharing non-distribution mode
In the load sharing and non-distribution mode, the management platform and each lower platform are respectively connected with a network device, that is, in the load sharing and non-distribution mode, the management platform and each lower platform are respectively independent log storage platforms, and the network device sends the generated logs to the platform connected with the network device and stores the logs by the platform connected with the network device.
In addition, under the load sharing and non-distribution mode, each lower platform can report the device information of the connected network device to the management platform, and management can be facilitated through the processing.
So far, the description of the two log storage modes involved in the embodiments of the present application is completed.
The following describes a log storage method proposed by the present application by way of an embodiment:
referring to fig. 2, a flowchart of an embodiment of a log storage method provided in an exemplary embodiment of the present application is provided, and as an example, the method may be applied to a management-level platform, such as the platform 101, in the distributed log management system 100 illustrated in fig. 1.
As shown in fig. 2, the process may include the following steps:
step 201: and receiving the log sent by the connected network equipment.
In the application, the network device sends the log generated in the operation to the log management platform connected with the network device, so that the log management platform can receive the log sent by the network device connected with the log management platform.
In this application, as can be seen from the above description, no matter in the load sharing and distributing mode or in the load sharing and non-distributing mode, the management-level platform is connected to the network device, so that in this step 201, the management-level platform may receive the log sent by the network device connected to the management-level platform.
Step 202: determining whether to store the received log in a grading way according to the set log storage mode; if yes, go to step 203, otherwise go to step 204.
As can be seen from the above description, in the load sharing and distributing mode, the management platform may distribute the received log to the lower platform for storage, and the management platform does not store the log, and in the load sharing and non-distributing mode, the manager platform is an independent log storage platform and may directly store the log sent by the network device connected to the manager platform.
Based on this, in this step 202, the management-level platform may determine to store the received logs hierarchically when the management-level platform is set to the load-sharing distribution mode, and perform step 203, and may determine not to store the received logs hierarchically when the management-level platform is set to the load-sharing non-distribution mode, and perform step 204.
Step 203: and distributing a lower platform for each log, and sending the log to the distributed lower platform for storage.
The management platform determines to store the received logs hierarchically in step 202, so in this step 203, the management platform may allocate a lower platform to each log, and send the log to the allocated lower platform for storage.
As to how the management-level platform allocates lower-level platforms to each log, the following description is given by way of example, and will not be repeated here.
Step 204: the log is stored locally.
The management-level platform, having determined through step 202 above that the received log is not to be stored hierarchically, can directly store the received log locally in this step 204.
It can be seen from the above embodiments that, after receiving the log sent by the connected network device, the management platform can send the log to the lower platform for storage, and can also store the log locally, so that distributed storage of the log can be realized, thereby effectively avoiding the phenomenon of overfilling of the disks of the management platform and the lower platform, and improving various performances of the management platform and the lower platform.
The following describes how the management level platform allocates the lower level platform for each log separately:
referring to fig. 3, a flow of implementing step 203 is shown for an exemplary embodiment of the present application. As shown in fig. 3, the process may include the following steps:
step 301: and traversing the local log storage path when the set log distribution condition is met.
As an example, when receiving the log sent by the network device, the management-level platform may first temporarily store the log locally. In the application, when the set log distribution condition is met, the process of distributing the log to the lower-level platform is executed again.
As an example, the log distribution condition set as described above may be: the set timer reaches a timeout. That is, the management platform may perform the process of distributing the log to the lower platform at regular intervals.
As an example, the log distribution condition set as described above may be: the number of the logs stored by the management-level platform reaches a set number threshold, or the storage space occupied by the logs reaches a set space threshold.
As one example, the management-level platform may traverse a local log storage path when a set log distribution condition is satisfied.
Step 302: and distributing a lower platform for the traversed log, and sending the log to the distributed lower platform for storage.
As an example, the management level platform may allocate a lower level platform for each traversal of a log, and send the log to the allocated lower level platform for storage.
As an example, the management-level platform may assign a lower-level platform to the traversed log by using an average random assignment algorithm.
As an example, the management-level platform may obtain storage-related information of each lower-level platform, such as storage amount, remaining storage space size, and the like, and allocate one lower-level platform for the traversed log. How the management-level platform obtains the storage-related information of each lower-level platform is not described herein again.
As an example, the management platform may send the log to the assigned lower platform for storage by means of FTP (File Transfer Protocol).
Step 303: and deleting the sent log from the local log storage path.
As can be seen from the above description, the management-level platform does not store the log in the load sharing distribution mode, and therefore, in this step 303, the management-level platform may delete the sent log from the local log storage path.
The flow shown in fig. 3 is completed.
Through the process shown in fig. 3, it is finally achieved that the management level platform allocates a lower level platform for each received log in the load sharing and distributing mode, and sends the log to the allocated lower level platform for storage.
It should be noted that the flow illustrated in fig. 3 is only an exemplary description of how the management level platform allocates the lower level platform to each log, and in practical application, the management level platform may also allocate the lower level platform to the log in other manners, for example, the management level platform may allocate the lower level platform to the log every time the management level platform receives one log, which is not limited in this application.
In addition, in the application, there is a log query requirement, and the following describes the log query process by an embodiment:
referring to fig. 4, a flow for implementing a log query process according to an exemplary embodiment of the present application is provided.
As shown in fig. 4, the process may include the following steps:
step 401: and receiving a log query request sent by a client.
In application, a user can send a log query request to the management-level platform through a client, so that the management-level platform can receive the log query request sent by the client.
As one example, the log query request may include, but is not limited to: log generation time, event type, network device identification, etc.
Step 402: determining whether to perform hierarchical query according to a log storage mode; if yes, go to step 403, otherwise go to step 404.
As can be seen from the above description, in the load sharing and distributing mode, the management platform may distribute the received log to the lower platform for storage, and the management platform does not store the log, and in the load sharing and non-distributing mode, the manager platform is an independent log storage platform and may directly store the log sent by the network device connected to the manager platform.
Based on this, in this step 402, the management-level platform may determine to perform hierarchical query when set to the load sharing distribution mode, and perform step 403, and may determine not to perform hierarchical query when set to the load sharing non-distribution mode, and perform step 404.
Step 403: and issuing the log query request to at least one lower platform so that the lower platform locally queries the log matched with the log query request, and executing step 405.
If the management platform determines to perform hierarchical query in step 402, in this step 403, the management platform may issue the log query request received in step 401 to at least one lower platform, so that the lower platform locally queries a log matching the log query request.
As an example, the management level platform may issue a log query request to each of the lower level platforms.
As an example, the management level platform may issue the log query request to a portion of the lower level platforms. For example, the lower platform may be specified by the user in advance, so that in this step 403, the management level platform may issue the log query request to the lower platform specified by the user.
As to how the lower platform locally queries the log matched with the log query request, details are not repeated in this application.
Step 404: and locally inquiring the log matched with the log inquiry request.
The management level platform has determined, via step 402 above, that a hierarchical query is not to be made, then in this step 404, the management level platform may locally query logs that match the log query request. As to how the management-level platform locally queries the log matched with the log query request, details are not repeated in this application.
Step 405: and receiving a log query result sent by the lower platform, wherein the log query result comprises log information of a log which is queried by the lower platform and is matched with the log query request.
In the application, if the lower platform locally queries the log matched with the log query request, the log information of the matched log can be sent to the management platform as a log query result, so that the management platform can receive the log query result sent by the lower platform.
As an example, the log information may include, but is not limited to: the log generation time, the event type, the network equipment identifier, log keywords, such as internet traffic, website access, and the like.
Step 406: and reporting the log query result to the client for display.
In this application, after receiving the log query result sent by the lower platform through the execution step 405, the management platform may report the log query result to the client for display.
By the embodiment shown in fig. 4, the log query based on the distributed storage log is finally realized.
Corresponding to the embodiment of the log storage method, the application also provides an embodiment of a log storage device.
The embodiment of the log storage device can be applied to a server. The device embodiments may be implemented by software, or by hardware, or by a combination of hardware and software. Taking a software implementation as an example, as a logical device, the device is formed by reading corresponding computer program instructions in the nonvolatile memory into the memory for operation through the processor of the server where the device is located. From a hardware aspect, as shown in fig. 5, it is a hardware structure diagram of a server where the log storage device of the present application is located, except for the processor 51, the memory 52, the network interface 53, the nonvolatile memory 54, and the internal bus 55 shown in fig. 5, the server where the device is located in the embodiment may also include other hardware according to the actual function of the server, which is not described again.
Referring to fig. 6, a block diagram of an embodiment of a log storage apparatus provided in an exemplary embodiment of the present application, where the apparatus is applicable to a management-level platform in a distributed log management system, where the distributed log management system further includes at least one lower-level platform, and the apparatus may include: a log receiving module 61, a first determining module 62, a log distributing module 63, and a log storing module 64.
The log receiving module 61 is configured to receive a log sent by a connected network device;
a first determining module 62, configured to determine whether to perform hierarchical storage on the received log according to the set log storage mode;
the log distributing module 63 is configured to, if it is determined that the received logs are stored in a hierarchical manner, allocate a lower-level platform to each log, and send the log to the allocated lower-level platform for storage;
and a log storage module 64, configured to store the received log locally if it is determined that the log is not stored hierarchically.
In an embodiment, the log distribution module 63 comprises (not shown in fig. 6):
the traversing submodule is used for traversing the local log storage path when the set log distribution condition is met;
the distribution submodule is used for distributing a lower platform for the traversed log;
the device further comprises (not shown in fig. 6):
and the log deleting module is used for deleting the sent log from the local log storage path.
In an embodiment, the apparatus further comprises (not shown in fig. 6):
the request receiving module is used for receiving a log query request sent by a client;
the second determining module is used for determining whether to carry out hierarchical query according to the log storage mode;
the request issuing module is used for issuing the log query request to at least one subordinate platform if the hierarchical query is determined to be carried out, so that the subordinate platform locally queries the log matched with the log query request;
and the query module is used for locally querying the logs matched with the log query request if the hierarchical query is determined not to be performed.
In an embodiment, the apparatus further comprises (not shown in fig. 6):
the result receiving module is used for receiving a log query result sent by the lower platform, wherein the log query result comprises log information of a log which is queried by the lower platform and matched with the log query request;
and the result reporting module is used for reporting the log query result to the client for display.
In one embodiment, the log storage mode comprises: a load sharing distribution mode, or a load sharing non-distribution mode.
The implementation process of the functions and actions of each unit in the above device is specifically described in the implementation process of the corresponding step in the above method, and is not described herein again.
For the device embodiments, since they substantially correspond to the method embodiments, reference may be made to the partial description of the method embodiments for relevant points. The above-described embodiments of the apparatus are merely illustrative, and the units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the modules can be selected according to actual needs to achieve the purpose of the scheme of the application. One of ordinary skill in the art can understand and implement it without inventive effort.
The above description is only exemplary of the present application and should not be taken as limiting the present application, as any modification, equivalent replacement, or improvement made within the spirit and principle of the present application should be included in the scope of protection of the present application.
Claims (10)
1. A log storage method applied to a management-level platform in a distributed log management system, the distributed log management system further comprising at least one lower-level platform, the method comprising:
receiving a log sent by the connected network equipment;
determining whether to store the received log in a grading way according to the set log storage mode;
if yes, distributing a lower platform for each log, and sending the log to the distributed lower platforms for storage; and if not, locally storing the log.
2. The method of claim 1, wherein assigning a lower level platform to each log comprises:
traversing a local log storage path when the set log distribution condition is met;
distributing a lower platform for the traversed log;
after sending the log to the assigned lower platform for storage, the method further comprises:
and deleting the sent log from the local log storage path.
3. The method of claim 1, further comprising:
receiving a log query request sent by a client;
determining whether to perform hierarchical query according to the log storage mode;
if so, sending the log query request to at least one subordinate platform so that the subordinate platform locally queries a log matched with the log query request; and if not, locally inquiring the log matched with the log inquiry request.
4. The method of claim 3, further comprising:
receiving a log query result sent by the lower platform, wherein the log query result comprises log information of a log which is queried by the lower platform and matched with the log query request;
and reporting the log query result to the client for display.
5. The method of any of claims 1 to 4, wherein the log storage mode comprises:
a load sharing distribution mode, or a load sharing non-distribution mode.
6. A log storage device applied to a management-level platform in a distributed log management system, the distributed log management system further comprising at least one lower-level platform, the device comprising:
the log receiving module is used for receiving logs sent by the connected network equipment;
the first determining module is used for determining whether to store the received logs in a grading way according to the set log storage mode;
the log distribution module is used for distributing a lower platform for each log and sending the log to the distributed lower platform for storage if the received logs are determined to be stored in a grading way;
and the log storage module is used for locally storing the received logs if the received logs are determined not to be stored in a grading way.
7. The apparatus of claim 6, wherein the log distribution module comprises:
the traversing submodule is used for traversing the local log storage path when the set log distribution condition is met;
the distribution submodule is used for distributing a lower platform for the traversed log;
the device further comprises:
and the log deleting module is used for deleting the sent log from the local log storage path.
8. The apparatus of claim 6, further comprising:
the request receiving module is used for receiving a log query request sent by a client;
the second determining module is used for determining whether to carry out hierarchical query according to the log storage mode;
the request issuing module is used for issuing the log query request to at least one subordinate platform if the hierarchical query is determined to be carried out, so that the subordinate platform locally queries the log matched with the log query request;
and the query module is used for locally querying the logs matched with the log query request if the hierarchical query is determined not to be performed.
9. The apparatus of claim 8, further comprising:
the result receiving module is used for receiving a log query result sent by the lower platform, wherein the log query result comprises log information of a log which is queried by the lower platform and matched with the log query request;
and the result reporting module is used for reporting the log query result to the client for display.
10. The apparatus according to any one of claims 6 to 9, wherein the log storage mode comprises:
a load sharing distribution mode, or a load sharing non-distribution mode.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911094101.9A CN111046009B (en) | 2019-11-11 | 2019-11-11 | Log storage method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911094101.9A CN111046009B (en) | 2019-11-11 | 2019-11-11 | Log storage method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111046009A true CN111046009A (en) | 2020-04-21 |
| CN111046009B CN111046009B (en) | 2023-11-21 |
Family
ID=70232352
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911094101.9A Active CN111046009B (en) | 2019-11-11 | 2019-11-11 | Log storage method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111046009B (en) |
Citations (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20110040788A1 (en) * | 2009-08-14 | 2011-02-17 | Ic Manage, Inc. | Coherent File State System Distributed Among Workspace Clients |
| CN102571845A (en) * | 2010-12-20 | 2012-07-11 | 南京中兴新软件有限责任公司 | Data storage method and device of distributed storage system |
| CN103051681A (en) * | 2012-12-06 | 2013-04-17 | 华中科技大学 | Collaborative type log system facing to distribution-type file system |
| US20130185329A1 (en) * | 2010-09-27 | 2013-07-18 | Telefonaktiebolaget L M Ericcson | Distributed database |
| US20140289370A1 (en) * | 2013-03-19 | 2014-09-25 | Canon Kabushiki Kaisha | Log management system, log management method, image forming apparatus and control method thereof, and non-transitory computer-readable medium |
| US9104745B1 (en) * | 2012-09-28 | 2015-08-11 | Palo Alto Networks, Inc. | Distributed log collector and report generation |
| CN105516367A (en) * | 2016-02-02 | 2016-04-20 | 北京百度网讯科技有限公司 | Distributed data storage system, method and device |
| CN106777371A (en) * | 2017-01-23 | 2017-05-31 | 北京齐尔布莱特科技有限公司 | Result collection system and method |
| CN106843750A (en) * | 2016-12-20 | 2017-06-13 | 中国科学院苏州生物医学工程技术研究所 | Distributed memory system |
| CN107835095A (en) * | 2017-11-20 | 2018-03-23 | 杭州迪普科技股份有限公司 | A kind of processing method and processing device of daily record |
| CN107947954A (en) * | 2016-10-12 | 2018-04-20 | 腾讯科技（深圳）有限公司 | Dynamic adjustment journal stage other system, method and server |
| CN108712296A (en) * | 2018-06-07 | 2018-10-26 | 郑州云海信息技术有限公司 | One kind being based on distributed daily record monitoring device and method |
| CN108846070A (en) * | 2018-06-07 | 2018-11-20 | 北京京东尚科信息技术有限公司 | Log processing method, system, electronic equipment and the storage medium of distributed system |
-
2019
- 2019-11-11 CN CN201911094101.9A patent/CN111046009B/en active Active
Patent Citations (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20110040788A1 (en) * | 2009-08-14 | 2011-02-17 | Ic Manage, Inc. | Coherent File State System Distributed Among Workspace Clients |
| US20130185329A1 (en) * | 2010-09-27 | 2013-07-18 | Telefonaktiebolaget L M Ericcson | Distributed database |
| CN102571845A (en) * | 2010-12-20 | 2012-07-11 | 南京中兴新软件有限责任公司 | Data storage method and device of distributed storage system |
| US9104745B1 (en) * | 2012-09-28 | 2015-08-11 | Palo Alto Networks, Inc. | Distributed log collector and report generation |
| CN103051681A (en) * | 2012-12-06 | 2013-04-17 | 华中科技大学 | Collaborative type log system facing to distribution-type file system |
| US20140289370A1 (en) * | 2013-03-19 | 2014-09-25 | Canon Kabushiki Kaisha | Log management system, log management method, image forming apparatus and control method thereof, and non-transitory computer-readable medium |
| CN105516367A (en) * | 2016-02-02 | 2016-04-20 | 北京百度网讯科技有限公司 | Distributed data storage system, method and device |
| CN107947954A (en) * | 2016-10-12 | 2018-04-20 | 腾讯科技（深圳）有限公司 | Dynamic adjustment journal stage other system, method and server |
| CN106843750A (en) * | 2016-12-20 | 2017-06-13 | 中国科学院苏州生物医学工程技术研究所 | Distributed memory system |
| CN106777371A (en) * | 2017-01-23 | 2017-05-31 | 北京齐尔布莱特科技有限公司 | Result collection system and method |
| CN107835095A (en) * | 2017-11-20 | 2018-03-23 | 杭州迪普科技股份有限公司 | A kind of processing method and processing device of daily record |
| CN108712296A (en) * | 2018-06-07 | 2018-10-26 | 郑州云海信息技术有限公司 | One kind being based on distributed daily record monitoring device and method |
| CN108846070A (en) * | 2018-06-07 | 2018-11-20 | 北京京东尚科信息技术有限公司 | Log processing method, system, electronic equipment and the storage medium of distributed system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111046009B (en) | 2023-11-21 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP3418877B1 (en) | Data writing and reading method and apparatus, and cloud storage system | |
| US20100115070A1 (en) | Method for generating manipulation requests of an initialization and administration database of server cluster, data medium and corresponding a server cluster, data medium and corresponding service cluster | |
| US6928459B1 (en) | Plurality of file systems using weighted allocation to allocate space on one or more storage devices | |
| US7392261B2 (en) | Method, system, and program for maintaining a namespace of filesets accessible to clients over a network | |
| US9411648B2 (en) | Flexible resource configuration management for computing clusters | |
| JP2007133586A (en) | Resource allocation arbitration device and resource allocation arbitration method | |
| CN101099132A (en) | Validation of resource functionality before grid jobs submitted to grid environments are used | |
| CN111163186B (en) | ID generation method, device, equipment and storage medium | |
| CN110798507B (en) | Method and system for DHCP address allocation memory | |
| CN111399761B (en) | Storage resource allocation method, device and equipment, and storage medium | |
| CN110636072B (en) | Target domain name scheduling method, device, equipment and storage medium | |
| CN103580899A (en) | Method and system for managing event logs, cloud service client side and virtualization platform | |
| CN111046009B (en) | Log storage method and device | |
| CN109451090A (en) | A kind of domain name analytic method and device | |
| CN104780235A (en) | IP attribution inquiry method and device and server | |
| JP5587254B2 (en) | Allocation apparatus, allocation program, allocation method, and allocation system | |
| CN116980146A (en) | Distribution method and device of fort machine, storage medium and electronic equipment | |
| Liu Sheng et al. | Data allocation design in computer networks: LAN versus MAN versus WAN | |
| US20060168108A1 (en) | Methods and systems for defragmenting subnet space within an adaptive infrastructure | |
| CN111212138B (en) | Cross-site storage system and data information access method | |
| CN109302505B (en) | Data transmission method, system, device and storage medium | |
| CN107491265B (en) | Method and apparatus for allocating Internet Protocol IP disks | |
| CN117579598B (en) | Method, device, equipment and medium for distributing IP address based on physical network card | |
| JP3950113B2 (en) | Job allocation method in grid system, grid mediation apparatus and program thereof | |
| CN118153079B (en) | Method and system for supporting cipher card key expansion |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |