CN102937956A - Method and device for storing real-time messages in intelligent substation - Google Patents
Method and device for storing real-time messages in intelligent substation Download PDFInfo
- Publication number
- CN102937956A CN102937956A CN2012101231184A CN201210123118A CN102937956A CN 102937956 A CN102937956 A CN 102937956A CN 2012101231184 A CN2012101231184 A CN 2012101231184A CN 201210123118 A CN201210123118 A CN 201210123118A CN 102937956 A CN102937956 A CN 102937956A
- Authority
- CN
- China
- Prior art keywords
- write
- disk
- message
- disks
- writing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title abstract description 15
- 238000012545 processing Methods 0.000 claims abstract description 4
- 239000002131 composite material Substances 0.000 claims description 3
- 230000005055 memory storage Effects 0.000 claims description 2
- 238000000605 extraction Methods 0.000 abstract description 3
- 238000012423 maintenance Methods 0.000 abstract description 2
- 230000002618 waking effect Effects 0.000 abstract 1
- 230000008901 benefit Effects 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 241001269238 Data Species 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 125000004122 cyclic group Chemical group 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000006386 memory function Effects 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000008520 organization Effects 0.000 description 1
Images
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a method and a device for storing real-time messages in an intelligent substation. The method includes a write-in step, a deleting step and a sleep processing step, wherein the write-in step includes sequentially numbering free disks in a system, selecting two disks from the free disks to serve as write-in disks, and sequentially writing the messages in the two disks when the messages are to be written in; the deleting step includes detecting the disks when the write-in step is performed and deleting part of the oldest data in the disks if the disks are fully written so as to achieve the purpose of circularly using disk space; and the sleep processing step includes placing the other unselected disks in the system in a sleep state when the write-in disks are selected in the write-in step and waking up the disks to write in the messages when the other disks need to be selected to perform write-in. By means of the method, massive messages in the intelligent substation can be concisely and orderly stored, finding and extraction efficiencies of the messages in later periods are improved, and maintenance and management levels of the substation are further improved.
Description
Technical field
The present invention relates to a kind of method for storing real-time data, relate in particular to a kind of storage means that real-time packet in the intelligent substation is adopted the tree structure cyclic redundancy.
Background technology
[0002] present, development along with intelligent grid, message data in the transformer station is concerned more and more, and the real-time packet storage system need to be processed a large amount of real time datas, and the data of magnanimity have proposed higher requirement to availability, reliability, the operating performance of system.Yet, existing method receive, often performance is low when storing, extracting these data, efficient is not high.And along with transformer station's time of putting into operation is more and more longer, the message amount of whole transformer station will increase gradually.Therefore, need to adopt a kind of reliable method that these magnanimity messages are stored, so as the later stage to the inquiry of message, call.
There are following problems in the packet storage mode of existing transformer station:
1, do not press the type of message classification: dissimilar message receives from a network interface, is stored in the identical file, brings difficulty for the message extraction of special packet type.
2, the TOC level of packet storage is simple: general message with a day all stores in the identical catalogue, if the message data that a period of time receives is excessive, will deposit a large amount of message files in the so single catalogue, causes the message retrieval inefficiency.
3, data have the risk of losing: if certain hard disk corruptions, so wherein the data of storage can be lost fully.
Summary of the invention
The object of the present invention is to provide the storage means of real-time packet in a kind of intelligent substation, this method can make in the intelligent substation message of magnanimity obtain succinct orderly storage, improve searching and extraction efficiency of later stage message, and then improve the maintenance and management level of transformer station.
Purpose of the present invention can realize by following technical measures:
The storage means of real-time packet comprises the steps: in a kind of intelligent substation
Write step: with the available disk number consecutively in the system, and therefrom select two disks as writing dish, fashionable when there being message to write, this message is written to simultaneously in two disks successively; Write fashionable carrying out message, record simultaneously epicycle data writing total amount, when the quantities of messages that writes when epicycle exceeds predetermined threshold values, perhaps, when any one disk breaks down, switchable disk then namely selects next disk as writing dish and proceed writing of message according to number order, then finishes this in two corresponding message files that write in the dish and takes turns write operation until this message correctly write simultaneously;
Delete step: in write step, disk is detected, full if disk is write, delete so the oldest data of part in this disk, reach the purpose that disk space recycles;
The sleep treatment step: when choose in the write step write dish after, all the other not selected disks in the system are placed sleep state, to select all the other disks to write fashionable when needs, wakes disk up again and carry out message and write.
The message file that writes in the said write step in the disk adopts the tree structure store path, and the catalogue level in described path is followed successively by network interface numbering, the composite catalog name in root directory, the message source of disk number, the packet storage at packet storage place, the filename of message from top to bottom.
The filename of described message is according to this message capturing time and type of message name.
Adopt the English alphabet order to the disk number consecutively in the said write step.
Described predetermined threshold values is set to 90% disk total volume.
Another object of the present invention provides the memory storage of real-time packet in a kind of intelligent substation, comprising:
Writing module: be used for the available disk number consecutively with system, and therefrom select two disks as writing dish, fashionable when there being message to write, this message is written to simultaneously in two disks successively; Write fashionable carrying out message, record simultaneously epicycle data writing total amount, when the quantities of messages that writes when epicycle exceeds predetermined threshold values, perhaps, when any one disk breaks down, switchable disk then namely selects next disk as writing dish and proceed writing of message according to number order, then finishes this in two corresponding message files that write in the dish and takes turns write operation until this message correctly write simultaneously;
Removing module: be used in write step disk being detected, full if disk is write, delete so the oldest data of part in this disk, reach the purpose that disk space recycles;
The sleep processing module: be used for when write step choose write dish after, all the other not selected disks in the system are placed sleep state, to select all the other disks to write fashionable when needs, wakes disk up again and carry out message and write.
The present invention contrasts prior art, have the following advantages: the present invention adopts a kind of dynamic pair of hard disk redundant storage message, the method had not only had the security of data of magnetic disk array storage but also can accomplish to only have and still has a hard disk to use in the system, and the memory function of system is not lost so.Improved greatly the availability of system.Like this, a large amount of real-time packets in the intelligent substation obtain reliable store and management, for the analysis of transformer station's fault provides Data support.In dynamically two hard disk redundant storage messages, adopt the method for message file tree structure store path, to store by the capture time generation catalogue of network interface numbering, type of message and message, the packet storage path is clear succinct; The message of storing in each catalogue is balanced to be distributed, and can reach the purpose of efficient retrieval message.
Description of drawings
Fig. 1 is the process flow diagram of message write step of the present invention;
Fig. 2 is the packet storage tree structure schematic diagram that adopts the inventive method.
Embodiment
The invention provides the storage means of real-time packet in a kind of intelligent substation, comprise the steps:
Write step: flow process as shown in Figure 1, available disk in the system is adopted English alphabet order (A, B, C, D, E etc.) number consecutively, and therefrom select two disks (such as A, B dish) as writing dish, fashionable when there being message to write, successively this message is written to simultaneously in two disks (A and B dish), the double plate redundancy writes; Write fashionable carrying out message, record simultaneously epicycle data writing total amount, when the quantities of messages that writes when epicycle exceeds predetermined threshold values (for example be 90% disk total volume), perhaps, when any one disk breaks down, switchable disk then namely selects next disk (for example C dish) as writing dish and proceed writing of message according to number order, then finishes this in two corresponding message files that write in the dish and takes turns write operation until this message correctly write simultaneously;
Delete step: in write step, disk is detected, full if disk is write, delete so the oldest data of part in this disk, reach the purpose that disk space recycles;
The sleep treatment step: when choose in the write step write dish after, all the other not selected disks in the system are placed sleep state, to select all the other disks to write fashionable when needs, wakes disk up again and carry out message and write.
The message file that writes in the said write step in the disk adopts the tree structure store path, the catalogue level in this path is followed successively by the network interface numbering, composite catalog name, the capture time of catching date and time, message of message, the filename of message in root directory, the message source of disk number, the packet storage at packet storage place from top to bottom, and the filename of message can be named according to this message capturing time and type of message.
The tree-like storage structural representation in certain path as shown in Figure 2, its complete path representation is:
A：packets/01/ALL/2012-01-31/03/00/03-00-11-301.pcap.gz
Wherein the implication of each level is as follows:
A: the disk at packet storage place;
Packets: the root directory of packet storage;
01: this catalogue is stored below is that network interface is numbered the message that 1 network interface is caught;
ALL: all messages of receiving from network interface all are put into the ALL catalogue;
2012-01-31: the catching the date of message;
03: the capture time of message is 03 o'clock;
00: the message capturing time is 00 minute;
03-00-11-301.pcap.gz: the file of packet storage.Wherein, 03-00-11-301 represent the capture time of message in the file be 03: 00: 11 301 milliseconds; Pcap.gz represents that this file is the GZIP compressed file of a pcap form.
This by minute organizing the method for storage directory can guarantee when network traffic data is larger, the file number in each storage directory is not too large.Based on this kind storage organization, can inquire about message by network interface numbering, type of message, time very efficiently.
The method has following several advantage:
1. the double plate redundancy writes, and also can not lose if can guarantee when data writing the single disk data that write so that break down.
2. as long as also have a disk not to be out of order in the system, system still can continue to store data.
3. improve the life-span of disk.Toward two disk data writings the time, other disk can be placed sleep pattern, reduce system power dissipation, guarantee the life-span of disk.
4. the utilization factor of disk is high.Write fashionablely at message, select dynamically two disk redundancys to write, to guarantee the real-time reliable memory of message.After the epicycle message write and finishes, one of them disk save data entered into sleep pattern, and the another one disk participates in the message redundancy storage of next round.
Embodiments of the present invention are not limited to this; under the above-mentioned basic fundamental thought of the present invention prerequisite;, all drop within the rights protection scope of the present invention modification, replacement or the change of other various ways that content of the present invention is made according to the ordinary skill knowledge of this area and customary means.
Claims (6)
1. the storage means of real-time packet in the intelligent substation is characterized in that comprising the steps:
Write step: with the available disk number consecutively in the system, and therefrom select two disks as writing dish, fashionable when there being message to write, this message is written to simultaneously in two disks successively; Write fashionable carrying out message, record simultaneously epicycle data writing total amount, when the quantities of messages that writes when epicycle exceeds predetermined threshold values, perhaps, when any one disk breaks down, switchable disk then namely selects next disk as writing dish and proceed writing of message according to number order, then finishes this in two corresponding message files that write in the dish and takes turns write operation until this message correctly write simultaneously;
Delete step: in write step, disk is detected, full if disk is write, delete so the oldest data of part in this disk, reach the purpose that disk space recycles;
The sleep treatment step: when choose in the write step write dish after, all the other not selected disks in the system are placed sleep state, to select all the other disks to write fashionable when needs, wakes disk up again and carry out message and write.
2. the storage means of real-time packet in the intelligent substation according to claim 1, it is characterized in that: the message file that writes in the said write step in the disk adopts the tree structure store path, and the catalogue level in described path is followed successively by network interface numbering, the composite catalog name in root directory, the message source of disk number, the packet storage at packet storage place, the filename of message from top to bottom.
3. the storage means of real-time packet in the intelligent substation according to claim 2 is characterized in that: the filename of described message is according to this message capturing time and type of message name.
4. the storage means of real-time packet to the described intelligent substation of 3 any one according to claim 1 is characterized in that: adopt the English alphabet order to the disk number consecutively in the said write step.
5. the storage means of real-time packet in the described intelligent substation of any one according to claim 4, it is characterized in that: described predetermined threshold values is set to 90% disk total volume.
6. the memory storage of real-time packet in the intelligent substation is characterized in that comprising:
Writing module: be used for the available disk number consecutively with system, and therefrom select two disks as writing dish, fashionable when there being message to write, this message is written to simultaneously in two disks successively; Write fashionable carrying out message, record simultaneously epicycle data writing total amount, when the quantities of messages that writes when epicycle exceeds predetermined threshold values, perhaps, when any one disk breaks down, switchable disk then namely selects next disk as writing dish and proceed writing of message according to number order, then finishes this in two corresponding message files that write in the dish and takes turns write operation until this message correctly write simultaneously;
Removing module: be used in write step disk being detected, full if disk is write, delete so the oldest data of part in this disk, reach the purpose that disk space recycles;
The sleep processing module: be used for when write step choose write dish after, all the other not selected disks in the system are placed sleep state, to select all the other disks to write fashionable when needs, wakes disk up again and carry out message and write.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2012101231184A CN102937956A (en) | 2012-04-25 | 2012-04-25 | Method and device for storing real-time messages in intelligent substation |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2012101231184A CN102937956A (en) | 2012-04-25 | 2012-04-25 | Method and device for storing real-time messages in intelligent substation |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN102937956A true CN102937956A (en) | 2013-02-20 |
Family
ID=47696854
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2012101231184A Pending CN102937956A (en) | 2012-04-25 | 2012-04-25 | Method and device for storing real-time messages in intelligent substation |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102937956A (en) |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104049917A (en) * | 2014-06-25 | 2014-09-17 | 北京思特奇信息技术股份有限公司 | Data processing method and system |
| CN104426687A (en) * | 2013-08-23 | 2015-03-18 | 南京南瑞继保电气有限公司 | A network storm filtering method applicable for a digital substation secondary device |
| CN104461385A (en) * | 2014-12-02 | 2015-03-25 | 国电南瑞科技股份有限公司 | Multi-hard disk balanced storage method with self-adaptive port traffic |
| CN104516953A (en) * | 2014-12-12 | 2015-04-15 | 国家电网公司 | Black box system for mass power dispatching automation message |
| CN109474492A (en) * | 2018-11-26 | 2019-03-15 | 许继集团有限公司 | A packet capture and positioning method |
| CN109918952A (en) * | 2019-03-08 | 2019-06-21 | 北京马尔马拉科技有限公司 | A kind of safer cloud computing platform system and processing method |
| CN115913751A (en) * | 2022-12-06 | 2023-04-04 | 江苏林洋能源股份有限公司 | Method, device, equipment and medium for analyzing data packets based on web pages |
| CN118796785A (en) * | 2024-09-11 | 2024-10-18 | 成都赛力斯科技有限公司 | Storage method, device, electronic device and storage medium for different vehicle-side data |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101118508A (en) * | 2007-08-24 | 2008-02-06 | 成都索贝数码科技股份有限公司 | Safe data storage method |
| CN101169705A (en) * | 2007-11-30 | 2008-04-30 | 中兴通讯股份有限公司 | Method and device for realizing file-level mirroring based on bare file system under multiple hard disks |
| CN101825992A (en) * | 2010-04-08 | 2010-09-08 | 杭州华三通信技术有限公司 | Saving method of data and device thereof |
| US20100328814A1 (en) * | 2009-06-26 | 2010-12-30 | Fujitsu Limited | Control apparatus, method of controlling apparatus and computer-readable recording medium |
-
2012
- 2012-04-25 CN CN2012101231184A patent/CN102937956A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101118508A (en) * | 2007-08-24 | 2008-02-06 | 成都索贝数码科技股份有限公司 | Safe data storage method |
| CN101169705A (en) * | 2007-11-30 | 2008-04-30 | 中兴通讯股份有限公司 | Method and device for realizing file-level mirroring based on bare file system under multiple hard disks |
| US20100328814A1 (en) * | 2009-06-26 | 2010-12-30 | Fujitsu Limited | Control apparatus, method of controlling apparatus and computer-readable recording medium |
| CN101825992A (en) * | 2010-04-08 | 2010-09-08 | 杭州华三通信技术有限公司 | Saving method of data and device thereof |
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104426687A (en) * | 2013-08-23 | 2015-03-18 | 南京南瑞继保电气有限公司 | A network storm filtering method applicable for a digital substation secondary device |
| CN104049917A (en) * | 2014-06-25 | 2014-09-17 | 北京思特奇信息技术股份有限公司 | Data processing method and system |
| CN104461385A (en) * | 2014-12-02 | 2015-03-25 | 国电南瑞科技股份有限公司 | Multi-hard disk balanced storage method with self-adaptive port traffic |
| CN104516953A (en) * | 2014-12-12 | 2015-04-15 | 国家电网公司 | Black box system for mass power dispatching automation message |
| CN104516953B (en) * | 2014-12-12 | 2016-03-09 | 国家电网公司 | A kind of black box subsystem for power dispatching automation magnanimity message |
| CN109474492A (en) * | 2018-11-26 | 2019-03-15 | 许继集团有限公司 | A packet capture and positioning method |
| CN109918952A (en) * | 2019-03-08 | 2019-06-21 | 北京马尔马拉科技有限公司 | A kind of safer cloud computing platform system and processing method |
| CN115913751A (en) * | 2022-12-06 | 2023-04-04 | 江苏林洋能源股份有限公司 | Method, device, equipment and medium for analyzing data packets based on web pages |
| CN118796785A (en) * | 2024-09-11 | 2024-10-18 | 成都赛力斯科技有限公司 | Storage method, device, electronic device and storage medium for different vehicle-side data |
| CN118796785B (en) * | 2024-09-11 | 2024-12-10 | 成都赛力斯科技有限公司 | Storage method, device, electronic device and storage medium for different vehicle-side data |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102937956A (en) | Method and device for storing real-time messages in intelligent substation | |
| CN110311817B (en) | Container log processing system for Kubernetes cluster | |
| CN101673192B (en) | Method for time-sequence data processing, device and system therefor | |
| CN104008207B (en) | The data external storage system and date storage method of the database based on CD | |
| CN102508913A (en) | Cloud computing system with data cube storage index structure | |
| CN104699723A (en) | Data exchange adapter and system and method for synchronizing data among heterogeneous systems | |
| CN103198027A (en) | Method and device for storing and providing files | |
| CN104035956A (en) | Time-series data storage method based on distributive column storage | |
| SE0300353D0 (en) | Method and system for managing energy information | |
| SG11201809827RA (en) | Method for conducting statistics on insurance type state information of policy, terminal device and storage medium | |
| CN104123237A (en) | Hierarchical storage method and system for massive small files | |
| CN103645984B (en) | log processing method and device | |
| CN105447146A (en) | Massive data collecting and exchanging system and method | |
| CN103164528B (en) | A kind of index establishing method of audio, video data | |
| CN105005585A (en) | Log data processing method and device | |
| CN105100716A (en) | Safe memory cell used for network video monitoring and system thereof | |
| CN103198157B (en) | A kind of compression storage processing method of telluric electricity field data | |
| CN114943287A (en) | Computer big data acquisition and processing system, method, equipment and medium | |
| CN105005517B (en) | System and method for storage and backup of recording files of call center | |
| CN103207916A (en) | Metadata processing method and device | |
| CN103455391B (en) | A kind of apparatus and method of data protection of dynamic conditioning | |
| CN104331460A (en) | Hbase-based data read-write operation method and system | |
| CN112133080B (en) | Storage method of metering data of power acquisition terminal, power acquisition terminal and power system | |
| CN104731716A (en) | Data storage method | |
| CN105117177B (en) | A kind of big data management method based on single hard disk multi partition |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C12 | Rejection of a patent application after its publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20130220 |