CN104361110B - Magnanimity electricity consumption data analysis system and in real time calculating, data digging method - Google Patents
Magnanimity electricity consumption data analysis system and in real time calculating, data digging method Download PDFInfo
- Publication number
- CN104361110B CN104361110B CN201410710769.2A CN201410710769A CN104361110B CN 104361110 B CN104361110 B CN 104361110B CN 201410710769 A CN201410710769 A CN 201410710769A CN 104361110 B CN104361110 B CN 104361110B
- Authority
- CN
- China
- Prior art keywords
- data
- electricity consumption
- analysis
- magnanimity
- module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/27—Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2458—Special types of queries, e.g. statistical queries, fuzzy queries or distributed queries
- G06F16/2462—Approximate or statistical queries
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/25—Integrating or interfacing systems involving database management systems
- G06F16/254—Extract, transform and load [ETL] procedures, e.g. ETL data flows in data warehouses
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/06—Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
- G06Q10/063—Operations research, analysis or management
- G06Q10/0637—Strategic management or analysis, e.g. setting a goal or target of an organisation; Planning actions based on goals; Analysis or evaluation of effectiveness of goals
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/06—Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
- G06Q10/063—Operations research, analysis or management
- G06Q10/0637—Strategic management or analysis, e.g. setting a goal or target of an organisation; Planning actions based on goals; Analysis or evaluation of effectiveness of goals
- G06Q10/06375—Prediction of business process outcome or impact based on a proposed change
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
- G06Q50/06—Energy or water supply
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Landscapes
- Engineering & Computer Science (AREA)
- Business, Economics & Management (AREA)
- Human Resources & Organizations (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Economics (AREA)
- Strategic Management (AREA)
- Databases & Information Systems (AREA)
- Educational Administration (AREA)
- Entrepreneurship & Innovation (AREA)
- Tourism & Hospitality (AREA)
- Data Mining & Analysis (AREA)
- General Engineering & Computer Science (AREA)
- Marketing (AREA)
- General Business, Economics & Management (AREA)
- Quality & Reliability (AREA)
- Health & Medical Sciences (AREA)
- Operations Research (AREA)
- Game Theory and Decision Science (AREA)
- Development Economics (AREA)
- Probability & Statistics with Applications (AREA)
- Public Health (AREA)
- Fuzzy Systems (AREA)
- Primary Health Care (AREA)
- Mathematical Physics (AREA)
- General Health & Medical Sciences (AREA)
- Water Supply & Treatment (AREA)
- Software Systems (AREA)
- Computational Linguistics (AREA)
- Computing Systems (AREA)
- Remote Monitoring And Control Of Power-Distribution Networks (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
The invention discloses a kind of magnanimity electricity consumption data analysis system, comprising: data source; Data acquisition module; Data memory module; Data computation module, for adopting SmartMing and/or Rhadoop analysis tool and/or Spark framework, carries out 98 Distributed Parallel Computing to the magnanimity electricity consumption data of data computation module; Infrastructure service module, provides GIS service and Visualization Service, and carries out data analysis according to the result of calculation of data computation module; Electrical energy consumption analysis platform, for carrying out measuring apparatus analysis, real-time line loss calculation, electricity consumption behavioural analysis, feeder line analysis, load forecast and load real-time estimate according to infrastructure service module.The invention also discloses a kind of magnanimity electricity consumption data real-time computing technique based on magnanimity electricity consumption data analysis system and a kind of magnanimity electricity consumption data mining method based on magnanimity electricity consumption data analysis system.The present invention can to the process of magnanimity electricity consumption data analysis, and treatment effeciency is high.
Description
Technical field
The present invention relates to electricity consumption data processing field, particularly relate to a kind of magnanimity electricity consumption data analysis system.
Background technology
Along with the high speed development of electrical network scale, informationization technology means have been widely used in the every aspect of electrical network, achieve remarkable result, for meeting the needs of national economy and social development, improving customer service quality and having made powerful support.Metering automation, the acquisition system of electric power enterprise also constantly perfect universal, thus create the electricity consumption data of magnanimity.
And the application management and control of enterprise to electricity consumption data lags behind the growth of electricity consumption data far away, its management difficulty and complicacy are also multiplied.In the electricity consumption data of magnanimity, just must can draw effective conclusion through long finishing analysis as decision maker, add managerial difficulty undoubtedly.
The electricity consumption real-time property that current electric grid gathers is high and data volume is huge, and bottleneck appears in traditional data storage method performance, and the problems such as response time length, reliability and stability also appear in statistical study on this basis.Therefore mining algorithm is used intelligent power field and is carried out customer analysis by technician, but there is operand when processing large for large-scale magnanimity electricity consumption data, adopts traditional mining algorithm efficiency too low.
Summary of the invention
Technical matters to be solved by this invention is, provides a kind of magnanimity electricity consumption data analysis system, can to the process of magnanimity electricity consumption data analysis, and treatment effeciency is high.
In order to solve the problems of the technologies described above, the invention provides a kind of magnanimity electricity consumption data analysis system, comprising:
Data source, for providing magnanimity electricity consumption data;
Data acquisition module, obtains magnanimity electricity consumption data for adopting web services mode and/or ETL mode from described data source;
Data memory module, stores for the magnanimity electricity consumption data obtained described data acquisition module;
Data computation module, for adopting SmartMing and/or Rhadoop analysis tool and/or Spark framework, carries out Distributed Parallel Computing to the magnanimity electricity consumption data of described data computation module;
Infrastructure service module, for providing GIS service and Visualization Service, and carries out data analysis according to the result of calculation of described data computation module;
Electrical energy consumption analysis platform, for carrying out measuring apparatus analysis, real-time line loss calculation, electricity consumption behavioural analysis, feeder line analysis, load forecast and load real-time estimate according to described infrastructure service module.
Present invention also offers a kind of magnanimity electricity consumption data real-time computing technique based on described magnanimity electricity consumption data analysis system, comprising:
Adopt the ETL mode in described data acquisition module from described data source, obtain magnanimity electricity consumption data;
According to the index reached required for calculating in real time, based on the Spark framework of described data computation module, adopt memory parallel computing technique to carry out data processing to described magnanimity electricity consumption data, and carry out denoising, filtration repetition theme/delete and irrelevant redundancy and the junk information of setting objectives;
Based on the Spark framework of described data computation module, adopt memory parallel computing technique to gather data processed result, and summarized results is stored in data warehouse;
Represent in conjunction with the described GIS service of described infrastructure service module and/or the data of Visualization Service to data warehouse.
Present invention also offers a kind of magnanimity electricity consumption data mining method based on described magnanimity electricity consumption data analysis system, comprising:
Adopt the Web service mode in described data acquisition module and ETL mode from described data source, obtain magnanimity electricity consumption data;
The map technology of hadoop in Rhadoop analysis tool described in described data computation module is adopted to be stored in HDFS by described magnanimity electricity consumption data,
The distributed computing technology of hadoop in Rhadoop analysis tool described in described data computation module is adopted to carry out data processing to described magnanimity electricity consumption data;
Adopt the data mining algorithm of Spark framework or RHadoop analysis tool described in data computation module to carry out analytical calculation to data processed result, and analysis result is stored in MySQL database;
Represent in conjunction with the described GIS service of described infrastructure service module and/or the data of Visualization Service to MySQL database.
The present invention can to the process of magnanimity electricity consumption data analysis, improve the ALARA Principle degree of mass data and the warehouse-in efficiency of mass data, the demand of satisfying magnanimity the inquiry of historical data statistical study, improve the speed that data calculate, treatment effeciency is high, provides abundant analytic statistics to meet business and management expectancy on this basis, and existing system can be allowed to process data acquisition session swimmingly, the simple application of reply represents, and meets more and more efficient statistical study demand.
Accompanying drawing explanation
In order to be illustrated more clearly in the embodiment of the present invention or technical scheme of the prior art, be briefly described to the accompanying drawing used required in embodiment or description of the prior art below, apparently, accompanying drawing in the following describes is only some embodiments of the present invention, for those of ordinary skill in the art, under the prerequisite not paying creative work, other accompanying drawing can also be obtained according to these accompanying drawings.
Fig. 1 is the structured flowchart of the embodiment of magnanimity electricity consumption data analysis system provided by the invention;
Fig. 2 is the schematic flow sheet of the embodiment of the magnanimity electricity consumption data real-time computing technique based on the electricity consumption of magnanimity shown in Fig. 1 data analysis system provided by the invention;
Fig. 3 is the schematic flow sheet of the embodiment of the magnanimity electricity consumption data mining method based on the electricity consumption of magnanimity shown in Fig. 1 data analysis system provided by the invention.
Embodiment
Below in conjunction with the accompanying drawing in the embodiment of the present invention, be clearly and completely described the technical scheme in the embodiment of the present invention, obviously, described embodiment is only the present invention's part embodiment, instead of whole embodiments.Based on the embodiment in the present invention, those of ordinary skill in the art, not making the every other embodiment obtained under creative work prerequisite, belong to the scope of protection of the invention.
Fig. 1 is the structured flowchart of the embodiment of magnanimity electricity consumption data analysis system provided by the invention, as shown in Figure 1, comprising:
Data source, for providing magnanimity electricity consumption data;
Data acquisition module, obtains magnanimity electricity consumption data for adopting web services mode and/or ETL mode from described data source;
Data memory module, stores for the magnanimity electricity consumption data obtained described data acquisition module;
Data computation module, for adopting SmartMing and/or Rhadoop analysis tool and/or Spark framework, carries out Distributed Parallel Computing to the magnanimity electricity consumption data of described data computation module;
Infrastructure service module, for providing GIS service and Visualization Service, and carries out data analysis according to the result of calculation of described data computation module;
Electrical energy consumption analysis platform, for carrying out measuring apparatus analysis, real-time line loss calculation, electricity consumption behavioural analysis, feeder line analysis, load forecast and load real-time estimate according to described infrastructure service module.
Wherein, described data source be metering automation system, energy management system, marketing system, battalion join in integration data center and external data one or more.
Wherein, described data memory module comprises data warehouse and the real-time database combined with relevant database.Such as, MySQL database and oracle database.
Wherein, electrical energy consumption analysis platform specifically comprises:
Measuring apparatus analytic unit, for judging measuring apparatus state according to the data results of described infrastructure service module, thus the cycle of minimizing tour error;
Real-time line loss calculation unit, carries out line loss calculation in real time for the smallest particles degrees of data based on each stoichiometric point, and adopts described GIS service line loss to be fed back in GIS map;
Electricity consumption behavioural analysis unit, for according to the data results of described infrastructure service module to client's electricity consumption behavioural analysis, for Electricity customers fine-grained management provides decision-making foundation;
Feeder line analytic unit, in conjunction with described GIS service to feeder line real-time analysis;
Load forecast unit, for the historical data by temporal data model off-line analysis one-phase, thus carries out the load forecast of short-term;
Load real-time estimate unit, for carrying out real-time estimate according to the data results of described infrastructure service module to load.
Fig. 2 is the schematic flow sheet of the embodiment of the magnanimity electricity consumption data real-time computing technique based on the electricity consumption of magnanimity shown in Fig. 1 data analysis system provided by the invention, as shown in Figure 2, comprises step:
S201, adopt the ETL mode in described data acquisition module from described data source, obtain magnanimity electricity consumption data;
S202, the index reached required for real-time calculating, based on the Spark framework of described data computation module, adopt memory parallel computing technique to carry out data processing to described magnanimity electricity consumption data, and carry out denoising, filtration repetition theme/delete and irrelevant redundancy and the junk information of setting objectives;
S203, Spark framework based on described data computation module, adopt memory parallel computing technique to gather data processed result, and be stored in data warehouse by summarized results;
S204, to represent in conjunction with the described GIS service of described infrastructure service module and/or the data of Visualization Service to data warehouse.
Fig. 3 is the schematic flow sheet of the embodiment of the magnanimity electricity consumption data mining method based on the electricity consumption of magnanimity shown in Fig. 1 data analysis system provided by the invention, as shown in Figure 3, comprises step:
S301, adopt the Web service mode in described data acquisition module and ETL mode from described data source, obtain magnanimity electricity consumption data;
S302, the map technology of hadoop in Rhadoop analysis tool described in described data computation module is adopted to be stored in HDFS by described magnanimity electricity consumption data,
S303, the distributed computing technology of hadoop in Rhadoop analysis tool described in described data computation module is adopted to carry out data processing to described magnanimity electricity consumption data;
Described in S304, employing data computation module, the data mining algorithm of Spark framework or RHadoop analysis tool carries out analytical calculation to data processed result, and is stored in MySQL database by analysis result;
S305, to represent in conjunction with the described GIS service of described infrastructure service module and/or the data of Visualization Service to MySQL database.
The present invention can to the process of magnanimity electricity consumption data analysis, improve the ALARA Principle degree of mass data and the warehouse-in efficiency of mass data, the demand of satisfying magnanimity the inquiry of historical data statistical study, improve the speed that data calculate, treatment effeciency is high, provides abundant analytic statistics to meet business and management expectancy on this basis, and existing system can be allowed to process data acquisition session swimmingly, the simple application of reply represents, and meets more and more efficient statistical study demand.
Above disclosedly be only a kind of preferred embodiment of the present invention, certainly can not limit the interest field of the present invention with this, therefore according to the equivalent variations that the claims in the present invention are done, still belong to the scope that the present invention is contained.
Claims (5)
1. a magnanimity electricity consumption data analysis system, is characterized in that, comprising:
Data source, for providing magnanimity electricity consumption data;
Data acquisition module, obtains magnanimity electricity consumption data for adopting web services mode and/or ETL mode from described data source;
Data memory module, stores for the magnanimity electricity consumption data obtained described data acquisition module;
Data computation module, for adopting SmartMing and/or Rhadoop analysis tool and/or Spark framework, carries out Distributed Parallel Computing to the magnanimity electricity consumption data of described data computation module;
Infrastructure service module, for providing GIS service and Visualization Service, and carries out data analysis according to the result of calculation of described data computation module;
Electrical energy consumption analysis platform, comprising: measuring apparatus analytic unit, for judging measuring apparatus state according to the data results of described infrastructure service module, thus the cycle of minimizing tour error; Real-time line loss calculation unit, carries out line loss calculation in real time for the smallest particles degrees of data based on each stoichiometric point, and adopts described GIS service line loss to be fed back in GIS map; Electricity consumption behavioural analysis unit, for according to the data results of described infrastructure service module to client's electricity consumption behavioural analysis, for Electricity customers fine-grained management provides decision-making foundation; Feeder line analytic unit, in conjunction with described GIS service to feeder line real-time analysis; Load forecast unit, for the historical data by temporal data model off-line analysis one-phase, thus carries out the load forecast of short-term; Load real-time estimate unit, for carrying out real-time estimate according to the data results of described infrastructure service module to load.
2. magnanimity electricity consumption data analysis system as claimed in claim 1, it is characterized in that, described data source is metering automation system, energy management system, marketing system, battalion join in integration data center and external data one or more.
3. magnanimity electricity consumption data analysis system as claimed in claim 1, is characterized in that, the database that described data memory module comprises data warehouse and combines with relevant database in real time.
4., based on a magnanimity electricity consumption data real-time computing technique for magnanimity electricity consumption data analysis system according to claim 1, it is characterized in that, comprising:
Adopt the ETL mode in described data acquisition module from described data source, obtain magnanimity electricity consumption data;
According to the index reached required for calculating in real time, based on the Spark framework of described data computation module, adopt memory parallel computing technique to carry out data processing to described magnanimity electricity consumption data, and carry out denoising, filtration repetition theme/delete and irrelevant redundancy and the junk information of setting objectives;
Based on the Spark framework of described data computation module, adopt memory parallel computing technique to gather data processed result, and summarized results is stored in data warehouse;
Represent in conjunction with the described GIS service of described infrastructure service module and/or the data of Visualization Service to data warehouse.
5., based on a magnanimity electricity consumption data mining method for magnanimity electricity consumption data analysis system according to claim 1, it is characterized in that, comprising:
Adopt the Web service mode in described data acquisition module and ETL mode from described data source, obtain magnanimity electricity consumption data;
The map technology of hadoop in Rhadoop analysis tool described in described data computation module is adopted to be stored in HDFS by described magnanimity electricity consumption data,
The distributed computing technology of hadoop in Rhadoop analysis tool described in described data computation module is adopted to carry out data processing to described magnanimity electricity consumption data;
Adopt the data mining algorithm of Spark framework or RHadoop analysis tool described in data computation module to carry out analytical calculation to data processed result, and analysis result is stored in MySQL database;
Represent in conjunction with the described GIS service of described infrastructure service module and/or the data of Visualization Service to MySQL database.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410710769.2A CN104361110B (en) | 2014-12-01 | 2014-12-01 | Magnanimity electricity consumption data analysis system and in real time calculating, data digging method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410710769.2A CN104361110B (en) | 2014-12-01 | 2014-12-01 | Magnanimity electricity consumption data analysis system and in real time calculating, data digging method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104361110A CN104361110A (en) | 2015-02-18 |
| CN104361110B true CN104361110B (en) | 2016-01-20 |
Family
ID=52528370
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410710769.2A Active CN104361110B (en) | 2014-12-01 | 2014-12-01 | Magnanimity electricity consumption data analysis system and in real time calculating, data digging method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104361110B (en) |
Families Citing this family (32)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104867059A (en) * | 2015-05-27 | 2015-08-26 | 南京国云电力有限公司 | Power load distribution analysis method |
| CN104992262A (en) * | 2015-05-27 | 2015-10-21 | 南京国云电力有限公司 | Power utilization big-data analysis and miningprocessing method |
| CN105184676A (en) * | 2015-09-17 | 2015-12-23 | 国网北京市电力公司 | Power utilization data processing method and apparatus |
| CN105243155A (en) * | 2015-10-29 | 2016-01-13 | 贵州电网有限责任公司电力调度控制中心 | Big data extracting and exchanging system |
| CN105427184A (en) * | 2015-11-06 | 2016-03-23 | 南京信息工程大学 | Hadoop-based electricity consumption feedback implementation method |
| CN105321124A (en) * | 2015-11-23 | 2016-02-10 | 南京信息工程大学 | Hadoop-based electric power cloud platform design scheme |
| CN105468741A (en) * | 2015-11-25 | 2016-04-06 | 曙光信息产业(北京)有限公司 | Police affair big data processing system |
| CN105550296B (en) * | 2015-12-10 | 2018-10-30 | 深圳市华讯方舟软件技术有限公司 | A kind of data lead-in method based on spark-SQL big data processing platforms |
| CN105786996A (en) * | 2016-02-18 | 2016-07-20 | 国网智能电网研究院 | Electricity information data quality analyzing system |
| CN105893628A (en) * | 2016-05-17 | 2016-08-24 | 中国农业银行股份有限公司 | Real-time data collection system and method |
| CN106326331A (en) * | 2016-06-29 | 2017-01-11 | 河南许继仪表有限公司 | Intelligent power utilization data service system based on cloud computation |
| CN106295983A (en) * | 2016-08-08 | 2017-01-04 | 烟台海颐软件股份有限公司 | Power marketing data visualization statistical analysis technique and system |
| CN110518880B (en) * | 2016-11-03 | 2022-03-25 | 许继集团有限公司 | Photovoltaic power station state diagnosis method and device |
| CN106599241B (en) * | 2016-12-20 | 2020-06-30 | 北京超图软件股份有限公司 | Visual management method for big data in GIS software |
| CN106709035B (en) * | 2016-12-29 | 2019-11-26 | 贵州电网有限责任公司电力科学研究院 | A kind of pretreatment system of electric power multidimensional panoramic view data |
| CN106874381B (en) * | 2017-01-09 | 2020-12-22 | 重庆邮电大学 | A Hadoop-based Radio Environment Map Data Processing System |
| CN108470127B (en) * | 2017-02-23 | 2021-10-29 | 全球能源互联网研究院 | A kind of offline desensitization method and device for electricity load data |
| CN106919685A (en) * | 2017-03-02 | 2017-07-04 | 浪潮软件集团有限公司 | A Method for Processing Massive Data Files |
| CN107124394B (en) * | 2017-03-10 | 2020-03-20 | 北京国电通网络技术有限公司 | Power communication network security situation prediction method and system |
| CN107153710A (en) * | 2017-05-19 | 2017-09-12 | 肇庆市智高电机有限公司 | A kind of big data processing method and system |
| CN109559138A (en) * | 2017-09-25 | 2019-04-02 | 北京京东尚科信息技术有限公司 | Dodge purchase activity sales volume prediction technique and device, storage medium, electronic equipment |
| CN107832876B (en) * | 2017-10-27 | 2020-09-04 | 国网江苏省电力公司南通供电公司 | Prediction method of partition maximum load based on MapReduce framework |
| CN108228772A (en) * | 2017-12-28 | 2018-06-29 | 北京航天云路有限公司 | A kind of method for visualizing of the crowd behaviour distribution based on GIS information |
| CN108536810A (en) * | 2018-03-30 | 2018-09-14 | 四川斐讯信息技术有限公司 | Data visualization methods of exhibiting and system |
| CN108897835A (en) * | 2018-06-25 | 2018-11-27 | 浪潮软件集团有限公司 | Label system management method based on offline calculation |
| CN109165202A (en) * | 2018-07-04 | 2019-01-08 | 华南理工大学 | A kind of preprocess method of multi-source heterogeneous big data |
| CN109492002B (en) * | 2018-10-19 | 2021-03-23 | 浙江大学华南工业技术研究院 | Smart power grid big data storage and analysis system and processing method |
| CN112148779B (en) * | 2019-06-28 | 2024-06-21 | 京东科技控股股份有限公司 | Method, device and storage medium for determining business index |
| CN110516332B (en) | 2019-08-15 | 2021-06-11 | 浪潮电子信息产业股份有限公司 | Method and system for filtering parallel calculation results |
| CN111078767A (en) * | 2019-11-25 | 2020-04-28 | 东莞理工学院 | A big data analysis system based on network data platform |
| CN111241087A (en) * | 2020-03-10 | 2020-06-05 | 天津市普迅电力信息技术有限公司 | An automatic processing method of energy data based on distributed computing |
| CN118484492B (en) * | 2024-07-16 | 2024-11-12 | 宁波安得智联科技有限公司 | Data analysis method, system, device and storage medium |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101944118A (en) * | 2010-09-21 | 2011-01-12 | 深圳市佳创视讯技术股份有限公司 | Viewer behavior analysis system |
| CN102254024A (en) * | 2011-07-27 | 2011-11-23 | 国网信息通信有限公司 | Mass data processing system and method |
| CN102722764A (en) * | 2012-05-22 | 2012-10-10 | 合肥恒卓科技有限公司 | Integrated power grid optimization auxiliary decision analysis system |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2005015366A2 (en) * | 2003-08-08 | 2005-02-17 | Electric Power Group, Llc | Real-time performance monitoring and management system |
-
2014
- 2014-12-01 CN CN201410710769.2A patent/CN104361110B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101944118A (en) * | 2010-09-21 | 2011-01-12 | 深圳市佳创视讯技术股份有限公司 | Viewer behavior analysis system |
| CN102254024A (en) * | 2011-07-27 | 2011-11-23 | 国网信息通信有限公司 | Mass data processing system and method |
| CN102722764A (en) * | 2012-05-22 | 2012-10-10 | 合肥恒卓科技有限公司 | Integrated power grid optimization auxiliary decision analysis system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104361110A (en) | 2015-02-18 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104361110B (en) | Magnanimity electricity consumption data analysis system and in real time calculating, data digging method | |
| US11581732B2 (en) | Establishing communication and power sharing links between components of a distributed energy system | |
| CN106484809A (en) | A kind of energy means of Internet information platform based on Spark and its application | |
| CN105303452A (en) | Power-grid regulation and control real-time data distributed processing method and system | |
| CN103942637A (en) | Electric-micro-grid power distribution method based on cloud computation | |
| CN115640935A (en) | Method and device for calculating carbon emission of power system and computer equipment | |
| Zhou et al. | Fuel cell generation in geo-distributed cloud services: A quantitative study | |
| Zieliński | Internet of Everything (IoE) in smart grid | |
| CN107948300A (en) | A kind of energy block catenary system and its data processing method | |
| CN103986783A (en) | Cloud computing system | |
| Shahzad et al. | Conceptual model of real time infrastructure within cloud computing environment | |
| CN105894174A (en) | Power system mobile internet cloud computing platform and scheduling and data analysis method | |
| CN111105096A (en) | New energy grid-connected layout planning method and system | |
| Ashfaq et al. | Secure energy trading for electric vehicles using consortium blockchain and k-nearest neighbor | |
| CN106934538A (en) | A kind of electric network data fusion method compared based on data blood relationship and gene | |
| CN103546566A (en) | Distribution network operation data processing method and system based on distributed storage and computing | |
| CN104408918A (en) | Floating car data and road matching method based on MapReduce calculation frame | |
| CN103606091B (en) | A kind of intelligent distribution network Spot Price information interaction method based on load sensitivity | |
| CN206021261U (en) | A kind of energy consumption data analysis system based on intelligent electric meter | |
| Yang et al. | Optimization analysis of distributed energy consumption based on dynamic data synchronization and intelligent control | |
| CN104463505A (en) | Operation state on-line monitoring method based on detail data | |
| CN106504120A (en) | Virtual reality Production Managementsystem For Electricpower Network | |
| CN208722264U (en) | A kind of carbon emission reduction data processing system | |
| Sharif et al. | A review on various smart grid technologies used in power system | |
| CN203574674U (en) | Large-scale data acquisition business multi-group distribution system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant |