CN113344731B - Automatic collection and integration system and method for randomly reporting scattered data - Google Patents

Abstract

The present invention is an automatic collection and integration system for randomly reporting scattered data, and its characteristics are: it includes WeChat group, WeChat automatic processing module, information reporting and format specification, file setting and program control on external network computer, transmission file generation module, network switching and integration and application module. Its automatic collection and integration method is: establishing WeChat group and reporting data, external network computer program, network switching and internal network computer program. It is suitable for the scene of changing the original manual random scattered telephone reporting data to automatic collection and integration, and has the advantages of practicality, economy and convenience of grassroots units, making it easier and more willing for front-line personnel to use it, and reducing the burden on grassroots teams.

Description

A system and method for automatically collecting and integrating randomly reported scattered data

Technical Field

The present invention relates to computers and WeChat, and is an automatic collection and integration system and method for randomly reporting scattered data.

Background technique

In the traditional power grid dispatching system, after the regional dispatcher on night shift takes over, the duty personnel of the power plants, substations and large users (hereinafter referred to as "plants, substations and users") under his jurisdiction will randomly report the relevant data to the dispatcher by phone. The duty dispatcher receives the data by phone and records it manually on the form. These dozens or hundreds of random and scattered calls need to continue until about 0:30. After that, the dispatcher will perform a series of calculations on the collected data and finally enter them one by one into the webpage of the reporting system. This work lasts from the first half of the night to the early morning every day, when ordinary people are deep asleep. Manual operation is very hard and prone to omissions and errors.

With the continuous improvement of the automation level of power grid dispatching, a considerable part of data can be queried and obtained from application systems such as energy management system, electricity billing system and user electricity information collection system, but there is still a part of data that is not collected in each application system and needs to be reported by the duty personnel of each plant and station by phone. This traditional method of randomly reporting and receiving scattered data by phone has seriously limited the improvement of the automation level of power grid dispatching. The present invention comes into being to solve this bottleneck problem.

Summary of the invention

The technical problem to be solved by the present invention is: to change the way of reporting data by telephone of plant and station users to reporting via WeChat, the dispatching end logs in to WeChat on the external network computer, uses the RPA program to automatically interact, judge and feedback with the WeChat groups of each plant and station user, collects and integrates the reported data, and encodes it with a variable key, stores it in ciphertext, and transmits it in plain text.

One of the solutions to the technical problem of the present invention is: an automatic collection and integration system for randomly reporting scattered data, which is characterized by: it includes a WeChat group, a WeChat automatic processing module, information reporting and format specifications, file settings and program control on an external network computer, a transfer file generation module, and a network switching and fusion and application module:

The WeChat group is created for each plant or station user in the dispatching WeChat application, and includes the data reporting duty officer, so as to report the data to be reported in the WeChat group in the required format.

The WeChat automatic processing module is a Windows version of WeChat application that uses RPA program to monitor and control running on external network computers at the dispatch end. It is used to automatically interact, judge and feedback with the WeChat groups of each plant and station user, collect and integrate their reported data, including program preparation and initialization, information monitoring and collection, unread information group name array generation, data reading and storage and ciphertext encoding. It is a program used to monitor new information sent from each plant and station user group in real time on an external network computer, and read, judge, store or reply to the new information.

The information submission and format specifications include requirements for the time, information format and data units for submitting data, and are used to standardize the WeChat groups, group members and the time, information format and data units for submitting data in the groups of each plant, station and household.

The file setting and program control on the external network computer is to set up a folder on the hard disk of the external network computer, which includes setting files, data files and transfer files, and set up a process file and three files, control panel, monitoring collection, and data transfer, in the RPA program folder. They are used to set and store the number, group name and running status of the data reporting unit, automatically generate files for storing the data reported by each data reporting unit during the program operation, transmit plain text data files between network computers that have taken physical isolation measures, and set file settings and program control through the control panel.

The transfer file generation module is a subroutine used to convert a WPS file in the encrypted xlsx format into a text file in the Dat format.

The network switch includes a KVM switch and a data transmission USB disk, which is used for fast data transmission between two or more network computers that have taken physical isolation measures.

The fusion and application module is composed of a ciphertext decoding subroutine and a data fusion and application subroutine running on an internal network computer, and is used to fuse the complete data file with the data files collected from the EMS system, the electric energy collection system and the user electricity consumption information collection system, so as to obtain complete operating data of the regional power grid dispatching, and provide complete data source support for regional power grid dispatching analysis and reporting.

Furthermore, the information submission and format specifications specifically include the following items:

⑴ On the dispatching WeChat application, WeChat groups are established with the plant and station account name as the group name. The WeChat group includes all the on-duty personnel who report data for the plant and station account. The data reporting personnel are not allowed to modify the group name, but are allowed to modify the remarks; the WeChat group name and number are consistent with the content of the setting file. The data reporting personnel shall report the data to be reported in the WeChat group every day at the specified time. The reported data must contain the "date" keyword, which is the unique information identification code when the WeChat automatic processing module collects data;

⑵ The data information reporting format requires entry in separate lines, with the name and data separated by a colon. The colon is not distinguished between Chinese and English and cannot be omitted; the first line is the data date, which is an 8-digit number. The first 4 digits are the year, the 5th and 6th digits are the month, and the 7th and 8th digits are the day. If the month and day are less than 10, add 0 to the tens digit; the following lines are reported data, and the unit of electricity is kilowatt-hour;

⑶ In the WeChat automatic processing module, several fault-tolerant formats are set for the information identification code. The date length format, horizontal bar, slash connector, etc. that may appear in the reported information are enumerated one by one, and fault-tolerant corrections are performed. When it is indeed impossible to identify, the WeChat automatic processing module simulates the WeChat sending process to automatically reply to the group and ask it to resend the message to ensure data integrity.

Furthermore, the file setting and program control on the external network computer is to set up a folder on the hard disk of the external network computer, which includes setting files, data files and transfer files, and set up a process file and three files including control panel, monitoring collection and data transfer in the RPA program folder:

(1) Setting file

The full name of the setting file is the data reporting unit group name setting file, which is a WPS file in xlsx format, used to set and store the number, group name and operation status of the data reporting unit; the number is used to determine the storage location of the data reported by the unit in the data file, and the operation status has two options: running and paused. When the household is in the paused state, the unit will be automatically skipped when the program is running;

(2) Data files

The data file is a WPS file in xlsx format, which is automatically generated during the program running process to store the data reported by each data reporting unit. For the sake of data security, the file is set to open permission protection, and the stored data is encoded ciphertext;

(3) Transferring documents

The transfer file is a Txt file in dat format, which is a plain text file automatically generated by a program from a complete data file and used to transmit data between network computers that have taken physical isolation measures; the text file stores a Json string converted from a two-dimensional array, in which the data is encoded ciphertext;

(4) Control Panel

The control panel is a user interactive setting interface program module. By running the program module, the user can conveniently set the WeChat.exe installation path, working directory, monitoring frequency, U disk drive letter, U disk password, U disk data storage area, date change time, scheduled automatic operation time, user storage area in the setting file, whether the data is stored and transmitted in plain text or cipher text, and other information; after this information is entered or modified through the control panel, it will be saved in the form of a dictionary Json string in a text file named Config.Cfg, so that it can be called at any time during program operation. This is a means for the program to adapt to personalized setting parameters for different users; at the same time, a text file named ybhRet.Rec is also set in the RPA program folder, which stores a data dictionary of reported user names and interruption times when the monitoring program is temporarily interrupted.

Furthermore, the WeChat automatic processing module includes program preparation and initialization, information monitoring and collection, unread information group name array generation, data reading and storage, and ciphertext encoding, which is used to monitor new information sent from each plant and station user group in real time, and read, judge, store or reply to the new information. It includes the following subroutines:

⑴Program preparation and initialization:

① Initialize variables: At the beginning of the program, various related variables and arrays are defined, and the saved information in the Config.Cfg and ybhRet.Rec files is read as the initial state of the program execution, so that the program operation can be perfectly connected with the last interruption;

② Start WeChat application: Check whether the Windows version of WeChat application is running. If not, start it here and confirm on the phone that you have logged into WeChat using the computer.

③ Adjust the program window: adjust the size of the WeChat window so that it occupies 1/3 of the left side of the screen, adjust the size of the RPA program running window so that it occupies 2/3 of the right side of the screen, and make the output information occupy a certain area of the lower right side of the window to display the output messages of the program in real time;

④ Make the WeChat window active: Write a prompt "Monitoring program is running" on the RPA window to make the WeChat window active;

(2) Monitoring and collection of information: Regularly cycle to detect unread information, decode the information that has been successfully read, encode it through the ciphertext encoding subroutine and store it, and output the plant and station household data that has been successfully read in this cycle, the plant and station household group name set that has been successfully read up to this point, and which plants and stations have not yet submitted data to the view output window, and automatically reply to the information that failed to be read and ask it to check and resubmit;

⑶ Unread message group name array generation: automatically search for unread messages and store the group names of the users who sent these unread messages into a defined array;

(4) Data reading and storage: Search each message in the dialog box one by one for the group name in the unread message group name array, obtain the last text containing the message identifier and cut the string, then store the obtained string in the data file after key encoding, and at the same time, record the plant station user group name in the reported user set;

⑸ Ciphertext encoding: Get a coding key through the calculation of the time function and the settings in the control panel, convert the captured data into ASCII code, and then superimpose the converted ASCII code with the key to generate the ciphertext code, save the ciphertext code in the data file with the background color and hide the WPS editing bar; convert the data file into a two-dimensional array through the read worksheet area command, and then convert the two-dimensional array into a Json string, and then write it to the transfer file, thereby generating a plain text ciphertext transfer file .dat.

Furthermore, the network switching includes a KVM switch and a data transfer USB flash drive. The two network computers are connected together using the KVM switch, and the transfer files are copied to the internal network computer through the internal network USB flash drive in a manner that isolates the internal network and the external network. In order to ensure data security, the transfer files use plain text encrypted files.

Furthermore, the fusion and application module is composed of a ciphertext decoding subroutine and a data fusion and application subroutine running on an internal network computer:

⑴ The ciphertext decoding subroutine is as follows: the transmitted file is decoded on the internal network computer, and the decoding process is the inverse process of the encoding process, that is, first read the transmitted file into a Json string variable, and then convert it into an object to form a two-dimensional array; obtain the maximum subscript of the array, and through a double loop, decode the array elements one by one according to the encoding inverse operation algorithm and then construct a new array; write the constructed new array into the WPS table file through the write area command, thereby obtaining a complete decoded data file;

⑵The data fusion and application subroutine: after the transmission file is decoded, a complete WPS format data file is obtained on the internal network computer. By integrating this file with the WPS format data files collected from the EMS system, the electric energy collection system and the user electricity consumption information collection system respectively, the complete operation data of the regional power grid dispatching can be obtained, which will provide complete data source support for the regional power grid dispatching analysis and reporting.

The second solution to the technical problem of the present invention is: a method for automatically collecting and integrating randomly reported scattered data, which is characterized in that it includes establishing a WeChat group and reporting data, running an external network computer program, network switching and running an internal network computer program. The specific steps are as follows:

1) Establish WeChat group and submit data

In the dispatching WeChat application, a WeChat group is created for each plant and station user, including the duty officer who reports the data. The duty officer who reports the data will report the data to be reported in the WeChat group in the required format;

2) External network computer program running

The external network computer program operation includes:

⑴Program preparation and initialization;

⑵ Regular cycle detection of unread messages;

⑶ Generate an array of unread message group names;

(4) Information trial reading;

⑸Ciphertext encoding and storage;

⑹ Read all unread messages or terminate manually;

⑺Transfer file generation;

3) Network switching

Use a KVM switch to connect two network computers together, and copy the transfer files to the internal network computer through the internal network USB flash drive in a way that the internal network and the external network are isolated;

4) Internal network computer program operation

The internal network computer program operation includes:

⑴Decode the transfer file;

(2) Data fusion;

⑶Data application.

Furthermore, the step 2) running the external network computer program specifically includes:

⑴Program preparation and initialization

⑵Timed loop detection of unread messages

Set a large cycle to detect unread messages. The cycle interval is set by the detection frequency in the control panel. The detection is performed once every set interval.

⑶ Generate an array of unread message group names

Automatically search for unread messages and store the names of the user groups that sent these unread messages into a defined array;

⑷ Information Reading

Trial read the unread information of the loop detection, and pass the successfully read information to the ciphertext encoding subroutine after decoding. At the same time, output the plant and station household data that have been successfully read in this cycle, the plant and station household group name set that has been successfully read so far, and which plants and stations households have not yet submitted data to the view output window. Automatically reply to the information that failed to be trial read and ask it to check and resubmit;

⑸Ciphertext encoding and storage

The successfully read information is decoded and passed to the ciphertext encoding subroutine, which encodes it and stores it;

⑹ Read all unread messages or terminate manually

Read all the unread messages in the loop detection, or manually terminate the message reading as needed;

⑺Transfer file generation

The ciphertext is encoded and stored in the data file with a background color and the WPS editing bar is hidden; the data file is converted into a two-dimensional array through the read worksheet area command, and then the two-dimensional array is converted into a Json string, and then written into the transfer file, thereby generating a plain text ciphertext transfer file .dat.

Further, the step (1) program preparation and initialization are specifically as follows:

① Initialize variables: At the beginning of the program, various related variables and arrays are defined, and the saved information in the Config.Cfg and ybhRet.Rec files is read as the initial state of the program execution, so that the program operation can be perfectly connected with the last interruption;

② Start WeChat application: Check whether the Windows version of WeChat application is running. If not, start it here and confirm on the phone that you have logged into WeChat using the computer.

③ Adjust the program window: adjust the size of the WeChat window so that it occupies 1/3 of the left side of the screen, adjust the size of the RPA program running window so that it occupies 2/3 of the right side of the screen, and make the output information occupy a certain area of the lower right side of the window to display the output messages of the program in real time;

④ Make the WeChat window active: Write a prompt "Monitoring program is running" on the RPA window to make the WeChat window active.

Furthermore, the internal network computer program operation in step 2) includes:

⑴Delivery file decoding

The transferred file is decoded on the internal network computer. First, the transferred file is read into a Json string variable, and then converted into an object to form a two-dimensional array. The maximum subscript of the array is obtained, and through a double loop, the array elements are decoded one by one according to the encoding inverse operation algorithm and then constructed into a new array. The constructed new array is written into the WPS file through the write area command, thereby obtaining a complete decoded data file.

(2) Data fusion

After the transmission file is decoded, a complete WPS format data file is obtained on the internal network computer, and the file is integrated with the WPS format data files collected from the EMS system, the electric energy collection system and the user electricity consumption information collection system;

⑶Data application

By integrating the complete WPS format data file obtained after decoding with the WPS format data files collected from the EMS system, electric energy collection system and user electricity consumption information collection system, we can obtain the complete operation data of the regional power grid dispatching, which will provide complete data source support for regional power grid dispatching analysis and reporting.

The beneficial effects of the present invention are:

(1) It can reduce the number of calls that night shift dispatchers answer by an average of more than 60 times per day;

(2) On average, more than 200 records of data were reduced every day;

(3) Reduce the psychological pressure of night shift dispatchers;

(4) Improved data accuracy;

(5) Improved the level of dispatch office automation and work efficiency.

The present invention is applicable to the scenario where the data originally reported by manual random and scattered telephone calls are changed to automatic collection and integration. It has the advantages of practicality, economy and convenience for grass-roots units, making it easier and more willing for front-line personnel to use it, thus reducing the burden on grass-roots teams.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG1 is a block diagram of a system for automatically collecting and integrating randomly reported scattered data according to the present invention;

FIG2 is a block diagram of an external network computer structure of the automatic collection and integration system for randomly reported scattered data of the present invention;

FIG3 is a block diagram of the WeChat automatic processing module of the automatic collection and integration system for randomly reporting scattered data of the present invention;

FIG4 is a flowchart of the method for automatically collecting and integrating randomly reported scattered data according to the present invention.

Detailed ways

The present invention is further described below in conjunction with the accompanying drawings and embodiments.

Referring to Figures 1 to 4, Example 1, this embodiment is an automatic collection and integration system for randomly reporting scattered data, which includes a WeChat group, a WeChat automatic processing module, information reporting and format specifications, file settings and program control on an external network computer, a transfer file generation module, and a network switching and fusion and application module:

The WeChat group is created for each plant or station user in the dispatching WeChat application, and includes the data reporting duty officer, so as to report the data to be reported in the WeChat group in the required format.

The WeChat automatic processing module is a Windows version of WeChat application that uses RPA program to monitor and control the operation on the external network computer at the dispatch end, and is used to automatically interact, judge and feedback with the WeChat groups of each plant and station user, and collect and integrate the reported data. It includes program preparation and initialization, information monitoring and collection, unread information group name array generation, data reading and storage, and ciphertext encoding. It is a program used to monitor new information sent from each plant and station user group in real time on the external network computer, and read, judge, store or reply to the new information.

The information submission and format specifications include requirements for the time, information format and data units for submitting data, and are used to standardize the WeChat groups, group members and the time, information format and data units for submitting data in the groups of each plant, station and household.

The file setting and program control on the external network computer is to set up a folder on the hard disk of the external network computer, which includes setting files, data files and transfer files. A process file and three files, control panel, monitoring collection, and data transfer, are set in the RPA program folder to set and store the number, group name and operation status of the data reporting unit, automatically generate files for storing the data reported by each data reporting unit during the program operation, transmit plain text data files between network computers that have taken physical isolation measures, and set file settings and program control through the control panel.

The transfer file generation module is a subroutine used to convert a WPS file in the encrypted xlsx format into a text file in the Dat format.

The network switch includes a KVM switch and a data transmission USB disk, which is used for fast data transmission between two or more network computers that have taken physical isolation measures.

The fusion and application module is composed of a ciphertext decoding subroutine and a data fusion and application subroutine running on an internal network computer, and is used to fuse the complete data file with the data files collected from the EMS system, the electric energy collection system and the user electricity consumption information collection system, so as to obtain complete operating data of the regional power grid dispatching, and provide complete data source support for regional power grid dispatching analysis and reporting.

The information submission and format specifications specifically include the following items:

⑴ On the dispatching WeChat application, WeChat groups are established with the plant and station account name as the group name. The WeChat group includes all the on-duty personnel who report data for the plant and station account. The data reporting personnel are not allowed to modify the group name, but are allowed to modify the remarks; the WeChat group name and number are consistent with the content of the setting file. The data reporting personnel shall report the data to be reported in the WeChat group every day at the specified time. The reported data must contain the "date" keyword, which is the unique information identification code when the WeChat automatic processing module collects data;

⑵ The data information reporting format requires entry in separate lines, with the name and data separated by a colon. The colon is not distinguished between Chinese and English and cannot be omitted; the first line is the data date, which is an 8-digit number. The first 4 digits are the year, the 5th and 6th digits are the month, and the 7th and 8th digits are the day. If the month and day are less than 10, add 0 to the tens digit; the following lines are reported data, and the unit of electricity is kilowatt-hour;

For example, if a user's electricity consumption on January 8, 2021 is 1688888 kWh, the information to be sent should be:

Date: 20210108

Battery: 1688888

If the user only reports one power data, it can also be simplified as

20210108:1688888

On December 8, 2020, the power consumption of a power plant was 22,166 kWh, the online power consumption was 22,156 kWh, the maximum power was 988 kW, the minimum power was 886 kW, and the load rate was 93.4%. The information to be sent should be:

Date: 20201208

Terminal: 22166

Internet access: 22156

Max: 988

Minimum: 886

Load factor: 93.4

⑶ In the WeChat automatic processing module, up to 20 error-tolerant formats are set for the information identification code, and the date length format, horizontal bar, slash connector, etc. that may appear in the submitted information are enumerated one by one, and error-tolerant corrections are made. For example: for the "date" information identifier "20201208", no matter whether the reporter writes it as 2020128, 2020-12-08, 2020-12-8, 2020/12/08, 2020/12/8, etc., the program can automatically recognize it. When it is indeed impossible to recognize, the WeChat automatic processing module simulates the WeChat sending process to automatically reply to the group to ask it to resend to ensure the integrity of the data.

The file setting and program control on the external network computer is to set up a folder on the hard disk of the external network computer, whose name is determined by the "working directory" in the control panel, which includes the setting file .xlsx, the data file .xlsx and the transfer file .dat, and set a flow process file and three task files of control panel, monitoring collection, and data transfer in the RPA program folder.

(1) Setting file

The full name of the setting file is the data reporting unit group name setting file, which is a WPS file in xlsx format, used to set and store the number, group name and operation status of the data reporting unit; the number is used to determine the storage location of the data reported by the unit in the data file, and the operation status has two options: running and paused. When the household is in the paused state, the unit will be automatically skipped when the program is running;

(2) Data files

The data file is a WPS file in xlsx format, which is automatically generated during the program running process to store the data reported by each data reporting unit. For the sake of data security, the file is set to open permission protection, and the stored data is encoded ciphertext;

(3) Transferring documents

The transfer file is a Txt file in dat format, which is a plain text file automatically generated by a program from a complete data file and used to transmit data between network computers that have taken physical isolation measures; the text file stores a Json string converted from a two-dimensional array, in which the data is encoded ciphertext;

(4) Control Panel

The control panel is a user interactive setting interface program module. By running the program module, the user can conveniently set the WeChat.exe installation path, working directory, monitoring frequency, U disk drive letter, U disk password, U disk data storage area, date change time, scheduled automatic operation time, user storage area in the setting file, whether the data is stored and transmitted in plain text or cipher text, and other information; after this information is entered or modified through the control panel, it will be saved in the form of a dictionary Json string in a text file named Config.Cfg, so that it can be called at any time during program operation. This is a means for the program to adapt to personalized setting parameters for different users; at the same time, a text file named ybhRet.Rec is also set in the RPA program folder, which stores a data dictionary of reported user names and interruption times when the monitoring program is temporarily interrupted.

The WeChat automatic processing module includes program preparation and initialization, information monitoring and collection, unread information group name array generation, data reading and storage, and ciphertext encoding. It is used to monitor new information sent from each plant and station user group in real time, and read, judge, store or reply to the new information. It includes the following subroutines:

⑴Program preparation and initialization:

① Initialize variables: At the beginning of the program, various related variables and arrays are defined, and the saved information in the Config.Cfg and ybhRet.Rec files is read as the initial state of the program execution, so that the program operation can be perfectly connected with the last interruption;

② Start WeChat application: Check whether the Windows version of WeChat application is running. If not, start it here and confirm on the phone that you have logged into WeChat using the computer.

③ Adjust the program window: adjust the size of the WeChat window so that it occupies 1/3 of the left side of the screen, adjust the size of the RPA program running window so that it occupies 2/3 of the right side of the screen, and make the output information occupy a certain area of the lower right side of the window to display the output messages of the program in real time;

④ Make the WeChat window active: Write a prompt "Monitoring program is running" on the RPA window to make the WeChat window active;

⑵ Monitoring and collection of information: Set up a large loop to periodically detect unread messages, once every 1 or 2 minutes (the number of minutes between each detection is determined by the setting value of the "detection frequency" in the control panel), and place the "unread message group name array generation subroutine" and "data reading and storage subroutine" in the loop in sequence. The former subroutine constructs an array by cyclically checking the group names with "red circle numbers" in the WeChat chat list window, and the latter subroutine searches for the unread message group names in the search bar of the WeChat window in turn, and tries to read, interpret or reply to the latest unread messages in its dialogue window. Before the end of the loop, the information that has been successfully read is interpreted and encoded by the ciphertext encoding subroutine and then stored. At the same time, the plant and station user data that has been successfully read in this cycle, the set of plant and station user group names that have been successfully read so far, and which plant and station users have not yet submitted data are output to the view output window. The information that failed to be read is automatically replied to request that it be checked and resubmitted;

⑶ Generation of unread message group name array: This subroutine can automatically search for unread messages in the chat list of the computer WeChat window, and collect the group names of the users who sent these unread messages into a defined array; the implementation method is as follows: use a loop statement and the "Get Text" command to read the element text of the first 15 records (Idx attribute = 0~14) in the chat list displayed on the screen in reverse order. Search the position of the substring "0:00" to "23:59" represented by the regular expression in the element text. If the position is not 1, it means that there are unread messages in the group. If the position is 1, add the "0\t" substring (\t is a tab character) before the element text string variable; replace the "\r\n" in the element text string with "\t"; use "\t" to cut the replaced element text string to get 15 chat list arrays; then use the regular expression to find whether the third element in the test chat list array exists in the plant station user group array; if not, use the exception capture command to mark the plant station user group judgment variable as "false"; finally, construct the third element in the chat list array whose first element in the chat list array is not equal to 0 and the plant station user group judgment variable is "true" into an unread message group name array;

⑷Data reading and storage: This subroutine can use a loop command in the search bar of the computer WeChat window to search the factory, station and user group names in its attribute parameter array one by one, so as to obtain the recent conversation information with the factory, station and user group in the conversation window. The attribute parameter of this subroutine is the array of unread message group names. The program obtains 20 compatible formats of the "date" information identifier of the data to be captured based on the "date change time" in the control panel, and uses the "determine whether the text exists in the target" command to search for each message in the dialog box for the group name in the unread message group name array. If none of the 20 "date" information identification formats are found, the program simulates the WeChat sending process and replies to the group with the message "The message cannot be automatically identified, please check and resend", asking it to resend, otherwise the program continues;

Use the "Click Text" command to double-click the last text in the window containing the "Date" information mark to make the target text in the full selection state; use the "Simulate Key Ctrl+C" command to copy the target text to the clipboard, and then use the "Get Clipboard Text" command to assign the target text to the target string variable; next, a series of processing is performed on the obtained target string variable, including replacing the Chinese colon, semicolon, comma, semicolon and other punctuation marks with English colons, replacing spaces, horizontal bars, and slashes with empty characters, replacing the letter o with the number 0, replacing the letter l with the number 1, and other fault-tolerant operations; next, the processed target string is cut with the line feed character "\n", and then the string cut with the line feed character is cut with the English colon ":", and then the obtained string is encoded with the key to construct the target array, and finally the array is written into the "Scattered Data" worksheet in the opened "Data File" workbook with the "Write Row" command. The number of rows in the write position is the same as the number of unit numbers of the plant station household group in the "Setting File", thereby completing the reading and storage of data, and at the same time, the name of the plant station household group is recorded in the "Reported Household Collection";

⑸ Ciphertext encoding: When capturing data reported by each plant and station user, the data monitoring and collection program first encodes the captured data using a key, then stores the encoded data in a data file, and finally converts the data file into a transmission file.

The specific process is as follows:

First, the year, month, and day data of the data capture time are obtained through the time function, and a certain encoding key is obtained after the encryption polynomial operation with the "Date Change Time" set in the control panel; the captured data is converted into ASCII code, and then the converted ASCII code and the key are superimposed to generate a ciphertext code; the ciphertext code is stored in the data file with a background color and the WPS editing bar is hidden; the data file is converted into a two-dimensional array through the "Read Worksheet Area" command, and then the two-dimensional array is converted into a Json string, and then written to the transfer file, thus generating a plain text ciphertext "Transfer File.dat", which can be copied to the intranet computer through the intranet U disk.

The network switch includes a KVM switch and a data transfer USB flash drive. According to the requirements of the State Grid Corporation's data security policy, the internal and external network computers are physically isolated. In order to enable users to use a set of keyboards, mice, and monitors to access and operate two computer hosts on the internal and external networks, the internal and external network computers are connected together with a KVM switch, so that the two computers on the internal and external networks share a set of keyboards, mice, monitors, and internal network USB flash drives. The scattered data monitoring and collection program runs on the external network computer. In order to ensure data security, the data files working on the external network computer are set with permission protection and stored in ciphertext. In order to avoid the spread of viruses, the transfer file used to transfer data to the internal network computer uses a plain text ciphertext file. The operations of copying the external network into the USB flash drive and the USB flash drive into the internal network are completed by calling the "file copy" subroutine with one click by the program.

The fusion and application module is composed of a ciphertext decoding subroutine and a data fusion and application subroutine running on an internal network computer:

⑴ The ciphertext decoding subroutine is: the transmitted file is decoded on the internal network computer, and the decoding process is the inverse process of the encoding process, that is, first read the transmitted file into the Json string variable, and then convert it into an object to form a two-dimensional array; obtain the maximum subscript of the array, and through a double loop, decode the array elements one by one according to the encoding inverse operation algorithm and then construct a new array; write the constructed new array into the WPS file through the write area command, thereby obtaining a complete decoded data file;

⑵The data fusion and application subroutine: after the transmission file is decoded, a complete WPS format data file is obtained on the internal network computer. By integrating this file with the WPS format data files collected from the EMS system, the electric energy collection system and the user electricity consumption information collection system respectively, the complete operation data of the regional power grid dispatching can be obtained, which will provide complete data source support for the regional power grid dispatching analysis and reporting.

This embodiment is used for the automatic collection and integration method of randomly reported scattered data, which includes establishing a WeChat group and reporting data, running an external network computer program, network switching and running an internal network computer program. The specific steps are as follows:

1) Establish WeChat group and submit data

In the dispatching WeChat application, a WeChat group is created for each plant and station user, including the duty officer who reports the data. The duty officer who reports the data will report the data to be reported in the WeChat group in the required format;

2) External network computer program running

The external network computer program operation includes:

⑴Program preparation and initialization;

⑵ Regular cycle detection of unread messages;

⑶ Generate an array of unread message group names;

(4) Information trial reading;

⑸Ciphertext encoding and storage;

⑹ Read all unread messages or terminate manually;

⑺Transfer file generation;

3) Network switching

Use a KVM switch to connect two network computers together, and copy the transfer files to the internal network computer through the internal network USB flash drive in a way that the internal network and the external network are isolated;

4) Internal network computer program operation

The internal network computer program operation includes:

⑴Decode the transfer file;

(2) Data fusion;

⑶Data application.

Furthermore, the step 2) running the external network computer program specifically includes:

⑴Program preparation and initialization

⑵Timed loop detection of unread messages

Set a large cycle to detect unread messages. The cycle interval is set by the detection frequency in the control panel. The detection is performed once every set interval.

⑶ Generate an array of unread message group names

Automatically search for unread messages and store the names of the user groups that sent these unread messages into a defined array;

⑷ Information Reading

Trial read the unread information of the loop detection, and pass the successfully read information to the ciphertext encoding subroutine after decoding. At the same time, output the plant and station household data that have been successfully read in this cycle, the plant and station household group name set that has been successfully read so far, and which plants and stations households have not yet submitted data to the view output window. Automatically reply to the information that failed to be trial read and ask it to check and resubmit;

⑸Ciphertext encoding and storage

The successfully read information is decoded and passed to the ciphertext encoding subroutine, which encodes it and stores it;

(6) Read all unread messages or terminate manually

Read all the unread messages in the loop detection, or manually terminate the message reading as needed;

⑺Transfer file generation

The ciphertext is encoded and stored in the data file with a background color and the WPS editing bar is hidden; the data file is converted into a two-dimensional array through the read worksheet area command, and then the two-dimensional array is converted into a Json string, and then written into the transfer file, thereby generating a plain text ciphertext transfer file .dat.

The steps (1) of program preparation and initialization are as follows:

① Initialize variables: At the beginning of the program, various related variables and arrays are defined, and the saved information in the Config.Cfg and ybhRet.Rec files is read as the initial state of the program execution, so that the program operation can be perfectly connected with the last interruption;

② Start WeChat application: Check whether the Windows version of WeChat application is running. If not, start it here and confirm on the phone that you have logged into WeChat using the computer.

③ Adjust the program window: adjust the size of the WeChat window so that it occupies 1/3 of the left side of the screen, adjust the size of the RPA program running window so that it occupies 2/3 of the right side of the screen, and make the output information occupy a certain area of the lower right side of the window to display the output messages of the program in real time;

④ Make the WeChat window active: Write a prompt "Monitoring program is running" on the RPA window to make the WeChat window active.

The step 2) of running the internal network computer program includes:

⑴Delivery file decoding

The transferred file is decoded on the internal network computer. First, the transferred file is read into a Json string variable, and then converted into an object to form a two-dimensional array. The maximum subscript of the array is obtained, and through a double loop, the array elements are decoded one by one according to the encoding inverse operation algorithm and then constructed into a new array. The constructed new array is written into the WPS file through the write area command, thereby obtaining a complete decoded data file.

(2) Data fusion

After the transmission file is decoded, a complete WPS format data file is obtained on the internal network computer, and the file is integrated with the WPS format data files collected from the EMS system, the electric energy collection system and the user electricity consumption information collection system;

⑶Data application

By integrating the complete WPS format data file obtained after decoding with the WPS format data files collected from the EMS system, electric energy collection system and user electricity consumption information collection system, we can obtain the complete operation data of the regional power grid dispatching, which will provide complete data source support for regional power grid dispatching analysis and reporting.

The present invention is not limited to this specific implementation mode. For those skilled in the art, simple duplication and improvement without creative work all fall within the scope of protection of the claims of the present invention.

Claims (2)

1. An automatic collection and integration system for randomly reporting scattered data, which is characterized in that: the system comprises a WeChat group, a WeChat automatic processing module, an information reporting and format specification, file setting and program control on an external network computer, a transfer file generating module, a network switching and fusing and application module:

The WeChat group is to create a WeChat group containing the reporting data attendant for each station in the dispatching WeChat application, and is used for reporting the data to be reported in the WeChat group according to the required format;

the automatic WeChat processing module is a Windows version WeChat application which is monitored and controlled by an RPA program at a dispatching end and is operated on an external network computer, and is used for automatically interacting, judging and feeding back with WeChat groups of each plant station, collecting and integrating reported data, including program preparation and initialization, information monitoring and collecting, unread information group name number group generation, data reading and storing and ciphertext coding, and is a program for monitoring new information sent from each plant station group in real time on the external network computer and reading, judging, storing or replying the new information, and comprises the following subprograms:

preparing and initializing a program:

(1) initializing variables: the program starts to define each related variable and array, and reads the stored information in Config.Cfg and ybhRec.Rec files as the initial state of program execution, so that the program operation can be perfectly linked with the last interruption;

(2) starting a WeChat application: judging whether the Windows edition WeChat application is operated, if not, starting the Windows edition WeChat application, and confirming that the WeChat is logged in by a computer on the mobile phone;

(3) Adjusting a setup program window: the size of the WeChat window is adjusted to enable the WeChat window to occupy 1/3 of the left side of a screen, the size of the RPA program running window is adjusted to enable the WeChat window to occupy 2/3 of the right side of the screen, and the output information of the WeChat window occupies a window with a certain area on the lower right side, so that the WeChat window is used for displaying the output information of program work in real time;

(4) placing the WeChat window in an active state: prompting 'monitoring program running' in the RPA window writing screen, and enabling the WeChat window to be in an activated state;

monitoring and collection of information: the method comprises the steps of periodically and circularly detecting unread information, decoding the information which is successfully subjected to trial reading, encoding by a cipher code subprogram, storing, and simultaneously outputting the factory and family data which is successfully read in the cycle, a factory and family group name set which is successfully read so far and also other factory and family not yet reported data to a view output window, and automatically replying the information which is failed to be subjected to trial reading to enable the information to be checked and then reported again;

generating unread information group names: automatically searching unread information and sending the unread information into a well-defined array of station family group names;

reading and storing data: searching each piece of information in a dialogue box one by one for the group names of the unread information group name array, acquiring the last text containing the information mark, cutting the character string, storing the obtained character string in a data file after the key coding, and simultaneously, recording the plant station group names into a reported user set;

Encoding ciphertext: obtaining a coding key through the operation of a time function and the setting in the control panel, converting the captured data into ASCII codes, superposing the converted ASCII codes and the key to generate ciphertext codes, storing the ciphertext codes in a data file in a background color, and hiding a WPS editing column; converting the data file into a two-dimensional array by reading the worksheet region command, converting the two-dimensional array into a Json character string, and writing the Json character string into a transfer file, thereby generating a plain text ciphertext transfer file;

the information reporting and format specification comprises requirements of time, information format and data unit of reporting data, is used for specifying micro-message groups, group members of each station and user reporting data and time, information format and data unit of reporting data in the groups, and specifically comprises the following items:

the method comprises the steps that a WeChat group taking a station name as a group name is respectively established on a scheduling WeChat application, the WeChat group comprises all operators on duty reporting data of the station, and each data reporting operator cannot modify the group name, but is allowed to modify remarks; the names and the number of the micro-letter groups are unified with the content of the setting file, data to be reported are reported in the micro-letter groups by data reporting personnel every day according to the set time, and the reported data must contain a date key word, which is a unique information identification code when the micro-letter automatic processing module collects the data;

Secondly, the data information reporting format requires line entry, names and data are separated by colon, and the colon does not separate Chinese and English and is omitted; the first row is a data date, the date is 8 digits, the first 4 digits are the year of the male element, the 5 th and 6 th digits are months, the 7 th and 8 th digits are days, and if the month and the days are less than 10, 0 is supplemented on ten digits; reporting data in kilowatt-hour unit;

thirdly, in the automatic WeChat processing module, a plurality of fault-tolerant formats are set for the information identification code, the possible date and time formats, the bar and the diagonal connector in the reported information are enumerated one by one, fault-tolerant correction is carried out, and when the information cannot be identified, the automatic WeChat processing module simulates the WeChat sending process to automatically reply the information to the group and resend the information, so that the integrity of the data is ensured;

the file setting and program control on the external network computer is to set a folder on a hard disk of the external network computer, which comprises a setting file, a data file and a transmission file, a process file and a control panel are set in the RPA program folder, three files are monitored, collected and transmitted, the files are used for setting and storing the number, group name and running state of data reporting units, automatically generating the file of data reported by each data reporting unit stored in the running process of the program, transmitting the data file of a plain text between the network computers adopting physical isolation measures, and setting the file setting and the program control through the control panel, wherein:

(1) Setting file

The set file is a group name set file of the data reporting unit, is a WPS file in xlsx format, and is used for setting and storing the number, group name and running state of the data reporting unit; the serial number is used for determining the storage position of the data reported by the unit in the data file, the running state has two choices of running and suspending, and when the user is in the suspending state, the program automatically skips the unit when running;

(2) Data file

The data file is an xlsx WPS file, is automatically generated in the process of program operation and stores data reported by each data reporting unit, and is provided with opening permission protection for the sake of data security, and the stored data is encoded ciphertext;

(3) Delivering files

The transfer file is a Txt file in dat format, and is a plain text file which is automatically generated from the complete data file through a program and is used for transmitting data between network computers taking physical isolation measures; the text file stores a Json character string converted from a two-dimensional array, wherein the data is a coded ciphertext;

(4) Control panel

The control panel is a user interaction setting interface program module, and by running the program module, a user can conveniently set a WeChat. Exe installation path, a working directory, a monitoring frequency, a USB flash disk character, a USB flash disk password, a USB flash disk data storage area, date change time, timing automatic running time, a storage area of the user in a setting file and whether data is plaintext or ciphertext storage and transmission; after the information is input or modified through the control panel, the information is stored in a text file named Config. Cfg in the form of a dictionary Json character string so as to be called at any time in the running process of the program, and the method is a means for adapting the program to the personalized setting parameters of different users; meanwhile, a text file named ybhRec is also arranged in the RPA program folder, and a data dictionary of the reported user name and interruption time when the monitoring program is temporarily interrupted is stored;

The transfer file generation module is a subprogram used for converting the WPS file in the xlsx format of the ciphertext into a plain text file in the Dat format;

the network switch comprises a KVM switch and a data transmission U disk, wherein the KVM switch is used for connecting two network computers together, a transmission file is copied into an internal network computer in an internal network and external network isolation mode through the internal network U disk, and in order to ensure data safety, the transmission file adopts a plain text ciphertext file and is used for quickly transmitting data between two or more network computers adopting physical isolation measures;

the fusion and application module is composed of a ciphertext decoding subprogram and a data fusion and application subprogram which run on an internal network computer, and is used for fusing a complete data file with data files respectively acquired from an EMS system, an electric energy acquisition system and a user electricity consumption information acquisition system to obtain complete running data of regional power grid dispatching and provide complete data source support for regional power grid dispatching analysis and report forms, wherein:

the ciphertext decoding subprogram comprises: the transfer file is decoded on an internal network computer, and the decoding process is the inverse process of the encoding process, namely, firstly reading the transfer file to Json character string variables, and then converting the transfer file into objects to form a two-dimensional array; obtaining the maximum subscript of the array, decoding array elements one by one according to a coding inverse operation algorithm through double circulation, and then constructing a new array; writing the constructed new array into the WPS table file through a writing area command, thereby obtaining a complete decoding data file;

The data fusion and application subroutines: after decoding, the transfer file obtains a complete WPS-format data file on an internal network computer, and the file is fused with the WPS-format data file respectively collected from the EMS system, the electric energy collection system and the user electricity consumption collection system to obtain complete operation data of regional power grid dispatching, so that complete data source support is provided for regional power grid dispatching analysis and report forms.

2. An automatic collection and integration method for randomly reporting scattered data is characterized by comprising the following steps: the method comprises the steps of establishing a micro-message group, reporting data, operating an external network computer program, switching a network and operating an internal network computer program, and specifically comprises the following steps:

1) Establishing a WeChat group and reporting data

Creating a micro-letter group containing the operator of the reported data for each plant station in the dispatching micro-letter application, and reporting the data to be reported in the micro-letter group according to a required format by the operator of the reported data;

2) External network computer program operation

The external network computer program operation includes:

program preparation and initialization

(1) Initializing variables: the program starts to define all relevant variables and arrays, and reads the stored information in Config. Cfg and ybhRec. Rec files to be used as an initial state of program execution, so that the program operation can be perfectly linked with the last interruption;

(2) Starting a WeChat application: judging whether the Windows edition WeChat application is operated, if not, starting the Windows edition WeChat application, and confirming that the WeChat is logged in by a computer on the mobile phone;

(3) adjusting a setup program window: the size of the WeChat window is adjusted to enable the WeChat window to occupy 1/3 of the left side of a screen, the size of the RPA program running window is adjusted to enable the WeChat window to occupy 2/3 of the right side of the screen, and the output information of the WeChat window occupies a window with a certain area on the lower right side, so that the WeChat window is used for displaying the output information of program work in real time;

(4) placing the WeChat window in an active state: prompting 'monitoring program running' in the RPA window writing screen, and enabling the WeChat window to be in an activated state;

timing cycle detection of unread information

Setting a large cycle timing cycle to detect unread information, wherein the cycle interval time is set by the detection frequency in the control panel, and the detection is carried out once every interval set time;

generating unread message group name number group

Automatically searching unread information and sending the unread information into a well-defined array of station family group names;

fourth step of information trial reading

The unread information of the cyclic detection is subjected to trial reading, the information of the trial reading success is read and then is transmitted to a ciphertext coding subprogram, meanwhile, the data of the station family which is successfully read in the cyclic reading at the present time, the station family group name set which is successfully read so far and the station family which are not yet reported data are output to a view output window, and the information of the trial reading failure is automatically returned to be checked and then reported again;

Ciphertext encoding and storing

Reading the information successfully tested and reading, then transmitting the information to a ciphertext coding subprogram, and storing the information after coding by the ciphertext coding subprogram;

full read of unread information or artificial termination of the sixth step

Completely reading unread information detected by circulation or manually stopping reading the information according to the need;

signaling file generation

Storing the ciphertext code in a data file in a background color and hiding the WPS editing column; converting the data file into a two-dimensional array by reading the worksheet region command, converting the two-dimensional array into a Json character string, and writing the Json character string into a transfer file, thereby generating a plain text ciphertext transfer file;

3) Network switching

Connecting two network computers together by using a KVM switch, copying the transmission file into the internal network computer in an internal network and external network isolation mode by using an internal network U disk;

4) Internal network computer program operation

The internal network computer program operation includes:

method and system for decoding a file

Decoding a transfer file on an internal network computer, firstly reading the transfer file to a Json character string variable, and then converting the transfer file into an object to form a two-dimensional array; obtaining the maximum subscript of the array, decoding array elements one by one according to a coding inverse operation algorithm through double circulation, and then constructing a new array; writing the constructed new array into the WPS file through a writing area command, thereby obtaining a complete decoding data file;

Data fusion of (C)

The transmitted file is decoded to obtain a complete WPS-format data file on an internal network computer, and the file is fused with the WPS-format data file respectively acquired from the EMS system, the electric energy acquisition system and the user electricity consumption information acquisition system;

data application

And merging the decoded complete WPS-format data file with the WPS-format data files respectively acquired from the EMS system, the electric energy acquisition system and the user electricity consumption information acquisition system to obtain regional power grid dispatching complete operation data, thereby providing complete data source support for regional power grid dispatching analysis and report forms.