CN118488103A - Multisource satellite telemetry data analysis system - Google Patents
Multisource satellite telemetry data analysis system Download PDFInfo
- Publication number
- CN118488103A CN118488103A CN202410941250.9A CN202410941250A CN118488103A CN 118488103 A CN118488103 A CN 118488103A CN 202410941250 A CN202410941250 A CN 202410941250A CN 118488103 A CN118488103 A CN 118488103A
- Authority
- CN
- China
- Prior art keywords
- telemetry
- data
- information
- message
- unit
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000007405 data analysis Methods 0.000 title claims abstract description 30
- 238000012545 processing Methods 0.000 claims abstract description 159
- 238000007781 pre-processing Methods 0.000 claims abstract description 63
- 238000004891 communication Methods 0.000 claims abstract description 50
- 238000005259 measurement Methods 0.000 claims abstract description 46
- 238000012544 monitoring process Methods 0.000 claims abstract description 29
- 238000004458 analytical method Methods 0.000 claims abstract description 20
- 238000007726 management method Methods 0.000 claims description 35
- 238000012795 verification Methods 0.000 claims description 32
- 230000006870 function Effects 0.000 claims description 28
- 230000005540 biological transmission Effects 0.000 claims description 23
- 230000000007 visual effect Effects 0.000 claims description 16
- 238000012800 visualization Methods 0.000 claims description 13
- 238000013524 data verification Methods 0.000 claims description 11
- 238000004364 calculation method Methods 0.000 claims description 8
- 238000013523 data management Methods 0.000 claims description 7
- 230000004044 response Effects 0.000 claims description 7
- 238000000034 method Methods 0.000 description 25
- 230000008569 process Effects 0.000 description 20
- 238000003672 processing method Methods 0.000 description 16
- 238000010586 diagram Methods 0.000 description 14
- 230000004927 fusion Effects 0.000 description 4
- 230000008676 import Effects 0.000 description 4
- 239000000470 constituent Substances 0.000 description 3
- 238000011161 development Methods 0.000 description 3
- 239000000284 extract Substances 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 3
- 102100030289 Chronophin Human genes 0.000 description 2
- 101000582974 Homo sapiens Chronophin Proteins 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 2
- 239000000872 buffer Substances 0.000 description 2
- 230000008859 change Effects 0.000 description 2
- 238000006243 chemical reaction Methods 0.000 description 2
- 239000011093 chipboard Substances 0.000 description 2
- 238000013461 design Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 238000009432 framing Methods 0.000 description 2
- 238000012423 maintenance Methods 0.000 description 2
- 238000002360 preparation method Methods 0.000 description 2
- 238000012360 testing method Methods 0.000 description 2
- 239000000969 carrier Substances 0.000 description 1
- 230000015556 catabolic process Effects 0.000 description 1
- 239000003086 colorant Substances 0.000 description 1
- 238000013144 data compression Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 238000000926 separation method Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/56—Provisioning of proxy services
- H04L67/565—Conversion or adaptation of application format or content
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04B—TRANSMISSION
- H04B7/00—Radio transmission systems, i.e. using radiation field
- H04B7/14—Relay systems
- H04B7/15—Active relay systems
- H04B7/185—Space-based or airborne stations; Stations for satellite systems
- H04B7/1851—Systems using a satellite or space-based relay
- H04B7/18513—Transmission in a satellite or space-based system
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/2866—Architectures; Arrangements
- H04L67/2869—Terminals specially adapted for communication
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/2866—Architectures; Arrangements
- H04L67/2871—Implementation details of single intermediate entities
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- Astronomy & Astrophysics (AREA)
- Aviation & Aerospace Engineering (AREA)
- General Physics & Mathematics (AREA)
- Radio Relay Systems (AREA)
Abstract
The invention relates to the technical field of satellite measurement and operation control, and particularly discloses a multisource satellite telemetry data analysis system which comprises a data transceiver module, a message middleware and a data processing module, wherein the data transceiver module is used for monitoring satellite telemetry data sent by each satellite measurement and operation control system according to preset communication information, analyzing the satellite telemetry data according to a preset data packet protocol, acquiring telemetry original codes and pushing first messages to the message middleware; the first message includes telemetry original; the telemetry preprocessing module is used for preprocessing telemetry original codes according to preset telemetry information to form serialized data and pushing second messages to the message middleware; the second message includes serialized data; the telemetry analysis module is used for acquiring telemetry information corresponding to the serialized data according to preset telemetry configuration information; processing the serialized data according to the telemetry processing information, obtaining telemetry processing results, and sending a third message to the message middleware; the third message includes telemetry processing results.
Description
Technical Field
The invention relates to the technical field of satellite measurement and operation control, in particular to a multisource satellite telemetry data analysis system.
Background
Telemetry data of current spacecraft is largely divided into two types, frame and packet, according to the formatting. The current telemetry data processing software processes telemetry data into engineering variables or state quantities according to satellite telemetry outline processing requirements, and then distributes processing results. The ground operation control system monitors the telemetry result and analyzes the working condition of each satellite system.
However, because each model of satellite has different requirements for structure and function, the format, engineering telemetry parameters, and parameter processing methods for the telemetry data downloaded by the different types of satellites are quite different. Meanwhile, the network transmission protocol and the data packet protocol between different ground operation control systems and the measurement operation control center are different. Therefore, current telemetry data processing software is mostly dedicated to the expert. When a satellite is newly added, the codes of the current telemetry data processing software need to be modified, and the current telemetry data processing software is updated and maintained. Therefore, the current telemetry data processing software only supporting a single star has poor universality, cannot adapt to the industry trend of multi-star common management, and is unfavorable for controlling the software cost.
Disclosure of Invention
Based on this, it is necessary to provide a multi-source satellite telemetry data analysis system for solving the problem that the current telemetry data processing software only supporting a single satellite has poor universality.
The multi-source satellite telemetry data analysis system comprises a data receiving and transmitting module, a first message pushing module and a second message pushing module, wherein the data receiving and transmitting module is used for monitoring satellite telemetry data sent by each satellite measurement and control system according to preset communication information, analyzing the satellite telemetry data according to a preset data packet protocol, obtaining telemetry original codes, sending chain monitoring data to each satellite measurement and control system, and pushing the first message to a message middleware; the first message includes the telemetry original code; the telemetry preprocessing module is used for subscribing the first message to the message middleware, preprocessing the telemetry original code according to preset telemetry information to form serialized data, and pushing the second message to the message middleware; the second message includes the serialized data; the telemetry analysis module is used for subscribing the second message to the message middleware and acquiring telemetry information corresponding to the serialized data according to preset telemetry configuration information; processing the serialized data according to the telemetry processing information, obtaining telemetry processing results, and sending a third message to the message middleware; the third message includes the telemetry processing result.
In one embodiment, the multi-source satellite telemetry data resolution system further comprises a visualization configuration module for managing configuration information, the configuration information including communication information, the data packet protocol, the telemetry information, the telemetry configuration information, the telemetry information; and the storage module is used for storing the configuration information.
In one embodiment, the data transceiver module includes a first configuration unit, configured to obtain the preset communication information and a preset packet protocol; the communication information includes, but is not limited to, communication protocols, communication ports, network transmission protocols; the monitoring unit is used for monitoring satellite telemetry data sent by each satellite measurement and control system according to the communication information; the data analysis unit is used for analyzing the packet header information of the satellite telemetry data according to the data packet protocol and extracting telemetry original codes of the satellite telemetry data; the chain monitoring unit is used for generating PB-format chain monitoring data according to the communication information and sending the PB-format chain monitoring data to each satellite measurement and operation control system; a first message pushing unit, configured to push a first message to the message middleware; the first message includes the telemetry original code.
In one embodiment, the data transceiver module further includes a data verification unit, configured to determine, after parsing header information of the satellite telemetry data, whether verification information in the data packet protocol matches verification information in the telemetry original code, transmit the telemetry original code to the first message pushing unit in response to a verification result that the verification information in the data packet protocol matches the verification information in the telemetry original code, and discard the satellite telemetry data in response to a verification result that the verification information in the data packet protocol does not match the verification information in the telemetry original code; and the network data quality statistics unit is used for counting the quality of the network data received at this time after the data verification unit discards the satellite telemetry data.
In one embodiment, the serialized data is PB format data, and the telemetry preprocessing module includes a second configuration unit, configured to obtain the telemetry information set in advance; the telemetry information includes, but is not limited to, telemetry frame format and parameter information; a first message subscription unit, configured to subscribe the first message to the message middleware; the data preprocessing unit is used for performing one or more data processing operations of descrambling, decryption, frame splitting and wave dividing channels on the telemetry original code according to the telemetry information, generating an intermediate result, and forming PB format data according to the intermediate result; a second message pushing unit, configured to push a second message to the message middleware; the second message includes the PB format data.
In one embodiment, the telemetry preprocessing module further includes a data matching unit, configured to determine whether a telemetry frame format in the telemetry information matches a telemetry frame format in the telemetry original after the first message is acquired, transmit the telemetry original to the data preprocessing unit in response to a verification result that the telemetry frame format in the telemetry information matches the telemetry frame format in the telemetry original, and discard the telemetry original in response to a verification result that the telemetry frame format in the telemetry information does not match the telemetry frame format in the telemetry original; and the telemetry data quality statistics unit is used for counting the quality of the telemetry data received at this time after the data matching unit discards the telemetry original codes.
In one embodiment, the telemetry resolution module includes a second message subscription unit for subscribing the message middleware to the second message; a third configuration unit, configured to obtain preset telemetry configuration information; the data loading unit is used for acquiring telemetry information corresponding to the serialized data according to the telemetry configuration information; the data processing unit is used for carrying out resolving processing on the serialized data according to the telemetry processing information to obtain telemetry processing results; a third message pushing unit, configured to send a third message to the message middleware; the third message includes the telemetry processing result.
In one embodiment, the data processing unit includes a first processing unit, configured to count a number of pieces of information of telemetry parameters corresponding to the serialized data, and determine a task amount of a calculation task according to the number of pieces of information; the second processing unit comprises at least one processing thread, and the first processing unit is used for distributing the resolving task to the processing thread of the second processing unit according to the task quantity and the thread number of the processing thread in the second processing unit; the processing thread is used for calling the telemetry processing information corresponding to the identification according to the identification in the serialized data, calculating engineering variables and state quantities according to the telemetry processing information, and carrying out secondary processing on the state quantities; and the second processing unit is also used for summarizing the resolving results of the processing threads to form telemetry processing results.
In one embodiment, the visual configuration module includes a data packet protocol management unit, configured to implement an add-delete-modify-check function for the data packet protocol; and the telemetry data management unit is used for realizing the functions of adding, deleting and checking the telemetry information, the telemetry configuration information and the telemetry information.
In one embodiment, the visual configuration module further includes a satellite information management unit, configured to implement an add-delete-modify-search function for satellite information; the satellite measurement and operation control system management unit is used for realizing the functions of adding, deleting and checking the satellite measurement and operation control system information; and the calibration mode management unit is used for realizing the functions of adding, deleting and modifying the calibration mode.
The multi-source satellite telemetry data analysis system comprises a data receiving and transmitting module, a telemetry preprocessing module and a telemetry analysis module, wherein the data receiving and transmitting module, the telemetry preprocessing module and the telemetry analysis module are communicated through message middleware. The data receiving and transmitting module respectively monitors each satellite measurement and operation control system, receives satellite telemetry data, analyzes the satellite telemetry data to obtain telemetry original codes, and sends the telemetry original codes to the message middleware. The telemetry preprocessing module acquires telemetry original codes through the message middleware, preprocesses the telemetry original codes to form serialized data, and sends the serialized data to the message middleware. The telemetry analysis module acquires the serialized data through the message middleware and processes the serialized data to form telemetry processing results, and the telemetry processing results are sent to the message middleware. The ground control system can acquire telemetry processing results through subscription message middleware. The message middleware can be used for realizing the parallel and efficient processing of multi-star telemetry data, and each star parameter processing thread is mutually independent and is not mutually influenced. The fusion unification of the multi-source heterogeneous telemetry data is realized by uniformly converting different types of satellite telemetry data into serialized data.
Drawings
In order to more clearly illustrate the embodiments of the present description or the technical solutions in the prior art, the following description will briefly explain the embodiments or the drawings used in the description of the prior art, and it is obvious that the drawings in the following description are only some embodiments described in the present description, and other drawings can be obtained according to these drawings without inventive effort for a person skilled in the art.
FIG. 1 is a diagram of a multi-source satellite telemetry data resolution system in accordance with one embodiment of the present application;
FIG. 2 is a schematic diagram of a multi-source satellite telemetry data resolution system according to another embodiment of the application;
FIG. 3 is a schematic diagram of a visual configuration module according to one embodiment of the present application;
Fig. 4 is a schematic structural diagram of a data transceiver module according to one embodiment of the present application;
FIG. 5 is a schematic diagram of a telemetry pre-processing module in accordance with one embodiment of the present application;
FIG. 6 is a schematic diagram of a telemetry resolution module according to one embodiment of the application;
FIG. 7 is a schematic diagram of a data processing unit according to one embodiment of the present application.
Detailed Description
In order that the invention may be readily understood, a more complete description of the invention will be rendered by reference to the appended drawings. The drawings illustrate preferred embodiments of the invention. This invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete.
Unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. The terminology used herein in the description of the invention is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. The term "and/or" as used herein includes any and all combinations of one or more of the associated listed items.
Different types of satellites currently have different requirements for structure and function, and the formats of telemetry data downloaded by different types of satellites, engineering telemetry parameters and parameter processing methods are quite different. Meanwhile, network transmission protocols and data packet protocols from different ground measurement and control stations to a measurement and control center are different. Therefore, current telemetry data processing software is mostly dedicated to the expert. When a satellite is newly added, the codes of the current telemetry data processing software need to be modified, and the current telemetry data processing software is updated and maintained. Therefore, the current telemetry data processing software only supporting a single star has poor universality, cannot adapt to the industry trend of multi-star common management, and is unfavorable for controlling the software cost. The current software has poor universality, only supports single-star telemetry data processing, and cannot adapt to the industry trend of multi-star common pipe.
The application provides a multisource satellite telemetry data analysis system capable of realizing multisatellite universal common management, which can process multisatellite, multisatellite and multisatellite type telemetry data in parallel. In some embodiments, the multi-satellite telemetry data analysis system of the multi-satellite universal common pipe can be deployed in a measurement and control center, and the multi-satellite telemetry data analysis system can be a device (such as a computer, a server, cloud computing and the like) with a large amount of computing resources or a device (such as a hardware circuit of an FPGA chip board, an ASIC chip board and the like) with limited computing resources.
FIG. 1 is a diagram of a multi-source satellite telemetry data resolution system in accordance with one embodiment of the present application. In one embodiment, a multi-satellite telemetry data resolution system for multi-satellite common-use common-pipe may include a data transceiver module 100, a telemetry preprocessing module 200, and a telemetry resolution module 300.
The data transceiver module 100 may be configured to monitor satellite telemetry data sent by each satellite measurement and control system according to preset communication information, parse the satellite telemetry data according to a preset data packet protocol, obtain telemetry codes, send chain monitoring data to each satellite measurement and control system, and push a first message to the message middleware 10; the first message includes telemetry original.
Because different measurement and operation control systems externally realize different communication connection modes, and meanwhile, the data formats, engineering telemetry parameters and parameter processing methods of satellite telemetry data transmitted by different measurement and operation control systems are also different, the information can be formed into communication information and a data packet protocol in a preconfigured mode. The communication information may be various information related to implementing communication connection between the data transceiver module 100 and the satellite measurement and operation control system. By acquiring the communication information corresponding to the target test operation control system, the data transceiver module 100 can realize communication connection with the target test operation control system according to the communication information. The data packet protocol may be information related to a data format, engineering telemetry parameters, a parameter processing method, and the like of satellite telemetry data transmitted by the measurement and control system, and the data transceiver module 100 may determine the data format, engineering telemetry parameters, a parameter processing method, and the like of the satellite telemetry data transmitted by the target measurement and control system by acquiring the data packet protocol corresponding to the target measurement and control system.
The data transceiver module 100 may establish a communication connection with each satellite measurement and control system according to the communication information after acquiring the preset communication information, so as to monitor each satellite measurement and control system to acquire satellite telemetry data sent by each satellite measurement and control system. After the data transceiver module 100 receives the satellite telemetry data, the satellite telemetry data may be parsed according to a data packet protocol corresponding to the satellite telemetry data to obtain a telemetry original code of the satellite telemetry data.
After obtaining the telemetry original, the data transceiver module 100 may push the first message to the message middleware 10. The telemetry original may be included in the first message. Message middleware 10 may be used to implement asynchronous, decoupled, reliable messaging services between distributed systems. The message middleware 10 may store the first message in one or more queues after receiving the first message. The queue provides a message buffer function that can temporarily hold the first message until the first message is consumed. So that the first message is not lost even if telemetry pre-processing module 200 is temporarily unavailable.
Meanwhile, the data transceiver module 100 can monitor the satellite link between the satellite monitoring and operation control system to form the link monitoring data, and send the link monitoring data to the satellite monitoring and operation control system. The link supervision data may include, but is not limited to, signal strength, signal quality, bit error rate, transmission delay, bandwidth occupancy, link availability, power control information, environment, and status parameters, among others. The satellite measurement and operation control system can timely find potential problems in the transmission link by analyzing the link data so as to ensure that measures can be timely taken to prevent faults, optimize the link performance and ensure the link quality of critical tasks.
The telemetry preprocessing module 200 may be configured to subscribe to the message middleware 10 for a first message, preprocess the telemetry original code according to preset telemetry information, form serialized data, and push a second message to the message middleware 10; the second message may include serialized data.
In particular, telemetry pre-processing module 200 may obtain telemetry original by subscribing to a first message of message middleware 10 after preparation, and data transceiver module 100 may not directly establish a connection with telemetry pre-processing module 200. The message middleware 10 can allow the data transceiver module 100 to asynchronously communicate with the telemetry preprocessing module 200, so that the data transceiver module 100 can continue to execute other tasks without waiting for the telemetry preprocessing module 200 to process messages, the response speed and the data throughput of the multi-source satellite telemetry data analysis system are improved, and the fault tolerance capability of the system is enhanced.
Since the preprocessing of satellite telemetry data transmitted for different survey and control systems involves different methods, information related to the preprocessing operation of satellite telemetry data can be formed into telemetry information in a preconfigured manner. By acquiring telemetry information corresponding to the target measurement and operation control system, the telemetry preprocessing module 200 can preprocess the telemetry original code according to the telemetry information to form serialized data. That is, the telemetry preprocessing module 200 can convert satellite telemetry data downloaded by different types of satellites into a unified format, so as to realize fusion and unification of multi-source heterogeneous satellite telemetry data, and is beneficial to improving the efficiency and accuracy of data processing of the telemetry analysis module 300.
Telemetry pre-processing module 200, after forming the serialized data, may push a second message to message middleware 10. The second message may include serialized data. Likewise, message broker 10 may store the second message in one or more queues after receiving the second message. The queue may temporarily hold the second message until the second message is consumed. So that the second message is not lost even if telemetry resolution module 300 is temporarily unavailable.
The telemetry analysis module 300 may be configured to subscribe to the message middleware 10 for a second message, and obtain telemetry information corresponding to the serialized data according to preset telemetry configuration information; processing the serialized data according to the telemetry processing information, obtaining telemetry processing results, and sending a third message to the message middleware 10; the third message may include telemetry processing results.
In particular, telemetry resolution module 300 may obtain serialized data by subscribing to a second message of message middleware 10 after preparation, and telemetry resolution module 300 may not directly establish a connection with telemetry preprocessing module 200. Message middleware 10 may allow telemetry resolution module 300 to communicate asynchronously with telemetry preprocessing module 200 so that telemetry preprocessing module 200 may continue to perform other tasks without waiting for telemetry resolution module 300 to process the message.
Because the telemetry configuration information corresponding to the satellite telemetry data transmitted by different telemetry systems is different, and meanwhile, the different telemetry configuration information also comprises different telemetry information, the corresponding relation between the satellite telemetry data and the telemetry configuration information can be predetermined, and the information corresponding to the different telemetry configuration information and relevant to analysis processing can be configured as telemetry information. Accordingly, telemetry resolution module 300 determines telemetry configuration information corresponding to the serialized data from the received serialized data, thereby determining corresponding telemetry information based on the telemetry configuration information. Telemetry preprocessing module 200 may perform telemetry raw code resolution based on telemetry processing information to obtain telemetry processing results.
Telemetry resolution module 300 may push a third message to message middleware 10 after obtaining telemetry processing results. The third message may include serialized data. Likewise, message broker 10 may store the third message in one or more queues after receiving the third message. The queue may temporarily hold the third message until the third message is consumed, nor is the third message lost.
In the multi-source satellite telemetry data analysis system, the data transceiver module 100, the telemetry preprocessing module 200 and the telemetry analysis module 300 realize asynchronous, decoupled and reliable message transmission through the message middleware 10, so that the complexity of communication among all functional modules in the multi-source satellite telemetry data analysis system can be simplified, and the expandability and flexibility of the system are improved. The data transceiver module 100 can monitor each satellite measurement and control system, receive satellite telemetry data, parse the satellite telemetry data to obtain telemetry codes, and send the telemetry codes to the message middleware 10. Telemetry preprocessing module 200 may obtain telemetry raw codes through message middleware 10 and preprocess them to form serialized data, which is sent to message middleware 10. The telemetry preprocessing module 200 can convert satellite telemetry data downloaded by different types of satellites into a unified format, so that fusion and unification of multi-source heterogeneous satellite telemetry data are realized. Telemetry resolution module 300 obtains and processes the serialized data through message middleware 10 to form telemetry processing results, which are sent to message middleware 10. Other ground operation control systems can consume the telemetry original codes and telemetry processing results from the message middleware 10 to finish the functions of telemetry display, telemetry storage, telemetry result judgment and the like.
Fig. 2 is a schematic structural diagram of a multi-source satellite telemetry data analysis system according to another embodiment of the present application, wherein in one embodiment, the multi-source satellite telemetry data analysis system may further comprise a visualization configuration module 400 and a storage module 500.
The visualization configuration module 400 may be used to manage configuration information, which may include communication information, packet protocols, telemetry information, telemetry configuration information, telemetry information. The storage module 500 may be used to store configuration information.
The visualization configuration module 400 may be used to provide a visualization page. The user can manage the configuration information by visualizing the page. When each satellite is newly added, a user may configure various configuration information associated with the novice via the visualization page provided by the visualization configuration module 400, including, but not limited to, communication information, packet protocols, telemetry information, telemetry configuration information, telemetry information. The visual configuration module 400 may dynamically generate configuration information according to information input by a user, and the storage module 500 may store the configuration information. The data transceiver module 100, the telemetry preprocessing module 200, and the visualization configuration module 400 may obtain configuration information through the storage module 500.
The multi-source satellite telemetry data analysis system provided by the application realizes the data visual configuration function through the visual configuration module 400, and various configured information can be stored in the storage module 500, so that the multi-source satellite telemetry data analysis system can have the advantages of visual operation, data safety and the like.
Fig. 3 is a schematic diagram illustrating the structure of a visualization configuration module according to one embodiment of the present application, in which the visualization configuration module 400 may include a packet protocol management unit 410 and a telemetry data management unit 420.
The packet protocol management unit 410 may be configured to provide a packet protocol management page to implement the function of adding, deleting and modifying the packet protocol. The packet protocol may include all protocols of the packet protocol management page configuration. The packet protocol management unit 410 may further implement a function of adding, deleting, and checking information such as protocol basic information and protocol format, where the protocol basic information may include, but is not limited to, information such as protocol name, byte sequence, code number, byte bit, bit sequence, type, value, remark, etc. In this embodiment, a mainstream or custom packet protocol such as PDXP and Cortex may be supported. A data protocol.
Telemetry data management unit 420 may be used to provide telemetry data management pages to enable add or subtract or retrieve telemetry information, telemetry configuration information, telemetry information. Telemetry information may include, but is not limited to, telemetry frame format and telemetry parameter information, wherein the frame format information may include, but is not limited to, format name, frame length, telemetry type (PCM, pulse Code Modulation, pulse code modulation; CCSDS, consultative Committee for SPACE DATA SYSTEM, spatial data system consultation committee), byte number, byte name, bit order, sequence number, value, remark, frame code identification, and the like. The telemetry parameter information may include, but is not limited to, information of the system, parameter name, parameter identification code, parameter number, feature type, unit, data type, parameter upper limit, parameter lower limit, telemetry format, frame code number, frame name, whether to combine parameters, subframe number, byte order, byte bit, length, calibration mode, condition, parameter processing method, etc.
The telemetry configuration information may refer to a correspondence of an identification in the satellite telemetry data with the telemetry information, and the telemetry information corresponding to the satellite telemetry data may be determined based on the telemetry configuration information and the identification in the satellite telemetry data.
The telemetry information may be a telemetry method of satellite telemetry data, and the telemetry information may include, but is not limited to, direct reading, list, curve, formula, expression and other processing methods, and secondary processing of parameter values may be achieved by using the telemetry method. Telemetry data management unit 420 may also generate a JAR package file from the telemetry processing method. Wherein JAR refers to Java Archive, a software package file format that can be used to develop Java platform applications or libraries.
Preferably, the telemetry data management unit 420 may also support a telemetry frame format and frame code identification information import/export function, and support a JAR packet file import/export function.
In one embodiment, the visual configuration module 400 may further include a satellite information management unit 430, a satellite survey and control system management unit 440, and a calibration mode management unit 450.
The satellite information management unit 430 may be used to implement an add-delete-modify-search function for satellite information. The satellite information may include, but is not limited to, satellite names, satellite codes, satellite identification codes, satellite types, orbit types, circle identifiers, internal numbers, space numbers, and the like.
The satellite measurement and control system management unit 440 may be used to implement the function of adding, deleting and checking the satellite measurement and control system information. The satellite measurement and control system information may include, but is not limited to, communication information, device antenna information, baseband information, communication nodes, monitoring parameters, DATAAGENT settings, etc. The communication information may include, but is not limited to, communication IP (Internet Protocol Address), communication ports, and network transmission protocols. In this embodiment, network transport protocols that may be supported include, but are not limited to TCP, UDP, FTP, PIM-SSM, PIM-ASM. Preferably, the satellite measurement and control system management unit 440 may also support an import/export function of satellite measurement and control system information.
The calibration mode management unit 450 may be used to implement the add-delete-modify-check function for the calibration mode. The calibration information may include, but is not limited to, calibration name, calibration code, calibration source code, calibration level nominal value, coefficient, remark, and the like. The calibration pattern management unit 450 may also support a calibration information import/export function.
The remote measurement data of different types of satellites have a one-to-one correspondence with the analysis dynamic library of the background. In the prior art, when a satellite is newly added, the analysis dynamic library corresponding to the satellite needs to be reprogrammed and developed and deployed, so that the workload of software development can be increased and the difficulty of system maintenance and management can be increased when the satellite is newly added in the prior art.
In the multi-source satellite telemetry data analysis system provided by the application, when a satellite is newly added, telemetry processing information such as multi-satellite information, a frame format, a frame code, telemetry parameters, a processing method, a calibration mode and the like can be bound through a visual page without modifying codes, so that the development workload of software is not increased. The system can dynamically generate the star telemetry analysis JAR package file according to the new star information configured on the page and store the star telemetry analysis JAR package file in the cloud server without programming development, thereby having good expandability and remarkably improving the expandability and the automation level of the system.
The telemetry formats of different types of satellites are different, and the network transmission protocols and the data packet protocols from different ground measurement and control stations to the measurement and control center are also different. However, the network transmission protocol supported by the prior art has few kinds and does not support the custom data packet protocol.
In the multisource satellite telemetry data analysis system provided by the application, a visualized configuration network transmission protocol TCP, UDP, FTP, PIM-SSM, PIM-ASM and telemetry data format PCM framing/CCSDS packetization are supported; the main stream or custom data packet protocol such as PDXP/Cortex is supported to be expanded according to the requirement, the basic information of the satellite, the telemetry processing method, the telemetry parameters and the calibration mode can be expanded according to the requirement, and the processing result of telemetry data can be processed for the second time according to the requirement of a user. All the configuration information is stored in a database, and a telemetry analysis JAR package file is dynamically generated and stored in a cloud server.
In one embodiment, the storage module 500 may include a MariaDB database and an OSS cloud server. The configuration information of the visual configuration module 400 may be transmitted to a MariaDB database for storage, and a JAR package file generated based on the telemetry processing method may be uploaded to an OSS cloud server for storage. The JAR package file is stored in the OSS cloud server without programming development, and has good expandability.
In a preferred embodiment, the storage module 500 may include a MariaDB database, OSS, and ClickHouse. ClickHouse is a powerful columnar database management system. The configuration information of the visual configuration module 400 can be transmitted to a MariaDB database for storage, a JAR packet file generated based on a telemetry processing method can be uploaded to an OSS for storage, and a telemetry original code and an analysis result can be uploaded to ClickHouse for storage. Compared with the OSS object storage service, clickHouse has the advantages of high performance, low delay, high writing speed, large data compression space, high query efficiency and the like, and is suitable for writing, storing and query analysis of mass data.
Fig. 4 is a schematic structural diagram of a data transceiver module according to one embodiment of the present application, where in one embodiment, the data transceiver module 100 may include a first configuration unit 110, a listening unit 120, a data parsing unit 130, a chain monitoring unit 140, and a first message pushing unit 150.
The first configuration unit 110 may be configured to obtain preset communication information and preset packet protocols. Specifically, the first configuration unit 110 may be connected to the storage module 500 to obtain the pre-configured communication information and the packet protocol stored in the storage module 500. In this embodiment, the communication information may include, but is not limited to, a communication protocol, a communication port, and a network transmission protocol, and the packet protocol may include all protocols configured by a packet protocol management page.
The monitoring unit 120 may be configured to monitor satellite telemetry data sent by each satellite measurement and control system according to the communication information. The first configuration unit 110 may transmit the communication information to the listening unit 120 after acquiring the communication information. The monitoring unit 120 may establish communication connection with each satellite measurement and control system according to information such as a preset communication IP, a preset port, a preset network transmission protocol, and the like, so that the monitoring unit 120 may monitor satellite telemetry data sent by each satellite measurement and control system. Satellite telemetry data may be transmitted in the form of data packets over the link.
The data parsing unit 130 may be configured to parse header information of the satellite telemetry data according to a data packet protocol, and extract telemetry codes of the satellite telemetry data. The first configuration unit 110 may transmit the packet protocol to the data parsing unit 130 after acquiring the packet protocol. Listening unit 120 may transmit satellite telemetry data to data resolution unit 130 after receiving the satellite telemetry data. The data parsing unit 130 may match the packet header according to the data packet protocol, unpack and extract the telemetry original code.
The data packet may include a packet header and a data payload, where the packet header includes various control information such as a source address, a destination address, a protocol type, a data length, a transmission sequence, and a checksum. That is, the beginning of the satellite telemetry contains important metadata about the entire data packet, so processing and analyzing the header portion of the satellite telemetry is beneficial for improving the accuracy of the data.
The link monitor unit 140 may be configured to count data transmission quality according to the communication information, and generate PB format link monitor data, where the link monitor unit 140 may send PB format link monitor data to each satellite monitoring and control system. Protocol Buffers is a lightweight data exchange format developed by Google, which is an efficient, language-independent and platform-independent data serialization format, smaller, faster and simpler than data exchange formats such as XML and JSON.
The first message pushing unit 150 may be configured to push a first message to the message middleware 10; the first message may include telemetry original. After the first message is pushed to the message middleware 10, the message middleware 10 may route the first message to a correct queue according to a preset rule, or directly deliver the first message to a designated consumer, so as to ensure that the first message can accurately reach an intended target. In this embodiment, the consumer may be the telemetry pre-processing module 200, and the consumer may be other surface management systems.
In one embodiment, the data transceiver module 100 may further include a data verification unit 160 and a network data quality statistics unit 170.
The data transceiver module 100 may further transmit the telemetry original code to the data verification unit 160 for verification after analyzing the header information of the satellite telemetry data by the data analysis unit 130 and extracting the telemetry original code of the satellite telemetry data, so as to ensure the validity of the data. Specifically, the data verification unit 160 may determine whether the satellite telemetry data is valid data by determining whether the verification information in the data packet protocol matches the verification information in the telemetry original. The verification information may also be preconfigured by the visual configuration module 400, and the first configuration unit 110 obtains the verification information from the storage module 500 and transmits the verification information to the data verification unit 160. The verification information may include, but is not limited to, satellite identification, station identification.
The data verification unit 160 may determine that the data is valid when the verification information in the data packet protocol matches the verification information in the telemetry original, and transmit the telemetry original to the first message pushing unit 150. The data verification unit 160 may determine that the data is invalid when the verification information in the data packet protocol does not match the verification information in the telemetry original code, and discard satellite telemetry data corresponding to the telemetry original code. The network data quality statistics unit 170 may be configured to perform statistics on the quality of the network data received at this time after the data verification unit 160 discards the satellite telemetry data.
In existing data parsing systems, configuration information is typically saved using XML (Extensible Markup Language ) documents. However, XML documents have the disadvantages of requiring third parties to process applications, difficult management, greater risk of tampering with data loss, slower processing speeds, etc. The processing software of the XML document needs to change and process the telemetry data of different satellites by manually modifying the configuration file, and does not have the multi-satellite parallel processing capability.
In this embodiment, the serialized data may be PB format data, that is, the PB format is adopted for data exchange and transmission format within the multi-source satellite telemetry data parsing system. According to the multisource satellite telemetry data analysis system, multisource heterogeneous satellite telemetry data are fused and unified into PB format data, and PB format data are adopted for data exchange and transmission formats in the system, so that the system is smaller, faster and simpler than XML, JSON and other data exchange formats, and the processing speed of the system on the data is higher.
Fig. 5 is a schematic structural diagram of a telemetry preprocessing module according to one embodiment of the present application, in which the telemetry preprocessing module 200 may include a second configuration unit 210, a first message subscription unit 220, a data preprocessing unit 230, and a second message pushing unit 240.
The second configuration unit 210 may be configured to obtain preset telemetry information; telemetry information may include, but is not limited to, telemetry frame format and parameter information. Specifically, the second configuration unit 210 may obtain the preconfigured telemetry information stored in the storage module 500 by connecting the storage module 500. In this embodiment, telemetry information may include, but is not limited to, telemetry frame format and parameter information.
The first message subscription unit 220 may fetch and process the first message from the queue of the message middleware 10 as needed. The first message is typically removed from the queue after it is successfully consumed by the first message subscription unit 220. The first message subscription unit 220 may also subscribe to the message middleware 10 for the first message, and when the message middleware 10 receives the first message, the message middleware 10 may push the first message to the first message subscription unit 220.
The second configuration unit 210 may transmit the telemetry information to the data preprocessing unit 230 after acquiring the telemetry information; the first message subscription unit 220 may also transmit the first message to the data preprocessing unit 230 after receiving the first message. The data preprocessing unit 230 may be configured to perform one or more data processing operations of descrambling, decrypting, deframeing, and splitting channels on the telemetry original according to the telemetry information, generate intermediate results, and compose PB format data according to the intermediate results.
In communication and data transmission, in order to improve the transmission efficiency and security of signals, scrambling, encryption and other processes may be performed on the data. Scrambling may refer to mathematically combining the original satellite telemetry data with a pseudorandom sequence (also referred to as a scrambling code) such that the processed satellite telemetry data appears as random noise during transmission. Encryption may refer to the conversion of originally readable satellite telemetry data by a specific algorithm and key (encryption key) into a form that appears random and unintelligible.
The data preprocessing unit 230 may determine whether the telemetry original is subject to scrambling. When the data preprocessing unit 230 determines that the telemetry original code has undergone scrambling processing, descrambling processing is performed on the telemetry original code. Specifically, descrambling is the inverse of scrambling. The data preprocessing unit 230 may also acquire the same pseudo random sequence and method as when scrambling, including but not limited to a seed or key of the pseudo random sequence, through the second configuration unit 210. The data preprocessing unit 230 may thus reverse-operate on the received scrambled telemetry original to recover the original telemetry original using the same pseudo-random sequence and method as when scrambling.
The data preprocessing unit 230 determines that the telemetry original code has not undergone scrambling processing, and may further perform other processing on the telemetry original code. The data preprocessing unit 230 may also determine whether the telemetry original is subject to encryption processing. When the data preprocessing unit 230 judges that the telemetry original is subjected to encryption processing, decryption processing is performed on the telemetry original. In particular, decryption is the inverse of encryption. The data preprocessing unit 230 may also acquire a decryption key corresponding to the encryption algorithm at the time of encryption (or use a paired private key in asymmetric encryption) through the second configuration unit 210. The data preprocessing unit 230 may also convert the encrypted telemetry original back to the originally readable telemetry original by the same encryption algorithm and corresponding decryption key (or using a paired private key in asymmetric encryption).
The data preprocessing unit 230 may perform a deframed process on the telemetry original to produce an intermediate result. During the transmission of satellite telemetry, the satellite telemetry may be packetized into frames, each of which contains control information such as synchronization information, address information, error checking, etc., in order to ensure data integrity and sequence. The process of de-framing the telemetry original code may include, but is not limited to, identifying a frame boundary, removing a frame header and a frame trailer, checking the integrity of the frame, ensuring that the data is extracted accurately, obtaining a complete intermediate result, and composing the intermediate result into PB format data.
The data preprocessing unit 230 may also perform channel separation processing on the telemetry original when satellite telemetry data is transmitted via optical communication technology. The process of splitting the telemetry original code may be to split the received multi-wavelength beam to separate out optical signals of different wavelengths, with different data signals carried by different wavelength (color) optical carriers.
The second message pushing unit 240 may be configured to push the second message to the message middleware 10; the second message may include PB format data. After the second message is pushed to the message middleware 10, the message middleware 10 may route the second message to a correct queue according to a preset rule, or directly deliver the second message to a designated consumer, so as to ensure that the second message can accurately reach an intended target. In this embodiment, the consumer may be the telemetry resolution module 300, and the consumer may be other surface control systems.
The data exchange and transmission formats in the multisource satellite telemetry data analysis system provided by the application are PB format. The telemetry preprocessing module 200 receives multi-source heterogeneous telemetry data according to a preset network transmission protocol, extracts data frames according to a preset data packet protocol, descrambles, decrypts, breaks frames and divides channels of the telemetry frames according to telemetry processing configuration information, generates intermediate results, and uniformly forms PB format data, so that fusion unification of the multi-source heterogeneous telemetry data is realized, and the efficiency and accuracy of data processing are effectively improved.
In one embodiment, telemetry preprocessing module 200 may also include a data matching unit 250 and a telemetry data quality statistics unit 260.
The telemetry preprocessing module 200 may further transmit the telemetry original code to the data matching unit 250 for verification after acquiring the first message by the first message subscription unit 220 and extracting the telemetry original code in the first message, so as to ensure the validity of the data. Specifically, the data matching unit 250 may determine whether the telemetry original is valid data by judging whether the telemetry frame format in the telemetry information matches the telemetry frame format in the telemetry original. The telemetry frame format may also be preconfigured by the data matching unit 250.
The data matching unit 250 may determine that the data is valid when the telemetry frame format in the telemetry information matches the telemetry frame format in the telemetry original, and transmit the telemetry original to the data preprocessing unit 230. The data matching unit 250 may determine that the data is invalid and discard the telemetry original when the telemetry frame format in the telemetry information does not match the telemetry frame format in the telemetry original. The telemetry data quality statistics unit 260 may be configured to count the quality of telemetry data received this time after the data matching unit 250 discards the telemetry original.
Fig. 6 is a schematic structural diagram of a telemetry resolution module according to one embodiment of the present application, in which the telemetry resolution module 300 may include a second message subscription unit 310, a third configuration unit 320, a data loading unit 330, a data processing unit 340, and a third message pushing unit 350.
The second message subscription unit 310 may fetch and process the second message from the queue of the message middleware 10 as needed. The second message is typically removed from the queue after it is successfully consumed by the second message subscription unit 310. The second message subscription unit 310 may also subscribe to the message middleware 10 for the second message, and when the message middleware 10 receives the second message, the message middleware 10 may push the second message to the second message subscription unit 310. The second message may include PB formatted data pre-processed by telemetry pre-processing module 200.
The third configuration unit 320 may be configured to obtain preset telemetry configuration information. Specifically, the third configuration unit 320 may be configured to obtain the pre-configured telemetry processing configuration information stored in the storage module 500 by connecting the storage module 500.
The second message subscription unit 310 may also transmit the second message to the data loading unit 330 after receiving the second message; the third configuration unit 320 may transmit the telemetry configuration information to the data loading unit 330 after acquiring the telemetry configuration information. The data loading unit 330 may be configured to obtain telemetry information corresponding to the serialized data according to the telemetry configuration information. In particular. The data loading unit 330 downloads the corresponding JAR packet file from the OSS cloud server into the cache according to the preset telemetry processing method information.
The second message subscription unit 310 may also transmit the PB format data to the data processing unit 340 after receiving the PB format data, where the data processing unit 340 may be configured to perform a resolving process on the serialized data according to the telemetry processing information, to obtain a telemetry processing result. The data processing unit 340 calls the corresponding JAR packet file according to the received PB format data, and the data processing unit 340 may calculate the engineering variable and the state quantity in real time based on the JAR packet file, and perform secondary processing on the state quantity. After the data processing unit 340 parses the result, telemetry results may be obtained.
In this embodiment, the Spark computing engine may be utilized to implement the parallel computing function to be implemented by the data processing unit 340. Spark is a quick and general calculation engine specially designed for large-scale data processing, and compared with a traditional disk calculation model, the application utilizes Spark to process a large-scale data set, can remarkably accelerate the data processing speed of a system and improves the processing efficiency of the system. The Spark computing engine supports real-time computing, has the advantages of high computing speed, low operation resource cost, high execution efficiency and the like, and can solve the problem of parallel processing of multi-star telemetry data. After the system receives the multi-source telemetry data, the Spark calculation engine can perform rule matching, statistics, frame disassembly, descrambling and resolving on the data according to the pre-bound telemetry processing information. In the resolving process, the Spark cluster can uniformly calculate engineering variables and state quantities in real time according to telemetry data and corresponding processing methods, and all telemetry words are calculated and converted into numerical values of the represented physical parameters.
The multi-source satellite telemetry data analysis system provided by the application realizes the parallel and efficient processing of multi-satellite telemetry data by utilizing the message middleware 10 and the big data calculation engine, and each satellite parameter processing thread is mutually independent and does not affect each other. The message middleware 10 is responsible for collecting multi-source telemetry data, and the big data computing cluster is responsible for calculating engineering variables and state quantities such as analog, digital and the like.
The third message pushing unit 350 may be configured to send a third message to the message middleware 10; the third message includes telemetry processing results. After the third message is pushed to the message middleware 10, the message middleware 10 may route the third message to a correct queue according to a preset rule, or directly deliver the third message to a designated consumer, so as to ensure that the third message can accurately reach an intended target. In this embodiment, the consumer may be a surface control system.
Fig. 7 is a schematic diagram of a data processing unit according to one embodiment of the present application, where in one embodiment, the data processing unit 340 may include a first processing unit 341 and a second processing unit 343.
The first processing unit 341 may be configured to count the number information of telemetry parameters corresponding to the serialized data, and determine the task amount of the calculation task according to the number information. Preferably, the functions of the first processing unit 341 are implemented by a CPU (Central Processing Unit ). CPUs are typically designed to perform a wide range of computational tasks, suitable for processing complex decision-making, logic control, and sequence computation. Specifically, the CPU may count the number of all telemetry parameters to obtain a resolved task amount, and copy PB format data, configuration information, JAR packet files, and the resolved task amount to the memory.
The second processing unit 343 may comprise at least one processing thread, preferably with a GPU (Graphics Processing Unit, graphics processor) to implement the functionality of the second processing unit 343. The GPU has a large number of cores, has strong parallel processing capability and is suitable for processing a large amount of parallel data. The large number of cores of a GPU may implement multiple parallel processing threads.
The first processing unit 341 may be further configured to allocate a resolving task to a processing line of the second processing unit 343 according to the task amount and the number of threads of the processing threads in the second processing unit 343. Specifically, the CPU may allocate the resolved task bar to each thread of the GPU for processing according to the number of threads processed by the GPU.
The processing thread of the second processing unit 343 may be configured to invoke telemetry processing information corresponding to the identifier according to the identifier in the serialized data, calculate an engineering variable and a state quantity according to the telemetry processing information, and perform secondary processing on the state quantity. The second processing unit 343 may be further configured to aggregate the solutions of the processing threads to form telemetry processing results. Specifically, each processing thread in the GPU may call, according to the identifier in the PB format data, the JAR packet file corresponding to the identifier. Each processing thread in the GPU can calculate engineering variables and state quantities in real time in parallel according to the called JAR packet file, and perform secondary processing on the state quantities. The GPU may copy the summary of the solution results in each processing thread to memory. The CPU transmits the telemetry processing result to the message middleware 10 using the third message pushing unit 350.
In the prior art, parallel computation based on a CPU computing mode is generally adopted for processing real-time telemetry data, however, the parallel computation of the CPU computing mode needs to run a plurality of sets of analysis software processes, and the problem of overlarge resource consumption exists. Meanwhile, when facing to a large-scale parallel computing task, the CPU computing mode is limited in performance and low in execution efficiency.
After the multi-satellite telemetry data analysis system receives multi-satellite telemetry data, the CPU can automatically match and call corresponding configuration information and telemetry analysis JAR package from the database and the cloud server according to the data identification, subscribe telemetry original codes after PB format conversion treatment, count the number of all telemetry parameters, obtain resolved task quantity, and copy the telemetry original codes, the configuration information, the JAR package and the resolved task quantity to a display memory. The CPU distributes the resolving task to each thread of the GPU for processing according to the number of the threads of the GPU, the GPU gathers the resolving result, copies the resolving result to the memory, and analyzes the telemetry parameter value in real time, thereby realizing the effect of multiplexing one set of telemetry data analysis system by multiple satellites.
In this embodiment, cluster cpu+gpu resource scheduling is used in Spark job to accelerate Spark data processing task. The CPU and the GPU can distribute proper tasks to the most proper processors for processing through heterogeneous computing technology. The CPU and the GPU are used for cooperative work to improve the calculation efficiency, so that better energy efficiency can be achieved, and the real-time processing rate of telemetry analysis is accelerated.
In the prior art, the state quantity analysis of the telemetry parameters is usually an integer of 0, 1,2 and the like, and information cannot be intuitively displayed, so that a user cannot intuitively know the parameter condition when monitoring the parameter state.
In one embodiment, the secondary processing of the state quantity may include, but is not limited to, direct reading, list, curve, formula, expression, and the like.
In this embodiment, the secondary processing may be performed on the processing result of the telemetry data according to the user display requirement. Specifically, the user creates a custom language through the page provided by the visual configuration module 400, dynamically compiles the custom language into a JAR package file by adopting Antlr4, and analyzes Chinese corresponding to the state quantity. Meanwhile, the system can also correlate engineering variables of a plurality of telemetry parameters, judge whether parameter values are out of limit by combining the variables, distinguish warning levels by font colors and display the warning levels on a parameter monitoring page provided by the visual configuration module 400. The user can quickly and intuitively know the parameter state based on the information of the parameter monitoring page, and the user experience is improved.
The traditional space survey operation control software is mostly a pile of various independent systems, and the independent systems have the problems of poor expansibility, low reliability, high maintenance cost and the like.
In one embodiment, the multi-source satellite telemetry data resolution system may construct the data transceiver module 100, telemetry pre-processing module 200, telemetry resolution module 300, visualization configuration module 400, and constituent elements thereof based on the architectural design of the microservice.
The multisource satellite telemetry data analysis system provided by the application constructs each functional module and the constituent units thereof based on the architecture design of the micro service cloud application, and any micro service unit can be accessed anytime and anywhere through the Internet, so that the multisource satellite telemetry data analysis system can be rapidly expanded and upgraded according to the requirements of users, provides high-reliability and high-stability software services, and improves the flexibility and the scalability of the whole system.
Preferably, the multi-source satellite telemetry data resolution system may include 1 front end and a plurality of micro-service units, each deployed in a different Docker (an open source application container engine) container. The front end may be the visual configuration module 400, and the other functional modules and their constituent units may be independent micro service units. Each Docker container may package one or more micro-services into an independent operating environment, which may be quickly deployed on various types of operating systems or cloud platforms. Meanwhile, the change of individual services in the deployment process does not affect other parts of the system, the expansion of the system functions can be realized only by scaling components or functions which need additional performance, and meanwhile, each service is isolated, so that the whole system breakdown caused by cascade failure can be prevented.
The micro-service units may include, but are not limited to, a data transceiver micro-service unit, a telemetry preprocessing micro-service unit, a telemetry parsing micro-service unit, a data packet protocol management micro-service unit, a telemetry processing method management micro-service unit, a file uploading micro-service unit, a satellite information management micro-service unit, a measurement and control device management micro-service unit, a user management micro-service unit, a software state management micro-service unit, and the like. Communication between the individual micro-service units may be via message middleware 10. When the visualized configuration module 400 is used for adding a satellite or expanding a telemetry processing method and telemetry parameters in the multisource satellite telemetry data analysis system, the visualized configuration module 400 does not influence other micro-service units, the existing micro-service units can be not updated and modified, and the existing telemetry processing process is not influenced.
In this specification, each embodiment is described in a progressive manner, and identical and similar parts of each embodiment are all referred to each other, and each embodiment mainly describes differences from other embodiments. In particular, for a hardware+program class embodiment, since it is substantially similar to a method embodiment, the description is relatively simple, and reference is made to the description of a method embodiment for relevant points.
In the description of the present specification, reference to the terms "some embodiments," "other embodiments," "desired embodiments," and the like, means that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the invention. In this specification, schematic descriptions of the above terms do not necessarily refer to the same embodiment or example.
The technical features of the above-described embodiments may be arbitrarily combined, and all possible combinations of the technical features in the above-described embodiments are not described for brevity of description, however, as long as there is no contradiction between the combinations of the technical features, they should be considered as the scope of the description.
The above examples illustrate only a few embodiments of the invention, which are described in detail and are not to be construed as limiting the scope of the invention. It will be apparent to those skilled in the art that various modifications and improvements can be made without departing from the spirit of the invention. Accordingly, the scope of protection of the present invention is to be determined by the appended claims.
Claims (10)
1. A multi-source satellite telemetry data resolution system, comprising:
The data transceiver module is used for monitoring satellite telemetry data sent by each satellite measurement and control system according to preset communication information, analyzing the satellite telemetry data according to a preset data packet protocol, obtaining telemetry codes, sending chain monitoring data to each satellite measurement and control system, and pushing a first message to the message middleware; the first message includes the telemetry original code;
The telemetry preprocessing module is used for subscribing the first message to the message middleware, preprocessing the telemetry original code according to preset telemetry information to form serialized data, and pushing the second message to the message middleware; the second message includes the serialized data;
The telemetry analysis module is used for subscribing the second message to the message middleware and acquiring telemetry information corresponding to the serialized data according to preset telemetry configuration information; processing the serialized data according to the telemetry processing information, obtaining telemetry processing results, and sending a third message to the message middleware; the third message includes the telemetry processing result.
2. The multi-source satellite telemetry data resolution system of claim 1, further comprising:
The visual configuration module is used for managing configuration information, wherein the configuration information comprises communication information, the data packet protocol, telemetry information, telemetry processing configuration information and telemetry processing information;
and the storage module is used for storing the configuration information.
3. The multi-source satellite telemetry data resolution system of claim 1 or 2 wherein the data transceiver module comprises:
the first configuration unit is used for acquiring the preset communication information and a preset data packet protocol; the communication information includes, but is not limited to, communication protocols, communication ports, network transmission protocols;
the monitoring unit is used for monitoring satellite telemetry data sent by each satellite measurement and control system according to the communication information;
The data analysis unit is used for analyzing the packet header information of the satellite telemetry data according to the data packet protocol and extracting telemetry original codes of the satellite telemetry data;
the chain monitoring unit is used for generating PB-format chain monitoring data according to the communication information and sending the PB-format chain monitoring data to each satellite measurement and operation control system;
a first message pushing unit, configured to push a first message to the message middleware; the first message includes the telemetry original code.
4. The multi-source satellite telemetry data resolution system of claim 3, wherein the data transceiver module further comprises:
The data verification unit is used for judging whether the verification information in the data packet protocol is matched with the verification information in the telemetry original code after analyzing the packet header information of the satellite telemetry data, transmitting the telemetry original code to the first message pushing unit according to the verification result of the matching of the verification information in the data packet protocol and the verification information in the telemetry original code, and discarding the satellite telemetry data according to the verification result of the unmatched verification information in the data packet protocol and the verification information in the telemetry original code;
And the network data quality statistics unit is used for counting the quality of the network data received at this time after the data verification unit discards the satellite telemetry data.
5. The multi-source satellite telemetry data resolution system of claim 1 wherein the serialized data is PB format data, the telemetry preprocessing module comprising:
The second configuration unit is used for acquiring the preset telemetry information; the telemetry information includes, but is not limited to, telemetry frame format and parameter information;
a first message subscription unit, configured to subscribe the first message to the message middleware;
The data preprocessing unit is used for performing one or more data processing operations of descrambling, decryption, frame splitting and wave dividing channels on the telemetry original code according to the telemetry information, generating an intermediate result, and forming PB format data according to the intermediate result;
A second message pushing unit, configured to push a second message to the message middleware; the second message includes the PB format data.
6. The multi-source satellite telemetry data resolution system of claim 5, wherein the telemetry preprocessing module further comprises:
the data matching unit is used for judging whether the telemetry frame format in the telemetry information is matched with the telemetry frame format in the telemetry original code after the first message is acquired, transmitting the telemetry original code to the data preprocessing unit in response to a verification result that the telemetry frame format in the telemetry information is matched with the telemetry frame format in the telemetry original code, and discarding the telemetry original code in response to a verification result that the telemetry frame format in the telemetry information is not matched with the telemetry frame format in the telemetry original code;
and the telemetry data quality statistics unit is used for counting the quality of the telemetry data received at this time after the data matching unit discards the telemetry original codes.
7. The multi-source satellite telemetry data resolution system of claim 1, wherein the telemetry resolution module comprises:
a second message subscription unit, configured to subscribe the second message to the message middleware;
A third configuration unit, configured to obtain preset telemetry configuration information;
The data loading unit is used for acquiring telemetry information corresponding to the serialized data according to the telemetry configuration information;
The data processing unit is used for carrying out resolving processing on the serialized data according to the telemetry processing information to obtain telemetry processing results;
a third message pushing unit, configured to send a third message to the message middleware; the third message includes the telemetry processing result.
8. The multi-source satellite telemetry data resolution system of claim 7 wherein said data processing unit comprises:
the first processing unit is used for counting the quantity information of telemetry parameters corresponding to the serialized data and determining the task quantity of a calculation task according to the quantity information;
The second processing unit comprises at least one processing thread, and the first processing unit is further used for distributing the resolving task to the processing thread of the second processing unit according to the task quantity and the thread number of the processing thread in the second processing unit;
The processing thread is used for calling the telemetry processing information corresponding to the identification according to the identification in the serialized data, calculating engineering variables and state quantities according to the telemetry processing information, and carrying out secondary processing on the state quantities;
And the second processing unit is also used for summarizing the resolving results of the processing threads to form telemetry processing results.
9. The multi-source satellite telemetry data resolution system of claim 2, wherein the visualization configuration module comprises:
The data packet protocol management unit is used for realizing the functions of adding, deleting and modifying the data packet protocol;
and the telemetry data management unit is used for realizing the functions of adding, deleting and checking the telemetry information, the telemetry configuration information and the telemetry information.
10. The multi-source satellite telemetry data resolution system of claim 9, wherein the visualization configuration module further comprises:
the satellite information management unit is used for realizing the functions of adding, deleting and modifying the satellite information;
the satellite measurement and operation control system management unit is used for realizing the functions of adding, deleting and checking the satellite measurement and operation control system information;
and the calibration mode management unit is used for realizing the functions of adding, deleting and modifying the calibration mode.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202410941250.9A CN118488103B (en) | 2024-07-15 | 2024-07-15 | Multisource satellite telemetry data analysis system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202410941250.9A CN118488103B (en) | 2024-07-15 | 2024-07-15 | Multisource satellite telemetry data analysis system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN118488103A true CN118488103A (en) | 2024-08-13 |
| CN118488103B CN118488103B (en) | 2024-10-08 |
Family
ID=92198347
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202410941250.9A Active CN118488103B (en) | 2024-07-15 | 2024-07-15 | Multisource satellite telemetry data analysis system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN118488103B (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20050157856A1 (en) * | 2004-01-16 | 2005-07-21 | Humphries Laymon S. | Method and apparatus for providing an externalized interface to mobile telemetry devices |
| US20080043716A1 (en) * | 2006-08-16 | 2008-02-21 | Sun Microsystems, Inc. | Telemetry stream performance analysis and optimization |
| CN107332604A (en) * | 2017-05-16 | 2017-11-07 | 上海卫星工程研究所 | The processing method and processing system of satellite complete period multi-source telemetry |
| CN108763377A (en) * | 2018-05-18 | 2018-11-06 | 郑州轻工业学院 | Multi-source telemetering big data feature extraction preprocess method is diagnosed based on satellite failure |
| CN111355524A (en) * | 2020-03-10 | 2020-06-30 | 中国西安卫星测控中心 | Multi-source heterogeneous telemetry data comprehensive processing method for Beidou third satellite |
-
2024
- 2024-07-15 CN CN202410941250.9A patent/CN118488103B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20050157856A1 (en) * | 2004-01-16 | 2005-07-21 | Humphries Laymon S. | Method and apparatus for providing an externalized interface to mobile telemetry devices |
| US20080043716A1 (en) * | 2006-08-16 | 2008-02-21 | Sun Microsystems, Inc. | Telemetry stream performance analysis and optimization |
| CN107332604A (en) * | 2017-05-16 | 2017-11-07 | 上海卫星工程研究所 | The processing method and processing system of satellite complete period multi-source telemetry |
| CN108763377A (en) * | 2018-05-18 | 2018-11-06 | 郑州轻工业学院 | Multi-source telemetering big data feature extraction preprocess method is diagnosed based on satellite failure |
| CN111355524A (en) * | 2020-03-10 | 2020-06-30 | 中国西安卫星测控中心 | Multi-source heterogeneous telemetry data comprehensive processing method for Beidou third satellite |
Also Published As
| Publication number | Publication date |
|---|---|
| CN118488103B (en) | 2024-10-08 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US7523198B2 (en) | Integrated testing approach for publish/subscribe network systems | |
| WO2023216424A1 (en) | Data link service processing system and method for networked encrypted transmission | |
| CN111241038B (en) | Satellite data processing method and system | |
| US11271842B2 (en) | Enhancing transmission control protocol (TCP) performance and scalability on multicore processor architectures | |
| Liu et al. | NetAlytics: Cloud-scale application performance monitoring with SDN and NFV | |
| CN115297098A (en) | Edge service acquisition method and device, edge computing system, medium and equipment | |
| CN110049020A (en) | A kind of CCSDS AOS protocol data real-time processing method and system | |
| CN116800647A (en) | Link tracking method and device, electronic equipment and media | |
| CN118488103B (en) | Multisource satellite telemetry data analysis system | |
| CN116132550A (en) | Data transmission method and device, electronic equipment and storage medium | |
| CN106648722A (en) | Flume receiving side data processing method and device based on big data | |
| CN111711675B (en) | Solution for concurrent message transmission in local area network | |
| US10812355B2 (en) | Record compression for a message system | |
| CN115048353B (en) | Data processing method, device, electronic device, storage medium and program product | |
| CN109697132A (en) | A kind of instantaneous communication system and method for terminal device | |
| CN116155362A (en) | Multi-source data processing system and method | |
| CN120675917A (en) | A data interaction method for large-scale distributed systems | |
| CN115514670B (en) | Data capturing method, device, electronic equipment and storage medium | |
| CN120281806B (en) | Financial information reporting method, device, computer equipment and readable storage medium | |
| CN119449924B (en) | Method, system, equipment and medium for externally analyzing private security protocol | |
| US11874847B2 (en) | Method for generating process protocols in a distributed IT infrastructure | |
| CN118193377A (en) | Civil aviation freight rate search function test method, device and system | |
| WO2025081621A1 (en) | Message transmission method and apparatus, and electronic device | |
| CN110704027B (en) | Satellite-borne software load software and hardware decoupling method | |
| CN120658593A (en) | Network data intelligent tool system and method based on model context protocol MCP |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |