CN117456635A - Data acquisition and uploading system and method thereof - Google Patents
Data acquisition and uploading system and method thereof Download PDFInfo
- Publication number
- CN117456635A CN117456635A CN202311403623.9A CN202311403623A CN117456635A CN 117456635 A CN117456635 A CN 117456635A CN 202311403623 A CN202311403623 A CN 202311403623A CN 117456635 A CN117456635 A CN 117456635A
- Authority
- CN
- China
- Prior art keywords
- data
- event
- uploading
- module
- trigger information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 20
- 238000012544 monitoring process Methods 0.000 claims abstract description 27
- 238000012545 processing Methods 0.000 claims abstract description 18
- 238000012216 screening Methods 0.000 claims abstract description 11
- 238000004806 packaging method and process Methods 0.000 claims abstract description 9
- 238000004590 computer program Methods 0.000 claims description 10
- 230000003139 buffering effect Effects 0.000 claims description 4
- 238000007906 compression Methods 0.000 claims description 3
- 230000006835 compression Effects 0.000 claims description 3
- 238000001914 filtration Methods 0.000 claims description 3
- 238000012858 packaging process Methods 0.000 claims 1
- 238000013480 data collection Methods 0.000 description 5
- 238000011161 development Methods 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 3
- 238000010586 diagram Methods 0.000 description 2
- 230000007613 environmental effect Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012856 packing Methods 0.000 description 2
- 230000001960 triggered effect Effects 0.000 description 2
- 230000007488 abnormal function Effects 0.000 description 1
- 230000001133 acceleration Effects 0.000 description 1
- 238000013459 approach Methods 0.000 description 1
- 238000013475 authorization Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 230000005059 dormancy Effects 0.000 description 1
- 230000007257 malfunction Effects 0.000 description 1
- 230000007958 sleep Effects 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
- 239000002699 waste material Substances 0.000 description 1
Classifications
-
- G—PHYSICS
- G07—CHECKING-DEVICES
- G07C—TIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE
- G07C5/00—Registering or indicating the working of vehicles
- G07C5/08—Registering or indicating performance data other than driving, working, idle, or waiting time, with or without registering driving, working, idle or waiting time
- G07C5/0808—Diagnosing performance data
-
- G—PHYSICS
- G07—CHECKING-DEVICES
- G07C—TIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE
- G07C5/00—Registering or indicating the working of vehicles
- G07C5/08—Registering or indicating performance data other than driving, working, idle, or waiting time, with or without registering driving, working, idle or waiting time
- G07C5/0841—Registering performance data
- G07C5/085—Registering performance data using electronic data carriers
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Traffic Control Systems (AREA)
Abstract
The invention relates to a data acquisition uploading system, a data acquisition uploading method, corresponding computer equipment, a computer readable storage medium and a vehicle. The data acquisition uploading system comprises an event monitoring unit, a data control unit and a data uploading unit. The event monitoring unit is used for acquiring a vehicle operation signal in real time, and generating event trigger information corresponding to an event and sending the event trigger information to the data control unit when the vehicle operation signal meets the condition defined by the event. The data control unit is used for acquiring vehicle sensing real-time data and receiving the event trigger information, screening out a data stream related to the event trigger information from the vehicle sensing real-time data according to the event trigger information, and sending the data stream to the data uploading unit. The data uploading unit is used for carrying out packaging processing on the data stream and uploading the data stream.
Description
Technical Field
The invention relates to the field of data acquisition, in particular to a data acquisition uploading system and a method thereof.
Background
Data is a key resource for intelligent driving algorithm development and iteration. The automotive field host factories or suppliers need to collect a large amount of data on vehicle state, environmental awareness, algorithm operation, etc. to support intelligent driving function development. The most common data acquisition mode at present is to plug in data acquisition equipment on an engineering vehicle to acquire required data. However, the method can be only implemented on a small number of engineering development vehicles, and the obtained data is mainly concentrated in a test environment, so that the scene and the limitation thereof are not beneficial to the deep development of the intelligent driving function. Moreover, this approach cannot be used with already sold vehicles, and often fails to obtain enough valid data to locate the problem when a malfunction or the like occurs in the product.
For various limitations of the plug-in data collection device, many intelligent driving related enterprises or institutions attempt to integrate data collection functions on in-vehicle embedded systems so that data can be uploaded in real time whether engineering vehicles or after-market vehicles. However, many such systems periodically upload the vehicle-side data to the background server, and then analyze and mine the scene of interest such as abnormal functions, etc., so that the data has low value density and generates great waste in terms of vehicle-side communication flow, background storage, computing resources, etc. Some of these systems can only upload data when a specific event occurs, but only support the monitoring of a small number of simple events (e.g., emergency braking), and cannot remotely update the event set and the type of uploaded data.
Disclosure of Invention
In view of the above problems, the following technical solutions are provided.
According to a first aspect of the present invention, there is provided a data acquisition and uploading system, including an event monitoring unit, a data control unit and a data uploading unit; the event monitoring unit is used for acquiring a vehicle running signal in real time, generating event triggering information corresponding to an event and sending the event triggering information to the data control unit when the vehicle running signal meets the condition defined by the event; the data control unit is used for acquiring vehicle sensing real-time data and receiving the event trigger information, screening out a data stream related to the event trigger information from the vehicle sensing real-time data according to the event trigger information, and sending the data stream to the data uploading unit; the data uploading unit is used for carrying out packaging processing on the data stream and uploading the data stream.
According to the data acquisition uploading system, the event monitoring unit comprises an event triggering judging module, and the event triggering judging module judges whether the vehicle running signal meets one or more event defined conditions according to a preset judging rule and generates corresponding one or more event triggering information.
According to the data acquisition uploading system of the embodiment of the invention, the event monitoring unit further comprises an event priority judging module, and in the case that the event monitoring unit generates a plurality of event trigger information, the event priority judging module ranks the priority orders of the event trigger information based on a predefined rule and sends the event trigger information to the data control unit according to the priority orders.
According to the data acquisition uploading system, the event monitoring unit further comprises an event definition updating module, and the event definition updating module is used for receiving an instruction for updating the event definition.
According to an embodiment of the present invention, the data acquisition and uploading system, the data control unit includes: the data buffer module is used for arranging and buffering the vehicle sensing real-time data according to a time sequence, and the data filter module is used for filtering data streams of types and/or duration corresponding to the event trigger information from the data buffer module based on a preset rule according to the received event trigger information.
According to the data acquisition uploading system, the data control unit further comprises a remote configuration module, wherein the remote configuration module is used for receiving a requirement for remote configuration data acquisition uploading, controlling the type of the data stream received by the data caching module and controlling whether the data screening module allows the data acquisition uploading system to upload data according to the requirement.
According to the data acquisition uploading system of the embodiment of the invention, the data uploading unit comprises a data processing module and a data temporary storage module, the packaging processing of the data stream by the data processing module comprises compression, packaging and naming, the data processing module uploads the packaged data stream in real time, and the data temporary storage module is used for temporarily storing the packaged data stream and uploading the data stream after the vehicle is flameout.
According to a second aspect of the present invention, there is provided a data acquisition uploading method comprising the steps of: an event monitoring step of acquiring a vehicle running signal in real time, and generating event triggering information corresponding to an event when the vehicle running signal meets the condition defined by the event; a data control step of acquiring vehicle sensing real-time data, receiving the event trigger information, and screening out a data stream related to the event trigger information from the vehicle sensing real-time data according to the event trigger information; and a data uploading step, wherein the data stream is packaged and uploaded.
According to a third aspect of the present invention, there is provided a computer readable storage medium having stored thereon a computer program which, when executed by a processor, implements a data acquisition uploading method according to the second aspect of the present invention.
According to a fourth aspect of the present invention, there is provided a computer device comprising a storage module, a processor and a computer program stored on the storage module and executable on the processor, the processor implementing the data acquisition uploading method according to the second aspect of the present invention when executing the computer program.
According to a fifth aspect of the present invention there is provided a vehicle comprising a data acquisition upload system according to the first aspect of the present invention.
As described above, according to the data acquisition uploading system and method thereof of the present invention, flexible and efficient data acquisition can be achieved by acquiring and uploading time series data triggered based on event monitoring and selectively uploading specific time series data for different events.
Drawings
The foregoing and/or other aspects and advantages of the present invention will become more apparent and more readily appreciated from the following description of the various aspects taken in conjunction with the accompanying drawings in which like or similar elements are designated with the same reference numerals. In the drawings:
FIG. 1 shows a schematic block diagram of a data acquisition upload system 100 in accordance with an embodiment of the present invention; and
fig. 2 shows a schematic flow chart of a data acquisition uploading method according to an embodiment of the invention.
Detailed Description
The following description of the specific embodiments is merely exemplary in nature and is in no way intended to limit the disclosed technology or the application and uses of the disclosed technology. Furthermore, there is no intention to be bound by any expressed or implied theory presented in the preceding technical field, background, or the following detailed description.
In the following detailed description of embodiments, numerous specific details are set forth in order to provide a more thorough understanding of the disclosed technology. It will be apparent, however, to one skilled in the art that the disclosed techniques may be practiced without these specific details. In other instances, well-known features have not been described in detail so as not to unnecessarily complicate the description.
Terms such as "comprising" and "including" mean that in addition to having elements and steps that are directly and explicitly recited in the description, the inventive aspects also do not exclude the presence of other elements and steps not directly or explicitly recited.
Hereinafter, various exemplary embodiments according to the present invention will be described in detail with reference to the accompanying drawings.
Referring now to fig. 1, fig. 1 is a schematic block diagram of a data acquisition upload system 100 in accordance with an embodiment of the present invention.
As shown in fig. 1, the data acquisition uploading system 100 includes an event monitoring unit 110, a data control unit 120, and a data uploading unit 130. The event monitoring unit 110 is configured to acquire a vehicle operation signal in real time, and generate event trigger information corresponding to an event and send the event trigger information to the data control unit 120 when the vehicle operation signal meets a condition defined by the event; the data control unit 120 is configured to obtain vehicle sensing real-time data and receive event trigger information, screen a data stream related to the event trigger information from the vehicle sensing real-time data according to the event trigger information, and send the data stream to the data uploading unit 130; the data uploading unit 130 is configured to perform a packetizing process on the data stream and upload the data stream.
Optionally, the event monitoring unit 110 includes an event trigger judging module, which judges whether the vehicle running signal acquired by the event monitoring unit 110 in real time meets one or more event-defined conditions according to a preset judging rule.
In the present embodiment, the vehicle operation signal obtained in real time by the event monitoring unit 110 is not particularly limited, and the vehicle operation signal may include one or more of the following: vehicle state (such as acceleration, braking, steering wheel torque, heading angle, etc.), environmental conditions (such as lane lines, speed limits, surrounding vehicle pedestrians, etc.), algorithmic model parameters (such as awareness, decision, control, etc.), functional diagnostic information, etc. When the vehicle running signal acquired in real time meets the condition defined by one or more events, namely, event triggering is monitored, and then the event triggering judging module generates corresponding one or more event triggering information.
Alternatively, the event monitoring unit 110 includes an event priority determination module that ranks the priority order of the plurality of event trigger information based on a predefined rule and transmits the event trigger information to the data control unit 120 in the priority order in the case where the event monitoring unit 110 generates the plurality of event trigger information.
Specifically, when a plurality of events are triggered in a short time, the event priority judging module ranks the priority order of the event trigger information according to a predefined rule, wherein the event trigger information with high priority is sent preferentially, the event trigger information with low priority is temporarily stored, and the event trigger information with low priority is sent after the event trigger information with high priority is sent. If the temporary storage space is insufficient to store the event trigger information with low priority, only the basic information (such as event identification code, trigger time and the like) of the event trigger information with low priority is sent; if the temporary storage space is insufficient to store the basic information, the event priority judging module discards the event trigger information with the lowest priority.
Optionally, the event monitoring unit 110 further comprises an event definition update module for receiving instructions to update the event definition. Specifically, when the event definition update module receives an instruction to update the event definition from a cloud back-end server (not shown) external to the data acquisition and uploading system 100, it first checks (such as integrity check, format correctness check, etc.), and after the check is passed, the event definition update module parses the instruction and refreshes the condition of the event definition in the event trigger determination module when the vehicle state is allowed (such as meeting user authorization, parking, battery normal, etc.), thereby implementing update of the event definition.
Optionally, the data control unit 120 includes a data caching module for timing and caching vehicle sensing real-time data (such as sensor data, sensing algorithm module data, regulation algorithm module data, diagnostic module data, etc.). Specifically, the data caching module caches the vehicle sensing real-time data in the special storage space respectively, and controls the vehicle sensing real-time data to be arranged in time sequence and aligned with a unified time axis. The buffered vehicle sensing real-time data is updated in a queue, and the earliest vehicle sensing real-time data exceeding the time range is discarded to ensure that new vehicle sensing real-time data enters in real-time.
Optionally, the data control unit 120 includes a data filtering module, which filters, according to the received event trigger information, the data stream of the type and/or duration corresponding to the event trigger information from the data buffering module based on a preset rule, which effectively reduces the uploading of redundant data. Specifically, the data screening module ensures that the time stamps of the screened and intercepted data streams are aligned in the process, and allows different events to have different screening and intercepting requirements.
Optionally, the data control unit 120 further includes a remote configuration module, where the remote configuration module is configured to receive a requirement for remote configuration data collection and upload, and control, according to the requirement, the type of the data stream received by the data cache module and whether the data screening module allows the data collection and upload system 100 to upload data to the cloud back-end server, so as to flexibly determine an object of data collection.
Optionally, the data uploading unit 130 includes a data processing module and a data buffering module.
The data processing module performs packing processing (including compression, packing and naming) on the data stream, and uploads the packed data stream in real time. Specifically, the data processing module receives the data stream processed by the data control unit 120, compresses and packages the data stream according to a predetermined rule, and names the file name of the data packet (which is in the clear and can provide the basic information of the data packet) according to the predetermined rule, which helps the cloud back office server to quickly file the original data. Optionally, the data stream after the packaging processing is uploaded to the data temporary storage module or the cloud back-end server in real time.
Specifically, for a module with sufficient computing power resources, the function operation and the simultaneous uploading of data do not affect the normal work of the module, so that the data processing module directly uploads the packed data stream to the cloud back-end server; for the module with tense computing power resources, the normal work of the module can be influenced by the function operation and the simultaneous uploading of data, so that the data processing module firstly uploads the data stream after the packaging processing to the data temporary storage module, the data temporary storage module temporarily stores the data stream and uploads the data stream to the cloud back-end server after the vehicle is flameout, and the whole vehicle network is stopped to wake up in time after the uploading is finished so as to ensure that the vehicle can sleep normally. Optionally, the data temporary storage module can have a calibrated protection time, and if the data stream temporarily stored in the data temporary storage module exceeding the protection time is not uploaded, the whole vehicle network is stopped to be awakened forcefully, so that the storage battery is prevented from being damaged due to long-time non-dormancy of the vehicle.
Referring now to fig. 2, fig. 2 is a schematic flow chart of a data acquisition upload method according to an embodiment of the present invention.
As shown in fig. 2, the data acquisition uploading method according to the embodiment of the invention comprises the following steps:
event monitoring step S100: acquiring a vehicle running signal in real time, and generating event triggering information corresponding to an event when the vehicle running signal meets the condition defined by the event;
data control step S200: acquiring vehicle sensing real-time data, receiving the event triggering information, and screening out a data stream related to the event triggering information from the vehicle sensing real-time data according to the event triggering information; and
data uploading step S300: and packaging the data stream and uploading the data stream.
The present invention also provides a computer readable storage medium having stored thereon a computer program which when executed by a processor implements the data acquisition uploading method of the present invention described above.
The invention also provides a computer device which comprises a storage module, a processor and a computer program stored on the storage module and capable of running on the processor, wherein the data acquisition uploading method is realized when the processor executes the computer program.
The invention further provides a vehicle, which comprises the data acquisition and uploading system. The vehicle referred to in the present invention may represent any suitable vehicle having a drive system composed of at least a battery, a power conversion device, and a drive motor, for example, a hybrid vehicle, an electric vehicle, a plug-in hybrid electric vehicle, or the like. A hybrid vehicle is a vehicle having two or more power sources, such as a gasoline powered and an electric vehicle.
The specific embodiments of the present application have been described above merely to provide a more clear description of the principles of the present application, in which individual components are explicitly shown or described so as to provide a more readily understood principles of the present invention. Various modifications or variations of this application may be readily made by those skilled in the art without departing from the scope of this application. It is to be understood that such modifications and variations are intended to be included within the scope of the present application.
Claims (11)
1. The data acquisition uploading system is characterized by comprising an event monitoring unit, a data control unit and a data uploading unit:
the event monitoring unit is used for acquiring a vehicle running signal in real time, generating event triggering information corresponding to an event and sending the event triggering information to the data control unit when the vehicle running signal meets the condition defined by the event;
the data control unit is used for acquiring vehicle sensing real-time data and receiving the event trigger information, screening out a data stream related to the event trigger information from the vehicle sensing real-time data according to the event trigger information, and sending the data stream to the data uploading unit;
the data uploading unit is used for carrying out packaging processing on the data stream and uploading the data stream.
2. The data acquisition and uploading system according to claim 1, wherein the event monitoring unit comprises an event trigger determination module that determines whether the vehicle operation signal satisfies one or more event-defined conditions and generates corresponding one or more event trigger information according to a preset determination rule.
3. The data acquisition upload system of claim 2 wherein the event monitoring unit further comprises an event priority determination module that, in the event that the event monitoring unit generates a plurality of event trigger information, prioritizes the plurality of event trigger information based on a predefined rule and sends the event trigger information to the data control unit in the prioritized order.
4. The data acquisition upload system of claim 1 wherein the event monitoring unit further comprises an event definition update module for receiving instructions to update the event definition.
5. The data acquisition upload system of claim 1 wherein the data control unit comprises: the data buffer module is used for arranging and buffering the vehicle sensing real-time data according to a time sequence, and the data filter module is used for filtering data streams of types and/or duration corresponding to the event trigger information from the data buffer module based on a preset rule according to the received event trigger information.
6. The data acquisition and uploading system according to claim 5, wherein the data control unit further comprises a remote configuration module, the remote configuration module is configured to receive a requirement for remote configuration of data acquisition and uploading, and control the type of the data stream received by the data buffer module and control whether the data screening module allows the data acquisition and uploading system to upload data according to the requirement.
7. The data acquisition and uploading system of claim 1, wherein the data uploading unit comprises a data processing module and a data staging module, the packaging process of the data stream by the data processing module comprises compression, packaging and naming, and the data processing module uploads the packaged data stream in real time, the data staging module is used for staging the packaged data stream and uploading the data stream after the vehicle is turned off.
8. The data acquisition and uploading method is characterized by comprising the following steps of:
an event monitoring step of acquiring a vehicle running signal in real time, and generating event triggering information corresponding to an event when the vehicle running signal meets the condition defined by the event;
a data control step of acquiring vehicle sensing real-time data, receiving the event trigger information, and screening out a data stream related to the event trigger information from the vehicle sensing real-time data according to the event trigger information; and
and a data uploading step, wherein the data stream is packaged and uploaded.
9. A computer readable storage medium having stored thereon a computer program, wherein the computer program when executed by a processor implements the data acquisition uploading method of claim 8.
10. A computer device comprising a memory module, a processor and a computer program stored on the memory module and executable on the processor, characterized in that the processor implements the data acquisition uploading method of claim 8 when executing the computer program.
11. A vehicle, characterized in that it comprises a data acquisition uploading system according to any of claims 1-7.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202311403623.9A CN117456635A (en) | 2023-10-26 | 2023-10-26 | Data acquisition and uploading system and method thereof |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202311403623.9A CN117456635A (en) | 2023-10-26 | 2023-10-26 | Data acquisition and uploading system and method thereof |
Publications (1)
Publication Number | Publication Date |
---|---|
CN117456635A true CN117456635A (en) | 2024-01-26 |
Family
ID=89581172
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202311403623.9A Pending CN117456635A (en) | 2023-10-26 | 2023-10-26 | Data acquisition and uploading system and method thereof |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN117456635A (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN119316308A (en) * | 2024-09-29 | 2025-01-14 | 东风商用车有限公司 | A method and device for switching vehicle data upload mode |
-
2023
- 2023-10-26 CN CN202311403623.9A patent/CN117456635A/en active Pending
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN119316308A (en) * | 2024-09-29 | 2025-01-14 | 东风商用车有限公司 | A method and device for switching vehicle data upload mode |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US11170589B2 (en) | Emergency event based vehicle data logging | |
JP4139314B2 (en) | Driving workload estimation method and system | |
US20150112542A1 (en) | Transportation event recorder for vehicle | |
JP7631299B2 (en) | Multi-state messaging anomaly detection for securing broadcast networks | |
US11423708B2 (en) | Synchronizing sensing systems | |
GB2522728A (en) | Monitoring device | |
US20200216027A1 (en) | Detecting vehicle intrusion using command pattern models | |
CN104875731A (en) | Method for identifying rapid acceleration or rapid deceleration of vehicle in real time by using satellite positioning data | |
CN115514741A (en) | OTA (over the air) upgrading method and device and computer readable storage medium | |
CN104361651A (en) | Real-time monitoring system and method for rental vehicles | |
US20240249623A1 (en) | Artificial intelligence-based persistence of vehicle black box data | |
CN111301317A (en) | Event generation method, event generation device and vehicle-mounted equipment | |
CN205304983U (en) | Car networking monitored control system | |
CN110995771A (en) | A monitoring and management system for truck land transportation based on the Internet of Things | |
CN115203078A (en) | Vehicle data acquisition system, method, equipment and medium based on SOA architecture | |
CN117456635A (en) | Data acquisition and uploading system and method thereof | |
US20250227149A1 (en) | Data collection policy management for vehicle sensor data | |
Schweppe et al. | Flexible on-board stream processing for automotive sensor data | |
US20240427934A1 (en) | Anonymous data collection for vehicle sensor data | |
CN117749624A (en) | Configurable method for vehicle data acquisition | |
US10733885B2 (en) | Multi-vehicle prediction system | |
US20240420523A1 (en) | Data collection for vehicle sensor data | |
US11604679B2 (en) | Dynamic workload shifting within a connected vehicle | |
CN119866626A (en) | Intrusion detection method, device and system | |
KR20140147298A (en) | Digital taco graph and method for data transformaing theirof |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination |