WO2025209316A1 - Environment detection methods and related apparatus - Google Patents
Environment detection methods and related apparatusInfo
- Publication number
- WO2025209316A1 WO2025209316A1 PCT/CN2025/085467 CN2025085467W WO2025209316A1 WO 2025209316 A1 WO2025209316 A1 WO 2025209316A1 CN 2025085467 W CN2025085467 W CN 2025085467W WO 2025209316 A1 WO2025209316 A1 WO 2025209316A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- vehicle
- data
- vibration
- environmental
- unit
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B19/00—Programme-control systems
- G05B19/02—Programme-control systems electric
- G05B19/04—Programme control other than numerical control, i.e. in sequence controllers or logic controllers
- G05B19/042—Programme control other than numerical control, i.e. in sequence controllers or logic controllers using digital processors
- G05B19/0423—Input/output
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B19/00—Programme-control systems
- G05B19/02—Programme-control systems electric
- G05B19/04—Programme control other than numerical control, i.e. in sequence controllers or logic controllers
- G05B19/042—Programme control other than numerical control, i.e. in sequence controllers or logic controllers using digital processors
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B2219/00—Program-control systems
- G05B2219/20—Pc systems
- G05B2219/24—Pc safety
- G05B2219/24215—Scada supervisory control and data acquisition
Definitions
- the present application relates to the field of automobile technology, and in particular to an environment detection method and related devices.
- the embodiments of the present application provide an environment detection method and related devices, which can reduce power consumption when the security guard function is turned on.
- the power consumption of the detection unit is lower than the power consumption of the calculation unit when it is awakened and working.
- the method further comprises:
- the detection unit determines that the first trigger event is detected when the vibration signal exceeds a first vibration threshold.
- the method further comprises:
- the detection unit determines whether there is a moving object around the vehicle based on the perception data
- the detection unit determines that a first trigger event is detected when it is determined that a moving object exists around the vehicle.
- the method further comprises:
- the vibration signal processing module sends a second wake-up signal to the perception data processing module when the vibration signal exceeds the first vibration threshold;
- the perception data processing module determines whether there is a moving object around the vehicle based on the perception data
- the perception data processing module determines that a first trigger event is detected when it is determined that there is a moving object around the vehicle;
- the perception data processing module Before receiving the second wake-up signal, the perception data processing module is in a dormant state.
- the vibration signal processing module detects vibration and wakes up the perception data processing module to detect vision and radar, and finally pulls up the computing unit.
- This hierarchical wake-up method can reduce power consumption.
- an embodiment of the present application provides an environment detection method, which can be performed by a computing unit.
- the computing unit can be a device, or a chip (system) or circuit for a device, and this application does not limit this.
- the computing unit receives a first wake-up signal and second environment data from the detection unit. Therefore, it can determine whether to generate an alarm message based on the second environment data after waking up.
- the above-mentioned second environment data includes the first environment data and/or the data processing result obtained according to the first environment data.
- a detection unit with lower power consumption is kept open, and a computing unit with higher power consumption is awakened by the detection unit to perform precise detection. This not only ensures the detection accuracy of the environmental safety detection function, but also helps to save power consumption.
- the second environmental data includes the first environmental data and a data processing result obtained based on the first environmental data
- the first environmental data includes perception data and a vibration signal
- the data processing result includes a suspected area where the mobile object is located, and the suspected area where the mobile object is located is determined based on the perception data
- the calculating unit determines whether to generate warning information based on the second environment data, including:
- the calculation unit generates warning information when the distance between the target mobile object and the vehicle is less than or equal to a distance threshold, and/or when the vibration intensity of the vehicle is greater than or equal to a second vibration threshold;
- the computing unit re-enters a dormant state when the distance between the target mobile object and the vehicle is greater than a distance threshold and the vibration intensity of the vehicle is less than the second vibration threshold;
- the vibration intensity of the vehicle is determined based on the vibration signal.
- the computing unit determines the target moving object based on the perception data and the suspected area where the moving object is located, including:
- the computing unit determines a region where at least one object of interest is located based on the sensing data
- the calculation unit determines the target moving object according to the area where the at least one object of interest is located and the suspected area where the moving object is located;
- the at least one object of interest includes the target moving object, and the degree of overlap between the area where the target moving object is located and the area where the moving object is suspected to be located is greater than or equal to a preset overlap threshold.
- the computing unit fuses the received information with the information determined by itself based on a more accurate detection algorithm to obtain the target moving object, thereby improving detection accuracy.
- the alarm information includes a target alarm level, where the target alarm level is one of multiple alarm levels, and the multiple alarm levels are used to indicate the severity of the alarm information;
- the target warning level is the first warning level
- the target warning level is the second warning level.
- warning severity levels can be indicated. It also reflects the severity of dangerous events occurring in the vehicle, which is conducive to timely reminding the owner to check.
- the method further includes:
- the computing unit sends a third wake-up signal and the alarm information to the control unit, where the alarm information includes a target alarm level.
- the method further includes:
- the computing unit displays the first alarm prompt information through the display device;
- the calculation unit sends second alarm prompt information to the user terminal.
- warning levels correspond to different prompting methods, which can reflect the severity of dangerous events occurring in the vehicle and help to remind the owner to check in time.
- the method further includes:
- the computing unit stores the video image data associated with the alarm information, wherein the video image data is acquired by a visual sensor; or
- the car owner can provide evidence for subsequent evidence collection.
- the device goes back to sleep, saving power.
- the computing unit can re-enter the dormant state when there is no detection demand, so as to save power consumption and improve user satisfaction.
- an embodiment of the present application provides an environment detection method, which can be performed by a control unit.
- the control unit can be a device, or a chip (system) or circuit for a device, which is not limited in this application.
- the control unit receives a third wake-up signal and alarm information from the computing unit, and then the control unit can issue an alarm prompt based on the alarm information after waking up.
- the alarm information includes a target alarm level.
- control unit issues an alarm prompt according to the alarm information, including:
- the control unit sends second alarm prompt information to the user terminal.
- the control unit stores the video image data associated with the alarm information, wherein the video image data is acquired by a visual sensor; or
- the control unit saves the video image data associated with the alarm information, and re-enters the dormant state after saving the video image data associated with the alarm information.
- the car owner can provide evidence for subsequent evidence collection.
- the device goes back to sleep, saving power.
- an embodiment of the present application provides an environmental detection method, in which a detection unit obtains first environmental data and performs environmental detection based on the first environmental data when the vehicle is in a parking state.
- the detection unit detects a first trigger event, it sends a first wake-up signal and second environmental data to the computing unit, and then the computing unit can determine whether to generate an alarm message based on the second environmental data after waking up.
- the second environmental data includes the first environmental data and/or a data processing result obtained based on the first environmental data.
- the detection unit is in a powered state, and before receiving the first wake-up signal, the computing unit is in a dormant state.
- the first environmental data includes a vibration signal from an acceleration sensor
- the method further comprises:
- the first environmental data includes perception data from an environmental perception sensor
- the method further comprises:
- the detection unit determines whether there is a moving object around the vehicle based on the perception data
- the processing unit When determining whether to generate alarm information based on the second environment data, the processing unit is configured to:
- the vibration intensity of the vehicle is determined based on the vibration signal.
- the at least one object of interest includes the target moving object, and the degree of overlap between the area where the target moving object is located and the area where the moving object is suspected to be located is greater than or equal to a preset overlap threshold.
- the alarm information includes a target alarm level, where the target alarm level is one of multiple alarm levels, and the multiple alarm levels are used to indicate the severity of the alarm information;
- the target warning level is the first warning level
- a third wake-up signal and the alarm information are sent to a control unit, where the alarm information includes a target alarm level.
- the target alarm level is the first alarm level
- the device further includes a storage unit:
- the storage unit is used to store the video image data associated with the alarm information
- the processing unit is configured to re-enter a dormant state after the storage unit saves the video image data associated with the alarm information.
- the processing unit is configured to:
- the system re-enters the dormant state.
- a transceiver unit configured to receive a third wake-up signal and alarm information from the computing unit, wherein the alarm information includes a target alarm level;
- a processing unit is used to issue an alarm prompt based on the alarm information.
- second alarm prompt information is sent to the user terminal.
- the device further includes a storage unit:
- the storage unit is used to store the video image data associated with the alarm information, wherein the video image data is acquired by a visual sensor;
- the storage unit is used to store the video image data associated with the alarm information
- the processing unit is configured to re-enter a dormant state after the storage unit saves the video image data associated with the alarm information.
- the environment detection device is a chip (system) or circuit used in a detection unit, a computing unit, or a control unit.
- the transceiver unit can be a communication interface (input/output interface), an interface circuit, an output circuit, an input circuit, a pin, or related circuits on the chip (system) or circuit; and the processing unit can be at least one processor, a processing circuit, or a logic circuit.
- an embodiment of the present application provides an environment detection device, comprising a processor.
- the processor is coupled to a memory and can be configured to execute instructions in the memory to implement the method of any of the first to third aspects described above and any possible implementation method.
- the environment detection device further comprises a memory.
- the environment detection device further comprises a communication interface, and the processor is coupled to the communication interface.
- an embodiment of the present application provides a computer-readable storage medium, which is used to store a computer program (also referred to as code, or instructions); when the computer program is run on a computer, the method of any one of the above-mentioned first to third aspects and any possible implementation method is implemented.
- a computer program also referred to as code, or instructions
- an embodiment of the present application provides a computer program product, which includes: a computer program (also referred to as code, or instructions); when the computer program is run, it enables the computer to execute any one of the above-mentioned first to third aspects and any possible implementation method.
- a computer program also referred to as code, or instructions
- an embodiment of the present application provides a system, comprising a detection unit and a computing unit, wherein the detection unit is configured to execute the method of the first aspect and any possible implementation manner described above, and the computing unit is configured to execute the method of the second aspect and any possible implementation manner described above.
- the system may further comprise a control unit configured to execute the method of the third aspect and any possible implementation manner described above.
- the process of sending information and/or receiving information in the above method can be understood as the process of the processor outputting information and/or the process of the processor receiving input information.
- the processor can output the information to the transceiver (or communication interface, or sending module) so that it can be transmitted by the transceiver. After the information is output by the processor, it may also need to undergo other processing before it reaches the transceiver.
- the transceiver or communication interface, or sending module
- the transceiver receives the information and inputs it into the processor.
- the information may need to undergo other processing before it is input into the processor.
- the sending of information mentioned in the above method can be understood as the processor outputting information.
- the receiving of information can be understood as the processor receiving input information.
- the at least one memory is located outside the device.
- the at least one memory is located within the device.
- part of the at least one memory is located inside the device, and another part of the memory is located outside the device.
- FIG2 is a schematic diagram of another system architecture applicable to an embodiment of the present application.
- FIG3 is a flow chart of an environmental detection method provided in an embodiment of the present application.
- FIG4 is a schematic diagram of a target moving object provided in an embodiment of the present application.
- FIG5 is a schematic diagram of an environmental detection process provided by an embodiment of the present application.
- FIG7 is another flow chart of the environmental detection method provided in an embodiment of the present application.
- FIG9 is a schematic structural diagram of another environment detection device provided in an embodiment of the present application.
- At least one” mentioned in the embodiments of this application refers to one or more, and “plurality” refers to two or more. “At least one of the following” or similar expressions refers to any combination of these items, including any combination of single items or plural items.
- at least one of a, b, or c can represent: a, b, c, (a and b), (a and c), (b and c), or (a and b and c), where a, b, c can be single or multiple.
- “And/or” describes the association relationship of associated objects, indicating that three relationships can exist.
- a and/or B can represent: A exists alone, A and B exist at the same time, and B exists alone, where A and B can be singular or plural.
- the character “/” generally indicates that the related objects before and after are in an “or” relationship.
- ordinal numbers such as “first” and “second” in the embodiments of this application are used to distinguish between multiple objects and are not used to define the order, timing, priority, or importance of multiple objects.
- first message and the second message are only used to distinguish different message types and do not indicate differences in structure, importance, etc. between the two messages.
- the safety guard function refers to the function of detecting the safety status of the vehicle through sensors on the vehicle while the vehicle is parked. When it is determined that the vehicle is at risk of damage or intrusion, it notifies the owner and records relevant environmental information.
- the sensors involved in the embodiments of the present application include acceleration sensors (also known as vibration sensors, shock sensors, etc.) and environmental perception sensors.
- the environmental perception sensors may include vision sensors and/or radar sensors, etc., without limitation.
- vision sensors include fisheye, eagle eye, monocular, binocular, four-way cameras, etc., without limitation here.
- Radar sensors may include radar (radio detection and ranging, Radar), laser radar (light detection and ranging, LiDAR), millimeter wave radar, ultrasonic radar, etc., without limitation here.
- the safety guard function In real life, when the driver parks and leaves the car, the vehicle is often scratched or collided. In response to the need for car safety monitoring after the driver leaves the car, the safety guard function has been introduced. Under the safety guard function, the safety of the vehicle is detected by sensors on the vehicle, and an early warning is issued and the sensed data is recorded after a predefined event occurs, which can help car owners maintain their rights and reduce their losses. In related technologies, the safety guard function is usually achieved with the help of sensors and analysis capabilities of intelligent driving (referred to as intelligent driving domain). Due to the reuse of the algorithm module of intelligent driving, it is necessary to run the algorithm module of intelligent driving when running the safety guard function, resulting in high computing power consumption and large power consumption. Therefore, how to design a solution with low power consumption and high detection accuracy has become an urgent problem to be solved.
- this application proposes an environmental detection method that can reduce vehicle power consumption and help improve user experience.
- Figure 1 is a schematic diagram of a system architecture applicable to an embodiment of the present application.
- the system includes a mobile data center (MDC) and a cockpit domain controller (CDC).
- the MDC includes four cameras, an ultrasonic radar, an accelerometer, a microcontroller unit (MCU), and a system on chip (SOC).
- the SOC is connected to the four cameras, the accelerometer and ultrasonic radar are connected to the MCU, and the MCU is connected to the SOC.
- Figure 2 is another system architecture diagram applicable to the embodiment of the present application.
- the system includes four cameras, ultrasonic radar, acceleration sensor, automatic parking assist (APA), MCU and CDC.
- the APA is connected to the four cameras and ultrasonic radar
- the acceleration sensor is connected to the MCU
- both the APA and the MCU are connected to the CDC.
- high-power components such as the CDC do not need to be constantly on during the operation of the safety guard function.
- the MCU is constantly on to obtain and detect the vibration signal collected by the acceleration sensor.
- the CDC is awakened for further, more accurate detection.
- the APA can also use the perception data collected by the ultrasonic radar and the four cameras for detection.
- the CDC can also be awakened for further, more accurate detection.
- the CDC can perform motion frame detection, radar detection, vibration detection, and human-vehicle AI detection on data from the MCU and APA based on the visual system. The fusion processing system then makes a comprehensive judgment on the visual system's detection results.
- the APA deploys lightweight algorithms such as visual detection and radar detection, while the MCU deploys lightweight algorithms such as vibration detection, powered by a small battery (e.g., 20AH).
- parking means that the vehicle is stopped and the parking gear is engaged.
- parking can sometimes also be referred to as parking, which is not limited in this application.
- being in a powered state can also be understood as being in an operating state.
- Figure 3 is a flow chart of the environment detection method provided by an embodiment of the present application.
- the environment detection method includes the following steps S301 to S303.
- the execution subject of the method shown in Figure 3 can be a vehicle, or the execution subject of the method shown in Figure 3 can also be a chip or vehicle-mounted component in which the detection software is deployed in the vehicle.
- the detection software can be deployed in the vehicle's CDC, MDC, APA, MCU and other vehicle-mounted components (or chips), and this application does not limit this.
- Figure 3 mainly uses the vehicle-mounted component in which the detection software is deployed in the vehicle as an example of the execution subject of the method.
- the vehicle component can be a detection unit, a computing unit or a control unit.
- Figure 3 is a schematic flow chart of an embodiment of the method of the present application, showing the detailed communication steps or operations of the method, but these steps or operations are only examples.
- the embodiment of the present application can also perform other operations or variations of the various operations in Figure 3.
- the various steps in Figure 3 can be performed in a different order from that presented in Figure 3, and it is possible that not all operations in Figure 3 need to be performed. Among them:
- a detection unit When a vehicle is in a parking state, a detection unit obtains first environmental data and performs environmental detection according to the first environmental data.
- the detection unit can specifically be an MCU, and the sensors connected to the MCU can include an accelerometer and a radar sensor, that is, the accelerometer and the radar sensor have a communication connection with the MCU.
- the first environmental data collected by the accelerometer is a vibration signal
- the first environmental data collected by the radar sensor is a radar signal.
- the MCU can determine whether the vehicle is generating abnormal vibrations based on the vibration signal, or can determine whether there are moving objects around the vehicle based on the radar signal.
- the MCU detects abnormal vibration and/or detects the presence of a moving object approaching the vehicle, it is considered that a first trigger event has been detected.
- the moving object may refer to a moving person, a motor vehicle, a non-motor vehicle, etc., without limitation.
- the detection unit may specifically include an MCU and/or an APA
- the sensor connected to the MCU may be an acceleration sensor
- the sensor connected to the APA may include an environmental perception sensor
- the environmental perception sensor may specifically be a visual sensor and/or a radar sensor.
- the following text uses the environmental perception sensor including a visual sensor and a radar sensor as an example for schematic illustration.
- the first environmental data collected by the acceleration sensor is a vibration signal
- the first environmental data collected by the environmental perception sensor is perception data.
- the video image data collected by the visual sensor and the radar signal collected by the radar sensor can be understood as perception data.
- the MCU can determine whether the vehicle has abnormal vibrations based on the vibration signal, and the APA can determine whether there are moving objects around the vehicle based on the radar signal or the video image data. Specifically, the APA can process the radar signal or the video image data according to the motion detection algorithm to determine whether there are moving objects around the vehicle.
- S302 When the detection unit detects a first trigger event, the detection unit sends a first wake-up signal and second environment data to the computing unit. Correspondingly, the computing unit receives the first wake-up signal and second environment data from the detection unit.
- the first wake-up signal and the second environmental data can be received at one time, or they can be received separately, which is not limited in this application.
- the computing device usually needs to be woken up first and then receive the second environmental data.
- the first environmental data included in the second environmental data may refer to perception data (such as video image data, or one or more of radar signals, etc.) and vibration signals, etc.
- the data processing result includes the suspected area where the moving object is located.
- the suspected area where the moving object is located can be determined based on the perception data.
- the detection unit can process the video image data based on the motion frame detection algorithm to determine the suspected area where the moving object is located; for another example, the detection unit can process the radar signal based on the radar detection algorithm to determine the suspected area where the moving object is located.
- the detection unit can also determine the union area of the suspected area determined based on the video image data and the suspected area determined based on the radar signal as the suspected area where the moving object is located, which is not limited in this application.
- the computing unit may be the SOC. That is, when the MCU detects abnormal vibration of the vehicle or the presence of a moving object around the vehicle, the MCU may wake up the SOC and send second environmental data to the SOC.
- the second environmental data may include a vibration signal.
- the computing unit may be a CDC. That is, when the MCU detects abnormal vibration of the vehicle or the APA detects the presence of a moving object around the vehicle, the MCU or APA may wake up the CDC and send second environmental data to the CDC.
- the second environmental data may include video image data, vibration signals, and the suspected location of the moving object.
- the calculation unit determines whether to generate alarm information based on the second environment data.
- the second environmental data includes the first environmental data and the data processing results obtained based on the first environmental data
- the first environmental data includes perception data (such as video image data, radar signals) and vibration signals
- the data processing results include the suspected area where the moving object is located.
- the computing unit can process the video image data based on the AI detection algorithm to determine whether there is an object of interest. In the case that the computing unit does not detect any object of interest, the computing unit can re-enter the sleep state; in the case that the computing unit detects at least one object of interest, the computing unit can further determine the target moving object based on the area where the at least one object of interest is located and the suspected area where the moving object is located.
- the object of interest can be considered to be the target moving object.
- the object of interest can refer to a person, a motor vehicle, a non-motor vehicle, etc., and this application does not impose any restrictions on this.
- Figure 4 is a schematic diagram of the target moving object provided in an embodiment of the present application.
- the video image data is processed to detect four objects of interest, namely object of interest 1, object of interest 2, object of interest 3, and object of interest 4.
- object of interest 4 is the target moving object.
- the computing unit can generate an alarm message when the distance between the target mobile object and the vehicle is less than or equal to a certain distance threshold (hereinafter referred to as the second distance threshold for ease of distinction) and/or when the vibration intensity of the vehicle indicated by the vibration signal is greater than or equal to the second vibration threshold. If the distance between the target mobile object and the vehicle is greater than the second distance threshold and the vibration intensity of the vehicle is less than the second vibration threshold, the computing unit re-enters the dormant state. Generally speaking, the first distance threshold is greater than the second distance threshold, and the first vibration threshold is less than the second vibration threshold.
- the warning information may include a target warning level, which is one of a plurality of warning levels, and the plurality of warning levels are used to indicate the severity of the warning information.
- the plurality of warning levels include a first warning level and a second warning level, wherein the first warning level is lower than the second warning level.
- the target warning level is the first warning level; when the vibration intensity of the vehicle is greater than or equal to the vibration threshold, or when the distance between the target moving object and the vehicle is less than or equal to the second distance threshold and the vibration intensity of the vehicle is greater than or equal to the second vibration threshold, the target warning level is the second warning level.
- the computing unit may be a system-on-chip (SOC). That is, when the MCU detects abnormal vehicle vibration and/or the presence of moving objects around the vehicle, the MCU may wake up the SOC. After waking up, the SOC may generate an alarm based on the second environmental data.
- the SOC may also wake up a control unit (e.g., a CDC) and send an alarm to the CDC.
- the SOC may wake up the CDC by sending a third wake-up signal to the CDC. After receiving the alarm, the CDC may issue an alarm based on the alarm.
- the CDC may display the first alarm on an onboard display device, such as by highlighting the alarm on the onboard screen. If the target alarm level is a second alarm level, the CDC may send a second alarm to a user terminal. Optionally, the CDC may also push corresponding video image data to the user terminal so that the user can promptly check the vehicle's status. Furthermore, the CDC may save the video image data associated with the alarm (or write the video image data associated with the alarm to disk). The video image data associated with the alarm information here can be understood as all video image data that triggers the generation of the alarm information. Optionally, after the CDC saves the video image data associated with the alarm information, the CDC can enter a dormant state. Optionally, if the SOC does not receive new second environmental data within a first period of time after the alarm information is generated, the SOC enters a dormant state.
- the implementation process of implementation (1) above can refer to the process shown in Figure 5, where: S1.
- a vibration signal is acquired for vibration detection, and a radar signal is acquired for radar detection.
- S2. Upon detecting a first trigger event, the MCU sends a first wake-up signal and second environmental data to the SOC.
- S3. The SOC determines whether to generate an alarm based on the second environmental data. This includes the following three branches: Branch 1: If the distance between the target mobile object and the vehicle is less than or equal to a second distance threshold, but the vibration intensity is less than the second vibration threshold, an alarm message containing a first alarm level is generated.
- Branch 2 If the distance between the target mobile object and the vehicle is less than or equal to the second distance threshold, and the vibration intensity is greater than or equal to the second vibration threshold, an alarm message containing a second alarm level is generated.
- Branch 3 If the distance between the target mobile object and the vehicle is greater than the second distance threshold, and the vibration intensity is less than the second vibration threshold, the SOC enters a dormant state. S4. If an alarm message is generated, the SOC sends the alarm message to the CDC. S5. The CDC issues a corresponding warning based on the alarm level and stores the video image data on disk. S6. The SOC enters a dormant state.
- the SOC if the SOC does not receive new second environmental data within a first period of time after generating the alarm message, the SOC enters a dormant state. S7.
- the CDC enters a dormant state.
- the CDC saves the video image data associated with the alarm message, it can enter a dormant state.
- the computing unit may be a CDC. That is, when the MCU detects abnormal vibrations in the vehicle or the APA detects the presence of moving objects around the vehicle, either the MCU or the APA can wake up the CDC. After waking up, the CDC can generate an alert based on the second environmental data and issue an alert based on the alert. For example, when the target alert level is the first alert level, the CDC can display the first alert via an onboard display device, such as by highlighting the alert on the onboard screen. When the target alert level is the second alert level, the CDC can send the second alert to the user terminal.
- the target alert level is the first alert level
- the CDC can display the first alert via an onboard display device, such as by highlighting the alert on the onboard screen.
- the target alert level is the second alert level
- the CDC can send the second alert to the user terminal.
- the CDC can also push corresponding video image data to the user terminal so that the user can promptly check the vehicle's status. Furthermore, the CDC can also save the video image data associated with the alert. Optionally, after saving the video image data associated with the alert, the CDC can enter a dormant state again. Alternatively, if the CDC does not receive new second environmental data within a first period after generating the alert, the CDC can enter a dormant state.
- the implementation process of the above-mentioned implementation (ii) can refer to the process shown in Figure 6, wherein: S1, when the vehicle is in a parked state, the MCU obtains a vibration signal for vibration detection. (Or, S1', when the vehicle is in a parked state, the APA obtains a radar signal for radar detection, or the APA obtains video image data for image detection. S2, when the MCU detects abnormal vibration, the MCU sends a first wake-up signal and second environmental data to the CDC.
- the CDC determines whether to generate an alarm message based on the second environmental data. It includes the following three branches: Branch one: When the distance between the target moving object and the vehicle is less than or equal to the second distance threshold, but the vibration intensity is less than the second vibration threshold, an alarm message containing a first alarm level is generated. Branch two : When the distance between the target moving object and the vehicle is less than or equal to the second distance threshold, and the vibration intensity is greater than or equal to the second vibration threshold, an alarm message containing a second alarm level is generated.
- Branch three When the distance between the target moving object and the vehicle is greater than the second distance threshold, and the vibration intensity is less than the second vibration threshold, the CDC enters a dormant state. S4. The CDC makes corresponding warnings according to the alarm level and writes the video image data to the disk. S5. The CDC enters a dormant state. Generally speaking, after the CDC saves the video image data associated with the alarm information, the CDC can enter a dormant state again, or if the CDC does not receive new second environmental data within the first period of time after the alarm information is generated, the CDC enters a dormant state.
- Figure 7 is another flow chart of the environment detection method provided by an embodiment of the present application.
- the environment detection method includes the following steps S701 to S705.
- the method execution subject shown in Figure 7 can be a vehicle, or the method execution subject shown in Figure 7 can also be a chip or vehicle-mounted component in which the detection software is deployed in the vehicle.
- the detection software can be deployed in the vehicle's CDC, MDC, APA, MCU and other vehicle-mounted components (or chips), and this application does not limit this.
- Figure 7 mainly uses the vehicle-mounted component in which the detection software is deployed in the vehicle as an example to illustrate the execution subject of the method.
- the vehicle component can be a perception data processing module, a vibration signal processing module and a computing unit.
- the vibration signal processing module can refer to the MCU
- the perception data processing module can refer to the APA
- the computing unit can be the CDC.
- FIG7 is a schematic flow chart of an embodiment of the method of the present application, showing detailed communication steps or operations of the method, but these steps or operations are merely examples, and the embodiment of the present application may also perform other operations or variations of the various operations in FIG7.
- the various steps in FIG7 may be performed in a different order than that presented in FIG7, and it is possible that not all operations in FIG7 need to be performed. Among them:
- the MCU determines whether the vehicle generates abnormal vibration based on a vibration signal and a first vibration threshold.
- the sensor connected to the MCU may be an accelerometer.
- the first environmental data collected by the accelerometer is a vibration signal.
- the MCU can determine whether the vehicle is experiencing abnormal vibration based on the vibration signal from the accelerometer and a first vibration threshold. Specifically, if the vibration intensity indicated by the vibration signal is not less than the first vibration threshold, the MCU can determine that the vehicle is experiencing abnormal vibration; if the vibration intensity indicated by the vibration signal is less than the first vibration threshold, the MCU can determine that the vehicle is not experiencing abnormal vibration.
- S702 When the MCU determines that the vehicle is vibrating abnormally, the MCU sends a second wake-up signal to the APA. In response, the APA receives the second wake-up signal from the MCU.
- the sensors connected to the APA may include environmental perception sensors, which may specifically be vision sensors and/or radar sensors.
- environmental perception sensors which may specifically be vision sensors and/or radar sensors.
- the first environmental data collected by the environmental perception sensor is perception data.
- video image data collected by a vision sensor and radar signals collected by a radar sensor can both be understood as perception data.
- the MCU can wake up the APA.
- S705 The CDC determines whether to generate alarm information based on the second environment data.
- step S303 of the embodiment corresponding to FIG. 3 which will not be elaborated here.
- the MCU after the MCU detects vibration, it wakes up the APA to detect vision and radar, and finally pulls up the CDC.
- This hierarchical wake-up method can reduce power consumption.
- an apparatus for implementing any method in the embodiments of the present application.
- an apparatus is provided that includes units (or means) for implementing each step performed by the device in any of the above methods.
- Figure 8 is a structural diagram of an environment detection device provided in an embodiment of the present application.
- the environment detection device 80 may include a transceiver unit 801 and a processing unit 802.
- the transceiver unit 801 and the processing unit 802 may be software, hardware, or a combination of software and hardware.
- the transceiver unit 801 can implement a sending function and/or a receiving function, and can also be described as a transceiver unit.
- the transceiver unit 801 can also be a unit that integrates an acquisition unit (or receiving unit) and a sending unit, wherein the acquisition unit is used to implement the receiving function and the sending unit is used to implement the sending function.
- the transceiver unit 801 can be used to receive information sent by other devices, and can also be used to send information to other devices.
- the environment detection device 80 may correspond to the detection unit or chip in the detection unit in the method embodiment shown in Figure 3 or Figure 7 above.
- the environment detection device 80 may include a unit for executing the operations performed by the detection unit in the method embodiment shown in Figure 3 or Figure 7 above, and each unit in the environment detection device 80 is respectively for implementing the operations performed by the detection unit in the method embodiment shown in Figure 3 or Figure 7 above.
- the description of each unit is as follows:
- the processing unit 802 is configured to obtain first environmental data and perform environmental detection based on the first environmental data when the vehicle is in a parking state;
- the transceiver unit 801 is configured to send a first wake-up signal and second environment data to the computing unit when a first trigger event is detected, where the second environment data includes the first environment data and/or a data processing result obtained based on the first environment data;
- the detection unit when the vehicle is in a parking state, the detection unit is in a powered state, and before receiving the first wake-up signal, the calculation unit is in a dormant state.
- the first environmental data includes a vibration signal from an acceleration sensor
- the processing unit 802 is configured to:
- the first environmental data includes perception data from an environmental perception sensor
- the processing unit 802 includes a perception data processing module and a vibration signal processing module;
- the first environmental data includes a vibration signal from an acceleration sensor and perception data from an environmental perception sensor;
- the vibration signal processing module is configured to send a second wake-up signal to the perception data processing module when detecting that the vibration signal exceeds a first vibration threshold;
- the perception data processing module is used to determine whether there is a moving object around the vehicle based on the perception data
- the perception data processing module is configured to determine that a first trigger event is detected when it is determined that there is a moving object around the vehicle;
- the environment detection device 80 may correspond to the computing unit in the method embodiment shown in FIG3 or FIG7 , for example, the environment detection device 80 may be a computing unit or a chip in the computing unit.
- the environment detection device 80 may include a unit for executing the operations performed by the computing unit in the method embodiment shown in FIG3 or FIG7 , and each unit in the environment detection device 80 is respectively for implementing the operations performed by the computing unit in the method embodiment shown in FIG3 or FIG7 .
- the description of each unit is as follows:
- the processing unit 802 is configured to determine whether to generate an alarm message based on the second environment data
- the detection unit when the vehicle is in a parking state, the detection unit is in a powered state, and before receiving the first wake-up signal, the calculation unit is in a dormant state.
- the power consumption of the detection unit is lower than the power consumption of the calculation unit when it is awakened and working.
- the second environmental data includes the first environmental data and a data processing result obtained based on the first environmental data
- the first environmental data includes perception data and a vibration signal
- the data processing result includes a suspected area where the mobile object is located, and the suspected area where the mobile object is located is determined based on the perception data
- the processing unit 802 When determining whether to generate alarm information based on the second environment data, the processing unit 802 is configured to:
- the vibration intensity of the vehicle is determined based on the vibration signal.
- the processing unit 802 when determining the target moving object based on the perception data and the suspected area where the moving object is located, the processing unit 802 is configured to:
- the at least one object of interest includes the target moving object, and the degree of overlap between the area where the target moving object is located and the area where the moving object is suspected to be located is greater than or equal to a preset overlap threshold.
- the alarm information includes a target alarm level, where the target alarm level is one of multiple alarm levels, and the multiple alarm levels are used to indicate the severity of the alarm information;
- the target warning level is the first warning level
- the transceiver unit 801 is configured to:
- the processing unit 802 is configured to:
- the target alarm level is the first alarm level
- second alarm prompt information is sent to the user terminal.
- the device further includes a storage unit 803 (not shown in the figure):
- the storage unit 803 is used to store the video image data associated with the alarm information, and the video image data is collected by a visual sensor; or
- the storage unit 803 is used to store the video image data associated with the alarm information
- the processing unit 802 is configured to:
- the system re-enters the dormant state.
- the environment detection device 80 may correspond to the control unit in the method embodiment shown in FIG3 or FIG7 above, for example, the environment detection device 80 may be a control unit or a chip in the control unit.
- the environment detection device 80 may include a unit for executing the operations performed by the control unit in the method embodiment shown in FIG3 or FIG7 above, and each unit in the environment detection device 80 is respectively for implementing the operations performed by the control unit in the method embodiment shown in FIG3 or FIG7 above.
- the description of each unit is as follows:
- the transceiver unit 801 is configured to receive a third wake-up signal and alarm information from the computing unit, wherein the alarm information includes a target alarm level;
- the processing unit 802 is configured to issue an alarm prompt based on the alarm information.
- second alarm prompt information is sent to the user terminal.
- the storage unit 803 is used to store the video image data associated with the alarm information, and the video image data is collected by a visual sensor; or
- the storage unit 803 is used to store the video image data associated with the alarm information
- the processing unit 802 is configured to re-enter the dormant state after saving the video image data associated with the alarm information.
- lightweight vibration detection or visual detection, and radar detection algorithms are pre-placed on a low-power detection unit (such as an MCU or APA), powered by a small battery.
- the computing unit (such as an SOC or CDC) is awakened to run the full detection algorithm only when necessary, which can save power consumption while ensuring accurate detection results.
- the environmental detection device 90 shown in Figure 9 is only an example.
- the environmental detection device of the embodiment of the present application may also include other components, or include components with similar functions to the various components in Figure 9, or not include all the components in Figure 9.
- the environment detection device 90 includes a communication interface 901 and at least one processor 902 .
- the environment detection device can be a chip or a chip system
- the chip 100 may further include a memory 1003 , which is used to store necessary program instructions and data.
- the processor in the embodiments of the present application may be a central processing unit (CPU), but may also be other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc.
- the general-purpose processor may be a microprocessor or any conventional processor.
- the memory in the embodiments of the present application is used to provide storage space, which can store data such as an operating system and computer programs.
- Memory includes, but is not limited to, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM), or compact disc read-only memory (CD-ROM).
- the embodiment of the present application also provides a computer-readable storage medium, in which a computer program is stored.
- a computer program runs on one or more processors, the method shown in Figure 3 or Figure 7 can be implemented.
- the embodiment of the present application also provides a computer program product, which includes a computer program.
- a computer program product which includes a computer program.
- the computer program runs on a processor, it can implement the method shown in Figure 3 or Figure 7 above.
- An embodiment of the present application also provides a system, which includes at least one environment detection device 80 or environment detection device 90 or chip 100 as described above, and is used to execute the steps executed by the corresponding device in any of the embodiments of Figures 3 or 7 above.
- An embodiment of the present application further provides a processing device, including a processor and an interface; the processor is used to execute the method in any of the above method embodiments.
- the processing device can be a chip.
- the processing device can be a field programmable gate array (FPGA), a general-purpose processor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic device, discrete gate or transistor logic device, discrete hardware component, a system on chip (SoC), a central processing unit (CPU), a network processor (NP), a digital signal processing circuit (DSP), a microcontroller unit (MCU), a programmable logic device (PLD), or other integrated chip.
- SoC system on chip
- CPU central processing unit
- NP network processor
- DSP digital signal processing circuit
- MCU microcontroller unit
- PLD programmable logic device
- the memory in the embodiments of the present application may be a volatile memory or a non-volatile memory, or may include both volatile and non-volatile memories.
- the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory.
- the volatile memory may be a random access memory (RAM), which is used as an external cache.
- RAM random access memory
- SRAM static RAM
- DRAM dynamic RAM
- SDRAM synchronous DRAM
- DDR SDRAM double data rate SDRAM
- ESDRAM enhanced SDRAM
- SLDRAM synchlink DRAM
- DR RAM direct RAM
- the computer program product includes one or more computer instructions.
- the computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device.
- the computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another computer-readable storage medium.
- the computer instructions can be transmitted from one website, computer, server or data center to another website, computer, server or data center by wired (such as coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (such as infrared, wireless, microwave, etc.) means.
- the computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device such as a server or data center that includes one or more available media integrated.
- the available medium may be a magnetic medium (e.g., a floppy disk, a hard disk, a magnetic tape), an optical medium (e.g., a high-density digital video disc (DVD)), or a semiconductor medium (e.g., a solid state disc (SSD)), etc.
- the units in the above-mentioned various apparatus embodiments completely correspond to the electronic devices in the method embodiments, and the corresponding modules or units perform the corresponding steps.
- the transceiver unit (transceiver) performs the receiving or sending steps in the method embodiments, and other steps except sending and receiving can be performed by the processing unit (processor).
- the functions of the specific units can be referred to the corresponding method embodiments. Among them, there can be one or more processors.
- the functions are implemented in the form of software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium.
- the computer software product is stored in a storage medium and includes several instructions for enabling a computer device (which can be a personal computer, server, or network device, etc.) to execute all or part of the steps of the method described in each embodiment of the present application.
- the aforementioned storage medium includes various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory ROM, a random access memory RAM, a magnetic disk or an optical disk.
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Automation & Control Theory (AREA)
- Traffic Control Systems (AREA)
Abstract
Description
本申请要求在2024年03月30日提交中国国家知识产权局、申请号为202410396147.0、申请名称为“环境检测方法及相关装置”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。This application claims priority to the Chinese patent application filed with the State Intellectual Property Office of China on March 30, 2024, with application number 202410396147.0 and application name “Environmental Detection Methods and Related Devices,” the entire contents of which are incorporated by reference into this application.
本申请涉及汽车技术领域,尤其涉及一种环境检测方法及相关装置。The present application relates to the field of automobile technology, and in particular to an environment detection method and related devices.
在车辆驻车场景下,可能出现剐蹭、碰撞等情况对车辆造成伤害。在无监控区域,存在车主获取举证材料困难、甚至存在无法提供举证材料的情况。为了保护车辆驻车安全,维护车主权益,当检测到车辆出现风险时,可以提醒车主并保存车辆周围视频。但是现有设计实现该功能的功耗较高,因此如何设计一种功耗低且检测准确性高的方案成为当前亟待解决的问题。When a vehicle is parked, scratches, collisions, and other incidents can cause damage. In unmonitored areas, it can be difficult for the owner to obtain evidence, or even impossible to provide. To ensure parking safety and protect the rights of vehicle owners, a system that detects a risky situation can alert the owner and save a video of the surrounding area. However, existing designs for this feature consume high power, leading to a pressing challenge: designing a low-power, yet highly accurate detection solution.
本申请实施例提供了一种环境检测方法及相关装置,可在开启安全卫士功能时,降低功耗。The embodiments of the present application provide an environment detection method and related devices, which can reduce power consumption when the security guard function is turned on.
第一方面,本申请实施例提供了一种环境检测方法,该方法可以由检测单元执行。该检测单元可以是设备,也可以是用于设备的芯片(系统)或电路,本申请对此不作限定。在该方法中,检测单元在车辆处于驻车状态时,获取第一环境数据并根据第一环境数据进行环境检测。当检测到第一触发事件时,检测单元可以向计算单元发送第一唤醒信号和发送第二环境数据。其中,该第二环境数据包括第一环境数据和/或根据第一环境数据得到的数据处理结果。在本申请实施例中,在车辆处于驻车状态时,检测单元处于被供电状态(或称为处于工作状态),在接收到所述第一唤醒信号前,计算单元处于休眠状态。也就是说,通过常开功耗较低的检测单元,并通过检测单元唤醒功耗更高的计算单元进行精准地检测,这样既保证了环境安全检测功能的检测准确性,同时还有利于节省功耗。In the first aspect, an embodiment of the present application provides an environment detection method, which can be performed by a detection unit. The detection unit can be a device, or a chip (system) or circuit for a device, and the present application does not limit this. In this method, the detection unit obtains first environment data and performs environment detection based on the first environment data when the vehicle is in a parking state. When a first trigger event is detected, the detection unit can send a first wake-up signal and second environment data to a computing unit. Wherein, the second environment data includes the first environment data and/or a data processing result obtained based on the first environment data. In an embodiment of the present application, when the vehicle is in a parking state, the detection unit is in a powered state (or referred to as being in a working state), and before receiving the first wake-up signal, the computing unit is in a dormant state. That is to say, by normally opening the detection unit with lower power consumption and waking up the computing unit with higher power consumption through the detection unit for accurate detection, the detection accuracy of the environmental safety detection function is guaranteed, while also helping to save power consumption.
在一种可能的实施方式中,所述检测单元的功耗低于所述计算单元被唤醒后工作时的功耗。In a possible implementation, the power consumption of the detection unit is lower than the power consumption of the calculation unit when it is awakened and working.
在一种可能的实施方式中,所述第一环境数据包括来自加速度传感器的振动信号;In a possible implementation, the first environmental data includes a vibration signal from an acceleration sensor;
所述方法还包括:The method further comprises:
所述检测单元在所述振动信号超过第一振动阈值时,确定检测到所述第一触发事件。The detection unit determines that the first trigger event is detected when the vibration signal exceeds a first vibration threshold.
在该种实现方式下,检测单元可以在初步识别到可能产生危险的振动事件时,唤醒计算单元进行更精确的检测,可操作性强。In this implementation, when the detection unit preliminarily identifies a vibration event that may cause danger, it can wake up the computing unit to perform more accurate detection, which has strong operability.
在一种可能的实施方式中,所述第一环境数据包括来自环境感知传感器的感知数据;In a possible implementation, the first environmental data includes perception data from an environmental perception sensor;
所述方法还包括:The method further comprises:
所述检测单元根据所述感知数据确定所述车辆周围是否存在移动对象;The detection unit determines whether there is a moving object around the vehicle based on the perception data;
所述检测单元在确定所述车辆周围存在移动对象的情况下,确定检测到第一触发事件。The detection unit determines that a first trigger event is detected when it is determined that a moving object exists around the vehicle.
在该种实现方式下,检测单元可以在检测到物体靠近车辆周围区域时,唤醒计算单元进行更精确的检测,可操作性强。In this implementation mode, when the detection unit detects that an object is approaching the area around the vehicle, it can wake up the computing unit to perform more accurate detection, which has strong operability.
在一种可能的实施方式中,所述检测单元包括感知数据处理模块和振动信号处理模块;所述第一环境数据包括来自加速度传感器的振动信号和来自环境感知传感器的感知数据;In a possible implementation, the detection unit includes a perception data processing module and a vibration signal processing module; the first environmental data includes a vibration signal from an acceleration sensor and perception data from an environmental perception sensor;
所述方法还包括:The method further comprises:
所述振动信号处理模块在所述振动信号超过第一振动阈值的情况下,向所述感知数据处理模块发送第二唤醒信号;The vibration signal processing module sends a second wake-up signal to the perception data processing module when the vibration signal exceeds the first vibration threshold;
所述感知数据处理模块根据所述感知数据确定所述车辆周围是否存在移动对象;The perception data processing module determines whether there is a moving object around the vehicle based on the perception data;
所述感知数据处理模块在确定所述车辆周围存在移动对象的情况下,确定检测到第一触发事件;The perception data processing module determines that a first trigger event is detected when it is determined that there is a moving object around the vehicle;
其中,在接收到所述第二唤醒信号之前,所述感知数据处理模块处于休眠状态。Before receiving the second wake-up signal, the perception data processing module is in a dormant state.
在该种实现方式下,振动信号处理模块检测到振动后唤醒感知数据处理模块检测视觉和雷达,最终再拉起计算单元,这种分级唤醒的方式可以使得功耗更低。In this implementation, the vibration signal processing module detects vibration and wakes up the perception data processing module to detect vision and radar, and finally pulls up the computing unit. This hierarchical wake-up method can reduce power consumption.
第二方面,本申请实施例提供了一种环境检测方法,该方法可以由计算单元执行。该计算单元可以是设备,也可以是用于设备的芯片(系统)或电路,本申请对此不作限定。在该方法中,计算单元接收来自检测单元的第一唤醒信号和第二环境数据,因此,可以在唤醒后基于第二环境数据确定是否生成告警信息。应理解,上述第二环境数据包括第一环境数据和/或根据第一环境数据得到的数据处理结果。In the second aspect, an embodiment of the present application provides an environment detection method, which can be performed by a computing unit. The computing unit can be a device, or a chip (system) or circuit for a device, and this application does not limit this. In this method, the computing unit receives a first wake-up signal and second environment data from the detection unit. Therefore, it can determine whether to generate an alarm message based on the second environment data after waking up. It should be understood that the above-mentioned second environment data includes the first environment data and/or the data processing result obtained according to the first environment data.
在本申请实施例中,通过常开功耗较低的检测单元,并通过检测单元唤醒功耗更高的计算单元进行精准地检测,这样既保证了环境安全检测功能的检测准确性,同时还有利于节省功耗。In an embodiment of the present application, a detection unit with lower power consumption is kept open, and a computing unit with higher power consumption is awakened by the detection unit to perform precise detection. This not only ensures the detection accuracy of the environmental safety detection function, but also helps to save power consumption.
在一种可能的实施方式中,所述第二环境数据包括所述第一环境数据和基于所述第一环境数据得到的数据处理结果,所述第一环境数据包括感知数据和振动信号,所述数据处理结果包括所述移动对象的疑似所在区域,所述移动对象的疑似所在区域基于所述感知数据确定;In one possible implementation, the second environmental data includes the first environmental data and a data processing result obtained based on the first environmental data, the first environmental data includes perception data and a vibration signal, the data processing result includes a suspected area where the mobile object is located, and the suspected area where the mobile object is located is determined based on the perception data;
所述计算单元基于所述第二环境数据确定是否生成告警信息,包括:The calculating unit determines whether to generate warning information based on the second environment data, including:
所述计算单元基于所述感知数据和所述移动对象的疑似所在区域确定目标移动对象;The computing unit determines a target mobile object based on the sensing data and the suspected area where the mobile object is located;
所述计算单元在所述目标移动对象与所述车辆之间的距离小于或者等于距离阈值,和/或,所述车辆的振动强度大于或者等于第二振动阈值的情况下,生成告警信息;The calculation unit generates warning information when the distance between the target mobile object and the vehicle is less than or equal to a distance threshold, and/or when the vibration intensity of the vehicle is greater than or equal to a second vibration threshold;
所述计算单元在所述目标移动对象与所述车辆之间的距离大于距离阈值,且所述车辆的振动强度小于所述第二振动阈值的情况下,重新进入休眠状态;The computing unit re-enters a dormant state when the distance between the target mobile object and the vehicle is greater than a distance threshold and the vibration intensity of the vehicle is less than the second vibration threshold;
其中,所述车辆的振动强度基于所述振动信号确定。Wherein, the vibration intensity of the vehicle is determined based on the vibration signal.
在该种实现方式下,计算单元在检测到危险事件时,生成告警信息,可及时提醒用户。在未检测到危险事件时,再次进入休眠状态,有利于降低功耗。In this implementation, when the computing unit detects a dangerous event, it generates an alarm message to promptly alert the user. When no dangerous event is detected, it enters the sleep state again, which is beneficial to reducing power consumption.
在一种可能的实施方式中,所述计算单元基于所述感知数据和所述移动对象的疑似所在区域确定目标移动对象,包括:In a possible implementation, the computing unit determines the target moving object based on the perception data and the suspected area where the moving object is located, including:
所述计算单元根据所述感知数据确定至少一个感兴趣对象所在的区域;The computing unit determines a region where at least one object of interest is located based on the sensing data;
所述计算单元根据所述至少一个感兴趣对象所在的区域和所述移动对象的疑似所在区域,确定所述目标移动对象;The calculation unit determines the target moving object according to the area where the at least one object of interest is located and the suspected area where the moving object is located;
其中,所述至少一个感兴趣对象包括所述目标移动对象,所述目标移动对象所在的区域与所述移动对象的疑似所在区域的重叠度大于或者等于预设重叠度阈值。The at least one object of interest includes the target moving object, and the degree of overlap between the area where the target moving object is located and the area where the moving object is suspected to be located is greater than or equal to a preset overlap threshold.
在该种实现方式下,计算单元根据接收到的信息以及自身基于更精准的检测算法确定的信息,融合处理得到目标移动对象,可提高检测准确性。In this implementation, the computing unit fuses the received information with the information determined by itself based on a more accurate detection algorithm to obtain the target moving object, thereby improving detection accuracy.
在一种可能的实施方式中,所述告警信息包括目标告警级别,所述目标告警级别为多个告警级别中的一项,所述多个告警级别用于指示告警信息的严重程度;In a possible implementation, the alarm information includes a target alarm level, where the target alarm level is one of multiple alarm levels, and the multiple alarm levels are used to indicate the severity of the alarm information;
在所述目标移动对象与所述车辆之间的距离小于或者等于距离阈值,或者,所述目标移动对象与所述车辆之间的距离小于或者等于所述距离阈值且所述车辆的振动强度小于所述第二振动阈值的情况下,所述目标告警级别为第一告警级别;When the distance between the target moving object and the vehicle is less than or equal to a distance threshold, or when the distance between the target moving object and the vehicle is less than or equal to the distance threshold and the vibration intensity of the vehicle is less than the second vibration threshold, the target warning level is the first warning level;
在所述车辆的振动强度大于或者等于振动阈值,或者,所述目标移动对象与所述车辆之间的距离小于或者等于所述距离阈值且所述车辆的振动强度大于或者等于所述第二振动阈值的情况下,所述目标告警级别为第二告警级别。When the vibration intensity of the vehicle is greater than or equal to a vibration threshold, or when the distance between the target mobile object and the vehicle is less than or equal to the distance threshold and the vibration intensity of the vehicle is greater than or equal to the second vibration threshold, the target warning level is the second warning level.
在该种实现方式下,通过设置不同的告警级别,可指示不同的告警严重程度,其同时还反映了车辆发生危险事件的严重程度,有利于及时提醒车主查看。In this implementation mode, by setting different warning levels, different warning severity levels can be indicated. It also reflects the severity of dangerous events occurring in the vehicle, which is conducive to timely reminding the owner to check.
在一种可能的实施方式中,所述方法还包括:In one possible implementation, the method further includes:
所述计算单元向控制单元发送第三唤醒信号和所述告警信息,所述告警信息包括目标告警级别。The computing unit sends a third wake-up signal and the alarm information to the control unit, where the alarm information includes a target alarm level.
在一种可能的实施方式中,所述方法还包括:In one possible implementation, the method further includes:
在所述目标告警级别为第一告警级别的情况下,所述计算单元通过显示设备显示第一告警提示信息;When the target alarm level is the first alarm level, the computing unit displays the first alarm prompt information through the display device;
在所述目标告警级别为第二告警级别的情况下,所述计算单元向用户终端发送第二告警提示信息。When the target alarm level is the second alarm level, the calculation unit sends second alarm prompt information to the user terminal.
在该种实现方式下,不同的告警级别对应不同的提示方式,这样可以反映车辆发生危险事件的严重程度,有利于及时提醒车主查看。In this implementation, different warning levels correspond to different prompting methods, which can reflect the severity of dangerous events occurring in the vehicle and help to remind the owner to check in time.
在一种可能的实施方式中,所述方法还包括:In one possible implementation, the method further includes:
所述计算单元保存所述告警信息关联的视频图像数据,所述视频图像数据通过视觉系传感器采集得到;或者,The computing unit stores the video image data associated with the alarm information, wherein the video image data is acquired by a visual sensor; or
所述计算单元保存所述告警信息关联的视频图像数据,并在保存所述告警信息关联的视频图像数据之后,重新进入休眠状态。The computing unit saves the video image data associated with the alarm information, and re-enters the dormant state after saving the video image data associated with the alarm information.
在该种实现方式下,通过对有效视频进行落盘,可为车主后续举证提供材料。除此之外,在视频落盘之后再次进入休眠状态,可节省功耗。In this implementation, by saving the valid video to disk, the car owner can provide evidence for subsequent evidence collection. In addition, after the video is saved, the device goes back to sleep, saving power.
在一种可能的实施方式中,所述方法还包括:In one possible implementation, the method further includes:
所述计算单元在生成所述告警信息后的第一时长内,未接收到来自所述检测单元的第二环境数据的情况下,重新进入休眠状态。The computing unit re-enters the dormant state if it does not receive the second environmental data from the detecting unit within a first period of time after generating the alarm information.
在该种实现方式下,计算单元可以在没有检测需求时,重新进入休眠状态,以节省功耗,有利于提高用户满意度。In this implementation, the computing unit can re-enter the dormant state when there is no detection demand, so as to save power consumption and improve user satisfaction.
第三方面,本申请实施例提供了一种环境检测方法,该方法可以由控制单元执行。该控制单元可以是设备,也可以是用于设备的芯片(系统)或电路,本申请对此不作限定。在该方法中,控制单元接收来自计算单元的第三唤醒信号和告警信息,进而控制单元可以在唤醒后基于告警信息进行告警提示。其中,该告警信息包括目标告警级别。On the third aspect, an embodiment of the present application provides an environment detection method, which can be performed by a control unit. The control unit can be a device, or a chip (system) or circuit for a device, which is not limited in this application. In this method, the control unit receives a third wake-up signal and alarm information from the computing unit, and then the control unit can issue an alarm prompt based on the alarm information after waking up. Among them, the alarm information includes a target alarm level.
在本申请实施例中,控制单元可以在有告警提示需求的情况下进行唤醒,这样有利于降低功耗。In an embodiment of the present application, the control unit can be awakened when there is an alarm prompt requirement, which is helpful in reducing power consumption.
在一种可能的实施方式中,所述控制单元根据所述告警信息进行告警提示,包括:In a possible implementation, the control unit issues an alarm prompt according to the alarm information, including:
在所述目标告警级别为第一告警级别的情况下,所述控制单元通过显示设备显示第一告警提示信息;When the target alarm level is the first alarm level, the control unit displays the first alarm prompt information through the display device;
在所述目标告警级别为第二告警级别的情况下,所述控制单元向用户终端发送第二告警提示信息。When the target alarm level is the second alarm level, the control unit sends second alarm prompt information to the user terminal.
在该种实现方式下,不同的告警级别对应不同的提示方式,这样可以反映车辆发生危险事件的严重程度,有利于及时提醒车主查看。In this implementation, different warning levels correspond to different prompting methods, which can reflect the severity of dangerous events occurring in the vehicle and help to remind the owner to check in time.
在一种可能的实施方式中,所述方法还包括:In one possible implementation, the method further includes:
所述控制单元保存所述告警信息关联的视频图像数据,所述视频图像数据通过视觉系传感器采集得到;或者,The control unit stores the video image data associated with the alarm information, wherein the video image data is acquired by a visual sensor; or
所述控制单元保存所述告警信息关联的视频图像数据,并在保存所述告警信息关联的视频图像数据之后,重新进入休眠状态。The control unit saves the video image data associated with the alarm information, and re-enters the dormant state after saving the video image data associated with the alarm information.
在该种实现方式下,通过对有效视频进行落盘,可为车主后续举证提供材料。除此之外,在视频落盘之后再次进入休眠状态,可节省功耗。In this implementation, by saving the valid video to disk, the car owner can provide evidence for subsequent evidence collection. In addition, after the video is saved, the device goes back to sleep, saving power.
第四方面,本申请实施例提供了一种环境检测方法,该方法中,检测单元在车辆处于驻车状态时,获取第一环境数据并根据所述第一环境数据进行环境检测。在所述检测单元在检测到第一触发事件时,向计算单元发送第一唤醒信号和发送第二环境数据,进而计算单元可以在唤醒后,基于所述第二环境数据确定是否生成告警信息。其中,所述第二环境数据包括所述第一环境数据和/或基于所述第一环境数据得到的数据处理结果,在所述车辆处于驻车状态时,所述检测单元处于被供电状态,在接收到所述第一唤醒信号前,所述计算单元处于休眠状态。In a fourth aspect, an embodiment of the present application provides an environmental detection method, in which a detection unit obtains first environmental data and performs environmental detection based on the first environmental data when the vehicle is in a parking state. When the detection unit detects a first trigger event, it sends a first wake-up signal and second environmental data to the computing unit, and then the computing unit can determine whether to generate an alarm message based on the second environmental data after waking up. The second environmental data includes the first environmental data and/or a data processing result obtained based on the first environmental data. When the vehicle is in a parking state, the detection unit is in a powered state, and before receiving the first wake-up signal, the computing unit is in a dormant state.
在一种可能的实施方式中,所述检测单元的功耗低于所述计算单元被唤醒后工作时的功耗。In a possible implementation, the power consumption of the detection unit is lower than the power consumption of the calculation unit when it is awakened and working.
在一种可能的实施方式中,所述第一环境数据包括来自加速度传感器的振动信号;In a possible implementation, the first environmental data includes a vibration signal from an acceleration sensor;
所述方法还包括:The method further comprises:
所述检测单元在所述振动信号超过第一振动阈值时,确定检测到所述第一触发事件。The detection unit determines that the first trigger event is detected when the vibration signal exceeds a first vibration threshold.
在一种可能的实施方式中,所述第一环境数据包括来自环境感知传感器的感知数据;In a possible implementation, the first environmental data includes perception data from an environmental perception sensor;
所述方法还包括:The method further comprises:
所述检测单元根据所述感知数据确定所述车辆周围是否存在移动对象;The detection unit determines whether there is a moving object around the vehicle based on the perception data;
所述检测单元在确定所述车辆周围存在移动对象的情况下,确定检测到第一触发事件。The detection unit determines that a first trigger event is detected when it is determined that a moving object exists around the vehicle.
在一种可能的实施方式中,所述检测单元包括感知数据处理模块和振动信号处理模块;所述第一环境数据包括来自加速度传感器的振动信号和来自环境感知传感器的感知数据;In a possible implementation, the detection unit includes a perception data processing module and a vibration signal processing module; the first environmental data includes a vibration signal from an acceleration sensor and perception data from an environmental perception sensor;
所述方法还包括:The method further comprises:
所述振动信号处理模块在所述振动信号超过第一振动阈值的情况下,向所述感知数据处理模块发送第二唤醒信号;The vibration signal processing module sends a second wake-up signal to the perception data processing module when the vibration signal exceeds the first vibration threshold;
所述感知数据处理模块根据所述感知数据确定所述车辆周围是否存在移动对象;The perception data processing module determines whether there is a moving object around the vehicle based on the perception data;
所述感知数据处理模块在确定所述车辆周围存在移动对象的情况下,确定检测到第一触发事件;The perception data processing module determines that a first trigger event is detected when it is determined that there is a moving object around the vehicle;
其中,在接收到所述第二唤醒信号之前,所述感知数据处理模块处于休眠状态。Before receiving the second wake-up signal, the perception data processing module is in a dormant state.
在一种可能的实施方式中,所述第二环境数据包括所述第一环境数据和基于所述第一环境数据得到的数据处理结果,所述第一环境数据包括感知数据和振动信号,所述数据处理结果包括所述移动对象的疑似所在区域,所述移动对象的疑似所在区域基于所述感知数据确定;In one possible implementation, the second environmental data includes the first environmental data and a data processing result obtained based on the first environmental data, the first environmental data includes perception data and a vibration signal, the data processing result includes a suspected area where the mobile object is located, and the suspected area where the mobile object is located is determined based on the perception data;
所述计算单元基于所述第二环境数据确定是否生成告警信息,包括:The calculating unit determines whether to generate warning information based on the second environment data, including:
所述计算单元基于所述感知数据和所述移动对象的疑似所在区域确定目标移动对象;The computing unit determines a target mobile object based on the sensing data and the suspected area where the mobile object is located;
所述计算单元在所述目标移动对象与所述车辆之间的距离小于或者等于距离阈值,和/或,所述车辆的振动强度大于或者等于第二振动阈值的情况下,生成告警信息;The calculation unit generates warning information when the distance between the target mobile object and the vehicle is less than or equal to a distance threshold, and/or when the vibration intensity of the vehicle is greater than or equal to a second vibration threshold;
所述计算单元在所述目标移动对象与所述车辆之间的距离大于距离阈值,且所述车辆的振动强度小于所述第二振动阈值的情况下,重新进入休眠状态;The computing unit re-enters a dormant state when the distance between the target mobile object and the vehicle is greater than a distance threshold and the vibration intensity of the vehicle is less than the second vibration threshold;
其中,所述车辆的振动强度基于所述振动信号确定。Wherein, the vibration intensity of the vehicle is determined based on the vibration signal.
在一种可能的实施方式中,所述计算单元基于所述感知数据和所述移动对象的疑似所在区域确定目标移动对象,包括:In a possible implementation, the computing unit determines the target moving object based on the perception data and the suspected area where the moving object is located, including:
所述计算单元根据所述感知数据确定至少一个感兴趣对象所在的区域;The computing unit determines a region where at least one object of interest is located based on the sensing data;
所述计算单元根据所述至少一个感兴趣对象所在的区域和所述移动对象的疑似所在区域,确定所述目标移动对象;The calculation unit determines the target moving object according to the area where the at least one object of interest is located and the suspected area where the moving object is located;
其中,所述至少一个感兴趣对象包括所述目标移动对象,所述目标移动对象所在的区域与所述移动对象的疑似所在区域的重叠度大于或者等于预设重叠度阈值。The at least one object of interest includes the target moving object, and the degree of overlap between the area where the target moving object is located and the area where the moving object is suspected to be located is greater than or equal to a preset overlap threshold.
在一种可能的实施方式中,所述告警信息包括目标告警级别,所述目标告警级别为多个告警级别中的一项,所述多个告警级别用于指示告警信息的严重程度;In a possible implementation, the alarm information includes a target alarm level, where the target alarm level is one of multiple alarm levels, and the multiple alarm levels are used to indicate the severity of the alarm information;
在所述目标移动对象与所述车辆之间的距离小于或者等于距离阈值,或者,所述目标移动对象与所述车辆之间的距离小于或者等于所述距离阈值且所述车辆的振动强度小于所述第二振动阈值的情况下,所述目标告警级别为第一告警级别;When the distance between the target moving object and the vehicle is less than or equal to a distance threshold, or when the distance between the target moving object and the vehicle is less than or equal to the distance threshold and the vibration intensity of the vehicle is less than the second vibration threshold, the target warning level is the first warning level;
在所述车辆的振动强度大于或者等于振动阈值,或者,所述目标移动对象与所述车辆之间的距离小于或者等于所述距离阈值且所述车辆的振动强度大于或者等于所述第二振动阈值的情况下,所述目标告警级别为第二告警级别。When the vibration intensity of the vehicle is greater than or equal to a vibration threshold, or when the distance between the target mobile object and the vehicle is less than or equal to the distance threshold and the vibration intensity of the vehicle is greater than or equal to the second vibration threshold, the target warning level is the second warning level.
在一种可能的实施方式中,所述方法还包括:In one possible implementation, the method further includes:
所述计算单元向控制单元发送第三唤醒信号和所述告警信息,所述告警信息包括目标告警级别;The computing unit sends a third wake-up signal and the alarm information to the control unit, where the alarm information includes a target alarm level;
所述控制单元根据所述告警信息进行告警提示。The control unit issues an alarm prompt according to the alarm information.
在一种可能的实施方式中,所述控制单元根据所述告警信息进行告警提示,包括:In a possible implementation, the control unit issues an alarm prompt according to the alarm information, including:
在所述目标告警级别为第一告警级别的情况下,所述控制单元通过显示设备显示第一告警提示信息;When the target alarm level is the first alarm level, the control unit displays the first alarm prompt information through the display device;
在所述目标告警级别为第二告警级别的情况下,所述控制单元向用户终端发送第二告警提示信息。When the target alarm level is the second alarm level, the control unit sends second alarm prompt information to the user terminal.
在一种可能的实施方式中,所述方法还包括:In one possible implementation, the method further includes:
所述控制单元保存所述告警信息关联的视频图像数据,所述视频图像数据通过视觉系传感器采集得到;或者,The control unit stores the video image data associated with the alarm information, wherein the video image data is acquired by a visual sensor; or
所述控制单元保存所述告警信息关联的视频图像数据,并在保存所述告警信息关联的视频图像数据之后,重新进入休眠状态。The control unit saves the video image data associated with the alarm information, and re-enters the dormant state after saving the video image data associated with the alarm information.
在一种可能的实施方式中,所述方法还包括:In one possible implementation, the method further includes:
在所述目标告警级别为第一告警级别的情况下,所述计算单元通过显示设备显示第一告警提示信息;When the target alarm level is the first alarm level, the computing unit displays the first alarm prompt information through the display device;
在所述目标告警级别为第二告警级别的情况下,所述计算单元向用户终端发送第二告警提示信息。When the target alarm level is the second alarm level, the calculation unit sends second alarm prompt information to the user terminal.
在一种可能的实施方式中,所述方法还包括:In one possible implementation, the method further includes:
所述计算单元保存所述告警信息关联的视频图像数据,所述视频图像数据通过视觉系传感器采集得到;或者,The computing unit stores the video image data associated with the alarm information, wherein the video image data is acquired by a visual sensor; or
所述计算单元保存所述告警信息关联的视频图像数据,并在保存所述告警信息关联的视频图像数据之后,重新进入休眠状态。The computing unit saves the video image data associated with the alarm information, and re-enters the dormant state after saving the video image data associated with the alarm information.
在一种可能的实施方式中,所述方法还包括:In one possible implementation, the method further includes:
所述计算单元在生成所述告警信息后的第一时长内,未接收到来自所述检测单元的第二环境数据的情况下,重新进入休眠状态。The computing unit re-enters the dormant state if it does not receive the second environmental data from the detecting unit within a first period of time after generating the alarm information.
关于第四方面以及任一项可能的实施方式所带来的技术效果,可参考对应于第一方面~第三方面以及相应的实施方式的技术效果的介绍。Regarding the technical effects brought about by the fourth aspect and any possible implementation method, reference may be made to the introduction of the technical effects corresponding to the first to third aspects and the corresponding implementation methods.
第五方面,本申请实施例提供了一种环境检测装置,该环境检测装置可以是检测单元,该检测单元包括用于执行如第一方面任一项所述方法的模块或单元。In a fifth aspect, an embodiment of the present application provides an environment detection device, which may be a detection unit including a module or unit for executing the method as described in any one of the first aspects.
在一种可能的设计中,该检测单元包括:In one possible design, the detection unit includes:
处理单元,用于在车辆处于驻车状态时,获取第一环境数据并根据所述第一环境数据进行环境检测;a processing unit, configured to obtain first environmental data and perform environmental detection based on the first environmental data when the vehicle is in a parked state;
收发单元,用于在检测到第一触发事件时,向计算单元发送第一唤醒信号和发送第二环境数据,所述第二环境数据包括所述第一环境数据和/或基于所述第一环境数据得到的数据处理结果;a transceiver unit, configured to send a first wake-up signal and second environment data to the computing unit when a first trigger event is detected, where the second environment data includes the first environment data and/or a data processing result obtained based on the first environment data;
其中,在所述车辆处于驻车状态时,所述检测单元处于被供电状态,在接收到所述第一唤醒信号前,所述计算单元处于休眠状态。Wherein, when the vehicle is in a parking state, the detection unit is in a powered state, and before receiving the first wake-up signal, the calculation unit is in a dormant state.
在一种可能的实施方式中,所述检测单元的功耗低于所述计算单元被唤醒后工作时的功耗。In a possible implementation, the power consumption of the detection unit is lower than the power consumption of the calculation unit when it is awakened and working.
在一种可能的实施方式中,所述第一环境数据包括来自加速度传感器的振动信号;In a possible implementation, the first environmental data includes a vibration signal from an acceleration sensor;
所述根据所述第一环境数据进行环境检测时,所述处理单元用于:When performing environmental detection according to the first environmental data, the processing unit is configured to:
在所述振动信号超过第一振动阈值时,确定检测到所述第一触发事件。When the vibration signal exceeds a first vibration threshold, it is determined that the first trigger event is detected.
在一种可能的实施方式中,所述第一环境数据包括来自环境感知传感器的感知数据;In a possible implementation, the first environmental data includes perception data from an environmental perception sensor;
所述根据所述第一环境数据进行环境检测时,所述处理单元用于:When performing environmental detection according to the first environmental data, the processing unit is configured to:
根据所述感知数据确定所述车辆周围是否存在移动对象;determining whether there is a moving object around the vehicle based on the perception data;
在确定所述车辆周围存在移动对象的情况下,确定检测到第一触发事件。In a case where it is determined that there is a moving object around the vehicle, it is determined that a first triggering event is detected.
在一种可能的实施方式中,所述处理单元包括感知数据处理模块和振动信号处理模块;所述第一环境数据包括来自加速度传感器的振动信号和来自环境感知传感器的感知数据;In a possible implementation, the processing unit includes a perception data processing module and a vibration signal processing module; the first environmental data includes a vibration signal from an acceleration sensor and perception data from an environmental perception sensor;
所述根据所述第一环境数据进行环境检测时:When performing environmental detection according to the first environmental data:
所述振动信号处理模块,用于在检测到所述振动信号超过第一振动阈值的情况下,向所述感知数据处理模块发送第二唤醒信号;The vibration signal processing module is configured to send a second wake-up signal to the perception data processing module when detecting that the vibration signal exceeds a first vibration threshold;
所述感知数据处理模块,用于根据所述感知数据确定所述车辆周围是否存在移动对象;The perception data processing module is used to determine whether there is a moving object around the vehicle based on the perception data;
所述感知数据处理模块,用于在确定所述车辆周围存在移动对象的情况下,确定检测到第一触发事件;The perception data processing module is configured to determine that a first trigger event is detected when it is determined that there is a moving object around the vehicle;
其中,在接收到所述第二唤醒信号之前,所述感知数据处理模块处于休眠状态。Before receiving the second wake-up signal, the perception data processing module is in a dormant state.
第六方面,本申请实施例提供了一种环境检测装置,该环境检测装置可以是计算单元,该计算单元包括用于执行如第二方面任一项所述方法的模块或单元。In a sixth aspect, an embodiment of the present application provides an environment detection device, which may be a computing unit including a module or unit for executing the method as described in any one of the second aspects.
在一种可能的设计中,该计算单元包括:In one possible design, the computing unit includes:
收发单元,用于接收来自检测单元的第一唤醒信号和第二环境数据,所述第二环境数据包括所述第一环境数据和/或基于所述第一环境数据得到的数据处理结果;a transceiver unit, configured to receive a first wake-up signal and second environment data from the detection unit, where the second environment data includes the first environment data and/or a data processing result obtained based on the first environment data;
处理单元,用于基于所述第二环境数据确定是否生成告警信息;a processing unit, configured to determine whether to generate alarm information based on the second environment data;
其中,在车辆处于驻车状态时,所述检测单元处于被供电状态,在接收到所述第一唤醒信号前,所述计算单元处于休眠状态。Wherein, when the vehicle is in a parking state, the detection unit is in a powered state, and before receiving the first wake-up signal, the calculation unit is in a dormant state.
在一种可能的实施方式中,所述检测单元的功耗低于所述计算单元被唤醒后工作时的功耗。In a possible implementation, the power consumption of the detection unit is lower than the power consumption of the calculation unit when it is awakened and working.
在一种可能的实施方式中,所述第二环境数据包括所述第一环境数据和基于所述第一环境数据得到的数据处理结果,所述第一环境数据包括感知数据和振动信号,所述数据处理结果包括所述移动对象的疑似所在区域,所述移动对象的疑似所在区域基于所述感知数据确定;In one possible implementation, the second environmental data includes the first environmental data and a data processing result obtained based on the first environmental data, the first environmental data includes perception data and a vibration signal, the data processing result includes a suspected area where the mobile object is located, and the suspected area where the mobile object is located is determined based on the perception data;
所述基于所述第二环境数据确定是否生成告警信息时,所述处理单元用于:When determining whether to generate alarm information based on the second environment data, the processing unit is configured to:
基于所述感知数据和所述移动对象的疑似所在区域确定目标移动对象;determining a target mobile object based on the sensing data and the suspected area where the mobile object is located;
在所述目标移动对象与所述车辆之间的距离小于或者等于距离阈值,和/或,所述车辆的振动强度大于或者等于第二振动阈值的情况下,生成告警信息;generating an alarm message when the distance between the target mobile object and the vehicle is less than or equal to a distance threshold, and/or when the vibration intensity of the vehicle is greater than or equal to a second vibration threshold;
在所述目标移动对象与所述车辆之间的距离大于距离阈值,且所述车辆的振动强度小于所述第二振动阈值的情况下,重新进入休眠状态;re-entering the dormant state when the distance between the target mobile object and the vehicle is greater than a distance threshold and the vibration intensity of the vehicle is less than the second vibration threshold;
其中,所述车辆的振动强度基于所述振动信号确定。Wherein, the vibration intensity of the vehicle is determined based on the vibration signal.
在一种可能的实施方式中,所述基于所述感知数据和所述移动对象的疑似所在区域确定目标移动对象时,所述处理单元用于:In a possible implementation, when determining the target moving object based on the perception data and the suspected area where the moving object is located, the processing unit is configured to:
根据所述感知数据确定至少一个感兴趣对象所在的区域;determining, based on the sensing data, an area where at least one object of interest is located;
根据所述至少一个感兴趣对象所在的区域和所述移动对象的疑似所在区域,确定所述目标移动对象;determining the target moving object according to the area where the at least one object of interest is located and the suspected area where the moving object is located;
其中,所述至少一个感兴趣对象包括所述目标移动对象,所述目标移动对象所在的区域与所述移动对象的疑似所在区域的重叠度大于或者等于预设重叠度阈值。The at least one object of interest includes the target moving object, and the degree of overlap between the area where the target moving object is located and the area where the moving object is suspected to be located is greater than or equal to a preset overlap threshold.
在一种可能的实施方式中,所述告警信息包括目标告警级别,所述目标告警级别为多个告警级别中的一项,所述多个告警级别用于指示告警信息的严重程度;In a possible implementation, the alarm information includes a target alarm level, where the target alarm level is one of multiple alarm levels, and the multiple alarm levels are used to indicate the severity of the alarm information;
在所述目标移动对象与所述车辆之间的距离小于或者等于距离阈值,或者,所述目标移动对象与所述车辆之间的距离小于或者等于所述距离阈值且所述车辆的振动强度小于所述第二振动阈值的情况下,所述目标告警级别为第一告警级别;When the distance between the target moving object and the vehicle is less than or equal to a distance threshold, or when the distance between the target moving object and the vehicle is less than or equal to the distance threshold and the vibration intensity of the vehicle is less than the second vibration threshold, the target warning level is the first warning level;
在所述车辆的振动强度大于或者等于振动阈值,或者,所述目标移动对象与所述车辆之间的距离小于或者等于所述距离阈值且所述车辆的振动强度大于或者等于所述第二振动阈值的情况下,所述目标告警级别为第二告警级别。When the vibration intensity of the vehicle is greater than or equal to a vibration threshold, or when the distance between the target mobile object and the vehicle is less than or equal to the distance threshold and the vibration intensity of the vehicle is greater than or equal to the second vibration threshold, the target warning level is the second warning level.
在一种可能的实施方式中,所述收发单元用于:In a possible implementation, the transceiver unit is configured to:
向控制单元发送第三唤醒信号和所述告警信息,所述告警信息包括目标告警级别。A third wake-up signal and the alarm information are sent to a control unit, where the alarm information includes a target alarm level.
在一种可能的实施方式中,所述处理单元用于:In a possible implementation, the processing unit is configured to:
在所述目标告警级别为第一告警级别的情况下,通过显示设备显示第一告警提示信息;When the target alarm level is the first alarm level, displaying the first alarm prompt information through the display device;
在所述目标告警级别为第二告警级别的情况下,向用户终端发送第二告警提示信息。When the target alarm level is the second alarm level, second alarm prompt information is sent to the user terminal.
在一种可能的实施方式中,所述装置还包括存储单元:In a possible implementation, the device further includes a storage unit:
所述存储单元,用于保存所述告警信息关联的视频图像数据,所述视频图像数据通过视觉系传感器采集得到;或者,The storage unit is used to store the video image data associated with the alarm information, wherein the video image data is acquired by a visual sensor; or
所述存储单元,用于保存所述告警信息关联的视频图像数据;The storage unit is used to store the video image data associated with the alarm information;
所述处理单元,用于在所述存储单元保存所述告警信息关联的视频图像数据之后,重新进入休眠状态。The processing unit is configured to re-enter a dormant state after the storage unit saves the video image data associated with the alarm information.
在一种可能的实施方式中,所述处理单元用于:In a possible implementation, the processing unit is configured to:
在生成所述告警信息后的第一时长内,未接收到来自所述检测单元的第二环境数据的情况下,重新进入休眠状态。If no second environmental data is received from the detection unit within a first period of time after the alarm information is generated, the system re-enters the dormant state.
第七方面,本申请实施例提供了一种环境检测装置,该环境检测装置可以是控制单元,该控制单元包括用于执行如第三方面任一项所述方法的模块或单元。In a seventh aspect, an embodiment of the present application provides an environment detection device, which may be a control unit including a module or unit for executing the method as described in any one of the third aspects.
在一种可能的设计中,该控制单元包括:In one possible design, the control unit includes:
收发单元,用于接收来自计算单元的第三唤醒信号和告警信息,所述告警信息包括目标告警级别;a transceiver unit, configured to receive a third wake-up signal and alarm information from the computing unit, wherein the alarm information includes a target alarm level;
处理单元,用于根据所述告警信息进行告警提示。A processing unit is used to issue an alarm prompt based on the alarm information.
在一种可能的实施方式中,所述控制单元根据所述告警信息进行告警提示时,所述处理单元用于:In a possible implementation, when the control unit issues an alarm prompt based on the alarm information, the processing unit is configured to:
在所述目标告警级别为第一告警级别的情况下,通过显示设备显示第一告警提示信息;When the target alarm level is the first alarm level, displaying the first alarm prompt information through the display device;
在所述目标告警级别为第二告警级别的情况下,向用户终端发送第二告警提示信息。When the target alarm level is the second alarm level, second alarm prompt information is sent to the user terminal.
在一种可能的实施方式中,所述装置还包括存储单元:In a possible implementation, the device further includes a storage unit:
所述存储单元,用于保存所述告警信息关联的视频图像数据,所述视频图像数据通过视觉系传感器采集得到;或者,The storage unit is used to store the video image data associated with the alarm information, wherein the video image data is acquired by a visual sensor; or
所述存储单元,用于保存所述告警信息关联的视频图像数据;The storage unit is used to store the video image data associated with the alarm information;
所述处理单元,用于在所述存储单元保存所述告警信息关联的视频图像数据之后,重新进入休眠状态。The processing unit is configured to re-enter a dormant state after the storage unit saves the video image data associated with the alarm information.
关于第五方面~第七方面以及任一项可能的实施方式所带来的技术效果,可参考对应于第一方面~第三方面以及相应的实施方式的技术效果的介绍。Regarding the technical effects brought about by the fifth to seventh aspects and any possible implementation methods, reference may be made to the introduction of the technical effects corresponding to the first to third aspects and the corresponding implementation methods.
可选的,在上述第一方面至第三方面任一方面以及任一项可能的实施方式所述环境检测装置中:Optionally, in the environment detection device described in any one of the first to third aspects and any possible implementation manner:
在一种设计中,该环境检测装置为检测单元或计算单元或控制单元。当该环境检测装置为检测单元或计算单元或控制单元时,收发单元可以是收发器,或,输入/输出接口;处理单元可以是至少一个处理器。可选地,收发器可以为收发电路。可选地,输入/输出接口可以为输入/输出电路。In one design, the environment detection device is a detection unit, a computing unit, or a control unit. When the environment detection device is a detection unit, a computing unit, or a control unit, the transceiver unit may be a transceiver or an input/output interface; and the processing unit may be at least one processor. Alternatively, the transceiver may be a transceiver circuit. Alternatively, the input/output interface may be an input/output circuit.
在另一种设计中,该环境检测装置为用于检测单元或计算单元或控制单元中的芯片(系统)或电路。当该环境检测装置为用于检测单元或计算单元或控制单元中的芯片(系统)或电路时,收发单元可以是该芯片(系统)或电路上的通信接口(输入/输出接口)、接口电路、输出电路、输入电路、管脚或相关电路等;处理单元可以是至少一个处理器、处理电路或逻辑电路等。In another design, the environment detection device is a chip (system) or circuit used in a detection unit, a computing unit, or a control unit. When the environment detection device is a chip (system) or circuit used in a detection unit, a computing unit, or a control unit, the transceiver unit can be a communication interface (input/output interface), an interface circuit, an output circuit, an input circuit, a pin, or related circuits on the chip (system) or circuit; and the processing unit can be at least one processor, a processing circuit, or a logic circuit.
第八方面,本申请实施例提供一种环境检测装置,该环境检测装置包括处理器。该处理器与存储器耦合,可用于执行存储器中的指令,以实现上述第一方面至第三方面任一方面以及任一项可能的实施方式的方法。可选地,该环境检测装置还包括存储器。可选地,该环境检测装置还包括通信接口,处理器与通信接口耦合。In an eighth aspect, an embodiment of the present application provides an environment detection device, comprising a processor. The processor is coupled to a memory and can be configured to execute instructions in the memory to implement the method of any of the first to third aspects described above and any possible implementation method. Optionally, the environment detection device further comprises a memory. Optionally, the environment detection device further comprises a communication interface, and the processor is coupled to the communication interface.
第九方面,本申请实施例提供了一种环境检测装置,包括:逻辑电路和通信接口。所述通信接口,用于接收信息或者发送信息;所述逻辑电路,用于通过所述通信接口接收信息或者发送信息,使得所述环境检测装置执行上述第一方面至第三方面任一方面以及任一项可能的实施方式的方法。In a ninth aspect, embodiments of the present application provide an environment detection device, comprising: a logic circuit and a communication interface. The communication interface is configured to receive or send information; the logic circuit is configured to receive or send information via the communication interface, so that the environment detection device executes the method of any of the first to third aspects and any possible implementation thereof.
第十方面,本申请实施例提供一种计算机可读存储介质,所述计算机可读存储介质用于存储计算机程序(也可以称为代码,或指令);当所述计算机程序在计算机上运行时,使得上述第一方面至第三方面任一方面以及任一项可能的实施方式的方法被实现。In the tenth aspect, an embodiment of the present application provides a computer-readable storage medium, which is used to store a computer program (also referred to as code, or instructions); when the computer program is run on a computer, the method of any one of the above-mentioned first to third aspects and any possible implementation method is implemented.
第十一方面,本申请实施例提供一种计算机程序产品,所述计算机程序产品包括:计算机程序(也可以称为代码,或指令);当所述计算机程序被运行时,使得计算机执行上述第一方面至第三方面任一方面以及任一项可能的实施方式的方法。In the eleventh aspect, an embodiment of the present application provides a computer program product, which includes: a computer program (also referred to as code, or instructions); when the computer program is run, it enables the computer to execute any one of the above-mentioned first to third aspects and any possible implementation method.
第十二方面,本申请实施例提供一种芯片,该芯片包括处理器,所述处理器用于执行指令,当该处理器执行所述指令时,使得该芯片执行上述第一方面至第三方面任一方面以及任一项可能的实施方式的方法。可选的,该芯片还包括通信接口,所述通信接口用于接收信号或发送信号。In a twelfth aspect, an embodiment of the present application provides a chip, comprising a processor configured to execute instructions. When the processor executes the instructions, the chip performs the method of any one of the first to third aspects and any possible implementation methods described above. Optionally, the chip further comprises a communication interface configured to receive or send signals.
第十三方面,本申请实施例提供一种车辆,所述车辆包括至少一个如第五方面所述的检测单元,或第六方面所述的计算单元,或第七方面所述的控制单元。In the thirteenth aspect, an embodiment of the present application provides a vehicle, which includes at least one detection unit as described in the fifth aspect, or the computing unit as described in the sixth aspect, or the control unit as described in the seventh aspect.
第十四方面,本申请实施例提供一种系统,所述系统包括检测单元和计算单元,所述检测单元用于执行上述第一方面以及任一项可能的实施方式的方法,所述计算单元用于执行上述第二方面以及任一项可能的实施方式的方法。可选地,该系统还可以包括控制单元,所述控制单元用于执行上述第三方面以及任一项可能的实施方式的方法。In a fourteenth aspect, an embodiment of the present application provides a system, comprising a detection unit and a computing unit, wherein the detection unit is configured to execute the method of the first aspect and any possible implementation manner described above, and the computing unit is configured to execute the method of the second aspect and any possible implementation manner described above. Optionally, the system may further comprise a control unit configured to execute the method of the third aspect and any possible implementation manner described above.
此外,在执行上述第一方面至第三方面任一方面以及任一项可能的实施方式所述的方法的过程中,上述方法中有关发送信息和/或接收信息等的过程,可以理解为由处理器输出信息的过程,和/或,处理器接收输入的信息的过程。在输出信息时,处理器可以将信息输出给收发器(或者通信接口、或发送模块),以便由收发器进行发射。信息在由处理器输出之后,还可能需要进行其他的处理,然后才到达收发器。类似的,处理器接收输入的信息时,收发器(或者通信接口、或发送模块)接收信息,并将其输入处理器。更进一步的,在收发器收到该信息之后,该信息可能需要进行其他的处理,然后才输入处理器。In addition, in the process of executing the method described in any aspect of the first to third aspects and any possible implementation method, the process of sending information and/or receiving information in the above method can be understood as the process of the processor outputting information and/or the process of the processor receiving input information. When outputting information, the processor can output the information to the transceiver (or communication interface, or sending module) so that it can be transmitted by the transceiver. After the information is output by the processor, it may also need to undergo other processing before it reaches the transceiver. Similarly, when the processor receives input information, the transceiver (or communication interface, or sending module) receives the information and inputs it into the processor. Furthermore, after the transceiver receives the information, the information may need to undergo other processing before it is input into the processor.
基于上述原理,举例来说,前述方法中提及的发送信息可以理解为处理器输出信息。又例如,接收信息可以理解为处理器接收输入的信息。Based on the above principles, for example, the sending of information mentioned in the above method can be understood as the processor outputting information. For another example, the receiving of information can be understood as the processor receiving input information.
可选的,对于处理器所涉及的发射、发送和接收等操作,如果没有特殊说明,或者,如果未与其在相关描述中的实际作用或者内在逻辑相抵触,则均可以更加一般性的理解为处理器输出和接收、输入等操作。Optionally, for the operations such as transmission, sending and receiving involved in the processor, if there is no special explanation, or if they do not conflict with their actual functions or internal logic in the relevant description, they can be more generally understood as processor output, reception, input and other operations.
可选的,在执行上述第一方面至第三方面任一方面以及任一项可能的实施方式所述的方法的过程中,上述处理器可以是专门用于执行这些方法的处理器,也可以是通过执行存储器中的计算机指令来执行这些方法的处理器,例如通用处理器。上述存储器可以为非瞬时性(non-transitory)存储器,例如只读存储器(read only memory,ROM),其可以与处理器集成在同一块芯片上,也可以分别设置在不同的芯片上,本申请实施例对存储器的类型以及存储器与处理器的设置方式不做限定。Optionally, in the process of executing the method described in any aspect of the first to third aspects and any possible implementation method, the processor may be a processor specifically used to execute these methods, or a processor that executes these methods by executing computer instructions in a memory, such as a general-purpose processor. The memory may be a non-transitory memory, such as a read-only memory (ROM), which may be integrated with the processor on the same chip or may be separately provided on different chips. The embodiments of the present application do not limit the type of memory and the configuration of the memory and the processor.
在一种可能的实施方式中,上述至少一个存储器位于装置之外。In a possible implementation, the at least one memory is located outside the device.
在又一种可能的实施方式中,上述至少一个存储器位于装置之内。In yet another possible implementation, the at least one memory is located within the device.
在又一种可能的实施方式之中,上述至少一个存储器的部分存储器位于装置之内,另一部分存储器位于装置之外。In another possible implementation, part of the at least one memory is located inside the device, and another part of the memory is located outside the device.
本申请中,处理器和存储器还可能集成于一个器件中,即处理器和存储器还可以被集成在一起。In this application, the processor and the memory may also be integrated into one device, that is, the processor and the memory may also be integrated together.
图1是本申请实施例适用的一系统架构示意图;FIG1 is a schematic diagram of a system architecture applicable to an embodiment of the present application;
图2是本申请实施例适用的另一系统架构示意图;FIG2 is a schematic diagram of another system architecture applicable to an embodiment of the present application;
图3是本申请实施例提供的环境检测方法的一流程示意图;FIG3 is a flow chart of an environmental detection method provided in an embodiment of the present application;
图4是本申请实施例提供的目标移动对象的示意图;FIG4 is a schematic diagram of a target moving object provided in an embodiment of the present application;
图5是本申请实施例提供的环境检测过程的一示意图;FIG5 is a schematic diagram of an environmental detection process provided by an embodiment of the present application;
图6是本申请实施例提供的环境检测过程的另一示意图;FIG6 is another schematic diagram of the environmental detection process provided by an embodiment of the present application;
图7是本申请实施例提供的环境检测方法的另一流程示意图;FIG7 is another flow chart of the environmental detection method provided in an embodiment of the present application;
图8为本申请实施例提供的一种环境检测装置的结构示意图;FIG8 is a schematic structural diagram of an environment detection device provided in an embodiment of the present application;
图9为本申请实施例提供的另一种环境检测装置的结构示意图;FIG9 is a schematic structural diagram of another environment detection device provided in an embodiment of the present application;
图10为本申请实施例提供的一种芯片的结构示意图。FIG10 is a schematic diagram of the structure of a chip provided in an embodiment of the present application.
下面结合本申请实施例中的附图对本申请实施例进行描述。需要说明的是,本申请中,“示例性的”或“例如”等词用于表示作例子、例证或说明。本申请中被描述为“示例性的”或“例如”的任何实施例或设计方案不应被解释为比其他实施例或设计方案更优选或更具优势。确切而言,使用“示例性的”或“例如”等词旨在以具体方式呈现相关概念。The embodiments of the present application are described below in conjunction with the drawings in the embodiments of the present application. It should be noted that, in this application, words such as "exemplary" or "for example" are used to indicate examples, illustrations or explanations. Any embodiment or design described in this application as "exemplary" or "for example" should not be interpreted as being more preferred or more advantageous than other embodiments or designs. Specifically, the use of words such as "exemplary" or "for example" is intended to present related concepts in a concrete way.
本申请中实施例提到的“至少一个”是指一个或多个,“多个”是指两个或两个以上。“以下至少一项(个)”或其类似表达,是指的这些项中的任意组合,包括单项(个)或复数项(个)的任意组合。例如,a、b、或c中的至少一项(个),可以表示:a、b、c、(a和b)、(a和c)、(b和c)、或(a和b和c),其中a、b、c可以是单个,也可以是多个。“和/或”,描述关联对象的关联关系,表示可以存在三种关系,例如,A和/或B,可以表示:单独存在A、同时存在A和B、单独存在B这三种情况,其中A、B可以是单数或复数。字符“/”一般表示前后关联对象是一种“或”的关系。The “at least one” mentioned in the embodiments of this application refers to one or more, and “plurality” refers to two or more. “At least one of the following” or similar expressions refers to any combination of these items, including any combination of single items or plural items. For example, at least one of a, b, or c can represent: a, b, c, (a and b), (a and c), (b and c), or (a and b and c), where a, b, c can be single or multiple. “And/or” describes the association relationship of associated objects, indicating that three relationships can exist. For example, A and/or B can represent: A exists alone, A and B exist at the same time, and B exists alone, where A and B can be singular or plural. The character “/” generally indicates that the related objects before and after are in an “or” relationship.
以及,除非有相反的说明,本申请实施例使用“第一”、“第二”等序数词是用于对多个对象进行区分,不用于限定多个对象的顺序、时序、优先级或重要程度。例如,第一消息和第二消息,只是为了区分不同的消息类型,而并不是表示这两种消息的结构、重要程度等不同。Furthermore, unless otherwise indicated, ordinal numbers such as "first" and "second" in the embodiments of this application are used to distinguish between multiple objects and are not used to define the order, timing, priority, or importance of multiple objects. For example, the first message and the second message are only used to distinguish different message types and do not indicate differences in structure, importance, etc. between the two messages.
首先,对本申请中的部分用语进行解释说明,以便于本领域技术人员理解。First, some terms in this application are explained to facilitate understanding by those skilled in the art.
1、安全卫士功能1. Security Guard Function
安全卫士功能是指在车辆停放期间,通过车辆上的传感器探测车辆的安全情况,在确定车辆受到破坏、入侵等风险时,通知车主并记录相关环境信息的功能。The safety guard function refers to the function of detecting the safety status of the vehicle through sensors on the vehicle while the vehicle is parked. When it is determined that the vehicle is at risk of damage or intrusion, it notifies the owner and records relevant environmental information.
2、传感器2. Sensors
本申请实施例中涉及的传感器包括加速度传感器(或称振动传感器,震动传感器等)和环境感知传感器。其中环境感知传感器可以包含视觉系传感器和/或雷达系传感器等,不予限定。示例性地,视觉系传感器包括鱼眼、鹰眼、单目、双目、四路摄像头等,在此不做限制。雷达系传感器可以包含雷达(radio detection and ranging,Radar)、激光雷达(light detection and ranging,LiDAR)、毫米波雷达、超声波雷达等,在此不做限制。The sensors involved in the embodiments of the present application include acceleration sensors (also known as vibration sensors, shock sensors, etc.) and environmental perception sensors. The environmental perception sensors may include vision sensors and/or radar sensors, etc., without limitation. For example, vision sensors include fisheye, eagle eye, monocular, binocular, four-way cameras, etc., without limitation here. Radar sensors may include radar (radio detection and ranging, Radar), laser radar (light detection and ranging, LiDAR), millimeter wave radar, ultrasonic radar, etc., without limitation here.
在现实生活中,当驾驶员驻车并离车后,时常存在车辆被刮蹭或碰撞的情况。针对驾驶员离车后的汽车安全监控需求,推出了安全卫士功能。在安全卫士功能下,通过车辆上的传感器探测车辆的安全情况,并在发生预定义的事件后进行预警并记录感知的数据,可以帮助车主维护权益,减少车主损失。在相关技术,通常借助智能驾驶(简称智驾域)的传感器以及分析能力,实现安全卫士功能。由于复用了智能驾驶的算法模块,使得在运行安全卫士功能时需要运行智能驾驶的算法模块,导致算力消耗较高,电量消耗也较大。因此如何设计一种功耗低且检测准确性高的方案成为当前亟待解决的问题。In real life, when the driver parks and leaves the car, the vehicle is often scratched or collided. In response to the need for car safety monitoring after the driver leaves the car, the safety guard function has been introduced. Under the safety guard function, the safety of the vehicle is detected by sensors on the vehicle, and an early warning is issued and the sensed data is recorded after a predefined event occurs, which can help car owners maintain their rights and reduce their losses. In related technologies, the safety guard function is usually achieved with the help of sensors and analysis capabilities of intelligent driving (referred to as intelligent driving domain). Due to the reuse of the algorithm module of intelligent driving, it is necessary to run the algorithm module of intelligent driving when running the safety guard function, resulting in high computing power consumption and large power consumption. Therefore, how to design a solution with low power consumption and high detection accuracy has become an urgent problem to be solved.
基于此,本申请提出了一种环境检测方法,可以降低车辆功耗,有利于提升用户体验。Based on this, this application proposes an environmental detection method that can reduce vehicle power consumption and help improve user experience.
示例性地,请参见图1,图1是本申请实施例适用的一系统架构示意图。如图1所示,该系统包括移动数据中心(mobile data center,MDC)和座舱域控制器(cockpit domain controller,CDC)。该MDC包括四路摄像头,超声波雷达,加速度传感器,微控制单元(microcontroller unit,MCU),以及系统芯片(system on chip,SOC)等。其中SOC与四路摄像头连接,加速度传感器和超声波雷达与MCU连接,MCU与SOC连接。通过将轻量级的振动检测和雷达检测部署到MCU上,从而在安全卫士功能运行期间,SOC和CDC等高功耗部件不用常开。具体来说,MCU可以常开,并接收加速度传感器采集的振动信息进行振动检测或者接收雷达采集的雷达信号进行雷达检测。若MCU识别到可能对车辆造成威胁的振动或者有靠近车周围的物体,则唤醒SOC进行进一步精度更高的检测。SOC唤醒后,接收四路摄像头采集的视频数据流,以及MCU提供的振动和雷达检测信息,经过动帧检测、雷达检测、振动检测、人车人工智能(artificial intelligence,AI)检测等算法处理后,最终确定是否发生危险事件。若判断发生了对车辆造成危害的事件,则向CDC发送告警信息。除此之外,CDC可以将危险事件对应的视频进行落盘。应理解,MCU上部署的是轻量级的振动检测和雷达检测算法,由小电池(例如20AH)供电。For example, please refer to Figure 1, which is a schematic diagram of a system architecture applicable to an embodiment of the present application. As shown in Figure 1, the system includes a mobile data center (MDC) and a cockpit domain controller (CDC). The MDC includes four cameras, an ultrasonic radar, an accelerometer, a microcontroller unit (MCU), and a system on chip (SOC). The SOC is connected to the four cameras, the accelerometer and ultrasonic radar are connected to the MCU, and the MCU is connected to the SOC. By deploying lightweight vibration detection and radar detection on the MCU, high-power components such as the SOC and CDC do not need to be constantly on during the operation of the safety guard function. Specifically, the MCU can be constantly on and receive vibration information collected by the accelerometer for vibration detection or receive radar signals collected by the radar for radar detection. If the MCU identifies vibrations that may pose a threat to the vehicle or objects close to the vehicle, it wakes up the SOC for further, more accurate detection. After waking up, the SOC receives video data streams from four cameras, as well as vibration and radar detection information provided by the MCU. After processing using algorithms such as motion frame detection, radar detection, vibration detection, and human-vehicle artificial intelligence (AI) detection, it ultimately determines whether a dangerous event has occurred. If an event deemed hazardous to the vehicle has occurred, an alert is sent to the CDC. Furthermore, the CDC can save the video corresponding to the dangerous event to disk. It should be understood that the MCU deploys lightweight vibration and radar detection algorithms, powered by a small battery (e.g., 20AH).
再示例性地,请参见图2,图2是本申请实施例适用的另一系统架构示意图。如图2所示,该系统包括四路摄像头,超声波雷达,加速度传感器,自动泊车辅助(auto parking assist,APA),MCU以及CDC。其中APA与四路摄像头和超声波雷达连接,加速度传感器和MCU连接,APA和MCU均与CDC连接。通过将轻量级的振动检测部署在MCU上、以及将轻量级的视觉检测和雷达检测部署到APA上,从而在安全卫士功能运行期间,CDC等高功耗部件不用常开。具体来说,MCU常开获取加速度传感器采集的振动信号并检测,若检测到可能对车辆造成威胁的振动,则唤醒CDC进行进一步精度更高的检测。与此同时,APA也可以利用超声波雷达和四路摄像头采集的感知数据进行检测,在检测到车辆周围有靠近的物体时,同样可以唤醒CDC进行进一步精度更高的检测。CDC唤醒后,可以基于视觉系统对来自MCU和APA的数据进行动帧检测、雷达检测、振动检测、人车AI检测等,并通过融合处理系统对视觉系统的检测结果进行综合判断,若判断发生了对车辆造成危害的事件,则触发显示屏高亮告警并远程推送至用户手机中,最终有效视频存储系统落盘。应理解,APA及MCU均可以独立工作,APA上部署的是轻量级视觉检测、雷达检测等算法,MCU上部署的是轻量级的振动检测等算法,由小电池(例如20AH)供电。As another example, please refer to Figure 2, which is another system architecture diagram applicable to the embodiment of the present application. As shown in Figure 2, the system includes four cameras, ultrasonic radar, acceleration sensor, automatic parking assist (APA), MCU and CDC. The APA is connected to the four cameras and ultrasonic radar, the acceleration sensor is connected to the MCU, and both the APA and the MCU are connected to the CDC. By deploying lightweight vibration detection on the MCU, and deploying lightweight visual detection and radar detection on the APA, high-power components such as the CDC do not need to be constantly on during the operation of the safety guard function. Specifically, the MCU is constantly on to obtain and detect the vibration signal collected by the acceleration sensor. If a vibration that may pose a threat to the vehicle is detected, the CDC is awakened for further, more accurate detection. At the same time, the APA can also use the perception data collected by the ultrasonic radar and the four cameras for detection. When an approaching object is detected around the vehicle, the CDC can also be awakened for further, more accurate detection. After waking up, the CDC can perform motion frame detection, radar detection, vibration detection, and human-vehicle AI detection on data from the MCU and APA based on the visual system. The fusion processing system then makes a comprehensive judgment on the visual system's detection results. If it determines that an event has occurred that poses a threat to the vehicle, it triggers a highlighted alarm on the display and pushes it remotely to the user's mobile phone. Ultimately, the effective video storage system writes it to the disk. It should be understood that both the APA and the MCU can operate independently. The APA deploys lightweight algorithms such as visual detection and radar detection, while the MCU deploys lightweight algorithms such as vibration detection, powered by a small battery (e.g., 20AH).
需要说明的是,本申请中提及的“驻车”即车辆停止且挂入了驻车挡。可选地,驻车有时也可称为停车,本申请不予限定。除此之外,处于被供电状态也可以理解为处于工作状态。It should be noted that the "parking" mentioned in this application means that the vehicle is stopped and the parking gear is engaged. Optionally, parking can sometimes also be referred to as parking, which is not limited in this application. In addition, being in a powered state can also be understood as being in an operating state.
下面对本申请提供的环境检测方法及相关装置进行详细介绍:The following is a detailed introduction to the environmental detection method and related devices provided by this application:
请参见图3,图3是本申请实施例提供的环境检测方法的一流程示意图。如图3所示,该环境检测方法包括如下步骤S301~S303。图3所示的方法执行主体可以为车辆,或者,图3所示的方法执行主体也可以为车辆中部署了检测软件的芯片或车载部件等。示例性地,检测软件可以部署在车辆的CDC,MDC,APA,MCU等车载部件(或芯片)中,本申请对此不做限制。为方便描述,图3主要以车辆中部署了检测软件的车载部件为方法的执行主体为例进行说明,具体来说,车辆部件可以为检测单元,计算单元或控制单元等。需要说明的是,图3是本申请的方法实施例的示意性流程图,示出了该方法的详细的通信步骤或操作,但这些步骤或操作仅是示例,本申请实施例还可以执行其它操作或者图3中的各种操作的变形。此外,图3中的各个步骤可以分别按照与图3所呈现的不同的顺序来执行,并且有可能并非要执行图3中的全部操作。其中:Please refer to Figure 3, which is a flow chart of the environment detection method provided by an embodiment of the present application. As shown in Figure 3, the environment detection method includes the following steps S301 to S303. The execution subject of the method shown in Figure 3 can be a vehicle, or the execution subject of the method shown in Figure 3 can also be a chip or vehicle-mounted component in which the detection software is deployed in the vehicle. For example, the detection software can be deployed in the vehicle's CDC, MDC, APA, MCU and other vehicle-mounted components (or chips), and this application does not limit this. For the convenience of description, Figure 3 mainly uses the vehicle-mounted component in which the detection software is deployed in the vehicle as an example of the execution subject of the method. Specifically, the vehicle component can be a detection unit, a computing unit or a control unit. It should be noted that Figure 3 is a schematic flow chart of an embodiment of the method of the present application, showing the detailed communication steps or operations of the method, but these steps or operations are only examples. The embodiment of the present application can also perform other operations or variations of the various operations in Figure 3. In addition, the various steps in Figure 3 can be performed in a different order from that presented in Figure 3, and it is possible that not all operations in Figure 3 need to be performed. Among them:
S301、检测单元在车辆处于驻车状态时,获取第一环境数据并根据第一环境数据进行环境检测。S301 : When a vehicle is in a parking state, a detection unit obtains first environmental data and performs environmental detection according to the first environmental data.
在一些可行的实施方式中,当车辆处于驻车状态时,车辆上部署的传感器持续性采集车辆周围的第一环境数据,并将采集的第一环境数据发送给检测单元。相应地,当检测单元接收到来自传感器的第一环境数据后,可以基于获取的第一环境数据进行环境检测。其中,在车辆处于驻车状态时,检测单元处于被供电状态,在接收到第一唤醒信号前,计算单元处于休眠状态。此外所述检测单元的功耗低于所述计算单元被唤醒后工作时的功耗。In some feasible implementations, when the vehicle is in a parked state, sensors deployed on the vehicle continuously collect first environmental data around the vehicle and send the collected first environmental data to the detection unit. Accordingly, after the detection unit receives the first environmental data from the sensor, it can perform environmental detection based on the acquired first environmental data. Specifically, when the vehicle is in a parked state, the detection unit is in a powered state, and the computing unit is in a dormant state before receiving the first wake-up signal. In addition, the power consumption of the detection unit is lower than the power consumption of the computing unit when it is working after being awakened.
在一种可能的实现(一)中,如果采用的是如图1所示的系统架构,那么检测单元具体可以为MCU,与MCU相连的传感器可以包括加速度传感器和雷达系传感器,即加速度传感器和雷达系传感器与MCU具有通信连接。加速度传感器采集的第一环境数据为振动信号,雷达系传感器采集的第一环境数据为雷达信号。MCU可以根据振动信号确定车辆是否产生异常振动,或者,可以根据雷达信号确定车辆周围是否存在移动对象。具体来说,在振动信号指示的振动强度不小于第一振动阈值的情况下,可以确定车辆产生异常振动;在振动信号指示的振动强度小于第一振动阈值的情况下,可以确定车辆未产生异常振动。通过雷达检测判断是否有物体向车辆靠近,例如在基于雷达信号确定移动对象与车辆之间的距离小于或者等于某个距离阈值(为便于区分,后文称作第一距离阈值)时,可以判断车辆周围存在移动对象;在移动对象与车辆之间的距离大于第一距离阈值时,可判断车辆周围不存在移动对象。应理解,本申请实施例中所涉及的“等于”的情况所属的分支可根据实际情况确定,不予限定。In one possible implementation (I), if the system architecture shown in FIG1 is used, the detection unit can specifically be an MCU, and the sensors connected to the MCU can include an accelerometer and a radar sensor, that is, the accelerometer and the radar sensor have a communication connection with the MCU. The first environmental data collected by the accelerometer is a vibration signal, and the first environmental data collected by the radar sensor is a radar signal. The MCU can determine whether the vehicle is generating abnormal vibrations based on the vibration signal, or can determine whether there are moving objects around the vehicle based on the radar signal. Specifically, if the vibration intensity indicated by the vibration signal is not less than a first vibration threshold, it can be determined that the vehicle is generating abnormal vibrations; if the vibration intensity indicated by the vibration signal is less than the first vibration threshold, it can be determined that the vehicle is not generating abnormal vibrations. Radar detection can be used to determine whether an object is approaching the vehicle. For example, if the distance between the moving object and the vehicle is less than or equal to a certain distance threshold (hereinafter referred to as the first distance threshold for ease of distinction) determined based on the radar signal, it can be determined that there is a moving object around the vehicle; if the distance between the moving object and the vehicle is greater than the first distance threshold, it can be determined that there are no moving objects around the vehicle. It should be understood that the branch to which the "equal to" situation involved in the embodiments of the present application belongs can be determined according to actual circumstances and is not limited.
通常来说,如果MCU检测到异常振动和/或检测到存在移动对象靠近车辆,则认为检测到了第一触发事件。示例性地,移动对象可以是指处于移动状态的人,机动车,非机动车等,不予限定。Generally speaking, if the MCU detects abnormal vibration and/or detects the presence of a moving object approaching the vehicle, it is considered that a first trigger event has been detected. For example, the moving object may refer to a moving person, a motor vehicle, a non-motor vehicle, etc., without limitation.
在一种可能的实现(二)中,如果采用的是如图2所示的系统架构,那么检测单元具体可以包括MCU和/或APA,与MCU相连的传感器可以为加速度传感器,与APA相连的传感器可以包括环境感知传感器,这里环境感知传感器具体可以为视觉系传感器和/或雷达系传感器,为方便描述,后文以环境感知传感器包括视觉系传感器和雷达系传感器为例进行示意性说明。其中加速度传感器采集的第一环境数据为振动信号,环境感知传感器采集的第一环境数据为感知数据,例如视觉系传感器采集的视频图像数据和雷达系传感器采集的雷达信号均可以理解为感知数据。MCU可以根据振动信号确定车辆是否产生异常振动,APA可以根据雷达信号或视频图像数据确定车辆周围是否存在移动对象。具体来说,APA可以根据移动侦测算法对雷达信号或视频图像数据进行处理,以确定车辆周围是否存在移动对象。In one possible implementation (two), if the system architecture shown in Figure 2 is adopted, the detection unit may specifically include an MCU and/or an APA, the sensor connected to the MCU may be an acceleration sensor, and the sensor connected to the APA may include an environmental perception sensor, where the environmental perception sensor may specifically be a visual sensor and/or a radar sensor. For the convenience of description, the following text uses the environmental perception sensor including a visual sensor and a radar sensor as an example for schematic illustration. The first environmental data collected by the acceleration sensor is a vibration signal, and the first environmental data collected by the environmental perception sensor is perception data. For example, the video image data collected by the visual sensor and the radar signal collected by the radar sensor can be understood as perception data. The MCU can determine whether the vehicle has abnormal vibrations based on the vibration signal, and the APA can determine whether there are moving objects around the vehicle based on the radar signal or the video image data. Specifically, the APA can process the radar signal or the video image data according to the motion detection algorithm to determine whether there are moving objects around the vehicle.
S302、检测单元在检测到第一触发事件时,向计算单元发送第一唤醒信号和发送第二环境数据。相应地,计算单元接收来自检测单元的第一唤醒信号和第二环境数据。S302: When the detection unit detects a first trigger event, the detection unit sends a first wake-up signal and second environment data to the computing unit. Correspondingly, the computing unit receives the first wake-up signal and second environment data from the detection unit.
在一些可行的实施方式中,检测单元通过对第一环境数据进行环境检测,可以确定是否存在第一触发事件。通常来说,在确定车辆产生异常振动和/或车辆周围存在移动对象的情况下,可以确定检测到第一触发事件。因此,检测单元唤醒计算单元,并向计算单元发送第二环境数据,该第二环境数据包括第一环境数据和/或根据第一环境数据得到的数据处理结果。应理解,第一唤醒信号和第二环境数据可以是一起发给计算单元的,或者,也可以是分别发送给计算单元的,本申请不予限定。相应地,对于计算单元而言,第一唤醒信号和第二环境数据可以是一次性收到的,或者,也可以是分别收到的,本申请不予限定。此外,对于计算设备而言,计算设备通常需要先被唤醒,再接收第二环境数据。In some feasible implementations, the detection unit can determine whether a first trigger event exists by performing environmental detection on the first environmental data. Generally speaking, when it is determined that the vehicle generates abnormal vibrations and/or there are moving objects around the vehicle, it can be determined that the first trigger event has been detected. Therefore, the detection unit wakes up the computing unit and sends the second environmental data to the computing unit, and the second environmental data includes the first environmental data and/or the data processing result obtained based on the first environmental data. It should be understood that the first wake-up signal and the second environmental data can be sent to the computing unit together, or they can be sent to the computing unit separately, which is not limited in this application. Accordingly, for the computing unit, the first wake-up signal and the second environmental data can be received at one time, or they can be received separately, which is not limited in this application. In addition, for the computing device, the computing device usually needs to be woken up first and then receive the second environmental data.
示例性地,第二环境数据中包括的第一环境数据可以是指感知数据(例如视频图像数据,或雷达信号等中的一项或者多项)和振动信号等,数据处理结果包括移动对象的疑似所在区域。其中移动对象的疑似所在区域可以基于感知数据确定,例如检测单元可以基于动帧检测算法对视频图像数据进行处理,以确定移动对象的疑似所在区域;又例如,检测单元可以基于雷达检测算法对雷达信号进行处理,以确定移动对象的疑似所在区域。再例如,检测单元也可以将基于视频图像数据确定出的疑似区域和基于雷达信号确定出的疑似区域的并集区域确定为移动对象的疑似所在区域,本申请不予限定。Exemplarily, the first environmental data included in the second environmental data may refer to perception data (such as video image data, or one or more of radar signals, etc.) and vibration signals, etc., and the data processing result includes the suspected area where the moving object is located. The suspected area where the moving object is located can be determined based on the perception data. For example, the detection unit can process the video image data based on the motion frame detection algorithm to determine the suspected area where the moving object is located; for another example, the detection unit can process the radar signal based on the radar detection algorithm to determine the suspected area where the moving object is located. For another example, the detection unit can also determine the union area of the suspected area determined based on the video image data and the suspected area determined based on the radar signal as the suspected area where the moving object is located, which is not limited in this application.
在一种可能的实现(一)中,如果采用的是如图1所示的系统架构,那么计算单元可以是指SOC。也就是说,在MCU检测到车辆产生异常振动或车辆周围存在移动对象时,MCU可以唤醒SOC,并向SOC发送第二环境数据,例如第二环境数据可以包含振动信号。In one possible implementation (1), if the system architecture shown in Figure 1 is used, the computing unit may be the SOC. That is, when the MCU detects abnormal vibration of the vehicle or the presence of a moving object around the vehicle, the MCU may wake up the SOC and send second environmental data to the SOC. For example, the second environmental data may include a vibration signal.
在一种可能的实现(二)中,如果采用的是如图2所示的系统架构,那么计算单元可以是指CDC。也就是说,在MCU检测到车辆产生异常振动或APA检测到车辆周围存在移动对象时,MCU或APA均可以唤醒CDC,并向CDC发送第二环境数据,例如第二环境数据可以包括视频图像数据,振动信号,以及移动对象的疑似所在区域等。In one possible implementation (two), if the system architecture shown in Figure 2 is used, the computing unit may be a CDC. That is, when the MCU detects abnormal vibration of the vehicle or the APA detects the presence of a moving object around the vehicle, the MCU or APA may wake up the CDC and send second environmental data to the CDC. For example, the second environmental data may include video image data, vibration signals, and the suspected location of the moving object.
S303、计算单元基于第二环境数据确定是否生成告警信息。S303: The calculation unit determines whether to generate alarm information based on the second environment data.
如前述描述的,第二环境数据包括第一环境数据和根据第一环境数据得到的数据处理结果,其中第一环境数据包括感知数据(例如视频图像数据,雷达信号)和振动信号,数据处理结果包括移动对象的疑似所在区域。在一些可行的实施方式中,计算单元可以基于AI检测算法对视频图像数据进行处理,以确定是否存在感兴趣对象。在计算单元未检测出任何一个感兴趣对象的情况下,计算单元可以重新进入休眠状态;在计算单元检测出至少一个感兴趣对象的情况下,计算单元可以进一步根据该至少一个感兴趣对象所在的区域和移动对象的疑似所在区域,确定出目标移动对象。具体来说,当某个感兴趣对象所在的区域与移动对象的疑似所在区域的重叠度大于或者等于预设重叠度阈值时,可以认为该感兴趣对象为目标移动对象。其中感兴趣对象可以是指人,机动车,非机动车等,本申请对此不做限制。As described above, the second environmental data includes the first environmental data and the data processing results obtained based on the first environmental data, wherein the first environmental data includes perception data (such as video image data, radar signals) and vibration signals, and the data processing results include the suspected area where the moving object is located. In some feasible embodiments, the computing unit can process the video image data based on the AI detection algorithm to determine whether there is an object of interest. In the case that the computing unit does not detect any object of interest, the computing unit can re-enter the sleep state; in the case that the computing unit detects at least one object of interest, the computing unit can further determine the target moving object based on the area where the at least one object of interest is located and the suspected area where the moving object is located. Specifically, when the degree of overlap between the area where a certain object of interest is located and the suspected area where the moving object is located is greater than or equal to a preset overlap threshold, the object of interest can be considered to be the target moving object. The object of interest can refer to a person, a motor vehicle, a non-motor vehicle, etc., and this application does not impose any restrictions on this.
示例性地,请参见图4,图4是本申请实施例提供的目标移动对象的示意图。如图4所示,基于AI检测算法对视频图像数据进行处理,可以检测出4个感兴趣对象分别为感兴趣对象1,感兴趣对象2,感兴趣对象3和感兴趣对象4。其中,由于感兴趣对象1,感兴趣对象2和感兴趣对象3所在的区域与移动对象的疑似所在区域的重叠度均小于预设重叠度阈值,而感兴趣对象4所在的区域与移动对象的疑似所在区域的重叠度大于预设重叠度阈值,因此感兴趣对象4即为目标移动对象。For example, please refer to Figure 4, which is a schematic diagram of the target moving object provided in an embodiment of the present application. As shown in Figure 4, based on the AI detection algorithm, the video image data is processed to detect four objects of interest, namely object of interest 1, object of interest 2, object of interest 3, and object of interest 4. Among them, since the overlap between the areas where objects of interest 1, 2, and 3 are located and the suspected area where the moving object is located is less than the preset overlap threshold, and the overlap between the area where object of interest 4 is located and the suspected area where the moving object is located is greater than the preset overlap threshold, object of interest 4 is the target moving object.
可理解的,计算单元可以在目标移动对象与车辆之间的距离小于或者等于某个距离阈值(为便于区分,后文称作第二距离阈值),和/或,振动信号所指示的车辆的振动强度大于或者等于第二振动阈值的情况下,生成告警信息。而在目标移动对象与车辆之间的距离大于第二距离阈值,且车辆的振动强度小于第二振动阈值的情况下,计算单元重新进入休眠状态。通常来说,第一距离阈值大于第二距离阈值,第一振动阈值小于第二振动阈值。It is understandable that the computing unit can generate an alarm message when the distance between the target mobile object and the vehicle is less than or equal to a certain distance threshold (hereinafter referred to as the second distance threshold for ease of distinction) and/or when the vibration intensity of the vehicle indicated by the vibration signal is greater than or equal to the second vibration threshold. If the distance between the target mobile object and the vehicle is greater than the second distance threshold and the vibration intensity of the vehicle is less than the second vibration threshold, the computing unit re-enters the dormant state. Generally speaking, the first distance threshold is greater than the second distance threshold, and the first vibration threshold is less than the second vibration threshold.
可选地,告警信息中可以包括目标告警级别,该目标告警级别为多个告警级别中的一项,该多个告警级别用于指示告警信息的严重程度。例如多个告警级别包括第一告警级别和第二告警级别,其中第一告警级别低于第二告警级别。具体来说,在目标移动对象与车辆之间的距离小于或者等于第二距离阈值,或者,目标移动对象与车辆之间的距离小于或者等于第二距离阈值且车辆的振动强度小于第二振动阈值的情况下,目标告警级别为第一告警级别;在车辆的振动强度大于或者等于振动阈值,或者,目标移动对象与车辆之间的距离小于或者等于第二距离阈值且车辆的振动强度大于或者等于第二振动阈值的情况下,目标告警级别为第二告警级别。Optionally, the warning information may include a target warning level, which is one of a plurality of warning levels, and the plurality of warning levels are used to indicate the severity of the warning information. For example, the plurality of warning levels include a first warning level and a second warning level, wherein the first warning level is lower than the second warning level. Specifically, when the distance between the target moving object and the vehicle is less than or equal to the second distance threshold, or when the distance between the target moving object and the vehicle is less than or equal to the second distance threshold and the vibration intensity of the vehicle is less than the second vibration threshold, the target warning level is the first warning level; when the vibration intensity of the vehicle is greater than or equal to the vibration threshold, or when the distance between the target moving object and the vehicle is less than or equal to the second distance threshold and the vibration intensity of the vehicle is greater than or equal to the second vibration threshold, the target warning level is the second warning level.
在一种可能的实现(一)中,如果采用的是如图1所示的系统架构,那么计算单元可以是指SOC。也就是说,在MCU检测到车辆产生异常振动和/或车辆周围存在移动对象时,MCU可以唤醒SOC。SOC唤醒后,可以基于第二环境数据生成告警信息。可选地,SOC还可以唤醒控制单元(例如控制单元可以是指CDC),并向CDC发送告警信息。示例性地,SOC可以通过向CDC发送第三唤醒信号,以唤醒CDC。当CDC接收告警信息之后,可以根据告警信息进行告警提示。例如,在目标告警级别为第一告警级别的情况下,CDC可以通过车载的显示设备显示第一告警提示信息,例如在车载屏幕上高亮提示。在目标告警级别为第二告警级别的情况下,CDC可以向用户终端发送第二告警提示信息,可选地,CDC还可以向用户终端推送对应的视频图像数据,以便用户可以及时查看车辆状况。除此之外,CDC还可以保存告警信息关联的视频图像数据(或称将告警信息关联的视频图像数据落盘)。这里告警信息关联的视频图像数据可以理解为所有触发生成告警信息的视频图像数据。可选地,CDC保存告警信息关联的视频图像数据之后,CDC可以进入休眠状态。可选地,如果SOC在生成告警信息后的第一时长内,未接收到新的第二环境数据,那么SOC进入休眠状态。In one possible implementation (I), if the system architecture shown in Figure 1 is used, the computing unit may be a system-on-chip (SOC). That is, when the MCU detects abnormal vehicle vibration and/or the presence of moving objects around the vehicle, the MCU may wake up the SOC. After waking up, the SOC may generate an alarm based on the second environmental data. Optionally, the SOC may also wake up a control unit (e.g., a CDC) and send an alarm to the CDC. For example, the SOC may wake up the CDC by sending a third wake-up signal to the CDC. After receiving the alarm, the CDC may issue an alarm based on the alarm. For example, if the target alarm level is a first alarm level, the CDC may display the first alarm on an onboard display device, such as by highlighting the alarm on the onboard screen. If the target alarm level is a second alarm level, the CDC may send a second alarm to a user terminal. Optionally, the CDC may also push corresponding video image data to the user terminal so that the user can promptly check the vehicle's status. Furthermore, the CDC may save the video image data associated with the alarm (or write the video image data associated with the alarm to disk). The video image data associated with the alarm information here can be understood as all video image data that triggers the generation of the alarm information. Optionally, after the CDC saves the video image data associated with the alarm information, the CDC can enter a dormant state. Optionally, if the SOC does not receive new second environmental data within a first period of time after the alarm information is generated, the SOC enters a dormant state.
示例性地,上述实现(一)的实施过程可参考图5所示的流程,其中:S1、在车辆处于驻车状态时,获取振动信号进行振动检测,以及获取雷达信号进行雷达检测。S2、MCU在检测到第一触发事件时,向SOC发送第一唤醒信号和发送第二环境数据。S3、SOC基于第二环境数据确定是否生成告警信息。其中包括如下3种分支:分支一:在目标移动对象与车辆之间的距离小于或者等于第二距离阈值,但振动强度小于第二振动阈值的情况下,生成包含第一告警级别的告警信息;分支二:在目标移动对象与车辆之间的距离小于或者等于第二距离阈值,且振动强度大于或者等于第二振动阈值的情况下,生成包含第二告警级别的告警信息;分支三:在目标移动对象与车辆之间的距离大于第二距离阈值,且振动强度小于第二振动阈值的情况下,SOC进入休眠状态。S4、在生成告警信息的情况下,SOC向CDC发送告警信息。S5、CDC根据告警级别做出相应警示,并进行视频图像数据落盘。S6、SOC进入休眠状态。一般来说,如果SOC在生成告警信息后的第一时长内,未接收到新的第二环境数据,那么SOC进入休眠状态。S7、CDC进入休眠状态。一般来说,CDC保存告警信息关联的视频图像数据之后,CDC可以进入休眠状态。For example, the implementation process of implementation (1) above can refer to the process shown in Figure 5, where: S1. When the vehicle is parked, a vibration signal is acquired for vibration detection, and a radar signal is acquired for radar detection. S2. Upon detecting a first trigger event, the MCU sends a first wake-up signal and second environmental data to the SOC. S3. The SOC determines whether to generate an alarm based on the second environmental data. This includes the following three branches: Branch 1: If the distance between the target mobile object and the vehicle is less than or equal to a second distance threshold, but the vibration intensity is less than the second vibration threshold, an alarm message containing a first alarm level is generated. Branch 2: If the distance between the target mobile object and the vehicle is less than or equal to the second distance threshold, and the vibration intensity is greater than or equal to the second vibration threshold, an alarm message containing a second alarm level is generated. Branch 3: If the distance between the target mobile object and the vehicle is greater than the second distance threshold, and the vibration intensity is less than the second vibration threshold, the SOC enters a dormant state. S4. If an alarm message is generated, the SOC sends the alarm message to the CDC. S5. The CDC issues a corresponding warning based on the alarm level and stores the video image data on disk. S6. The SOC enters a dormant state. Generally speaking, if the SOC does not receive new second environmental data within a first period of time after generating the alarm message, the SOC enters a dormant state. S7. The CDC enters a dormant state. Generally speaking, after the CDC saves the video image data associated with the alarm message, it can enter a dormant state.
在一种可能的实现(二)中,如果采用的是如图2所示的系统架构,那么计算单元可以是指CDC。也就是说,在MCU检测到车辆产生异常振动或APA检测到车辆周围存在移动对象时,MCU或APA均可以唤醒CDC。CDC唤醒后,可以基于第二环境数据生成告警信息,并根据告警信息进行告警提示。例如,在目标告警级别为第一告警级别的情况下,CDC可以通过车载的显示设备显示第一告警提示信息,例如在车载屏幕上高亮提示。在目标告警级别为第二告警级别的情况下,CDC可以向用户终端发送第二告警提示信息,可选地,CDC还可以向用户终端推送对应的视频图像数据,以便用户可以及时查看车辆状况。除此之外,CDC还可以保存告警信息关联的视频图像数据。可选地,CDC保存告警信息关联的视频图像数据之后,CDC可以再次进入休眠状态,或者,如果CDC在生成告警信息后的第一时长内,未接收到新的第二环境数据,那么CDC进入休眠状态。In one possible implementation (two), if the system architecture shown in Figure 2 is used, the computing unit may be a CDC. That is, when the MCU detects abnormal vibrations in the vehicle or the APA detects the presence of moving objects around the vehicle, either the MCU or the APA can wake up the CDC. After waking up, the CDC can generate an alert based on the second environmental data and issue an alert based on the alert. For example, when the target alert level is the first alert level, the CDC can display the first alert via an onboard display device, such as by highlighting the alert on the onboard screen. When the target alert level is the second alert level, the CDC can send the second alert to the user terminal. Optionally, the CDC can also push corresponding video image data to the user terminal so that the user can promptly check the vehicle's status. Furthermore, the CDC can also save the video image data associated with the alert. Optionally, after saving the video image data associated with the alert, the CDC can enter a dormant state again. Alternatively, if the CDC does not receive new second environmental data within a first period after generating the alert, the CDC can enter a dormant state.
示例性地,上述实现(二)的实施过程可参考图6所示的流程,其中:S1、在车辆处于驻车状态时,MCU获取振动信号进行振动检测。(或者,S1'、在车辆处于驻车状态时,APA获取雷达信号进行雷达检测,或者,APA获取视频图像数据进行图像检测。S2、在MCU检测到异常振动时,MCU向CDC发送第一唤醒信号和发送第二环境数据。(或者,S2'、在APA检测到车辆周围存在移动对象时,APA向CDC发送第一唤醒信号和发送第二环境数据)S3、CDC基于第二环境数据确定是否生成告警信息。其中包括如下3种分支:分支一:在目标移动对象与车辆之间的距离小于或者等于第二距离阈值,但振动强度小于第二振动阈值的情况下,生成包含第一告警级别的告警信息。分支二:在目标移动对象与车辆之间的距离小于或者等于第二距离阈值,且振动强度大于或者等于第二振动阈值的情况下,生成包含第二告警级别的告警信息。分支三:在目标移动对象与车辆之间的距离大于第二距离阈值,且振动强度小于第二振动阈值的情况下,CDC进入休眠状态。S4、CDC根据告警级别做出相应警示,并进行视频图像数据落盘。S5、CDC进入休眠状态。一般来说,CDC保存告警信息关联的视频图像数据之后,CDC可以再次进入休眠状态,或者,如果CDC在生成告警信息后的第一时长内,未接收到新的第二环境数据,那么CDC进入休眠状态。Exemplarily, the implementation process of the above-mentioned implementation (ii) can refer to the process shown in Figure 6, wherein: S1, when the vehicle is in a parked state, the MCU obtains a vibration signal for vibration detection. (Or, S1', when the vehicle is in a parked state, the APA obtains a radar signal for radar detection, or the APA obtains video image data for image detection. S2, when the MCU detects abnormal vibration, the MCU sends a first wake-up signal and second environmental data to the CDC. (Or, S2', when the APA detects the presence of a moving object around the vehicle, the APA sends a first wake-up signal and second environmental data to the CDC) S3, the CDC determines whether to generate an alarm message based on the second environmental data. It includes the following three branches: Branch one: When the distance between the target moving object and the vehicle is less than or equal to the second distance threshold, but the vibration intensity is less than the second vibration threshold, an alarm message containing a first alarm level is generated. Branch two : When the distance between the target moving object and the vehicle is less than or equal to the second distance threshold, and the vibration intensity is greater than or equal to the second vibration threshold, an alarm message containing a second alarm level is generated. Branch three: When the distance between the target moving object and the vehicle is greater than the second distance threshold, and the vibration intensity is less than the second vibration threshold, the CDC enters a dormant state. S4. The CDC makes corresponding warnings according to the alarm level and writes the video image data to the disk. S5. The CDC enters a dormant state. Generally speaking, after the CDC saves the video image data associated with the alarm information, the CDC can enter a dormant state again, or if the CDC does not receive new second environmental data within the first period of time after the alarm information is generated, the CDC enters a dormant state.
在本申请实施例中,将轻量级的振动检测或视觉检测、雷达检测算法前置到低功耗的检测单元(例如MCU或APA)上,由小电瓶供电,必要时才唤醒计算单元(例如SOC或CDC)运行全量检测算法,可以在保证检测效果准确的同时,节省功耗。In an embodiment of the present application, lightweight vibration detection or visual detection, and radar detection algorithms are pre-positioned on a low-power detection unit (such as an MCU or APA), powered by a small battery. The computing unit (such as an SOC or CDC) is awakened to run the full detection algorithm only when necessary, which can save power consumption while ensuring accurate detection results.
请参见图7,图7是本申请实施例提供的环境检测方法的另一流程示意图。如图7所示,该环境检测方法包括如下步骤S701~S705。图7所示的方法执行主体可以为车辆,或者,图7所示的方法执行主体也可以为车辆中部署了检测软件的芯片或车载部件等。示例性地,检测软件可以部署在车辆的CDC,MDC,APA,MCU等车载部件(或芯片)中,本申请对此不做限制。为方便描述,图7主要以车辆中部署了检测软件的车载部件为方法的执行主体为例进行说明,具体来说,车辆部件可以为感知数据处理模块,振动信号处理模块和计算单元。应理解,如果采用的是如图2所示的系统架构,那么振动信号处理模块可以是指MCU,感知数据处理模块可以是指APA,计算单元可以为CDC,本实施例主要以图2所示的架构进行说明。需要说明的是,图7是本申请的方法实施例的示意性流程图,示出了该方法的详细的通信步骤或操作,但这些步骤或操作仅是示例,本申请实施例还可以执行其它操作或者图7中的各种操作的变形。此外,图7中的各个步骤可以分别按照与图7所呈现的不同的顺序来执行,并且有可能并非要执行图7中的全部操作。其中:Please refer to Figure 7, which is another flow chart of the environment detection method provided by an embodiment of the present application. As shown in Figure 7, the environment detection method includes the following steps S701 to S705. The method execution subject shown in Figure 7 can be a vehicle, or the method execution subject shown in Figure 7 can also be a chip or vehicle-mounted component in which the detection software is deployed in the vehicle. For example, the detection software can be deployed in the vehicle's CDC, MDC, APA, MCU and other vehicle-mounted components (or chips), and this application does not limit this. For the convenience of description, Figure 7 mainly uses the vehicle-mounted component in which the detection software is deployed in the vehicle as an example to illustrate the execution subject of the method. Specifically, the vehicle component can be a perception data processing module, a vibration signal processing module and a computing unit. It should be understood that if the system architecture shown in Figure 2 is adopted, then the vibration signal processing module can refer to the MCU, the perception data processing module can refer to the APA, and the computing unit can be the CDC. This embodiment is mainly illustrated by the architecture shown in Figure 2. It should be noted that FIG7 is a schematic flow chart of an embodiment of the method of the present application, showing detailed communication steps or operations of the method, but these steps or operations are merely examples, and the embodiment of the present application may also perform other operations or variations of the various operations in FIG7. In addition, the various steps in FIG7 may be performed in a different order than that presented in FIG7, and it is possible that not all operations in FIG7 need to be performed. Among them:
S701、MCU基于振动信号和第一振动阈值确定车辆是否产生异常振动。S701 : The MCU determines whether the vehicle generates abnormal vibration based on a vibration signal and a first vibration threshold.
在一些可行的实施方式中,与MCU相连的传感器可以为加速度传感器。其中加速度传感器采集的第一环境数据为振动信号,MCU可以根据来自加速传感器的振动信号和第一振动阈值确定车辆是否产生异常振动。具体来说,在振动信号指示的振动强度不小于第一振动阈值的情况下,MCU可以确定车辆产生异常振动;在振动信号指示的振动强度小于第一振动阈值的情况下,MCU可以确定车辆未产生异常振动。In some feasible implementations, the sensor connected to the MCU may be an accelerometer. The first environmental data collected by the accelerometer is a vibration signal. The MCU can determine whether the vehicle is experiencing abnormal vibration based on the vibration signal from the accelerometer and a first vibration threshold. Specifically, if the vibration intensity indicated by the vibration signal is not less than the first vibration threshold, the MCU can determine that the vehicle is experiencing abnormal vibration; if the vibration intensity indicated by the vibration signal is less than the first vibration threshold, the MCU can determine that the vehicle is not experiencing abnormal vibration.
S702、MCU在确定车辆产生异常振动的情况下,向APA发送第二唤醒信号。相应地,APA接收来自MCU的第二唤醒信号。S702: When the MCU determines that the vehicle is vibrating abnormally, the MCU sends a second wake-up signal to the APA. In response, the APA receives the second wake-up signal from the MCU.
在一些可行的实施方式中,与APA相连的传感器可以包括环境感知传感器,这里环境感知传感器具体可以为视觉系传感器和/或雷达系传感器,为方便描述,后文以环境感知传感器包括视觉系传感器和雷达系传感器为例进行示意性说明。环境感知传感器采集的第一环境数据为感知数据,例如视觉系传感器采集的视频图像数据和雷达系传感器采集的雷达信号均可以理解为感知数据。In some feasible embodiments, the sensors connected to the APA may include environmental perception sensors, which may specifically be vision sensors and/or radar sensors. For ease of description, the following description uses the example of an environmental perception sensor including a vision sensor and a radar sensor as an example. The first environmental data collected by the environmental perception sensor is perception data. For example, video image data collected by a vision sensor and radar signals collected by a radar sensor can both be understood as perception data.
需要说明的是,当MCU确定车辆产生异常振动时,MCU可以唤醒APA。It should be noted that when the MCU determines that the vehicle has abnormal vibration, the MCU can wake up the APA.
S703、APA在根据感知数据确定车辆周围存在移动对象的情况下,确定检测到第一触发事件。S703: When the APA determines, based on the perception data, that there is a moving object around the vehicle, it determines that a first triggering event is detected.
应理解,当APA被MCU唤醒后,APA可以根据雷达信号或视频图像数据确定车辆周围是否存在移动对象。例如在基于雷达信号确定移动对象与车辆之间的距离小于或者等于某个距离阈值(为便于区分,后文称作第一距离阈值)时,可判断车辆周围存在移动对象;在移动对象与车辆之间的距离大于第一距离阈值时,可判断车辆周围不存在移动对象。通常来说,在车辆周围存在移动对象的情况下,可以认为检测到了第一触发事件。It should be understood that when the APA is awakened by the MCU, the APA can determine whether there is a moving object around the vehicle based on the radar signal or video image data. For example, when the distance between the moving object and the vehicle is less than or equal to a certain distance threshold (hereinafter referred to as the first distance threshold for ease of distinction) determined based on the radar signal, it can be determined that there is a moving object around the vehicle; when the distance between the moving object and the vehicle is greater than the first distance threshold, it can be determined that there is no moving object around the vehicle. Generally speaking, when there is a moving object around the vehicle, it can be considered that the first trigger event has been detected.
S704、APA在检测到第一触发事件时,向CDC发送第一唤醒信号和发送第二环境数据。相应地,CDC接收来自APA的第一唤醒信号和第二环境数据。S704: When the APA detects the first trigger event, the APA sends a first wake-up signal and second environment data to the CDC. Correspondingly, the CDC receives the first wake-up signal and second environment data from the APA.
在一些可行的实施方式中,APA在检测到第一触发事件时,可以唤醒CDC,并向CDC发送第二环境数据。In some feasible implementations, when the APA detects the first trigger event, it may wake up the CDC and send the second environment data to the CDC.
S705、CDC基于第二环境数据确定是否生成告警信息。S705: The CDC determines whether to generate alarm information based on the second environment data.
有关CDC基于第二环境数据确定是否生成告警信息的实现可参考前述图3对应的实施例的步骤S303中的相关描述,在此不进行赘述。Regarding the implementation of the CDC determining whether to generate alarm information based on the second environment data, reference may be made to the relevant description in step S303 of the embodiment corresponding to FIG. 3 , which will not be elaborated here.
在本申请实施例中,MCU检测到振动后唤醒APA检测视觉和雷达,最终再拉起CDC,这种分级唤醒的方式可以使得功耗更低。In an embodiment of the present application, after the MCU detects vibration, it wakes up the APA to detect vision and radar, and finally pulls up the CDC. This hierarchical wake-up method can reduce power consumption.
上述详细阐述了本申请实施例的方法,下面提供用于实现本申请实施例中任一种方法的装置,例如,提供一种装置包括用以实现以上任一种方法中设备所执行的各步骤的单元(或手段)。The above describes in detail the methods of the embodiments of the present application. The following provides an apparatus for implementing any method in the embodiments of the present application. For example, an apparatus is provided that includes units (or means) for implementing each step performed by the device in any of the above methods.
请参见图8,图8为本申请实施例提供的一种环境检测装置的结构示意图。Please refer to Figure 8, which is a structural diagram of an environment detection device provided in an embodiment of the present application.
如图8所示,该环境检测装置80可以包括收发单元801以及处理单元802。收发单元801以及处理单元802可以是软件,也可以是硬件,或者是软件和硬件结合。As shown in Figure 8, the environment detection device 80 may include a transceiver unit 801 and a processing unit 802. The transceiver unit 801 and the processing unit 802 may be software, hardware, or a combination of software and hardware.
其中,收发单元801可以实现发送功能和/或接收功能,收发单元801也可以描述为收发单元。收发单元801还可以是集成了获取单元(或称接收单元)和发送单元的单元,其中,获取单元用于实现接收功能,发送单元用于实现发送功能。可选的,收发单元801可以用于接收其他装置发送的信息,还可以用于向其他装置发送信息。The transceiver unit 801 can implement a sending function and/or a receiving function, and can also be described as a transceiver unit. The transceiver unit 801 can also be a unit that integrates an acquisition unit (or receiving unit) and a sending unit, wherein the acquisition unit is used to implement the receiving function and the sending unit is used to implement the sending function. Optionally, the transceiver unit 801 can be used to receive information sent by other devices, and can also be used to send information to other devices.
在一种可能的设计中,该环境检测装置80可对应于上述图3或图7所示的方法实施例中的检测单元或检测单元中的芯片。该环境检测装置80可以包括用于执行上述图3或图7所示的方法实施例中由检测单元所执行的操作的单元,并且,该环境检测装置80中的各单元分别为了实现上述图3或图7所示的方法实施例中由检测单元所执行的操作。其中,各个单元的描述如下:In one possible design, the environment detection device 80 may correspond to the detection unit or chip in the detection unit in the method embodiment shown in Figure 3 or Figure 7 above. The environment detection device 80 may include a unit for executing the operations performed by the detection unit in the method embodiment shown in Figure 3 or Figure 7 above, and each unit in the environment detection device 80 is respectively for implementing the operations performed by the detection unit in the method embodiment shown in Figure 3 or Figure 7 above. The description of each unit is as follows:
处理单元802,用于在车辆处于驻车状态时,获取第一环境数据并根据所述第一环境数据进行环境检测;The processing unit 802 is configured to obtain first environmental data and perform environmental detection based on the first environmental data when the vehicle is in a parking state;
收发单元801,用于在检测到第一触发事件时,向计算单元发送第一唤醒信号和发送第二环境数据,所述第二环境数据包括所述第一环境数据和/或基于所述第一环境数据得到的数据处理结果;The transceiver unit 801 is configured to send a first wake-up signal and second environment data to the computing unit when a first trigger event is detected, where the second environment data includes the first environment data and/or a data processing result obtained based on the first environment data;
其中,在所述车辆处于驻车状态时,所述检测单元处于被供电状态,在接收到所述第一唤醒信号前,所述计算单元处于休眠状态。Wherein, when the vehicle is in a parking state, the detection unit is in a powered state, and before receiving the first wake-up signal, the calculation unit is in a dormant state.
在一种可能的实施方式中,所述检测单元的功耗低于所述计算单元被唤醒后工作时的功耗。In a possible implementation, the power consumption of the detection unit is lower than the power consumption of the calculation unit when it is awakened and working.
在一种可能的实施方式中,所述第一环境数据包括来自加速度传感器的振动信号;In a possible implementation, the first environmental data includes a vibration signal from an acceleration sensor;
所述根据所述第一环境数据进行环境检测时,所述处理单元802用于:When performing environmental detection according to the first environmental data, the processing unit 802 is configured to:
在检测到所述振动信号超过第一振动阈值的情况下,确定检测到第一触发事件。In the case that it is detected that the vibration signal exceeds a first vibration threshold, it is determined that a first triggering event is detected.
在一种可能的实施方式中,所述第一环境数据包括来自环境感知传感器的感知数据;In a possible implementation, the first environmental data includes perception data from an environmental perception sensor;
所述根据所述第一环境数据进行环境检测时,所述处理单元802用于:When performing environmental detection according to the first environmental data, the processing unit 802 is configured to:
根据所述感知数据确定所述车辆周围是否存在移动对象;determining whether there is a moving object around the vehicle based on the perception data;
在确定所述车辆周围存在移动对象的情况下,确定检测到第一触发事件。In a case where it is determined that there is a moving object around the vehicle, it is determined that a first triggering event is detected.
在一种可能的实施方式中,所述处理单元802包括感知数据处理模块和振动信号处理模块;所述第一环境数据包括来自加速度传感器的振动信号和来自环境感知传感器的感知数据;In a possible implementation, the processing unit 802 includes a perception data processing module and a vibration signal processing module; the first environmental data includes a vibration signal from an acceleration sensor and perception data from an environmental perception sensor;
所述根据所述第一环境数据进行环境检测时:When performing environmental detection according to the first environmental data:
所述振动信号处理模块,用于在检测到所述振动信号超过第一振动阈值的情况下,向所述感知数据处理模块发送第二唤醒信号;The vibration signal processing module is configured to send a second wake-up signal to the perception data processing module when detecting that the vibration signal exceeds a first vibration threshold;
所述感知数据处理模块,用于根据所述感知数据确定所述车辆周围是否存在移动对象;The perception data processing module is used to determine whether there is a moving object around the vehicle based on the perception data;
所述感知数据处理模块,用于在确定所述车辆周围存在移动对象的情况下,确定检测到第一触发事件;The perception data processing module is configured to determine that a first trigger event is detected when it is determined that there is a moving object around the vehicle;
其中,在接收到所述第二唤醒信号之前,所述感知数据处理模块处于休眠状态。Before receiving the second wake-up signal, the perception data processing module is in a dormant state.
关于本设计以及任一项可能的实施方式所带来的技术效果,可参考对应于图3或图7以及相应的实施方式的技术效果的介绍。Regarding the technical effects brought about by this design and any possible implementation, please refer to the introduction of the technical effects corresponding to Figure 3 or Figure 7 and the corresponding implementation.
在图8所示的环境检测装置80的另一种可能的设计中,该环境检测装置80可对应于上述图3或图7所示的方法实施例中的计算单元,如该环境检测装置80可以是计算单元,也可以是计算单元中的芯片。该环境检测装置80可以包括用于执行上述图3或图7所示的方法实施例中由计算单元所执行的操作的单元,并且,该环境检测装置80中的各单元分别为了实现上述图3或图7所示的方法实施例中由计算单元所执行的操作。其中,各个单元的描述如下:In another possible design of the environment detection device 80 shown in FIG8 , the environment detection device 80 may correspond to the computing unit in the method embodiment shown in FIG3 or FIG7 , for example, the environment detection device 80 may be a computing unit or a chip in the computing unit. The environment detection device 80 may include a unit for executing the operations performed by the computing unit in the method embodiment shown in FIG3 or FIG7 , and each unit in the environment detection device 80 is respectively for implementing the operations performed by the computing unit in the method embodiment shown in FIG3 or FIG7 . The description of each unit is as follows:
收发单元801,用于接收来自检测单元的第一唤醒信号和第二环境数据,所述第二环境数据包括所述第一环境数据和/或基于所述第一环境数据得到的数据处理结果;The transceiver unit 801 is configured to receive a first wake-up signal and second environment data from a detection unit, where the second environment data includes the first environment data and/or a data processing result obtained based on the first environment data;
处理单元802,用于基于所述第二环境数据确定是否生成告警信息;The processing unit 802 is configured to determine whether to generate an alarm message based on the second environment data;
其中,在车辆处于驻车状态时,所述检测单元处于被供电状态,在接收到所述第一唤醒信号前,所述计算单元处于休眠状态。Wherein, when the vehicle is in a parking state, the detection unit is in a powered state, and before receiving the first wake-up signal, the calculation unit is in a dormant state.
在一种可能的实施方式中,所述检测单元的功耗低于所述计算单元被唤醒后工作时的功耗。In a possible implementation, the power consumption of the detection unit is lower than the power consumption of the calculation unit when it is awakened and working.
在一种可能的实施方式中,所述第二环境数据包括所述第一环境数据和基于所述第一环境数据得到的数据处理结果,所述第一环境数据包括感知数据和振动信号,所述数据处理结果包括所述移动对象的疑似所在区域,所述移动对象的疑似所在区域基于所述感知数据确定;In one possible implementation, the second environmental data includes the first environmental data and a data processing result obtained based on the first environmental data, the first environmental data includes perception data and a vibration signal, the data processing result includes a suspected area where the mobile object is located, and the suspected area where the mobile object is located is determined based on the perception data;
所述基于所述第二环境数据确定是否生成告警信息时,所述处理单元802用于:When determining whether to generate alarm information based on the second environment data, the processing unit 802 is configured to:
基于所述感知数据和所述移动对象的疑似所在区域确定目标移动对象;determining a target mobile object based on the sensing data and the suspected area where the mobile object is located;
在所述目标移动对象与所述车辆之间的距离小于或者等于距离阈值,和/或,所述车辆的振动强度大于或者等于第二振动阈值的情况下,生成告警信息;generating an alarm message when the distance between the target mobile object and the vehicle is less than or equal to a distance threshold, and/or when the vibration intensity of the vehicle is greater than or equal to a second vibration threshold;
在所述目标移动对象与所述车辆之间的距离大于距离阈值,且所述车辆的振动强度小于所述第二振动阈值的情况下,重新进入休眠状态;re-entering the dormant state when the distance between the target mobile object and the vehicle is greater than a distance threshold and the vibration intensity of the vehicle is less than the second vibration threshold;
其中,所述车辆的振动强度基于所述振动信号确定。Wherein, the vibration intensity of the vehicle is determined based on the vibration signal.
在一种可能的实施方式中,所述基于所述感知数据和所述移动对象的疑似所在区域确定目标移动对象时,所述处理单元802用于:In a possible implementation, when determining the target moving object based on the perception data and the suspected area where the moving object is located, the processing unit 802 is configured to:
根据所述感知数据确定至少一个感兴趣对象所在的区域;determining, based on the sensing data, an area where at least one object of interest is located;
根据所述至少一个感兴趣对象所在的区域和所述移动对象的疑似所在区域,确定所述目标移动对象;determining the target moving object according to the area where the at least one object of interest is located and the suspected area where the moving object is located;
其中,所述至少一个感兴趣对象包括所述目标移动对象,所述目标移动对象所在的区域与所述移动对象的疑似所在区域的重叠度大于或者等于预设重叠度阈值。The at least one object of interest includes the target moving object, and the degree of overlap between the area where the target moving object is located and the area where the moving object is suspected to be located is greater than or equal to a preset overlap threshold.
在一种可能的实施方式中,所述告警信息包括目标告警级别,所述目标告警级别为多个告警级别中的一项,所述多个告警级别用于指示告警信息的严重程度;In a possible implementation, the alarm information includes a target alarm level, where the target alarm level is one of multiple alarm levels, and the multiple alarm levels are used to indicate the severity of the alarm information;
在所述目标移动对象与所述车辆之间的距离小于或者等于距离阈值,或者,所述目标移动对象与所述车辆之间的距离小于或者等于所述距离阈值且所述车辆的振动强度小于所述第二振动阈值的情况下,所述目标告警级别为第一告警级别;When the distance between the target moving object and the vehicle is less than or equal to a distance threshold, or when the distance between the target moving object and the vehicle is less than or equal to the distance threshold and the vibration intensity of the vehicle is less than the second vibration threshold, the target warning level is the first warning level;
在所述车辆的振动强度大于或者等于振动阈值,或者,所述目标移动对象与所述车辆之间的距离小于或者等于所述距离阈值且所述车辆的振动强度大于或者等于所述第二振动阈值的情况下,所述目标告警级别为第二告警级别。When the vibration intensity of the vehicle is greater than or equal to a vibration threshold, or when the distance between the target mobile object and the vehicle is less than or equal to the distance threshold and the vibration intensity of the vehicle is greater than or equal to the second vibration threshold, the target warning level is the second warning level.
在一种可能的实施方式中,所述收发单元801用于:In a possible implementation, the transceiver unit 801 is configured to:
向控制单元发送第三唤醒信号和所述告警信息,所述告警信息包括目标告警级别。A third wake-up signal and the alarm information are sent to a control unit, where the alarm information includes a target alarm level.
在一种可能的实施方式中,所述处理单元802用于:In a possible implementation, the processing unit 802 is configured to:
在所述目标告警级别为第一告警级别的情况下,通过显示设备显示第一告警提示信息;When the target alarm level is the first alarm level, displaying the first alarm prompt information through the display device;
在所述目标告警级别为第二告警级别的情况下,向用户终端发送第二告警提示信息。When the target alarm level is the second alarm level, second alarm prompt information is sent to the user terminal.
在一种可能的实施方式中,所述装置还包括存储单元803(图中未示出):In a possible implementation, the device further includes a storage unit 803 (not shown in the figure):
所述存储单元803,用于保存所述告警信息关联的视频图像数据,所述视频图像数据通过视觉系传感器采集得到;或者,The storage unit 803 is used to store the video image data associated with the alarm information, and the video image data is collected by a visual sensor; or
所述存储单元803,用于保存所述告警信息关联的视频图像数据;The storage unit 803 is used to store the video image data associated with the alarm information;
所述处理单元802,用于在所述存储单元803保存所述告警信息关联的视频图像数据之后,重新进入休眠状态。The processing unit 802 is configured to re-enter the dormant state after the storage unit 803 saves the video image data associated with the alarm information.
在一种可能的实施方式中,所述处理单元802用于:In a possible implementation, the processing unit 802 is configured to:
在生成所述告警信息后的第一时长内,未接收到来自所述检测单元的第二环境数据的情况下,重新进入休眠状态。If no second environmental data is received from the detection unit within a first period of time after the alarm information is generated, the system re-enters the dormant state.
关于本设计以及任一项可能的实施方式所带来的技术效果,可参考对应于图3或图7以及相应的实施方式的技术效果的介绍。Regarding the technical effects brought about by this design and any possible implementation, please refer to the introduction of the technical effects corresponding to Figure 3 or Figure 7 and the corresponding implementation.
在图8所示的环境检测装置80的又一种可能的设计中,该环境检测装置80可对应于上述图3或图7所示的方法实施例中的控制单元,如该环境检测装置80可以是控制单元,也可以是控制单元中的芯片。该环境检测装置80可以包括用于执行上述图3或图7所示的方法实施例中由控制单元所执行的操作的单元,并且,该环境检测装置80中的各单元分别为了实现上述图3或图7所示的方法实施例中由控制单元所执行的操作。其中,各个单元的描述如下:In another possible design of the environment detection device 80 shown in FIG8 , the environment detection device 80 may correspond to the control unit in the method embodiment shown in FIG3 or FIG7 above, for example, the environment detection device 80 may be a control unit or a chip in the control unit. The environment detection device 80 may include a unit for executing the operations performed by the control unit in the method embodiment shown in FIG3 or FIG7 above, and each unit in the environment detection device 80 is respectively for implementing the operations performed by the control unit in the method embodiment shown in FIG3 or FIG7 above. The description of each unit is as follows:
收发单元801,用于接收来自计算单元的第三唤醒信号和告警信息,所述告警信息包括目标告警级别;The transceiver unit 801 is configured to receive a third wake-up signal and alarm information from the computing unit, wherein the alarm information includes a target alarm level;
处理单元802,用于根据所述告警信息进行告警提示。The processing unit 802 is configured to issue an alarm prompt based on the alarm information.
在一种可能的实施方式中,所述控制单元根据所述告警信息进行告警提示时,所述处理单元802用于:In a possible implementation, when the control unit issues an alarm prompt according to the alarm information, the processing unit 802 is configured to:
在所述目标告警级别为第一告警级别的情况下,通过显示设备显示第一告警提示信息;When the target alarm level is the first alarm level, displaying the first alarm prompt information through the display device;
在所述目标告警级别为第二告警级别的情况下,向用户终端发送第二告警提示信息。When the target alarm level is the second alarm level, second alarm prompt information is sent to the user terminal.
在一种可能的实施方式中,所述装置还包括存储单元803(图中未示出):In a possible implementation, the device further includes a storage unit 803 (not shown in the figure):
所述存储单元803,用于保存所述告警信息关联的视频图像数据,所述视频图像数据通过视觉系传感器采集得到;或者,The storage unit 803 is used to store the video image data associated with the alarm information, and the video image data is collected by a visual sensor; or
所述存储单元803,用于保存所述告警信息关联的视频图像数据;The storage unit 803 is used to store the video image data associated with the alarm information;
所述处理单元802,用于在保存所述告警信息关联的视频图像数据之后,重新进入休眠状态。The processing unit 802 is configured to re-enter the dormant state after saving the video image data associated with the alarm information.
关于本设计以及任一项可能的实施方式所带来的技术效果,可参考对应于图3或图7以及相应的实施方式的技术效果的介绍。Regarding the technical effects brought about by this design and any possible implementation, please refer to the introduction of the technical effects corresponding to Figure 3 or Figure 7 and the corresponding implementation.
可选的,在上述图8所示的环境检测装置80的任一种可能的设计中:Optionally, in any possible design of the environment detection device 80 shown in FIG8 :
在一种实现方式中,该环境检测装置为检测单元或计算单元或控制单元。当该环境检测装置为检测单元或计算单元或控制单元时,收发单元可以是收发器,或,输入/输出接口;处理单元可以是至少一个处理器。可选地,收发器可以为收发电路。可选地,输入/输出接口可以为输入/输出电路。In one implementation, the environment detection device is a detection unit, a computing unit, or a control unit. When the environment detection device is a detection unit, a computing unit, or a control unit, the transceiver unit may be a transceiver or an input/output interface; and the processing unit may be at least one processor. Alternatively, the transceiver may be a transceiver circuit. Alternatively, the input/output interface may be an input/output circuit.
在另一种实现方式中,该环境检测装置为用于检测单元或计算单元或控制单元中的芯片(系统)或电路。当该环境检测装置为用于检测单元或计算单元或控制单元中的芯片(系统)或电路时,收发单元可以是该芯片(系统)或电路上的通信接口(输入/输出接口)、接口电路、输出电路、输入电路、管脚或相关电路等;处理单元可以是至少一个处理器、处理电路或逻辑电路等。In another implementation, the environment detection device is a chip (system) or circuit used in a detection unit, a computing unit, or a control unit. When the environment detection device is a chip (system) or circuit used in a detection unit, a computing unit, or a control unit, the transceiver unit may be a communication interface (input/output interface), an interface circuit, an output circuit, an input circuit, a pin, or related circuits on the chip (system) or circuit; and the processing unit may be at least one processor, a processing circuit, or a logic circuit.
根据本申请实施例,图8所示的装置中的各个单元可以分别或全部合并为一个或若干个另外的单元来构成,或者其中的某个(些)单元还可以再拆分为功能上更小的多个单元来构成,这可以实现同样的操作,而不影响本申请的实施例的技术效果的实现。上述单元是基于逻辑功能划分的,在实际应用中,一个单元的功能也可以由多个单元来实现,或者多个单元的功能由一个单元实现。在本申请的其它实施例中,基于电子设备也可以包括其它单元,在实际应用中,这些功能也可以由其它单元协助实现,并且可以由多个单元协作实现。According to an embodiment of the present application, the various units in the device shown in Figure 8 can be separately or all merged into one or several other units to constitute, or a certain (some) unit therein can also be split into multiple smaller units to constitute, which can achieve the same operation without affecting the realization of the technical effects of the embodiments of the present application. The above-mentioned units are divided based on logical functions. In practical applications, the functions of a unit can also be implemented by multiple units, or the functions of multiple units can be implemented by one unit. In other embodiments of the present application, other units can also be included based on electronic equipment. In practical applications, these functions can also be implemented with the assistance of other units, and can be implemented by collaboration of multiple units.
需要说明的是,各个单元的实现还可以对应参照上述图3或图7所示的方法实施例的相应描述。It should be noted that the implementation of each unit may also refer to the corresponding description of the method embodiment shown in FIG. 3 or FIG. 7 .
在图8所描述的环境检测装置80中,将轻量级的振动检测或视觉检测、雷达检测算法前置到低功耗的检测单元(例如MCU或APA)上,由小电瓶供电,必要时才唤醒计算单元(例如SOC或CDC)运行全量检测算法,可以在保证检测效果准确的同时,节省功耗。In the environmental detection device 80 described in Figure 8, lightweight vibration detection or visual detection, and radar detection algorithms are pre-placed on a low-power detection unit (such as an MCU or APA), powered by a small battery. The computing unit (such as an SOC or CDC) is awakened to run the full detection algorithm only when necessary, which can save power consumption while ensuring accurate detection results.
请参见图9,图9为本申请实施例提供的一种环境检测装置的结构示意图。Please refer to Figure 9, which is a structural diagram of an environment detection device provided in an embodiment of the present application.
应理解,图9示出的环境检测装置90仅是示例,本申请实施例的环境检测装置还可包括其他部件,或者包括与图9中的各个部件的功能相似的部件,或者并非要包括图9中所有部件。It should be understood that the environmental detection device 90 shown in Figure 9 is only an example. The environmental detection device of the embodiment of the present application may also include other components, or include components with similar functions to the various components in Figure 9, or not include all the components in Figure 9.
环境检测装置90包括通信接口901和至少一个处理器902。The environment detection device 90 includes a communication interface 901 and at least one processor 902 .
该环境检测装置90可以对应部署了检测软件的检测单元或计算单元或控制单元中的任一设备。通信接口901用于收发信号,至少一个处理器902执行程序指令,使得环境检测装置90实现上述图3或图7方法实施例中由对应设备所执行的方法的相应流程。The environment detection device 90 can correspond to any device in a detection unit, computing unit, or control unit that deploys detection software. A communication interface 901 is used to transmit and receive signals, and at least one processor 902 executes program instructions, enabling the environment detection device 90 to implement the corresponding process of the method executed by the corresponding device in the method embodiment of Figures 3 or 7 above.
在图9所描述的环境检测装置90中,将轻量级的振动检测或视觉检测、雷达检测算法前置到低功耗的检测单元(例如MCU或APA)上,由小电瓶供电,必要时才唤醒计算单元(例如SOC或CDC)运行全量检测算法,可以在保证检测效果准确的同时,节省功耗。In the environmental detection device 90 described in Figure 9, lightweight vibration detection or visual detection, and radar detection algorithms are pre-placed on a low-power detection unit (such as an MCU or APA), powered by a small battery. The computing unit (such as an SOC or CDC) is awakened to run the full detection algorithm only when necessary, which can save power consumption while ensuring accurate detection results.
对于环境检测装置可以是芯片或芯片系统的情况,可参见图10所示的芯片的结构示意图。In the case where the environment detection device can be a chip or a chip system, reference can be made to the schematic structural diagram of the chip shown in FIG10 .
如图10所示,芯片100包括处理器1001和接口1002。其中,处理器1001的数量可以是一个或多个,接口1002的数量可以是多个。需要说明的是,处理器1001、接口1002各自对应的功能既可以通过硬件设计实现,也可以通过软件设计来实现,还可以通过软硬件结合的方式来实现,这里不作限制。As shown in Figure 10, chip 100 includes a processor 1001 and an interface 1002. There may be one or more processors 1001, and there may be multiple interfaces 1002. It should be noted that the functions of processor 1001 and interface 1002 can be implemented through hardware design, software design, or a combination of hardware and software, without limitation.
可选的,芯片100还可以包括存储器1003,存储器1003用于存储必要的程序指令和数据。Optionally, the chip 100 may further include a memory 1003 , which is used to store necessary program instructions and data.
本申请中,处理器1001可用于从存储器1003中调用本申请的一个或多个实施例提供的环境检测方法在部署了检测软件的检测单元或计算单元或控制单元中一个或多个设备的实现程序,并执行该程序包含的指令。接口1002可用于输出处理器1001的执行结果。本申请中,接口1002可具体用于输出处理器1001的各个消息或信息。In this application, processor 1001 may be configured to call from memory 1003 an implementation program for the environmental detection method provided in one or more embodiments of this application in one or more devices within a detection unit, computing unit, or control unit where detection software is deployed, and execute the instructions contained in the program. Interface 1002 may be configured to output the execution results of processor 1001. In this application, interface 1002 may be specifically configured to output various messages or information from processor 1001.
关于本申请的一个或多个实施例提供的环境检测方法可参考前述图3或图7所示各个实施例,这里不再赘述。Regarding the environmental detection method provided by one or more embodiments of the present application, reference may be made to the various embodiments shown in FIG. 3 or FIG. 7 , which will not be described in detail here.
本申请实施例中的处理器可以是中央处理单元(Central Processing Unit,CPU),该处理器还可以是其他通用处理器、数字信号处理器(digital signal processor,DSP)、专用集成电路(application specific integrated circuit,ASIC)、现成可编程门阵列(field programmable gate array,FPGA)或者其他可编程逻辑器件、分立门或者晶体管逻辑器件、分立硬件组件等。通用处理器可以是微处理器或者该处理器也可以是任何常规的处理器等。The processor in the embodiments of the present application may be a central processing unit (CPU), but may also be other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor may be a microprocessor or any conventional processor.
本申请实施例中的存储器用于提供存储空间,存储空间中可以存储操作系统和计算机程序等数据。存储器包括但不限于是随机存储记忆体(random access memory,RAM)、只读存储器(read-only memory,ROM)、可擦除可编程只读存储器(erasable programmable read only memory,EPROM)、或便携式只读存储器(compact disc read-only memory,CD-ROM)。The memory in the embodiments of the present application is used to provide storage space, which can store data such as an operating system and computer programs. Memory includes, but is not limited to, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM), or compact disc read-only memory (CD-ROM).
根据本申请实施例提供的方法,本申请实施例还提供一种计算机可读存储介质,上述计算机可读存储介质中存储有计算机程序,当上述计算机程序在一个或多个处理器上运行时,可以实现上述图3或图7所示的方法。According to the method provided in the embodiment of the present application, the embodiment of the present application also provides a computer-readable storage medium, in which a computer program is stored. When the computer program runs on one or more processors, the method shown in Figure 3 or Figure 7 can be implemented.
根据本申请实施例提供的方法,本申请实施例还提供一种计算机程序产品,上述计算机程序产品包括计算机程序,当上述计算机程序在处理器上运行时,可以实现上述图3或图7所示的方法。According to the method provided in the embodiment of the present application, the embodiment of the present application also provides a computer program product, which includes a computer program. When the computer program runs on a processor, it can implement the method shown in Figure 3 or Figure 7 above.
本申请实施例还提供了一种系统,该系统包括至少一个如上述环境检测装置80或环境检测装置90或芯片100,用于执行上述图3或图7任一实施例中相应设备执行的步骤。An embodiment of the present application also provides a system, which includes at least one environment detection device 80 or environment detection device 90 or chip 100 as described above, and is used to execute the steps executed by the corresponding device in any of the embodiments of Figures 3 or 7 above.
本申请实施例还提供了一种系统,该系统包括部署了检测软件的检测单元或计算单元或控制单元,该检测单元或计算单元或控制单元用于执行上述图3或图7所示实施例中各对应的设备执行的步骤。An embodiment of the present application also provides a system, which includes a detection unit or a computing unit or a control unit deployed with detection software, and the detection unit or the computing unit or the control unit is used to execute the steps performed by the corresponding devices in the embodiments shown in Figures 3 or 7 above.
本申请实施例还提供了一种处理装置,包括处理器和接口;所述处理器用于执行上述任一方法实施例中的方法。An embodiment of the present application further provides a processing device, including a processor and an interface; the processor is used to execute the method in any of the above method embodiments.
应理解,上述处理装置可以是一个芯片。例如,该处理装置可以是现场可编程门阵列(field programmable gate array,FPGA),可以是通用处理器、数字信号处理器(digital signal processor,DSP)、专用集成电路(application specific integrated circuit,ASIC)、现成可编程门阵列(field programmable gate array,FPGA)或者其他可编程逻辑器件、分立门或者晶体管逻辑器件、分立硬件组件,还可以是系统芯片(system on chip,SoC),还可以是中央处理器(central processor unit,CPU),还可以是网络处理器(network processor,NP),还可以是数字信号处理电路(digital signal processor,DSP),还可以是微控制器(micro controller unit,MCU),还可以是可编程控制器(programmable logic device,PLD)或其他集成芯片。可以实现或者执行本申请实施例中的公开的各方法、步骤及逻辑框图。通用处理器可以是微处理器或者该处理器也可以是任何常规的处理器等。结合本申请实施例所公开的方法的步骤可以直接体现为硬件译码处理器执行完成,或者用译码处理器中的硬件及软件模块组合执行完成。软件模块可以位于随机存储器,闪存、只读存储器,可编程只读存储器或者电可擦写可编程存储器、寄存器等本领域成熟的存储介质中。该存储介质位于存储器,处理器读取存储器中的信息,结合其硬件完成上述方法的步骤。It should be understood that the above-mentioned processing device can be a chip. For example, the processing device can be a field programmable gate array (FPGA), a general-purpose processor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic device, discrete gate or transistor logic device, discrete hardware component, a system on chip (SoC), a central processing unit (CPU), a network processor (NP), a digital signal processing circuit (DSP), a microcontroller unit (MCU), a programmable logic device (PLD), or other integrated chip. The various methods, steps, and logic block diagrams disclosed in the embodiments of the present application can be implemented or executed. The general-purpose processor can be a microprocessor, or the processor can also be any conventional processor. The steps of the method disclosed in the embodiments of this application can be directly implemented and executed by a hardware decoding processor, or by a combination of hardware and software modules in the decoding processor. The software module can be located in a storage medium well-known in the art, such as random access memory, flash memory, read-only memory, programmable read-only memory, electrically erasable programmable memory, registers, etc. The storage medium is located in the memory, and the processor reads the information in the memory and, in conjunction with its hardware, completes the steps of the above method.
可以理解,本申请实施例中的存储器可以是易失性存储器或非易失性存储器,或可包括易失性和非易失性存储器两者。其中,非易失性存储器可以是只读存储器(read-only memory,ROM)、可编程只读存储器(programmable ROM,PROM)、可擦除可编程只读存储器(erasable PROM,EPROM)、电可擦除可编程只读存储器(electrically EPROM,EEPROM)或闪存。易失性存储器可以是随机存取存储器(random access memory,RAM),其用作外部高速缓存。通过示例性但不是限制性说明,许多形式的RAM可用,例如静态随机存取存储器(static RAM,SRAM)、动态随机存取存储器(dynamic RAM,DRAM)、同步动态随机存取存储器(synchronous DRAM,SDRAM)、双倍数据速率同步动态随机存取存储器(double data rate SDRAM,DDR SDRAM)、增强型同步动态随机存取存储器(enhanced SDRAM,ESDRAM)、同步连接动态随机存取存储器(synchlink DRAM,SLDRAM)和直接内存总线随机存取存储器(direct rambus RAM,DR RAM)。应注意,本文描述的系统和方法的存储器旨在包括但不限于这些和任意其它适合类型的存储器。It is understood that the memory in the embodiments of the present application may be a volatile memory or a non-volatile memory, or may include both volatile and non-volatile memories. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), which is used as an external cache. By way of example and not limitation, many forms of RAM are available, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDR SDRAM), enhanced SDRAM (ESDRAM), synchlink DRAM (SLDRAM), and direct RAM (DR RAM). It should be noted that the memory of the systems and methods described herein is intended to include, but is not limited to, these and any other suitable types of memory.
在上述实施例中,可以全部或部分地通过软件、硬件、固件或者其任意组合来实现。当使用软件实现时,可以全部或部分地以计算机程序产品的形式实现。所述计算机程序产品包括一个或多个计算机指令。在计算机上加载和执行所述计算机指令时,全部或部分地产生按照本申请实施例所述的流程或功能。所述计算机可以是通用计算机、专用计算机、计算机网络、或者其他可编程装置。所述计算机指令可以存储在计算机可读存储介质中,或者从一个计算机可读存储介质向另一个计算机可读存储介质传输,例如,所述计算机指令可以从一个网站站点、计算机、服务器或数据中心通过有线(例如同轴电缆、光纤、数字用户线(digital subscriber line,DSL))或无线(例如红外、无线、微波等)方式向另一个网站站点、计算机、服务器或数据中心进行传输。所述计算机可读存储介质可以是计算机能够存取的任何可用介质或者是包含一个或多个可用介质集成的服务器、数据中心等数据存储设备。所述可用介质可以是磁性介质(例如,软盘、硬盘、磁带)、光介质(例如,高密度数字视频光盘(digital video disc,DVD))、或者半导体介质(例如,固态硬盘(solid state disc,SSD))等。In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer instructions are loaded and executed on a computer, the process or function described in the embodiment of the present application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions can be transmitted from one website, computer, server or data center to another website, computer, server or data center by wired (such as coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (such as infrared, wireless, microwave, etc.) means. The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device such as a server or data center that includes one or more available media integrated. The available medium may be a magnetic medium (e.g., a floppy disk, a hard disk, a magnetic tape), an optical medium (e.g., a high-density digital video disc (DVD)), or a semiconductor medium (e.g., a solid state disc (SSD)), etc.
上述各个装置实施例中的单元和方法实施例中的电子设备完全对应,由相应的模块或单元执行相应的步骤,例如收发单元(收发器)执行方法实施例中接收或发送的步骤,除发送、接收外的其它步骤可以由处理单元(处理器)执行。具体单元的功能可以参考相应的方法实施例。其中,处理器可以为一个或多个。The units in the above-mentioned various apparatus embodiments completely correspond to the electronic devices in the method embodiments, and the corresponding modules or units perform the corresponding steps. For example, the transceiver unit (transceiver) performs the receiving or sending steps in the method embodiments, and other steps except sending and receiving can be performed by the processing unit (processor). The functions of the specific units can be referred to the corresponding method embodiments. Among them, there can be one or more processors.
可以理解的,本申请实施例中,电子设备可以执行本申请实施例中的部分或全部步骤,这些步骤或操作仅是示例,本申请实施例还可以执行其它操作或者各种操作的变形。此外,各个步骤可以按照本申请实施例呈现的不同的顺序来执行,并且有可能并非要执行本申请实施例中的全部操作。It is understood that in the embodiments of the present application, the electronic device can perform some or all of the steps in the embodiments of the present application. These steps or operations are merely examples, and the embodiments of the present application can also perform other operations or variations of various operations. In addition, the various steps can be performed in a different order than those presented in the embodiments of the present application, and it is possible that not all operations in the embodiments of the present application need to be performed.
本领域普通技术人员可以意识到,结合本文中所公开的实施例描述的各示例的单元及算法步骤,能够以电子硬件、或者计算机软件和电子硬件的结合来实现。这些功能究竟以硬件还是软件方式来执行,取决于技术方案的特定应用和设计约束条件。专业技术人员可以对每个特定的应用来使用不同方法来实现所描述的功能,但是这种实现不应认为超出本申请的范围。Those skilled in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.
所属领域的技术人员可以清楚地了解到,为描述的方便和简洁,上述描述的系统、装置和单元的具体工作过程,可以参考前述方法实施例中的对应过程,在此不再赘述。Those skilled in the art will clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.
在本申请所提供的几个实施例中,应该理解到,所揭露的系统、装置和方法,可以通过其它的方式实现。例如,以上所描述的装置实施例仅仅是示意性的,例如,所述单元的划分,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式,例如多个单元或组件可以结合或者可以集成到另一个系统,或一些特征可以忽略,或不执行。另一点,所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些接口,装置或单元的间接耦合或通信连接,可以是电性,机械或其它的形式。In the several embodiments provided in this application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are merely schematic. For example, the division of the units is merely a logical function division. In actual implementation, there may be other division methods, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.
所述作为分离部件说明的单元可以是或者也可以不是物理上分开的,作为单元显示的部件可以是或者也可以不是物理单元,即可以位于一个地方,或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部单元来实现本实施例方案的目的。The units described as separate components may or may not be physically separate, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed across multiple network units. Some or all of these units may be selected to achieve the purpose of this embodiment according to actual needs.
另外,在本申请各个实施例中的各功能单元可以集成在一个处理单元中,也可以是各个单元单独物理存在,也可以两个或两个以上单元集成在一个单元中。In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.
所述功能如果以软件功能单元的形式实现并作为独立的产品销售或使用时,可以存储在一个计算机可读取存储介质中。基于这样的理解,本申请的技术方案本质上或者说做出贡献的部分或者该技术方案的部分可以以软件产品的形式体现出来,该计算机软件产品存储在一个存储介质中,包括若干指令用以使得一台计算机设备(可以是个人计算机,服务器,或者网络设备等)执行本申请各个实施例所述方法的全部或部分步骤。而前述的存储介质包括:U盘、移动硬盘、只读存储器ROM、随机存取存储器RAM、磁碟或者光盘等各种可以存储程序代码的介质。If the functions are implemented in the form of software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application, or the part that contributes or the part of the technical solution, can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes several instructions for enabling a computer device (which can be a personal computer, server, or network device, etc.) to execute all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory ROM, a random access memory RAM, a magnetic disk or an optical disk.
以上所述,仅为本申请的具体实施方式,但本申请的保护范围并不局限于此,任何熟悉本技术领域的技术人员在本申请揭露的技术范围内,可轻易想到变化或替换,都应涵盖在本申请的保护范围之内。The above is only a specific implementation method of the present application, but the scope of protection of the present application is not limited thereto. Any technician familiar with this technical field can easily think of changes or replacements within the technical scope disclosed in this application, which should be covered by the scope of protection of the present application.
Claims (39)
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202410396147.0 | 2024-03-30 | ||
| CN202410396147.0A CN120762315A (en) | 2024-03-30 | 2024-03-30 | Environmental detection method and related device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2025209316A1 true WO2025209316A1 (en) | 2025-10-09 |
Family
ID=97238297
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/CN2025/085467 Pending WO2025209316A1 (en) | 2024-03-30 | 2025-03-27 | Environment detection methods and related apparatus |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN120762315A (en) |
| WO (1) | WO2025209316A1 (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20150221142A1 (en) * | 2014-02-05 | 2015-08-06 | Harman International Industries, Incorporated | Self-monitoring and alert system for intelligent vehicle |
| CN110816474A (en) * | 2019-09-26 | 2020-02-21 | 四川野马汽车股份有限公司 | Anti-theft system and method based on 360-degree look-around |
| CN116709482A (en) * | 2023-06-05 | 2023-09-05 | 上海赫千电子科技有限公司 | Collision safety monitoring system based on vehicle-mounted Ethernet |
| CN117227659A (en) * | 2023-09-08 | 2023-12-15 | 岚图汽车科技有限公司 | A vehicle control method and device |
| CN117360410A (en) * | 2023-10-11 | 2024-01-09 | 北斗星通智联科技有限责任公司 | Low-power-consumption sentinel mode implementation method and device, computer equipment and storage medium |
-
2024
- 2024-03-30 CN CN202410396147.0A patent/CN120762315A/en active Pending
-
2025
- 2025-03-27 WO PCT/CN2025/085467 patent/WO2025209316A1/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20150221142A1 (en) * | 2014-02-05 | 2015-08-06 | Harman International Industries, Incorporated | Self-monitoring and alert system for intelligent vehicle |
| CN110816474A (en) * | 2019-09-26 | 2020-02-21 | 四川野马汽车股份有限公司 | Anti-theft system and method based on 360-degree look-around |
| CN116709482A (en) * | 2023-06-05 | 2023-09-05 | 上海赫千电子科技有限公司 | Collision safety monitoring system based on vehicle-mounted Ethernet |
| CN117227659A (en) * | 2023-09-08 | 2023-12-15 | 岚图汽车科技有限公司 | A vehicle control method and device |
| CN117360410A (en) * | 2023-10-11 | 2024-01-09 | 北斗星通智联科技有限责任公司 | Low-power-consumption sentinel mode implementation method and device, computer equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN120762315A (en) | 2025-10-10 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP2905704B1 (en) | Self-monitoring and alert system for intelligent vehicle | |
| CN109649407B (en) | Vehicle safety system using sensor data | |
| EP3549116B1 (en) | Vehicle surveillance | |
| CN114387705A (en) | Vehicle intelligent monitoring method and system, vehicle-mounted controller and acceleration sensor | |
| CN107976989A (en) | Comprehensive vehicle intelligent safety monitoring system and monitoring method | |
| CN115649111B (en) | Vehicle exterior monitoring method, device, electronic device, and storage medium | |
| US10524295B2 (en) | Environmental surveillance system and method of driving portable information capture device | |
| US20210188213A1 (en) | System and method for using on-vehicle sensors for security monitoring | |
| CN116653857A (en) | Vehicle sentinel monitoring method, system, monitoring device and controller | |
| CN114435244A (en) | A vehicle door switch obstacle detection method, device, device and medium | |
| CN105196973A (en) | Automobile monitoring system | |
| WO2025209316A1 (en) | Environment detection methods and related apparatus | |
| CN214796238U (en) | Vehicle electronic sentinel early warning monitoring system | |
| US20220084379A1 (en) | Video pre-recording method, video camera and electronic device | |
| CN115465225A (en) | Service life prolonging method and device of vehicle-mounted camera, vehicle and storage medium | |
| CN106408829A (en) | Internet-based remote intelligent anti-theft alarm system | |
| CN204978556U (en) | Automobile monitoring system | |
| CN118501882B (en) | A Collision Detection Method and System Based on UWB Technology for Vehicles at Stationary Status | |
| US12541945B2 (en) | Monitoring device, monitoring system, and monitoring method | |
| US20240340544A1 (en) | Data collection method and system, and apparatus | |
| CN219456895U (en) | Parking monitoring system, vehicle-mounted recorder and vehicle | |
| US20250392683A1 (en) | Vehicle Video Recording Device and Method of Controlling The Same | |
| CN113232600B (en) | Vehicle monitoring device and method | |
| WO2025086667A1 (en) | Sentry mode control method, and device | |
| CN121121886A (en) | Data processing methods and related devices |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 25781613 Country of ref document: EP Kind code of ref document: A1 |