DE102019212408B4 - Method for determining body weight and/or seat position, control unit and motor vehicle - Google Patents

Abstract

Method for determining the body weight and/or the seating position of a vehicle occupant (F) of a motor vehicle (10) with the following steps:
- Obtaining an image (B) of the vehicle occupant (F) from a camera (20) of the motor vehicle (10),
- determining at least one body feature (M) of the vehicle occupant (F) based on the image (B) by a feature module (24) of the motor vehicle (10), and
- Determining the body weight and/or the sitting position by a classical machine learning module (26) based on the at least one determined body feature (M), wherein the classical machine learning module (26) uses a symbolic approach to machine learning, characterized in that the feature module (24) uses a classical machine learning method, in particular with a symbolic approach, when determining the at least one body feature (M).

Description

The invention relates to a method for determining the body weight and/or the seating position of a vehicle occupant of a motor vehicle, a control device for a motor vehicle and a motor vehicle.

Modern motor vehicles, such as cars and trucks, have safety systems, such as seat belt systems and gas bag modules, the protective effect of which can be optimized if they are appropriately tailored to the vehicle occupant of the respective seat. The weight and/or seating position of the vehicle occupant are particularly important.

However, control units of motor vehicles, in particular for safety-relevant systems, should be designed to be as resource-efficient and robust, i.e. with as little complexity as possible. It is therefore the object of the invention to provide a method for determining the body weight and/or the seating position of a vehicle occupant that can be implemented in a robust and resource-efficient manner.

• - Erhalten eines Bildes des Fahrzeuginsassen von einer Kamera des Fahrzeugs,
• - Ermitteln von wenigstens einem Körpermerkmal des Fahrzeuginsassen anhand des Bildes durch ein Merkmalmodul des Fahrzeugs, und
• - Ermitteln des Körpergewichts und/oder der Sitzposition durch ein klassisches Maschinenlernmodul anhand des wenigstens einen ermittelten Körpermerkmals.

The problem is solved by a method for determining the body weight and/or the seating position of a vehicle occupant of a motor vehicle, comprising the following steps:

• - Obtaining an image of the vehicle occupant from a vehicle camera,
• - Determining at least one body feature of the vehicle occupant based on the image by a feature module of the vehicle, and
• - Determining the body weight and/or the sitting position by a classic machine learning module based on the at least one determined body characteristic.

By using a classic machine learning module, a particularly robust, reliable and resource-saving determination of the body weight and/or seating position of the vehicle occupant is possible.

In the context of this invention, a classic machine learning module is understood to be a machine learning module that is not or does not comprise an artificial neural network.

For example, several different physical characteristics are identified and taken into account.

In one embodiment, a safety system, in particular a seat belt system and/or a restraint system, is controlled depending on the determined body weight and/or the determined seating position in order to be able to optimally adapt the safety system to the vehicle occupant.

For example, the classic machine learning module uses a symbolic approach to machine learning, which determines body weight and/or sitting position in a resource-efficient but reliable manner.

In one embodiment, the machine learning module uses a classification method, in particular a random forest, when determining the body weight and/or the sitting position. This allows the body weight and/or the sitting position to be determined quickly.

Alternatively or additionally, the machine learning module can use a regression method, in particular a support vector machine, when determining the body weight and/or the sitting position, which enables a particularly reliable determination.

For example, the image is pre-processed, in particular by segmenting the body of the vehicle occupant, so that the determination of body weight and/or seating position can be further simplified.

For robust recognition of body parts, the feature module can determine the at least one body feature using a machine image recognition method, in particular using the Canny algorithm. In particular, camera parameters, for example calibration parameters, can be taken into account.

In order to provide a particularly resource-saving method, the feature module can use a classic machine learning method, in particular with a symbolic approach, when determining the at least one body feature.

For example, a random forest, i.e. a classification method consisting of several uncorrelated decision trees, can be used.

In one embodiment of the method, the feature module uses an artificial neural network when determining the at least one body feature, whereby a plurality of different body features can be distinguished.

For example, the feature module has an artificial neural network.

For example, the at least one body characteristic is the height of the body, in particular of the upper body, the width of the body, in particular the upper body, the arm length of at least one arm, the abdominal circumference, the orientation of the upper body, the orientation of the head and/or the orientation of at least one arm, whereby the body weight and/or the sitting position can be precisely determined.

The orientation is determined, for example, relative to other parts of the body or to a part fixed to the vehicle, such as the seat or the B-pillar.

In order to further increase the effectiveness of the method, the at least one body characteristic used to determine the body weight and/or the sitting position can be selected by means of at least one data mining method.

In one embodiment of the invention, the image is a recording of the vehicle occupant sitting on a corresponding seat of the motor vehicle, whereby the body characteristics are determined in the relevant situation, in particular in the position relevant for the safety system.

Furthermore, the object is achieved by a control device for a motor vehicle which is configured to carry out one of the methods described above.

The task is also solved by a motor vehicle with a camera and a previously described control unit.

The features and advantages explained for the method apply accordingly to the control unit and the motor vehicle and vice versa.

• - 1 schematisch ein erfindungsgemäßes Kraftfahrzeug mit einem erfindungsgemäßen Steuergerät,
• - 2 zeigt äußerst schematisch ein Bild eines Fahrzeuginsassen, und
• - 3 ein Ablaufdiagramm eines erfindungsgemäßen Verfahrens.

Further features and advantages of the invention will become apparent from the following description and from the accompanying drawings, to which reference is made. In the drawings:

• - 1 schematically a motor vehicle according to the invention with a control unit according to the invention,
• - 2 shows a very schematic picture of a vehicle occupant, and
• - 3 a flow chart of a method according to the invention.

1 shows a schematic of a motor vehicle 10, here a passenger car. It is of course also conceivable that the motor vehicle 10 is a truck.

The motor vehicle 10 has a seat 12 on which a vehicle occupant F, here the driver of the motor vehicle 10, is seated.

Furthermore, the motor vehicle 10 has a steering wheel 14 in which a restraint system 16, e.g. a gas bag module, is arranged, a safety belt system 18 ( 3 ), a camera 20 directed towards the seat 12, and a control unit 22.

The control unit 22 is connected to the restraint system 16, the seat belt system 18 and the camera 20 for data exchange and in particular controls the restraint system 16, the seat belt system 18 and the camera 20.

The control unit 22 also has a feature module 24 and a classic machine learning module 26.

In 2 schematically shows an image B of the seat 12 together with the vehicle occupant F, which was recorded by means of the camera 20 and which is used by the control unit 22 to determine the body weight and/or the seating position of the vehicle occupant F.

For this purpose, the control unit 22 carries out the 3 described procedures.

In a first step S1, the camera 20 takes an image B of the vehicle occupant F, as shown, for example, in 2 is shown.

In the next step S2, the camera 20 transmits the image B to the control unit 22, which accordingly receives the image B.

The image B is preprocessed by the control unit 22 in a next step S3. The body of the vehicle occupant F is segmented. Other objects fixed to the vehicle can also be recognized and segmented, such as the seat 12 or the B-pillar 28 of the motor vehicle 10.

Already in this step, a Canny algorithm (Canny edge detector) can be used for edge detection.

Parameters of the camera 20, in particular calibration parameters, can also be taken into account.

In a next step S4, the preprocessed image is passed on to the feature module 24 and processed there.

The feature module 24 determines at least one body feature M of the vehicle occupant F on the basis of the preprocessed image B.

A body characteristic M can be, for example, the height of the upper body M ₁ , the width of the upper body M ₂ , the arm length M ₃ , the Abdominal circumference M ₄ and/or the orientations of the various body parts to each other or to a vehicle-fixed part, such as the seat 12 or the B-pillar 28.

For example, the orientation of the upper body, the orientation of the head and/or the orientation of the arms are determined as body characteristics M.

Either the length and/or orientation of one of the arms, both arms separately, or both arms together can be determined.

The feature module 24 determines those body features M that have been predetermined and selected beforehand, for example at the factory.

The selection of which body characteristics M are suitable for determining body weight and/or sitting position and should be used was determined in a preceding step S0.

The determination is made, for example, using a data mining procedure, manually or in another suitable manner.

The feature module 24 uses a classic machine learning method with a symbolic approach to determine the body features M, for example, and not an artificial neural network. For example, a random forest is used.

In addition, the feature module 24 may perform a machine vision process, e.g. using a Canny algorithm and/or at least one camera parameter, such as a calibration parameter of the camera.

Alternatively or in addition to the classic machine learning method, it is also conceivable that the feature module 24 uses an artificial neural network when determining the at least one body feature M. For this purpose, the feature module 24 then has, for example, an artificial neural network 30.

The determined body characteristics M are then transmitted to the classic machine learning module 26 of the control unit 22 in a next step S5.

In step S6, the classical machine learning module 26 determines the weight and/or the seating position of the vehicle occupant F based on the determined body characteristics M.

The classic machine learning module 26 does not use an artificial neural network, but rather a symbolic approach to machine learning.

For example, a classification method, in particular a random forest, is used to determine the body weight and/or the seating position of the vehicle occupant F based on the body characteristics M.

Alternatively or additionally, the machine learning module 26 can use a regression method, for example a support vector machine, to determine the weight and/or position of the vehicle occupant F.

Regardless of whether one, both or a combination of these methods is used, the classical machine learning module 26 receives the body weight and/or the seating position of the vehicle occupant F.

In a next step S7, the control unit 22 controls the seat belt system 18, the restraint system 16 and/or other restraint systems of the motor vehicle 10 on the basis of the determined weight and/or the determined seat position.

For example, in the case of a heavy vehicle occupant, a belt tensioner of the seat belt system 18 is given a command to tighten the seat belt more.

The restraint system 16 can be controlled such that different chambers of the gas bag are inflated or not inflated in the restraint case, depending on whether the vehicle occupant is heavy or less heavy or whether the seating position is upright or more reclining.

Due to the use of a classic machine learning module, the resources required to determine the body weight and/or the seating position of the control unit 22 are reduced. In addition, the effort required to train the classic machine learning module 26 is significantly reduced.

reference sign

10

motor vehicle

12

seat

14

steering wheel

16

restraint system

18

seat belt system

20

camera

22

control unit

24

feature module

26

classic machine learning module

28

B-pillar

30

artificial neural network

B

Picture

F

vehicle occupant

M

physical feature

Claims (12)

Method for determining the body weight and/or the seating position of a vehicle occupant (F) of a motor vehicle (10), comprising the following steps: - obtaining an image (B) of the vehicle occupant (F) from a camera (20) of the motor vehicle (10), - determining at least one body feature (M) of the vehicle occupant (F) based on the image (B) by a feature module (24) of the motor vehicle (10), and - determining the body weight and/or the seating position by a classic machine learning module (26) based on the at least one determined body feature (M), wherein the classic machine learning module (26) uses a symbolic approach to machine learning, characterized in that the feature module (24) uses a classic machine learning method, in particular with a symbolic approach, when determining the at least one body feature (M). procedure according to claim 1 , characterized in that a safety system, in particular a seat belt system (18) and/or a restraint system (16) is controlled as a function of the determined body weight and/or the determined seating position. procedure according to claim 1 or 2 , characterized in that the machine learning module (26) uses a classification method, in particular a random forest, when determining the body weight and/or the sitting position. Method according to one of the preceding claims, characterized in that the machine learning module (26) uses a regression method, in particular a support vector machine, when determining the body weight and/or the sitting position. Method according to one of the preceding claims, characterized by preprocessing the image (B), in particular by segmenting the body of the vehicle occupant (F). Method according to one of the preceding claims, characterized in that the feature module (24) determines the at least one body feature (M) by means of a machine image recognition method, in particular using the Canny algorithm. Method according to one of the preceding claims, characterized in that the feature module (24) uses an artificial neural network (30) in determining the at least one body feature (M). Method according to one of the preceding claims, characterized in that the at least one body feature (M) is the height of the body (M ₁ ), in particular of the upper body, the width of the body (M ₂ ), in particular of the upper body, the arm length (M ₃ ) of at least one arm, the abdominal circumference (M ₄ ), the orientation of the upper body, the orientation of the head and/or the orientation of at least one arm. Method according to one of the preceding claims, characterized in that the at least one body characteristic (M) used to determine the body weight and/or the sitting position is selected by means of at least one data mining method. Method according to one of the preceding claims, characterized in that the image (B) is a picture of the vehicle occupant (F) sitting on a corresponding seat (12) of the motor vehicle (10). Control device for a motor vehicle (10), which is designed to carry out a method according to one of the preceding claims. Motor vehicle with a camera (20) and a control unit (22) according to claim 11 .

Images