CN111818497A - An electric tailgate automatic opening system, method, device and storage medium - Google Patents

Abstract

The invention relates to an electric tailgate automatic opening system, method, equipment and storage medium. The electric tailgate opening system utilizes bluetooth, vehicle motion and static detection, human body detection, motion recognition and the like to form a complete opening process. The electric tailgate opening system is easy to open, safe, low cost, and excellent in user experience.

Description

An electric tailgate automatic opening system, method, device and storage medium

technical field

The present invention relates to the technical field of automobiles, and in particular, to an electric tailgate automatic opening system, method, device and storage medium.

Background technique

Guangzhou Automobile Group Co., Ltd. applied for the patent of "Automotive Tailgate Opening Control System, Method and Device", the application number is CN201710157339.6, and the publication number is CN106882023A. In this patent, a sensor module is used to detect the kicking action in its detection area, and determine whether the kicking action is correct. The body control module receives the tailgate opening request, and controls the vehicle's tailgate to be unlocked. The patent requires the vehicle to install additional motion-sensing modules to intelligently control the tailgate. The solution of the present invention can directly utilize the vehicle's original surround-view camera and the vehicle-mounted computing platform to realize the function of intelligently controlling the tailgate.

Shenzhen Anyi Innovation Technology Co., Ltd. applied for a patent for "a device for automatically opening a car tailgate by kicking induction", the application number is CN201621351899.2, and the publication number is CN206337968U. The patent designs a new type of kick-sensing auto-opening tailgate device, including a kick-sensing device and an electric tailgate control ECU. The kick sensor designed by the patent is based on the capacitive method. People need to stand in a suitable position to kick the foot. It cannot be triggered if it is too close or too far away from the car, and it is not sensitive enough. In addition, the rear bumper is a vulnerable part, which has a high probability of being collided and is easily damaged.

The vision-based electric tailgate opening system proposed by Chery, the patent mainly discusses the use of the vehicle electronic infotainment system and the rear-view camera for motion recognition, but the algorithm for human motion recognition is only template matching. It has been proposed in the aforementioned patent 2018108705507. Also in the Chery company's patent is not suitable for the aftermarket.

SUMMARY OF THE INVENTION

The purpose of the present invention is to provide an electric tailgate automatic opening system, method, device and storage medium in order to overcome the above-mentioned defects of the prior art.

The object of the present invention can be realized through the following technical solutions:

An electric tailgate automatic opening system, the system includes a main control logic unit at the vehicle end, a secondary control logic unit at the user mobile phone end, a motion detection module, a vehicle end Bluetooth identification communication module, a user mobile phone end Bluetooth identification communication module, tailgate control output module, vehicle rearview camera acquisition module, motion recognition module and vehicle owner identification module, wherein:

The main control logic unit on the vehicle side is used for the system self-checking and control logic on the vehicle side of the system, as well as the interaction with the motion detection module on the vehicle side, the bluetooth identification communication module on the vehicle side, and the tailgate control output module;

The secondary control logic unit of the user's mobile phone is used for the system self-checking and control logic of the user's mobile phone of the system, as well as the communication between the action recognition module, the Bluetooth identification communication module and the vehicle owner identification module of the user's mobile phone. interact;

The tailgate control output module is used for converting and outputting the result of the main control logic unit at the vehicle end into an electrical signal for controlling the tailgate;

The motion detection module is used to detect whether the vehicle is in a motion state when the vehicle-side Bluetooth identification communication module detects the user's mobile phone and is connected and paired with it;

The vehicle-side Bluetooth identification communication module is used to detect the user's mobile phone signal and connect and pair with the user's mobile phone-side Bluetooth identification communication module; when the vehicle rearview camera acquisition module collects images, it assists in sending the collected images; when the collected images pass the After identification, receive the door opening instruction issued by the bluetooth identification communication module on the mobile phone of the user; when the vehicle tailgate switch is opened to open the door, send the opened state indication to the bluetooth identification communication module on the mobile phone of the user;

The bluetooth identification communication module on the mobile phone of the user is used for connecting and pairing with the bluetooth identification communication module on the vehicle side after it is turned on; after receiving the heartbeat signal of the main control logic unit of the vehicle side, it receives the bluetooth from the vehicle side. Identify the collected image sent by the assistance of the communication module; send a door opening command to the vehicle-side bluetooth identification communication module after the collected image is identified; receive the opened state sent by the vehicle-side Bluetooth identification communication module after the vehicle tailgate switch opens the door instruct;

The vehicle rear-view camera acquisition module is configured to acquire an image of the rear area of the vehicle in real time from the rear-view camera at the rear of the vehicle when the motion detection module detects and determines that the vehicle is not in a motion state;

The motion recognition module is used to perform door opening motion recognition for the image after the user mobile phone Bluetooth recognition communication module receives the image;

The vehicle owner identification module is used to perform vehicle owner identification on the image after the user mobile phone Bluetooth identification communication module receives the captured image.

Further, the system further includes a vehicle owner interaction setting module arranged on the user's mobile phone and interactively controlled by the secondary control logic unit of the user's mobile phone and used for allowing the vehicle owner to set the user's mobile phone.

The present invention also provides an opening method based on the electric tailgate automatic opening system, the method comprising the following steps:

Step 1: When the self-check of the whole system is normal at the vehicle end, the user's mobile phone is detected by the Bluetooth identification communication module at the vehicle end, and at the same time, when the Bluetooth is turned on at the user mobile phone end, the Bluetooth identification communication module at the user mobile phone end communicates with the user's mobile phone. Vehicle-side Bluetooth identification communication module Bluetooth pairing;

Step 2: Use the motion detection module to detect whether the vehicle is in motion;

Step 3: When the motion detection module detects and judges that the vehicle is not in motion, use the vehicle rear-view camera acquisition module to collect the image of the rear area of the vehicle in real time, and use the vehicle-side Bluetooth identification communication module to assist in sending the collected image to the User mobile phone Bluetooth identification communication module;

Step 4: After receiving the heartbeat signal of the main control logic unit on the vehicle side, the bluetooth identification and communication module on the mobile phone of the user receives the captured image sent with the assistance of the bluetooth identification and communication module on the vehicle side;

Step 5: Use the motion recognition module and the vehicle owner identity recognition module to perform door opening motion recognition and vehicle owner identity recognition for the received collected images respectively;

Step 6: When the door opening action recognition and the vehicle owner identity recognition are simultaneously recognized accurately, the user mobile phone Bluetooth identification communication module sends the door opening instruction to the vehicle end Bluetooth identification communication module;

Step 7: After receiving the door opening instruction, the vehicle-side Bluetooth identification communication module turns on the tailgate switch to open the door.

Further, the method further includes: when the self-check of the whole system is abnormal, the vehicle-side Bluetooth identification and communication module does not detect the user's mobile phone, the vehicle-side Bluetooth identification and communication module assists in sending the collected images and there is an abnormality, and the vehicle rear view is abnormal. When the camera acquisition module collects the rear image of the vehicle in real time and there is an abnormality, and the vehicle-side Bluetooth identification communication module times out and does not receive the door opening instruction, it returns to the indicator back to the manual mode state.

Further, the method also includes: when the result of the action recognition module for the recognition of the door opening action of the received captured image is no, no action is performed and triggering to return to the user mobile phone Bluetooth recognition communication module to receive the heartbeat signal of the tailgate of the vehicle. state.

Further, the method also includes: when the result of the vehicle owner identification module for the received vehicle owner identification of the collected image is no, no action is performed and a trigger is returned to the user mobile phone Bluetooth identification communication module to receive the heartbeat of the tailgate of the vehicle. Signal status.

Further, the step 7 specifically includes: after the vehicle-side Bluetooth identification and communication module receives the door-opening instruction, the tailgate control output module is used to turn on the tailgate switch to open the door, and at the same time, return to send a door-opened state indication to the user's mobile phone terminal. Bluetooth identification communication module.

The present invention also provides a computer device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, when the processor executes the computer program, the processor implements the based on the computer program. The steps of the opening method of the electric tailgate automatic opening system described above.

The present invention also provides a computer-readable storage medium, where the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the opening method based on the electric tailgate automatic opening system is implemented A step of.

Compared with the prior art, the present invention has the following advantages:

(1) The present invention proposes an electric tailgate automatic opening system, which includes a main control logic unit at the vehicle end, a secondary logic control unit at the mobile phone end, a tailgate control output module, a motion detection module, a vehicle end Bluetooth identification communication module, The Bluetooth identification communication module on the user's mobile phone, the vehicle rear-view camera acquisition module, the action identification module and the vehicle owner identification module use Bluetooth, vehicle motion detection, human detection, and motion identification to form a complete opening process. The electric tailgate opening system is easy to open, safe, low cost, and excellent in user experience.

(2) The present invention proposes an opening method matched with an opening system, including step 1: when the self-check of the whole system is normal at the vehicle end, the user's mobile phone is detected by the Bluetooth identification communication module at the vehicle end, and at the same time, the user's mobile phone is used as a Bluetooth When turned on, the Bluetooth identification communication module on the user's mobile phone is paired with the Bluetooth identification communication module at the vehicle end; Step 2: Use the motion detection module to detect whether the vehicle is in motion; Step 3: When the motion detection module detects and determines that the vehicle is not in motion In the state, use the vehicle rearview camera acquisition module to collect the vehicle tail image in real time, and use the vehicle-side Bluetooth identification communication module to assist in sending the collected image to the user's mobile phone-side Bluetooth identification and communication module; Step 4: When the user's mobile phone-side Bluetooth identification and communication module receives the vehicle After receiving the heartbeat signal of the main control logic unit at the end of the vehicle, the collected image sent with the assistance of the vehicle-side Bluetooth identification communication module is received; Step 5: Use the motion identification module and the vehicle owner identification module to perform door opening action identification and Vehicle owner identification; Step 6: When the door opening action recognition and the vehicle owner identification are both accurately identified, the user mobile phone Bluetooth identification communication module sends the door opening command to the vehicle Bluetooth identification communication module; Step 7: The vehicle Bluetooth identification communication module receives the door opening command Then turn on the tailgate switch to open the door, and use bluetooth, vehicle motion detection, human body detection, motion recognition and other methods to form a complete opening process, which is suitable for car after-installation.

(3) The opening method of the present invention also includes many steps in consideration of safety, and the method is more comprehensive.

Description of drawings

Fig. 1 is a system frame diagram of the present invention;

Fig. 2 is the flow chart of the vehicle end in the method of the present invention;

FIG. 3 is a flowchart of the method of the present invention on the mobile phone of the user.

Detailed ways

The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, but not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative work shall fall within the protection scope of the present invention.

Example

Figure 1 shows a frame diagram of an electric tailgate automatic opening system of the present invention. The system includes a main control logic unit at the vehicle end, a secondary logic control unit at the mobile phone end, a motion detection module, a Bluetooth identification communication module at the vehicle end, and a tailgate. Control output module, user mobile phone terminal Bluetooth identification communication module, vehicle rearview camera acquisition module, motion identification module and vehicle owner identification module, among which:

The main control logic unit on the vehicle side is used for the system self-checking and control logic on the vehicle side of the system, as well as the interaction with the motion detection module on the vehicle side, the Bluetooth identification communication module on the vehicle side, and the tailgate control output module.

The secondary control logic unit of the user's mobile phone is used for the system self-checking and control logic of the user's mobile phone, as well as the action recognition module of the user's mobile phone, the Bluetooth identification communication module of the user's mobile phone, the vehicle owner identification, and the vehicle owner interaction settings. interaction.

The tailgate control output module is used to convert the result of the control logic unit at the vehicle end into an electrical signal for controlling the tailgate.

The motion detection module is used to detect whether the vehicle is in a motion state when the vehicle-side Bluetooth identification communication module detects the user's mobile phone and is connected and paired with it;

The vehicle-side Bluetooth identification communication module is used to detect the user's mobile phone signal and connect and pair with the user's mobile phone-side Bluetooth identification communication module; when the vehicle rear-view camera acquisition module collects images, it assists in sending the collected images; when the collected images pass the identification, they are received by the user's mobile phone. The door opening command issued by the Bluetooth identification communication module of the terminal; when the tailgate switch of the vehicle opens the door, it sends the opened status indication to the Bluetooth identification communication module of the user mobile phone;

The Bluetooth identification communication module on the user's mobile phone is used to connect and pair with the Bluetooth identification communication module on the vehicle side when it is turned on; after receiving the heartbeat signal of the tailgate of the vehicle, it receives the collected image sent with the assistance of the Bluetooth identification communication module on the vehicle side; when the image is collected After identification, the door opening command is sent to the vehicle-side Bluetooth identification communication module; when the vehicle tailgate switch opens the door, the vehicle-side Bluetooth identification communication module sends an open-door status indication;

The vehicle rear view camera acquisition module is used to collect the rear image of the vehicle in real time when the motion detection module detects and judges that the vehicle is not in motion;

The action recognition module is used to recognize the door opening action on the image after the Bluetooth recognition communication module on the user's mobile phone receives the captured image;

The vehicle owner identification module is used to identify the vehicle owner according to the image after receiving the captured image by the Bluetooth identification communication module on the user's mobile phone;

The car owner interaction setting module is used to allow the car owner to set the user's mobile phone.

Figure 2 and Figure 3 are the flow charts of the vehicle tailgate opening method matched with the system of the present invention on the vehicle end and the user's mobile phone end, which are comprehensively summarized as the following steps:

Step 1: When the self-check of the whole system is normal on the vehicle side, the user's mobile phone is detected through the vehicle-side Bluetooth identification communication module. At the same time, when the Bluetooth is turned on on the user's mobile phone side, the user's mobile phone side Bluetooth identification communication module and vehicle-side Bluetooth identification communication module Bluetooth pairing;

Step 2: Use the motion detection module to detect whether the vehicle is in motion;

Step 3: When the motion detection module detects and determines that the vehicle is not in motion, the vehicle rear view camera acquisition module is used to collect the rear image of the vehicle in real time, and the vehicle-side Bluetooth identification and communication module is used to assist in sending the collected image to the user's mobile phone-side Bluetooth identification and communication module;

Step 4: After receiving the heartbeat signal of the main control logic unit of the vehicle end by the Bluetooth identification communication module on the mobile phone of the user, receive the image of the rear area of the vehicle collected by the vehicle rearview camera acquisition module with the assistance of the Bluetooth identification communication module at the vehicle end;

Step 5: Use the motion recognition module and the vehicle owner identity recognition module to respectively perform door opening action recognition and vehicle owner identity recognition for the received image of the rear area of the vehicle;

Step 6: When the door opening action recognition and the vehicle owner identity recognition are simultaneously recognized accurately, the user's mobile phone Bluetooth identification communication module sends the door opening instruction to the vehicle end Bluetooth identification communication module;

Step 7: After receiving the door opening command, the vehicle-side Bluetooth identification communication module turns on the tailgate switch to open the door. After receiving the door-opening command, the vehicle-side Bluetooth identification communication module turns on the tailgate switch to open the door through the tailgate control output module, and returns to send an open-door status indication. to the Bluetooth identification communication module of the user's mobile phone.

In addition, the method of the present invention further includes: when the self-check of the whole system is abnormal, the vehicle-side Bluetooth identification and communication module does not detect the user's mobile phone, the vehicle-side Bluetooth identification and communication module assists in sending the collected images, and the vehicle rear-view camera collection module is abnormal. If there is an abnormality in the real-time collection of the rear image of the vehicle and the Bluetooth identification communication module on the vehicle side does not receive the door opening command over time, it will return to the indicator and return to the manual mode state.

When the result of the action recognition module for the recognition of the door opening action of the received collected image is no, no action is performed, and it is triggered to return to the Bluetooth recognition communication module on the user's mobile phone to receive the heartbeat signal status of the tailgate of the vehicle;

When the result of the vehicle owner identification module for the received image collection is no, it does not take action and triggers the return to the user mobile phone Bluetooth identification communication module to receive the heartbeat signal status of the vehicle tailgate;

When the electric tailgate automatic opening system detects that the status of the Bluetooth identification communication module on the user's mobile phone is overtime and has not received the open-door status indication, it continues to receive, and when the status is overtime and has received the open-door status indication, it returns to detect whether the user's mobile phone Bluetooth is open. On state.

The above are only specific embodiments of the present invention, but the protection scope of the present invention is not limited to this. Any person skilled in the art can easily think of various equivalents within the technical scope disclosed by the present invention. Modifications or substitutions should be included within the protection scope of the present invention. Therefore, the protection scope of the present invention should be subject to the protection scope of the claims.

Claims (10)

1. The utility model provides an automatic system of opening of electronic tail-gate, its characterized in that, this system include the main control logic unit of vehicle end, the vice control logic unit of user's cell-phone end, motion detection module, vehicle end bluetooth identification communication module, user's cell-phone end bluetooth identification communication module, tail-gate control output module, vehicle rear view camera collection module, action identification module and car owner identity identification module, wherein:

the main control logic unit of the vehicle end is used for system self-checking and control logic of the vehicle end of the system and interaction among the motion detection module, the vehicle end Bluetooth identification communication module and the tail gate control output module of the vehicle end;

the auxiliary control logic unit of the user mobile phone end is used for the system self-checking and control logic of the user mobile phone end of the system and the interaction with the action recognition module, the user mobile phone end Bluetooth recognition communication module and the vehicle owner identity recognition module of the user mobile phone end;

the tail gate control output module is used for converting the result of the main control logic unit of the vehicle end into an electric signal for controlling the tail gate;

the motion detection module is used for detecting whether the vehicle is in a motion state or not when the vehicle-end Bluetooth identification communication module detects the mobile phone of the user and is connected and paired with the mobile phone;

the vehicle end Bluetooth identification communication module is used for detecting a user mobile phone signal and is connected and matched with the user mobile phone end Bluetooth identification communication module; when the vehicle rearview camera acquisition module acquires an image, assisting in sending the acquired image; when the collected image passes through identification, receiving a door opening instruction sent by a Bluetooth identification communication module at the mobile phone end of the user; when the vehicle tail door switch opens the door, the Bluetooth identification communication module at the user mobile phone end sends an opened state indication;

the user mobile phone end Bluetooth identification communication module is used for connecting and pairing with the vehicle end Bluetooth identification communication module after being started; receiving a collected image which is assisted to be sent by the vehicle end Bluetooth identification communication module after receiving a heartbeat signal of the main control logic unit of the vehicle end; when the collected image passes through the identification, a door opening instruction is sent to the vehicle-end Bluetooth identification communication module; when the vehicle tail door is opened and closed, receiving an opened state indication sent by the vehicle end Bluetooth identification communication module;

the vehicle rearview camera acquisition module is used for acquiring a vehicle tail area image in real time from a rearview camera at the tail of the vehicle when the motion detection module detects and judges that the vehicle is not in a motion state;

the action recognition module is used for carrying out door opening action recognition on the image after the Bluetooth recognition communication module at the user mobile phone end receives the image;

and the vehicle owner identity recognition module is used for recognizing the vehicle owner identity of the image after the user mobile phone end Bluetooth recognition communication module receives the collected image.

2. The system of claim 1, further comprising a car owner interaction setting module, arranged at the user's mobile phone end, interactively controlled by the sub control logic unit of the user's mobile phone end, for letting the car owner set the user's mobile phone end.

3. An opening method based on the automatic opening system of the electric tail gate as claimed in claim 1, characterized by comprising the following steps:

step 1: when the whole system is self-checked normally at the vehicle end, a user mobile phone is detected through the vehicle end Bluetooth identification communication module, and when the user mobile phone end is started, the user mobile phone end Bluetooth identification communication module is in Bluetooth pairing with the vehicle end Bluetooth identification communication module;

step 2: detecting whether the vehicle is in a motion state by utilizing the motion detection module;

and step 3: when the motion detection module detects and judges that the vehicle is not in a motion state, the vehicle rearview camera acquisition module is used for acquiring images of the tail area of the vehicle in real time, and the vehicle end Bluetooth identification communication module is used for assisting in sending the acquired images to the user mobile phone end Bluetooth identification communication module;

and 4, step 4: when a user mobile phone end Bluetooth identification communication module receives a heartbeat signal of a main control logic unit of the vehicle end, receiving an acquired image which is assisted to be sent by the vehicle end Bluetooth identification communication module;

and 5: the action recognition module and the vehicle owner identity recognition module are used for respectively carrying out door opening action recognition and vehicle owner identity recognition on the received collected image;

step 6: when the door opening action recognition and the vehicle owner identity recognition are simultaneously and accurately recognized, the user mobile phone end Bluetooth recognition communication module sends a door opening instruction to the vehicle end Bluetooth recognition communication module;

and 7: and the vehicle end Bluetooth identification communication module is connected with a tail gate switch to open the door after receiving the door opening instruction.

4. The opening method of the automatic opening system of the electric tail gate is characterized by further comprising the following steps: when the whole system is abnormally self-checked, the vehicle end Bluetooth recognition communication module does not detect a user mobile phone, the vehicle end Bluetooth recognition communication module assists in sending collected images which are abnormal, the vehicle rearview camera collection module collects images of the tail of the vehicle in real time which are abnormal, and the vehicle end Bluetooth recognition communication module returns to an index to a manual mode state when the vehicle end Bluetooth recognition communication module does not receive a door opening instruction overtime.

5. The opening method of the automatic opening system of the electric tail gate is characterized by further comprising the following steps: and when the door opening action recognition result of the action recognition module for the received collected image is negative, the action recognition module does not act and triggers the action to return to the state that the Bluetooth recognition communication module at the user mobile phone end receives the heartbeat signal of the tail door of the vehicle.

6. The opening method of the automatic opening system of the electric tail gate is characterized by further comprising the following steps: and when the vehicle owner identification module does not act and triggers to return to the user mobile phone end Bluetooth identification communication module to receive the state of the heartbeat signal of the tail door of the vehicle aiming at the received vehicle owner identification result of the collected image.

7. The opening method of the automatic opening system of the electric tail gate according to claim 3, wherein the step 7 specifically comprises: and after receiving a door opening instruction, the vehicle-end Bluetooth recognition communication module is connected with a tail door switch to open a door through the tail door control output module, and returns to send a door opening state indication to the user mobile phone-end Bluetooth recognition communication module.

8. The opening method of the automatic opening system of the electric tail gate is characterized by further comprising the following steps: when the automatic opening system of the electric tail gate detects that the state of the Bluetooth identification communication module at the user mobile phone end is overtime and does not receive the indication of the opened state, the automatic opening system continues to receive the state, and returns to detect whether the Bluetooth at the user mobile phone end is opened or not when the state is overtime and receives the indication of the opened state.

9. Computer device comprising a memory, a processor and a computer program stored in said memory and executable on said processor, characterized in that said processor, when executing said computer program, carries out the steps of the opening method according to any one of claims 3 to 8 based on said electric tailgate automatic opening system.

10. A computer-readable storage medium, in which a computer program is stored, which, when being executed by a processor, carries out the steps of the opening method according to any one of claims 3 to 8 based on the electric tailgate automatic opening system.

Images