CN116620312A - Human-vehicle interaction control method and device, equipment, system, vehicle and storage medium - Google Patents

Abstract

Embodiments of the present application provide a human-vehicle interaction control method and device, equipment, system, vehicle, and storage medium. The human-vehicle interaction control method includes: confirming whether the authority of the current operator outside the vehicle is qualified; if the authority of the current operator is qualified, obtaining the current vehicle status information and confirming whether the current vehicle status information is qualified; If the status information is qualified, the first action image of the current operator is obtained, and an interactive execution instruction that can be executed by the vehicle is generated and issued according to the first action image. The embodiments of the present application can achieve beneficial effects such as higher convenience of manipulation, unlimited types of manipulation, easy expansion, and better operational safety during the human-vehicle interaction process outside the vehicle.

Description

Human-vehicle interaction control method and device, equipment, system, vehicle, storage medium

technical field

The present application relates to the technical field of vehicle control, in particular, the present application relates to a human-vehicle interaction control method and device, equipment, system, vehicle, and storage medium.

Background technique

Since the development of the automobile industry, it has no longer purely pursued the mechanical performance of vehicles. In order to meet the changing needs of car owners, cars have begun to develop in the direction of intelligence, especially the personalized control of vehicles, such as: human-vehicle interaction outside the car .

The existing human-vehicle interaction outside the car is usually based on the remote control car key. Specifically, the operator controls the vehicle to unlock, lock, lift and lower the windows, start the engine, and turn on the car air conditioner by pressing the corresponding control key on the remote control car key. and so on.

However, the human-vehicle interaction based on such a method has disadvantages such as low control convenience, limited control types, and poor safety.

Contents of the invention

In view of the shortcomings of the existing methods, the present application proposes a human-vehicle interaction control method and device, equipment, system, vehicle, and storage medium to solve the problems in the prior art that the control convenience of human-vehicle interaction outside the vehicle is low, or the type of control Technical issues such as limited or poor security.

In the first aspect, the embodiment of the present application provides a human-vehicle interaction control method, including:

Confirm whether the authority of the current operator outside the vehicle is qualified;

If the authority of the current operator is qualified, obtain the current vehicle status information and confirm whether the current vehicle status information is qualified;

If the current vehicle state information is qualified, the first action image information of the current operator is obtained, and an interactive execution instruction executable by the vehicle is generated and issued according to the first action image information.

Optionally, confirm whether the authority of the current operator outside the vehicle is qualified, including:

Confirm whether there is a legal car key in the detection area outside the car;

If there is a legal car key in the detection area, obtain the facial image information of the current operator, and confirm whether the facial image information of the current operator matches the pre-recorded facial information;

If the facial image information of the current operator matches the pre-recorded face information, it is confirmed that the authority of the current operator is qualified.

Optionally, confirm whether the authority of the current operator outside the vehicle is qualified, including:

Confirm whether there is a legal car key in the detection area outside the car;

If there is a legal car key in the detection area, obtain the second action image information of the current operator, and confirm whether the second action image information of the current operator matches the pre-recorded unlock image information;

If the second action image information of the current operator matches the pre-recorded unlocking image information, it is confirmed that the authority of the current operator is qualified.

Optionally, obtain the current vehicle status information, and confirm whether the current vehicle status information is qualified, including any of the following:

Obtain the engine status information, if the engine status information is flameout, then confirm that the current vehicle status information is qualified;

Obtain the gear position status information, if the gear position status information is neutral or parking gear, then confirm that the current vehicle status information is qualified;

Obtain the information about the occupants in the vehicle. If the information about the occupants in the vehicle indicates that at least the main driving area and the co-driving area are unoccupied, then confirm that the current vehicle status information is qualified.

Optionally, obtain the information about the occupants in the vehicle. If the information about the occupants in the vehicle is that at least the main driving area and the co-driving area are unoccupied, then confirm that the current vehicle status information is qualified, including:

Obtain life information in the vehicle, if at least the main driving area and the co-driving area are inanimate, then confirm that the current vehicle status information is qualified;

Or, obtain the loading information of the seats in the vehicle, and if at least the driver's seat and the co-driver's seat are empty, then confirm that the current vehicle status information is qualified.

Optionally, the interactive execution instructions include: door lock control, tailgate control, vehicle light control, vehicle window control, hidden door handle control, front cabin hood control, wiper control, interior ambient light control, vehicle air conditioning control, electric At least one of the seat controls.

In the second aspect, the embodiment of the present application provides a human-vehicle interaction control device, including:

The authority confirmation module is used to confirm whether the authority of the current operator outside the vehicle is qualified;

The vehicle state confirmation module is used to obtain the current vehicle state information if the authority of the current operator is qualified, and confirm whether the current vehicle state information is qualified;

The instruction generation module is used to obtain the first action image information of the current operator if the current vehicle status information is qualified, and generate and issue an interactive execution instruction that can be executed by the vehicle according to the first action image information.

In the third aspect, the embodiment of the present application provides a human-vehicle interaction control device, including:

processor;

a memory electrically connected to the processor;

At least one program is stored in the memory and is configured to be executed by the processor, at least one program is configured to: execute the human-vehicle interaction control method provided in the first aspect above.

In the fourth aspect, the embodiment of the present application provides a human-vehicle interaction system, including: the human-vehicle interaction control device provided in the third aspect above, and the vehicle-mounted camera connected to the processor signal in the human-vehicle interaction control device respectively , keyless sensor components, body controller.

In a fifth aspect, an embodiment of the present application provides a vehicle, including: the human-vehicle interaction system provided in the fourth aspect above.

In the sixth aspect, the embodiment of the present application provides a computer-readable storage medium. The computer-readable storage medium is used to store computer instructions. When the computer instructions are run on the computer, the human-vehicle interaction as provided in the first aspect above is realized. Control Method.

The beneficial technical effects brought by the technical solutions provided by the embodiments of the present application include:

1. During the human-vehicle interaction process outside the vehicle, confirm the authority of the current operator and conduct self-inspection on the current vehicle status. Only when the authority of the current operator is qualified and the current vehicle status is qualified, can Generate and issue interactive execution instructions that can be executed by the vehicle, which is conducive to ensuring the safety of the operating authority and timing of human-vehicle interaction, and providing double security for human-vehicle interaction;

2. During the human-vehicle interaction process outside the vehicle, the interactive execution instructions that can be executed by the vehicle are generated based on the recognition of the acquired first action image information of the current operator. In terms of interaction, there is no need to take out the car key during the interaction process, and the operation is more convenient. The interactive commands do not need to rely on the limited physical buttons on the remote control car key. The types of human-computer interaction operations are no longer limited, which is conducive to expanding the types of operations and realizing customization. Personalized operation methods such as operation actions;

3. In the process of human-vehicle interaction outside the vehicle, the self-inspection of the current vehicle status is carried out after confirming that the authority of the current operator is qualified, which is conducive to saving vehicle resources and reducing vehicle energy consumption.

Additional aspects and advantages of the application will be set forth in part in the description which follows, and will become apparent from the description, or may be learned by practice of the application.

Description of drawings

The above and/or additional aspects and advantages of the present application will become apparent and easy to understand from the following description of the embodiments in conjunction with the accompanying drawings, wherein:

FIG. 1 is a schematic diagram of a structural framework of a human-vehicle interaction system provided in an embodiment of the present application;

Fig. 2 is a schematic structural frame diagram of a human-vehicle interaction control device provided in an embodiment of the present application;

FIG. 3 is a schematic flowchart of a method for controlling human-vehicle interaction provided by an embodiment of the present application;

Fig. 4 is a schematic flow diagram of the implementation mode 1 for confirming whether the authority of the current operator outside the vehicle is qualified in a human-vehicle interaction control method provided by the embodiment of the present application;

Fig. 5 is a schematic flow diagram of the implementation mode 2 for confirming whether the authority of the current operator located outside the vehicle is qualified in a human-vehicle interaction control method provided by the embodiment of the present application;

FIG. 6 is a schematic structural frame diagram of a human-vehicle interaction control device provided in an embodiment of the present application.

In the picture:

100-human-vehicle interaction system;

110-human-vehicle interaction control equipment; 111-processor; 112-memory; 113-bus; 114-transceiver; 115-input unit; 116-output unit;

120-vehicle camera; 130-keyless sensor component; 140-body controller;

200-human-vehicle interaction control device; 210-authority confirmation module; 220-vehicle status confirmation module; 230-command generation module.

Detailed ways

The present application is described in detail below, and examples of embodiments of the present application are shown in the drawings, wherein the same or similar reference numerals denote the same or similar components or components having the same or similar functions throughout. Also, detailed descriptions of known technologies will be omitted if they are not necessary to illustrate the features of the present application. The embodiments described below by referring to the figures are exemplary only for explaining the present application, and are not construed as limiting the present application.

Those skilled in the art can understand that, unless otherwise defined, all terms (including technical terms and scientific terms) used herein have the same meanings as commonly understood by those of ordinary skill in the art to which this application belongs. It should also be understood that terms, such as those defined in commonly used dictionaries, should be understood to have meanings consistent with their meaning in the context of the prior art, and unless specifically defined as herein, are not intended to be idealized or overly Formal meaning to explain.

Those skilled in the art will understand that unless otherwise stated, the singular forms "a", "an", "said" and "the" used herein may also include plural forms. It should be further understood that the word "comprising" used in the specification of the present application refers to the presence of said features, integers, steps, operations, elements and/or components, but does not exclude the presence or addition of one or more other features, Integers, steps, operations, elements, components, and/or groups thereof. It will be understood that when an element is referred to as being "connected" or "coupled" to another element, it can be directly connected or coupled to the other element or intervening elements may also be present. Additionally, "connected" or "coupled" as used herein may include wireless connection or wireless coupling. The expression "and/or" used herein includes all or any elements and all combinations of one or more associated listed items.

The inventors of the present application conducted research and found that the interaction between people outside the car and the car based on the remote control car key needs to be operated by holding the key and pressing the corresponding control key, and the control convenience is low; The number of control keys will also increase, which will put forward requirements for the size of the remote control car key, but the size of the remote control car key cannot be increased indefinitely. It can be seen that the types of controls that can be controlled are limited and it is difficult to expand; the interaction between people outside the car and the car based on the remote control car key , the vehicle usually acts instantly according to the remote control signal of the remote control car key, no matter what state the vehicle is in, it will be executed immediately. For example, if the vehicle is in the driving state and the engine is turned off by mistake, it will cause a safety accident, which shows that the safety is poor.

The inventors of the present application also found that the human-vehicle interaction outside the vehicle can recognize the operator's operation instructions by adding additional sensors, and then realize the corresponding interactive operation of the vehicle. For example, add a power tailgate system (plg) and a kick sensor (kicksensor) to the vehicle, and realize the opening of the tailgate by recognizing the operator’s kicking action by aiming at the sensor, but the additional kick sensor will increase The cost of the vehicle.

The human-vehicle interaction control method, device, device, system, vehicle, and storage medium provided in this application aim to solve the above technical problems in the prior art.

The technical solution of the present application and how the technical solution of the present application solves the above technical problems will be described in detail below with specific embodiments.

An embodiment of the present application provides a vehicle, and the vehicle includes: any human-vehicle interaction system 100 as provided below.

In this embodiment, the human-vehicle interaction system 100 in the vehicle can implement any of the human-vehicle interaction control methods provided below, which can achieve higher control convenience and unlimited types of control in the process of human-vehicle interaction outside the vehicle And it has beneficial effects such as easy expansion and better operation security.

Among them, the human-vehicle interaction system 100 and the control method for the human-vehicle interaction will be introduced in detail below, and will not be repeated here.

Optionally, the vehicle may be a fuel vehicle or a new energy vehicle.

Based on the same inventive concept, the embodiment of the present application provides a human-vehicle interaction system 100. The structural frame diagram of the human-vehicle interaction system 100 is shown in Figure 1, including: any kind of human-vehicle interaction control device 110 as provided below , and the vehicle-mounted camera 120 , the keyless sensor component 130 , and the vehicle body controller 140 respectively connected with the processor signal in the human-vehicle interaction control device 110 .

In this embodiment, the human-vehicle interaction control device 110 in the human-vehicle interaction system 100 can execute any of the human-vehicle interaction control methods provided below, which can achieve higher control convenience, The control type is unlimited, easy to expand, and has better operational safety and other beneficial effects.

Among them, the human-vehicle interaction control device 110 and the human-vehicle interaction control method will be introduced in detail below, and will not be repeated here.

In some possible implementations, the keyless sensing component 130 can be used to sense whether there is a legal car key in a certain area outside the car. If a legal car key is sensed, the human-vehicle interaction control device 110 will wake up the car camera 120 to work. The vehicle-mounted camera 120 can be used to obtain the facial image information of the current operator outside the vehicle, or the action image information of the current operator, and send it to the human-vehicle interaction control device 110 for authority confirmation; Afterwards, the on-board camera 120 continues to acquire the first action image information of the current operator, and the human-vehicle interaction control device 110 generates and sends an interactive execution command that can be executed by the vehicle to the body controller 140 according to the first action image information, and finally the body controller 140 Correspondingly drive each actuator of the vehicle according to the interaction execution instruction to complete the human-vehicle interaction. For example, drive the opening and closing of the door lock, the opening and closing of the tailgate, the opening and closing of the car lights, the lifting and lowering of the car windows, the extension or retraction of the invisible door handle, etc.

In some other possible implementations, the keyless sensing component 130 can be used to sense whether there is a legal car key in a certain area outside the car. If a legal car key is sensed, the human-vehicle interaction control device 110 will perform authority confirmation. And wake up the vehicle-mounted camera 120 to work; the vehicle-mounted camera 120 can obtain the first action image information of the current operator, and the human-vehicle interaction control device 110 generates and sends an interactive execution command that can be executed by the vehicle to the vehicle body controller 140 according to the first action image information, Finally, the vehicle body controller 140 correspondingly drives each actuator of the vehicle according to the interaction execution command to complete the human-vehicle interaction.

Optionally, the vehicle-mounted camera 120 may include: at least one of a driving recorder, a reversing camera, and a 360-degree surround-view camera.

Based on the same inventive concept, the embodiment of the present application provides a human-vehicle interaction control device 110. The structural frame diagram of the human-vehicle interaction control device 110 is shown in Figure 2, including: a processor 111, a memory 112, and at least one program .

The memory 112 is electrically connected to the processor 111;

At least one program is stored in the memory 112 and is configured to be executed by the processor 111, and the at least one program is configured to: execute any human-vehicle interaction control method provided in the following embodiments.

The embodiment of the present application provides a human-vehicle interaction control device 110 suitable for executing any of the human-vehicle interaction control methods provided below, and its implementation principles are similar, so details are not repeated here.

Those skilled in the art can understand that the human-vehicle interaction control device 110 provided in the embodiment of the present application can be specially designed and manufactured for the required purpose, or can also include known devices in a general-purpose computer. These devices have computer programs stored therein that are selectively activated or reconfigured. Such a computer program can be stored in a device (eg computer) readable medium or in any type of medium suitable for storing electronic instructions and respectively coupled to a bus.

The present application provides a human-vehicle interaction control device 110 in an optional embodiment. As shown in FIG. 2 , the human-vehicle interaction control device 110 shown in FIG. 2 includes: a processor 111 and a memory 112 . Wherein, the processor 111 and the memory 112 are electrically connected, such as through a bus 113 .

Processor 111 can be CPU (Central Processing Unit, central processing unit), general purpose processor, DSP (Digital Signal Processor, data signal processor), ASIC (Application Specific Integrated Circuit, application specific integrated circuit), FPGA (Field-Programmable Gate Array , Field Programmable Gate Array) or other programmable logic devices, transistor logic devices, hardware components, or any combination thereof. It can implement or execute the various illustrative logical blocks, modules and circuits described in connection with the present disclosure. The processor 111 may also be a combination that implements computing functions, for example, a combination of one or more microprocessors, a combination of a DSP and a microprocessor, and the like.

The bus 113 may include a path for transferring information between the aforementioned components. The bus 113 may be a PCI (Peripheral Component Interconnect, Peripheral Component Interconnect Standard) bus or an EISA (Extended Industry Standard Architecture, Extended Industry Standard Architecture) bus or the like. The bus 113 can be divided into an address bus, a data bus, a control bus, and the like. For ease of representation, only one thick line is used in FIG. 2 , but it does not mean that there is only one bus or one type of bus.

Memory 112 can be ROM (Read-Only Memory, read-only memory) or other types of static storage devices that can store static information and instructions, RAM (random access memory, random access memory) or other types that can store information and instructions It can also be EEPROM (Electrically Erasable Programmable Read Only Memory, Electrically Erasable Programmable Read-Only Memory), CD-ROM (Compact DiscRead-Only Memory, CD-ROM) or other CD-ROM storage, CD-ROM storage (including compression optical disc, laser disc, optical disc, digital versatile disc, blu-ray disc, etc.), magnetic disk storage medium or other magnetic storage device, or a computer that can be used to carry or store desired program code in the form of instructions or data structures and can be accessed by a computer Any other medium, but not limited to it.

Optionally, the human-vehicle interaction control device 110 may also include a transceiver 114 . The transceiver 114 may be used for signal reception and transmission. The transceiver 114 may allow the human-vehicle interaction control device 110 to perform wireless or wired communication with other devices to exchange data. It should be noted that, in practical applications, the transceiver 114 is not limited to one.

Optionally, the human-vehicle interaction control device 110 may also include an input unit 115 . The input unit 115 can be used to receive input numbers, characters, images and/or sound information, or generate key signal input related to user settings and function control of the human-vehicle interaction control device 110 . The input unit 115 may include, but not limited to, one or more of a touch screen, a physical keyboard, function keys (such as volume control keys, switch keys, etc.), trackball, mouse, joystick, camera, pickup, etc.

Optionally, the human-vehicle interaction control device 110 may also include an output unit 116 . The output unit 116 can be used to output or display the information processed by the processor 111 . The output unit 116 may include, but is not limited to, one or more of a display device, a speaker, a vibration device, and the like.

Although FIG. 2 shows the human-vehicle interaction control device 110 having various devices, it should be understood that it is not required to implement or have all the devices shown. More or fewer means may alternatively be implemented or provided.

Optionally, the memory 112 is used to store application program codes for executing the solution of the present application, and the execution is controlled by the processor 111 . The processor 111 is configured to execute the application program code stored in the memory 112, so as to implement any human-vehicle interaction control method provided in the embodiment of the present application.

Based on the same inventive concept, the embodiment of the present application provides a human-vehicle interaction control method, the flow diagram of which is shown in Figure 3, including steps S101-S103:

S101: Confirm whether the authority of the current operator outside the vehicle is qualified.

S102: If the authority of the current operator is qualified, obtain the current vehicle state information, and confirm whether the current vehicle state information is qualified.

S103: If the current vehicle state information is qualified, acquire the first action image information of the current operator, and generate and issue an interactive execution instruction that can be executed by the vehicle according to the first action image information.

After steps S101-S103, can realize:

During the human-vehicle interaction process outside the vehicle, the authority of the current operator is confirmed, and the current vehicle status is self-inspected. Only when the authority of the current operator is qualified and the current vehicle status is qualified, the generated and Issue interactive execution instructions that can be executed by the vehicle, which is conducive to ensuring the safety of the operation authority and timing of the human-vehicle interaction, and providing double security for the human-vehicle interaction.

In the process of human-vehicle interaction outside the vehicle, the interactive execution instructions that can be executed by the vehicle are generated based on the acquired first action image information of the current operator. In other words, there is no need to take out the car key during the interaction process, and the operation is more convenient. The interactive commands do not need to rely on the limited physical buttons on the remote control car key. The types of human-computer interaction operations are no longer limited, which is conducive to expanding the types of operations and realizing custom operation actions. and other personalized operations.

In the process of human-vehicle interaction outside the vehicle, the self-inspection of the current vehicle status is carried out after confirming that the authority of the current operator is qualified, which is conducive to saving vehicle resources and reducing vehicle energy consumption.

In the process of human-vehicle interaction outside the vehicle, the original equipment of the vehicle can be fully utilized, such as: on-board camera 120, keyless sensor component 130, body controller 140, etc., without adding new hardware devices, which is conducive to reducing costs and realizing on-board The upgrading and transformation of existing vehicles has a good prospect of promotion and popularization.

Optionally, the above steps S101-S103 can all be executed by the human-vehicle interaction control device 110 provided in the foregoing embodiments.

In some possible implementations, in the above step S101, it is confirmed whether the authority of the current operator outside the vehicle is qualified, as shown in FIG. 4 , which may include steps S201-S203:

S201: Confirm whether there is a legal car key in the detection area outside the vehicle.

In this step S201, the detection area can be a spatial area surrounded by a set of points with a specified distance from the center of the vehicle, or it can be a certain area (such as at the tailgate, at the main and co-driver's doors, etc.) or a certain area of the vehicle. The space area surrounded by a set of points with a specified distance between several specific parts.

Whether the car key is legal, the low-frequency antenna driven by the keyless sensing component 130 can periodically generate a low-frequency signal for searching the key, and detect whether there is a matching car key in the detection area. The human-vehicle interaction control device 110 makes a judgment according to the search result of the keyless sensing component 130. If yes, it can be determined that there is a legal car key in the detection area; if not, it can be determined that there is no legal car key in the detection area.

S202: If there is a legal car key in the detection area, obtain the facial image information of the current operator, and confirm whether the facial image information of the current operator matches the pre-recorded facial information.

In this step S202 , the face image information can be obtained by the vehicle camera 120 waking up to work after the human-vehicle interaction control device 110 determines that there is a legitimate car key in the detection area, and acquiring the face image of the current operator.

S203: If the facial image information of the current operator matches the pre-recorded face information, confirm that the authority of the current operator is qualified.

In this embodiment, after the above steps S201-S203, it is possible to wake up the on-board camera 120 to work by using a legal car key in the detection area outside the car, and obtain and convert the face of the current operator outside the car according to the on-board camera 120. Image information to confirm whether the authority of the current operator outside the vehicle is qualified.

In some possible implementations, in the above step S101, it is confirmed whether the authority of the current operator outside the vehicle is qualified, as shown in FIG. 5 , may include steps S301-S303:

S301: Confirm whether there is a legal car key in the detection area outside the vehicle.

S302: If there is a legal car key in the detection area, obtain the second motion video information of the current operator, and confirm whether the second motion video information of the current operator matches the pre-recorded unlocking video information.

In this step S302 , the second action image information can be obtained by the on-board camera 120 waking up to work after the human-vehicle interaction control device 110 determines that there is a legitimate car key in the detection area, and acquiring the second action image of the current operator.

Optionally, the second motion may be a dynamic gesture, for example, the current operator's single-hand motion trace is in an "L" shape.

Optionally, the second action may be a static gesture, for example: the current gesture of the operator's hands is "X" or "∧" and so on.

S303: If the second action image information of the current operator matches the pre-recorded unlocking image information, confirm that the authority of the current operator is qualified.

In this embodiment, after the above steps S301-S303, it is possible to wake up the on-board camera 120 to work by using a legal car key in the detection area outside the car, and obtain and convert the first number of the current operator outside the car according to the on-board camera 120. 2. Action image information to confirm whether the authority of the current operator outside the vehicle is qualified.

In some possible implementations, the above step S102 obtains the current vehicle state information, and confirms whether the current vehicle state information is qualified. The following method is adopted: obtain the engine state information, and if the engine state information is flameout, then confirm that the current vehicle state information is qualified.

In some possible implementations, the above step S102 obtains the current vehicle state information, and confirms whether the current vehicle state information is qualified, the following method is adopted: obtain the gear state information, if the gear state information is neutral or park, Then confirm that the current vehicle status information is qualified.

In some possible implementations, the above step S102 obtains the current vehicle state information, and confirms whether the current vehicle state information is qualified. The following method is adopted: obtain the information of the personnel in the vehicle, if the information of the personnel in the vehicle is at least the main driving area and the auxiliary driving area If no one is present, it is confirmed that the current vehicle status information is qualified.

Optionally, obtain the information of the people in the car, if the information of the people in the car is that at least the main driving area and the co-driving area are unoccupied, then confirm that the current vehicle status information is qualified, including: obtaining the life information in the car, if at least the main driving area and the passenger area are both inanimate, then confirm that the current vehicle status information is qualified. That is, the acquisition of the information of the occupants in the vehicle can be realized through the life detector.

Optionally, obtain the information about the occupants in the vehicle. If the information about the occupants in the vehicle is that at least the main driver area and the co-driver area are unoccupied, then confirm that the current vehicle status information is qualified, including: obtaining the seat load information in the vehicle, if at least the main driver area If both the seat and the passenger seat are empty, then confirm that the current vehicle status information is qualified. That is, the acquisition of the information of the occupants in the vehicle can be realized through the pressure sensors of the seats in the vehicle.

It can be understood that, according to usage requirements, one or any combination of the aforementioned various specific ways of judging whether the current vehicle status information is qualified or not can be used.

In some possible implementation manners, the interactive execution instructions in step S103 above include: door lock control, tailgate control, car light control, car window control, hidden door handle control, front hatch control, wiper control, and interior atmosphere control. At least one of light control, vehicle air conditioning control, and electric seat control.

Based on the same inventive concept, the embodiment of the present application provides a human-vehicle interaction control device 200 . The structural frame diagram of the device is shown in FIG.

The authority confirmation module 210 is used for confirming whether the authority of the current driver located outside the vehicle is qualified.

The vehicle state confirmation module 220 is used to obtain the current vehicle state information if the authority of the current operator is qualified, and confirm whether the current vehicle state information is qualified.

The instruction generation module 230 is used to obtain the first action image information of the current operator if the current vehicle state information is qualified, and generate and issue an interactive execution instruction that can be executed by the vehicle according to the first action image information.

In this embodiment, when the human-vehicle interaction control device 200 realizes the human-vehicle interaction outside the vehicle, the authority confirmation module 210 confirms the authority of the current operator, and the vehicle state confirmation module 220 performs self-check on the current vehicle state, Only when the authority of the current operator is qualified and the current state of the vehicle is qualified, the instruction generation module 230 generates and issues an interactive execution instruction that can be executed by the vehicle, which is conducive to ensuring the safety of the operation authority of the human-vehicle interaction and the timing of the operation. Security, providing double security for human-vehicle interaction.

The interactive execution instructions that can be executed by the vehicle are generated based on the recognition of the first action image information of the current operator. Compared with the interaction between people outside the car and the car based on the remote control car key, the interaction process does not need to take out the car key. The operation is more convenient, interactive commands do not need to rely on the limited physical buttons on the remote control car key, and the types of human-computer interaction operations are no longer limited, which is conducive to expanding the types of operations and realizing personalized operation methods such as custom operation actions.

The self-inspection of the current vehicle state by the vehicle state confirmation module 220 is performed after the authority confirmation module 210 confirms that the authority of the current operator is qualified, which is beneficial to save vehicle resources and reduce vehicle energy consumption.

In some possible implementations, the authority confirmation module 210 is used to confirm whether the authority of the current driver located outside the vehicle is qualified, specifically to: confirm whether there is a legal car key in the detection area located outside the vehicle; If there is a legal car key, obtain the facial image information of the current operator, and confirm whether the facial image information of the current operator matches the pre-recorded facial information; if the facial image information of the current operator matches the pre-recorded facial information, Then confirm that the authority of the current operator is qualified.

In some possible implementations, the authority confirmation module 210 is used to confirm whether the authority of the current driver located outside the vehicle is qualified, specifically to: confirm whether there is a legal car key in the detection area located outside the vehicle; If there is a legal car key, obtain the second action image information of the current operator, and confirm whether the second action image information of the current operator matches the pre-recorded unlock image information; if the second action image information of the current operator matches the pre-recorded If the unlocked image information matches, it is confirmed that the authority of the current operator is qualified.

In some possible implementations, the vehicle state confirmation module 220 is used to obtain the current vehicle state information and confirm whether the current vehicle state information is qualified, specifically to: obtain the engine state information, if the engine state information is flameout, then Confirm that the current vehicle status information is qualified; or, obtain the gear status information, if the gear status information is neutral or parking, then confirm that the current vehicle status information is qualified; or, obtain the information of the occupants in the vehicle, if the occupants If the information is that at least the main driving area and the co-driving area are unoccupied, it is confirmed that the current vehicle status information is qualified.

In some possible implementations, the vehicle state confirmation module 220 is used to obtain information about the occupants in the vehicle. If the information about the occupants in the vehicle is that at least the main driving area and the co-driving area are unoccupied, then the process of confirming that the current vehicle state information is qualified , which is specifically used to: obtain life information in the vehicle, if at least the driver’s area and the passenger’s area are inanimate, then confirm that the current vehicle status information is qualified; or, obtain the seat load information in the vehicle, if at least If they are all empty, confirm that the current vehicle status information is qualified.

Based on the same inventive concept, an embodiment of the present application provides a computer-readable storage medium, which is used to store computer instructions. When the computer instructions are run on the computer, any of the above-mentioned embodiments can be realized. A human-vehicle interaction control method.

Embodiments of the present application provide a computer-readable storage medium suitable for various optional implementations of the above-mentioned human-vehicle interaction control method, the implementation principles of which are similar and will not be repeated here.

The computer-readable storage medium can be ROM (Read-Only Memory, read-only memory) or other types of static storage devices that can store static information and instructions, RAM (random access memory, random access memory) or can store information and instructions Other types of dynamic storage devices can also be EEPROM (Electrically Erasable Programmable Read Only Memory, Electrically Erasable Programmable Read-Only Memory), CD-ROM (CompactDisc Read-Only Memory, CD-ROM) or other optical disc storage, optical disc storage (including compact discs, laser discs, optical discs, digital versatile discs, Blu-ray discs, etc.), magnetic disk storage media or other magnetic storage devices, or can be used to carry or store desired program code in the form of instructions or data structures and can be programmed by a computer Any other medium accessed, but not limited to.

By applying the embodiments of the present application, at least the following beneficial effects can be achieved:

1. During the human-vehicle interaction process outside the vehicle, confirm the authority of the current operator and conduct self-inspection on the current vehicle status. Only when the authority of the current operator is qualified and the current vehicle status is qualified, can Generate and issue interactive execution instructions that can be executed by the vehicle, which is conducive to ensuring the safety of the operation authority and timing of the human-vehicle interaction, and provides double security for the human-vehicle interaction.

2. During the human-vehicle interaction process outside the vehicle, the interactive execution instructions that can be executed by the vehicle are generated based on the recognition of the acquired first action image information of the current operator. In terms of interaction, there is no need to take out the car key during the interaction process, and the operation is more convenient. The interactive commands do not need to rely on the limited physical buttons on the remote control car key. The types of human-computer interaction operations are no longer limited, which is conducive to expanding the types of operations and realizing customization. Personalized operation methods such as operation actions.

3. In the process of human-vehicle interaction outside the vehicle, the self-inspection of the current vehicle status is carried out after confirming that the authority of the current operator is qualified, which is conducive to saving vehicle resources and reducing vehicle energy consumption.

4. In the process of human-vehicle interaction outside the vehicle, the original equipment of the vehicle can be fully utilized without adding new hardware equipment, which is conducive to reducing costs and realizing the upgrading and transformation of existing vehicles, and has a good prospect for promotion and popularization.

Those skilled in the art can understand that the various operations, methods, and steps, measures, and schemes in the processes that have been discussed in this application can be replaced, changed, combined, or deleted. Furthermore, the various operations, methods, and other steps, measures, and schemes in the processes that have been discussed in this application may also be replaced, changed, rearranged, decomposed, combined, or deleted. Further, steps, measures, and schemes in the prior art that have operations, methods, and processes disclosed in the present application may also be alternated, changed, rearranged, decomposed, combined, or deleted.

In the description of this application, it is to be understood that the terms "center", "upper", "lower", "front", "rear", "left", "right", "vertical", "horizontal", The orientations or positional relationships indicated by "top", "bottom", "inner", "outer", etc. are based on the orientations or positional relationships shown in the drawings, and are only for the convenience of describing the application and simplifying the description, rather than indicating or implying References to devices or elements must have a particular orientation, be constructed, and operate in a particular orientation and therefore should not be construed as limiting the application.

The terms "first" and "second" are used for descriptive purposes only, and cannot be interpreted as indicating or implying relative importance or implicitly specifying the quantity of indicated technical features. Thus, a feature defined as "first" and "second" may explicitly or implicitly include one or more of these features. In the description of the present application, unless otherwise specified, "plurality" means two or more.

In the description of this application, it should be noted that unless otherwise specified and limited, the terms "installation", "connection", and "connection" should be understood in a broad sense, for example, it can be a fixed connection or a detachable connection. Connected, or integrally connected; it can be directly connected, or indirectly connected through an intermediary, and it can be the internal communication of two elements. Those of ordinary skill in the art can understand the specific meanings of the above terms in this application in specific situations.

In the description of this specification, specific features, structures, materials or characteristics may be combined in any one or more embodiments or examples in an appropriate manner.

It should be understood that although the various steps in the flow chart of the accompanying drawings are displayed sequentially according to the arrows, these steps are not necessarily executed sequentially in the order indicated by the arrows. Unless otherwise specified herein, there is no strict order restriction on the execution of these steps, and they can be executed in other orders. Moreover, at least some of the steps in the flowcharts of the accompanying drawings may include multiple sub-steps or multiple stages, and these sub-steps or stages may not necessarily be executed at the same time, but may be executed at different times, and the order of execution is also It is not necessarily performed sequentially, but may be performed alternately or alternately with at least a part of other steps or sub-steps or stages of other steps.

The above description is only part of the implementation of the present application, and it should be pointed out that for those of ordinary skill in the art, without departing from the principle of the present application, some improvements and modifications can also be made, and these improvements and modifications are also It should be regarded as the protection scope of this application.

Claims (11)

1. The human-vehicle interaction control method is characterized by comprising the following steps of:

confirming whether the authority of the current operator positioned outside the vehicle is qualified or not;

if the authority of the current operator is qualified, acquiring current vehicle state information, and confirming whether the current vehicle state information is qualified or not;

and if the current vehicle state information is qualified, acquiring first action image information of the current operator, and generating and sending an interactive execution instruction which can be executed by the vehicle according to the first action image information.

2. The human-vehicle interaction control method according to claim 1, wherein the confirming whether the authority of the current operator located outside the vehicle is qualified comprises:

confirming whether a legal car key exists in a detection area outside the car;

if a legal car key exists in the detection area, acquiring the facial image information of the current operator, and confirming whether the facial image information of the current operator is matched with the prerecorded facial information;

and if the facial image information of the current operator is matched with the prerecorded facial information, confirming that the authority of the current operator is qualified.

3. The human-vehicle interaction control method according to claim 1, wherein the confirming whether the authority of the current operator located outside the vehicle is qualified comprises:

confirming whether a legal car key exists in a detection area outside the car;

if a legal car key exists in the detection area, acquiring second action image information of the current operator, and confirming whether the second action image information of the current operator is matched with prerecorded unlocking image information or not;

and if the second action image information of the current operator is matched with the prerecorded unlocking image information, confirming that the authority of the current operator is qualified.

4. The human-vehicle interactive control method according to claim 1, wherein the obtaining current vehicle state information and confirming whether the current vehicle state information is acceptable comprises any one of:

acquiring engine state information, and if the engine state information is flameout, confirming that the current vehicle state information is qualified;

acquiring gear state information, and if the gear state information is neutral or parking gear, confirming that the current vehicle state information is qualified;

and acquiring in-vehicle personnel information, and if the in-vehicle personnel information is that at least a main driving area and a secondary driving area are unmanned, confirming that the current vehicle state information is qualified.

5. The method for controlling interaction between a vehicle and a person according to claim 4, wherein the obtaining the in-vehicle personnel information, if the in-vehicle personnel information is that at least a main driving area and a sub driving area are unmanned, determining that the current vehicle state information is qualified, comprises:

acquiring in-vehicle life information, and if at least a main driving area and a secondary driving area are inanimate, confirming that the current vehicle state information is qualified;

or acquiring the in-vehicle seat bearing information, and if at least the main driver seat and the auxiliary driver seat are empty, confirming that the current vehicle state information is qualified.

6. The human-vehicle interaction control method according to claim 1, wherein the interaction execution instruction includes: at least one of door lock control, tail door control, car lamp control, car window control, hidden door handle control, front cabin cover control, windshield wiper control, atmosphere lamp control in the car, vehicle-mounted air conditioner control and electric seat control.

7. A human-vehicle interaction control device, characterized by comprising:

the permission confirming module is used for confirming whether the permission of the current control personnel positioned outside the vehicle is qualified or not;

the vehicle state confirmation module is used for acquiring current vehicle state information and confirming whether the current vehicle state information is qualified or not if the authority of the current operator is qualified;

and the instruction generation module is used for acquiring first action image information of the current operator if the current vehicle state information is qualified, and generating and sending an interactive execution instruction which can be executed by the vehicle according to the first action image information.

8. A human-vehicle interactive control apparatus, characterized by comprising:

a processor;

a memory electrically connected to the processor;

at least one program stored in the memory and configured to be executed by the processor, the at least one program configured to: a human-vehicle interaction control method according to any one of the preceding claims 1-6.

9. A human-vehicle interaction system, comprising: the human-vehicle interactive control device according to claim 8, and an on-vehicle camera, a keyless sensing assembly and a vehicle body controller which are respectively in signal connection with a processor in the human-vehicle interactive control device.

10. A vehicle, characterized by comprising: the human-vehicle interaction system of claim 9.

11. A computer readable storage medium for storing computer instructions which, when run on a computer, implement the human-vehicle interaction control method of any one of the preceding claims 1-6.