CN102866803B - A kind ofly support the virtual console gesture control method of the automobile of blind operation and device - Google Patents

Abstract

The invention discloses a gesture control method and device for a virtual center console of a car that supports blind operation, which can facilitate the user to control the car by swipe gestures on the touch screen of the center console without diverting the road driving line of sight during the driving process. , this kind of blind operation function to the car makes up for the deficiency of searching for complex and diverse mechanical buttons in the traditional cab to control. At the same time, the virtual center console of the present invention integrates a gesture language library module and a gesture analysis and processing module. Gesture language recognition module, gesture language library management module, gesture control execution module, and gesture control security mechanism management module, the cooperative processing of each module makes its gesture language control easy to use, gesture control window-independent, and gesture semantics Features such as uniqueness, modifiability of gesture language, and safety of the control mechanism can provide users with a convenient, fast, friendly, and safe car center console control experience according to specific needs.

Description

A gesture control method and device for a car virtual center console supporting blind operation

technical field

The invention relates to automobile electronic control technology, in particular to a gesture control method and device applied to a virtual center console of an automobile.

Background technique

With the rapid development and popularization of automotive electronics, there are more and more control functions in the car. In the cockpit, the center console and around the steering wheel are covered with various function control buttons. These diversified control buttons in the car do provide users with more control options, but at the same time, they also affect the convenience and complexity of the driver's operation, making the driver in the process of driving with high safety. , but also let go of the steering wheel to reach out or even turn your head to look away from the driving road to see or take a longer time to find the position of the function button you want to execute. Such behavior will inevitably distract the driver's attention and undoubtedly affect driving safety. cause greater hazards. During the driving process, the driver looks away from the driving road to find and press, rotate or toggle these various function buttons, which really affects the safety of driving and also brings inconvenience to the operation and control during driving.

Today, with the development of the automobile industry and the improvement of the computer level, more requirements are put forward for the integration of human-computer interaction in automobiles. Controlling the car through the touch screen has become a new trend in the development of the times. Touch screen technology is a new type of human-computer interaction input method. Compared with the traditional button input method, touch screen input is more intuitive and convenient. The touch screen consists of a detection part installed in front of the LCD screen and a touch screen controller. When a finger or other object touches the graphic button installed on the touch screen at the front of the display, the touched position is detected by the touch screen detection component. After detecting the user's touch position, the coordinate information of the touch point is sent to the touch screen controller. The touch screen controller After analyzing the touch information, execute the corresponding operation command. Therefore, the traditional mechanical button control panel in the car cab can be replaced by a touch screen, and a vivid graphic control effect can be produced by means of the liquid crystal display screen of the touch screen.

However, although the existing car touch screen has improved the aesthetics and interactive friendliness of the button control interface of the center console of the car cab, it still stays at using traditional simple operations such as touch and click to control the car. During driving, if you want to operate through the touch screen, you still need to take your eyes off the driving road and shift to view the graphic buttons on the touch screen, and click the buttons to perform the desired functional operation. Therefore, letting the driver look away from the driving road to click to perform operations during driving still has a relatively large potential safety hazard, which does not change the traditional mechanical button control panel in essence. Check the location of the button to operate the deficiency.

Contents of the invention

The purpose of the present invention is to solve the deficiencies existing in the above-mentioned automobile center console touch screen technology at present, and to provide a method and device for gesture control of the automobile virtual center console that supports blind operation, so that the driver can check the driver's cab without shifting his sight The touch screen of the center console, and the corresponding functions can be executed only by gesture operation on the touch screen, realizing the blind operation function of the touch screen of the virtual center console of the car.

In order to solve the problems of the technologies described above, the technical solution of the present invention is as follows:

A gesture control device for a virtual center console of an automobile that supports blind operation, comprising a touch screen of the center console, a gesture language library module, a gesture language library management module, a gesture analysis and processing module, a gesture language recognition module, a gesture control execution module and a gesture control security Mechanism management module;

The center console touch screen adopts a capacitive touch screen, adopts a touch screen controller with a programmable system-on-chip architecture, can communicate and work together with other peripherals, and can obtain gesture information according to customized requirements;

The gesture language library module stores the defined gesture language and the control functions of the car center console corresponding to the gesture language;

The gesture language library management module is used to manage the gesture languages in the gesture language library module;

The gesture analysis and processing module is used to analyze and process the gestures detected by the touch screen of the center console, and call the gesture language recognition module after obtaining the complete gesture language;

The gesture language recognition module analyzes and recognizes the obtained gesture information, judges the matching similarity between the gesture path and the gesture language in the gesture language library module, and if it reaches a certain threshold, it can be considered as the gesture; the gesture control execution module According to the gesture information identified by the gesture language recognition module, query the corresponding vehicle operation, send control signals to the vehicle body electronic control system or vehicle electrical control system through the CAN, LIN bus, control the corresponding vehicle components, and perform corresponding operations ;

The gesture manipulation security mechanism management module is used for security verification of gesture management operations in the gesture language library management module.

Furthermore, when the gesture language library management module manages the gesture language in the gesture language library, it needs the gesture control security mechanism management module to perform security verification. Only after the security verification is passed, can the gesture language library be managed and operated. After security authentication, when you want to add a new gesture operation, first obtain the entered gesture operation, analyze and identify it, and judge whether the gesture language has a high repetition similarity with the gesture language stored in the existing gesture language library module If the similarity between the new gesture language to be added and one of the existing gesture languages exceeds the set threshold, it can be considered that the gesture language conflict is repeated. If the addition is unsuccessful, another input is required until the similarity conflict detection is satisfied. After passing the similarity conflict detection, select the car center console control function that is currently available and not used by other gesture languages, and finally add the new gesture and its corresponding control function to the gesture language library module.

A method for gesture control of a car virtual center console supporting blind operation, comprising the following steps

31) The center console touch screen detects and acquires gesture information;

32) The gesture analysis and processing module is used to analyze and process the gestures detected by the touch screen of the center console, and call the gesture language recognition module after obtaining the complete gesture language;

33) The gesture language recognition module analyzes and recognizes the obtained gesture information, judges the matching similarity between the gesture path and the gesture language in the gesture language library module, and if it reaches a certain threshold, it can be considered as the gesture; the gesture control According to the gesture information identified by the gesture language recognition module, the execution module queries the corresponding vehicle operation, sends control signals to the vehicle body electronic control system or the vehicle electrical control system through the CAN and LIN buses, controls the corresponding vehicle components, and executes corresponding operation;

The gesture language library module stores the defined gesture language and the control functions of the car center console corresponding to the gesture language;

34) The gesture language library management module is used to manage the gesture languages in the gesture language library module, and can manage gestures in the gesture language library management module after the security verification of the gesture control safety mechanism management module.

Further, the gesture analysis and processing method of the gesture analysis and processing module includes the following steps:

41) The touch screen of the center console detects a hand touch, wait for the gesture input to be completed, and obtain complete gesture information;

42) Call the gesture language recognition module;

43) The gesture analysis and processing module judges whether the detected gesture operation is a conventional touch screen operation;

44) If it is a conventional touch screen operation, call the conventional gesture processing module, and perform corresponding conventional gesture operations on it according to the current specific window;

45) If it is not a conventional touch screen operation, then the gesture language recognition module judges whether it is a gesture language in the gesture language library module?

46) If it is not a gesture language in the gesture language library module, no manipulation command will be executed;

47) If it is a gesture language in the gesture language library module, call the gesture control execution module to execute the functional operation corresponding to the gesture language defined in the gesture language library module.

Further, in the step 41), when the touch screen of the center console detects a hand touch, it waits for the complete gesture input to be completed according to the set waiting time.

Further, in step 43), the gesture analysis and processing module treats the conventional touch screen gesture operation differently from the defined gesture language library gesture operation. The conventional touch screen gesture operation is an operation on the graphics window currently displayed on the center console touch screen. The gesture It is a window-dependent gesture operation. The gesture language operation in the gesture language library module has nothing to do with the current window interface. Using these gesture languages in any window can execute the corresponding car control commands.

Further, the processing method for detecting a gesture touch from the touch screen of the center console to calling the gesture language recognition module for the gesture includes the following steps:

71) When the center console touch screen detects a finger touch, the center console touch screen detection component sends an interrupt signal to the gesture analysis and processing module in the form of an interrupt;

72) After the gesture analysis and processing module receives the interrupt signal, it calls the corresponding interrupt processing function;

73) Start gesture control language input timer;

74) When the timer expires, obtain all gesture information of the current center console touch screen;

75) Analyze and process all gesture information of the current center console touch screen;

76) Call the gesture language recognition module for each gesture information, and perform corresponding operations after recognizing it.

The beneficial effect of the present invention is that: the present invention can facilitate the user to control the car correspondingly by swiping gestures on the touch screen of the center console without diverting the road driving sight during the driving process. This kind of blind operation function for the car makes up for the lack of finding complex and diverse mechanical buttons in the traditional cab to control. At the same time, the virtual center console of the present invention integrates a gesture language library module, a gesture analysis and processing module, a gesture language recognition module, a gesture language library management module, a gesture control execution module, and a gesture control security mechanism management module. The cooperative processing of each module makes its gesture language control have the characteristics of ease of use, irrelevance of gesture control window, uniqueness of gesture semantics, modifiability of gesture language, and security of control mechanism. According to specific needs, it can provide users with convenient, fast, friendly and safe car center console control experience.

Description of drawings

Fig. 1 is a hierarchical structure diagram of each functional module in the device system of the present invention;

Fig. 2 is a connection diagram between the device of the present invention and the vehicle body electronic control system and the vehicle electrical control system;

Fig. 3 is a gesture language library customized by the device system of the present invention and its corresponding functional operations;

Fig. 4 is a flow chart of processing gesture language input in the device system of the present invention;

Fig. 5 is a flow chart of the gesture analysis and processing module in the device system of the present invention;

Fig. 6 is the processing step flow chart of this automobile virtual center console gesture language library management system;

Fig. 7 is a flow chart of adding gesture control to the gesture language management module of the automobile virtual center console.

detailed description

The present invention will be further described below in conjunction with the accompanying drawings and specific embodiments.

As shown in Figure 1, a gesture control device for a virtual center console of a car that supports blind operation, the center console (central control platform) device includes a center console touch screen, a gesture language library module, a gesture language library management module, gesture analysis A processing module, a gesture language recognition module, a gesture manipulation execution module, and a gesture manipulation safety mechanism management module.

The center console touch screen adopts a capacitive touch screen, which supports simultaneous recognition of two or more points on the contact surface, that is, supports multi-point contact position recognition. At the heart of a multi-touch system is capacitive sensing consisting of a pair of adjacent electrodes. When a conductor such as a finger approaches these electrodes, the capacitance between the two electrodes increases, which is then detected by the microcontroller to identify the touch location information.

The center console touch screen adopts a touch screen controller with a programmable system-on-chip architecture, which can easily sense the touch of a single finger or multiple fingers of the user, and can communicate and work collaboratively with other peripherals, with good design flexibility and Configurability, so that it is convenient to obtain gesture information according to customized needs.

The gesture language library module defines a set of gesture languages oriented to the operation of the center console of the car cab. A set of gesture language libraries and the corresponding functional operations of the car virtual center console can be pre-defined in the virtual center console system.

This gesture language library module has the following characteristics:

(a) The control functions corresponding to the gesture language defined in the gesture language library module are generally the functional operations commonly used by drivers, and the gesture language does not cover all the functional operations of the center console of the car cab.

(b) There is a one-to-one correspondence between the gesture language in the gesture language library module and the common function operations of the car virtual center console.

(c) The gesture language defined in the gesture language library module is an extension and supplement to the existing common gesture operations of conventional touch screens (such as single click, long press, up and down, left and right sliding to turn pages, zoom in and out, etc.). The gesture language defined in the gesture language library module does not conflict with the commonly used gesture operations of the existing touch screen.

(d) The gesture operations defined in the gesture language library module can be performed on any graphical interface window on the touch screen of the virtual center console, and it is not necessary to return to the corresponding functional window interface to perform corresponding functional operations.

(e) The gesture language has the characteristics of the uniqueness of gesture semantics and the independence of gesture control windows. The uniqueness of gesture semantics is handled by the gesture manipulation security mechanism management module, and the gesture manipulation window irrelevance is handled by the gesture analysis and processing module.

The gesture language library management module supports users to manage gesture languages in the gesture language library module, such as adding custom gestures and their corresponding operations, deleting gestures, modifying gesture languages and their corresponding operations, etc. At the same time, when the gesture language is modified, the gesture control security mechanism management module is required to perform security verification. The gesture language library can only be modified after the security verification is passed.

When the user passes security authentication and wants to add a new gesture operation, the gesture operation entered by the user will be obtained first, and will be analyzed and identified to determine whether the gesture has a high degree of repetition with the gestures in the existing gesture language library module Similarity, if the similarity between the new gesture that the user is going to add and one of the existing gestures exceeds the set threshold (there are many mature methods and algorithms for calculating the similarity of gesture curves, the calculation of gesture similarity can be used Conventional method), it can be considered that the gesture conflict is repeated, the addition is unsuccessful, and the user needs to input again until the requirements of the gesture similarity conflict detection are met. After passing the gesture similarity conflict detection, select the currently available and not selected The car center console control functions used by other gesture languages, and finally add the new gestures and their corresponding control functions to the gesture language library module.

The gesture analysis and processing module is mainly responsible for analyzing and processing the gestures detected by the touch screen of the center console. The steps of the gesture analysis and processing method of this module are as follows:

(1) The touch screen detects hand touch, waits for the user gesture input to complete, and obtains complete gesture information;

(2) Call the gesture language recognition module;

(3) The gesture analysis and processing module judges whether the detected gesture operation is a conventional touch screen operation?

(4) If yes, call the conventional gesture processing module, and perform corresponding conventional gesture operations on the current specific window.

(5) If not, determine whether it is a language in the gesture language library?

(6) If not, do not execute any manipulation command.

(7) If yes, call the gesture control execution module to execute the functional operation corresponding to the gesture language defined in the gesture language library.

In the above step (1): the touch screen of the virtual center console does not call the gesture language recognition module immediately after detecting a hand touch, because the user may be performing some gesture operations such as multi-touch, so it has to wait for the user to After the complete input is completed, the obtained complete gesture information is analyzed and recognized. Otherwise, it may lead to errors in the analysis and recognition of gesture semantics. The time to wait for user gesture input can be set according to the situation.

In the step (3): the gesture analysis and processing module treats conventional touch screen gesture operations and defined gesture language library gesture operations differently. For conventional touch screen gesture operations (such as single click, long press, up and down, left and right sliding to turn pages, zoom in and out, etc.) are operations on the graphics window currently displayed on the center console touch screen, so these gestures are window-related gesture operations. The gesture operations in the gesture language library module have nothing to do with the current window interface. Using these gestures in any window can execute the corresponding car control commands, so the gesture operations in the gesture language library are window-independent.

For the detection of a gesture touch from the center console touch screen, the processing steps of calling the gesture language recognition module for the gesture are as follows:

(11) When the touch screen of the center console detects a finger touch, the touch screen detection component sends an interrupt signal to the gesture analysis and processing module in the form of an interrupt;

(12) After the gesture analysis and processing module receives the interrupt signal, it calls the corresponding interrupt processing function;

(13) Start the gesture control language input timer;

(14) When the timer expires, obtain all gesture information of the current touch screen;

(15) Analyze and process all gesture information of the current touch screen;

(16) Call the gesture language recognition module for each gesture information, and perform corresponding operations after recognizing it.

The gesture language recognition module analyzes and recognizes the obtained complete gesture information of the touch screen, and judges the matching similarity between the gesture path and the gesture language in the gesture language library. If it reaches a certain threshold, it can be considered as the gesture. Find the car operation corresponding to the gesture in the gesture language library.

The gesture control execution module queries the corresponding vehicle operation according to the gesture information recognized by the gesture language recognition module. The corresponding car components are controlled and corresponding operations are performed.

The gesture control security mechanism management module is mainly responsible for security verification of the gesture modification operation in the gesture language library management module. The features of this module are as follows:

(a) When using the virtual center console touch screen gesture control system for the first time, the car owner needs to input its fingerprint information first, and can input one finger or multiple fingers. After the input is completed, when the gesture language library needs to be modified in the future, it needs to You need to pass fingerprint authentication first. If you need to add and manage new fingerprint information in the future, you also need to pass the fingerprint authentication set before.

(b) Only after the owner user has passed the fingerprint authentication can he customize and add gestures and their corresponding operations or delete or modify the gesture language. Ensure the security of the center console touch screen gesture language library.

(c) The gesture control security mechanism management module has the gesture similarity conflict detection function. For a new gesture input by the user, the system will calculate the similarity between the current input gesture and all existing gestures in the system. Only when the similarity of all gestures is lower than the set threshold can the gesture be considered as a new gesture and added to the Existing gesture language library, otherwise new gestures will not be added successfully. This ensures the uniqueness of the gesture language.

As shown in Figure 2, the present invention provides a gesture control device for a virtual center console of a car that supports blind operation. The touch screen of the virtual center console of the car has a touch screen button lock. Locked, the center console is in standby mode at this time and does not support gesture operation; press the button lock of the center console again to restore gesture touch control.

The virtual center console is connected to the car's body electronic control system (BCM) or vehicle electrical control system through the LIN/CAN bus, and controls the car to perform corresponding operations by sending corresponding control signals.

At the same time, the touch screen of the center console adopts a touch screen controller with a programmable system-on-chip architecture. The center console integrates a gesture language library module, a gesture analysis and processing module, a gesture language recognition module, a gesture language library management module, and a gesture control execution module. , and a gesture control security mechanism management module.

The hierarchical structure of each functional module in the touch screen controller is shown in FIG. 1 . The user can perform two types of operations through the touch screen: one is mainly the operation performed by the user on the gesture language in the gesture language library of the system, which is mainly responsible for the gesture language library module, the gesture language library management module and the gesture control security mechanism management module. The other type is mainly the car control operation performed by the user using the gesture language, which is mainly responsible for the gesture analysis and processing module, the gesture language recognition module and the gesture control execution module.

As an optional implementation example of the present invention, as shown in FIG. 3 , a set of gesture language libraries and corresponding functional operations of the car virtual center console can be pre-defined inside the virtual center console system. The gesture language can be one-stroke gestures, two-stroke gestures or multi-stroke gestures, and relevant gestures are properly defined according to the meaning of specific operations, which is convenient for users to remember and use.

For example, to open the car window (window), use the gesture of its English initial letter w to control; open the trunk (pack), use the gesture of its English initial letter p to control; unlock the hood (suo), use its Chinese language The initial letter s of Pinyin is used for gesture control; open the glass sunroof, and perform gesture control according to the shape of the sunroof "mouth". These can also be changed through the gesture language library management module according to the user's specific usage habits.

one. The first time the owner logs in and uses the virtual center console touch screen system process:

The basic steps when the car owner uses the gesture control system of the car virtual center console for the first time are as follows:

(1) The car owner enters the fingerprint, creates the owner's fingerprint information, and enters the gesture control system of the car's virtual center console.

(2) The car owner inputs a certain gesture operation on the touch screen of the center console, and the complete flow of the gesture language input operation according to the present invention is shown in FIG. 4 .

(3) According to the gesture control method of the system, the gesture analysis and processing module is invoked for the input gesture, and the processing process is shown in FIG. 5 .

As an optional implementation case of the present invention, the following describes a specific case process of user operation using the gesture control device of the car virtual center console:

(a) The car owner inputs a gesture of sliding to the left on the touch screen of the center console. According to the control method of the system, the system recognizes that the gesture is a conventional touch screen operation gesture, and then proceeds to turn to the next page accordingly.

(b) When the car owner inputs clockwise C on the touch screen of the center console, the system recognizes the gesture as an unconventional touch screen gesture operation, and at the same time there is the gesture language in the gesture language library, so it calls the gesture control execution module to perform the corresponding operation, That is, turn on the air conditioner.

(c) At this time, the owner enters a clockwise triangle on the touch screen of the center console to turn on the interior lights.

(d) At this time, when the owner enters a clockwise circle on the touch screen of the center console, the radio is turned on.

(e) At this time, when the owner enters the upper sharp angle clockwise from left to right on the touch screen of the center console, the temperature of the air conditioner will be increased.

(f) At this time, when the owner inputs a clockwise square on the center console touch screen, the glass sunroof will be opened.

In the operation process of this case, the gesture operation does not need to be in the corresponding window to perform the corresponding gesture operation, that is, the air conditioner temperature can be adjusted without the touch screen air conditioning control interface of the center console. As long as the system detects that it is the corresponding gesture control, it will Immediately execute the corresponding operation, regardless of the current window interface. Therefore, this process reflects that the car virtual center console system has the characteristics of gesture control window independence and semantic uniqueness.

two. The owner manages the process of modifying the gesture language library:

Car owners can manage the gesture language library of the system, and support users to add custom gestures and their corresponding operations, delete gestures, modify gesture languages and their corresponding operations, etc.

The processing steps of the gesture language library management system are as follows:

(1) The user logs in to the management interface of the gesture language library for identity verification;

(2) After the identity verification is passed, the user chooses to manage gestures;

(3) If the choice is "Add new gesture", you need to enter the new gesture and perform a similarity test on the new gesture. After the test is passed, select the car operation corresponding to the new gesture and add it to the gesture language library.

(4) If you choose "Modify gesture and its corresponding operation", you need to further choose "Modify the gesture corresponding to the operation" or choose "Modify the corresponding operation of the gesture";

(a) If you choose "Modify the gesture corresponding to the operation", you need to enter a new gesture and perform a similarity test on the new gesture. After the test passes, you can successfully modify the new gesture corresponding to the operation.

(b) If you select "Modify the operation corresponding to the gesture", select the operation that the current car can choose to perform, and save the modification to the gesture language library.

(5) If the selection is "Delete Gesture Control", select the gesture to be deleted and delete it.

The flow chart of the processing steps of the gesture language library management system of the automobile virtual center console is shown in FIG. 6 .

As an optional implementation case of the present invention, the following describes the specific steps for adding a new gesture language control:

(a) First call the gesture control security mechanism management module to verify the user's identity;

(b) Enter user fingerprint information on the touch screen of the virtual center console;

(c) Determine whether the fingerprint information entered by the user matches the user fingerprint information in the database?

(d) If not, user authentication failed.

(e) If yes, the user inputs new gestures on the touch screen of the center console;

(f) Analyze and recognize newly added gesture information;

(g) Calculate the similarity between the newly added gestures and all gestures on the center console touch screen;

(h) Judging whether there is a gesture similarity reaching the set threshold?

(i) If yes, the new gesture was not added successfully.

(j) If not, select the car operation corresponding to the new gesture;

(k) Add new gestures and their corresponding car operations to the gesture language library.

The specific process of adding gesture control to the gesture language management module of the car virtual center console is shown in Figure 7.

It can be seen from the above examples that the present invention can facilitate the blind operation of the car owner in the driving process, and correspondingly control the car by swipe gestures on the touch screen of the center console. The ease of use of its gesture language operation, window independence, management and modification of the gesture language library, and its security mechanism can provide car owners with a convenient, fast and safe car center console control experience.

The car virtual center console gesture control method supporting blind operation provided by the present invention can be widely used in various car center console control systems, and the gesture language in its gesture language library, optional car operation and gesture recognition method can be based on Different customizations are determined according to specific needs.

The above is only a preferred embodiment of the present invention, it should be pointed out that for those of ordinary skill in the art, without departing from the concept of the present invention, some improvements and modifications can also be made, and these improvements and modifications should also be considered Within the protection scope of the present invention.

Claims (5)

1. support the automobile virtual console gesture actuation means of blind operation for one kind, it is characterized in that, comprise console touch-screen, sign language library module, sign language database management module, gesture analysis processing module, sign language identification module, gesture manipulation execution module and gesture manipulation security mechanism management module;

Described console touch-screen adopts capacitive touch screen, uses the touch screen controller of programmable system on chip framework, can carry out communicating and collaborative work with other peripheral hardwares, and can obtain gesture information according to customized demand;

The sign language that described sign language library module stores through definition mentions and sign language automobile center console manipulation function one to one;

Described sign language database management module is for managing the sign language in sign language library module;

Described gesture analysis processing module is used for carrying out analyzing and processing to the gesture that described console touch-screen detects, then calls sign language identification module after obtaining complete sign language;

Described sign language identification module carries out analysis to the gesture information obtained and identifies, judges the matching similarity of sign language in its gesture path and sign language library module, if reach certain threshold value, then thinks the gesture in sign language library module; The gesture information that described gesture manipulation execution module identifies according to described sign language identification module, inquire about the Automobile operation of its correspondence, transmitted control signal to electrical control unit system or vehicle mounted electrical apparatus control system by CAN, LIN bus, corresponding automobile component is controlled, performs corresponding operating;

Described gesture manipulation security mechanism management module is used for carrying out safety verification to the gesture bookkeeping in described sign language database management module;

When sign language database management module carries out bookkeeping to the sign language in gesture language library, gesture is needed to manipulate security mechanism management module to carry out safety verification, after only having safety verification to pass through, bookkeeping could be carried out to gesture language library, after through safety certification, when wanting to add new gesture operation, first the gesture operation of typing is got, and analysis identification can be carried out to the gesture operation of typing, whether the sign language judging typing has higher duplication similarity degree with the sign language that stores in existing sign language library module, if prepare some similarity in the new sign language that adds and existing sign language to reach more than the threshold value of setting, then can think that sign language conflict repeats, add unsuccessful, need to input again in addition, until the requirement meeting similarity collision detection, after similarity collision detection, select current alternative again and not by automobile center console manipulation function that other sign languages use, finally new gesture and its corresponding manipulation function are added in sign language library module.

2. support the virtual console gesture control method of automobile of blind operation, it is characterized in that, comprise the steps

31) console touch-screen detects and obtains gesture information;

32) gesture analysis processing module is used for carrying out analyzing and processing to the gesture that described console touch-screen detects, then calls sign language identification module after obtaining complete sign language;

33) described sign language identification module carries out analysis identification to the gesture information obtained, and judges the matching similarity of sign language in its gesture path and sign language library module, if reach certain threshold value, then thinks the gesture in language library module; The gesture information that gesture manipulation execution module identifies according to described sign language identification module, inquire about the Automobile operation of its correspondence, transmitted control signal to electrical control unit system or vehicle mounted electrical apparatus control system by CAN, LIN bus, corresponding automobile component is controlled, performs corresponding operating;

The sign language that described sign language library module stores through definition mentions and sign language automobile center console manipulation function one to one;

34) sign language database management module is for managing the sign language in sign language library module, after the checking of gesture manipulation security mechanism management module safety, and can to the gesture bookkeeping in described sign language database management module; The gesture analysis disposal route of gesture analysis processing module comprises the steps:

41) console touch-screen detects touch in one's hands, waits for that gesture input is complete, obtains complete gesture information;

42) sign language identification module is called;

43) gesture analysis processing module judges whether the gesture operation detected is conventional touch screen operation;

44) if conventional touch screen operation, then allocating conventional gesture processing module, according to the concrete window in current place, performs corresponding conventional gesture operation to it;

Does 45) if not conventional touch screen operation, then sign language identification module determine whether sign language in sign language library module?

46) if not sign language in sign language library module, then any manipulation instruction is not performed;

47) if sign language in sign language library module, then call gesture manipulation execution module, perform the feature operation that the sign language that defines in sign language library module is corresponding.

3. according to claim 2ly a kind ofly support the virtual console gesture control method of the automobile of blind operation, it is characterized in that, in described step 41) in this console touch-screen when having detected that hand touches, according to incoming timing device arrange stand-by period, wait for that complete gesture has inputted.

4. according to claim 3ly a kind ofly support the virtual console gesture control method of the automobile of blind operation, it is characterized in that, in step 43) in gesture analysis processing module the sign language storehouse gesture operation difference of conventional touch screen gesture operation and definition is treated, it is the operation that the graphical window of the current display of console touch-screen is carried out for conventional touch screen gesture operation, conventional touch screen gesture is the gesture operation of window correlativity, sign language operation in sign language library module is had nothing to do with current place window interface, use these sign languages can perform corresponding automobile manipulation order at any window.

5. according to claim 3ly a kind ofly support the virtual console gesture control method of the automobile of blind operation, it is characterized in that, gesture touch-control detected for from console touch-screen, comprised the steps: to the disposal route gesture detected being called to sign language identification module

71) when console touch-screen detects finger touch, console touch-screen detection part sends look-at-me with the form of interruption to gesture analysis processing module;

72), after gesture analysis processing module receives look-at-me, corresponding interrupt processing function is called;

73) initiation gesture manipulation language in-put timer;

74) when timer time arrives, then all gesture informations of current console touch-screen are obtained;

75) analyzing and processing is carried out to all gesture informations of current console touch-screen;

76) sign language identification module is called respectively to each gesture information, after it is identified, perform corresponding operating.