CN103309513B - Comprise the handwriting input equipment of palm side surface information - Google Patents

Abstract

The invention provides a handwriting input device and a data collection method. The handwriting input device simultaneously collects handwriting information generated during the writing process and surface information on the palm side of a hand holding a pen, and belongs to the field of computer information and the field of electronics. The information acquisition device of the device includes a side palmprint sensor, a display screen and an antenna array, wherein the antenna array is located at the bottom of the display screen, the display screen is located at the top of the antenna array, and the side palmprint sensor is located at the top of the display screen. The side palmprint sensor is used to acquire the two-dimensional image information of the palmprint on the opposite side, the antenna array is used to acquire the handwriting information, and the display screen is used to display the handwriting track information and present it to the user. Compared with collecting handwriting and other physiological characteristics separately, collecting handwriting information and palm print information generated during the writing process at the same time can effectively increase the difficulty of attack, thereby improving the security of the authentication system.

Description

Handwriting input device containing information on the surface of the palm side

technical field

The invention relates to the fields of computer information and electronics, in particular to a handwriting input device including palm side surface information.

Background technique

With the rapid development of e-commerce, the problem of user identity authentication in the network environment has become increasingly prominent. Handwriting is naturally suitable for applications in the network environment because of its various characteristics. However, due to the inherent differences between real handwriting and the threat of potential imitation of handwriting with high similarity, the current online handwriting authentication methods cannot fully meet the security requirements of application systems. Therefore, people think of fusing handwriting with other physiological features to improve the overall security of the authentication system. In the Chinese Patent Publication No. CN1794266A, entitled "Identification and Authentication Method for Biometric Fusion", a method for fusing handwriting with physiological features such as human face and iris is disclosed.

However, there is a security hole in using the above-mentioned fusion method in the network environment, that is, the independent feature collection process. After the attacker collects the user's characteristics, they present them to the authentication system in turn. In this case, the overall security of the authentication system is the greatest among all subsystems. The so-called independent feature collection process means that because physiological features belong to different parts of the body or behavioral features are contained in different processes, the collection of one feature does not presuppose the collection of other features. Obviously, multi-feature fusion in which the acquisition process is independent of each other cannot really solve the security problem of online authentication.

A common writing process is carried out by the pen-holding hand supported by a stable support plane. In this process, in addition to the handwriting that embodies behavioral characteristics, it also includes various dynamic and static information generated by the contact between the surface of the palm side and the support surface as the pen-holding hand moves. The dynamic information includes the pressure exerted by the palm contact surface on the support surface, the changing contour shape and area of the contact surface, and the distance from the contact surface to the pen tip; the static information includes the side palm print image of the contact surface. It is very difficult for an attacker to present to the system various information about the contact between the surface of the palm and the writing surface while imitating the handwriting.

Contents of the invention

The technical problem to be solved by the present invention is to avoid the shortcomings of the above-mentioned prior art and develop a handwriting input device that can include information on the surface of the palm. In particular, the present invention can realize simultaneous acquisition of handwriting handwriting information and palm side surface information during the handwriting input process, thereby solving the security problem caused by independent feature collection for authentication in the prior art. Among them, the handwriting information includes the trajectory information of the pen tip movement, the three-dimensional force exerted by the pen tip on the writing plane, and the angle of the pen holder relative to the writing plane; Texture image information.

The technical solution adopted in the present invention is: a handwriting input device, comprising: a side palmprint sensor, a display screen and an antenna array, wherein the antenna array is located at the bottom of the display screen, the display screen is located at the top of the antenna array, and the side palmprint sensor is placed On the upper part of the display screen, the side palmprint sensor is used to realize the two-dimensional image information acquisition of the opposite side palmprint, the antenna array is used to realize the acquisition of handwriting handwriting information, and the display screen is used to realize the display of handwriting track information , and present it to the user.

As a further improvement to the prior art, the present invention also provides a method for acquiring handwriting input information applied to the handwriting input device, the steps comprising:

A. Under the control of the synchronization module, read the data of the electromagnetic handwriting sensor and the side palmprint sensor at the same time.

B. Data denoising, especially the noise at the tip of the pen in the side palmprint image.

C. If the force in the Z direction is greater than the threshold or the area of the side palmprint image is greater than the threshold, go to the next step, otherwise, jump to A and read the data of the electromagnetic handwriting sensor and the side palmprint sensor again.

D. If the force in the Z direction is greater than the threshold, save the data such as the position of the pen tip and the pressure of the pen tip at the sampling time, otherwise, set the data such as the position and pressure of the pen tip at the sampling time to be empty.

E. If the area of the side palmprint image is greater than the threshold, save the side palmprint image data at the sampling moment, otherwise, set the side palmprint image at the sampling moment as empty.

F. Send the data such as the position of the pen tip, the pressure of the pen tip, the side palm print image and the time stamp at the sampling time to the interface module, jump to A, and read the data at the next sampling time.

The present invention additionally provides a handwriting input device containing palm side surface information, including an information acquisition module, a processing module, a synchronization module, a storage module and a display module, wherein:

Information acquisition module: used to simultaneously acquire handwriting information and side palm image information during the writing process, wherein the handwriting information includes the trajectory information of the pen tip movement, the three-dimensional force exerted by the pen tip on the writing plane, and the relative writing plane of the pen holder angle and other information;

Processing module: used to analyze and process the handwritten input information collected by the information acquisition module at the same time, specifically including digital filtering processing, signal conditioning analysis, threshold judgment and handwriting feature extraction functions;

Synchronization module: used to provide the working clock function of the handwriting device, and provide the synchronization function of handwriting information acquisition for the information acquisition module, so that the processing module can judge the time sequence synchronization of the handwriting input information according to the synchronization clock;

Storage module: used to store configuration parameters, and provide storage space for dynamic storage of data in the processing module;

Display module: used to provide a human-computer interaction interface function, so that the user can view the input information in real time during the handwriting input process.

The present invention additionally provides a handwriting input method including information on the surface of the palm side, including an information acquisition step, a processing step, a synchronization step, a storage step and a display step, wherein:

Information acquisition step: used to realize the simultaneous acquisition of handwritten handwriting information and side palm image information during the writing process, wherein the handwritten handwriting information includes the trajectory information of the movement of the pen tip, the three-dimensional force exerted by the pen tip on the writing plane, and the relative writing plane of the pen holder angle and other information;

Processing steps: used to analyze and process the handwritten input information collected at the same time in the information acquisition step, specifically including digital filtering processing, signal conditioning analysis, threshold judgment and handwriting feature extraction functions;

Synchronization step: used to provide the working clock function of the handwriting device, and provide the information acquisition module with the synchronization function of handwriting information acquisition, so that the processing step can judge the time sequence synchronization of the handwriting input information according to the synchronization clock;

Storage step: used to store configuration parameters, and provide storage space for dynamic storage of data during processing steps;

Displaying step: for providing a human-computer interaction interface function, so that the user can view the input information in real time during the handwriting input process.

As a further improvement to the prior art, the handwriting input device provided by the present invention can realize the simultaneous acquisition of the handwriting information generated during the writing process and the two-dimensional image information of the side palmprint, so that the present invention is an existing one-to-many feature Provide useful solutions and ideas for the problems brought about by the independent feature extraction of the authentication system.

Compared with the prior art, the beneficial effect of the present invention is: the simultaneous acquisition of the handwriting information generated in the writing process and the two-dimensional image information of the side palm print, which is brought by the existing independent feature extraction of the multi-feature authentication system Problems provide useful solutions and ideas. Even though an attacker can imitate forged handwriting with a high degree of similarity, while imitating the handwriting, it is also necessary to present to the system the surface texture image information of the side palm of the hand holding the pen in contact with the writing plane, as well as the contour shape of the contact surface of the side palm and the pen tip. The distance and orientation information to the contact surface is very difficult. This is because imitating handwriting while imitating the habit of holding a pen and writing will undoubtedly increase the difficulty of imitation. More importantly, the texture image information and contour shape information of the side palm contact surface reflect the physiological information of the writer's hand, which cannot be imitated , thus using the multiple biometric features collected simultaneously by the present invention can effectively improve the overall security of the authentication system.

Description of drawings

Fig. 1 is the system block diagram of handwriting input device of the present invention;

Fig. 2 is the composition block diagram of processing module of the present invention;

Fig. 3 is a block diagram of the composition of the sensor of the present invention;

Fig. 4 is a flow chart of handwriting input information acquisition;

Fig. 5 is a schematic diagram of a writing method including side palm information;

Fig. 6 is a structural block diagram of the electromagnetic handwriting device;

Fig. 7 is a schematic diagram of optical side palm information acquisition;

Figure 8 is eight frames of side palmprint images and handwriting data collected by the handwriting device when the user writes the word "one";

Figure 9 is the result of eight frames of data superimposed together;

Figure 10 is the information obtained by the handwriting device at each sampling moment;

Fig. 11 is the Z-direction pressure acquired by the electromagnetic input device;

Fig. 12 is the inclination angle between the pen holder and the plane obtained by the electromagnetic input device;

Fig. 13 is the rotation angle between the pen holder and the plane acquired by the electromagnetic input device.

detailed description

The present invention will be further described below in conjunction with the accompanying drawings and specific embodiments.

Fig. 1 is the system block diagram of handwriting input device of the present invention: comprise synchronization module 1, information acquisition module 2, processing module 3, storage module 4 and display module 5, wherein:

Information Acquisition Module 1: Used to simultaneously acquire handwritten handwriting information and side palm image information during the writing process, wherein the handwritten handwriting information includes the trajectory information of the pen tip movement, the three-dimensional force exerted by the pen tip on the writing plane, and the relative writing of the pen holder Information such as the angle of the plane;

Processing module 2: used to analyze and process the handwritten input information collected by the information acquisition module at the same time, specifically including digital filtering processing, signal conditioning analysis, threshold judgment and handwriting feature extraction functions;

Synchronization module 3: used to provide the working clock function of the handwriting device, especially to provide the synchronization function of handwriting information acquisition for the information acquisition module, so that the processing module can judge the time sequence synchronization of the handwriting input information according to the synchronization clock.

Storage module 4: used to store the configuration parameters of the device of the present invention, and provide storage space for dynamically saving data in the processing module;

Display module 5: used to provide the human-computer interaction interface function of the device of the invention, so that the user can view the input handwritten note information in real time during the handwriting input process.

Fig. 2 is the composition block diagram of processing module of the present invention: comprise handwriting handwriting information collection 21, side palm print image collection 22, analysis module 23 and bus interface module 24; Wherein, handwriting handwriting information collection 21 is used for realizing handwriting in the handwriting input process The trajectory data of the nib, the three-dimensional force exerted by the nib on the writing plane, and the angle of the penholder relative to the writing plane are obtained. The side palmprint image collection 22 is used to acquire the side palmprint image data. The analysis module 23 is used to realize the The analysis and processing of the above-mentioned handwritten data specifically includes digital filter processing, signal conditioning analysis and calculation of handwritten characteristic data. The bus interface module 24 then performs bus driving and initiates bus data transmission functions for the output data of the analysis module 23, and the processing module 3 Establish bus data communication link.

Fig. 3 is the composition block diagram of sensor of the present invention: comprise side palmprint sensor S1, display screen S2 and antenna array S3, wherein antenna array S3 is positioned at the bottom of display screen, display screen S2 is positioned at the top of antenna array S3, palmprint sensor S1 is positioned at display screen On the upper part of the screen S2, the side palmprint sensor S1 is used to obtain the two-dimensional image information of the palmprint on the opposite side, the display screen S2 is used to display the handwriting track information and present it to the user, and the antenna array S3 is used To realize the acquisition of handwritten handwriting information, specifically by sensing a passive stylus to realize the sensing of handwritten handwriting information, and through the processing module 3 to realize the analysis and calculation of the sensed handwritten input trajectory information, so as to obtain handwritten The input handwriting handwriting data, particularly, side palmprint sensor S1 can be made of semiconductor image sensor or optical image sensor or ultrasonic image sensor or can realize the component or module or the equipment that can realize palmprint image information is obtained, further, side The thickness of the palmprint sensor S1 and the display screen S2 can be designed according to application requirements, but should not affect the reception and calculation of handwriting input trajectory information by the antenna array S3.

If limited by the current technical conditions, the sum of the thicknesses of the side palmprint sensor S1 and the display screen S2 affects the reception and calculation of the handwriting input trajectory information of the antenna array S3. As a suboptimal solution, the display screen S2 in the middle layer is moved to In other areas of the handwriting device, the side palmprint sensor S1 is placed directly above the antenna array S3. This suboptimal solution does not affect the simultaneous collection of handwriting information and side palmprint image information.

The antenna array S3 belongs to the signal sensing part of the electromagnetic handwriting device. The structural block diagram of the electromagnetic handwriting device is shown in Fig. 6 .

Figure 4 is a flow chart of handwriting input information acquisition, and the specific steps are as follows:

Step S101: Under the control of the synchronization module, simultaneously read the data of the electromagnetic handwriting sensor and the side palmprint sensor.

Step S102: Data denoising, especially the noise at the tip of the pen in the side palmprint image.

Step S103: If the force in the Z direction is greater than the threshold or the area of the side palmprint image is greater than the threshold, go to step S104; otherwise, go to step S101 to read the electromagnetic handwriting sensor and side palmprint sensing data again.

Step S104: If the force in the Z direction is greater than the threshold, go to step S105; otherwise, go to step S106.

Step S105: Save data such as the position of the pen tip and the pressure of the pen tip at the sampling moment.

Step S106: Set the data such as the nib position and nib pressure at the sampling moment to be empty

Step S107: If the area of the side palmprint image is greater than the threshold, go to step S108; otherwise, go to step S109.

Step S108: Save the side palmprint image data at the sampling moment.

Step S109: Set the side palmprint image at the sampling moment as empty.

Step S110: Jump to step S101 to read data at the next sampling time to the interface module for transmitting data such as pen tip position, pressure, side palmprint image and time stamp at the sampling time.

The reading of the data of the electromagnetic handwriting sensor and the side palmprint sensor refers to reading the handwriting data and the two-dimensional image data of the side palmprint processed by the information processing unit and sensed by the antenna array and the image sensor respectively.

FIG. 5 is a schematic diagram of a writing method including side palm information. The writer holds a passive inductive stylus S4 and writes on a stable writing plane provided by the handwriting input device. During the writing process, the side palmprint sensor S1 acquires the palmprint image information of the hand holding the pen in contact with the writing surface. For handwriting information, the display screen S2 is used to display handwriting information in real time.

In the method of the present invention, the electromagnetic handwriting device is the prior art. The following is an exemplary description of its structural block diagram for the convenience of implementation. As shown in FIG. 6 , the electromagnetic handwriting device includes an electromagnetic tablet and an electromagnetic pen. The electromagnetic tablet includes an antenna array and an information processing module. Preferably, the signal processing module includes a second amplifier, a signal processor, an integrating circuit, an analog-to-digital converter and a central processing unit. The second amplifier amplifies the induction signal received by the receiving line diagram, and outputs the amplified signal. The signal processor processes the amplified signal. The integration circuit integrates the signal processed by the signal processor and outputs the integration signal. The analog-to-digital converter performs analog-to-digital conversion on the integrated signal to output a digital signal, and the central processing unit processes the digital signal to obtain information including position information and pressure information of the electromagnetic pen.

As shown in FIG. 6, the signal processing module further includes a second multiplexer, a first multiplexer, a signal generator and a first amplifier. Under the control of the central processing unit, the signal generator generates a signal, and after being amplified by the first amplifier, the sending coil is strobed through the first multiplexer, so that the specific sending coil sends electromagnetic waves outward, and the electromagnetic pen senses After receiving the electromagnetic wave sent by the sending coil, an induction signal is sent out, and the second multiplexer selects the receiving coil to receive the induction signal, and outputs it to the second amplifier for the above-mentioned follow-up processing.

In the method of the present invention, the side palmprint sensor is the prior art, and the existing side palmprint sensor includes a semiconductor image sensor; an optical image sensor; an ultrasonic image sensor and the like. The following takes the optical palmprint sensor as an example to illustrate the side palmprint collection process for easy implementation. As shown in Figure 7, the principle is that the strong light (red or blue) emitted from the collection head hits the side palm, the light diffuses from the side palm and then enters the prism, refracts and hits the convex lens, and is focused by the lens The palmprint signal of the side palm is imaged on the CMOS screen, and the image data of the side palmprint is obtained after being processed by the processor.

Figure 8 shows eight frames of palm print images and handwriting data collected by the handwriting input device containing side surface information when the user writes the word "one". Figures 11, 12, and 13 show the electromagnetic handwriting device The acquired Z-direction pressure information applied by the electromagnetic pen on the writing plane, the inclination angle and rotation angle information of the pen holder and the plane. The result of superimposing eight frames of data is shown in Figure 9, and the information acquired by the handwriting device at each sampling moment is shown in Figure 10, including the handwriting information S5 acquired by the electromagnetic handwriting device and the side palm print information obtained by the side palmprint sensor. Texture image information S6, wherein the handwriting information includes the position of the pen tip, the pressure exerted by the pen tip on the writing plane, the angle between the pen holder and the writing plane, and the inclination information. The side palmprint image is a side palmprint image in the writing area, and should not only contain the contact part of the side palm, as shown in the shaded part in Figure 10 .

The parts not disclosed in detail in the present invention belong to the known technology in the art.

Although the illustrative specific embodiments of the present invention have been described above, so that those skilled in the art can understand the present invention, it should be clear that the present invention is not limited to the scope of the specific embodiments. For those of ordinary skill in the art, As long as various changes are within the spirit and scope of the present invention defined and determined by the appended claims, these changes are obvious, and all inventions and creations using the concept of the present invention are included in the protection list.

Claims (1)

1. the collecting method of a handwriting input device, this handwriting input device comprises: side palmprint sensor, display screen and aerial array, wherein, aerial array is positioned at the bottom of display screen, side palmprint sensor is positioned at the top of display screen, described side palmprint sensor is used for realizing offside palmmprint two-dimensional image information and obtains, aerial array is for realizing the acquisition to handwriting signal, display screen is then for realizing the display to hand-written trace information, and present to user, it is characterized in that, comprise the steps:

Steps A, under synchronization module controls, read electromagnetic handwritten sensor and side palmprint sensor data simultaneously;

Step B, data de-noising, remove the noise at nib place in the palmprint image of side;

If step C Z-direction power is greater than threshold value or side palmprint image area is greater than threshold value, then enter next step, otherwise, jump to steps A, again read electromagnetic handwritten sensor and side palmprint sensor data;

If step D Z-direction power is greater than threshold value, preserve pen tip position and the pen point pressure data of sampling instant, otherwise pen tip position and the pressure data of putting this sampling instant are sky;

If step e side palmprint image area is greater than threshold value, preserve the side palmprint image data of this sampling instant, otherwise, put the side palmprint image of this sampling instant for empty;

Step F, the pen tip position of this sampling instant, pen point pressure, side palmprint image and time stamp data are sent to interface module, jump to steps A, read next sampling instant data.