CN114816053A - Eye tracking interaction method and device, electronic equipment and readable storage medium - Google Patents

Abstract

The present application discloses an eye-tracking interaction method, device, electronic device and readable storage medium. The eye-tracking interaction method includes: controlling an eye-tracking component to project electromagnetic waves to the eyeballs, receiving electromagnetic waves projected to the eyeballs and reflecting them back Based on the light intensity of the reflected waves received by each eye tracking component, the eye gaze angle is determined; the eye tracking component is controlled to continuously monitor the eye gaze angle, and the interactive interface is controlled according to the current eye gaze angle. The present application improves the convenience of human-computer interaction for the intelligent display device.

Description

Eye tracking interaction method, apparatus, electronic device and readable storage medium

technical field

The present application relates to the field of interaction of intelligent display devices, and in particular, to an eye tracking interaction method, apparatus, electronic device and readable storage medium.

Background technique

Head-mounted virtual reality devices, also known as VR (Virtual Reality) glasses or VR helmets, head-mounted augmented reality devices, also known as AR (Augmented Reality) glasses, or AR helmets, are currently rapidly developing and popularizing virtual reality and Augmented reality products. Many smart display devices on the market, such as AR devices or VR devices, basically realize human-computer interaction by manipulating the handle. This interaction method requires both hands to hold the handle to operate, and long-term operation of the handle is prone to fatigue. At the same time, some people with hand or arm disabilities cannot operate the handle smoothly, which is very inconvenient, and thus makes the convenience of human-computer interaction poor. However, how to improve the convenience of human-computer interaction for the intelligent display device has become an urgent technical problem to be solved.

SUMMARY OF THE INVENTION

The main purpose of the present application is to provide an eye tracking interaction method, device, electronic device and readable storage medium, aiming at improving the convenience of human-computer interaction for smart display devices.

In order to achieve the above object, the present application provides an eye tracking interaction method, the eye tracking interaction method is applied to an eye tracking interaction device, and the eye tracking interaction device includes at least four eye tracking components, and each The eye-tracking components are distributed in multiple directions relative to the eyeball, and the eye-tracking interaction method includes:

controlling the eye tracking component to project electromagnetic waves to the eyeballs, and receiving reflected waves reflected back by the electromagnetic waves projected to the eyeballs;

determining the eye gaze angle based on the light intensity of the reflected waves received by each of the eye tracking components;

The eye tracking component is controlled, the eye gaze angle is continuously monitored, and the interactive interface is controlled according to the current eye gaze angle.

Optionally, the step of manipulating the interactive interface according to the current eye gaze angle includes:

If it is detected that the light intensity of the reflected wave has a preset number of sudden changes within a preset time period, according to the current eye gaze angle, query the current eye gaze angle mapping from the preset interface coordinate mapping table coordinate position;

Trigger a functional operation corresponding to the UI control at the current coordinate position of the interactive interface.

Optionally, the step of determining the eye gaze angle based on the light intensity of the reflected waves received by each of the eye tracking components includes:

Based on the light intensity of the reflected waves received by each of the eye tracking components, construct light intensity data features of the reflected waves in various directions;

From a preset gaze angle mapping library, the matching gaze angle of the feature map of the light intensity data is obtained by querying, and the matched gaze angle is used as the eye gaze angle.

Optionally, before the step of controlling the eye tracking component to project electromagnetic waves to the eyeball, the step includes:

Display the visual mark at the preset coordinate position of the interactive interface;

controlling the eye tracking component to project electromagnetic waves to the eyeballs, and receiving reflected waves reflected back by the electromagnetic waves projected to the eyeballs;

The gaze angle mapping library is calibrated according to the light intensity of the reflected wave received by each of the eye tracking components when the eye is gazing at the visual marker.

Optionally, the eye-tracking interaction device includes at least eight eye-tracking components, and at least four eye-tracking components are set for each eyeball, so that the eye-tracking interaction device can monitor the current The eye gaze angles of the two eyeballs are determined, and the interactive interface is controlled according to the eye gaze angles of the two eyeballs.

Optionally, the step of manipulating the interactive interface according to the current eye gaze angle further includes:

If the confirmation instruction sent by the external device is received, according to the current eye gaze angle, query the current coordinate position of the eye gaze angle mapping from a preset interface coordinate mapping table;

Trigger a functional operation corresponding to the UI control at the current coordinate position of the interactive interface.

Optionally, the eye-tracking assembly includes a paired transmitting module and a receiving module, and the step of controlling the eye-tracking assembly to project electromagnetic waves to the eyeball includes:

controlling the transmitting modules in each of the eye tracking components to project electromagnetic waves of different operating frequencies to the eyeballs respectively;

Based on the light intensity of the reflected waves received by each of the eye tracking components, the step of determining the eye gaze angle includes:

The gaze angle of the eyeball is determined based on the light intensity of the paired reflected waves received by each of the receiving modules, wherein the paired reflected waves are the reflected waves of the operating frequencies projected by the transmitting modules paired with each of the receiving modules.

The present application also provides an eye-tracking interaction device, the eye-tracking interaction device includes at least four eye-tracking components, and each of the eye-tracking components is distributed in multiple directions relative to the eyeball, the eye-tracking Interactive devices include:

an electromagnetic wave transceiver unit, configured to control the eye tracking component to project electromagnetic waves to the eyeballs, and receive reflected waves reflected back by the electromagnetic waves projected to the eyeballs;

A gaze angle analysis unit, configured to determine an eye gaze angle based on the light intensity of the reflected waves received by each of the eye tracking components;

The interactive interface control unit is configured to control the eye tracking component, continuously monitor the eye gaze angle, and control the interactive interface according to the current eye gaze angle.

The present application also provides an electronic device, the electronic device is a physical device, and the electronic device includes: a memory, a processor, and the eye tracking interaction stored on the memory and executable on the processor The program of the method, when the program of the eye-tracking interaction method is executed by the processor, can realize the steps of the above-mentioned eye-tracking interaction method.

The present application also provides a readable storage medium on which a program for implementing the eye tracking interaction method is stored, and the program for implementing the eye tracking interaction method is executed by a processor to implement the above-mentioned eye tracking The steps of the interactive method.

The present application also provides a computer program product, including a computer program, which implements the steps of the above-mentioned eye tracking interaction method when the computer program is executed by a processor.

Because the shape of the surface of the eyeball is different when the human eyeball is in different gaze directions, the angle of reflected light to the electromagnetic wave is different. Therefore, the light intensity of the reflected wave reflected to different directions relative to the eyeball is different for different eyeball gaze angles. The invention receives reflected waves through eye tracking components distributed in different directions relative to the eyeball, analyzes the eye gaze angle of the user according to the light intensity of the reflected waves collected in different directions, and continuously monitors the eye gaze by controlling the eye tracking components angle, so as to continuously track and locate the gaze point trajectory of the eyeball, and determine the current eyeball gaze point according to the current eye gaze angle, control the interactive interface, and realize the eyeball control function. For human-computer interaction, the present invention gets rid of the limitation of the handle, eliminates the fatigue caused by operating the handle for a long time, and can perform human-computer interaction with the smart device by moving the eyes, which is more convenient for people with hand or arm disabilities. The operation greatly increases the operability of the intelligent display device, expands the target audience, and further improves the convenience of human-computer interaction for the intelligent display device.

Description of drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the application and together with the description serve to explain the principles of the application.

In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the following briefly introduces the accompanying drawings that need to be used in the description of the embodiments or the prior art. In other words, on the premise of no creative labor, other drawings can also be obtained from these drawings.

FIG. 1 is a schematic flowchart of a first embodiment of an eye tracking interaction method according to the present application;

FIG. 2 is a schematic flow chart of the refinement of step S20 in the second embodiment of the eye tracking interaction method of the present application;

FIG. 3 is a schematic diagram of a hardware structure of an eye tracking interaction device according to an embodiment of the present application;

FIG. 4 is a schematic structural diagram of a module of an eye-tracking interaction device according to an embodiment of the present application;

5 is a schematic diagram of the amount of light of the reflected wave above the eyeball when the eyeball looks down in the embodiment of the present application;

6 is a schematic diagram of the amount of light of reflected waves above the eyeball when the eyeball is looking forward in an embodiment of the present application;

7 is a schematic diagram of the amount of light of the reflected wave above the eyeball when the eyeball is viewed upward in the embodiment of the present application;

8 is a schematic diagram of the amount of light of the reflected wave below the eyeball when the eyeball looks down in the embodiment of the present application;

Fig. 9 is the corresponding light intensity data characteristic when the eyeball looks up in the embodiment of the present application;

Fig. 10 is the corresponding light intensity data characteristic when the eyeball looks down in the embodiment of the application;

FIG. 11 is the corresponding light intensity data feature when the eyeball is left looking in the embodiment of the present application;

FIG. 12 is the corresponding light intensity data feature when the eyeball looks right in the embodiment of the application;

FIG. 13 is a schematic diagram of a device structure of a hardware operating environment involved in an eye-tracking interaction apparatus according to an embodiment of the present application.

The realization, functional features and advantages of the present application will be further described with reference to the accompanying drawings in conjunction with the embodiments.

Detailed ways

In order to make the above objects, features and advantages of the present invention more obvious and easy to understand, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some, but not all, embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative work fall within the protection scope of the present invention.

Example 1

At present, many smart display devices on the market, such as AR devices or VR devices, basically realize human-computer interaction by manipulating the handle. This interaction method requires both hands to hold the handle to operate, and long-term operation of the handle is easy to produce Fatigue, and at the same time, some people with hand or arm disabilities cannot operate the handle smoothly, which is very inconvenient, which makes the convenience of human-computer interaction poor.

Based on this, the present application proposes the eye-tracking interaction method in the first embodiment, which is applied to the field of interaction of smart display devices, such as AR devices, VR devices, smart TVs, projectors, LEDs (Light-Emitting Diodes) Diode) display large screen or flat panel, etc.

Please refer to FIG. 1 , the eye tracking interaction method is applied to an eye tracking interaction device, and the eye tracking interaction device includes at least four eye tracking components, and each of the eye tracking components is distributed in a plurality of relative eyeballs. the orientation, the eye tracking interaction method includes:

Step S10, controlling the eye tracking component to project electromagnetic waves to the eyeballs, and receiving reflected waves reflected back by projecting the electromagnetic waves to the eyeballs;

In this embodiment, the application is not limited to the interactive field of smart glasses such as AR devices or VR devices, but also includes other smart display devices such as smart TVs, projectors, large LED display screens and tablets. It should be noted that, the smart display device may allow the user to view visual data or other visual data provided by the head-mounted virtual reality device or the head-mounted augmented reality device, such as game images and the like. Just as an example, such smart display devices may include LCD (Liquid Crystal Display, liquid crystal display) screens, LED (Light-Emitting Diode, light-emitting diode) screens, OLED (Organic Light Emitting Display, organic light-emitting display) screens, projectors and /or other display technologies (eg, phone screens, tablet screens, etc.).

In this embodiment, the electromagnetic waves may be infrared, radio waves, or microwaves. It is easy to understand that the eye tracking component includes at least an electromagnetic wave transmitting module and an electromagnetic wave receiving module, the electromagnetic wave transmitting module projects electromagnetic waves to the eyeball, and the electromagnetic wave receiving module receives the reflected waves projected by the electromagnetic wave to the eyeball and reflected back.

It is easy to understand that according to the eye movement habits of the human eye, the eyeballs of both eyes are often fixed in one direction at the same time, that is, the fixation points of the two eyeballs are often the same. location tracking. It should be noted that, in this embodiment, the eye-tracking interaction device includes at least four eye-tracking components, and each eye-tracking component is distributed in multiple directions relative to the eyeball relative to a single eyeball. That is to say, when positioning and tracking one eye in both eyes, the eye-tracking interaction device includes at least four eye-tracking components, and when positioning and tracking two eyeballs, the eye-tracking interaction device includes at least eight an eye-tracking component. By positioning and tracking only one eyeball in the binocular, the purpose of tracking the gaze point of the binocular can also be achieved, so that it is unnecessary to set up more eye-tracking components, thereby reducing the structural cost of the eye-tracking interactive device.

In a possible implementation manner, in order to track and locate both eyeballs, the eye-tracking interaction device includes at least eight eye-tracking components, and at least four eye-tracking components are set for each eye-ball A motion tracking component is used for the eye tracking interaction device to monitor the current eye gaze angles of the two eyeballs at the same time, and to control the interactive interface according to the eye gaze angles of the two eyeballs.

In this embodiment, the gaze point of the human eye is determined by tracking and positioning both eyeballs at the same time, and comprehensively analyzing the gaze angles of the two eyeballs, which can eliminate the deviation caused by monitoring the gaze angle of a single eyeball, thereby improving the monitoring of human eyes. Gaze accuracy.

Step S20, determining the eye gaze angle based on the light intensity of the reflected waves received by each of the eye tracking components;

In this embodiment, the light intensity of the reflected wave is used to represent the luminous intensity of the reflected wave in a given direction. It can be understood by those skilled in the art that when electromagnetic waves are projected to the eyeballs, a part of the electromagnetic waves will be reflected by the eyeballs, and these electromagnetic waves reflected by the eyeballs are called reflected waves. The angle of the reflected light is different, therefore, the light intensity of the reflected wave reflected to different directions relative to the eye is different for different eye gaze angles. The present application receives reflected waves through eye tracking components distributed in multiple directions relative to the eyeball, and analyzes and determines the gaze angle of the eyeball according to the light intensities of the reflected waves collected in different directions.

Step S30 , controlling the eye tracking component, continuously monitoring the eye gaze angle, and controlling the interactive interface according to the current eye gaze angle.

In this embodiment, continuous monitoring of the eye gaze angle can be achieved by controlling the eye tracking component to emit electromagnetic waves at a preset frequency, and correspondingly to receive reflected waves reflected from the electromagnetic waves projected to the eyeballs at the preset frequency. It can be understood that, in this embodiment, by continuously monitoring the eye gaze angle, if the user presses the confirmation key of the external device connected to the eye tracking component for wireless communication or wired communication, or the user performs a preset human eye operation, such as a single Eye blinking operation or binocular blinking operation, the current eye gaze angle is obtained, and according to the eye gaze point corresponding to the current eye gaze angle, the eye gaze point on the interactive interface corresponding to the UI (User Interface Design, user interface) control is triggered. Function operation to control the interactive interface.

Because the shape of the surface of the eyeball is different when the human eyeball is in different gaze directions, the angle of reflected light to the electromagnetic wave is different. Therefore, the light intensity of the reflected wave reflected to different directions relative to the eyeball is different for different eyeball gaze angles. In this embodiment, the reflected waves are received by the eye tracking components distributed in different directions relative to the eyeball, and the eye gaze angle of the user is analyzed according to the light intensity of the reflected waves collected in different directions, and the eyeball is continuously monitored by controlling the eye tracking component. Gaze angle, so as to continuously track and locate the gaze point trajectory of the eyeball, and determine the current eye gaze point according to the current eye gaze angle, control the interactive interface, and realize the eyeball control function. The handle performs human-computer interaction. This embodiment gets rid of the limitation of the handle and eliminates the fatigue caused by operating the handle for a long time. Human-computer interaction with the smart device can be performed by moving the eyes, which is more convenient for those with hand or arm disabilities. It greatly increases the operability of the smart display device, expands the target audience, and improves the convenience of human-computer interaction for the smart display device.

In an embodiment, the eye tracking interaction device applied in the embodiment of the present application is VR/AR glasses. As shown in FIG. 3 , the structure of the VR/AR glasses includes eight eye tracking components, wherein one eye tracking The component includes an electromagnetic wave transmitter and an electromagnetic wave receiver, and four eye tracking components are set corresponding to one eyeball, and one eye tracking component is respectively set on the upper, lower, left and right directions (relative four sides) of each eyeball. components. This embodiment can monitor the gaze angles of the two eyeballs, and realize the interface control of an intelligent display device such as a VR device according to the eye gaze angles of the two eyeballs. The moving position and rotation angle of the eyeballs can be detected by electromagnetic waves, so that an accurate judgment can be made. The gaze point of the eyeball at all times, or the trajectory of the eyeball movement in a certain period of time, in this way, the eyeball can control the intelligent display device, and the convenience of human-computer interaction on the intelligent display device is improved.

Further, in order to further help the understanding of the present application, please refer to FIG. 4 . In one embodiment, the eye tracking interaction device applied in the present application includes an electromagnetic wave transmitter and an electromagnetic wave receiver (eye tracking component), a DSP (Digital Signal Process , digital signal processing) signal processing module, SOC (System on Chip, system-on-chip) host control module, screen display module, and battery and power supply module. Through a new circuit design, this embodiment integrates an electromagnetic wave transmitter, an electromagnetic wave receiver and a DSP processing module on the basis of the original VR/AR circuit. After the SOC host control module works, the electromagnetic wave transmitter will emit electromagnetic wave signals and project To the user's eyeball, since the electromagnetic wave will be scattered and reflected after contacting different media, part of the electromagnetic wave will be reflected back, and at the same time, the reflected electromagnetic wave energy will be received by the electromagnetic wave receiver and processed by the algorithm of the DSP processing module. The program performs data processing to calculate the user's eye gaze angle. The SOC host control module determines the eye gaze angle corresponding to the eye gaze point on the interactive interface according to the eye gaze angle, and triggers the interactive interface to operate at the eye gaze point. , so that the screen display module displays the interactive interface corresponding to the function operation. In this embodiment, when the SOC host control module determines the eye gaze point, a manipulation mark, such as a cursor such as a mouse arrow, will be displayed on the interactive interface at the position corresponding to the eye gaze point, and the manipulation mark will move in real time with the movement of the eyeball. After the control logo is moved to the touch button (ie UI control), the user can enter the confirmation command by blinking twice in succession. Since the surface of the eyelid is rough when the eyes are closed, the electromagnetic waves are scattered in multiple directions, so the reflected electromagnetic waves are relatively weak. , the signal received by the electromagnetic wave receiver is relatively small, so the electromagnetic wave receiving module will detect two signal sudden changes, and the two signal sudden changes can be set as valid data when the interval is less than 0.5S to avoid the habitual single signal of the human eye. Interference caused by the blink of an eye on human-computer interaction. When the electromagnetic wave receiving module detects two signal sudden changes with an interval of less than 0.5S, the SOC host control module will execute the "OK" command to control the screen display module to enter the interactive interface of the function operation corresponding to the touch button.

In an implementable manner, the step of manipulating the interactive interface according to the current gaze angle of the eyeball includes:

Step A10, if it is detected that the light intensity of the reflected wave has a preset number of sudden changes within a preset duration, then according to the current eye gaze angle, query the eye gaze angle from a preset interface coordinate mapping table The current coordinate position of the map;

In this embodiment, the preset duration and the preset number of times can be set by those skilled in the art according to the actual situation, which is not specifically limited in this embodiment. For example, the preset duration may be 0.5S, 0.6S, 0.8S, or 1S, etc., preferably between 0.3S and 1S, and the preset number of times may be two or three, etc., preferably two.

It should be noted that the interface coordinate mapping table is pre-stored in the eye tracking interaction device, and the interface coordinate mapping table has a one-to-one mapping relationship between the eye gaze angle and the coordinate position of the gaze on the interactive interface.

Step A20: Trigger a functional operation corresponding to the UI control at the current coordinate position of the interactive interface.

It is understandable that different UI controls often correspond to different functional operations. As an example, the functional operation corresponding to the UI control may include a slide-up command for displaying data, a slide-down command for displaying data, a left-slide command for displaying data, a right-slide command for displaying data, a playback pause command, a playback start command, and a volume Increase command and volume decrease command, etc. It should be noted that the above examples of UI controls are for the purpose of helping the understanding of UI controls, and do not constitute a limitation on UI controls.

In this embodiment, by detecting that the light intensity of the reflected wave has a preset number of sudden changes within a preset time period, it is determined that the user has performed a preset human eye operation corresponding to the determined instruction, such as blinking two or three times in a row, and then Or blinking your eyes two or three times in a row. Because the surface of the eyelid is relatively rough at the moment of closing the eyes, and the electromagnetic waves are scattered in multiple directions, the reflected electromagnetic waves are relatively weak, and the signal received by the electromagnetic wave receiver is relatively small. Therefore, the electromagnetic wave receiving module will detect that the light intensity of the reflected wave is pre- A preset number of sudden changes are generated within the set duration. In this embodiment, the preset duration is set so as to avoid disturbance to human-computer interaction caused by the habitual single blink of the human eye. That is to say, it is detected that the light intensity of the reflected wave has a preset number of sudden changes within a preset time period, which is similar to receiving the confirmation button instruction. At this time, by triggering the function operation corresponding to the UI control at the current coordinate position of the interactive interface, Thus, the control of the eyeball on the intelligent display device is realized.

In an implementable manner, in the step S20, the step of determining the gaze angle of the eyeball based on the light intensity of the reflected wave received by each of the eye tracking components includes:

Step S21, based on the light intensity of the reflected waves received by each of the eye tracking components, constructing the light intensity data features of the reflected waves in various directions;

In this embodiment, the light intensity data feature refers to feature information corresponding to the light intensity of the reflected waves received in various directions. It is easy to understand that different eye gaze angles correspond to different light intensity data characteristics.

Step S22, query to obtain the matching gaze angle of the light intensity data feature map from a preset gaze angle mapping library, and use the matched gaze angle as the eye gaze angle.

In this embodiment, the gaze angle mapping library is pre-stored in the eye tracking interactive device, and the gaze angle mapping library has a one-to-one mapping relationship between light intensity data features and eye gaze angles. It is easy to understand that the matching gaze angle is the eye gaze angle of the feature mapping of the current light intensity data.

This embodiment uses the principle of different light intensities of reflected waves reflected to different directions relative to the eyeball based on different eye gaze angles, and pre-calibrates a gaze angle mapping library that maps each light intensity data feature and eye gaze angle one by one. The light intensity of the reflected wave received by the eye tracking component is constructed from the light intensity data characteristics of the reflected wave in various directions, and the matching gaze angle of the light intensity data feature map is obtained by querying from the preset gaze angle mapping library. The matching gaze angle is used as the eye gaze angle, so that the user's eye gaze angle can be detected accurately and efficiently.

In a possible embodiment, the gaze angle mapping library can use the real model of the human eyeball in the laboratory to build a physical model, and build an algorithm model to build a real product use environment, and then train through a large number of models And test, record the one-to-one correspondence between the light intensity data characteristics and the eye gaze angle under multiple different eye gaze angles, so as to complete the calibration of the gaze angle mapping library.

In order to help understand the technical idea or working principle of the present application, a specific embodiment is listed:

When the electromagnetic wave receiver collects the reflected wave, the larger the angle between the electromagnetic wave receiver and the tangent plane of the eyeball, the more the amount of light collected (that is, the light intensity of the electromagnetic wave), so that the eye tracking component (including the Electromagnetic wave receiver and electromagnetic wave transmitter) as an example, when the eyes are looking down, the angle between the electromagnetic wave receiver above the eyeball and the tangent plane of the eyeball is smaller, and the electromagnetic wave receiver above the eyeball receives the least amount of light at this time. Please Refer to Figure 5. When the eye looks forward, the angle between the electromagnetic wave receiver above the eyeball and the tangential plane of the eyeball increases, and the amount of light received by the electromagnetic wave receiver above the eyeball increases, please refer to Figure 6. When the eye is looking upward, the angle between the electromagnetic wave transmitter above the eyeball and the tangential plane of the eyeball is the largest, and the electromagnetic wave receiver above the eyeball receives the most light at this time, as shown in Figure 7. Taking the eye tracking component (including the electromagnetic wave receiver and the electromagnetic wave transmitter) placed under the eyeball as an example, when the eye is looking downward, the angle between the electromagnetic wave transmitter under the eyeball and the tangent plane of the eyeball is the largest. The amount of light received by the electromagnetic wave receiver is the largest, and the other eye gaze directions correspond to the same analogy, which will not be repeated here. According to the above analysis, when the gaze point of the eye is closer to an eye tracking component, the amount of light received by the eye tracking component is more, and as the gaze point moves away from the eye tracking component, the eye tracking component will receive more light. The amount of light received is gradually reduced. Figures 9 to 12 respectively show the light intensity data characteristics of four typical eye gaze angles of eye up, eye down, eye left and right eye. Among them, the emission wave intensity curve corresponding to "receiver 1 (top)" refers to the light intensity information corresponding to the reflected wave received by the electromagnetic wave receiver in the eye tracking component placed above the eyeball, and "receiver 2 (bottom)" corresponds to The emission wave intensity curve refers to the light intensity information corresponding to the reflected wave received by the electromagnetic wave receiver in the eye tracking component located under the eyeball. The light intensity information corresponding to the reflected wave received by the electromagnetic wave receiver in the eye-tracking component of Fang’s eye tracking component, and the emission wave intensity curve corresponding to “Receiver 4 (bottom)” refers to the electromagnetic wave receiver in the eye-tracking component located under the eyeball. Receive the light intensity information corresponding to the reflected wave. From the emission wave intensity curves corresponding to each typical eye gaze angle, it is easy to see that when the eyeball looks upward (that is, the eyeball looks upward), the light intensity corresponding to the reflected wave received by the eye tracking component disposed above the eyeball is the largest , the light intensity corresponding to the reflected wave received by the eye tracking components disposed on the left and right of the eyeball is second, and the light intensity corresponding to the reflected wave received by the eye tracking component disposed below the eyeball is the smallest. When the eyeball looks downward (that is, the eyeball looks downward), the light intensity corresponding to the reflected wave received by the eye-tracking component disposed below the eyeball is the largest, and the reflected wave received by the eye-tracking component disposed on the left and right of the eyeball The corresponding light intensity is next, and the light intensity corresponding to the reflected wave received by the eye tracking component disposed above the eyeball is the smallest. When the eyeball looks left (that is, the eyeball looks to the left), the light intensity corresponding to the reflected wave received by the eye-tracking component located on the left side of the eyeball is the largest, and the reflected wave received by the eye-tracking component located above and below the eyeball corresponds to the reflected wave The light intensity is the second, and the light intensity corresponding to the reflected wave received by the eye tracking component located on the right side of the eyeball is the smallest. When the eyeball looks right (that is, the eyeball looks to the right), the light intensity corresponding to the reflected wave received by the eye-tracking component located on the right side of the eyeball is the largest, and the reflected wave received by the eye-tracking component located above and below the eyeball corresponds to the reflected wave The light intensity is second, and the light intensity corresponding to the reflected wave received by the eye tracking component located on the left side of the eyeball is the smallest. Based on this, the system can accurately identify the user's current eye gaze angle according to the light intensity information corresponding to the reflected waves received by the eye tracking components in various directions.

It should be noted that the light intensity data features of these four typical eye gaze angles are only used to help understand the technical concept or working principle of the present application, and do not constitute a limitation on the light intensity data features actually calibrated in the present application. And it will be easily understood by those skilled in the art that the above-mentioned gaze angle mapping library should include the mapping of four typical eye gaze angles (eyeball up, eye down, left eye and right eye) and light intensity data features. relationship, and should also include more mapping relationships between eye gaze angles and light intensity data features.

In an implementable manner, the step of manipulating the interactive interface according to the current gaze angle of the eyeball further includes:

Step B10, if the confirmation instruction sent by the external device is received, according to the current eye gaze angle, query the current coordinate position of the eye gaze angle mapping from a preset interface coordinate mapping table;

In this embodiment, the external device refers to a control device that is connected to the eye tracking interaction device by wired communication or wireless communication, and the external device has a click function, such as a remote control or a mouse. The user can make the external device send the confirmation instruction by pressing the confirmation button on the external device.

Step B20, triggering a functional operation corresponding to the UI control at the current coordinate position of the interactive interface.

In this embodiment, if a confirmation command sent by an external device is received, according to the current eye gaze angle, the current coordinate position of the eye gaze angle map is inquired from the preset interface coordinate mapping table, and then the interactive interface is triggered at the current coordinate position The function operation corresponding to the UI control of the APP enables the eyeball to control the intelligent display device. Compared with the blinking selection through pure eye movement interaction, this embodiment will not be blacked out during the input process of the confirmation command, avoiding the The blinking operation reduces the user's viewing experience, continues the operation habit of people using external devices such as a mouse or a remote control, and improves the human-computer interaction experience.

In an implementable manner, the eye-tracking assembly includes a paired transmitting module and a receiving module, and in step S10, the step of controlling the eye-tracking assembly to project electromagnetic waves to the eyeball includes:

Step C10, controlling the transmitting modules in each of the eye tracking components to project electromagnetic waves of different operating frequencies to the eyeballs respectively;

In this embodiment, those skilled in the art can understand that the electromagnetic waves of different operating frequencies mean that the wavelengths of the electromagnetic waves are different.

In the step S20, the step of determining the eye gaze angle based on the light intensity of the reflected wave received by each of the eye tracking components includes:

Step C20, determining the eye gaze angle based on the light intensity of the paired reflected waves received by each of the receiving modules, wherein the paired reflected waves are the reflected waves of the operating frequencies projected by the corresponding transmitting modules paired with each of the receiving modules .

Because if each eye tracking component emits electromagnetic waves of the same working frequency (ie the same wavelength), the electromagnetic waves emitted by each eye tracking component will interfere with each other, so that the light intensity information corresponding to the reflected waves in different directions cannot be accurately detected, which leads to inaccuracy. The light intensity data characteristics are obtained, and the user's eye gaze angle is accurately tracked and positioned. Therefore, in this embodiment, by controlling the transmitting modules in each eye tracking component, electromagnetic waves of different operating frequencies are projected to the eyeballs, and the eye gaze angle is determined based on the light intensity of the paired reflected waves received by each receiving module, thereby avoiding eye tracking. The electromagnetic waves sent and received by the components will interfere with each other, which improves the accuracy of tracking and positioning the user's eye gaze angle.

Embodiment 2

Referring to FIG. 2 , based on the first embodiment of the present application, in another embodiment of the present application, for the same or similar content as the above-mentioned first embodiment, reference may be made to the above description, and no further description will be given in the following. On this basis, the step of controlling the eye tracking component to project electromagnetic waves to the eyeball includes:

Step D10, displaying a visual mark at a preset coordinate position of the interactive interface;

In this embodiment, the visual identification is a kind of cursor, and the user completes the calibration process of the gaze angle mapping library by gazing at the cursor. The preset coordinate position can be set by those skilled in the art according to the actual situation, subject to better calibration of the gaze angle mapping library, which is not specifically limited in this embodiment. In one embodiment, the preset coordinate position may be the middle coordinate position of the interactive interface.

Step D20, controlling the eye-tracking component to project electromagnetic waves to the eyeballs, and receiving reflected waves reflected back by projecting the electromagnetic waves to the eyeballs;

Step D30 , calibrating the gaze angle mapping library according to the light intensity of the reflected wave received by each of the eye tracking components when the eye gazes at the visual identifier.

Even if the eye gaze angles of two people are exactly the same, because each person's eyeballs are more or less different, the light intensity corresponding to the reflected waves collected by the eye tracking component in different directions when two people have the same eye gaze angle The information may still be different, so before the eye tracking interaction, the gaze angle mapping library needs to be calibrated to better match the real model of the user's individual eye.

In this embodiment, it should be noted that the visual identification can be displayed at different preset coordinate positions of the interactive interface in time division. For example, a visual indicator is displayed at the first coordinate position in the middle of the interactive interface, and the user looks at the visual indicator at the first coordinate position. At this time, the eye tracking component projects electromagnetic waves to the eyeballs, and receives electromagnetic waves that are projected to the eyeballs and reflected back. According to the light intensity information of the reflected waves received by the eye tracking components distributed in different directions relative to the eyeball, the light intensity data characteristics corresponding to the forward vision of the eyeball (the first typical eyeball gaze angle) in the gaze angle mapping library are analyzed. calibration. Then, a visual mark is displayed at the second coordinate position in the middle of the upper area of the interactive interface, and the user looks at the visual mark of the second coordinate position. The reflected wave reflected back, according to the light intensity information of the reflected wave received by each eye tracking component distributed in different directions relative to the eyeball, to the light intensity data corresponding to the eye up (the second typical eye gaze angle) in the gaze angle mapping library features are calibrated. Next, a visual mark is displayed at the third coordinate position in the middle of the lower area of the interactive interface, and the user looks at the visual mark at the third coordinate position. At this time, the eye tracking component projects electromagnetic waves to the eyeballs, and receives electromagnetic waves and projects them to the eyeballs. For the reflected wave reflected back, according to the light intensity information of the reflected wave received by the eye tracking components distributed in different directions relative to the eyeball, the light intensity corresponding to the downward eye gaze (third typical eye gaze angle) in the gaze angle mapping library Data features are calibrated. Then, a visual mark is displayed at the fourth coordinate position in the middle of the left area of the interactive interface, and the user looks at the visual mark of the fourth coordinate position. At this time, the eye tracking component projects electromagnetic waves to the eyeballs, and receives electromagnetic waves and projects them to the eyeballs. The reflected wave reflected back, according to the light intensity information of the reflected wave received by each eye tracking component distributed in different directions relative to the eyeball, to the light intensity data corresponding to the left eye (the fourth typical eye gaze angle) in the gaze angle mapping library features are calibrated. Finally, a visual mark is displayed at the fifth coordinate position in the middle of the right area of the interactive interface, and the user looks at the visual mark at the fifth coordinate position. At this time, the eye tracking component projects electromagnetic waves to the eyeballs, and receives electromagnetic waves and projects them to the eyeballs. The reflected wave reflected back, according to the light intensity information of the reflected wave received by each eye tracking component distributed in different directions relative to the eyeball, to the light intensity data corresponding to the right eye (the fifth typical eye gaze angle) in the gaze angle mapping library features are calibrated.

In this embodiment, since each person's eyeballs are more or less different, this embodiment displays the visual identification at the preset coordinate position of the interactive interface, and controls the eye tracking component to project electromagnetic waves to the eyeballs, and receives the electromagnetic wave projections The reflected wave reflected back to the eyeball, and then according to the light intensity of the reflected wave received by each eye tracking component when the eyeball is gazing at the visual mark, the gaze angle mapping library is calibrated, so as to perform eyeball mapping for different users. Differentiated modeling, after the modeling is completed, the gaze angle mapping library is calibrated, which is conducive to more accurate positioning of the eye gaze direction, and further improves the accuracy of tracking and positioning the user's eye gaze angle.

Embodiment 3

An embodiment of the present invention also provides an eye-tracking interaction device, the eye-tracking interaction device includes at least four eye-tracking components, and each of the eye-tracking components is distributed in multiple directions relative to the eyeball, the eye-tracking components are The motion tracking interactive device includes:

an electromagnetic wave transceiver unit, configured to control the eye tracking component to project electromagnetic waves to the eyeballs, and receive reflected waves reflected back by the electromagnetic waves projected to the eyeballs;

A gaze angle analysis unit, configured to determine an eye gaze angle based on the light intensity of the reflected waves received by each of the eye tracking components;

The interactive interface control unit is configured to control the eye tracking component, continuously monitor the eye gaze angle, and control the interactive interface according to the current eye gaze angle.

Optionally, the interactive interface control unit is also used for:

If it is detected that the light intensity of the reflected wave has a preset number of sudden changes within a preset time period, according to the current eye gaze angle, query the current eye gaze angle mapping from the preset interface coordinate mapping table coordinate position;

Trigger a functional operation corresponding to the UI control at the current coordinate position of the interactive interface.

Optionally, the gaze angle analysis unit is also used for:

Based on the light intensity of the reflected waves received by each of the eye tracking components, construct light intensity data features of the reflected waves in various directions;

From a preset gaze angle mapping library, the matching gaze angle of the feature map of the light intensity data is obtained by querying, and the matched gaze angle is used as the eye gaze angle.

Optionally, the eye tracking interaction device further includes a calibration unit, and the calibration unit is used for:

Display the visual mark at the preset coordinate position of the interactive interface;

controlling the eye tracking component to project electromagnetic waves to the eyeballs, and receiving reflected waves reflected back by the electromagnetic waves projected to the eyeballs;

The gaze angle mapping library is calibrated according to the light intensity of the reflected wave received by each of the eye tracking components when the eye gazes at the visual marker.

Optionally, the eye-tracking interaction device includes at least eight eye-tracking components, and at least four eye-tracking components are set for each eyeball, so that the eye-tracking interaction device can monitor the current The eye gaze angles of the two eyeballs are determined, and the interactive interface is controlled according to the eye gaze angles of the two eyeballs.

Optionally, the interactive interface control unit is also used for:

If the confirmation instruction sent by the external device is received, according to the current eye gaze angle, query the current coordinate position of the eye gaze angle mapping from a preset interface coordinate mapping table;

Trigger a functional operation corresponding to the UI control at the current coordinate position of the interactive interface.

Optionally, the eye tracking assembly includes a paired transmitter module and receiver module, and the electromagnetic wave transceiver unit is further used for:

controlling the transmitting modules in each of the eye tracking components to project electromagnetic waves of different operating frequencies to the eyeballs respectively;

Based on the light intensity of the reflected waves received by each of the eye tracking components, the step of determining the eye gaze angle includes:

The gaze angle of the eyeball is determined based on the light intensity of the paired reflected waves received by each of the receiving modules, wherein the paired reflected waves are the reflected waves of the operating frequencies projected by the transmitting modules paired with each of the receiving modules.

The eye tracking interaction device provided by the present invention adopts the eye tracking interaction method in the first embodiment or the second embodiment, which improves the convenience of human-computer interaction for the intelligent display device. Compared with the prior art, the beneficial effects of the eye-tracking interaction device provided by the embodiments of the present invention are the same as the beneficial effects of the eye-tracking interaction method provided by the above-mentioned embodiments, and other technical features of the eye-tracking interaction device are The features disclosed by the method in the previous embodiment are the same, and are not repeated here.

Embodiment 4

An embodiment of the present invention provides an electronic device, the electronic device includes: at least one processor; and a memory connected in communication with the at least one processor; wherein, the memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor. The processor executes, so that at least one processor can execute the eye tracking interaction method in the first embodiment.

Referring next to FIG. 13 , it shows a schematic structural diagram of an electronic device suitable for implementing an embodiment of the present disclosure. The electronic devices in the embodiments of the present disclosure may include, but are not limited to, smart display devices such as AR devices, VR devices, smart TVs, projectors, large LED display screens or flat panels, and the like. The electronic device shown in FIG. 13 is only an example, and should not impose any limitation on the function and scope of use of the embodiments of the present disclosure.

As shown in FIG. 13, an electronic device may include processing means (eg, a central processing unit, a graphics processor, etc.), which may be loaded into a random access memory (RAM) according to a program stored in a read only memory (ROM) or from a storage device to execute various appropriate actions and processes. In the RAM, various programs and data necessary for the operation of the electronic device are also stored. The processing device, the ROM, and the RAM are connected to each other through a bus. Input/output (I/O) interfaces are also connected to the bus.

Typically, the following systems can be connected to the I/O interface: input devices including, for example, touchscreens, touchpads, keyboards, mice, image sensors, microphones, accelerometers, gyroscopes, etc.; including, for example, liquid crystal displays (LCDs), speakers, vibrators output devices, etc.; storage devices including, for example, magnetic tapes, hard disks, etc.; and communication devices. Communication means may allow electronic devices to communicate wirelessly or by wire with other devices to exchange data. While the figures show electronic devices having various systems, it should be understood that not all of the systems shown are required to be implemented or available. More or fewer systems may alternatively be implemented or provided.

In particular, according to embodiments of the present disclosure, the processes described above with reference to the flowcharts may be implemented as computer software programs. For example, embodiments of the present disclosure include a computer program product comprising a computer program carried on a computer-readable medium, the computer program containing program code for performing the method illustrated in the flowchart. In such an embodiment, the computer program may be downloaded and installed from a network via a communication device, or from a storage device, or from a ROM. When the computer program is executed by the processing apparatus, the above-mentioned functions defined in the methods of the embodiments of the present disclosure are executed.

The electronic device provided by the present invention adopts the eye tracking interaction method in the first embodiment or the second embodiment, which improves the convenience of human-computer interaction for the intelligent display device. Compared with the prior art, the beneficial effects of the electronic device provided by the embodiment of the present invention are the same as the beneficial effects of the eye tracking interaction method provided in the above-mentioned first embodiment, and other technical features in the electronic device are the same as those of the method in the previous embodiment. The disclosed features are the same and will not be repeated here.

It should be understood that portions of the present disclosure may be implemented in hardware, software, firmware, or a combination thereof. In the foregoing description of the embodiments, the particular features, structures, materials or characteristics may be combined in any suitable manner in any one or more of the embodiments or examples.

The above are only specific embodiments of the present invention, but the protection scope of the present invention is not limited thereto. Any person skilled in the art can easily think of changes or substitutions within the technical scope disclosed by the present invention. should be included within the protection scope of the present invention. Therefore, the protection scope of the present invention should be based on the protection scope of the claims.

Embodiment 5

An embodiment of the present invention provides a computer-readable storage medium having computer-readable program instructions stored thereon, where the computer-readable program instructions are used to execute the eye tracking interaction method in the foregoing first embodiment.

The computer-readable storage medium provided by the embodiment of the present invention may be, for example, a U disk, but is not limited to an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, system or device, or any combination of the above. More specific examples of computer readable storage media may include, but are not limited to, electrical connections with one or more wires, portable computer disks, hard disks, random access memory (RAM), read only memory (ROM), erasable Programmable read only memory (EPROM or flash memory), fiber optics, portable compact disk read only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing. In this embodiment, the computer-readable storage medium can be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction execution system, system, or device. Program code embodied on a computer-readable storage medium may be transmitted using any suitable medium including, but not limited to, electrical wire, optical fiber cable, RF (radio frequency), etc., or any suitable combination of the foregoing.

The above-mentioned computer-readable storage medium may be included in the electronic device; or may exist independently without being assembled into the electronic device.

The above-mentioned computer-readable storage medium carries one or more programs, and when the above-mentioned one or more programs are executed by the electronic device, the electronic device: controls the eye tracking component to project electromagnetic waves to the eyeballs, and receives the electromagnetic waves and projects them to the eyeballs. based on the light intensity of the reflected waves received by each of the eye tracking components, determine the eye gaze angle; control the eye tracking component, continuously monitor the eye gaze angle, and determine the eye gaze angle according to the current The eye gaze angle is used to control the interactive interface.

Computer program code for carrying out operations of the present disclosure may be written in one or more programming languages, including object-oriented programming languages—such as Java, Smalltalk, C++, but also conventional Procedural programming language - such as the "C" language or similar programming language. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer, or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any kind of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (eg, using an Internet service provider through Internet connection).

The flowchart and block diagrams in the Figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present invention. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code that contains one or more logical functions for implementing the specified functions executable instructions. It should also be noted that, in some alternative implementations, the functions noted in the blocks may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It is also noted that each block of the block diagrams and/or flowchart illustrations, and combinations of blocks in the block diagrams and/or flowchart illustrations, can be implemented in dedicated hardware-based systems that perform the specified functions or operations , or can be implemented in a combination of dedicated hardware and computer instructions.

The modules involved in the embodiments of the present disclosure may be implemented in software or hardware. Among them, the name of the module does not constitute a limitation of the unit itself under certain circumstances.

The computer-readable storage medium provided by the present invention stores computer-readable program instructions for executing the above-mentioned eye-tracking interaction method, which improves the convenience of human-computer interaction for the intelligent display device. Compared with the prior art, the beneficial effects of the computer-readable storage medium provided by the embodiments of the present invention are the same as those of the eye-tracking interaction method provided in the first embodiment or the second embodiment, and are not repeated here.

Embodiment 6

An embodiment of the present invention further provides a computer program product, including a computer program, which implements the steps of the above-mentioned eye tracking interaction method when the computer program is executed by a processor.

The computer program product provided by the present application improves the convenience of human-computer interaction for the intelligent display device. Compared with the prior art, the beneficial effects of the computer program product provided by the embodiments of the present invention are the same as the beneficial effects of the eye tracking interaction method provided in the first embodiment or the second embodiment, and are not repeated here.

The above are only the preferred embodiments of the present application, and are not intended to limit the patent scope of the present application. Any equivalent structure or equivalent process transformation made by using the contents of the description and drawings of the present application, or directly or indirectly applied in other related technical fields , are similarly included within the scope of patent processing of this application.

Claims (10)

1. An eye-tracking interaction method, wherein the eye-tracking interaction method is applied to an eye-tracking interaction device, and the eye-tracking interaction device comprises at least four eye-tracking components, and each of the eye-tracking and The movement tracking components are distributed in multiple directions relative to the eyeball, and the eye tracking interaction method includes: controlling the eye tracking component to project electromagnetic waves to the eyeballs, and receiving reflected waves reflected back by the electromagnetic waves projected to the eyeballs; determining the eye gaze angle based on the light intensity of the reflected waves received by each of the eye tracking components; The eye tracking component is controlled, the eye gaze angle is continuously monitored, and the interactive interface is controlled according to the current eye gaze angle. 2. The eye tracking interaction method according to claim 1, wherein the step of manipulating the interactive interface according to the current gaze angle of the eyeball comprises: If it is detected that the light intensity of the reflected wave has a preset number of sudden changes within a preset time period, according to the current eye gaze angle, query the current eye gaze angle mapping from the preset interface coordinate mapping table coordinate position; Trigger a functional operation corresponding to the UI control at the current coordinate position of the interactive interface. 3. The eye-tracking interaction method according to claim 1, wherein the step of determining the eye gaze angle based on the light intensity of the reflected waves received by each of the eye-tracking components comprises: Based on the light intensity of the reflected waves received by each of the eye tracking components, construct light intensity data features of the reflected waves in various directions; From a preset gaze angle mapping library, the matching gaze angle of the feature map of the light intensity data is obtained by querying, and the matched gaze angle is used as the eye gaze angle. 4. The eye-tracking interaction method according to claim 3, wherein before the step of controlling the eye-tracking component to project electromagnetic waves to the eyeball, it comprises: Display the visual mark at the preset coordinate position of the interactive interface; controlling the eye tracking component to project electromagnetic waves to the eyeballs, and receiving reflected waves reflected back by the electromagnetic waves projected to the eyeballs; The gaze angle mapping library is calibrated according to the light intensity of the reflected wave received by each of the eye tracking components when the eye is gazing at the visual marker. 5. The eye-tracking interaction method according to claim 1, wherein the eye-tracking interaction device comprises at least eight eye-tracking components, and one of the eyeballs corresponds to at least four of the eye-tracking components. The tracking component is used for the eye tracking interaction device to monitor the current eye gaze angles of the two eyeballs at the same time, and to control the interactive interface according to the eye gaze angles of the two eyeballs. 6. The eye tracking interaction method according to claim 1, wherein the step of manipulating the interactive interface according to the current eye gaze angle further comprises: If the confirmation instruction sent by the external device is received, according to the current eye gaze angle, query the current coordinate position of the eye gaze angle mapping from a preset interface coordinate mapping table; Trigger a functional operation corresponding to the UI control at the current coordinate position of the interactive interface. 7. The eye-tracking interaction method according to any one of claims 1 to 6, wherein the eye-tracking component comprises a paired transmitting module and a receiving module, and the eye-tracking component is controlled to The steps of projecting electromagnetic waves from the eye include: controlling the transmitting modules in each of the eye tracking components to project electromagnetic waves of different operating frequencies to the eyeballs respectively; Based on the light intensity of the reflected waves received by each of the eye tracking components, the step of determining the eye gaze angle includes: The gaze angle of the eyeball is determined based on the light intensity of the paired reflected waves received by each of the receiving modules, wherein the paired reflected waves are the reflected waves of the operating frequencies projected by the transmitting modules paired with each of the receiving modules. 8. An eye-tracking interaction device, wherein the eye-tracking interaction device comprises at least four eye-tracking components, and each of the eye-tracking components is distributed in multiple directions relative to the eyeball, and the eye-tracking components are The motion tracking interactive device includes: an electromagnetic wave transceiver unit, configured to control the eye tracking component to project electromagnetic waves to the eyeballs, and receive reflected waves reflected back by the electromagnetic waves projected to the eyeballs; A gaze angle analysis unit, configured to determine an eye gaze angle based on the light intensity of the reflected waves received by each of the eye tracking components; The interactive interface control unit is configured to control the eye tracking component, continuously monitor the eye gaze angle, and control the interactive interface according to the current eye gaze angle. 9. An electronic device, characterized in that the electronic device comprises: at least one processor; and, a memory communicatively coupled to the at least one processor; wherein, The memory stores instructions executable by the at least one processor, the instructions being executed by the at least one processor to enable the at least one processor to perform the execution of any one of claims 1 to 7 Steps of an eye-tracking interaction method. 10. A readable storage medium, wherein the readable storage medium stores a program for realizing the eye-tracking interaction method, and the program for realizing the eye-tracking interaction method is executed by a processor to realize the method as claimed in the claims. Steps of the eye tracking interaction method described in any one of 1 to 7.

Images