CN116069416A - User interface display control method, device, electronic device and medium - Google Patents

Abstract

The application provides a display control method, a device, electronic equipment and a medium of a user interface, wherein the method comprises the following steps: collecting pupil data of a user in real time; determining the gazing duration of a visual focus of a user on a preset application interface aiming at a first application according to pupil data; when the gazing duration exceeds the set threshold, the display of the preset application interface is switched to the display of the first application main interface, so that the user can conveniently perform related operations of various driving functions on the application interface through the eyeball tracking technology on the premise of driving safety.

Description

User interface display control method, device, electronic device and medium

technical field

The present application relates to the field of assisted driving, and in particular to a display control method, device, electronic device and medium of a user interface.

Background technique

With the development of science and technology, in recent years, the touch-sensitive in-vehicle system has gradually become the standard configuration of vehicles of various manufacturers. Compared with traditional vehicle systems based on physical controls, touch-based vehicle systems can provide richer functions, such as calls, navigation, video, music, etc. Different from the mobile interaction scene, the driving task in the vehicle scene is the main task, and other tasks are secondary tasks. The vehicle system should be used under the premise of driving safety. However, whether it is an in-vehicle system with physical controls or a touch-based in-vehicle system, the user needs to perform a touch operation to display secondary tasks, so that attention is diverted to other areas that affect driving safety for a long time, and it will occupy the user during driving. More visual resources affect driving safety.

Contents of the invention

Embodiments of the present application provide a user interface display control method, device, electronic equipment, and media to solve problems in related technologies. The technical solution is as follows:

In the first aspect, the embodiment of the present application provides a display control method of a user interface, which is applied to a vehicle-mounted terminal, including: collecting the pupil data of the user in real time; The gaze duration of an application; when the gaze duration exceeds a set threshold, switch from displaying the preset application interface to displaying the first application main interface.

In the second aspect, the embodiment of the present application provides a display control device of a user interface, which is applied to a vehicle-mounted terminal, and includes: a collection module, used to collect the user's pupil data in real time; a determination module, used to determine the user's pupil data according to the pupil data. The gaze duration of the visual focus on the preset application interface for the first application; the display module is configured to switch from displaying the preset application interface to displaying the first application main interface when the gaze duration exceeds a set threshold.

In a third aspect, an embodiment of the present application provides an electronic device, the electronic device includes: at least one processor; and a memory communicatively connected to the at least one processor; wherein, the memory stores instructions executable by the at least one processor , so that at least one processor can execute the display control method of the above user interface.

In a fourth aspect, the embodiments of the present application provide a computer-readable storage medium, which stores computer instructions, and when the computer instructions are run on a computer, the method in any one of the above-mentioned aspects is executed.

The advantages or beneficial effects of the above technical solutions at least include:

The display control scheme of the user interface of the present application can control the opening of the application on the preset application interface according to the pupil data of the user, and facilitate the user to perform various operations on the application interface through the eye tracking technology under the premise of driving safety.

The above summary is for illustrative purposes only and is not intended to be limiting in any way. In addition to the illustrative aspects, embodiments and features described above, further aspects, embodiments and features of the present application will be readily apparent by reference to the drawings and the following detailed description.

Description of drawings

In the drawings, unless otherwise specified, the same reference numerals designate the same or similar parts or elements throughout the several drawings. The drawings are not necessarily drawn to scale. It should be understood that these drawings only depict some embodiments disclosed according to the application, and should not be regarded as limiting the scope of the application.

FIG. 1 is a flowchart of a display control method of a user interface according to an embodiment of the present application;

FIG. 2 is a schematic diagram of a target gesture behavior according to an embodiment of the present application;

FIG. 3 is a schematic diagram of a preset application interface according to an embodiment of the present application;

4A-4D are schematic diagrams of different display modes of a preset application interface according to an embodiment of the present application;

5 is a block diagram of a display control device of a user interface according to an embodiment of the present application;

Fig. 6 is a block diagram of an electronic device for implementing the display control method of a user interface according to the embodiment of the present application.

Detailed ways

In the following, only some exemplary embodiments are briefly described. As those skilled in the art would realize, the described embodiments may be modified in various different ways, all without departing from the spirit or scope of the present application. Accordingly, the drawings and descriptions are to be regarded as illustrative in nature and not restrictive.

In the prior art, the touch-type vehicle-mounted terminal has gradually become the standard configuration of vehicles of various manufacturers. However, when the user needs to start some applications with entertainment functions during driving, it is inevitable that the user needs to perform touch operations to Switching to the application operation interface, and further, because the switched application interface is usually displayed in full screen, it will occupy more visual resources of the user during driving, so that the user cannot focus on driving and affects driving safety.

In view of this, please refer to FIG. 1. The embodiment of the present application provides a display control method of a user interface, which is applied to a vehicle-mounted terminal. As shown in FIG. 1, the display control method may include:

Step S101: Collect user's pupil data in real time.

Step S102: Determine the gaze duration of the user's visual focus on the first application on the preset application interface according to the pupil data.

Step S103: When the gaze duration exceeds the set threshold, switch from displaying the default application interface to displaying the first application main interface.

The display control method of the user interface in the embodiment of the present application can control the opening of the application on the preset application interface according to the pupil data of the user, and on the premise of driving safety, it is convenient for the user to perform various operations on the application interface through eye tracking technology. operate.

In a possible implementation manner, before switching from displaying the preset application interface to displaying the first application main interface, the method further includes: displaying a confirmation interface on the preset application interface whether to open the first application; When confirming the feedback operation on the interface, switch from displaying the preset application interface to displaying the first application main interface.

In the embodiment of the present application, the user's feedback operation on the confirmation interface includes various user operations, for example, the head operation includes nodding or shaking the head, click operation, voice operation, body operation, or eyeball operation.

Optionally, in this application, machine vision recognition technology is used to identify and analyze user operations fed back by users.

For example, when recognizing a target gesture action, target gesture behavior mapping is performed on the collected gesture features, so that the collected gesture features are mapped to the corresponding target gesture action. FIG. 2 exemplarily shows 7 target gesture behaviors, for example, Compare the collected gesture features with the target gesture behavior in Figure 2, and use the target gesture behavior with the smallest difference as the recognized target gesture behavior. Similar to it, when identifying target body movements and target lip language movements, the same recognition principle is used to map the collected body features to target body movements, and the collected lip language features are mapped to target lip language movements, which will not be repeated here. .

In a possible implementation manner, after switching from displaying the preset application interface to displaying the first application main interface, it further includes: collecting the user's visual movement data in real time; The target function matched by the visual movement data; the vehicle terminal is controlled by the target function.

Exemplarily, when it is detected that the user's visual focus on the preset application interface is concentrated on the first application for a long time, the vehicle-mounted terminal jumps from displaying the preset application interface to the first application main interface, and on the first application main interface according to the user's For example, when the user’s eye movement from bottom to top is detected on the main interface of the first application, switching from the main interface of the first application to the Head Up Display (HUD) ;When the user's eyeballs are turned to the left, turn on the left turn symbol of the left turn signal in advance; when the user's eyeballs are turned to the right, turn on the right turn symbol of the right turn signal in advance; detect the user's frequent blinking , control the ISD intelligent interactive light to project the shape of the eye.

In step S101, the real-time collection of the user's visual movement data may be realized through the following process: using eye tracking technology to capture the visual movement data of the user's visual focus on the main interface of the first application.

In a possible implementation manner, before determining according to the pupil data that the user's visual focus is on the preset application interface for the gaze duration of the first application, the method further includes:

According to the judgment result of driving attention, determine the display mode of the preset application interface on the vehicle terminal, including any of the following:

In the case that the driving attention judgment result satisfies the first preset condition, it is determined that the display mode of the preset application interface is to display the entry function display area in the navigation bar of the advanced driver assistance system ADAS interface;

In the case that the driving attention judgment result satisfies the second preset condition, determine that the display mode of the preset application interface is to display the entry-type function display area in the navigation bar of the ADAS interface, and display the operation in the first sub-interface Class function display area and status class function display area, the first sub-interface occupies part of the main interface of the ADAS interface;

In the case that the driving attention judgment result satisfies the third preset condition, it is determined that the display mode of the preset application interface is to display the entry-type function display area in the navigation bar of the ADAS interface, and display the operation in the second sub-interface Class function display area, status class function display area and streaming class function display area, the second sub-interface occupies part of the main interface of the ADAS interface, and the display area of the second sub-interface is larger than that of the first sub-interface;

In the case that the driving attention judgment result satisfies the fourth preset condition, it is determined that the display mode of the preset application interface is to display the entrance function display area in the navigation bar of the ADAS interface, and display the entry function display area in all the main interfaces of the ADAS interface. Displays the operation-type function display area, the status-type function display area, the streaming-type function display area, and the editing-type function display area.

In a possible implementation manner, user behavior data and driving data are used to judge driving attention, and the result of driving attention judgment can be obtained, which can be realized in the following manner: input user behavior data and driving data into the preset driving attention The force judgment model is used to judge driving attention to obtain the result of driving attention judgment.

Optionally, when acquiring the driving data of the vehicle-mounted terminal, the vehicle-mounted sensor is used to acquire the road data, gear position data, GPS data and vehicle speed data of the vehicle-mounted terminal to obtain the driving data of the vehicle-mounted terminal.

Optionally, in the embodiment of the present application, according to the identified user behavior data and driving data, the driving attention judgment model is used to score the driver's attention, wherein the driver's attention score is used to represent the driver's attention force level. Specifically, if the identified user behavior data is consistent with the characteristics of the driver's drowsiness and inattention, the attention score is low; otherwise, the attention score is high, if the driving data is consistent with the characteristics of the driver's inattention , for example, if the engine is on and the duration of the speed is 0 is less than the preset duration, etc., the attention score is high, otherwise the attention score is low, and the attention score is high, indicating a high degree of attention. Optionally, the driving attention judgment model separately performs attention scores on the user behavior data and the driving data, and performs weighting processing on the obtained scores to obtain a final attention score.

Optionally, in the embodiment of the present application, it is necessary to pre-build an attention judgment model to obtain driving data and user behaviors involved in various driving scenarios for various driving scenarios, analyze the impact of user behaviors on driving safety, and combine various The degree of impact of user behavior and driving data on driving safety is graded. After obtaining the above data, it can be used as training data to build an attention judgment model. After the attention judgment model is established, new user behavior data and driving data are input into the attention judgment model, and the corresponding driving scene and the attention judgment level corresponding to the driving scene can be automatically output.

It is worth mentioning that the preset application interface in the embodiment of the present application is an application operation interface for human-computer interaction.

Please refer to FIG. 3 , which is a schematic diagram of an exemplary preset application interface. The preset application interface is composed of 5 display areas of different operation types, namely the entry function display area, the operation function display area, the status function display area, the flow type function display area and the editing function display area. The function display area is located at the bottom of the interface and is used to provide control functions of important vehicle subsystems, such as the control function of the air conditioning system. The display area of operation functions can select the services provided by the application, and the display area of status functions is used to display the The current status of the services provided, the streaming function display area is used to stream display the works contained in the application, and the editing function display area is used to implement editing and search functions in the application, where different types of display areas are loading Different from the priorities in the display process, Table 1 shows different priorities corresponding to different types of display areas, among which P0 has the highest priority and P3 has the lowest priority.

Table 1

information type priority Entry class P0 Operation class P0 state class P1 streaming class P2 Editing P3

ADAS uses various sensors installed on the car (which can detect light, heat, pressure and other variables) to collect environmental data inside and outside the car at the first time, and carry out identification, detection and verification of static and dynamic objects. Tracking and other technical processing, so that the driver can detect possible dangers in the fastest time, so as to attract attention and improve safety. Active safety technology.

ADAS is mainly composed of GPS and CCD camera detection module, communication module and control module. Among them, the GPS and CCD camera detection module receives GPS satellite signals through the GPS receiver, obtains the longitude and latitude coordinates, speed, time and other information of the car, and uses the CCD cameras installed at the front and rear of the car to observe the conditions on both sides of the road in real time ; The communication module can send the detected relevant information and transmit the driving information between the vehicles approaching each other in real time; the control module can make active control when an accident is about to occur, so as to avoid the accident.

The ADAS interface of this application is an interface capable of displaying the posture and driving conditions of the vehicle.

Specifically, according to the driving attention judgment result, determine the display mode of the preset application interface, and display the preset application interface on the vehicle terminal according to the display mode, and the display mode is used to determine the display content and display mode of the preset application interface. Area, including the following four display modes:

Display Mode 1, when the driving attention determination result satisfies the first preset condition, determine that the display mode of the preset application interface is to display the entrance function display area in the navigation bar of the ADAS interface.

Among them, the ADAS interface includes two parts, namely the main interface and the navigation bar at the bottom of the main interface. In display mode 1, the content of the default application interface will not be displayed in the main interface of the ADAS interface, and the content of the original main interface will continue to be displayed. Display mode 1 is used to fully display the preset ADAS interface. For details, please refer to Figure 4A. Show.

Display Mode 2: When the driving attention judgment result satisfies the second preset condition, determine that the display mode of the preset application interface is to display the entrance function display area in the navigation bar of the ADAS interface. The interface displays an operation-type function display area and a status-type function display area, and the first sub-interface occupies part of the main interface of the ADAS interface.

In display mode 2, only part of the content of the preset application interface is displayed. The display position of the first sub-interface can be set according to the user's visual habits, or it can be pre-positioned, for example, in the lower left corner of the main interface. This application does not care about this. For specific limitations, see FIG. 4B for details.

Display Mode 3: When the driving attention judgment result satisfies the third preset condition, determine that the display mode of the preset application interface is to display the entrance function display area in the navigation bar of the ADAS interface, and in the second sub- The interface displays an operation function display area, a status function display area and a streaming function display area, the second sub-interface occupies part of the main interface of the ADAS interface, and the display area of the second sub-interface is larger than that of the first sub-interface .

In display mode 3, only part of the content of the preset application interface is displayed. The display position of the first sub-interface can be set according to the user's visual habits, or it can be pre-positioned, for example, in the lower left corner of the main interface, which is the same as that of display mode 2. Compared with the second display mode, the display content and display area of the preset application are better than the second display mode, as shown in FIG. 4C for details.

Display mode 4, in the case that the driving attention judgment result satisfies the fourth preset condition, determine that the display mode of the preset application interface is to display the entrance function display area in the navigation bar of the ADAS interface, and the ADAS interface The display area for operation functions, status functions, streaming functions, and editing functions is displayed in all the main interfaces of the system, and the ADAS interface is not displayed.

In display mode 4, all the main interfaces of the ADAS interface are used to display the preset application interface. At this time, the preset ADAS interface is hidden, and the preset application interface is displayed in full screen, as shown in FIG. 4D for details.

In a possible implementation, when different display modes are determined according to the driving attention judgment result, optionally, the difference between the attention score output by the driving attention judgment model or the attention judgment level and the preset decision threshold is relationship, and adopt corresponding display strategies. In this application, four display modes are designed. Optionally, four thresholds are designed for the attention score or attention judgment level, which are respectively the first threshold, the second threshold, the third threshold, and the second threshold. Four thresholds, and the values are increased sequentially. At this time, the first preset condition is not greater than the first threshold, the second preset condition is greater than the first threshold and not greater than the second threshold, and the third preset condition is not greater than the second threshold. Assuming that the condition is greater than the third threshold and not greater than the fourth threshold, and the fourth preset condition is greater than the fourth threshold, of course, the first preset condition, the second preset condition, the third preset condition, the first preset condition The four preset conditions can also be set in other ways, as long as the corresponding display mode can be determined.

When the driving attention is high, the content of the preset application interface displayed by the vehicle terminal is relatively simple. In this case, the driving attention needs to pay more attention to the driving task to improve driving safety. The content of the preset application interface displayed is relatively complete. In this case, driving attention can be diverted to secondary tasks other than driving tasks, which is convenient for users to perform further operations on the preset application interface. For example, related applications that can open music functions , to improve user experience.

In a possible implementation manner, according to the driving attention determination result, the display mode of the preset application interface on the vehicle-mounted terminal is determined, and after the vehicle-mounted terminal displays the preset application interface according to the display mode, it further includes: When it is detected that the driving attention determination result changes and the change value exceeds a set threshold, the display mode of the preset application interface is controlled to switch.

It is worth noting that if the driving attention at the current moment satisfies the first preset condition, the preset application interface is displayed according to display mode 1 at this time. Setting the display mode of the application interface increases the display content and display area of the preset application interface. Of course, the user's manual operation or voice operation can also be received in the process to switch the display mode.

In a possible implementation manner, according to the driving attention determination result, the display mode of the preset application interface on the vehicle-mounted terminal is determined, and after the vehicle-mounted terminal displays the preset application interface according to the display mode, it further includes: Using the eye tracking technology, the user's visual focus is captured on the visual area of the preset application interface, and the visual area is enlarged and displayed. It is further convenient for the user to search and select the common functions of the preset application interface, satisfy the entertainment needs of the user, and improve the user experience.

It should be noted that although four display modes are used as an example to introduce a display interface in which driving attention satisfies a certain preset condition, as above, those skilled in the art can understand that the present application should not be limited thereto. In fact, the user can flexibly set the display mode of the preset application interface according to personal preferences and/or actual application scenarios, as long as the display of specific entertainment functions can be realized.

To sum up, in the embodiment of the present application, the opening of the application can be controlled on the preset application interface according to the pupil data of the user, and the user can perform various operations on the application interface through the eye tracking technology under the premise of driving safety.

Fig. 5 shows a structural block diagram of a display control device for a user interface according to an embodiment of the present application. The device is applied to a vehicle-mounted terminal, as shown in Figure 5, the device may include:

Collection module 501, for collecting the user's pupil data in real time;

A determining module 502, configured to determine the gaze duration of the user's visual focus on the preset application interface for the first application according to the pupil data;

The display module 503 is configured to switch from displaying the preset application interface to displaying the first application main interface when the gaze duration exceeds a set threshold.

In a possible implementation manner, the display module 503 is also used for:

Before switching from displaying the preset application interface to displaying the main interface of the first application, display a confirmation interface on whether to open the first application on the preset application interface;

When receiving the user's feedback operation on the confirmation interface, switch from displaying the preset application interface to displaying the first application main interface.

In a possible implementation manner, the collection module 501 is also configured to: collect the user's visual movement data in real time after switching from displaying the preset application interface to displaying the first application main interface;

The determining module 502 is also used for: determining a target function matching the visual motion data among the various functions included in the first application main interface; and using the target function to perform functional control on the vehicle terminal.

In a possible implementation manner, the acquisition module 501 is specifically configured to:

Eye tracking technology is used to capture the visual movement data of the user's visual focus on the main interface of the first application.

In a possible implementation manner, the determination module 502 is also used to:

According to the pupil data, before determining the user's visual focus on the preset application interface for the gaze duration of the first application, according to the driving attention judgment result, determine the display mode of the preset application interface on the vehicle terminal, including any of the following:

In the case that the driving attention judgment result satisfies the first preset condition, it is determined that the display mode of the preset application interface is to display the entry function display area in the navigation bar of the advanced driver assistance system ADAS interface;

In the case that the driving attention judgment result satisfies the second preset condition, determine that the display mode of the preset application interface is to display the entry-type function display area in the navigation bar of the ADAS interface, and display the operation in the first sub-interface Class function display area and status class function display area, the first sub-interface occupies part of the main interface of the ADAS interface;

In the case that the driving attention judgment result satisfies the third preset condition, it is determined that the display mode of the preset application interface is to display the entry-type function display area in the navigation bar of the ADAS interface, and display the operation in the second sub-interface Class function display area, status class function display area and streaming class function display area, the second sub-interface occupies part of the main interface of the ADAS interface, and the display area of the second sub-interface is larger than that of the first sub-interface;

In the case that the driving attention judgment result satisfies the fourth preset condition, it is determined that the display mode of the preset application interface is to display the entrance function display area in the navigation bar of the ADAS interface, and display the entry function display area in all the main interfaces of the ADAS interface. Displays the operation-type function display area, the status-type function display area, the streaming-type function display area, and the editing-type function display area.

For the functions of each module in each device in the embodiment of the present application, reference may be made to the corresponding description in the foregoing method, and details are not repeated here.

Fig. 6 shows a structural block diagram of an electronic device according to an embodiment of the present application. As shown in FIG. 6 , the electronic device includes: a memory 610 and a processor 620 , and instructions executable on the processor 620 are stored in the memory 610 . When the processor 620 executes the instruction, the display control method of the user interface in the foregoing embodiments is implemented. The number of memory 610 and processor 620 may be one or more. The electronic device is intended to represent various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other suitable computers. Electronic devices may also represent various forms of mobile devices, such as personal digital processing, cellular telephones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions, are by way of example only, and are not intended to limit implementations of the applications described and/or claimed herein.

The electronic device may also include a communication interface 630 for communicating with external devices for interactive data transmission. The various devices are interconnected using different buses and may be mounted on a common motherboard or otherwise as desired. The processor 620 may process instructions executed within the electronic device, including instructions stored in or on the memory, to display graphical information of a GUI on an external input/output device such as a display device coupled to an interface. In other implementations, multiple processors and/or multiple buses may be used with multiple memories and multiple memories, if desired. Likewise, multiple electronic devices may be connected, with each device providing some of the necessary operations (eg, as a server array, a set of blade servers, or a multi-processor system). The bus can be divided into address bus, data bus, control bus and so on. For ease of representation, only one thick line is used in FIG. 6 , but it does not mean that there is only one bus or one type of bus.

Optionally, in a specific implementation, if the memory 610, the processor 620, and the communication interface 630 are integrated on one chip, the memory 610, the processor 620, and the communication interface 630 may communicate with each other through an internal interface.

It should be understood that the above-mentioned processor can be a central processing unit (Central Processing Unit, CPU), and can also be other general-purpose processors, digital signal processors (Digital Signal Processing, DSP), application specific integrated circuits (Application Specific Integrated Circuit, ASIC), Field Programmable Gate Array (Field Programmable Gate Array, FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general purpose processor may be a microprocessor or any conventional processor or the like. It should be noted that the processor may be a processor supporting Advanced RISC Machines (ARM) architecture.

The embodiment of the present application provides a computer-readable storage medium (such as the above-mentioned memory 610 ), which stores computer instructions, and when the program is executed by a processor, the method provided in the embodiment of the present application is implemented.

Optionally, the memory 610 may include a program storage area and a data storage area, wherein the program storage area may store an operating system and an application program required by at least one function; data etc. In addition, the memory 610 may include a high-speed random access memory, and may also include a non-transitory memory, such as at least one magnetic disk storage device, a flash memory device, or other non-transitory solid-state storage devices. In some embodiments, the memory 610 may optionally include memory located remotely relative to the processor 620, and these remote memories may be connected to the electronic device of FIG. 6 through a network. Examples of the aforementioned networks include, but are not limited to, the Internet, intranets, local area networks, mobile communication networks, and combinations thereof.

In the description of this specification, descriptions referring to the terms "one embodiment", "some embodiments", "example", "specific examples", or "some examples" mean that specific features described in connection with the embodiment or example , structure, material or characteristic is included in at least one embodiment or example of the present application. Furthermore, the described specific features, structures, materials or characteristics may be combined in any suitable manner in any one or more embodiments or examples. In addition, those skilled in the art can combine and combine different embodiments or examples and features of different embodiments or examples described in this specification without conflicting with each other.

In addition, the terms "first" and "second" are used for descriptive purposes only, and cannot be interpreted as indicating or implying relative importance or implicitly specifying the quantity of indicated technical features. Thus, the features defined as "first" and "second" may explicitly or implicitly include at least one of these features. In the description of the present application, "plurality" means two or more, unless otherwise specifically defined.

Any process or method descriptions in flowcharts or otherwise described herein can be understood as representing instructions comprising one or more (two or more) executable instructions for implementing a specific logical function or process. A module, fragment, or section of code. Also, the scope of preferred embodiments of the present application includes additional implementations in which functions may be performed out of the order shown or discussed, including substantially concurrently or in reverse order as the functions involved are involved.

The logic and/or steps represented in the flowcharts or otherwise described herein, for example, can be considered as a sequenced listing of executable instructions for implementing logical functions, can be embodied in any computer-readable medium, For use with instruction execution systems, devices, or devices (such as computer-based systems, systems including processors, or other systems that can fetch instructions from instruction execution systems, devices, or devices and execute instructions), or in conjunction with these instruction execution systems, devices or equipment used.

It should be understood that each part of the present application may be realized by hardware, software, firmware or a combination thereof. In the embodiments described above, various steps or methods may be implemented by software or firmware stored in memory and executed by a suitable instruction execution system. All or part of the steps of the method in the above embodiments can be completed by instructing related hardware through a program. The program can be stored in a computer-readable storage medium. When the program is executed, it includes one of the steps of the method embodiment or its combination.

In addition, each functional unit in each embodiment of the present application may be integrated into one processing module, each unit may exist separately physically, or two or more units may be integrated into one module. The above-mentioned integrated modules can be implemented in the form of hardware or in the form of software function modules. If the above-mentioned integrated modules are implemented in the form of software function modules and sold or used as independent products, they can also be stored in a computer-readable storage medium. The storage medium may be a read-only memory, a magnetic disk or an optical disk, and the like.

The above is only a specific embodiment of the application, but the scope of protection of the application is not limited thereto. Any person familiar with the technical field can easily think of its various changes or modifications within the technical scope disclosed in the application. Replacement, these should be covered within the protection scope of this application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

Claims (12)

1. A display control method of a user interface, applied to a vehicle-mounted terminal, characterized by comprising:

collecting pupil data of a user in real time;

determining the gazing duration of a visual focus of a user on a preset application interface aiming at a first application according to the pupil data;

and when the gazing duration exceeds a set threshold, switching from displaying the preset application interface to displaying a first application main interface.

2. The method of claim 1, further comprising, prior to switching from displaying the preset application interface to displaying the first application main interface:

displaying a confirmation interface for whether to open a first application on the preset application interface;

and when receiving feedback operation of the user for the confirmation interface, switching from displaying the preset application interface to displaying a first application main interface.

3. The method of claim 1, further comprising, after switching from displaying the preset application interface to displaying the first application main interface:

acquiring visual motion data of a user in real time;

determining a target function matched with the visual motion data in various functions included in the first application main interface;

and performing function control on the vehicle-mounted terminal by utilizing the target function.

4. The method of claim 1, wherein collecting visual motion data of the user in real time comprises:

and capturing visual movement data of the visual focus of the user on the first application main interface by utilizing an eyeball tracking technology.

5. The method of any one of claims 1-4, wherein determining, from the pupil data, a visual focus of the user prior to a gaze duration for the first application on a preset application interface, further comprises:

according to the driving attention judging result, determining a display mode of a preset application interface on the vehicle-mounted terminal, wherein the display mode comprises any one of the following steps:

determining a display mode of the preset application interface as an entry function display area displayed in a navigation bar of an ADAS interface of the advanced driving assistance system under the condition that the driving attention judging result meets a first preset condition;

under the condition that the driving attention judging result meets a second preset condition, determining that the display mode of the preset application interface is that an entry function display area is displayed in a navigation bar of the ADAS interface, and an operation function display area and a state function display area are displayed in a first sub-interface, wherein the first sub-interface occupies part of a main interface of the ADAS interface;

under the condition that the driving attention judging result meets a third preset condition, determining that the display mode of the preset application interface is that an entry function display area is displayed in a navigation column of the ADAS interface, and an operation function display area, a state function display area and a stream function display area are displayed in a second sub-interface, wherein the second sub-interface occupies part of a main interface of the ADAS interface, and the display area of the second sub-interface is larger than that of the first sub-interface;

and under the condition that the driving attention judging result meets a fourth preset condition, determining that the display mode of the preset application interface is that an entry type function display area is displayed in a navigation column of the ADAS interface, and an operation type function display area, a state type function display area, a stream type function display area and an editing type function display area are displayed in all main interfaces of the ADAS interface.

6. A display control device of a user interface, applied to a vehicle-mounted terminal, characterized by comprising:

the acquisition module is used for acquiring pupil data of a user in real time;

the determining module is used for determining the gazing duration of the visual focus of the user on a preset application interface aiming at the first application according to the pupil data;

and the display module is used for switching from displaying the preset application interface to displaying the first application main interface when the gazing time length exceeds a set threshold value.

7. The apparatus of claim 6, wherein the display module is further configured to:

before switching from displaying the preset application interface to displaying a first application main interface, displaying a confirmation interface of whether to open the first application on the preset application interface;

and when receiving feedback operation of the user for the confirmation interface, switching from displaying the preset application interface to displaying a first application main interface.

8. The apparatus according to claim 6, comprising:

the acquisition module is also used for: after switching from displaying the preset application interface to displaying a first application main interface, acquiring visual motion data of a user in real time;

the determining module is further configured to: determining a target function matched with the visual motion data in various functions included in the first application main interface; and performing function control on the vehicle-mounted terminal by utilizing the target function.

9. The device according to claim 6, wherein the acquisition module is specifically configured to:

and capturing visual movement data of the visual focus of the user on the first application main interface by utilizing an eyeball tracking technology.

10. The apparatus of any one of claims 6-9, wherein the determining module is further configured to:

before determining the gazing duration of the visual focus of the user on the preset application interface aiming at the first application according to the pupil data, determining the display mode of the preset application interface on the vehicle-mounted terminal according to the driving attention judging result, wherein the display mode comprises any one of the following steps:

determining a display mode of the preset application interface as an entry function display area displayed in a navigation bar of an ADAS interface of the advanced driving assistance system under the condition that the driving attention judging result meets a first preset condition;

under the condition that the driving attention judging result meets a second preset condition, determining that the display mode of the preset application interface is that an entry function display area is displayed in a navigation bar of the ADAS interface, and an operation function display area and a state function display area are displayed in a first sub-interface, wherein the first sub-interface occupies part of a main interface of the ADAS interface;

under the condition that the driving attention judging result meets a third preset condition, determining that the display mode of the preset application interface is that an entry function display area is displayed in a navigation column of the ADAS interface, and an operation function display area, a state function display area and a stream function display area are displayed in a second sub-interface, wherein the second sub-interface occupies part of a main interface of the ADAS interface, and the display area of the second sub-interface is larger than that of the first sub-interface;

and under the condition that the driving attention judging result meets a fourth preset condition, determining that the display mode of the preset application interface is that an entry type function display area is displayed in a navigation column of the ADAS interface, and an operation type function display area, a state type function display area, a stream type function display area and an editing type function display area are displayed in all main interfaces of the ADAS interface.

11. An electronic device, comprising:

at least one processor; and

a memory communicatively coupled to the at least one processor; wherein,,

the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method of any one of claims 1-5.

12. A computer readable storage medium having stored therein computer instructions which, when executed by a processor, implement the method of any of claims 1-5.

Images