CN111813285A - Floating window management method, device, electronic device and readable storage medium - Google Patents

Abstract

The present application discloses a floating window management method, device, electronic device and readable storage medium, which belong to the technical field of communication. The electronic device receives a first input from the user on the display screen of the electronic device, determines a target area in the display screen in response to the first input, acquires object information of an object displayed in the target area, and displays a display corresponding to the target area according to the object information floating window. The menu items in the floating window are associated with the objects in the area that the user pays attention to, and the menu items in the floating window can change according to the changes of the objects in the area that the user pays attention to, which is convenient for the user to perform operations related to the objects in the area that the user pays attention to. , which can improve the flexibility of user operation.

Description

Floating window management method, device, electronic device and readable storage medium

technical field

The present application belongs to the field of communication technologies, and in particular relates to a floating window management method, device, electronic device and readable storage medium.

Background technique

At present, most electronic devices are integrated with a floating window, and a certain number of menu items can be displayed on the display screen of the electronic device through the floating window, so as to facilitate the user to operate the electronic device. In the process of using the electronic device, the user can operate the menu items in the floating window, and flexibly operate the electronic device through the menu items in the floating window.

In the process of realizing the present application, the inventor found that there are at least the following problems in the prior art: different areas of the display screen display different information, and when the area that the user pays attention to is different, the required operations are also different. When using an electronic device, when staying at a certain position on the display screen of the electronic device, the menu items displayed in the floating window are all fixed menu items, and the fixed menu items can only provide the user with the function operations corresponding to the fixed menu items. It is inconvenient for users to perform other functional operations other than fixed menu items.

Application content

The purpose of the embodiments of the present application is to provide a floating window management method, device, electronic device, and readable storage medium, which can solve the problem that the menu items displayed in the floating window are all fixed, and it is inconvenient for users to perform functions other than fixed menu items. operational problems.

In order to solve the above technical problems, this application is implemented as follows:

In a first aspect, an embodiment of the present application provides a method for managing a floating window, the method comprising:

receiving a first input from the user on the display screen of the electronic device;

in response to the first input, determining a target area in the display screen;

obtaining object information of the object displayed in the target area;

According to the object information, a floating window corresponding to the target area is displayed; wherein, the floating window includes a menu item corresponding to the object.

In a second aspect, an embodiment of the present application provides a floating window management device, the device comprising:

a receiving module, configured to receive a user's first input on the display screen of the electronic device;

a response module for determining a target area in the display screen in response to the first input;

an acquisition module for acquiring the object information of the object displayed in the target area;

A display module, configured to display a floating window corresponding to the target area according to the object information; wherein the floating window includes a menu item corresponding to the object.

In a third aspect, embodiments of the present application provide an electronic device, the electronic device includes a processor, a memory, and a program or instruction stored on the memory and executable on the processor, the program or instruction being The processor implements the steps of the method according to the first aspect when executed.

In a fourth aspect, an embodiment of the present application provides a readable storage medium, where a program or an instruction is stored on the readable storage medium, and when the program or instruction is executed by a processor, the steps of the method according to the first aspect are implemented .

In a fifth aspect, an embodiment of the present application provides a chip, the chip includes a processor and a communication interface, the communication interface is coupled to the processor, and the processor is configured to run a program or an instruction, and implement the first aspect the method described.

In the embodiment of the present application, the electronic device receives a first input from the user on the display screen of the electronic device, determines a target area in the display screen in response to the first input, acquires object information of the object displayed in the target area, and determines the target area according to the object information, display a floating window corresponding to the target area, and the floating window includes menu items corresponding to the object. The menu items in the floating window are associated with the objects in the area that the user pays attention to, and the menu items in the floating window can change according to the changes of the objects in the area that the user pays attention to, which is convenient for the user to perform operations related to the objects in the area that the user pays attention to. , to improve the flexibility of user operation.

Description of drawings

1 is a flowchart of steps of a method for managing a floating window provided by an embodiment of the present application;

Fig. 2 is a desktop schematic diagram of a display screen provided by an embodiment of the present application;

3 is a flowchart of steps of another floating window management method provided by an embodiment of the present application;

4 is a schematic diagram of an application program interface provided by an embodiment of the present application;

5 is a schematic diagram of another application program interface provided by an embodiment of the present application;

6 is a schematic diagram of another application program interface provided by an embodiment of the present application;

7 is a schematic diagram of another application program interface provided by an embodiment of the present application;

8 is a structural block diagram of a floating window management device provided by an embodiment of the present application;

9 is a structural block diagram of another floating window management device provided by an embodiment of the present application;

10 is a structural block diagram of an electronic device provided by an embodiment of the present application;

FIG. 11 is a schematic diagram of a hardware structure of an electronic device implementing an embodiment of the present application.

Detailed ways

The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative work fall within the protection scope of the present application.

The terms "first", "second" and the like in the description and claims of the present application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It is to be understood that data so used may be interchanged under appropriate circumstances so that embodiments of the application can be practiced in sequences other than those illustrated or described herein. In addition, "and/or" in the description and claims indicates at least one of the connected objects, and the character "/" generally indicates that the associated objects are in an "or" relationship.

The floating window management method provided by the embodiments of the present application will be described in detail below with reference to the accompanying drawings through specific embodiments and application scenarios thereof.

Referring to FIG. 1, FIG. 1 is a flowchart of steps of a floating window management method provided by an embodiment of the present application. The method is applied to an electronic device and may include:

Step 101: Receive a first input from the user on the display screen of the electronic device.

The electronic device may be, for example, an electronic device with a display screen such as a mobile phone, a tablet computer, and a wearable device.

In this embodiment, the electronic device may receive the first input performed by the user on the display screen. Exemplarily, the first input may be a sliding operation on the display screen in a clockwise or counterclockwise direction, as shown in FIG. 2 , which is a schematic desktop diagram of a display screen provided by an embodiment of the present application. Position A on the screen starts to slide clockwise to position B, and the electronic device can receive the user's sliding operation and determine the corresponding operation trajectory of the sliding operation. The specific form of the first input can be set according to requirements.

Step 102, in response to the first input, determine a target area in the display screen.

In this embodiment, the electronic device may determine the target area in the display screen in response to the first input.

In combination with step 101, the electronic device can respond to the user's sliding operation from position A on the display screen to slide clockwise to position B, and determine the target area 201 corresponding to the sliding operation, that is, a circular area, according to the trajectory of the sliding operation. The trajectory of the sliding operation may be a regular or irregular circle or ellipse, or a polygon such as a triangle, a quadrilateral, and a pentagon, which is not limited in this embodiment.

In this embodiment, the electronic device may determine the target area corresponding to the sliding operation when the trajectory of the sliding operation is closed. For example, the electronic device may determine the target area corresponding to the sliding operation when the position A and the position B overlap. Alternatively, the electronic device may determine the target area corresponding to the sliding operation when the distance between the A position and the B position is less than or equal to a preset value (for example, 2 mm). Alternatively, the electronic device may determine the target area corresponding to the sliding operation when the trajectory of the sliding operation is a preset shape (eg, a rectangle). The electronic device determines the target area in the display screen when the trajectory of the sliding operation is closed or the trajectory of the sliding operation is a preset shape, which can prevent the user from determining the target area after misoperation and reduce the power consumption of the electronic device.

Step 103: Acquire object information of the object displayed in the target area.

In this embodiment, the objects are objects such as images, application program (APP, Application) icons, controls, and text displayed in the target area. After determining the target area in the display screen, the electronic device may identify the objects in the target area to determine object information of the objects in the target area.

For example, after determining the target area on the display screen, the electronic device may perform a screenshot operation to obtain an image corresponding to the target area, and then input the image into a pre-trained image recognition model to obtain object information output by the image recognition model. As shown in FIG. 1 , the target area 201 includes the first icon 202 of the dial-up APP and the second icon 203 of the dating APP (objects in the target area). After acquiring the image corresponding to the target area 201, the electronic device can pass the image The recognition model recognizes the image corresponding to the target area 201, and obtains object information output by the image recognition model, such as "dialer APP icon" and "friendship APP icon". The process of acquiring the image corresponding to the target area by the electronic device and the training and use method of the image recognition model may refer to the prior art, which will not be repeated in this embodiment.

It should be noted that the above is only an exemplary example, and the process of acquiring object information by the electronic device may include, but is not limited to, a method using an image recognition model.

Step 104: Display a floating window corresponding to the target area according to the object information.

The floating window includes menu items corresponding to the objects.

In this embodiment, after acquiring the object information of the objects in the target area, the electronic device may display a floating window according to the object information, and the floating window includes menu items corresponding to the objects in the target area.

For example, as shown in FIG. 2 , after the electronic device determines that the object information of the first icon 202 of the dial-up APP is a “dial-up APP icon” through the image recognition model, it can be determined according to the object information “dial-up APP icon” that the user may need to open the dial-up phone. APP. If the application program interface included in the dial-up APP includes a dial-up interface and an address book interface, the electronic device can determine the dial-up APP among all the applications already installed in the electronic device according to the object information "dial-up APP icon", and determine the dial-up APP in the dial-up APP. In the dialing interface, a menu item 301 corresponding to the dialing APP is generated (the menu item is, for example, a button), and the calling relationship between the menu item 301 and the dialing interface is established. When the user clicks on the menu item 301, the electronic device can open the dialing interface in response to the user's click operation. Similarly, a menu item 302 corresponding to the dating APP can be established, and the menu item 302 is used to open the chat interface in the dating APP.

After generating the menu items, the electronic device may display a floating window including the menu items. As shown in FIG. 2 , after generating the menu item 301 and the menu item 302 , the electronic device may display the floating window 300 including the menu item 301 and the menu item 302 at a position close to the target area 201 . The user can operate the menu item 301 in the floating window 300 to quickly enter the dialing interface, and operate the menu item 302 in the floating window 300 to quickly enter the chat interface. The floating window may be displayed at a position close to the target area, or directly above the target area, and the display position of the floating window may be set as required, which is not limited in this embodiment.

It should be noted that there may be one or more objects in the target area, and the electronic device may generate one or more menu items for each object, or only generate one or more menu items for some of the objects.

To sum up, in this embodiment, the electronic device receives the user's first input on the display screen of the electronic device, determines the target area in the display screen in response to the first input, and obtains object information of the object displayed in the target area , and display the floating window corresponding to the target area according to the object information. The menu items in the floating window are associated with the objects in the area that the user pays attention to, and the menu items in the floating window can change according to the changes of the objects in the area that the user pays attention to, which is convenient for the user to perform operations related to the objects in the area that the user pays attention to. , to improve the flexibility of user operation.

Referring to FIG. 3, FIG. 3 is a flowchart of steps of another floating window management method provided by an embodiment of the present application. The method is applied to an electronic device and may include:

Step 301: Receive a first input from the user on the application program interface displayed on the display screen.

Step 302 , in response to the first input, determine a target area in the display screen.

The application program interface is, for example, a dialing interface of a dialing APP, or a chatting interface of a dating APP.

In this embodiment, the first input may act on the application program interface, and the electronic device may receive the user's first input on the application program interface, and in response to the first input, determine the target area in the display screen, that is, the target area in the application program interface. target area. Objects exist in different areas within the application interface. After the electronic device receives the first input in different areas of the application program interface, it can obtain different object information in response to the first input, and then generate corresponding menu items.

Optionally, there can be multiple target areas. That is, the electronic device may determine a plurality of target areas in response to the user's first input.

4 is a schematic diagram of an application program interface provided by an embodiment of the present application, in conjunction with step 101, the first input may be a continuous multiple sliding operation, and the user may continuously Perform multiple swipes. The electronic device may determine the target area corresponding to each sliding operation in response to multiple sliding operations performed continuously by the user. That is, the first target area 401 , the second target area 402 and the third target area 403 as shown in FIG. 4 . In practical applications, the electronic device may determine the target area corresponding to each sliding operation at one time after the user performs multiple sliding operations, or may determine the target area corresponding to this sliding operation each time the user performs the sliding operation.

Optionally, after determining the target area in the display screen, the electronic device may display a contour line corresponding to the target area, so as to facilitate the user to identify the target area. As shown in FIG. 2 , the electronic device may determine the trajectory of the sliding operation in response to the user's sliding operation, and display a contour line 2011 corresponding to the sliding operation trajectory, so as to facilitate the user to identify the target area 201 according to the contour line 2011 . The contour line may be, for example, a thick solid line or a thin solid line, and the specific form of the contour line is not limited in this embodiment.

Step 303: Acquire object information of the object displayed in the target area.

In this embodiment, when there are multiple target areas, the electronic device may separately acquire object information of objects in each target area.

For example, as shown in FIG. 4 , after the electronic device determines the first target area 401 , the second target area 402 and the third target area 403 in response to the first input, the electronic device Perform a screenshot operation on the target area 402 and the third target area 403 to obtain images corresponding to the first target area 401, the second target area 402 and the third target area 403 respectively. The images corresponding to the three target areas 403 are input into the image recognition model in turn, and the object information of the objects in the first target area 401 , the object information of the objects in the second target area 402 , and the objects in the third target area 403 respectively output by the image recognition model are obtained. object information.

Step 304: Determine the target operation of the user according to the object information, and determine the target application program related to the target operation from the electronic device.

The target operation is a user operation that the user may want to perform. User operation such as clicking a control in the application interface to open an interface in the application; or the user clicking an application icon on the desktop of the electronic device to open an application; or the user Enter keywords in the application program interface of an application to perform retrieval operations. The electronic device can predict the user operation according to the object information, and obtain the target operation corresponding to the object in the target area.

It should be noted that, when there are multiple target areas, the electronic device may determine the target operation corresponding to each target area according to the object information of the objects in each target area. As shown in FIG. 4 , the electronic device can determine the target operation corresponding to the first target area 401 according to the object information of the objects in the first target area 401 . Similarly, it can determine the second target operation according to the object information of the objects in the second target area 402 . The target operation corresponding to the target area 402 and the target operation corresponding to the third target area 403 are determined according to the object information of the objects in the third target area 403 . The electronic device may determine the target operation corresponding to each target area synchronously, or may determine the target operation corresponding to each target area step by step, which is not limited in this embodiment.

In this embodiment, the electronic device can directly determine the target operation and the target application related to the target operation according to the object information, or can determine the target application related to the target operation from the electronic device according to the target operation after the target operation is determined. .

For example, as shown in FIG. 4 , the application program interface currently displayed on the display screen of the electronic device is an application program interface in a shopping APP. The objects included in the first target area 401 are the search box control 4011 and the keyword 4012 in the application program interface. After the electronic device determines the first target area 401, the image recognition model can determine the object information of the object (search box) in the first target area 401 as a "search box". After the electronic device obtains the object information "search box", according to the "search box", through the preset recommendation algorithm or recommendation model, it can be determined that the target operation that the user may want to perform is to perform a search-related operation, such as opening the current application. , or use the pasteboard to copy the contents of the pasteboard into the search box.

For another example, the object included in the second target area 402 is the food delivery APP icon 4021 . After the electronic device determines the second target area 402, the image recognition model can determine that the object information of the food delivery APP icon 4021 in the second target area 402 is "food delivery APP icon". After the electronic device obtains the object information "food delivery APP icon", according to the "food delivery APP icon", through the preset recommendation algorithm or recommendation model, it can be determined that the target operation that the user may perform is to open the delivery APP and place an order to buy food delivery. Meanwhile, according to the food delivery APP icon in the second target area 402, it can be determined that the target application corresponding to the target operation is the food delivery APP installed in the electronic device.

It should be noted that, for ease of understanding, the object information in this embodiment is the same as the description of the object. In practical applications, the object information may also be other types of information representing the characteristics of the object, which is not limited in this embodiment.

Optionally, step 304 may be implemented in the following manner:

The target operation is determined according to at least one of the type of the application program corresponding to the application program interface, the user's user portrait, and the object information, and the target application program related to the target operation is determined from the electronic device.

The type of the application program may be, for example, the type of the application program determined after classifying the application programs installed in the electronic device in advance according to the function of the application program. For example, the type of APP1 is "friend-making APP", the type of APP2 is "shopping APP", and the type of APP3 is "image processing APP". The electronic device may predetermine and store type information of each application program installed in the electronic device. In practical applications, the application programs may also be classified according to other features of the application programs, which are not limited in this embodiment.

User portraits are data that can describe various characteristics, preferences, and habits of users. For example, the user's user profile may include the user's age, gender, income status, hobbies, work category, fitness habits, and other data information used to describe the user's characteristics. Among them, the electronic device can obtain and store the user's user portrait from the server in advance. Of course, any method known in the art and any method for obtaining the user's portrait that may appear in the future can be applied to this application. Not limited.

For example, the electronic device may determine the target operation according to the object information and the application type. As shown in FIG. 4 , the objects included in the third target area 403 are pictures and prices of the cups 4031 . After the electronic device determines the third target area 403, the image recognition model can determine the object information of the object (cup) in the third target area 403 as "cup" and "price". At the same time, the electronic device may determine that the type information of the pre-stored shopping APP is "shopping APP". After the electronic device obtains the object information "cup" and "price", and determines the type of application "shopping APP", according to the "cup", "price" and "shopping APP", through the preset recommendation algorithm or recommendation The model can determine that the target action that the user may take is the user action of searching for a cup in the shopping app. At this time, according to the target operation "go to the shopping APP to search for cups", it can be determined whether another shopping APPX (target application) is installed in the electronic device, and the shopping APPX installed in the electronic device is used as the target application.

For example, the electronic device may determine the target operation according to the object information and the user's profile. As shown in FIG. 5 , FIG. 5 is a schematic diagram of another application program interface provided by an embodiment of the present application. The application program interface currently displayed on the display screen of the electronic device is an application program interface in an image processing APP (such as a photo album). . The electronic device determines a target area 501 in response to the user's first input, and the object included in the target area 501 is the lipstick 5012 on the user's face. After the electronic device determines the target area 501, the image recognition model can determine that the object information of the object (lipstick 5012) in the target area 501 is "lipstick". At the same time, the electronic device may determine that the pre-acquired user portrait is "female". After the electronic device determines the object information "lipstick" and the user portrait "female", according to "lipstick" and "female", through the preset recommendation algorithm or recommendation model, it can be determined that the target operation that the user may want to perform is to search in the shopping APP. The user operation of lipstick, and the user operation of opening the sharing interface and sharing pictures in the dating APP. At this time, according to the target operation, the target application (shopping APP) corresponding to the search lipstick can be determined from the applications installed on the electronic device, and the target application corresponding to the shared picture can be determined from the applications installed on the electronic device ( dating apps).

For example, the electronic device may determine the target operation according to the object information, the type of the application and the user profile of the user. As shown in FIG. 6 , FIG. 6 is a schematic diagram of another application program interface provided by an embodiment of the present application. The application program interface currently displayed on the display screen of the electronic device is an application program interface in a dating APP. The electronic device determines the target area 601 in response to the user's first input, and the object included in the target area 601 is the emoticon package 6012 . After the electronic device determines the target area 601, the image recognition model can determine the object information of the object (expression pack 6012) in the target area 601 as "expression pack". At the same time, the electronic device may determine that the pre-acquired user portraits are "optimistic" and "expressionist", and determine the type information of the application as "friendship app". After the electronic device determines that the object information "expression pack" and user portraits are "optimistic" and "expressionist", as well as the type information of the application "friendship app", according to the "expression pack", "optimistic", "expressionist" "People" and "Dating APP", through the preset recommendation algorithm or recommendation model, it can be determined that the target operation that the user may perform is to click on the emoticon package to save the emoticon package, or select and send it in the sending window in the chat interface of the dating APP User actions for emoticons. After it is determined that the target operation is to send an emoticon package, a dating APP can be determined from the applications installed on the electronic device, and the dating APP can be used as a target application related to sending an emoticon package.

It should be noted that the above are only exemplary examples, and the method of determining the target operation according to the object information is not limited to the recommendation model and the recommendation algorithm. Applicable to the present application, the present application does not limit the specific manner of determining the target operation. The recommendation algorithm is, for example, any one of a content-based recommendation algorithm, a collaborative filtering-based recommendation algorithm (Collaborative Filtering Recommendation), and an association rule-based recommendation algorithm (Association Rule-based Recommendation). For the training and use methods of the recommendation model, reference may be made to the prior art, which will not be repeated in this implementation.

In practical applications, the target operation can be predicted according to at least one of the type of the application program, the user's user portrait, and the object information, and the target operation that is more in line with the user can be obtained. accuracy.

Step 305: Display a floating window corresponding to the target area according to the target operation and the target application.

In this embodiment, after the target operation and the target application related to the target operation are determined, menu items corresponding to the target operation can be generated according to the target operation and the target application, thereby displaying a floating window corresponding to the target area.

For example, if it is determined that the target operation is to open the search history in the currently running application (target application) and use the pasteboard, the electronic device can determine the components corresponding to the search history and the pasteboard from the currently running application. The corresponding component can generate the menu item 4013 shown in Figure 4 according to the keyword (search history) in the target operation (open the search history), and establish the calling relationship between the menu item 4013 and the component corresponding to the search history, and According to the keyword information (pasteboard) in the target operation (opening the pasteboard), the menu item 4014 shown in FIG. 4 can be generated, and the calling relationship between the menu item 4014 and the component corresponding to the pasteboard can be established. The electronic device may open the search history in response to the user's operation of clicking the menu item 4013 , and open the pasteboard in response to the user's operation of clicking the menu item 4014 .

Combined with step 303, if it is determined that the target operation is to open a takeaway APP and place an order to buy takeaway, if the electronic device determines that a takeaway APPW (target application) has been installed, then the keyword information in the target operation "open the takeaway APP" and the target The name of the application program "APPW" generates a menu item 4022 as shown in FIG. 4, and establishes a calling relationship between the menu item 4022 and the takeaway APPW. The electronic device can open the takeaway APPW in response to the user's operation of clicking on the menu item 4022. On the contrary, if the takeaway APPZ is not installed in the electronic device, the electronic device can determine that the target application related to the target operation is a download APP that provides the APP download function, and the electronic device can use the keywords “download” and “download” corresponding to the target operation. Take-out APPZ, establish menu item 4023 as shown in Figure 5, and establish the calling relationship between menu item 4023 and the download APP, the electronic device can respond to the user's operation of clicking menu item 4023, open the download APP, and download the take-out APPZ.

Combined with step 303, if the target operation is a user operation to search for cups in the shopping APP, and it is determined that another shopping APPX (ie, the target application) is installed on the electronic device, then the keyword information of the target operation "search" and another shopping APPX can be determined. The name "APPX" of the shopping APPX generates the menu item and 4032 shown in Figure 4, and establishes the calling relationship between the menu item and 4032 and another shopping APPX, and the electronic device can respond to the operation of the user clicking on the menu item 4032 to open another shopping APPX.

Combined with step 303, if the target operation is the user operation of searching for lipstick in the shopping APP, and the operation of opening the sharing interface in the dating APP, sharing pictures, and determining the target application (shopping APP) corresponding to the search for lipstick, and Determine the target application (friendship APP) corresponding to the shared picture, then according to the keyword information "search" and "lipstick" of the target operation, and the name of the target application, generate the menu items shown in Figure 5 with 5013 and 5013 menu item 5014

In practical applications, if the target operation is to open an application program interface in an application program, the electronic device can directly establish a calling relationship between the menu item and the application program interface in the process of generating the menu item. As shown in FIG. 6 , if the target operation is a user operation of selecting and sending an emoticon package in the sending window of the chat interface of the friend-making APP, the electronic device can generate a menu item 6013 as shown in FIG. 6 , and the electronic device can respond to the user clicking The operation of menu item 6013 opens the sending window of the chat interface and sends the emoticon package. And when the target operation is a user operation of clicking and saving emoticons, the electronic device can generate a menu item 6014 as shown in FIG.

It should be noted that the above is only an exemplary example. In practical applications, the electronic device can determine the corresponding target application according to different target operations, and generate different menu items according to different target operations and target applications, so as to display the contents including: Floating windows for different menu items.

In this embodiment, after generating one or more menu items corresponding to the target area, the electronic device may display a floating window according to the menu items. As shown in FIG. 4 , FIG. 5 and FIG. 6 , the electronic device may display the floating window 300 corresponding to each target area respectively. Moreover, when there are multiple menu items corresponding to the target area, the electronic device may display a floating window including multiple menu items, so as to sequentially display multiple menu items in the floating window.

Optionally, when the target area includes multiple objects, step 305 may be implemented in the following manner:

determine the priority of each of the multiple objects;

According to the target operation, the target application, and the priority of each object, the floating window corresponding to the target area is displayed; wherein, the menu items corresponding to each object are displayed in the floating window in order according to the priority of each object. ; the priority of the object corresponding to the first menu item in the floating window is the highest priority among all priorities.

In this embodiment, when the floating window includes multiple objects, the electronic device can first determine the priority of each object, and determine the display position of the menu item corresponding to each object in the floating window according to the priority of each object, During the display process of the floating window, the menu items are arranged in order from top to bottom according to the priority level. The higher the priority of the object, the higher the position of the corresponding menu item in the floating window.

Optionally, determining the priority of each of the plurality of objects may include:

According to the ratio of the area corresponding to each of the multiple objects to the area of the target area, the color information of each of the multiple objects, the weight corresponding to each of the multiple objects, and the At least one of the popularity information of each object determines the priority of each object in the plurality of objects.

For example, as shown in FIG. 4 , the objects in the first target area include a search box control 4011 and a keyword 4012. When the electronic device uses the image recognition model to determine the object, it can also determine that the search box control 4011 and the keyword 4012 occupy the corresponding positions respectively. The ratio of the area of the first target area 401, the ratio of the search box control 4011 to the area of the first target area 401 is larger than the ratio of the keyword 4012 to the area of the first target area 401, then the priority of the search box control 4011 is determined to be high Priority on keyword 4012. In the process of displaying the floating window, the menu item corresponding to the search box control 4011 can be set above the menu item corresponding to the keyword 4012 .

For another example, after determining the search box control 4011 and the keyword 4012, the electronic device can obtain the color information (color information such as hue, brightness and saturation) of the search box control 4011 and the keyword 4012, respectively, and determine the search box control with high brightness. 4011 has a higher priority than keywords 4012 with low brightness.

For another example, when the electronic device determines the search box control 4011 and the keyword 4012 through the image recognition model, the weight of the search box control 4011 and the weight of the keyword 4012 can be determined at the same time, and the search box control 4011 with a higher weight is determined than the search box control 4011 with a lower weight. The keyword 4012 has a high priority. Among them, the weight represents the probability of the object information determined by the image recognition model. For the understanding of the weight, reference may be made to the prior art, which is not limited in this embodiment.

For another example, as shown in FIG. 4 , the first target area may also include other keywords 4015 , and the electronic device may determine, according to the keyword 4012 and the popularity information of the keyword 4015 , that the keyword 4015 with high popularity information has a higher priority than the keyword 4015 . The priority of keywords 4012 with low popularity information. Wherein, the popularity information indicates the frequency of occurrence of keywords. For understanding of the popularity information, reference may be made to the prior art, which is not limited in this embodiment.

In this embodiment, in the process of displaying the floating window, the priority of each object in the target area is firstly determined, and the position of the menu item corresponding to each object in the floating window is determined according to the priority, so that the objects with high user attention can be placed. The menu items are set at important positions in the floating window, which can improve the practicability of the floating window and provide users with more convenient menu item selection. At the same time, the priority of each object is determined according to at least one of the area size, color information, weight and heat information of each object in the target area, and the priority of each object can be determined more accurately.

It should be noted that the above is only an exemplary example, and the method for determining the priority of each object may include, but is not limited to, the ratio of the area corresponding to each object to the area of the target area, the color information of each object, the One or more of the corresponding weight and the popularity information of each object determine the priority of the object.

To sum up, in this embodiment, the electronic device may determine the target area in the application program interface in response to the user's first input to the application program interface, and display a floating window including menu items according to the object information of the objects in the target area . The menu items in the floating window are related to the objects in the area that the user pays attention to. According to the objects in the area that the user pays attention to, the user operation can be predicted to generate the corresponding menu items. Since there are many types of objects in the application program interface, when the area that the user pays attention to is located in the application program interface, a large number of menu items can be generated according to the objects in the application program interface, and more operations can be provided for the user through the floating window , which can further improve the flexibility of user operation. At the same time, in the process of generating menu items, the user operation is first predicted according to the object information, and then the menu items are generated according to the predicted target operation, which can enable the electronic device to provide menu items that meet the current needs of the user, and improve the flexibility of the electronic device. At the same time, it can improve the real-time performance of electronic equipment and meet the real-time requirements of users.

Optionally, the number of target areas is N, where N is an integer greater than 1;

Correspondingly, displaying a floating window corresponding to the target area according to the object information may include: displaying a floating window corresponding to each of the N target areas according to the object information of the objects in the N target areas;

Or, display N floating windows according to the object information of objects in each target area in the N target areas; wherein, one target area in the N target areas corresponds to one floating window in the N floating windows, and the N target areas The floating window corresponding to each target area in is different.

In this embodiment, when the number of target areas is multiple, the electronic device may acquire object information of objects in all target areas, and display a floating window including menu items corresponding to each object according to the object information of all objects .

7 is a schematic diagram of another application program interface provided by an embodiment of the present application, after the electronic device determines the first target area 401, the second target area 402 and the third target area 403, A floating window 300 may be displayed. Combining the above examples, the floating window 300 includes menu items corresponding to objects in the first target area 401 , menu items corresponding to objects in the second target area 402 , and menu items corresponding to objects in the third target area 303 . In practical applications, the electronic device can display a total floating window according to the object information in all target areas, and multiple target areas can be associated with one floating window, which can facilitate the user to determine a larger range, so that a floating window can be used to Provide users with more operation options.

In this embodiment, when the number of target areas is multiple, the electronic device may display a floating window corresponding to each target area according to the object information of the objects in each target area. For the specific process of displaying the floating window corresponding to each target area, reference may be made to step 301 to step 305 , which will not be repeated in this embodiment.

Optionally, when the first input is the first preset input, the electronic device may display a floating window corresponding to each of the multiple target areas according to the object information of the objects in the multiple target areas. And when the first input is the second preset input, according to the object information in each target area, a floating window corresponding to each target area is displayed.

For example, when the first input is sliding in a clockwise direction, the electronic device may display a floating window corresponding to each of the multiple target areas according to the object information of the objects in the multiple target areas. In the case where the first input is to slide in the counterclockwise direction, according to the object information in each target area, a floating window corresponding to each target area is displayed. The specific forms of the first preset input and the second preset input can be set according to requirements, which are not limited in this embodiment.

It should be noted that, in the floating window management method provided by the embodiment of the present application, the execution body may be a floating window management device, or a control module in the floating window management device for executing the loading floating window management method. In the embodiment of the present application, the floating window management method provided by the embodiment of the present application is described by taking the floating window management device executing the loading suspended window management method as an example.

Referring to FIG. 8 , FIG. 8 is a structural block diagram of a floating window management apparatus provided by an embodiment of the present application. The apparatus is set in an electronic device. The apparatus 800 may include: a receiving module 801 , a response module 802 , an acquisition module 803 and a display module 804 .

The receiving module 801 is configured to receive a user's first input on the display screen of the electronic device.

The response module 802 is configured to determine the target area in the display screen in response to the first input.

The obtaining module 803 is used for obtaining the object information of the object displayed in the target area.

The display module 804 is configured to display a floating window corresponding to the target area according to the object information; wherein, the floating window includes menu items corresponding to the object.

Optionally, the receiving module 801 is specifically configured to receive the first input from the user to the application program interface displayed on the display screen.

Optionally, referring to FIG. 9 , FIG. 9 is a structural block diagram of another floating window management apparatus provided by an embodiment of the present application. The display module 804 may include: a determination unit 8041 and a display unit 8042 .

The determining unit 8041 is configured to determine the target operation of the user according to the object information, and determine the target application program related to the target operation from the electronic device.

The display unit 8042 is configured to display a floating window corresponding to the target area according to the target operation and the target application.

Optionally, the determining unit 8041 is specifically configured to determine the target operation according to at least one of the type of the application program corresponding to the application program interface, the user portrait of the user, and the object information, and determine the target operation from the electronic device. target application.

Optionally, the target area includes multiple objects; the display unit 8042 includes: a determination subunit 80421 and a display subunit 80422 .

The determination subunit 80421 is used to determine the priority of each object in the plurality of objects.

The display subunit 80422 is used to display the floating window corresponding to the target area according to the target operation, the target application, and the priority of each object; wherein, the menu item corresponding to each object is according to the priority of each object. , the order is displayed in the floating window; the priority of the object corresponding to the first menu item in the floating window is the highest priority among all priorities.

Optionally, the determination subunit 80421 is specifically configured to determine the ratio of the area corresponding to each of the multiple objects to the area of the target area, the color information of each of the multiple objects, and the corresponding value of each of the multiple objects. At least one of the weight and the popularity information of each of the multiple objects determines the priority of each of the multiple objects.

Optionally, the number of target regions is N, where N is an integer greater than 1.

The display module 804 is specifically configured to display a floating window corresponding to the N target areas according to the object information of the objects in the N target areas; or, according to the object information of the objects in each of the N target areas, display the N target areas. wherein, one target area in the N target areas corresponds to one suspension window in the N target areas, and each target area in the N target areas corresponds to a different suspension window.

The floating window management device in this embodiment of the present application may be a device, or may be a component, an integrated circuit, or a chip in a terminal. The apparatus may be a mobile electronic device or a non-mobile electronic device. Exemplarily, the mobile electronic device may be a mobile phone, a tablet computer, a notebook computer, a palmtop computer, an in-vehicle electronic device, a wearable device, an ultra-mobile personal computer (UMPC), a netbook, or a personal digital assistant (personal digital assistant). , PDA), etc., the non-mobile electronic device may be a server, a network attached storage (NAS), a personal computer (personal computer, PC), a television (television, TV), a teller machine or a self-service machine, etc. The embodiments of the present application There is no specific limitation.

The floating window management device in the embodiment of the present application may be a device with an operating system. The operating system may be an Android (Android) operating system, an ios operating system, or other possible operating systems, which are not specifically limited in the embodiments of the present application.

The floating window management device provided in the embodiment of the present application can implement various processes implemented by the floating window management device in the method embodiments of FIG. 1 and FIG. 3 , and to avoid repetition, details are not repeated here.

In this embodiment, the electronic device receives the user's first input on the display screen of the electronic device, determines the target area in the display screen in response to the first input, acquires object information of the object displayed in the target area, and according to the object information, Displays a floating window corresponding to the target area. The menu items in the floating window are associated with the objects in the area that the user pays attention to, and the menu items in the floating window can change according to the changes of the objects in the area that the user pays attention to, which is convenient for the user to perform operations related to the objects in the area that the user pays attention to. , to improve the flexibility of user operation.

Optionally, an embodiment of the present application further provides an electronic device. As shown in FIG. 10 , FIG. 10 is a structural block diagram of an electronic device provided by an embodiment of the present application. The electronic device 1000 includes a processor 1001 , a memory 1002 , a storage A program or instruction on the memory 1002 that can be run on the processor 1001, when the program or instruction is executed by the processor 1001, implements each process of the above-mentioned embodiment of the floating window management method, and can achieve the same technical effect, which is: To avoid repetition, I will not repeat them here.

It should be noted that the electronic devices in the embodiments of the present application include the aforementioned mobile electronic devices and non-mobile electronic devices.

FIG. 11 is a schematic diagram of a hardware structure of an electronic device implementing an embodiment of the present application.

The electronic device 1100 includes but is not limited to: a radio frequency unit 1101, a network module 1102, an audio output unit 1103, an input unit 1104, a sensor 1105, a display unit 1106, a user input unit 1107, an interface unit 1108, a memory 1109, and a processor 1110, etc. part.

Those skilled in the art can understand that the electronic device 1100 may also include a power source (such as a battery) for supplying power to various components, and the power source may be logically connected to the processor 1110 through a power management system, so that the power management system can manage charging, discharging, and power consumption. consumption management and other functions. The structure of the electronic device shown in FIG. 11 does not constitute a limitation on the electronic device. The electronic device may include more or less components than those shown in the figure, or combine some components, or arrange different components, which will not be repeated here. .

The processor 1110 is configured to control the user input unit 1107 to receive the first input of the user on the display screen of the electronic device;

in response to the first input, determining a target area in the display screen;

Get the object information of the object displayed in the target area;

According to the object information, the display unit 1106 is controlled to display a floating window corresponding to the target area; wherein the floating window includes menu items corresponding to the object.

In this embodiment, the electronic device receives the user's first input on the display screen of the electronic device, determines the target area in the display screen in response to the first input, acquires object information of the object displayed in the target area, and according to the object information, Displays a floating window corresponding to the target area. The menu items in the floating window are associated with the objects in the area that the user pays attention to, and the menu items in the floating window can change according to the changes of the objects in the area that the user pays attention to, which is convenient for the user to perform operations related to the objects in the area that the user pays attention to. , to improve the flexibility of user operation.

The processor 1110 is specifically configured to control the user input unit 1107 to receive the user's first input to the application program interface displayed on the display screen.

In this embodiment, the electronic device may determine a target area in the display screen in the application program interface in response to the user's first input to the application program interface, and display a floating window including menu items according to object information of objects in the target area. The menu items in the floating window are related to the objects in the area that the user pays attention to. According to the objects in the area that the user pays attention to, the user operation can be predicted to generate the corresponding menu items. Since there are many types of objects in the application program interface, when the area that the user pays attention to is located in the application program interface, a large number of menu items can be generated according to the objects in the application program interface, and more operations can be provided for the user through the floating window , which can further improve the flexibility of user operation.

The processor 1110 is further configured to determine the target operation of the user according to the object information, and determine the target application program related to the target operation from the electronic device;

According to the target operation and the target application, the display unit 1106 is controlled to display a floating window corresponding to the target area.

In this embodiment, in the process of generating the menu items, the user operation is first predicted according to the object information, and then the menu items are generated according to the predicted target operation, so that the electronic device can provide the menu items that meet the current needs of the user. While the electronic equipment is flexible, the real-time performance of the electronic equipment can be improved to meet the real-time performance requirements of users.

The processor 1110 is specifically configured to determine the target operation according to at least one of the type of the application program corresponding to the application program interface, the user portrait of the user, and the object information, and determine the target application program related to the target operation from the electronic device .

In this embodiment, the target operation can be predicted according to at least one of the type of the application program, the user portrait of the user, and the object information, and the target operation that is more in line with the user can be obtained, so that more accurate menu items can be displayed, and the electronic equipment accuracy.

The processor 1110 is further configured to determine the priority of each object in the plurality of objects;

According to the target operation, the target application, and the priority of each object, the display unit 1106 is controlled to display the floating window corresponding to the target area; wherein, the menu items corresponding to each object are in the order of the priority of each object. Displayed in the floating window; the priority of the object corresponding to the first menu item in the floating window is the highest priority among all priorities;

In this embodiment, in the process of displaying the floating window, the priority of each object in the target area is firstly determined, and the position of the menu item corresponding to each object in the floating window is determined according to the priority, so that the objects with high user attention can be placed. The menu items are set at important positions in the floating window, which can improve the practicability of the floating window and provide users with more convenient menu item selection.

The processor 1110 is further configured to, according to the ratio of the area corresponding to each of the multiple objects to the area of the target area, the color information of each of the multiple objects, the weight corresponding to each of the multiple objects, and the multiple At least one of the popularity information of each object in the plurality of objects determines the priority of each object in the plurality of objects.

In this embodiment, the priority of each object is determined according to at least one of the area size, color information, weight, and heat information of each object in the target area, and the priority of each object can be determined more accurately.

The number of target regions is N, where N is an integer greater than 1.

The processor 1110 is further configured to acquire object information of objects in the N target regions;

For controlling the display unit 1106 to display a floating window corresponding to the N target areas according to the object information of the object in the N target areas; or, according to the object information of the object in each target area in the N target areas, display N wherein, one target area in the N target areas corresponds to one suspension window in the N target areas, and each target area in the N target areas corresponds to a different suspension window.

In this embodiment, when the number of target areas is multiple, the electronic device may acquire object information of objects in all target areas, and display a floating window including menu items corresponding to each object according to the object information of all objects . Multiple target areas can be associated with one floating window, which can facilitate the user to determine a larger range, so that the user can be provided with more operation options through one floating window.

It should be understood that, in this embodiment of the present application, the input unit 1104 may include a graphics processor (Graphics Processing Unit, GPU) 11041 and a microphone 11042. camera) to process the image data of still pictures or videos. The display unit 1106 may include a display panel 11061, which may be configured in the form of a liquid crystal display, an organic light emitting diode, or the like. The user input unit 1107 includes a touch panel 11071 and other input devices 11072 . The touch panel 11071 is also called a touch screen. The touch panel 11071 may include two parts, a touch detection device and a touch controller. Other input devices 11072 may include, but are not limited to, physical keyboards, function keys (such as volume control keys, switch keys, etc.), trackballs, mice, and joysticks, which will not be described herein again. Memory 1109 may be used to store software programs as well as various data including, but not limited to, application programs and operating systems. The processor 1110 may integrate an application processor and a modem processor, wherein the application processor mainly handles the operating system, user interface, and application programs, and the like, and the modem processor mainly handles wireless communication. It can be understood that, the above-mentioned modulation and demodulation processor may not be integrated into the processor 1110.

The embodiments of the present application further provide a readable storage medium, where a program or an instruction is stored on the readable storage medium, and when the program or instruction is executed by a processor, each process of the above-mentioned embodiment of the floating window management method is implemented, and can achieve The same technical effect, in order to avoid repetition, will not be repeated here.

Wherein, the processor is the processor in the electronic device described in the foregoing embodiments. The readable storage medium includes a computer-readable storage medium, such as a computer read-only memory (Read-Only Memory, ROM), a random access memory (Random Access Memory, RAM), a magnetic disk or an optical disk, and the like.

An embodiment of the present application further provides a chip, where the chip includes a processor and a communication interface, the communication interface is coupled to the processor, and the processor is used to run a program or an instruction to implement the above embodiment of the floating window management method and can achieve the same technical effect, in order to avoid repetition, it will not be repeated here.

It should be understood that the chip mentioned in the embodiments of the present application may also be referred to as a system-on-chip, a system-on-chip, a system-on-a-chip, or a system-on-a-chip, or the like.

It should be noted that, herein, the terms "comprising", "comprising" or any other variation thereof are intended to encompass non-exclusive inclusion, such that a process, method, article or device comprising a series of elements includes not only those elements, It also includes other elements not expressly listed or inherent to such a process, method, article or apparatus. Without further limitation, an element qualified by the phrase "comprising a..." does not preclude the presence of additional identical elements in a process, method, article or apparatus that includes the element. Furthermore, it should be noted that the scope of the methods and apparatus in the embodiments of the present application is not limited to performing the functions in the order shown or discussed, but may also include performing the functions in a substantially simultaneous manner or in the reverse order depending on the functions involved. To perform functions, for example, the described methods may be performed in an order different from that described, and various steps may also be added, omitted, or combined. Additionally, features described with reference to some examples may be combined in other examples.

From the description of the above embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus a necessary general hardware platform, and of course hardware can also be used, but in many cases the former is better implementation. Based on this understanding, the technical solution of the present application can be embodied in the form of a software product in essence or in a part that contributes to the prior art, and the computer software product is stored in a storage medium (such as ROM/RAM, magnetic disk, CD-ROM), including several instructions to make a terminal (which may be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) execute the methods described in the various embodiments of this application.

The embodiments of the present application have been described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific embodiments, which are merely illustrative rather than restrictive. Under the inspiration of this application, without departing from the scope of protection of the purpose of this application and the claims, many forms can be made, which all fall within the protection of this application.

Claims (12)

1. a suspension window management method, is characterized in that, comprises: receiving a first input from the user on the display screen of the electronic device; in response to the first input, determining a target area in the display screen; obtaining object information of the object displayed in the target area; According to the object information, a floating window corresponding to the target area is displayed; wherein, the floating window includes a menu item corresponding to the object. 2. The method according to claim 1, wherein the receiving the first input of the user on the display screen of the electronic device comprises: A first input from the user to an application program interface displayed on the display screen is received. 3. The method according to claim 2, wherein, according to the object information, displaying a floating window corresponding to the target area, comprising: According to the object information, determine the target operation of the user, and determine the target application related to the target operation from the electronic device; According to the target operation and the target application, a floating window corresponding to the target area is displayed. 4. The method according to claim 3, wherein the target operation of the user is determined according to the object information, and a target application program related to the target operation is determined from the electronic device, include: According to at least one of the type of the application program corresponding to the application program interface, the user portrait of the user, and the object information, the target operation is determined, and the target operation is determined from the electronic device the relevant target application. 5 . The method according to claim 3 , wherein the target area includes a plurality of objects; the displaying a floating window corresponding to the target area according to the target operation and the target application program, comprising: 6 . : determining a priority for each of the plurality of objects; According to the target operation, the target application, and the priority of each object, a floating window corresponding to the target area is displayed; wherein, the menu item corresponding to each object is selected according to each object. The priority of the object is displayed in order in the floating window; the priority of the object corresponding to the first menu item in the floating window is the highest priority among all priorities. 6. The method of claim 5, wherein the determining the priority of each of the plurality of objects comprises: according to the ratio of the area corresponding to each of the plurality of objects to the area of the target area, the color information of each of the plurality of objects, the corresponding weight of each of the plurality of objects, and At least one of the popularity information of each object in the plurality of objects determines the priority of each object in the plurality of objects. 7. The method according to claim 1, wherein the number of the target areas is N, and the N is an integer greater than 1; The displaying the floating window corresponding to the target area according to the object information includes: According to the object information of the objects in the N target areas, a floating window corresponding to the N target areas is displayed; or, According to the object information of the object in each of the N target areas, N floating windows are displayed; wherein, one target area in the N target areas corresponds to one floating window in the N floating windows, The floating windows corresponding to each of the N target areas are different. 8. A suspension window management device, characterized in that, comprising: a receiving module, configured to receive a user's first input on the display screen of the electronic device; a response module for determining a target area in the display screen in response to the first input; an acquisition module for acquiring the object information of the object displayed in the target area; A display module, configured to display a floating window corresponding to the target area according to the object information; wherein the floating window includes a menu item corresponding to the object. 9 . The device according to claim 8 , wherein the receiving module is specifically configured to receive a first input from the user to the application program interface displayed on the display screen. 10 . 10. The device according to claim 9, wherein the display module comprises: a determining unit, configured to determine a target operation of the user according to the object information, and determine a target application program related to the target operation from the electronic device; A display unit, configured to display a floating window corresponding to the target area according to the target operation and the target application. 11. An electronic device, characterized in that it comprises a processor, a memory, and a program or instruction stored on the memory and executable on the processor, and the program or instruction is implemented when executed by the processor The steps of the floating window management method according to any one of claims 1-7. 12. A readable storage medium, wherein a program or an instruction is stored on the readable storage medium, and when the program or instruction is executed by a processor, the floating window according to any one of claims 1-7 is realized The steps of the management method.

Images