CN115373818A - Application method, device and medium of floating window based on head-mounted device - Google Patents

Abstract

The application discloses a suspended window application method, a suspended window application device and a medium thereof based on a head-mounted device, relates to the technical field of the head-mounted device, and is used for providing a suspended window application method suitable for AR/VR products.

Description

Application method, device and medium of floating window based on head-mounted device

technical field

The present application relates to the technical field of head-mounted devices, in particular to a method, device and medium for applying a floating window based on a head-mounted device.

Background technique

With the development of head-mounted devices, especially augmented reality (Augmented Reality, AR)/virtual reality (Virtual Reality, VR) products, it has been able to support multiple applications at the same time, usually one application is displayed on the front, and the rest The application continues to run in the background as a background application, but the application running in the background will not be perceived by the user. The user cannot view or operate another application on the premise of opening a certain application, thereby affecting the user experience.

Therefore, those skilled in the art urgently need a method for applying a floating window based on a head-mounted device to solve the problem that current head-mounted device products cannot view or operate another application while opening a certain application.

Contents of the invention

The purpose of this application is to provide a method for applying a floating window based on a head-mounted device, a device and its medium, and to provide a method for applying a floating window suitable for a head-mounted device product.

In order to solve the above technical problems, this application provides a method for applying a floating window based on a head-mounted device, including:

Obtaining user instructions, and determining whether the user instructions are instructions in a preset instruction set; wherein, the preset instruction set includes: a floating window calling instruction and a floating window exit instruction;

When the user instructs to invoke an instruction for the floating window, the image to be displayed by the background application is displayed in the current window in the form of a floating window; wherein, the size and position of the floating window are the preset size and position;

When the user command is a suspension window exit command, close the suspension window.

Preferably, when there are multiple background applications, the preset instruction set further includes: application selection instructions;

Correspondingly, displaying the image to be displayed by the background application in the current window in the form of a floating window includes:

When the user instruction is an application selection instruction, determine the only target application in the background application according to the application selection instruction;

The image of the target application is displayed in the current window in the form of a floating window as the image to be displayed.

Preferably, the preset instruction set further includes: a permission selection instruction;

Correspondingly, displaying the image to be displayed by the background application in the current window in the form of a floating window includes:

When the user instruction is a permission selection instruction, according to the permission selection instruction, the image to be displayed by the background application is displayed in the current window in the form of a floating window corresponding to the permission; wherein, the permission includes: viewing permission and operation permission.

Preferably, the preset instruction set further includes: an application switching instruction;

Correspondingly, this method also includes:

When the user instruction is an application switching instruction, the image to be displayed by the background application is re-determined according to the application switching instruction, and displayed in the floating window.

Preferably, the preset instruction set further includes: a permission switching instruction;

Correspondingly, this method also includes:

When the user command is a permission switching command, switch the permission of the current floating window to another permission.

Preferably, the preset instruction set further includes: a floating window scaling instruction;

Correspondingly, this method also includes:

When the user command is a floating window scaling command, the size of the floating window is adjusted according to the floating window scaling command.

Preferably, obtaining user instructions includes:

The user instruction is obtained through the gesture recognition module, and correspondingly, the user instruction is a gesture instruction.

In order to solve the above technical problems, this application also provides a floating window application device based on a head-mounted device, including:

The instruction acquisition module is used to obtain user instructions and determine whether the user instructions are instructions in the preset instruction set; wherein, the preset instruction set includes: floating window calling instruction and floating window exit instruction;

The floating window calling module is used to display the image to be displayed in the background application in the current window in the form of a floating window when the user's instruction is a floating window calling instruction; wherein, the size and position of the floating window are preset sizes and location;

The floating window exit module is used to close the floating window when the user command is a floating window exit command.

Preferably, it also includes:

The application selection module is configured to determine the unique target application in the background application according to the application selection instruction when the user instruction is an application selection instruction.

The authority selection module is used to display the image to be displayed by the background application in the current window in the form of a floating window corresponding to the authority according to the authority selection instruction when the user instruction is an authority selection instruction; wherein, the authority includes: viewing authority and operation authority.

The application switching module is configured to re-determine the image to be displayed by the background application according to the application switching instruction when the user instruction is an application switching instruction, and display it in the floating window.

The authority switching module is used to switch the authority of the current floating window to another authority when the user instruction is an authority switching instruction.

The floating window scaling module is configured to adjust the size of the floating window according to the floating window scaling command when the user command is a floating window scaling command.

In order to solve the above technical problems, this application also provides a floating window application device based on a head-mounted device, including:

memory for storing computer programs;

The processor is configured to implement the steps of the above method for applying a floating window based on a head-mounted device when executing a computer program.

In order to solve the above-mentioned technical problems, the present application also provides a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the above-mentioned floating window application method based on a head-mounted device is realized. A step of.

The application method of a floating window based on a head-mounted device provided by this application determines the operation behavior corresponding to different user instructions according to the preset instruction set, so that when the head-mounted device product collects the user's instructions through the built-in instruction collection module , and when the user command calls out the command for the floating window, the background application is displayed in the current window in the form of a floating window, and the size of the floating window is smaller than the size of the current window, so that while keeping the current application open, other To view or operate an application, a floating window application method suitable for head-mounted device products is provided, which further improves the user's operating experience of using the head-mounted device product.

The head-mounted device-based floating window application device and the computer-readable storage medium provided by the present application correspond to the above method, and the effect is the same as above.

Description of drawings

In order to illustrate the embodiments of the present application more clearly, the following will briefly introduce the accompanying drawings used in the embodiments. Obviously, the accompanying drawings in the following description are only some embodiments of the present application. As far as people are concerned, other drawings can also be obtained based on these drawings on the premise of not paying creative work.

FIG. 1 is a flow chart of a method for applying a floating window based on a head-mounted device provided by the present invention;

FIG. 2 is a flowchart of an AR device projecting a real scene provided by the present invention;

Fig. 3 is a structural diagram of a floating window application device based on a head-mounted device provided by the present invention;

FIG. 4 is a structural diagram of another head-mounted device-based floating window application device provided by the present invention.

Detailed ways

The following will clearly and completely describe the technical solutions in the embodiments of the present application with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are only some of the embodiments of the present application, not all of them. Based on the embodiments in this application, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of this application.

The core of the present application is to provide a method, device and medium for applying a floating window based on a head-mounted device.

In order to enable those skilled in the art to better understand the solution of the present application, the present application will be further described in detail below in conjunction with the drawings and specific implementation methods.

At present, head-mounted devices represented by AR/VR are developing rapidly, and both hardware and software have been greatly improved. However, compared with mobile terminals such as mobile phones, personal computers (PC), and tablets, Said, there are still some deficiencies. In some application scenarios, such as viewing the file download process and hovering lyrics prompts, etc., the user needs to focus on another application while operating one application, the suspension function is particularly important.

For existing AR/VR devices, there is no floating window application. If you want to forcibly realize it, you can only transplant the operating systems on mobile terminals such as mobile phones and PCs to VR/AR devices in the form of software plug-ins. The previous system operates the floating window for the application of the AR/VR device itself. This method is extremely inconvenient, and at the same time, it will occupy a large amount of operating resources of hardware devices such as the processor of the AR/VR device, affecting the performance of the device. It also increases the cost.

Based on the above reasons, as shown in Figure 1, the present application provides a method for applying a floating window based on a head-mounted device, including:

S11: Obtain a user instruction, and determine whether the user instruction is an instruction in a preset instruction set.

Wherein, the preset instruction set includes: a floating window calling instruction and a floating window exit instruction. But in fact, the instructions contained in the above-mentioned preset instruction set are only one possible implementation mode. Among them, the preset instruction set may also include: an application selection instruction for selecting a specific background application floating window, a permission selection instruction for determining the permission of the floating window, and an application for switching the application displayed in the current floating window. A switching instruction, a permission switching instruction for switching the permission of the current floating window, and a floating window zooming instruction for adjusting the size of the floating window, etc.

The method of obtaining user instructions can be determined according to the information collection module configured in the AR/VR device. Generally speaking, due to the characteristics of the AR/VR device, a gesture recognition module will be configured to collect user gestures. Specifically, the gesture recognition module may be an image recognition module, which collects the user's action image information, performs image recognition and analyzes the user's gestures, and corresponds to different user instructions to perform corresponding operations on the AR/VR device; the information collection module It can also be a voice recognition module, which collects the user's voice information to achieve corresponding manipulation; in addition, the information collection module can also be an ultrasonic detection module, which determines the user's gesture by detecting the position change of the user's hand or other parts, and then corresponds to Based on different user instructions, complete the operation of the AR/VR device. This application is not limited to the specific way of collecting user instructions, but provides a preferred implementation solution, obtaining user instructions includes:

Obtain user instructions through the gesture recognition module.

Correspondingly, the user instruction is a gesture instruction.

In this embodiment, the most commonly configured gesture recognition module in AR/VR equipment realizes the collection of user instructions without requiring additional hardware devices, and adapts to the characteristics of AR/VR equipment, further improving user experience.

S12: When the user's instruction is to invoke an instruction for the floating window, display the image to be displayed by the background application in the current window in the form of a floating window.

Wherein, the size and position of the floating window are preset size and position. For the floating window, it can be displayed in the current window with a preset size, and the preset size is smaller than the size of the current window. The size of the floating window may also be adjusted according to subsequent user instructions. As for the display position of the floating window, generally speaking, it is set above or below the current display area.

However, in some specific application scenarios, the floating window can also be superimposed on the real scene. At this time, the position and size of the floating window are determined by the actual environment. More specifically, for example, the floating window can be set in the non-occluded area of the real object, that is, the area that the user can see intuitively and without hindrance. Or, the position of the floating window can be adjusted according to the user's gaze area, and the user's gaze area can be realized by an eye tracker and other devices installed in the AR/VR device, and the eye tracker and other eye tracking devices track the user's eye movement trajectory, In this way, the user's current gaze area is determined, and the floating window is projected into the gaze area, so that the user can intuitively see the content and information displayed on the floating window.

In addition, if there are other windows in the user's current gaze area, the size and position of the floating window can be adjusted according to the pre-configuration, for example, the size of the floating window is smaller than the entire gaze area of the current user, and the position is in the upper part of the current gaze area area, or the lower part of the area. Furthermore, if there are other windows in the gaze area, and the window does not cover the complete gaze area, the floating window can be displayed in a position that cannot be covered by other windows in the gaze area, so as to satisfy the user's intuitive and convenient View the content displayed in the floating window without affecting the user's other visual perception.

In addition, for AR devices, if the floating window of the AR device displays the real scene (that is, the real scene information is collected and then projected through devices such as optical machines), and the real scene has backup data in the cloud, you can directly By downloading cloud data to project the content of the floating window, the delay can be effectively reduced. This kind of real scene has backup data on the cloud. Specifically, it may be that the real scene information projected this time has not changed compared with the previous collection, or it may be that multiple devices are projecting the same scene. At this time, only One device collects the real scene information on site, and then uploads it to the cloud. Other devices do not need to collect it themselves, and can realize the projection of the real scene through the data in the cloud. A specific application scenario is shown in FIG. 2 , including: an AR device 21 , a cloud server 22 , a user 23 and a real scene 24 .

S13: When the user instruction is an instruction to exit the floating window, close the floating window.

This application provides a floating window application method based on a head-mounted device. Through the preset instruction set, the collected user instructions are compared, so that the background application is displayed in the current window in the form of a floating window, and the floating window is realized. Call out, and close the current floating window under the corresponding user instruction, which is implemented in the AR/VR device. When the current application is opened, other applications can also be viewed or operated, further improving the user experience.

It can be known from the above that the preset instruction set may also include other instructions to better realize the application of the hovering function. Therefore, this embodiment provides a preferred implementation solution, and the preset instruction set further includes: applying a selected instruction;

Correspondingly, displaying the image to be displayed by the background application in the current window in the form of a floating window includes:

When the user instruction is an application selection instruction, determine the only target application in the background application according to the application selection instruction;

The image of the target application is displayed in the current window in the form of a floating window as the image to be displayed.

It is easy to understand that in the actual use of AR/VR devices, the background application is not necessarily unique, so when it is necessary to call out the floating window of the background application, it is necessary to select one or several background applications, because selecting a background application The principle is the same as selecting multiple background applications. The following uses selecting a background application as an example to illustrate:

A possible implementation manner is: the application selection command includes multiple sub-commands, each sub-command corresponds to a different background application, and when it is determined that the current user command is a certain sub-command, the corresponding background application floating window is invoked.

The advantage of this embodiment is that few user commands are required to call out the floating window, and only one corresponding sub-command needs to be detected to call out the corresponding background application floating window.

Another possible implementation manner is that: the application selection instruction includes at least one sub-instruction for switching the selected target, and a sub-instruction for determining that the currently selected target is the target application.

When there is only one sub-command for switching the selected target, the background applications should be arranged according to the preset order (it can be the order in which the applications were opened, or the order in which the most recent applications were opened), and then when the user command is the above When the sub-command used to switch the selected target, switch the next background application as the selected target according to the order, until after switching to the expected background application, it can be selected by inputting a sub-command to confirm that the currently selected target is the target application, In order to call out the subsequent floating window.

The advantage of this implementation is that the number of instructions for the corresponding selected target application is not limited by the number of background applications, and the sub-instruction for switching the selected target and the instruction for determining the currently selected target as the target application can be simply used. Subcommands select any number of background applications.

In an actual application, an appropriate application selection implementation may be selected according to the number of background applications, which is not limited in this embodiment. Through the above-mentioned application selection instruction, when there are multiple background applications, the floating window of the target background application can still be accurately called out to view or operate it, further improving the user experience.

Similarly, this embodiment also provides a preferred implementation solution, the preset instruction set also includes: permission selection instruction;

Correspondingly, displaying the image to be displayed by the background application in the current window in the form of a floating window includes:

When the user instruction is a permission selection instruction, according to the permission selection instruction, the image to be displayed by the background application is displayed in the current window in the form of a floating window corresponding to the permission; wherein, the permission includes: viewing permission and operation permission.

View permission refers to the normal display content of the current floating window. The user can view the status of the corresponding application through the floating window, but cannot operate it, that is, the application that invokes the floating window does not respond to the user's operation instructions.

Operation authority refers to the normal display content of the current floating window, and corresponding to the user's operation instructions, the user can not only view the application status through the floating window, but also perform corresponding operations on the application through the operation instructions.

From the above, it can be seen that the permissions of the floating window can be divided into viewing permissions and operating permissions, so a preferred embodiment is that the permission selection command includes two sub-commands, which respectively represent viewing permissions and operating permissions. When the user's operation command is the corresponding permission When subcommand, grant the corresponding permission to the current floating window.

A preferred solution provided by this embodiment realizes the control of the floating window permission through the permission selection instruction in the preset instruction set, so that the user can select the appropriate operation permission when calling the floating window, for example, when the user is playing a game When playing, you usually don’t want to be disturbed by other applications. If the user misuses the floating window during operation, it will greatly affect the user’s experience. Therefore, in this application scenario, a floating window should be set. The permission of is the viewing permission, the user can only view the image displayed in the floating window, but cannot operate it. Based on the same principle, in scenarios such as reading and watching movies, the permission of the floating window can be the operation permission, in addition to being able to view the images displayed on the floating window, it can also be operated. The preferred solution provided by this embodiment makes the function of the floating window better adapt to the individual needs of the user through the selection of the permission of the floating window, and further improves the experience of using the AR/VR device.

Similarly, it can be seen from the above that although the above embodiment provides a method for selecting background applications when calling out the floating window, it is a method during the calling out process of the floating window. When the floating window has been called out, the user There is still a need to switch the background application displayed in the current floating window. Therefore, in order to solve the above problem, this embodiment also provides a preferred implementation solution, the preset instruction set further includes: an application switching instruction;

Correspondingly, this method also includes:

When the user instruction is an application switching instruction, the image to be displayed by the background application is re-determined according to the application switching instruction, and displayed in the floating window.

It is easy to understand that the application switching command is essentially the same as the application selection command, which is used to select the desired target application from many background applications. The difference is that the application selection command is used in the process of calling out the floating window , and the application switching command is used when the floating window has been called out, so when the application switching command selects the target application, there may also be two possible implementations of the above application selection command: application switching command There are multiple sub-instructions one-to-one corresponding to background applications, and the application switching instruction has at least one sub-instruction for switching the selected target and one sub-instruction for determining the currently selected target as the target application. Specific implementation manners have been described in the foregoing embodiments, and details are not described in this embodiment here.

A preferred implementation solution provided in this embodiment provides a method for switching applications displayed in the floating window when the floating window is called out. The required background application is displayed in the floating window, and there is no need to close the current floating window and reopen the floating window of the required background application, which simplifies the user operation.

Similarly, when the floating window is called out, the user's requirements for the permission of the floating window may also change. For example, the floating window called out when the user is playing a game usually requires the permission to view, but after the user quits the game, it may be It will read or play music. At this time, there is a need for the user to operate the floating window, which requires the permission switch of the floating window. Therefore, this embodiment provides another preferred implementation solution, and the preset instruction set further includes: a permission switching instruction;

Correspondingly, this method also includes:

When the user command is a permission switching command, switch the permission of the current floating window to another permission.

After the floating window is called out, if the user command is a permission switching command, if the current permission of the floating window is the viewing permission, switch to the operation permission; if the current floating window permission is the operation permission, switch to the viewing permission.

The preferred solution provided by this embodiment realizes the permission switching after the floating window is called out, which makes the user's operation of the floating window more flexible. When the permission of the floating window needs to be switched, there is no need to close the floating window and reopen it, which simplifies The operation process has optimized the experience of using the suspension function.

In addition, different users have different requirements for the size of the floating window of different applications at different times, so this embodiment also provides another preferred implementation solution, and the preset instruction set also includes: a floating window scaling instruction;

Correspondingly, this method also includes:

When the user command is a floating window scaling command, the size of the floating window is adjusted according to the floating window scaling command.

It is easy to understand that when the floating window is invoked, it is displayed in the current window with a preset size, and the floating window can be subsequently scaled according to the floating window switching instruction. For example, in a possible implementation, the user selects a certain window (the VR device can be controlled by the handle to place the cursor on the corresponding window, and the AR device can place the finger on the projected image at the position of the corresponding window. ), place your finger or cursor on the edge of the floating window and drag, the size of the floating window will increase or decrease accordingly, so as to realize the zooming of the floating window.

It should be noted that the application switching command, permission switching command, and floating window zooming command are applied when the floating window has been invoked, and the specific steps should be implemented after the floating window invoke command and before the floating window exit command There is no sequence between them, and they are triggered according to user instructions.

Similarly, for the application selection command and permission selection command, it is carried out in the process of calling out the floating window, and the implementation steps are included in the process of calling out the floating window, so the receiving of the command should be done in the floating window After the command is issued, there is no sequence restriction between the application selection command and the permission selection command.

This embodiment provides a method for adjusting the size of the floating window after being called out, which further improves the flexibility of the floating window function based on the AR/VR device and further improves the user experience.

In the foregoing embodiments, a method for applying a floating window based on a head-mounted device is described in detail, and the present application also provides a corresponding embodiment of a device for applying a floating window based on a head-mounted device. It should be noted that this application describes the embodiments of the device part from two perspectives, one is based on the perspective of functional modules, and the other is based on the perspective of hardware.

Based on the perspective of functional modules, as shown in Figure 3, this embodiment provides a floating window application device based on a head-mounted device, including:

The instruction obtaining module 31 is used to obtain user instructions, and determine whether the user instructions are instructions in a preset instruction set; wherein, the preset instruction set includes: a floating window calling instruction and a floating window exit instruction;

The floating window calling module 32 is used to display the image to be displayed in the background application in the current window in the form of a floating window when the user instruction is a floating window calling instruction; wherein, the size and position of the floating window are preset size and location;

The floating window exit module 33 is configured to close the floating window when the user instruction is a floating window exit instruction.

Preferably, it also includes:

The application selection module is configured to determine the unique target application in the background application according to the application selection instruction when the user instruction is an application selection instruction.

The authority selection module is used to display the image to be displayed by the background application in the current window in the form of a floating window corresponding to the authority according to the authority selection instruction when the user instruction is an authority selection instruction; wherein, the authority includes: viewing authority and operation authority.

The application switching module is configured to re-determine the image to be displayed by the background application according to the application switching instruction when the user instruction is an application switching instruction, and display it in the floating window.

The authority switching module is used to switch the authority of the current floating window to another authority when the user instruction is an authority switching instruction.

The floating window scaling module is configured to adjust the size of the floating window according to the floating window scaling command when the user command is a floating window scaling command.

Since the embodiment of the device part corresponds to the embodiment of the method part, please refer to the description of the embodiment of the method part for the embodiment of the device part, and details will not be repeated here.

This embodiment provides a floating window application device based on a head-mounted device, which acquires user instructions through an instruction acquisition module, compares the collected user instructions according to a preset instruction set, and calls the background application through the floating window module. It is displayed in the current window in the form of a floating window, and the floating window is called out, and under the corresponding user instruction, the current floating window is closed through the floating window exit module, which is implemented in the AR/VR device. When the current application is opened Under this mode, other applications can also be viewed or operated, further improving the user experience.

FIG. 4 is a structural diagram of a head-mounted device-based floating window application device provided by another embodiment of the present application. As shown in FIG. 4 , a head-mounted device-based floating window application device includes: a memory 40, for storing computer programs;

The processor 41 is configured to implement the steps of a method for applying a floating window based on a head-mounted device as in the above-mentioned embodiment when executing a computer program.

A floating window application device based on a head-mounted device provided in this embodiment may include but not limited to a VR helmet, an AR interactive platform, a smart phone, a tablet computer, a notebook computer or a desktop computer, and the like.

Wherein, the processor 41 may include one or more processing cores, such as a 4-core processor, an 8-core processor, and the like. Processor 41 can adopt at least one hardware form in Digital Signal Processor (Digital Signal Processor, DSP), Field-Programmable Gate Array (Field-Programmable Gate Array, FPGA), Programmable Logic Array (Programmable LogicArray, PLA) accomplish. The processor 41 may also include a main processor and a coprocessor, the main processor is a processor for processing data in the wake-up state, and is also called a central processing unit (Central Processing Unit, CPU); Low-power processor for processing data in standby state. In some embodiments, the processor 41 may be integrated with a graphics processor (Graphics Processing Unit, GPU), and the GPU is used for rendering and drawing the content that needs to be displayed on the display screen. In some embodiments, the processor 41 may also include an artificial intelligence (Artificial Intelligence, AI) processor, and the AI processor is used to process computing operations related to machine learning.

Memory 40 may include one or more computer-readable storage media, which may be non-transitory. The memory 40 may also include high-speed random access memory, and non-volatile memory, such as one or more magnetic disk storage devices, flash memory storage devices. In this embodiment, the memory 40 is at least used to store the following computer program 401, wherein, after the computer program is loaded and executed by the processor 41, a floating window application based on a head-mounted device disclosed in any of the above-mentioned embodiments can be realized relevant steps of the method. In addition, the resources stored in the memory 40 may also include an operating system 402 and data 403, etc., and the storage method may be temporary storage or permanent storage. Wherein, the operating system 402 may include Windows, Unix, Linux and so on. The data 403 may include, but is not limited to, a method for applying a floating window based on a head-mounted device, and the like.

In some embodiments, a floating window application device based on a head-mounted device may further include a display screen 42 , an input/output interface 43 , a communication interface 44 , a power supply 45 and a communication bus 46 .

Those skilled in the art can understand that the structure shown in FIG. 4 does not constitute a limitation to a head-mounted device-based floating window application device, and may include more or less components than those shown in the illustration.

A floating window application device based on a head-mounted device provided in an embodiment of the present application includes a memory and a processor. When the processor executes a program stored in the memory, the following method can be implemented: A floating window based on a head-mounted device application method.

This embodiment provides a floating window application device based on a head-mounted device. A processor executes a computer program stored therein to obtain user instructions, and compares the collected user instructions according to a preset instruction set to obtain Determine the operation to be performed; when the user command is a floating window call command, display the background application in the current window in the form of a floating window to realize the call of the floating window; when the user command is a floating window exit command, close the current window Floating window: implemented in AR/VR devices, when the current application is opened, other applications can also be viewed or operated, further improving the user experience.

Finally, the present application also provides an embodiment corresponding to a computer-readable storage medium. A computer program is stored on a computer-readable storage medium, and when the computer program is executed by a processor, the steps described in the foregoing method embodiments are implemented.

It can be understood that if the methods in the above embodiments are implemented in the form of software function units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application is essentially or part of the contribution to the prior art or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium , executing all or part of the steps of the methods described in the various embodiments of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (Read-Only Memory, ROM), random access memory (Random Access Memory, RAM), magnetic disk or optical disk and other various media that can store program codes. .

This embodiment provides a computer-readable storage medium. When the computer program stored therein is executed, user instructions can be obtained, and the user instructions are compared to which instructions in the preset instruction set; It is used to display the background application in the current window in the form of a floating window to realize the calling of the floating window; the floating window exit command is used to close the current floating window; this is implemented in the AR/VR device, when the current application is opened In this case, other applications can also be viewed or operated, thereby further improving the user experience.

The method, device and medium for applying a floating window based on a head-mounted device provided in this application have been introduced in detail above. Each embodiment in the description is described in a progressive manner, each embodiment focuses on the difference from other embodiments, and the same and similar parts of each embodiment can be referred to each other. As for the device disclosed in the embodiment, since it corresponds to the method disclosed in the embodiment, the description is relatively simple, and for the related information, please refer to the description of the method part. It should be pointed out that those skilled in the art can make some improvements and modifications to the application without departing from the principles of the application, and these improvements and modifications also fall within the protection scope of the claims of the application.

It should also be noted that in this specification, relative terms such as first and second are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply that these entities or operations There is no such actual relationship or order between the operations. Furthermore, the term "comprises", "comprises" or any other variation thereof is intended to cover a non-exclusive inclusion such that a process, method, article, or apparatus comprising a set of elements includes not only those elements, but also includes elements not expressly listed. other elements of or also include elements inherent in such a process, method, article, or device. Without further limitations, an element defined by the phrase "comprising a ..." does not exclude the presence of additional identical elements in the process, method, article or apparatus comprising said element.

Claims (10)

1. A method for applying a floating window based on a head-mounted device, comprising: Obtaining user instructions, and determining whether the user instructions are instructions in a preset instruction set; wherein, the preset instruction set includes: a floating window calling instruction and a floating window exit instruction; When the user instruction calls out an instruction for the floating window, the image to be displayed by the background application is displayed in the current window in the form of a floating window; wherein, the size and position of the floating window are preset size and position ; When the user instruction is an instruction to exit the floating window, close the floating window. 2. The method for applying a floating window based on a head-mounted device according to claim 1, wherein when there are multiple background applications, the preset instruction set further includes: an application selection instruction; Correspondingly, the displaying the image to be displayed by the background application in the current window in the form of a floating window includes: When the user instruction is the application selection instruction, determine the only target application among the background applications according to the application selection instruction; The image of the target application is displayed in the current window in the form of a floating window as the image to be displayed. 3. The application method of a floating window based on a head-mounted device according to claim 1, wherein the preset instruction set further includes: an authority selection instruction; Correspondingly, the displaying the image to be displayed by the background application in the current window in the form of a floating window includes: When the user instruction is the permission selection instruction, according to the permission selection instruction, the image to be displayed by the background application is displayed in the current window in the form of a floating window corresponding to the permission; wherein the permission includes: viewing permission and operation authority. 4. The method for applying a floating window based on a head-mounted device according to claim 1, wherein the preset instruction set further includes: an application switching instruction; Correspondingly, this method also includes: When the user instruction is the application switching instruction, the image to be displayed by the background application is re-determined according to the application switching instruction, and displayed in the floating window. 5. The method for applying a floating window based on a head-mounted device according to claim 1, wherein the preset instruction set further includes: an authority switching instruction; Correspondingly, this method also includes: When the user instruction is the authority switching instruction, switch the authority of the current floating window to another authority. 6. The method for applying a floating window based on a head-mounted device according to claim 1, wherein the preset instruction set further includes: a floating window scaling instruction; Correspondingly, this method also includes: When the user instruction is the floating window zooming instruction, the size of the floating window is adjusted according to the floating window zooming instruction. 7. The method for applying a floating window based on a head-mounted device according to any one of claims 1 to 6, wherein said obtaining user instructions comprises: The user instruction is acquired through a gesture recognition module, and correspondingly, the user instruction is a gesture instruction. 8. A floating window application device based on a head-mounted device, characterized in that it comprises: An instruction acquiring module, configured to acquire user instructions, and determine whether the user instructions are instructions in a preset instruction set; wherein, the preset instruction set includes: a floating window calling instruction and a floating window exit instruction; A floating window calling module, configured to display the image to be displayed in the background application in the current window in the form of a floating window when the user instruction is the floating window calling instruction; wherein, the size of the floating window and The position is the preset size and position; A floating window exit module, configured to close the floating window when the user instruction is the floating window exit instruction. 9. A floating window application device based on a head-mounted device, characterized in that it includes: memory for storing computer programs; The processor is configured to implement the steps of the head-mounted device-based floating window application method according to any one of claims 1 to 7 when executing the computer program. 10. A computer-readable storage medium, characterized in that, a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the method based on any one of claims 1 to 7 is implemented. Steps of a method for applying a suspension window of a head-mounted device.

Images