CN118193092A - Display method and electronic equipment - Google Patents

Abstract

The embodiment of the application provides a display method and electronic equipment, wherein the display method is applied to the electronic equipment and comprises the following steps: displaying a first interface, wherein the first interface comprises a first window and a second window, and the first window is a window allowing information to be inserted; receiving a first user input of a user to a first window; according to the first user input, executing a first operation on the second window; information corresponding to the execution result of the first operation is inserted into the first window. According to the display method and the electronic device provided by the embodiment of the application, when a user needs to share or record information or content of other windows through one of the windows in a multi-window mode, the convenience of operation and the experience of the user are improved.

Description

Display method and electronic device

Technical Field

The embodiments of the present application relate to the field of terminal devices, and more specifically, to a display method and an electronic device.

Background technique

With the development of electronic communication technology, the functions and applications of electronic devices are becoming increasingly rich and user-friendly. In order to meet the personalized needs of users, more and more electronic devices support multi-window mode, that is, displaying and running multiple applications on one display screen.

In some cases, users may need to obtain the content of the application interface or information related to the interface content and further share or record it. For example, they can obtain the information or content of the application interface through functions such as screenshot, screen recording, or screen recognition, save it locally, or share it with other users. However, existing functions such as screenshot, screen recording, or screen recognition are all for the entire screen, and the operation process is cumbersome, which reduces the user experience.

Summary of the invention

The embodiments of the present application provide a display method and an electronic device, which can improve the convenience of operation and the user experience when a user needs to share or record information or content of other windows through one window in a multi-window mode.

In a first aspect, a display method is provided, which is applied to an electronic device, the method comprising: displaying a first interface, the first interface comprising a first window and a second window, the first window being a window allowing information insertion; receiving a first user input to the first window; performing a first operation on the second window according to the first user input; and inserting information corresponding to the execution result of the first operation into the first window.

In this embodiment, the first interface displayed by the electronic device includes a first window and a second window. When the user performs a first user input on the first window, the electronic device can determine that the target window of the first user input is the second window, and perform a first operation on the second window, and then insert information corresponding to the execution result of the first operation into the first window. The information corresponding to the execution result of the first operation can be text, a link or a file. Since the information corresponding to the execution result of the first operation is directly inserted into the window, the steps of user operation are reduced and the convenience is improved.

In some embodiments, the first window may include an input box. When the information corresponding to the execution result of the first operation is text or a link, the text or link can be directly inserted into the input box; when the information corresponding to the execution result of the first operation is a file, the icon of the file can be inserted into the input box, or the icon of the file can also be displayed on the interface.

In other embodiments, the first window may not include an input box, but the window may allow files to be inserted. Schematically, the window may be a window of a file compression application, and the user can generally drag the file or select the file from the file library to place the file in the area to be compressed and compress it. For the split-screen scenario of the embodiment of the present application, after the user performs the first operation, the electronic device can directly determine the target window of the first operation as the second window, and insert the file corresponding to the execution result of the first operation into the area to be compressed, and the user can directly click to compress it later.

In addition to the application in the first window being a file compression application, the first window can also be an email application. For example, the first window displays the main interface of the email application. There may be no input box on the main interface, but the user can trigger the opening of a new email editing interface by dragging to various functional areas of the main interface, such as dragging to the inbox, and directly insert the file into the new email editing window. For the split-screen scenario of the embodiment of the present application, when the user performs the first operation, the email application can open the new email editing interface by default, and directly insert the file corresponding to the execution result of the first operation into the new email editing interface in the first window.

It should be understood that the application of the first window may also be other applications that allow information insertion, which will not be described in detail here.

Exemplarily, the first user input may be a click input on a control or a gesture input on the interface of the first window, and the first operation may be a screenshot operation, a screen recording operation, or a screen recognition operation. After receiving the user's input, the electronic device may directly insert the screenshot image file, the screen recording video file, or the screen-recognized text, link, or file into the first window to facilitate the user's recording or subsequent sharing. In addition, since the first operation is directly targeted at the second window required by the user, other editing actions of the user (such as cropping of the screenshot image, etc.) are reduced, thereby improving the user experience. In combination with the first aspect, in some implementations of the first aspect, the first operation is any one or more of a screenshot operation, a screen recording operation, a screen recognition operation, or a sound recognition operation; when the first operation is a screenshot operation, the information corresponding to the execution result of the first operation is a picture file obtained according to the screenshot operation; or, when the first operation is a screen recording operation, the information corresponding to the execution result of the first operation is a video file obtained according to the screen recording operation; or, when the first operation is a screen recognition operation, the information corresponding to the execution result of the first operation is at least one of text or links obtained according to the screen recognition operation, and the screen recognition operation includes text recognition or object recognition; or, when the first operation is the sound recognition operation, the information corresponding to the execution result of the first operation is at least one of music files or text information obtained according to the sound recognition operation.

When the first operation is a music recognition operation on the second window, the information corresponding to the execution result of the first operation may also be a link to the music.

In combination with the first aspect, in some implementations of the first aspect, the first window includes a first control, and the first user input is a click operation on the first control.

In this embodiment, the first control is set on the application interface of the first window. When the user clicks the control, the application of the first window or the operating system of the electronic device can determine that the target window for the user to click the control to operate is the second window. For example, the application of the first window can determine the coordinates of the target window of the first operation according to the coordinates of the first window, and transmit the coordinates to the operating system of the electronic device. The corresponding module of the operating system can perform the first operation on the second window according to the coordinates, and directly insert the information corresponding to the execution result of the first operation into the first window or the input box of the first window, thereby improving the user experience. Alternatively, the operating system of the electronic device can determine the position or coordinates of the second window according to the position or coordinates of the first window, and perform the first operation on the second window; the operating system of the electronic device can also directly determine the position or coordinates of the second window according to the relevant information of window management.

In combination with the first aspect, in some implementations of the first aspect, the first user input is a gesture input on an interface of the first window.

Optionally, the first user input may also be a shortcut key, a drop-down box, etc. corresponding to the first operation on the electronic device. The present application does not limit the form of the first user input corresponding to the first operation.

In combination with the first aspect, in some implementations of the first aspect, the first interface includes only two windows, and the first window and the second window are two windows of a split-screen interface of the electronic device.

In combination with the first aspect, in certain implementations of the first aspect, before performing the first operation on the second window, the method also includes: determining the position of the second window based on the position of the first window; wherein performing the first operation on the second window includes: performing the first operation on the second window based on the position of the second window.

In this embodiment, when the first interface includes two windows, the coordinates of the other window can be determined according to the coordinates of one of the windows. The operation of determining the position of the second window can be performed by the application of the first window or the operating system of the electronic device, so that the application of the first window can transmit the position or coordinates of the second window to the operating system of the electronic device, and then the operating system performs the first operation on the second window.

In combination with the first aspect, in certain implementations of the first aspect, the first interface also includes a third window, and before performing the first operation on the second window, the method also includes: prompting the user to determine the target window of the first operation; receiving a second user input from the user, the second user input being used to determine that the target window is the second window.

In this embodiment, when the first interface displayed by the electronic device includes more than two windows, the electronic device can prompt the user to determine the target window of the first operation after the user performs the first user input, and the user can perform the second user input to determine that the target window of the first operation is the second window. Therefore, the technical solution of the embodiment of the present application can be applied in a multi-window scenario and has a wide range of applications.

In combination with the first aspect, in some implementations of the first aspect, the application corresponding to the first window is a note application or a memo application.

In this embodiment, the application of the first window is a note application or a memo application. The application of the first window can also be a document application, a chat application, etc., so that when the user uses this type of application, he can conveniently record or share information of other windows in the application, such as screenshots and videos of other windows, thereby improving the speed of recording and the user experience.

In combination with the first aspect, in some implementations of the first aspect, the application corresponding to the second window is a video application or a document application.

In a second aspect, an electronic device is provided, comprising: a display unit, used to display a first interface, the first interface comprising a first window and a second window, the first window being a window allowing information insertion; a processing unit, used to: receive a first user input to the first window; perform a first operation on the second window according to the first user input; and insert information corresponding to the execution result of the first operation into the first window.

In combination with the second aspect, in some implementations of the second aspect, the first operation is any one or more of a screenshot operation, a screen recording operation, a screen recognition operation, or a sound recognition operation; when the first operation is a screenshot operation, the information corresponding to the execution result of the first operation is a picture file obtained according to the screenshot operation; or, when the first operation is a screen recording operation, the information corresponding to the execution result of the first operation is a video file obtained according to the screen recording operation; or, when the first operation is a screen recognition operation, the information corresponding to the execution result of the first operation is at least one of text or links obtained according to the screen recognition operation, and the screen recognition operation includes text recognition or object recognition; or, when the first operation is the sound recognition operation, the information corresponding to the execution result of the first operation is at least one of a music file or text information obtained according to the sound.

In combination with the second aspect, in some implementations of the second aspect, the first window includes a first control, and the first user input is a click operation on the first control.

In combination with the second aspect, in some implementations of the second aspect, the first user input is a gesture input on the interface of the first window.

In combination with the second aspect, in some implementations of the second aspect, the first interface includes only two windows, and the first window and the second window are two windows of a split-screen interface of the electronic device.

In combination with the second aspect, in some implementations of the second aspect, the processing unit is further used to: determine the position of the second window based on the position of the first window; the processing unit is specifically used to: perform the first operation on the second window based on the position of the second window.

In combination with the second aspect, in certain implementations of the second aspect, the first interface also includes a third window, and the processing unit is further used to: prompt the user to determine the target window of the first operation; receive the user's second user input, and the second user input is used to determine that the target window is the second window.

In combination with the second aspect, in some implementations of the second aspect, the application corresponding to the first window is a note application or a memo application.

In combination with the second aspect, in some implementations of the second aspect, the application corresponding to the second window is a video application or a document application.

According to a third aspect, a computer storage medium is provided. When the computer instructions are executed on an electronic device, the electronic device executes the method according to the first aspect or any one of the implementations of the first aspect.

In a fourth aspect, an electronic device is provided, comprising: a memory for storing computer instructions; and a processor for executing the computer instructions stored in the memory, so that the electronic device executes the method described in the first aspect or any one of the implementations of the first aspect.

In a fifth aspect, a chip system is provided, characterized in that it comprises at least one processor, and when program instructions are executed in the at least one processor, the at least one processor executes the method described in the first aspect or any one implementation of the first aspect.

In a sixth aspect, a chip is provided, comprising a processor and a data interface, wherein the processor reads instructions stored in a memory through the data interface to execute the method described in the first aspect and any possible implementation of the first aspect.

Optionally, as an implementation, the chip may further include a memory, wherein the memory stores instructions.

The processor is used to execute instructions stored in the memory. When the instructions are executed, the processor is used to execute the method described in the first aspect and any possible implementation manner of the first aspect.

The above chip may specifically be a field programmable gate array or a dedicated integrated circuit.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG1 is a schematic diagram of the hardware structure of an electronic device to which an embodiment of the present application is applicable.

FIG. 2 is a schematic diagram of the software structure of an electronic device to which an embodiment of the present application is applicable.

FIG3 shows a schematic interface diagram of a user recording video window content through a note application in a multi-window scenario.

FIG. 4 shows a schematic flow chart of a display method provided in an embodiment of the present application.

FIG5 shows a schematic diagram of a multi-window scenario provided in an embodiment of the present application.

FIG6 shows a schematic diagram of a user interface of a display method provided in an embodiment of the present application.

FIG. 7 shows a schematic diagram of another user interface of the display method provided in an embodiment of the present application.

FIG. 8 shows a schematic diagram of window coordinates of an electronic device provided in an embodiment of the present application.

FIG. 9 shows a schematic diagram of a user interface of a display method provided in an embodiment of the present application.

FIG. 10 shows a schematic diagram of another user interface of the display method provided in an embodiment of the present application.

FIG. 11 shows a schematic diagram of another user interface of the display method provided in an embodiment of the present application.

FIG. 12 shows a schematic block diagram of an electronic device provided in an embodiment of the present application.

FIG. 13 shows a schematic block diagram of another electronic device provided in an embodiment of the present application.

Detailed ways

The technical solutions in the embodiments of the present application will be described below in conjunction with the accompanying drawings.

The terms used in the following embodiments are only for the purpose of describing specific embodiments, and are not intended to be used as limitations on the present application. As used in the specification and the appended claims of the present application, the singular expressions "one", "a kind of", "said", "above", "the" and "this" are intended to also include expressions such as "one or more", unless there is a clear contrary indication in the context. It should also be understood that in the following embodiments of the present application, "at least one", "one or more" refer to one, two or more. The term "and/or" is used to describe the association relationship of associated objects, indicating that three relationships may exist; for example, A and/or B can represent: A exists alone, A and B exist at the same time, and B exists alone, where A and B can be singular or plural. The character "/" generally indicates that the objects associated before and after are in an "or" relationship.

References to "one embodiment" or "some embodiments" etc. described in this specification mean that a particular feature, structure or characteristic described in conjunction with the embodiment is included in one or more embodiments of the present application. Thus, the phrases "in one embodiment", "in some embodiments", "in some other embodiments", "in some other embodiments", etc. appearing in different places in this specification do not necessarily all refer to the same embodiment, but mean "one or more but not all embodiments", unless otherwise specifically emphasized in other ways. The terms "including", "comprising", "having" and their variations all mean "including but not limited to", unless otherwise specifically emphasized in other ways.

The method provided in the embodiments of the present application is applied to electronic devices, including but not limited to mobile phones, tablet computers, vehicle-mounted devices, wearable devices, augmented reality (AR)/virtual reality (VR) devices, laptop computers, ultra-mobile personal computers (UMPC), netbooks, personal digital assistants (PDA), smart screens, and other electronic devices with display screens. The embodiments of the present application do not impose any restrictions on the specific types of electronic devices.

Illustratively, FIG1 shows a schematic diagram of the hardware structure of an electronic device provided in an embodiment of the present application.

As shown in Figure 1, the electronic device 100 may include: a processor 110, a memory 120, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a camera 191, a display screen 192, a button 193, etc.

The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and/or a neural-network processing unit (NPU). Different processing units may be independent devices or integrated into one or more processors.

The controller may be the nerve center and command center of the electronic device 100. The controller may generate an operation control signal according to the instruction operation code and the timing signal to complete the control of fetching and executing instructions.

The processor 110 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may store instructions or data that the processor 110 has just used or cyclically used. If the processor 110 needs to use the instruction or data again, it may be directly called from the memory, thereby avoiding repeated access, reducing the waiting time of the processor 110, and thus improving the efficiency of the system.

In some embodiments, the processor 110 may include one or more interfaces. The interface may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver/transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input/output (GPIO) interface, a subscriber identity module (SIM) interface, and/or a universal serial bus (USB) interface, etc.

For example, the processor 110 and the touch sensor 180E can communicate through an I2C bus interface to implement the touch function of the electronic device 100. The processor 110 and the camera 191 can communicate through a CSI interface to implement the shooting function of the electronic device 100. The processor 110 and the display screen 192 can communicate through a DSI interface to implement the display function of the electronic device 100.

It is understandable that the interface connection relationship between the modules illustrated in the embodiment of the present application is only a schematic illustration and does not constitute a structural limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may also adopt different interface connection methods in the above embodiments, or a combination of multiple interface connection methods.

The charging management module 140 is used to receive charging input from the charger. The power management module 141 is used to connect to the battery 142. While the charging management module 140 is charging the battery 142, the power management module 141 can also be used to power the electronic device 100. The power management module 141 can also be used to monitor parameters such as battery capacity, battery cycle number, and battery health status.

The wireless communication function of the electronic device 100 can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor.

Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve the utilization of antennas. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In some other embodiments, the antenna can be used in combination with a tuning switch.

The mobile communication module 150 can provide solutions for wireless communications including 2G/3G/4G/5G, etc., applied to the electronic device 100. The mobile communication module 150 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves from the antenna 1, and filter, amplify, and process the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 1. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the same device as at least some of the modules of the processor 110.

The wireless communication module 160 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc., which are applied to the electronic device 100. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, modulates the frequency of the electromagnetic wave signal and performs filtering, and sends the processed signal to the processor 110. The wireless communication module 160 can also receive the signal to be sent from the processor 110, modulate the frequency of it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.

The electronic device 100 implements the display function through a GPU, a display screen 192, and an application processor. The GPU is a microprocessor for image processing, which connects the display screen 192 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs that execute program instructions to generate or change display information.

The display screen 192 is used to display images, videos, etc. The display screen 192 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light emitting diode or an active-matrix organic light emitting diode (AMOLED), a flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-oLed, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the electronic device 100 may include 1 or N display screens 192, where N is a positive integer greater than 1.

The electronic device 100 can realize the shooting function through ISP, camera 191, video codec, GPU, display screen 192 and application processor. ISP is used to process the data fed back by camera 191. Camera 191 is used to capture static images or videos. The object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal oxide semiconductor (CMOS) phototransistor. In some embodiments, the electronic device 100 may include 1 or N cameras 191, where N is a positive integer greater than 1.

Video codecs are used to compress or decompress digital videos. The electronic device 100 may support one or more video codecs. Thus, the electronic device 100 may play or record videos in a variety of coding formats, such as Moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, MPEG4, etc.

The memory 120 is used to store data and/or instructions.

The memory 120 may include an internal memory. The internal memory is used to store computer executable program codes, which include instructions. The processor 110 executes various functional applications and data processing of the electronic device 100 by running the instructions stored in the internal memory. The internal memory may include a program storage area and a data storage area. Among them, the program storage area may store an operating system; the program storage area may also store one or more applications (such as a gallery, contacts, etc.). The data storage area may store data (such as images, contacts, etc.) created during the use of the electronic device 100. In addition, the internal memory may include a high-speed random access memory, and may also include a non-volatile memory, such as one or more disk storage devices, flash memory devices, universal flash storage (UFS), etc. In some embodiments, the processor 110 may execute instructions stored in the internal memory, and/or instructions stored in a memory provided in the processor 110, so that the electronic device 100 executes the card sharing method provided in the embodiment of the present application.

The memory 120 may also include an external memory, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory may communicate with the processor 110 via an external memory interface to implement a data storage function, such as storing music, video and other files in the external memory.

The electronic device 100 can implement audio functions such as audio playback and recording through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone jack 170D, and the application processor.

The sensor module 180 may include a pressure sensor 180A, a gyro sensor 180B, an acceleration sensor 180C, a distance sensor 180D, a touch sensor 180E, and some other sensors.

The pressure sensor 180A is used to sense the pressure signal and can convert the pressure signal into an electrical signal. In some embodiments, the pressure sensor 180A can be set on the display screen 192. There are many types of pressure sensors 180A, such as resistive pressure sensors, inductive pressure sensors, capacitive pressure sensors, etc. The capacitive pressure sensor can be a parallel plate including at least two conductive materials. When a force acts on the pressure sensor 180A, the capacitance between the electrodes changes. The electronic device 100 determines the intensity of the pressure according to the change in capacitance. When a touch operation acts on the display screen 192, the electronic device 100 detects the touch operation intensity according to the pressure sensor 180A. The electronic device 100 can also calculate the touch position according to the detection signal of the pressure sensor 180A. In some embodiments, touch operations acting on the same touch position but with different touch operation intensities can correspond to different operation instructions. For example: when a touch operation with a touch operation intensity less than the first pressure threshold acts on the short message application icon, an instruction to view the short message is executed. When a touch operation with a touch operation intensity greater than or equal to the first pressure threshold acts on the short message application icon, an instruction to create a new short message is executed.

The gyroscope sensor 180B is also called an angular velocity sensor, which can be used to determine the motion posture of the electronic device 100. In some embodiments, the angular velocity of the electronic device 100 around three axes (i.e., x, y, and z axes) can be determined by the gyroscope sensor 180B. The gyroscope sensor 180B can be used for anti-shake shooting. The gyroscope sensor 180B can also be used for navigation and somatosensory game scenes. For example, the gyroscope can fully monitor the displacement of the player's hand, thereby achieving various game operation effects, such as changing the horizontal screen to the vertical screen, turning in a racing game, and so on.

The acceleration sensor 180C can detect the magnitude of the acceleration of the electronic device 100 in all directions (generally three axes). When the electronic device 100 is stationary, the magnitude and direction of gravity can be detected. The acceleration sensor 180C can also be used to identify the posture of the electronic device 100, and is applied to applications such as horizontal and vertical screen switching, pedometers, etc.

The distance sensor 180D is used to measure the distance. The electronic device 100 can measure the distance by infrared or laser. In some embodiments, when shooting a scene, the electronic device 100 can use the distance sensor 180D to measure the distance to achieve fast focusing.

The touch sensor 180E is also called a "touch panel". The touch sensor 180E can be set on the display screen 192, and the touch sensor 180E and the display screen 192 form a touch screen, also called a "touch screen". The touch sensor 180E is used to detect touch operations acting on or near it. The touch sensor can pass the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through the display screen 192. In other embodiments, the touch sensor 180E can also be set on the surface of the electronic device, which is different from the position of the display screen 192.

It should be understood that in the embodiment of the present application, there is no limitation on the type of sensors included in the sensor module 180, and the sensor module 180 may include more or fewer sensors, depending on actual needs, which will not be described in detail here.

The key 193 may include a power key, a volume key, etc. The key 193 may be a mechanical key or a touch key. The electronic device 100 may receive key input and generate key signal input related to user settings and function control of the electronic device 100.

It is to be understood that the structure illustrated in the embodiments of the present application does not constitute a specific limitation on the electronic device. In other embodiments of the present application, the electronic device may include more or fewer components than shown in the figure, or combine certain components, or split certain components, or arrange the components differently. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

The above describes a possible hardware structure diagram of the electronic device 100. The software system of the electronic device 100 may adopt a layered architecture, an event-driven architecture, a micro-core architecture, a micro-service architecture, or a cloud architecture. Taking the system as an example, the software structure of the electronic device 100 is exemplified.

FIG2 shows a software structure diagram of an electronic device provided in an embodiment of the present application. As shown in FIG2, the layered architecture divides the software into several layers, and each layer has a clear role and division of labor. The layers communicate with each other through software interfaces. In some embodiments, The system is divided into four layers, from top to bottom: application layer, application framework layer, system runtime layer (including system library and Android runtime) and kernel layer. Below the kernel layer is the hardware layer.

The application layer may include a series of application (APP) packages. As shown in FIG2 , the application package may include camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, short message and other applications.

The application framework layer provides an application programming interface (API) and a programming framework for the applications in the application layer. The application framework layer includes some predefined functions. As shown in Figure 2, the application framework layer may include a window manager, a content provider, a phone manager, a resource manager, a notification manager, a view system, a card service engine, etc.

The window manager is used to manage window programs. The window manager can obtain the display screen size, determine whether there is a status bar, lock the screen, capture the screen, etc.

Content providers are used to store and retrieve data and make it accessible to applications. The data may include videos, images, audio, calls made and received, browsing history and bookmarks, phone books, etc.

The phone manager is used to provide communication functions of the electronic device 100, such as management of call status (including connecting, hanging up, etc.).

The resource manager provides various resources for applications, such as localized strings, icons, images, layout files, video files, and so on.

The notification manager enables applications to display notification information in the status bar. It can be used to convey notification-type messages and can disappear automatically after a short stay without user interaction. For example, the notification manager is used to notify download completion, message reminders, etc. The notification manager can also be a notification that appears in the system top status bar in the form of a chart or scroll bar text, such as notifications of applications running in the background, or a notification that appears on the screen in the form of a dialog window. For example, a text message is displayed in the status bar, a prompt sound is emitted, the terminal device vibrates, the indicator light flashes, etc.

The view system includes visual controls, such as controls for displaying text, controls for displaying images, etc. The view system can be used to build applications. A display interface can be composed of one or more views. For example, a display interface including a text notification icon can include a view for displaying text and a view for displaying images.

The system runtime library layer (libraries) can be divided into two parts: system libraries and Android runtime.

Android runtime is the Android operating environment, including the core library and virtual machine. Android runtime is responsible for the scheduling and management of the Android system. The core library consists of two parts: one is the function that the Java language needs to call, and the other is the Android core library.

The application layer and the application framework layer run in a virtual machine. The virtual machine executes the Java files of the application layer and the application framework layer as binary files. The virtual machine is used to perform functions such as object life cycle management, stack management, thread management, security and exception management, and garbage collection.

The system library is the support of the application framework and can include multiple functional modules, such as: surface manager, media libraries, 2D graphics engine (such as SGL), 3D graphics processing library (such as OpenGL ES), image processing library, etc.

The surface manager is used to manage the display subsystem and provide the fusion of 2D and 3D layers for multiple applications.

The media library supports playback and recording of a variety of commonly used audio and video formats, as well as static image files, etc. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, synthesis and layer processing, etc.

A 2D graphics engine is a drawing engine for 2D drawings.

The kernel layer is the layer between hardware and software, which is used to provide essential functions of the operating system such as file management, memory management, process management, network protocol stack, etc. The kernel layer includes at least display driver, camera driver, audio driver, sensor driver, Bluetooth driver, etc.

For ease of understanding, the following embodiments of the present application will take an electronic device having the structure shown in Figures 1 and 2 as an example, and combine the accompanying drawings and application scenarios to specifically explain the display method provided in the embodiments of the present application.

With the continuous development of electronic equipment technology, the screen size of electronic devices such as mobile phones and tablets is getting larger and larger, and the number of applications (applications, Apps) installed on electronic devices is also increasing. In order to meet the personalized needs of users, more and more electronic devices support multi-window mode (also called multi-screen mode or split-screen function), that is, multiple applications can be run and displayed on one screen at the same time. After the multi-window mode of the electronic device is turned on, the user can split the screen of the electronic device, for example, divide the vertical screen into two upper and lower windows, or divide the horizontal screen into two left and right windows, where each window runs an application independently, and the two applications do not affect each other.

When the electronic device is in multi-window mode, the display modes of the application window include full-screen display, split-screen display, and floating display.

Full screen display, also known as full screen mode, means that only one application window is displayed on the screen, and the interface of the application fills the entire screen. In the embodiment of the present application, when a window is displayed in full screen, the state of the window is defined as the full screen state, and accordingly, the application displayed in the window is defined as the full screen display application.

Split-screen display, also known as split-screen mode, refers to two or more application windows occupying a portion of the screen respectively, no two application windows overlap, each application window can change size, and the position of the application window is either immovable or can only be moved to a fixed position, such as swapping the positions of two application windows. In the embodiment of the present application, when a window is split-screen displayed, the state of the window is defined as the split-screen state, and accordingly, the application displayed by the window is defined as the split-screen display application.

Floating display, also known as floating mode, refers to at least one application window being displayed floating above other first interfaces and partially covering other first interfaces. When the user does not operate the floating application window, the floating application window remains in a fixed position and does not change with changes in other first interfaces. The at least one application window is displayed in layers on the screen, and the application windows may partially or fully overlap each other. Each application window can be resized and moved. In an embodiment of the present application, when a window is displayed in a floating state, for example, floating above a window displayed in full screen or above a window displayed in split screen, the state of the window is defined as a floating state, and accordingly, the application displayed by the window is defined as a floating display application.

When using the multi-window mode, the user may need to obtain information about a certain window interface. The window interface information may be, for example, a screenshot of the window interface, a video of the window interface, or information obtained after further processing of the window interface, such as text obtained by window interface recognition, or text converted from the content of the window interface, etc. The user can then record the obtained window interface information in the windows of other applications or share it through other applications.

Taking Figure 3 as an example, the user is watching a video in one window and taking notes in another window. The user wants to capture a picture of the current video interface and insert the picture into the interface of the note application (record the information of the video window interface in the window of the note application). The user can take a screenshot of the interface 310 of the current electronic device through the screenshot control on the current interface or drop-down box, gestures, or shortcut keys of the electronic device (for example, pressing the volume key and the power key at the same time), and then the thumbnail 311 of the screenshot image will be displayed on the interface 310, as shown in Figure 3 (a). The user can click on the thumbnail 311 of the screenshot image, and the interface 320 for editing the screenshot image will appear on the display screen, as shown in Figure 3 (b), the user can cut the screenshot image to a suitable size by moving the control 321 on the edge of the screenshot image, and the user can move the control 321 so that the screenshot image is cropped to the size shown in 331 in Figure 3 (c), that is, only the part 331 of the video window in the screenshot image is retained. After the cropping is completed, the user can click the control 332 on the interface 330 to save the cropped screenshot image. Afterwards, the user can click the control 341 on the interface 340 shown in (d) of Figure 3, and click "Select from Album" in the pop-up option box 342 to select the cropped screenshot image from the thumbnails in the album, thereby inserting the screenshot image of the video window into the note-taking application.

The above uses screenshots as an example to illustrate the process of a user obtaining information related to one window (screenshot image) and inserting the information into another window application in multi-window mode. When the user needs to obtain the screen recording file of the window, or the text or information for text recognition or object recognition in the window interface, the process is similar to the above operation. The whole process has many steps, and for some of the information, such as screen recording files, since special video editing software is required to crop the screen recording files, the user needs to exit the split-screen interface and use the video cropping software to further process the screen recording files, which affects the user experience.

The embodiment of the present application provides a display method, which can improve the convenience of operation and enhance the user experience when a user needs to record or share information related to another window in an application in one window in a multi-window mode.

As shown in FIG. 4 , the method includes:

S410, displaying a first interface, the first interface including a first window and a second window, the first window being a window allowing information insertion.

S420: Receive a first user input to the first window.

S430: Execute a first operation on the second window according to the first user input.

S440: Insert information corresponding to the first operation execution result into the first window.

In S410, the first interface includes a first window and a second window. In some embodiments, the first window and the second window may include a full-screen window. As shown in (a) of Figure 5, for example, the first window is a full-screen window 511, and the second window is a floating window 512. The floating window 512 may include some controls for window operations. For example, the user clicks on the control 5121 to change the window 512 from a floating window to a full-screen window; the user clicks on the control 5122 to minimize the window 512, and after minimization, the icon of the application of the window can be displayed on the side of the display screen, thereby reducing the impact of the window on the full-screen window 511. When the user clicks on the icon, the window 512 can be displayed on the interface again as a floating window; when the user clicks on the control 5123, the floating window 512 can be closed.

In other embodiments, the first window and the second window may not include a full-screen window. As shown in (b) of FIG. 5 , the display screen includes a window obtained by splitting the screen and a floating window. Among them, the window obtained by splitting the screen may include window 521, window 522, and window 523, and there are controls as shown in 5211 between the split-screen windows. The user can change the size of each split-screen window by moving the control; the floating window may include window 524 and window 525, and each floating window may still include some of the controls described above. For example, the first window may be window 521, and the second window may be window 522, that is, the first window and the second window are both split-screen windows. For another example, the first window may be window 521, and the second window may be window 524, that is, the first window and the second window are respectively a split-screen window and a floating window. For another example, the first window may be window 524, and the second window may be window 525, that is, the first window and the second window are both floating windows.

It should be understood that the above only introduces the types of the first window and the second window with FIG. 5, and the electronic device display screen interface may also include more or fewer windows. For example, FIG. 5 (a) may also include other floating windows, and FIG. 5 (b) may also include other split-screen windows and/or floating windows. In addition, the types of the first window and the second window may be interchangeable. For example, for FIG. 5 (a), the first window may be a floating window 512, and the second window may be a full-screen window 511.

The first window is a window that allows information to be inserted, and the information may be text, a link or a file, that is, the first window allows text, a link or a file to be inserted.

In some embodiments, the first window includes an input box, which may be an input box of an application, such as an input box of a chat application; or other applications, such as an input box of a note-taking application, which may include memos, notepads, documents, and other note-taking applications; the input box may also be, for example, an input box for commenting on a user or service. Text, links, icons and/or names of files may be inserted into the input box. Alternatively, although the window includes an input box, when a file is inserted, the icon or name of the file is not displayed in the input box, but is displayed in other locations of the first window, such as below the input box.

In other embodiments, the first window may not include an input box, but allows the insertion of files. For example, the first window displays the interface of a file compression application, and when a file is inserted, the icon and/or name of the file will be displayed in the area to be compressed of the file compression application. Or the first window displays the main interface of an email application, and when a file is inserted, the icon and/or name of the file may be displayed in the default new email editing window as an attachment to the new email.

In S420 and S430, the electronic device receives a first user input from a user on the first window, and performs a first operation on the second window according to the first user input.

The first user input may correspond to the first operation, and the first user input may be an input by the user on the interface of the application in the first window, and the first user input may be in various forms. The following takes the case where the first user input of the user corresponds to a screenshot instruction, and the first operation is that the electronic device takes a screenshot of the second window as an example to introduce various forms of the first user input.

In some embodiments, a first control is set in the application of the first window, and the first user input is a click input of the user to the first control. Specifically, for the screenshot operation, there is a screenshot control on the interface of the first window, and the first user input is a click input of the user to the screenshot control. For example, as shown in (a) of FIG6 , the first interface 610 may include a first window 601 and a second window 602. The first window 601 runs a note-taking application, and there is an input box on the interface of the application (the input box refers to a location that allows user input). The input box may be in an activated state, and the user may click the screenshot control 611 on the application interface of the first window 601, so that the electronic device may perform subsequent screenshot operations according to the user's click input to the screenshot control.

In other embodiments, the user may perform gesture input on the interface of the first window. For the screenshot operation, the gesture input may correspond to the screenshot instruction of the application of the first window, for example, the user may perform finger/knuckle tapping on the interface of the application of the first window or slide the finger on the screen in a preset manner and/or trajectory to trigger the screenshot instruction of the application of the first window. For example, the user may perform finger knuckle tapping on the interface of the first window 701 shown in (a) of FIG. 7 , so that the electronic device will perform a subsequent screenshot operation.

After receiving the first user input, the electronic device determines the position or coordinates of the target window (second window) for performing the first operation corresponding to the first user input.

When there are only two windows on the first interface, the electronic device can use a window other than the first window that receives the first user input as the target window, that is, the second window as the target window of the first operation. For example, when the first window and the second window are two windows formed by splitting the first interface, the electronic device can determine that the target window is the second window. For another example, when the first window is a full-screen window 511 as shown in (a) of FIG5 , it can be determined that the second window is a floating window 512; and if the first window is a floating window 512, it can be determined that the second window is a full-screen window 511.

When the first window and the second window are two windows on a split-screen interface and the first interface includes only two windows, the electronic device can determine the position or coordinates of the second window based on the position or coordinates of the first window, and then perform the first operation on the second window based on the position or coordinates of the second window.

In some embodiments, since the first user input is an input to the first window, it can be preset that the application of the first window can know that the first user input corresponds to an instruction for performing a first operation on other windows after receiving the first user input. The application of the first window can determine the position or coordinates of the second window according to at least one of the position or coordinates of the first window, so that the electronic device can perform the first operation on the second window according to the position or coordinates of the second window. As shown in Figure 8, a coordinate system can be established with the upper left corner of the display interface of the electronic device as the coordinate origin O, with the direction parallel to the time display direction as the x-axis direction, and the direction perpendicular to the time display direction as the y-axis direction (the coordinate axis rotates according to the screen state when the electronic device is in landscape mode or portrait mode).

If the display interface is as shown in (a) of FIG8 , assuming that the length of the longer side of the display interface is h, the length of the shorter side is w, and the width of the split-screen control 801 is d.

If the first window is window 810, the position or coordinates of the first window 810 are: upper left vertex (x1, 0), lower right vertex (h, w). When the user performs a first user input on window 810, the application of the first window 810 can receive the first user input and determine the coordinates of the second window 820 that needs to be captured based on the coordinates of the first window 810. The coordinates of the second window 820 are: upper left vertex (0, 0), lower right vertex (x1-d, w). The application of the first window 810 can send a screenshot instruction to the operating system of the electronic device. The instruction can carry the position (coordinates) of the second window 820. After receiving the screenshot instruction, the screenshot module of the operating system can take a screenshot based on the coordinates of the second window 820.

If the first window is window 820, the position or coordinates of the first window 820 are: upper left vertex (0, 0), lower right vertex (x2, w). The application of the first window 820 can determine that the target window of the screenshot, the second window 810, is located on the right side of the first window 820 according to the coordinates of the first window 820, and the position or coordinates of the second window 810 are: upper left vertex (x2+d, 0), lower right vertex (h, w). The first window 820 can carry the position or coordinates of the second window 810 in the screenshot instruction and send the corresponding instruction to the screenshot module.

If the display interface is as shown in (b) of FIG8 , assuming that the length of the longer side of the display interface is h, the length of the shorter side is w, and the width of the split-screen control 801 is d.

If the first window is window 830, the position or coordinates of the first window 830 are: upper left vertex (0, 0), lower right vertex (w, y1). The application of the first window 830 can determine that the target window of the screenshot, the second window 840, is located below the first window 830 according to the coordinates of the first window 830, and the position or coordinates of the second window 840 are: upper left vertex (0, y1+d), lower right vertex (w, h). The first window 830 can carry the position or coordinates of the second window 840 in the screenshot instruction and send the corresponding instruction to the screenshot module.

If the first window is window 840, the position or coordinates of the first window 840 are: upper left vertex (0, y2), lower right vertex (w, h). The application of the first window 840 can determine that the target window of the screenshot, the second window 830, is located above the first window 840 according to the coordinates of the first window 840, and the position or coordinates of the second window 830 are: upper left vertex (0, 0), lower right vertex (w, y2-d). The first window 830 can carry the position or coordinates of the second window 840 in the screenshot instruction and send the corresponding instruction to the screenshot module.

It should be understood that for Figure 8, in the horizontal screen scenario of Figure 8 (a), the method for determining the position or coordinates of the second window is introduced by splitting the screen left and right. When the screen is split up and down in the horizontal screen mode, the method for determining the position or coordinates of the second window is similar. In the vertical screen scenario of Figure 8 (b), the method for determining the position or coordinates of the second window is introduced by taking the split screen up and down as an example. When the vertical screen is split up and down, the method for determining the position or coordinates of the second window is similar and will not be repeated here. When the screen rotates, the coordinate axis can be rotated according to the screen adaptability so that the x-axis clock is parallel to the display direction of time.

In other embodiments, the position or coordinates of the second window may be determined by the operating system of the electronic device. If the display interface of the electronic device includes only two windows, after receiving the first user input, the operating system of the electronic device may directly use the window other than the first window as the target window of the first operation. Specifically, when the user performs the first user input in the first window, the application of the first window may send the instruction of the first operation to the operating system. The first user input of the user may be preset by the application of the first window or the operating system in a multi-window scenario and when the input box of the first window is in an activated state, and the first user input of the user is used to perform the first operation on the window other than the first window. For example, when the application of the first window receives the first user input, it sends the instruction of the first operation to the operating system and instructs the operating system to perform the first operation on another window. Alternatively, the first application sends the instruction of the first operation, and the operating system of the electronic device determines that the target window of the first operation is the second window. Therefore, when the display screen of the electronic device includes only two windows, the operating system of the electronic device may determine the position or coordinates of the second window, and perform the first operation on the second window according to the position or coordinates of the second window, such as screenshot, screen recording, screen recognition and other operations.

If the first window is a floating window and the second window is a full-screen window, the first window can be preset or instructed by the application of the first window to hide or display the first window when the operating system of the electronic device performs the first operation. For example, when the first operation is screenshot or screen recording, the floating first window can be hidden when the screenshot or screen recording is performed, so as not to affect the interface of the application of the second window.

If the electronic device includes more than two windows, before the electronic device performs the first operation on the second window, the user may be prompted to determine the target window of the first operation, and the electronic device may receive the second user input and determine the target window (the second window) of the first operation according to the second user input. For example, the electronic device may prompt the user to select a target window by means of a pop-up window, so that the user may click on one of the windows, and the electronic device may use the window clicked by the user as the target window and perform the first operation on the window.

The above describes the steps for the electronic device to determine the target window of the first operation in different scenarios. After the electronic device determines the target window (second window) of the first operation, the information corresponding to the execution node of the first operation can be inserted into the first window. As shown in FIG6(b) and FIG7(b), the information corresponding to the first operation is a screenshot image. The electronic device can directly insert the screenshot images 621 and 721 into the input box of the first window, thereby reducing the user's operations and improving the user's experience.

It should be understood that the above takes the first user input as an example of the first window (the first user input is a click operation on the control of the first window or a gesture operation on the first window) to introduce the technical solution of the embodiment of the present application. In some embodiments, the control clicked by the user and related to the first operation can be located in a drop-down box of the electronic device, near a side frame, or on a floating button for assisting user operation.

Still taking the first operation as a screenshot or screen recording operation as an example, the user or operating system can preset the screenshot or screen recording operation in the multi-window mode, and the screenshot or screen recording operation is performed by window by default. When the user clicks the screenshot or screen recording operation control on the drop-down box of the electronic device, if the electronic device determines that it is currently in the multi-window mode, the user can be prompted to determine the target window for the screenshot or screen recording. If the electronic device determines that the first window or the input box of the first window is in an activated state before the user performs the first user input (clicks the screenshot or screen recording control), the file corresponding to the screenshot or screen recording can be directly inserted into the first window after the user determines the target window for the screenshot or screen recording, thereby improving the convenience of user operation. Alternatively, the activation state of the window or input box can be ignored, and the user can be directly prompted to determine the insertion window of the file corresponding to the screenshot or screen recording, that is, the electronic device can prompt the user to determine the target window (second window) of the screenshot or screen recording operation and the target insertion window (first window) of the file of the screenshot or screen recording operation.

In an embodiment of the present application, the first operation is any one or more of a screenshot operation, a screen recording operation, a screen recognition operation, or a sound recognition operation; the first operation may be a screenshot operation, and the information corresponding to the execution result of the first operation is a picture file obtained according to the screenshot operation; or, the first operation may be a screen recording operation, and the information corresponding to the execution result of the first operation is a video file obtained according to the screen recording operation; or, the first operation may be a screen recognition operation, and the information corresponding to the execution result of the first operation is text or a link obtained according to the screen recognition operation, and the screen recognition operation includes text recognition or object recognition; or, the first operation may be a sound recognition operation, and the information corresponding to the execution result of the first operation is at least one of a music file or text information obtained according to the sound recognition operation.

Different first operations and information corresponding to the execution results of the first operations are introduced below with reference to FIGS. 9 to 11 .

As shown in FIG9 , window 902 is a video window, and window 901 is a window of a note-taking application. As shown in FIG9 (a), the user can click on the interface screen recognition control 911. After the application of the first window receives the user's click operation, it can determine the coordinates of the target window 902 for screen recognition according to the coordinates of window 901, and send a screen recognition request to the operating system of the electronic device according to the coordinates of the window, and carry the coordinates of window 902 in the request. After receiving the request, the operating system of the electronic device can automatically recognize window 902 and automatically insert the recognized text into the input box of window 901, as shown in FIG9 (b).

It should be understood that in FIG. 9 , screen recognition is recognition of text, and in other scenarios, object recognition may be performed, such as commodity recognition, and allowing the user to insert a commodity link in an input box.

As shown in Figure 10, window 1001 is a chat window, and window 1002 is a video window. The user can click the screen recording control 1011 on the interface 1010 so that the electronic device can record the window 1002. The user can click the screen recording status control 1012 to end the screen recording, so that the recorded file is directly inserted into the window 1001 without any other user operation. The icon and name corresponding to the file are displayed below the input box, as shown in (b) of Figure 10. The user can then click the "Send" control on the interface 1020 to share the recorded file with others.

As shown in FIG11 , the display screen of the electronic device includes four windows, among which window 1111, window 1112 and window 1113 are split-screen windows, window 1114 is a floating window, and window 1113 can be currently in an activated state. The user can click on the screenshot control 1115 on the floating button of the electronic device, at which time, a prompt box 1116 prompting the user to input can appear on the interface 1110, prompting the user to select a screenshot window (the target window for the screenshot). The user can select any one of the four windows on the interface 1110 for screenshot. Schematically, the user can click on the interface of window 1114, so that a control 1126 will appear on the border of window 1114 (interface 1120 of (b) of FIG11 ), prompting the user to select the target window as window 1114, and then the electronic device can insert the screenshot image file of window 1114 into window 1113 (for example, in the input box of the window), as shown in interface 1130 of (c) of FIG11 , the user can click on the "Send" control on the interface 1130 to share the screenshot file with others.

The display method provided by the embodiment of the present application is introduced above with reference to FIGS. 4 to 11 , and the electronic device provided by the embodiment of the present application is introduced below with reference to FIGS. 12 and 13 .

FIG. 12 shows an electronic device 1200 provided in an embodiment of the present application. The electronic device 1200 includes a display unit 1210 and a processing unit 1220 .

The electronic device 1200 may include a unit for executing the method of Fig. 4. Moreover, each unit in the electronic device 1200 and the above-mentioned other operations and/or functions are respectively for implementing the corresponding processes of the embodiment of the method of Fig. 4.

Specifically, the electronic device 1200 includes: a display unit 1210, used to display a first interface, the first interface includes a first window and a second window, the first window is a window that allows information insertion; a processing unit 1220, used to: receive a first user input from a user to the first window; perform a first operation on the second window according to the first user input; and insert information corresponding to the execution result of the first operation into the first window.

In the embodiment of the present application, the first operation is any one or more of a screenshot operation, a screen recording operation, a screen recognition operation, or a sound recognition operation; when the first operation is a screenshot operation, the execution result of the first operation corresponds to

The information corresponding to the execution result of the first operation is a picture file obtained according to the screen capture operation; or, when the first operation is a screen recording operation, the information corresponding to the execution result of the first operation is a video file obtained according to the screen recording operation; or, when the first operation is a screen

When the first operation is a screen recognition operation, the information corresponding to the execution result of the first operation is text or a link obtained according to the screen recognition operation, and the screen recognition operation includes text recognition or object recognition; or, when the first operation is the sound recognition operation, the information corresponding to the execution result of the first operation is at least one of a music file or text information obtained according to the sound.

In the embodiment of the present application, the first window includes a first control, and the first user input is an input to the first control.

Click operation of the item.

In the embodiment of the present application, the first user input is a gesture input on the interface of the first window.

In the embodiment of the present application, the first window and the second window are two windows of the split-screen interface of the electronic device.

In the embodiment of the present application, the processing unit 1220 is further configured to: determine, according to the position of the first window,

The position of the second window; the processing unit 1220 is specifically used to: perform the first operation on the second window according to the position of the second window.

In the embodiment of the present application, the first interface further includes a third window, and the processing unit 1220 is further configured to:

Prompting the user to determine a target window for the first operation; and receiving a second user input from the user, where the second user input is used to determine that the target window is the second window.

In an embodiment of the present application, the application corresponding to the first window is a note application or a memo application.

In an embodiment of the present application, the application corresponding to the second window is a video application or a document application.

FIG13 shows an electronic device 1300 provided in an embodiment of the present application. The electronic device 1300 shown in FIG13 can

Corresponding to the electronic device described above, specifically, the electronic device 1300 may be a specific example of the electronic device in FIG. 1. The electronic device 1300 includes: a processor 1320. In the embodiment of the present application, the processor 1320 is used to implement the corresponding

The processor 1320 is used to support the electronic device 1300 in executing the method, operation or function of the above-mentioned embodiment. Optionally, the electronic device 1300 may further include: a memory 1310 and a communication interface 1330; the processor 1320, the communication interface 1330 and the memory 1310 may be connected to each other or connected to each other through a bus 1340.

In the embodiment of the present invention, the communication interface 1330 is used to support the electronic device to communicate with other devices, and the memory 1310 is used to store the program code and data of the electronic device. The processor 1320 calls the code or data stored in the memory 1310 to implement the corresponding operation. The memory 1310 can be coupled with the processor or not. The coupling in the embodiment of the present application is an indirect coupling or communication connection between electronic devices, units or modules, which can be electrical, mechanical or other forms, and is used for information exchange between electronic devices, units or modules.

The processor 1320 may be a central processing unit, a general-purpose processor, a digital signal processor, a dedicated integrated circuit, a field programmable gate array or other programmable logic device, a transistor logic device, a hardware component or the like.

Any combination. It can implement or execute various exemplary logic blocks, modules and circuits described in conjunction with the disclosure of this application. The processor can also be a combination that implements computing functions, such as a combination of one or more microprocessors, a combination of a digital signal processor and a microprocessor, and the like. The communication interface 1330 can be a transceiver, a circuit, a bus, a module, or other types of communication interfaces. The bus 1340 can be a peripheral component interconnect (PCI) bus or an extended industry standard architecture (EISA) bus, and the like. The bus can be divided into an address bus, a data bus, a control bus, and the like. For ease of representation, only one thick line is used in FIG. 13, but it does not mean that there is only one bus or one type of bus.

Those of ordinary skill in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

In the several embodiments provided in the present application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.

If the functions are implemented in the form of software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application can be essentially or partly embodied in the form of a software product that contributes to the prior art. The computer software product is stored in a storage medium and includes several instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the methods described in each embodiment of the present application. The aforementioned storage medium includes: various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.

The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art who is familiar with the present technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

Claims (20)

1. A display method, applied to an electronic device, comprising: Displaying a first interface, wherein the first interface includes a first window and a second window, wherein the first window is a window allowing information to be inserted; receiving a first user input to the first window; Performing a first operation on the second window according to the first user input; Information corresponding to the execution result of the first operation is inserted into the first window. 2. The method according to claim 1, wherein the first operation is any one or more of a screenshot operation, a screen recording operation, a screen recognition operation, or a sound recognition operation; When the first operation is the screenshot operation, the information corresponding to the execution result of the first operation is a picture file obtained according to the screenshot operation; or, When the first operation is the screen recording operation, the information corresponding to the execution result of the first operation is a video file obtained according to the screen recording operation; or, When the first operation is the screen recognition operation, the information corresponding to the execution result of the first operation is at least one of text or a link obtained according to the screen recognition operation, and the screen recognition operation includes text recognition or object recognition; or When the first operation is the voice recognition operation, the information corresponding to the execution result of the first operation is at least one of a music file or text information obtained according to the voice recognition operation. 3. The method according to claim 1 or 2, characterized in that The first window includes a first control, and the first user input is a click operation on the first control. 4. The method according to claim 1 or 2, characterized in that: The first user input is a gesture input on the interface of the first window. 5. The method according to any one of claims 1 to 4, characterized in that the first interface includes only two windows, and the first window and the second window are two windows of a split-screen interface of the electronic device. 6. The method according to claim 5, characterized in that before performing the first operation on the second window, the method further comprises: Determining the position of the second window according to the position of the first window; The performing the first operation on the second window includes: The first operation is performed on the second window according to the position of the second window. 7. The method according to any one of claims 1 to 4, wherein the first interface further comprises a third window, and before performing the first operation on the second window, the method further comprises: Prompting the user to determine a target window for the first operation; A second user input is received from a user, where the second user input is used to determine that the target window is the second window. 8. The method according to any one of claims 1 to 7, wherein the application corresponding to the first window is a note application or a memo application. 9. The method according to any one of claims 1 to 8, wherein the application corresponding to the second window is a video application or a document application. 10. An electronic device, comprising: A display unit, configured to display a first interface, wherein the first interface includes a first window and a second window, wherein the first window is a window allowing information to be inserted; A processing unit for: receiving a first user input to the first window; Performing a first operation on the second window according to the first user input; Information corresponding to the execution result of the first operation is inserted into the first window. 11. The electronic device according to claim 10, wherein the first operation is any one or more of a screenshot operation, a screen recording operation, a screen recognition operation, or a sound recognition operation; When the first operation is the screenshot operation, the information corresponding to the execution result of the first operation is a picture file obtained according to the screenshot operation; or, When the first operation is the screen recording operation, the information corresponding to the execution result of the first operation is a video file obtained according to the screen recording operation; or, When the first operation is the screen recognition operation, the information corresponding to the execution result of the first operation is at least one of text or a link obtained according to the screen recognition operation, and the screen recognition operation includes text recognition or object recognition; or When the first operation is the sound recognition operation, the information corresponding to the execution result of the first operation is at least one of a music file or text information obtained according to the sound. 12. The electronic device according to claim 10 or 11, characterized in that: The first window includes a first control, and the first user input is a click operation on the first control. 13. The electronic device according to claim 10 or 11, characterized in that: The first user input is a gesture input on the interface of the first window. 14 . The electronic device according to claim 10 , wherein the first interface comprises only two windows, and the first window and the second window are two windows of a split-screen interface of the electronic device. 15. The electronic device according to claim 14, wherein the processing unit is further configured to: Determining the position of the second window according to the position of the first window; The processing unit is specifically used for: The first operation is performed on the second window according to the position of the second window. 16. The electronic device according to any one of claims 10 to 13, wherein the first interface further comprises a third window, and the processing unit is further configured to: Prompting the user to determine a target window for the first operation; A second user input is received from a user, where the second user input is used to determine that the target window is the second window. 17 . The electronic device according to claim 10 , wherein the application corresponding to the first window is a note application or a memo application. 18 . The electronic device according to claim 10 , wherein the application corresponding to the second window is a video application or a document application. 19. A computer storage medium, when the computer instructions are executed on an electronic device, enables the electronic device to execute the display method according to any one of claims 1 to 9. 20. A chip system, characterized in that it comprises at least one processor, and when program instructions are executed in the at least one processor, the at least one processor executes the method as described in any one of claims 1 to 9.