[go: up one dir, main page]

WO2018072459A1 - 一种屏幕截图和读取的方法及终端 - Google Patents

一种屏幕截图和读取的方法及终端 Download PDF

Info

Publication number
WO2018072459A1
WO2018072459A1 PCT/CN2017/088129 CN2017088129W WO2018072459A1 WO 2018072459 A1 WO2018072459 A1 WO 2018072459A1 CN 2017088129 W CN2017088129 W CN 2017088129W WO 2018072459 A1 WO2018072459 A1 WO 2018072459A1
Authority
WO
WIPO (PCT)
Prior art keywords
screenshot
target element
user interface
terminal
target
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2017/088129
Other languages
English (en)
French (fr)
Inventor
黄曦
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huawei Technologies Co Ltd
Original Assignee
Huawei Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Technologies Co Ltd filed Critical Huawei Technologies Co Ltd
Priority to US16/342,717 priority Critical patent/US11003331B2/en
Priority to CN201780005428.7A priority patent/CN108496150B/zh
Publication of WO2018072459A1 publication Critical patent/WO2018072459A1/zh
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L51/00—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
    • H04L51/07—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail characterised by the inclusion of specific contents
    • H04L51/10—Multimedia information
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90—Details of database functions independent of the retrieved data types
    • G06F16/95—Retrieval from the web
    • G06F16/955—Retrieval from the web using information identifiers, e.g. uniform resource locators [URL]
    • G06F16/9566—URL specific, e.g. using aliases, detecting broken or misspelled links
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/0482—Interaction with lists of selectable items, e.g. menus
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04845—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range for image manipulation, e.g. dragging, rotation, expansion or change of colour
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L51/00—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
    • H04L51/21—Monitoring or handling of messages
    • H04L51/216—Handling conversation history, e.g. grouping of messages in sessions or threads

Definitions

  • Embodiments of the present invention relate to the field of data transmission content, and in particular, to a screenshot and a reading method and a terminal.
  • Screen captures also known as screenshots
  • screenshots are now commonly used to capture content on screens, especially for content that is inconvenient to share at a time, such as chat logs, and often choose to share it with others through screenshots.
  • the user can take a screenshot of the screen display by triggering a combination button on the terminal, such as a power button plus a volume down button or a power button plus a primary button.
  • a combination button on the terminal such as a power button plus a volume down button or a power button plus a primary button.
  • the terminal acquires the content in the video memory.
  • the terminal running the Android system acquires the content in the framebuffer, and generates a screenshot according to the content in the video memory.
  • the generated screenshot can also be identified.
  • the terminal obtains the original image by using the application corresponding to the image in the screenshot, and then compresses the obtained original image and screenshot into The compressed package is sent in the form of a compressed package, so that when the screenshot is displayed, the original picture corresponding to the picture included in the screenshot of the display screen can be triggered.
  • the original picture is obtained by recognizing the content in the screenshot, and the original picture and the screenshot are compressed into a compressed package, which increases the complexity of the screenshot process.
  • the format of the original image corresponding to the image in the screenshot may be different from the format of the screenshot, and the format of the original image corresponding to the image in the screenshot may be various, and the original image generated by the above method is included.
  • the embodiment of the present invention provides a screen shot and a reading method and a terminal, which solve the problem in the prior art by recognizing the content in the generated screenshot, and obtaining the content in the screenshot, and then The content of the screenshot and the screenshot are compressed into a compressed package, which is sent in the form of a compressed package, which adds complexity.
  • the method provided by the embodiment of the present invention solves the problem that the format of the original picture corresponding to the picture included in the screenshot is incompatible with the format of the screenshot, and can only identify and obtain the picture element and the text element in the screenshot.
  • the problem is that the recognition richness of the content is limited, and the user cannot choose to send and receive one or more elements.
  • an embodiment of the present invention provides a method for a screenshot, where the method includes: receiving, by a first terminal a screen capture instruction, the screen capture instruction is used to instruct the first terminal to acquire a screenshot of the user interface of the first terminal; the first terminal determines a target element in the user interface; the first terminal determines an association relationship between the target element and the screenshot of the user interface; the first terminal determines The screenshot image of the user interface, the screenshot image of the user interface includes: a screenshot of the user interface, a target element, and a relationship between the target element and a screenshot of the user interface.
  • the target element in the user interface is determined by the terminal, and the relationship between the target element and the screenshot of the target element and the user interface is embedded in the screenshot picture of the user interface, and the format of the screenshot and the original corresponding to the picture included in the screenshot are solved.
  • the format of the image is incompatible, the image elements and text elements in the screenshot can only be identified and obtained, and the user is provided with the option of sending and receiving one or more elements, thereby improving the user experience.
  • the method for determining that the first terminal determines a target element in the user interface may include: determining, by the first terminal, the target element according to the target format, where the target format includes a picture format, a video format, an audio format, and a map. At least one of a format, or a format of a hyperlink; each target format in the target format includes at least one file format.
  • the method for determining that the first terminal determines a target element in the user interface may include: determining, by the first terminal, content of the target element, where the content includes a layout file and/or an original file, where the layout file includes: The source code and source address of the target element.
  • the method of “associating a target element with a screenshot of a user interface” may include: a location of a target element and a target element in a screenshot of the user interface, and a target element and a target element in the user interface. The relationship between the proportions of the screenshots.
  • the first terminal determines a screenshot picture of the user interface
  • the screenshot picture of the user interface includes: a screenshot of the user interface, a target element, and a relationship between the target element and a screenshot of the user interface”.
  • the method may include embedding a screenshot of the user interface, a target element, and an association relationship between the target element and the screenshot of the user interface in a metadata field of the screenshot image of the user interface.
  • the method that the “first terminal receives a screen capture instruction, and the screen capture instruction is used to instruct the first terminal to acquire a screenshot of the user interface of the first terminal” may include: the first terminal receives the screen capture instruction, A terminal determines an application of one or more of the plurality of applications running in the foreground of the first terminal according to the screen capture instruction.
  • the method that the “first terminal determines the application of one or more of the multiple applications running in the foreground of the first terminal” may include: the first terminal runs according to the foreground At least one application and a target format determine a target element in the user interface, the target format including at least one of a picture format, a video format, an audio format, a map format, or a hyperlink format; each target in the target format The format includes at least one format.
  • the method for “the first terminal acquires the target element according to at least one application running in the foreground” may include: determining, by the first terminal, content of the target element according to at least one application running in the foreground
  • the content includes a layout file and/or an original file
  • the layout file includes: source code and source address of the target element.
  • the first terminal determines a screenshot picture of the user interface
  • the screenshot picture of the user interface includes: a screenshot of the user interface, a target element, and a relationship between the target element and a screenshot of the user interface”.
  • the method includes: the first terminal displays a selection list of the target elements to provide one or more target elements included in the selection list of the user selection target elements; the screenshot after the user is selected, the target element selected by the user, and the user selected The association between the target element and the screenshot selected by the user is embedded in the screenshot image of the user interface.
  • selection list of target elements includes: a number of target elements and/or preview information.
  • the foregoing “embrating the screenshot of the interface after the user is selected, the target element selected by the user, and the relationship between the target element selected by the user and the screenshot of the interface selected by the user are embedded in the user interface.
  • the method in the screenshot picture may include: the first terminal sends the screenshot picture of the user interface.
  • the method for “sending a screenshot image of a user interface by the first terminal” includes: if the user interface of the first terminal includes a plurality of target elements selected by the user, The screenshot is sent separately with a plurality of the user-selected target elements; sending the plurality of user-selected target elements includes adopting a method of transmitting the original file and/or the layout file in the target element.
  • an embodiment of the present invention provides a method for reading a screenshot, where the method includes: the second terminal receives a screenshot image of the user interface, and the screenshot image of the user interface includes: a screenshot of the user interface, a target element, and a target element and An association relationship between the screenshots of the user interface; determining, according to the association relationship between the target element and the screenshot of the user interface, when the trigger point is located in an area of the at least one target element; displaying the original file corresponding to one of the at least one target element .
  • the screenshot image of the user interface is determined by the terminal, and one or more target elements in the screenshot image of the user interface are obtained.
  • the embodiment of the invention provides a method for reading a screenshot. Under certain conditions, more information can be obtained, the operation is simple, and compatibility problems are not generated when the screenshot image is received, and the user can subjectively select one or more.
  • the element improves the user's quality and solves the problem that the target element recognition richness in the screenshot image is limited.
  • the method for the second terminal to present a target element may include: the second terminal presents content of a target element, where the content includes a layout file, and the layout file includes: source code and source of the target element.
  • the address, layout file corresponds to the application; the content of a target element is displayed according to the layout file and the application.
  • the target element includes a source address of the original file
  • the original file is obtained according to the source address of the original file, where the source address of the original file includes a uniform resource locator.
  • an embodiment of the present invention provides a terminal for a screenshot, where the terminal includes:
  • the receiver is configured to receive a screen capture instruction, and the screen capture instruction is used to indicate that the user interface of the first terminal is intercepted.
  • a processor that determines the target element in the user interface.
  • the processor is further configured to determine an association relationship between the target element and the screenshot of the user interface; determine a screenshot image of the user interface, and the screenshot image of the user interface includes: a screenshot of the user interface, a target element, and a relationship between the target element and a screenshot of the user interface. .
  • the target element in the user interface is determined by the processor, and the relationship between the target element and the screenshot of the information and the user interface is embedded in the screenshot picture of the user interface.
  • the foregoing processor is specifically configured to determine a target element according to a target format, where the target format includes at least one of a picture format, a video format, an audio format, a map format, or a hyperlink format; Each target format in the format includes at least one format.
  • the foregoing processor is specifically configured to determine content of a target element, and the content package include layout files and / or original files, including: source code and source address of the target element.
  • the relationship between the target element and the screenshot of the user interface includes: a position of the target element and the target element in the screenshot of the user interface, and a ratio of the target element and the target element in the screenshot of the user interface. The relationship between them.
  • the foregoing processor is specifically configured to embed the relationship between the screenshot, the target element, and the screenshot of the target element and the user interface in a metadata field of the screenshot image of the user interface.
  • the receiver is specifically configured to receive a screen capture instruction, where the screen capture instruction is used to instruct the first terminal to obtain a screenshot of the user interface of the first terminal, where the processor is specifically configured to determine according to the screen capture instruction An application of one or more of a plurality of applications running in the foreground of the first terminal.
  • the foregoing processor is specifically configured to determine a target element in the user interface according to at least one application running in the foreground and a target format, where the target format includes a picture format, a video format, an audio format, and a map. At least one of a format, or a format of a hyperlink; each target format in the target format includes at least one format.
  • the foregoing processor is specifically configured to determine, according to at least one application running in the foreground, content of the target element, where the content includes a layout file and/or an original file, where the layout file includes: source code of the target element. And source address.
  • a display screen is configured to display a selection list of target elements to prompt the user to select one or more target elements in the target element selection list; the processor is specifically configured to select the user after The screenshot of the interface, the target element selected by the user, and the association relationship between the target element selected by the user and the screenshot of the interface selected by the user are embedded in the screenshot image of the user interface.
  • the “target element selection list” may include: a number of the target element and/or preview information.
  • the transmitter is configured to send a screenshot image of the user interface
  • the screenshot image of the user interface includes: a screenshot of the user interface, a target element, and a relationship between the target element and a screenshot of the user interface.
  • the foregoing processor is specifically configured to: if the user interface of the first terminal includes a plurality of target elements selected by the user, respectively, the screenshot of the user interface and the target elements selected by the plurality of users respectively Sending; sending a plurality of user-selected target elements includes using a method of sending original files and/or layout files in the target element.
  • an embodiment of the present invention provides a terminal for reading a screenshot, where the terminal includes:
  • the receiver is configured to receive a screenshot image of the user interface, and the screenshot image of the user interface includes: a screenshot of the user interface, a target element, and a relationship between the target element and a screenshot of the user interface.
  • a processor configured to determine, according to an association relationship between the target element and the screenshot of the user interface, when the trigger point is located in an area of the at least one target element; and display the original file corresponding to one of the at least one target element.
  • the screenshot image of the user interface is determined by the processor, and one or more target elements in the screenshot image of the user interface are obtained.
  • the embodiment of the invention provides a terminal for reading a screenshot. Under certain conditions, it can acquire more information, and the operation is simple, and the compatibility problem is not generated when the screenshot image is received. The user can subjectively select one or more. The element improves the user's quality and solves the problem that the target element recognition richness in the screenshot image is limited.
  • the terminal further includes: a display screen for presenting a target element, including: The display presents the content of a target element, the content includes a layout file, the layout file includes: source code and source address of the target element, the layout file corresponds to the application; and the content of a target element is displayed according to the layout file and the application.
  • the foregoing “target element” may include a source address of the original file; and the original file is obtained according to the source address of the original file, and the source address of the original file includes a uniform resource locator.
  • an embodiment of the present application provides a computer readable storage medium, where the computer readable storage medium stores instructions that, when run on a computer, cause the computer to perform the methods described in the above aspects.
  • an embodiment of the present application provides a computer program product comprising instructions that, when run on a computer, cause the computer to perform the methods described in the above aspects.
  • FIG. 1 is a schematic structural diagram of a terminal of a screenshot according to an embodiment of the present invention.
  • FIG. 2 is a flowchart of a method for taking a screenshot according to an embodiment of the present invention
  • FIG. 3 is a schematic structural diagram of another mobile phone with a screenshot according to an embodiment of the present invention.
  • FIG. 4 is a schematic diagram of a mobile phone interface according to an embodiment of the present invention.
  • FIG. 5 is another schematic diagram of an interface provided by an embodiment of the present application.
  • FIG. 6 is a schematic diagram of still another interface provided by an embodiment of the present application.
  • FIG. 7 is a schematic diagram of still another interface provided by an embodiment of the present application.
  • FIG. 8 is a schematic diagram of still another interface provided by an embodiment of the present application.
  • FIG. 9 is a schematic diagram of still another interface provided by an embodiment of the present application.
  • FIG. 10 is a flowchart of another method for taking a screenshot according to an embodiment of the present invention.
  • FIG. 11 is a schematic diagram of still another interface provided by an embodiment of the present application.
  • FIG. 12 is a schematic diagram of still another interface provided by an embodiment of the present application.
  • FIG. 13 is a schematic diagram of still another interface provided by an embodiment of the present application.
  • FIG. 14 is a flowchart of still another method for taking a screenshot according to an embodiment of the present application.
  • FIG. 15 is a flowchart of a method for reading a screenshot according to an embodiment of the present application
  • FIG. 16 is a schematic diagram of still another interface provided by an embodiment of the present application.
  • FIG. 17 is a schematic diagram of still another interface provided by an embodiment of the present application.
  • FIG. 18 is a schematic diagram of still another interface provided by an embodiment of the present application.
  • FIG. 20 is a schematic structural diagram of another terminal involved in the embodiment of the present application.
  • the terminal in the embodiment of the present invention includes: a terminal for screenshots and a terminal for reading a screenshot image, where the two terminals can be a terminal, that is, the terminal can intercept the screenshot image, You can read the screenshot image.
  • the terminal may include a mobile phone, a tablet computer, a notebook computer, a personal digital assistant (PDA), a point of sales (POS), and a car computer.
  • the terminal can include at least a memory, a touch screen, and a processor.
  • the memory can be used to store a software program.
  • the processor executes various functions of the terminal by running a software program stored in the memory, and the touch screen can be used to display information input by the user and provide the information to the user.
  • the information as well as the various menus of the terminal can also accept user input.
  • the following terminals are specifically described by taking a mobile phone as an example.
  • FIG. 1 is a schematic structural diagram of a terminal according to an embodiment of the present invention.
  • FIG. 1 is a schematic structural diagram of a mobile phone related to an embodiment of the present application.
  • a block diagram of a partial structure of the mobile phone 100 The mobile phone 100 includes an RF (Radio Frequency) circuit 110, a memory 120, an input unit 130, a display unit 140, a sensor 150, an audio circuit 160, a WiFi (Wireless Fidelity) module 170, and a processor 180.
  • the power supply 190 It will be understood by those skilled in the art that the structure of the handset shown in FIG. 1 does not constitute a limitation to the handset, and may include more or less components than those illustrated, or some components may be combined, or different components may be arranged.
  • the components of the mobile phone 100 will be specifically described below with reference to FIG. 1 :
  • the RF circuit 110 can be used for transmitting and receiving information or receiving and transmitting signals during a call.
  • the RF circuit 110 receives the downlink information of the base station, and sends the downlink information of the base station to the processor 180, where the server processes the downlink information.
  • the RF circuit 110 can also send the designed uplink data to the base station.
  • RF circuits include, but are not limited to, an antenna, at least one amplifier, a transceiver, a coupler, an LNA (Low Noise Amplifier), a duplexer, and the like.
  • RF circuitry 110 can also communicate with the network and/or other devices via wireless communication.
  • the wireless communication can use any communication standard or protocol, including but not limited to GSM (Global System of Mobile communication), GPRS (General Packet Radio Service), CDMA (Code Division Multiple Access, Code division multiple access), WCDMA (Wideband Code Division Multiple Access), LTE (Long Term Evolution), e-mail, and SMS (Short Messaging Service).
  • GSM Global System of Mobile communication
  • GPRS General Packet Radio Service
  • CDMA Code Division Multiple Access, Code division multiple access
  • WCDMA Wideband Code Division Multiple Access
  • LTE Long Term Evolution
  • e-mail Short Messaging Service
  • the memory 120 can be used to store software programs and modules.
  • the memory 120 includes, but is not limited to, an operating system, a communication module, a contact/moving module, a graphics module, a text output module, a GPS system module, an application, a content intercepting module, a camera module, a standby module, and a lock screen module.
  • the memory 120 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application required for at least one function (such as a sound playing function, an image playing function, etc.), and the like; Data (such as audio data, phone book, etc.) created according to the use of the mobile phone 100 can be stored.
  • Memory 120 may also include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.
  • the memory 120 includes a contact/motion module for detecting contact of an object or finger with the touch screen 140 or the point-and-click touch dial, capturing the speed (direction and size) of the contact, acceleration (change in size or direction), and determining the type of contact event.
  • a variety of contact event detection modules figure-down/dragging/up/tap, sometimes combining gestures with elements in the UI interface to achieve some operations: pinching/depinching (finger squeeze/expansion) and so on.
  • the graphics module is used to render and display graphics on a touch screen or other display, including web pages, icons, digital images, videos, and animations.
  • Applications can include contacts, phones, video conferencing, email clients, instant messaging, personal transport Cameras, video management, video players, music players, calendars, plugins (weather, stocks, calculators, clocks, dictionaries), custom plugins, search, notes, maps, online videos and more.
  • the input unit 130 can be configured to receive input digital or character information, and generate key signal input related to user settings and function control of the mobile phone 100.
  • the input unit 130 may include a touch panel 131 and other input devices 132.
  • the touch panel 131 also referred to as a touch screen, can collect touch operations on or near the user (such as the user using a finger, a stylus, or the like on the touch panel 131 or on the touch panel 131. The nearby operation), and the corresponding connection device is driven according to a preset program.
  • the touch panel 131 may further include two parts of the touch detection device and the touch controller.
  • the touch detection device detects the touch orientation of the user, and detects a signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts the touch information into contact coordinates, and sends the touch information.
  • the processor 180 is provided and can receive commands from the processor 180 and execute them.
  • the touch panel 131 can be implemented in various types such as a resistive type, a capacitive type, an infrared ray, and a surface acoustic wave.
  • the input unit 130 may also include other input devices 132.
  • the other input devices 132 may include, but are not limited to, one or more of a physical keyboard, function keys (such as volume control buttons, switch buttons, etc.), trackballs, mice, joysticks, and the like.
  • the display unit 140 can be used to display information input by the user or information provided to the user and various menus of the mobile phone 100.
  • the display unit 140 may include a display panel 141.
  • the display panel 141 may be configured in the form of an LCD (Liquid Crystal Display), an OLED (Organic Light-Emitting Diode), or the like.
  • the touch panel 131 can cover the display panel 141. When the touch panel 131 detects a touch operation on or near the touch panel 131, the touch panel 131 transmits to the processor 180 to determine the type of the touch event, and then the processor 180 according to the touch event. The type provides a corresponding visual output on display panel 141.
  • the touch panel 131 and the display panel 141 are two independent components to implement the input and input functions of the mobile phone 100 in FIG. 1, in some embodiments, the touch panel 131 may be integrated with the display panel 141. The input and output functions of the mobile phone 100 are implemented. Further, for the present invention, the display unit may also provide a display of a screenshot picture or the like.
  • the handset 100 can also include at least one type of sensor 150, such as a light sensor, motion sensor, and other sensors.
  • the light sensor may include an ambient light sensor and a proximity sensor, wherein the ambient light sensor may adjust the brightness of the display panel 141 according to the brightness of the ambient light, and the proximity sensor may close the display panel 141 when the mobile phone 100 moves to the ear. / or backlight.
  • the accelerometer sensor can detect the magnitude of acceleration in all directions (usually three axes). When it is stationary, it can detect the magnitude and direction of gravity. It can be used to identify the gesture of the mobile phone (such as horizontal and vertical screen switching, related Game, magnetometer attitude calibration), vibration recognition related functions (such as pedometer, tapping), etc.
  • the mobile phone 100 can also be configured with gyroscopes, barometers, hygrometers, thermometers, infrared sensors and other sensors, here Let me repeat.
  • the audio circuit 160, the speaker 161, and the microphone 162 can provide an audio interface between the user and the handset 100.
  • the audio circuit 160 can transmit the converted electrical data of the received audio data to the speaker 161 for conversion to the sound signal output by the speaker 161; on the other hand, the microphone 162 converts the collected sound signal into an electrical signal by the audio circuit 160. After receiving, it is converted into audio data, and then the audio data is output to the RF circuit 110 for transmission to, for example, another mobile phone, or the audio data is output to the memory 120 for further processing.
  • WiFi is a short-range wireless transmission technology
  • the mobile phone 100 can help users to send and receive emails, browse web pages, and access streaming media through the WiFi module 170, which provides wireless broadband Internet access for users.
  • FIG. 1 shows the WiFi module 170, it can be understood that it does not belong to the necessary configuration of the mobile phone 100, and can be completely based on It is necessary to omit it within the scope of not changing the essence of the invention.
  • the processor 180 executes various functional applications and data processing of the mobile phone 100 by running software programs and modules stored in the memory 120.
  • the processor 180 is the control center of the handset 100, connecting various portions of the entire handset with various interfaces and lines, by running or executing software programs and/or modules stored in the memory 120, and recalling data stored in the memory 120,
  • the various functions and processing data of the mobile phone 100 are executed to perform overall monitoring of the mobile phone.
  • the processor 180 may include one or more processing units; the processor 180 may integrate an application processor and a modem processor, where the application processor mainly processes an operating system, a user interface, an application, etc., and a modulation solution
  • the processor mainly handles wireless communication. It can be understood that the above modem processor may not be integrated into the processor 180.
  • the handset 100 also includes a power source 190 (such as a battery) that powers various components, wherein the power source can be logically coupled to the processor 180 through a power management system to manage functions such as charging, discharging, and power consumption through the power management system.
  • a power source 190 such as a battery
  • the power source can be logically coupled to the processor 180 through a power management system to manage functions such as charging, discharging, and power consumption through the power management system.
  • the mobile phone 100 may further include a camera, a Bluetooth module, and the like, and details are not described herein.
  • FIG. 2 is a flowchart of a method for taking a screenshot according to an embodiment of the present invention. As shown in FIG. 2, the method specifically includes:
  • the first terminal receives a screen capture instruction, where the screen capture instruction is used to instruct the first terminal to acquire a screenshot of the user interface of the first terminal.
  • this step is mainly executed by the instruction receiving module, and needs to cooperate with hardware modules, such as an input unit and a sensor unit.
  • the input unit is used to obtain input of the user, such as pressing/activating a button or a sensor; the sensor unit is used to acquire a fingerprint of the user or a motion state of the device.
  • the mobile phone 200 includes a body 1 and a touch screen 2 (for example, the touch screen 131 shown in FIG. 1) as shown in FIG.
  • the input and output functions of the handset 200 can be implemented by integrating the touch screen 2 with a display panel (e.g., 141 as shown in FIG. 1).
  • the body 1 includes a camera 11, a photosensitive element 12, an earpiece 13, a physical key 14, a power key 15, a volume key 16, and the like.
  • the camera 11 can include a front camera and a rear camera.
  • the photosensitive element 12 is mainly used for sensing the distance between the human body and the mobile phone.
  • the physical key 14 is generally a Home key, and may also be a Home key integrated with a fingerprint recognition module.
  • the physical key 14 may further include a return key, a menu key, and an exit key.
  • the physical key 14 may also be a touch key of a set position on the touch screen.
  • the physical key 14, the power key 15 and the volume key 16 may be specifically referred to the description of the other input devices 130 in the embodiment shown in FIG. 1. It should be noted that the embodiment of the present application may further include a microphone 17, a data interface 18, a Subscriber Identification Module (SIM) card interface (not shown), a headphone interface 19, and the like.
  • SIM Subscriber Identification Module
  • the mobile phone 200 shown in FIG. 2 is merely an example and is not limiting, and may include more or less components than those illustrated, or combine some components, or split certain components, or different components. Arrangement.
  • the triggering manner of the screen capture operation may at least include the following manners:
  • Method 1 receiving an input signal of the input screen capture through a physical button on the terminal, for example, a combination button included in the other input device 132 in the input unit 130: a power button 15+ a volume button 16, a dedicated button as shown in FIG.
  • the key 14 may also be a fingerprint sensor or the like included in the sensor 150; the receiving screen capture command is a receiving button that the user presses/activates the above-mentioned button or sensor.
  • Method 2 receiving an input signal of the input screen capture by using a virtual button on the terminal, such as a screen capture button in the notification column displayed by the display panel 141 in the display unit 140, a screenshot button of the interface resident, etc.; receiving the screen capture instruction is input through The touch panel 131 in the unit 130 receives a touch operation of the user at a corresponding position of the screen capture button.
  • a virtual button on the terminal such as a screen capture button in the notification column displayed by the display panel 141 in the display unit 140, a screenshot button of the interface resident, etc.
  • Mode 3 receiving a user's voice operation command through the microphone 17 (for example, the microphone 162 in the audio circuit 160 shown in FIG. 1); using the camera 11 and the photosensitive element 12 (for example, the image in 150 as shown in FIG. 1)
  • the sensor receives an eye movement instruction and/or a gesture control instruction command or the like; that is, receives the user's voice instruction through the microphone 17, or tracks the user's eye movement through the camera 11, or acquires through a motion sensor (such as an acceleration, a three-axis gyroscope, etc.) The action of the user's hand, or the pressure sensor to obtain the magnitude of the user's pressing force.
  • a motion sensor such as an acceleration, a three-axis gyroscope, etc.
  • Method 4 As shown in FIG. 3, the finger 3 or the stylus 4 can be used to perform a screen capture operation by clicking, swiping, etc. on the touch screen, and the touch panel can detect these screen capture operations, and the touch screen can also be referred to as a screen.
  • the first terminal determines a target element in the user interface.
  • the first terminal determines a target element of the plurality of elements in the user interface.
  • the plurality of elements may include: text, picture, audio, geographic location, link, and business card, etc.
  • the target element included in the user interface may be determined by the processor 180 executing the program code stored in the memory 120 as in FIG.
  • 401 is a video element
  • 402 is a text element
  • 403 is a picture element
  • 404 is a voice element.
  • the manner of determining the target element of the plurality of elements included in the user interface may include at least the following manner:
  • the terminal determines by means of image recognition (image recognition of the current user interface may be performed by, for example, a graphics module in the memory 120 of FIG. 1 to determine a target element).
  • image recognition image recognition of the current user interface may be performed by, for example, a graphics module in the memory 120 of FIG. 1 to determine a target element.
  • the visual elements such as the text elements and the picture elements in the user interface can be distinguished by the image recognition technology, and the text elements can be further identified by OCR (Optical Character Recognition) technology for the image elements.
  • OCR Optical Character Recognition
  • the content included in the picture may be further identified, and the label may be selectively labeled, and the label may include: a character, a scene, an item, and the like.
  • the picture element 403 is currently displayed as a task in FIG. 4
  • the picture may be Element 403 is labeled as a task, and the label position can be optionally marked on the picture.
  • the terminal recognizes that the picture element includes: trees and mountains, the label
  • Method 2 You can also obtain the elements contained in the user interface by analyzing the UI layout file of the application.
  • the UI layout file of the application can be the layout file of the user interface of the application, and the UI layout file can be Includes the source code of the web page and/or the source address of the target element.
  • the terminal determines a target element included in a plurality of elements in the user interface according to a target format in the UI layout file.
  • the first terminal determines the target element according to the target format, where the target format includes at least one of a picture format, a video format, an audio format, a map format, or a hyperlink format; each target format in the target format includes at least one format.
  • the first terminal can obtain not only the layout file of the target element, but also the original file of the target element. For example, as shown in FIG. 4, if the video element 401 is locally downloaded, the first terminal can directly obtain the video. The original file of the element 401; if the video element 401 is not downloaded locally, the first terminal may obtain the web address information of the video element 401 by obtaining the source code of the video element 401 in the webpage.
  • the above method of determining the target element can be used for a normal screen shot or a long screen shot to determine the target element.
  • the normal screen capture refers to intercepting the content of the user interface displayed in the current display page.
  • the long screen capture refers to intercepting the content included in the current display page, and the subsequent display is not displayed on the current display after the current display page.
  • the content of the page is shown in Figure 7.
  • whether the current interface includes a target element including but not limited to: picture, audio, video, link, geographic location information, etc., may be determined according to the foregoing method 1 and method 2.
  • step S220 the first terminal determines the original file and/or the layout file of the target element while determining the target element in the user interface, wherein the layout file may include: the target element Source code and source address.
  • Determining, by the first terminal, the target element in the user interface includes determining a storage location of the target element and a content of the target element, wherein the content of the target element includes an original file and/or a layout file of the target element, and the layout file may include: a target element Source code and source address.
  • the terminal determines the content of the target element and the storage location of the target element. For example, when the target element is a picture, if the terminal recognizes that the user interface includes two pictures, the storage location corresponding to the two pictures is obtained in the terminal or the webpage, and the corresponding two pieces are read or downloaded from the storage location. image.
  • the storage location may be in a non-volatile memory, such as an SD card, a built-in storage of the mobile phone, or a volatile memory, such as a memory or a video memory, or a URL on the Internet (Uniform Resource Locator, unified) Resource locator).
  • the storage location corresponding to the video is obtained, and the storage location may be any one of the above image storage locations, and is read from the storage location and/or Download the corresponding video.
  • the same manner as the image and/or video may be used for reading and/or downloading, and details are not described herein.
  • the first terminal determines an association relationship between the target element and a screenshot of the user interface.
  • the association relationship between the target element and the screenshot of the user interface includes: a relationship between the content of the target element and the location of the target element in the screenshot of the user interface, and the ratio of the content of the target element and the ratio of the target element to the screenshot of the user interface.
  • the first terminal determines a screenshot image of the user interface.
  • the screenshot image of the user interface includes: a screenshot of the user interface, a target element, and a relationship between the target element and a screenshot of the user interface.
  • the association relationship between the target element and the screenshot of the user interface is embedded in the metadata field of the screenshot image of the user interface.
  • the embedding method may be directly adding the target element to the thumbnail field (picture) and/or audio field (audio) of the EXIF (Exchangeable Image File) of the screen content picture; for example, the link, the geographical coordinate
  • the target element may be directly added to the thumbnail field (picture) and/or audio field (audio) of the EXIF (Exchangeable Image File) of the screen content picture; for example, the link, the geographical coordinate
  • attributes such as the display position, size, and shape of the screenshot of the target element in the user interface may be simultaneously added to the metadata of the screenshot image of the user interface for marking the screenshot image of the user interface. The location of the target image in the screenshot image of the user interface.
  • the user may select a target element that needs to be added to the screenshot image from all the target elements included in the user interface, and the form may be as shown in FIG. 7 , and the manner of receiving the user selection may be through input.
  • the touch panel 131 in the unit 130 acquires a touch operation of the user. For example, the user touches “Yes” in FIG. 1 to indicate that the video needs to be added to the screenshot image of the user interface, or may be through other input devices in the input unit 130. 132, such as physical button selection to add content.
  • the current interface includes multiple multimedia files of the same type, the user may be prompted to make a selection in the form of a number, or may prompt the user to select in a preview manner.
  • the display unit 140 Display a preview of the image.
  • the user can also select to add a picture element 403 in the current user interface to the screenshot while the screenshot is being taken.
  • a screenshot picture of the user interface is finally generated, which is processed by the processor 180 executing the program code stored in the memory 120.
  • the screenshot image of the user interface is generated according to the screenshot of the user interface, the target element, and the association relationship between the target element and the screenshot of the user interface.
  • the target image may be included in the screenshot image of the finally generated user interface, such as in the thumbnail field (picture) or Audio field (audio) of the screenshot image placed in the user interface mentioned above; if the current interface only includes text information , directly generate the current interface screenshot as a screenshot image of the user interface.
  • the communication module program in the memory 120 is executed by the processor 180 to send a screenshot picture of the user interface generated by the above method to other devices, the other devices including: other terminal devices.
  • the transmission mode may include, but is not limited to, wired transmission and wireless transmission.
  • FIG. 10 is a flowchart of another method for taking a screenshot according to an embodiment of the present invention. The embodiments of the present application are further described below with reference to FIG. 10 to FIG. 14. As shown in FIG. 10, the method specifically includes:
  • S1000 and S1001 are the same as S210 and S220, so they are not described here.
  • S1002 Acquire local and/or non-local storage location information of the target element.
  • the obtaining manner may be any one or a combination of the following, including:
  • Method 1 The first terminal sends the screenshot instruction to one or more applications of the plurality of applications running in the foreground, and the application of one or more of the multiple applications, while receiving the screen capture instruction Obtaining a storage location of the target element in the user interface, after receiving the screenshot instruction, the application of the one or more applications acquires the storage location of the target element in the user interface according to the request of the first terminal, and stores the location The location is returned to the first terminal; optionally, when the target element has access control, the application of one or more of the plurality of applications should at least give the first terminal permission to read the content of the target element.
  • Manner 2 After identifying the target element in the user interface in S1001, the first terminal searches for the content of the corresponding target element in the storage space of the first terminal or in the network according to the target element, and records the found content in the memory 120.
  • the storage location of the target element For example, as shown in Table 1 below:
  • S1003 Determine an association relationship between the target element and a screenshot of the user interface.
  • the name and storage location of the final screenshot image can be determined in advance, and the finally generated user interface is saved.
  • the content of the target element included in the screenshot image of the user interface may be cached in the first terminal, and after the screenshot image of the user interface is generated in S1004, the corresponding association relationship is saved. It may be understood that the screenshot of the user interface may be It is understood as a screenshot without adding associations and target elements.
  • association can be saved in the form of Table 2 below:
  • the two forms shown in the above table represent the screenshot 1.png with two element resources, 12.jpg and 34.wma. And the screenshot 2.png has an element resource qq.png.
  • the associated list can be temporarily saved in memory so that when the screenshot image of the user interface is generated, it is added to the attribute information of the screenshot.
  • the association list can also be directly saved in the non-volatile memory of the device, such as an SD card, a built-in memory card, etc.; the associated list can also be uploaded to the cloud for storage, and only the locally recorded access link or location saved in the cloud can be used.
  • the form of the URL or URI is mapped to the cloud.
  • a description field may be added to the screenshot image of the user interface, which is used to indicate that the screenshot image of the user interface includes element content; and may be generated in the user interface. Add the associated file information to the attribute information of the screenshot image.
  • S1005 Acquire an instruction for sending and/or sharing.
  • the method for sending and/or sharing the screenshot image of the user interface may be as follows: in the image browser/file manager, after selecting the file, clicking the share button, and selecting the sharing method for sharing, as shown in FIG.
  • the operation can be performed by the input method mentioned in S1000.
  • the user sends one or more screenshots in the chat interface by selecting a sending picture.
  • the shared picture can be edited through an editing interface such as an email client or instant messaging in the application.
  • Figure 12 uses WeChat and Weibo as examples.
  • the manner of obtaining the above operation may be: detecting the position of the button clicked by the user, and the action triggered by the button. If the button triggers the call to the picture browser, the user's current request may be determined as a request to share the screenshot image of the user interface.
  • the method for obtaining a request for a user to send/share a screenshot image of a user interface is not limited herein, and the user may obtain a request for sending/sharing a screenshot image of the user interface in any other feasible manner.
  • S1006 Determine whether the instruction sent and/or shared includes at least one target element, if yes, execute S1007, otherwise, execute S1008.
  • the way to judge can be as follows:
  • the screenshot picture is processed by the processor 180 executing the program code stored in the memory 120.
  • the manner of embedding the target element to the screenshot image of the user interface is the same as the embedding manner of the S240; and the method for generating the screenshot image of the user interface to be sent and the S240 The transmission method is the same, so it will not be described here.
  • the communication module program in the memory 120 is executed by the processor 180 to send a screenshot picture of the user interface to other devices, and other devices include other terminals.
  • FIG. 14 is a flowchart of still another method for taking a screenshot according to an embodiment of the present invention. As shown in FIG. 14, the method specifically includes:
  • S1401 and S1402 are the same as S210 and S220, so they are not described here.
  • S1403, S1404, S1405, S1406, and S1407 are the same as S1002, S1003, S1004, S1005, and S1006 in the method flowchart of another screen shot provided by the embodiment of the present invention, and therefore are not described herein again.
  • S1408 Determine whether the sending user interface screenshot sends the target element at the same time.
  • the instruction receiving module receives the selection instruction input by the user through the input unit, and the input mode includes but is not limited to the input in S1000. the way.
  • the communication module program in the memory 120 is executed by the processor 180 to send the screenshot to other devices.
  • the difference between the embodiment described in FIG. 10 is that the embodiment described in FIG. 10 generates a screenshot image of the user interface, and a new user interface.
  • the screenshot image includes at least one target element, and the embodiment does not generate a screenshot image of the user interface, but separately sends the screenshot of the user interface and the target element separately, and the target element at this time may be the original file of the target element. It can also be a layout file for the target file.
  • the screenshot of the user interface includes two images (picture A and picture B) and a video
  • the target element needs to be acquired according to the associated file.
  • the storage location that is, the original picture A, the original picture B, and the storage location of the video, respectively send the original picture A, the original picture B, and the original file and/or layout file of the video (eg, the connection of the web page, etc.) to the receiving square.
  • This embodiment is similar to the embodiment described in FIG. 10. This step also allows the user to select a target element to be transmitted, and transmits according to the user's selection.
  • FIG. 15 is a flowchart of a method for reading a screenshot according to an embodiment of the present application. As shown in Figure 15, the method includes:
  • the second terminal receives a screenshot image of the user interface.
  • the screenshot picture of the user interface includes: a screenshot of the user interface of the first terminal, a target element, and a relationship between the target element and a screenshot of the user interface; the target element includes an original file and/or a layout file, and each of the at least one target element
  • the format includes at least one of a picture format, a video format, an audio format, a map format, or a hyperlink format; the target element corresponds to the original file.
  • the target element may include a layout file, and the layout file may correspond to the application; the original file is displayed according to the layout file and the application.
  • the target element may include a source address of the original file; the original file is obtained according to the source address of the original file, and the source address of the original file includes a uniform resource locator.
  • the first terminal may be the same as or different from the second terminal.
  • the second terminal displays a screenshot picture of the user interface of the first terminal.
  • the manner in which the second terminal displays the screenshot image of the user interface of the first terminal may include at least the following manner:
  • Method 1 receiving an operation instruction for the user to browse the screenshot picture of the user interface, for example, the user selects and opens the picture in the file management/picture browsing program, and the display panel in the display unit 140 displays the picture preview interface stored in the memory 130 of the terminal 100, and inputs The touch panel 131 or other input device 132 of the unit 130 receives the user's selection operation at the picture preview interface.
  • the user's voice selection command may also be received through the microphone 162 of the audio circuit 160, or the user's gesture selection operation may be received by the gravity/acceleration sensor of the sensor 150, such as shaking, or receiving the user's gesture through the image sensor of the sensor 150. Select an action or an eyeball selection operation.
  • the manner of obtaining includes the following manners, corresponding to the embodiment described in FIG. 2 and FIG. 6, directly acquiring the screenshot image of the user interface, corresponding to the embodiment described in FIG.
  • the screenshot of the interface and the target elements included in the screenshot of the user interface can be, but are not limited to, the target elements in the screenshot image of the user interface:
  • the audio or thumbnail field in the screenshot image of the user interface may be read according to the target format to obtain corresponding audio and image content; the corresponding target element may be obtained through the associated target element included in the screenshot image of the user interface; When the target element is obtained, the size, shape, and position of the display element representing the target element can be obtained, so as to prompt the user when displaying the screenshot image of the user interface.
  • S1502. Determine, according to the association relationship between the target element and the screenshot of the user interface, that the trigger point is located in an area where the target element of the at least one target element is located, and then present content corresponding to one of the at least one target element.
  • the trigger point may be a user touch on the touch template 131, for example, a mouse cursor.
  • the screenshot image of the selected user interface is displayed by the display unit 140, and the screenshot image of the corresponding user interface is opened and displayed; the display manner may be full screen display, or half screen display, or displayed as any size; the screenshot image of the user interface is displayed. Previously, you could crop, or augment, or add a background to the screenshot image of the user interface.
  • the second terminal will pop up a prompt box, which prompts the user to select to obtain a view picture element or a video element or a voice element. Get the picture element if you select an image element.
  • the picture element or the video element or the voice element is a layout file (for example, a connection of a webpage, etc.), the user can select whether to download the picture from the webpage.
  • the terminal may highlight the target element identified by the target element in the screenshot image of the user interface. If the screenshot image of the user interface includes audio, the icon corresponding to the audio may be highlighted. Highlighting methods include, but are not limited to, bold borders, changing border colors, changing border shapes, changing icon sizes, animation effects, and more.
  • the second terminal determines whether the target image is included in the screenshot image of the current user interface.
  • the current touch position coordinates may be acquired. According to the current touch position coordinates, the operation target is the content at the corresponding coordinate position in the screenshot image of the user interface.
  • the user's voice operation instruction When the user's voice operation instruction is received through the microphone 162, the user's voice operation instruction can be converted into text by voice recognition, and the corresponding operation item is searched through the text and the content included in the screenshot image of the user interface. If the voice operation command is “Play the first audio”, you can find the first audio contained in the screenshot picture of the user interface, and use the first audio found as the operation target.
  • the attribute of the operation target may be determined after the operation target is acquired, for example, the user operation is received through the touch panel 131, and the operation target is a picture, and the corresponding image can be found.
  • the image file it is determined that the current operation target is the target element.
  • the operation target is audio and the corresponding audio file can be found, it is determined that the current operation target is the target element.
  • the operation target only includes text information
  • the user is provided with a text operation option; the text operation options include free selection, copying, searching for text, etc.; the text content can be identified by the OCR method; for the non-text content, according to Existing operational responses give the user an option to operate.
  • the screenshot picture of the user interface and the target element are separately transmitted. Therefore, the following steps can be performed when receiving: first receiving a screenshot of the user interface, and secondly receiving at least one target element.
  • the selection is to separately send the screen capture image and at least one element, so when receiving, it may be as shown in FIG. 18, and the user may start the required element information according to the need. .
  • a message can be received that includes picture elements and video elements. It can also be received in two, the first message receives the picture element and the second message receives the video element.
  • the at least one target element may include: an original file and/or a layout file of the target element (eg, a connection of a web page, etc.).
  • the target element corresponding to the operation target is acquired here, corresponding to the embodiment described in FIG. 2 and FIG. 10, the storage manner of the target element in the embodiment illustrated in FIG. Obtaining the file of the target element from the screenshot image of the user interface, and finding the storage location of the target element from the target element association list in the screenshot image of the user interface, and searching for the corresponding target element from the storage location.
  • the corresponding content is output according to the current operation target: when the current operation target is audio, the audio is played by using the speaker 161; when the current operation target is a picture, the display unit 140 is used to display the picture; when the current operation target is video, the speaker 161 is used. The audio in the video is played, and the picture (video frame) in the video is displayed using the display unit 140.
  • FIG. 19 is a schematic structural diagram of a terminal involved in an embodiment of the present application. As shown in FIG. 19, the terminal includes a display screen 1901, a receiver 1902, a processor 1903, and a transmitter 1904.
  • the transceiver can include a receiver 1902 and a transmitter 1904, which can be integrated.
  • the transmitter conditions (eg, analog conversion, filtering, amplification, upconversion, etc.) the output samples and generates an uplink signal that is transmitted to the network device via the antenna.
  • the antenna receives the downlink signal transmitted by the network device in the above embodiment.
  • the receiver conditions (eg, filters, amplifies, downconverts, digitizes, etc.) the signals received from the antenna and provides input samples.
  • the terminal may further include a modem processor, in the modem processor, receiving service data and signaling messages to be transmitted on the uplink, and processing the service data and the signaling message (eg, formatting, Coding and interleaving).
  • the encoded service data and signaling messages are further processed (e.g., symbol mapped and modulated) and provided with output samples.
  • the input samples are processed (e.g., demodulated) and provided with symbol estimates.
  • the symbol is processed (e.g., deinterleaved and decoded) and the decoded data and signaling messages sent to the UE are provided.
  • These units are processed according to the radio access technology employed by the radio access network (e.g., access technologies of LTE and other evolved systems).
  • the processor controls and manages the actions of the terminal for performing the processing performed by the terminal in the above embodiment. For example, other processes for controlling screenshots and/or the techniques described herein. Taking FIG. 19 as an example, this application The provided terminal is explained in detail as follows:
  • the receiver is configured to receive a screen capture instruction, and the screen capture instruction is used to indicate that the user interface of the first terminal is intercepted.
  • a processor that determines the target element in the user interface.
  • the processor is further configured to determine an association relationship between the target element and the screenshot of the user interface; determine a screenshot image of the user interface, and the screenshot image of the user interface includes: a screenshot of the user interface, a target element, and a relationship between the target element and a screenshot of the user interface. .
  • the processor is specifically configured to determine a target element according to a target format, where the target format includes at least one of a picture format, a video format, an audio format, a map format, or a hyperlink format; each of the target formats
  • the target format includes at least one format.
  • the processor is specifically configured to determine content of the target element, where the content includes a layout file and/or an original file, and the layout file includes: a source code and a source address of the target element.
  • the association relationship between the target element and the screenshot of the user interface includes: a relationship between the target element and the position of the target element in the screenshot of the user interface, and a ratio of the target element to the ratio of the target element in the screenshot of the user interface.
  • the foregoing processor is specifically configured to embed the relationship between the screenshot, the target element, and the screenshot of the target element and the user interface in a metadata field of the screenshot image of the user interface.
  • the receiver is specifically configured to receive a screen capture instruction, where the screen capture instruction is used to instruct the first terminal to obtain a screenshot of the user interface of the first terminal.
  • the processor is specifically configured to determine, according to the screen capture instruction, multiple applications running in the foreground of the first terminal. One or more applications in the program.
  • the processor is specifically configured to determine content of the target element according to at least one application running in the foreground, the content includes a layout file and/or an original file, and the layout file includes: a source code and a source address of the target element.
  • a display screen for displaying a selection list of target elements to prompt the user to select one or more target elements in the target element selection list;
  • a processor specifically for taking a screenshot of the interface after the user is selected, and a target element selected by the user And the association relationship between the target element selected by the user and the screenshot of the interface selected by the user is embedded in the screenshot picture of the user interface.
  • target element selection list may include: a number of the target element and/or preview information.
  • the processor is specifically configured to: if the user interface of the first terminal includes a plurality of target elements selected by the user, send the screenshot of the user interface and the target elements selected by the plurality of users separately; and send the target selected by the multiple users.
  • the elements include a method of sending the original file and/or layout file in the target element.
  • FIG. 20 is a schematic structural diagram of another terminal involved in the embodiment of the present application.
  • the terminal includes a display screen 2001, a receiver 2002, and a processor 2003.
  • another terminal provided by the present application has the same structure and function as the terminal provided in FIG. 19, except that the interface embodied by the two steps of distinguishing between the screen capture and the reading is different.
  • the processor controls and manages the actions of the terminal for performing the processing performed by the terminal in the above embodiment. For example, other processes for controlling screenshots and/or the techniques described herein. With reference to FIG. 19 as an example, another terminal provided by the present application is explained in detail as follows:
  • the receiver is configured to receive a screenshot image of the user interface, and the screenshot image of the user interface includes: a screenshot of the user interface, a target element, and a relationship between the target element and a screenshot of the user interface.
  • a processor configured to determine, according to an association relationship between the target element and a screenshot of the user interface, when the trigger point is located in an area of the at least one target element; displaying the original file corresponding to one of the at least one target element, the layout file Includes: source code and source address of the target element.
  • the terminal may further include: a display screen for presenting a target element, including: the display screen presents content of a target element, the content includes a layout file, and the layout file includes: a source code and a source address of the target element, and the layout file corresponds to the application ; Display the contents of a target element based on the layout file and the application.
  • the above "target element” may include a source address of the original file; the original file is obtained according to the source address of the original file, and the source address of the original file includes a uniform resource locator.
  • non-transitory English: non-trans itory
  • non-transitory such as random access memory, read-only memory, flash memory, hard disk, solid state disk, magnetic tape (English: magnetic tape), floppy disk (English: floppy disk), optical disc (English: optical disc ) and any combination thereof.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Databases & Information Systems (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Data Mining & Analysis (AREA)
  • Multimedia (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

一种屏幕截图和读取的方法及终端，涉及数据传输内容领域，具体方法包括：第一终端接收截屏指令，截屏指令用于指示第一终端获取第一终端的用户界面的截图(S210)；第一终端确定用户界面中的目标元素(S220)；第一终端确定目标元素与当前用户界面的截图的关联关系(S230)；第一终端确定用户界面的截图图片，用户界面的截图图片包括：用户界面的截图、目标元素以及目标元素与用户界面的截图的关联关系(S240)。由此，解决了现有技术中通过识别生成的截图中的内容来查找图片增加复杂性的问题、在某些条件下屏幕截图中包含图片对应的原始图片的格式与屏幕截图的格式不兼容的问题以及只能识别并获取截图中的图片元素和文字元素的问题。

Description

一种屏幕截图和读取的方法及终端
本申请要求2016年10月18日提交中国专利局、申请号为201610908768.8、发明名称为“一种截取，发送和呈现屏幕内容的方法和设备”的中国专利申请的优先权，其全部内容通过引用结合在本申请文件中。
技术领域
本发明实施例涉及数据传输内容领域，尤其涉及一种屏幕截图和读取的方法及终端。
背景技术
截屏又称屏幕截图，如今，用截屏获取屏幕上的内容是用户使用终端时常用的一个功能，特别是对于聊天记录等不方便一次性分享的内容，往往选择通过屏幕截图等方式分享给他人。
通常情况下，用户可以通过触发终端上的组合按键，如电源键加音量下键或是电源键加主键等对屏幕显示内容进行截图。当按键触发后，终端会获取显存中的内容，例如:运行Android系统的终端获取显存帧缓冲(framebuffer)中的内容，根据显存中的内容生成屏幕截图。另外，还可以对生成的屏幕截图进行识别，若识别出屏幕截图中包含图片，则终端通过屏幕截图中包含图片所对应的应用程序获取原始图片，再将获取到的原始图片与屏幕截图压缩为压缩包，以压缩包的形式进行发送，使得该屏幕截图在显示时，可触发显示屏幕截屏中包含图片对应的原始图片。
但是，由于上述方法中是完成截图之后，通过识别截图中的内容获取原始图片，并将该原始图片和截图压缩为压缩包的形式进行发送，此过程增加了截图过程的复杂性。而且由于屏幕截图中包含图片对应的原始图片的格式与屏幕截图的格式可能是不同的，且屏幕截图中包含图片对应的原始图片的格式可能是多种多样的，采用上述方法生成的包含原始图片的屏幕截图先发送给对端显示时，会产生兼容性问题。而且，上述方法中只能识别并获取截图中的图片元素和文字元素，使内容的识别程度受到了限制。
发明内容
为了克服相关技术中存在的问题，本发明实施例提供了一种屏幕截图和读取的方法及终端，解决现有技术中通过识别生成的截图中的内容,得到截图中的内容，再将该截图内容与截图压缩为压缩包，以压缩包的形式进行发送的方法,该方法增加复杂性的问题。在某些条件下，本发明实施例提供的方法解决了截图与截图中包含图片对应的原始图片的格式与截图的格式不兼容的问题、只能识别并获取截图中的图片元素和文字元素的问题，使内容的识别丰富度受到限制的问题，以及用户不能自主选择发送和接收一个或多个元素的问题。
第一方面，本发明实施例提供了一种屏幕截图的方法，该方法包括：第一终端接收 截屏指令，截屏指令用于指示第一终端获取第一终端的用户界面的截图；第一终端确定用户界面中目标元素；第一终端确定目标元素与用户界面的截图的关联关系；第一终端确定用户界面的截图图片，用户界面的截图图片包括：用户界面的截图、目标元素以及目标元素与用户界面的截图的关联关系。
本方案中，通过终端确定用户界面中目标元素，再将该目标元素和该目标元素与用户界面的截图的关联关系嵌入用户界面截图图片中，解决了截图的格式与截图中包含图片对应的原始图片的格式不兼容、只能识别并获取截图中的图片元素和文字元素、以及为用户提供自主选择发送和接收一个或多个元素的问题，从而提高用户体验。
在一个可选的实现方式中，上述“第一终端确定用户界面中的目标元素”的方法可以包括：第一终端根据目标格式确定目标元素，目标格式包括图片格式、视频格式、音频格式、地图格式、或超链接的格式中的至少一种；目标格式中的每个目标格式包括至少一种文件格式。
在另一个可选的实现方式中，上述“第一终端确定用户界面中目标元素”的方法可以包括：第一终端确定目标元素的内容，内容包括布局文件和/或原始文件，布局文件包括：目标元素的源代码和源地址。
在又一个可选的实现方式中，上述“目标元素与用户界面的截图的关联关系”的方法可以包括：目标元素与目标元素在用户界面的截图的位置、和目标元素与目标元素在用户界面的截图的比例之间的关联关系。
在再一个可选的实现方式中，上述“第一终端确定用户界面的截图图片，用户界面的截图图片包括：用户界面的截图、目标元素以及目标元素与用户界面的截图的关联关系”的方法可以包括：将用户界面的截图、目标元素以及目标元素与用户界面的截图的关联关系嵌入用户界面的截图图片的元数据字段中。
在再一个可选的实现方式中，上述“第一终端接收截屏指令，截屏指令用于指示第一终端获取第一终端的用户界面的截图”的方法可以包括：第一终端接收截屏指令，第一终端根据截屏指令确定在第一终端前台运行的多个应用程序中的一个或多个的应用程序。
在再一个可选的实现方式中，上述“第一终端确定在第一终端前台运行的多个应用程序中的一个或多个的所述应用程序”的方法可以包括：第一终端根据前台运行的至少一个应用程序以及目标格式确定在用户界面中的目标元素，目标格式包括图片格式、视频格式、音频格式、地图格式、或超链接的格式中的至少一种；目标格式中的每个目标格式包括至少一种格式。
在再一个可选的实现方式中，上述“第一终端根据前台运行的至少一个应用程序获取所述目标元素”的方法可以包括：第一终端根据前台运行的至少一个应用程序确定目标元素的内容，内容包括布局文件和/或原始文件，布局文件包括：目标元素的源代码和源地址。
在再一个可选的实现方式中，上述“第一终端确定用户界面的截图图片，用户界面的截图图片包括：用户界面的截图、目标元素以及目标元素与用户界面的截图的关联关系”的方法包括：第一终端显示目标元素的选择列表，以提供用户选择目标元素的选择列表中包括的一个或多个目标元素；将用户选定之后的截图、用户选定的目标元素以及用户选定的目标元素与用户选定之后的截图的关联关系嵌入用户界面的截图图片中。
在再一个可选的实现方式中，上述“目标元素的选择列表”包括：目标元素的编号和/或预览信息。
在再一个可选的实现方式中，上述“将用户选定之后界面的截图、用户选定的目标元素以及用户选定的目标元素与用户选定之后的界面的截图的关联关系嵌入用户界面的截图图片中”的方法之后可以包括：第一终端将用户界面的截图图片进行发送。
在再一个可选的实现方式中，上述“第一终端将用户界面的截图图片进行发送”的方法包括：若第一终端的用户界面包括多个用户选定的目标元素，则将用户界面的截图和多个所述用户选定的目标元素分别发送；发送多个用户选定的目标元素包括，采用发送目标元素中的原始文件和/或布局文件的方法。
第二方面，本发明实施例提供了一种读取截图的方法，该方法包括：第二终端接收用户界面的截图图片，用户界面的截图图片包括：用户界面的截图、目标元素以及目标元素与用户界面的截图的关联关系；根据目标元素与用户界面的的截图的关联关系确定触发点位于至少一个目标元素中的一个所在的区域时；则显示至少一个目标元素中的一个所对应的原始文件。
本方案中，通过终端确定用户界面的截图图片，获取用户界面的截图图片中的一个或多个目标元素。本发明实施例提供了一种读取截图的方法，在一定条件下，能够获取更多的信息，操作简单，不会在接收截图图片时产生兼容性问题，用户可以主观选择获取一个或多个元素，提高用户质量，解决了截图图片中的目标元素识别丰富度受到限制的问题。
在一个可选的实现方式中，上述第二终端呈现一个目标元素的方法中，可以包括：第二终端呈现一个目标元素的内容，内容包括布局文件，布局文件包括：目标元素的源代码和源地址，布局文件对应应用程序；根据布局文件以及应用程序显示一个目标元素的内容。
在另一个可选的实现方式中，上述目标元素包括原始文件的源地址；根据原始文件的源地址获取原始文件，原始文件的源地址包括统一资源定位符。
第三方面，本发明实施例提供了一种屏幕截图的终端，该终端包括：
接收器，用于接收截屏指令，截屏指令用于指示截取第一终端的用户界面。
处理器，用于确定用户界面中的目标元素。
处理器还用于，确定目标元素与用户界面的截图的关联关系；确定用户界面的截图图片，用户界面的截图图片包括：用户界面的截图、目标元素以及目标元素与用户界面的截图的关联关系。
本方案中，通过处理器确定用户界面中目标元素，再将该目标元素和该信息与用户界面的截图的关联关系嵌入用户界面截图图片中。提供了一种通过识别用户界面的截图图片来获取截图中的信息，在一定条件下解决了截图的格式与截图中包含图片对应的原始图片的格式不兼容的问题、只能识别并获取截图中的图片元素和文字元素的问题，以及为用户提供自主选择发送和接收一个或多个元素的问题，从而提高用户体验。
在一个可选的实现方式中，上述处理器，具体用于根据目标格式确定目标元素，目标格式包括图片格式、视频格式、音频格式、地图格式、或超链接的格式中的至少一种；目标格式中的每个目标格式包括至少一种格式。
在另一个可选的实现方式中，上述处理器，具体用于确定目标元素的内容，内容包 括布局文件和/或原始文件，布局文件包括：目标元素的源代码和源地址。
在又一个可选的实现方式中，上述目标元素与用户界面的截图的关联关系，包括：目标元素与目标元素在用户界面的截图的位置、和目标元素与目标元素在用户界面的截图的比例之间的关联关系。
在再一个可选的实现方式中，上述处理器，具体用于将截图、目标元素以及目标元素与用户界面的截图的关联关系嵌入用户界面的截图图片的元数据字段中。
在再一个可选的实现方式中，上述接收器，具体用于接收截屏指令，截屏指令用于指示第一终端获取第一终端的用户界面的截图；上述处理器，具体用于根据截屏指令确定在第一终端前台运行的多个应用程序中的一个或多个的应用程序。
在再一个可选的实现方式中，上述处理器，具体用于根据前台运行的至少一个应用程序以及目标格式确定在用户界面中的目标元素，目标格式包括图片格式、视频格式、音频格式、地图格式、或超链接的格式中的至少一种；目标格式中的每个目标格式包括至少一种格式。
在再一个可选的实现方式中，上述处理器，具体用于根据前台运行的至少一个应用程序确定目标元素的内容，内容包括布局文件和/或原始文件，布局文件包括：目标元素的源代码和源地址。
在再一个可选的实现方式中，显示屏，用于显示目标元素的选择列表，以提示用户选择目标元素选择列表中的一个或多个目标元素；处理器，具体用于将用户选定之后界面的截图、用户选定的目标元素以及用户选定的目标元素与用户选定之后的界面的截图的关联关系嵌入用户界面的截图图片中。
在再一个可选的实现方式中，上述“目标元素选择列表”可以包括：目标元素的编号和/或预览信息。
在再一个可选的实现方式中，发送器，用于将用户界面的截图图片进行发送，用户界面的截图图片包括：用户界面的截图、目标元素以及目标元素与用户界面的截图的关联关系。
在再一个可选的实现方式中，上述处理器，具体用于若第一终端的用户界面包括多个用户选定的目标元素，则将用户界面的截图和多个用户选定的目标元素分别发送；发送多个用户选定的目标元素包括，采用发送目标元素中的原始文件和/或布局文件的方法。
第四方面，本发明实施例提供了一种读取截图的终端，该终端包括：
接收器，用于接收用户界面的截图图片，用户界面的截图图片包括：用户界面的截图、目标元素以及目标元素与用户界面的截图的关联关系。处理器，用于根据目标元素与用户界面的的截图的关联关系确定触发点位于至少一个目标元素中的一个所在的区域时；则显示至少一个目标元素中的一个所对应的原始文件。
本方案中，通过处理器确定用户界面的截图图片，获取用户界面的截图图片中的一个或多个目标元素。本发明实施例提供了一种读取截图的终端，在一定条件下，能够获取更多的信息，操作简单，不会在接收截图图片时产生兼容性问题，用户可以主观选择获取一个或多个元素，提高用户质量，解决了截图图片中的目标元素识别丰富度受到限制的问题。
在一个可选的实现方式中，该终端还包括：显示屏，用于呈现一个目标元素，包括： 显示屏呈现一个目标元素的内容，内容包括布局文件，布局文件包括：目标元素的源代码和源地址，布局文件对应应用程序；根据布局文件以及应用程序显示一个目标元素的内容。在另一个可选的实现方式中，上述“目标元素”可以包括原始文件的源地址；根据原始文件的源地址获取原始文件，原始文件的源地址包括统一资源定位符。
第五方面，本申请实施例提供了一种计算机可读存储介质，所述计算机可读存储介质中存储有指令，当其在计算机上运行时，使得计算机执行上述各方面所述的方法。
第六方面，本申请实施例提供了一种包含指令的计算机程序产品，当其在计算机上运行时，使得计算机执行上述各方面所述的方法。
附图说明
图1为本发明实施例提供的一种屏幕截图的终端结构示意图；
图2为本发明实施例提供的一种屏幕截图的方法流程图；
图3为本发明实施例提供的另一种屏幕截图的手机结构示意图；
图4为本发明实施例提供的一个手机界面示意图；
图5为本申请实施例提供的另一个界面示意图；
图6为本申请实施例提供的又一个界面示意图；
图7为本申请实施例提供的再一个界面示意图；
图8为本申请实施例提供的再一个界面示意图；
图9为本申请实施例提供的再一个界面示意图；
图10为本发明实施例提供的另一种屏幕截图的方法流程图；
图11为本申请实施例提供的再一个界面示意图；
图12为本申请实施例提供的再一个界面示意图；
图13为本申请实施例提供的再一个界面示意图；
图14为本申请实施例提供的又一种屏幕截图的方法流程图；
图15为本申请实施例提供的一种读取截图的方法流程图
图16为本申请实施例提供的再一个界面示意图；
图17为本申请实施例提供的再一个界面示意图；
图18为本申请实施例提供的再一个界面示意图；
图19为本申请实施例中所涉及的一种终端的结构示意图；
图20为本申请实施例中所涉及的另一种终端的结构示意图。
具体实施方式
为便于对本发明实施例的理解，下面将结合附图以具体实施例做进一步的解释说明，实施例并不构成对本发明实施例的限定。
本发明实施例提供的技术方案中，终端确定用户界面中目标元素，再将该目标元素和该目标元素与用户界面的截图的关联关系嵌入到用户界面的截图图片中，从而解决了截图的格式与截图中包含图片对应的原始图片的格式不兼容、只能识别并获取截图中的图片元素和文字元素、以及为用户提供自主选择发送和接收一个或多个元素的问题，提高用户体验。
本申请实施例中的终端包括：本发明实施例涉及的一种屏幕截图的终端和一种读取屏幕截图图片的终端，两个终端可以为一种终端，即终端即可以截取截图图片，也可以读取截图图片。该终端可以包括手机、平板电脑、笔记本电脑、个人数字助理(personal digital assistant，PDA)、销售终端(point of sales，POS)以及车载电脑等。该终端至少可以包括存储器、触摸屏以及处理器，存储器可用于存储软件程序，处理器通过运行存储在存储器的软件程序，执行终端的各种功能，触摸屏可用于显示由用户输入的信息、提供给用户的信息以及终端的各种菜单，还可以接受用户输入。为了方便描述，本申请中，下述终端以手机为例进行具体描述。
图1为本发明实施例提供的一种终端结构示意图。图1示出的是与本申请实施例相关的一种手机结构示意图。如图1所示，手机100的部分结构的框图。其中，手机100包括：RF(Radio Frequency，射频)电路110、存储器120、输入单元130、显示单元140、传感器150、音频电路160、WiFi(wireless fidelity，无线保真)模块170、处理器180、以及电源190。本领域技术人员可以理解，图1中示出的手机结构并不构成对手机的限定，可以包括比图示更多或更少的部件，或者组合某些部件，或者不同的部件布置。
下面结合图1对手机100的各个构成部件进行具体的介绍：
RF电路110，可以用于收发信息或通话过程中，信号的接收和发送。其中，RF电路110接收基站的下行信息，将该基站的下行信息发送至处理器180，该服务器对该下行信息进行处理；另外，RF电路110还可以将设计上行的数据发送给基站。通常，RF电路包括但不限于天线、至少一个放大器、收发信机、耦合器、LNA(Low Noise Amplifier，低噪声放大器)以及双工器等。此外，RF电路110还可以通过无线通信与网络和/或其他设备通信。该无线通信可以使用任一通信标准或协议，包括但不限于GSM(Global System of Mobile communication，全球移动通讯系统)、GPRS(General Packet Radio Service，通用分组无线服务)、CDMA(Code Division Multiple Access，码分多址)、WCDMA(Wideband Code Division Multiple Access,宽带码分多址)、LTE(Long Term Evolution,长期演进)、电子邮件以及SMS(Short Messaging Service，短消息服务)等。
存储器120，可用于存储软件程序以及模块。通常，该存储器120包括但不限于操作系统、通信模块、接触/移动模块、图形模块、文本输出模块、GPS系统模块、应用程序、内容截取模块、照相机模块、待机模块以及锁屏模块等。此外，存储器120可以主要包括存储程序区和存储数据区，其中，存储程序区可存储操作系统、至少一个功能所需的应用程序(比如声音播放功能、图象播放功能等)等；存储数据区可存储根据手机100的使用所创建的数据(比如音频数据、电话本等)等。存储器120还可以包括高速随机存取存储器，还可以包括非易失性存储器，例如至少一个磁盘存储器件、闪存器件、或其他易失性固态存储器件。此外，存储器120包括的接触/运动模块用于检测物体或手指与触摸屏140或点击式触摸转盘的接触，捕捉接触的速度(方向和大小)、加速度(大小或方向的变化)，判断接触事件类型。例如，多种接触事件检测模块：figure-down/dragging/up/tap，有时手势和UI界面中的元素相结合实现一些操作：pinching/depinching(手指挤压/扩大)等等。
其中，图形模块用于在触摸屏或其他显示器上渲染和显示图形，图形包括网页、图标、数字图像、视频和动画。
应用程序可以包括联系人、电话、视频会议、电子邮件客户端、即时通信、个人运 动、相机、图像管理、视频播放器、音乐播放器、日历、插件(天气、股票、计算器、时钟、词典)、自定义插件、搜索、笔记、地图以及在线视频等等。
输入单元130，可用于接收输入的数字或字符信息，以及产生与手机100的用户设置以及功能控制有关的键信号输入。输入单元130可包括触控面板131以及其他输入设备132。其中，触控面板131，也称为触摸屏，可收集用户在其上或附近的触摸操作(比如用户使用手指、触笔等任何适合的物体或附件在触控面板131上或在触控面板131附近的操作)，并根据预先设定的程式驱动相应的连接装置。此外，触控面板131还可以包括触摸检测装置和触摸控制器两个部分。其中，触摸检测装置检测用户的触摸方位，并检测触摸操作带来的信号，将信号传送给触摸控制器；触摸控制器从触摸检测装置上接收触摸信息，并将它转换成触点坐标，再送给处理器180，并能接收处理器180发来的命令并加以执行。具体地，可以采用电阻式、电容式、红外线以及表面声波等多种类型实现触控面板131。除了触控面板131，输入单元130还可以包括其他输入设备132。其中，其他输入设备132可以包括但不限于物理键盘、功能键(比如音量控制按键、开关按键等)、轨迹球、鼠标、操作杆等中的一种或多种。
显示单元140，可用于显示由用户输入的信息或提供给用户的信息以及手机100的各种菜单。显示单元140可以包括显示面板141，其中，可以采用LCD(Liquid Crystal Display，液晶显示器)、OLED(Organic Light-Emitting Diode,有机发光二极管)等形式来配置显示面板141。进一步的，触控面板131可覆盖显示面板141，当触控面板131检测到在其上或附近的触摸操作后，传送给处理器180以确定触摸事件的类型，随后处理器180根据触摸事件的类型在显示面板141上提供相应的视觉输出。虽然在图1中，触控面板131与显示面板141是作为两个独立的部件来实现手机100的输入和输入功能，但是在某些实施例中，可以将触控面板131与显示面板141集成而实现手机100的输入和输出功能。此外，对于本发明而言，显示单元还可以提供显示截图图片等。
手机100还可包括至少一种传感器150，比如光传感器、运动传感器以及其他传感器。具体地，光传感器可包括环境光传感器及接近传感器，其中，环境光传感器可根据环境光线的明暗来调节显示面板141的亮度，接近传感器可在手机100移动到耳边时，关闭显示面板141和/或背光。作为运动传感器的一种，加速计传感器可检测各个方向上(一般为三轴)加速度的大小，静止时可检测出重力的大小及方向，可用于识别手机姿态的应用(比如横竖屏切换、相关游戏、磁力计姿态校准)、振动识别相关功能(比如计步器、敲击)等；至于手机100还可配置的陀螺仪、气压计、湿度计、温度计、红外线传感器等其他传感器，在此不再赘述。
音频电路160、扬声器161，麦克风162可提供用户与手机100之间的音频接口。音频电路160可将接收到的音频数据转换后的电信号，传输到扬声器161，由扬声器161转换为声音信号输出；另一方面，麦克风162将收集的声音信号转换为电信号，由音频电路160接收后转换为音频数据，再将音频数据输出至RF电路110以发送给比如另一手机，或者将音频数据输出至存储器120以便进一步处理。
WiFi属于短距离无线传输技术，手机100通过WiFi模块170可以帮助用户收发电子邮件、浏览网页和访问流式媒体等，它为用户提供了无线的宽带互联网访问。虽然图1示出了WiFi模块170，但是可以理解的是，其并不属于手机100的必须构成，完全可以根据 需要在不改变发明的本质的范围内而省略。
处理器180通过运行存储在存储器120的软件程序以及模块，从而执行手机100的各种功能应用以及数据处理。处理器180是手机100的控制中心，利用各种接口和线路连接整个手机的各个部分，通过运行或执行存储在存储器120内的软件程序和/或模块，以及调用存储在存储器120内的数据，执行手机100的各种功能和处理数据，从而对手机进行整体监控。可选的，处理器180可包括一个或多个处理单元；处理器180可集成应用处理器和调制解调处理器，其中，应用处理器主要处理操作系统、用户界面和应用程序等，调制解调处理器主要处理无线通信。可以理解的是，上述调制解调处理器也可以不集成到处理器180中。
手机100还包括给各个部件供电的电源190(比如电池)，其中，电源可以通过电源管理系统与处理器180逻辑相连，从而通过电源管理系统实现管理充电、放电、以及功耗等功能。
尽管未示出，手机100还可以包括摄像头、蓝牙模块等，在此不再赘述。
下面结合图2到图9对本发明实施例进行进一步的介绍。
图2本发明实施例提供的一种屏幕截图的方法流程图。如图2所示，该方法具体包括：
S210，第一终端接收截屏指令，该截屏指令用于指示第一终端获取第一终端的用户界面的截图。
其中，此步骤主要由指令接收模块执行，需要配合使用硬件模块，例如：输入单元和传感器单元。输入单元用于获取用户的输入，如按压/激活按键或传感器；传感器单元用于获取用户的指纹或设备运动状态等。
具体地，如图3所示该手机200包括本体1以及触摸屏2(例如，如图1所示的触摸屏131)。可以采用触摸屏2与显示面板(例如，如图1所示的141)集成一体而实现手机200的输入和输出功能。本体1包括摄像头11、感光元件12、听筒13、实体键14、电源键15和音量键16等等。其中摄像头11可包括前置摄像头和后置摄像头。感光元件12主要用于感测人体与手机的距离，例如，用户在打电话时，手机是紧挨耳边的，感光元件12检测到该距离信息后，手机200的触摸屏可关闭输入功能，这样可防止误触。实体键14一般为Home键，也可以是集成指纹识别模块的Home键，实体键14还可以包括返回键、菜单键以及退出键，另外，实体键14还可以是触摸屏上设定位置的触摸键，其中，实体键14、电源键15和音量键16具体可参照图1所示的实施例中其他输入设备130的描述。应该知道的是，本申请实施例还可包括话筒17、数据接口18、客户识别模块(Subscriber Identification Module，SIM)卡接口(图中未示出)以及耳机接口19等等。
应该知道的是图2所示的手机200仅为示例，并不构成限定，可以包括比图示更多或更少的部件，或者组合某些部件，或者拆分某些部件，或者不同的部件布置。
该截屏操作的触发方式至少可以包括如下方式：
方式一:通过终端上的实体按键接收输入截屏的输入信号，例如：输入单元130中的其他输入设备132所包含的组合按键：电源键15+音量键16、专用按键如图3所示的实体键14、也可以是传感器150中包含的指纹传感器等；接收截屏指令即是接收用户按压/激活上述的按键或传感器。
方式二：通过终端上的虚拟按键接收输入截屏的输入信号，如显示单元140中的显示面板141所显示的通知栏中的截屏按键，界面常驻的截屏按钮等；接收截屏指令即是通过输入单元130中的触控面板131接收用户在截屏按键对应位置处的触摸操作。
方式三：通过话筒17(例如，如图1所示的音频电路160中的麦克风162)接收用户的语音操作指令；利用摄像头11以及感光元件12(例如，如图1所示的150中的图像传感器)接收眼球运动指令和/或手势控制指令指令等；即通过话筒17接收用户的语音指令，或通过摄像头11追踪用户的眼球运动，或通过运动传感器(如加速度，三轴陀螺仪等)获取用户手部的动作，或通过压力传感器获取用户按压力度大小。
方式四：如图3所示，可以利用手指3或手写笔4在触摸屏进行点击、划动等操作进行截屏操作，触控面板可检测到这些截屏操作，触摸屏也可称为屏幕。
S220，第一终端确定用户界面中的目标元素。
首先，第一终端确定用户界面中多个元素中的目标元素。该多个元素可以包括：文本、图片、音频、地理位置、链接以及名片等，可以由如图1中处理器180执行存储器120中存储的程序代码，确定用户界面中包含的目标元素。例如，如图4所示，401为视频元素、402为文本元素、403为图片元素以及404为语音元素。具体地，确定用户界面中包含的多个元素中的目标元素的方式至少可以包括如下方式：
方式一：终端通过图像识别方式进行确定(可以通过例如图1中存储器120中的图形模块进行对当前用户界面进行图像识别，进而确定目标元素)。具体地，可以通过图像识别技术将用户界面中的文本元素以及图片元素等视觉元素进行区分，对于文本元素可以进一步通过OCR(Optical Character Recognition，光学字符识别)技术识别出具体文本内容，对于图片元素401，可以进一步识别图片中包含的内容，并可以选择性标注标签，该标签可以包括：人物，景物，物品等，例如，如图4中图片元素403当前显示的为任务，则可以将此图片元素403标注为任务，标注位置可以选择标注在该图片上。例如：终端识别出该图片元素包括：树木和山川，则标签可以为：景物。
方式二：还可以通过对应用程序的UI布局文件进行分析，获得用户界面中包含的元素，可以理解的是应用程序的UI布局文件可以为应用程序的用户界面的布局文件，该UI布局文件可以包括网页的源代码和/或目标元素的源地址。具体地，终端根据UI布局文件中的目标格式确定在用户界面中的多个元素中包含的目标元素。其中，第一终端根据目标格式确定目标元素，目标格式包括图片格式、视频格式、音频格式、地图格式、或超链接的格式中的至少一种；目标格式中的每个目标格式包括至少一种格式。第一终端不仅可以获取目标元素的布局文件，也可以直接获取该目标元素的原始文件，例如，如图4所示，若视频元素401是在本地下载的，则第一终端可以直接获取该视频元素401的原始文件；若视频元素401是不在本地下载的，则第一终端可以通过获取该视频元素401在网页中的源代码，获取该视频元素401的网址信息。
需要注意的是，上述确定目标元素的方法可以用于普通截屏或长截屏来确定目标元素。普通截屏是指截取显示在当前显示页面中的用户界面的内容，如图6所示，长截屏是指截取包括显示在当前显示页面中的内容、以及接续在当前显示页面之后未显示在当前显示页面的内容，如图7所示。具体地，可以根据上述方法一和方法二判断当前界面是否包含目标元素，该目标元素包括但不限于：图片、音频、视频、链接、地理位置信息等内容 类型中的一种或多种。
其次，需要理解的是，在步骤S220中，第一终端确定用户界面中的目标元素的同时已经获取了该目标元素的原始文件和/或布局文件，其中，该布局文件可以包括：目标元素的源代码和源地址。
第一终端确定用户界面中的目标元素包括确定目标元素的存储位置和目标元素的内容，其中，目标元素的内容包括目标元素的原始文件和/或布局文件，该布局文件可以包括：目标元素的源代码和源地址。
具体地，根据S220的方法确定了用户界面中的目标元素时，该终端要确定所述目标元素的内容和目标元素的存储位置。例如，当目标元素为图片时，若终端识别出用户界面中包含两张图片，则在终端中或者网页中获取两张图片对应的存储位置，并从该存储位置读取或下载对应的两张图片。其中，该存储位置可以是在非易失性存储器，如SD卡，手机内置存储，也可以是易失性存储器，如内存或显存，也可以是在internet上的一个URL(Uniform Resource Locator，统一资源定位符)。
当目标元素为视频时，若终端识别出用户界面中包含一个视频，则获取视频对应的存储位置，存储位置可以是上述图片存储位置中的任何一个位置，并从存储位置处读取和/或下载对应的该视频。
类似的，当识别出用户界面中包含语音等其他元素时，可以采用与图片和/或视频相同的获取方式进行读取和/或下载，在此不再赘述。
S230，第一终端确定目标元素与用户界面的截图的关联关系。
其中，目标元素与用户界面的截图的关联关系包括：目标元素的内容与目标元素在用户界面的截图的位置、和目标元素的内容与目标元素在用户界面的截图的比例之间的关联关系。
确定目标元素的内容同时，还可以获取目标元素在用户界面中所占截图的大小、位置等；例如当获取到的目标元素为语音消息时，可以获取的语音消息的图标在图片中的位置以及大小。
如图4所示，以屏幕左上角为坐标原点(x＝0,y＝0)，最下方的的语音元素404的坐标为(x＝200,y＝500)，大小为(length＝200,height＝40)，形状为(shape＝rectangle)，可以理解的是，当显示元素是圆形时，只需记录圆形的圆心和半径，以及形状属性，当显示元素是不规则的图形时，可以将其近似处理为矩形或圆形或多边形等形状，并相应记录坐标，大小和形状属性。
S240，第一终端确定用户界面的截图图片，用户界面的截图图片包括：用户界面的截图、目标元素、以及目标元素与用户界面的截图的关联关系。
其中，将目标元素与用户界面的截图的关联关系嵌入用户界面的截图图片的元数据字段中。
具体地，嵌入的方式可以是将目标元素直接加入到屏幕内容图片的EXIF(Exchangeable Image File，图像文件格式)的thumbnail字段(图片)和/或audio字段(音频)等；如链接，地理位置坐标等信息，可以直接添加到屏幕内容图片的EXIF中的user comments字段。此外，可以同时将代表目标元素在用户界面的截图的显示位置、大小以及形状等属性添加到用户界面的截图图片的元数据中，用于显示用户界面的截图图片时标记 目标元素在用户界面的截图图片的位置。
在一个可实现的实施方式中，可以让用户从用户界面包含的所有目标元素中选择需要添加到截图图片中的目标元素，形式可以是如图7所示，接收用户选择的方式可以是通过输入单元130中的触控面板131获取用户的触摸操作，如用户触摸下图1的“是”，表明需要将视频添加到用户界面的截图图片中，也可以是通过输入单元130中的其他输入设备132，如物理按键选择需要添加的内容。如图8所示，若当前界面包含多个相同类型的多媒体文件时，可以以编号的形式提示用户进行选择，也可以以预览的方式提示用户选择，如有多个图片时，通过显示单元140显示图片的预览图。如图9所示，用户也可以选择在截图的同时将当前用户界面中的图片元素403添加到该截图中。
通过上述方法，最后生成用户界面的截图图片，该步骤由处理器180执行存储器120中存储的程序代码进行处理。若当前界面包含目标元素时，根据用户界面的截图、目标元素以及目标元素与用户界面的截图的关联关系生成用户界面的截图图片。在最终生成的用户界面的截图图片中可以包含目标元素，如采用上面提到的置于用户界面的截图图片的thumbnail字段(图片)或Audio字段(音频)中；若当前界面仅包括文本信息时，直接生成当前界面截图作为用户界面的截图图片。生成用户界面的截图图片时，还可以生成仅包含文本信息的截图。
由处理器180执行存储器120中的通信模块程序将由上述方法生成的用户界面的截图图片发送至其他设备，该其他设备包括：其他终端设备。
其中，传输方式可以包括但不限于有线传输和无线传输。
图10本发明实施例提供的另一种屏幕截图的方法流程图。下面结合图10到图14对本申请实施例进行进一步的介绍。如图10所示，该方法具体包括：
S1000和S1001,与S210和S220相同，所以在此不再赘述。
S1002，获取该目标元素在本地和/或非本地的存储位置信息。
其中，获取的方式可以是以下的任意一种或几种的组合，包括：
方式一：第一终端中在接收到截屏指令的同时，将截图指令发送给前台运行的多个应用程序中的一个或多个的应用程序，多个应用程序中的一个或多个的应用程序获取用户界面中的目标元素的存储位置，多个应用程序中的一个或多个的应用程序接收到截图指令后，根据第一终端的请求，获取用户界面中目标元素的存储位置，并将存储位置返回给第一终端；可选的，当目标元素有访问权限控制时，多个应用程序中的一个或多个的应用程序至少应当赋予第一终端读取该目标元素的内容的权限。
方式二：第一终端在S1001中识别出用户界面中的目标元素后，根据目标元素在第一终端的存储空间中或网络中查找对应的目标元素的内容，并在存储器120中记录查找到的目标元素的存储位置。例如下表1所示：
表1
Figure PCTCN2017088129-appb-000001
S1003，确定目标元素与用户界面的截图的关联关系。
其中，可以预先确定最终截图图片的名称和存储位置，并保存最终生成的用户界面 的截图图片与目标元素的内容的关联关系。也可以是在第一终端中缓存用户界面的截图图片所包含的目标元素的内容，并在S1004生成用户界面的截图图片之后，保存对应的关联关系，可以理解的是，上述用户界面的截图可以理解为是没有添加关联关系和目标元素的截图。
例如，该关联关系可以保存为如下表2的形式：
表2
Figure PCTCN2017088129-appb-000002
如上表所示的两种形式分别代表截图1.png具有两个元素资源，12.jpg和34.wma。以及截图2.png具有一个元素资源qq.png。关联列表可以临时保存在内存中，以便在生成用户界面的截图图片时，将其添加到截图的属性信息中。该关联列表还可以直接保存在设备的非易失性存储器中，如SD卡，内置存储卡等；该关联列表还可以上传到云端保存，只在本地记录云端保存的访问链接或位置，可以采用URL或URI的形式。
S1004，生成用户界面的截图图片。
在一个可实现的实施方式中，生成用户界面的截图图片时，可以在用户界面的截图图片中增加一个描述字段，用于表示用户界面的截图图片中包含元素内容；可以在生成的用户界面的截图图片的属性信息中添加关联的文件信息。
S1005，获取发送和/或分享的指令。
其中，发送和/或分享用户界面的截图图片的方式可以如下：用户在图片浏览器/文件管理器中，选中文件后，点击分享按钮，并选中分享方式进行分享，如图11所示，用户的操作都可以是通过S1000中提到的输入方式进行。用户在聊天界面通过选择发送图片的形式发送一张或多张截图，例如，如图13所示，还可以是通过应用程序中的电子邮件客户端、即时通信等编辑界面编辑分享的图片，视频等多媒体内容，图12中以微信以及微博为例。
获取以上述操作的方式可以是，检测用户点击的按钮位置，以及按钮所触发的动作，若按钮触发对图片浏览器的调用，则可以确定用户当前的请求为分享用户界面的截图图片的请求。在此并不限定获取用户发送/分享用户界面的截图图片的请求的方法，可以采用其他任意可行的方式获取用户发送/分享用户界面的截图图片的请求。
S1006，判断发送和/或分享的指令是否包含至少一个目标元素，若包含，则执行S1007，否则，执行S1008。判断的方式可以如下：
通过查找上述S1003的用户界面的截图图片关联列表查找当前用户界面的截图图片是否包含目标元素内容；通过查找S1004中用户界面的截图图片文件中的属性信息查看是否有“包含目标元素”的标签；通过查找S1004中添加到用户界面的截图图片文件中的关联列表来确定用户界面的截图图片中是否包含了目标元素；
S1007，将关联的目标元素添加到用户界面的截图图片中，生成选择后的用户界面的 截图图片，该步骤由处理器180执行存储器120中存储的程序代码进行处理，嵌入目标元素到用户界面的截图图片的方式与S240的嵌入方式相同；生成待发送用户界面的截图图片的方式与S240的发送方式相同，故在此不再赘述。
S1008，由处理器180执行存储器120中的通信模块程序将用户界面的截图图片发送至其他设备,其他设备包括其他终端。
图14本发明实施例提供的又一种屏幕截图的方法流程图。如图14所示，该方法具体包括：
S1401和S1402,与S210和S220相同，所以在此不再赘述。
S1403、S1404、S1405、S1406和S1407和图10本发明实施例提供的另一种屏幕截图的方法流程图中的S1002、S1003、S1004、S1005和S1006相同，所以在此不再赘述。
S1408，判断发送用户界面截图是否同时发送目标元素。
其中，提示用户是否添加目标元素，若用户选择不添加目标元素直接发送，则执行S1409，否则执行S1410，指令接收模块接收用户通过输入单元输入的选择指令，输入方式包含但不限于S1000中的输入方式。
S1409，由处理器180执行存储器120中的通信模块程序将截图发送至其他设备。
S1410，发送用户界面的截图同时发送目标元素，需要注意的是此处与图10所述的实施例的区别在于，图10所述的实施例会生成一张用户界面的截图图片，新的用户界面的截图图片中包含至少一种目标元素，而本实施例不生成用户界面的截图图片，而是将用户界面的截图和目标元素分开单独发送，此时的目标元素可以为目标元素的原始文件，也可以为目标文件的布局文件。
例如，若用户界面的截图中包含两张图片(图片A和图片B)，以及一个视频，那么在用户选择发送截图时，发送完用户界面的截图之后，还需要根据关联文件，获取到目标元素的存储位置，即原始图片A，原始图片B，以及视频的存储位置，将原始图片A，原始图片B，以及视频的原始文件和/或布局文件(例如：网页的连接等)分别发送给接收方。
该实施例类似于图10所述的实施例，本步骤也可以让用户选择需要发送的目标元素，根据用户的选择，进行发送。
下面结合图15到图18对本申请实施例进行进一步的介绍。
图15为本申请实施例提供的一种读取截图的方法流程图。如图15所示，该方法包括：
S1500，第二终端接收用户界面的截图图片。
其中，用户界面的截图图片包括：第一终端的用户界面的截图、目标元素以及目标元素与用户界面的截图的关联关系；目标元素包括原始文件和/或布局文件，至少一个目标元素中的每个的格式包括：图片格式、视频格式、音频格式、地图格式、或超链接的格式中的至少一种；目标元素对应原始文件。其中，目标元素可以包括布局文件，布局文件可以对应应用程序；根据布局文件以及应用程序显示原始文件。
目标元素可以包括原始文件的源地址；根据原始文件的源地址获取原始文件，原始文件的源地址包括统一资源定位符。
其中，第一终端可以与第二终端相同，也可以不同。
S1501，第二终端显示第一终端的用户界面的截图图片。
例如，第二终端显示第一终端的用户界面的截图图片的方式至少可以包括如下方式：
方式一：接收用户浏览用户界面的截图图片的操作指令，如用户在文件管理/图片浏览程序中选择并打开图片，显示单元140中的显示面板显示终端100中存储器130存储的图片预览界面，输入单元130的触摸面板131或其他输入设备132接收用户在图片预览界面的选择操作。
方式二：还可以通过音频电路160的麦克风162接收用户的语音选择指令，也可以通过传感器150的重力/加速度传感器接收用户的手势选择操作，如晃动，或通过传感器150的图像传感器接收用户的手势选择操作或眼球选择操作。
获取用户界面的截图图片中的目标元素，获取的方式包括以下方式，对应图2和图6所述的实施例，直接获取用户界面的截图图片，对应图9所述的实施例，分别获取用户界面的截图和该用户界面的截图所包含的目标元素，可以但不限于通过以下几种方式获取用户界面的截图图片中的目标元素：
识别用户界面的截图图片中的目标格式，根据目标格式确定目标元素。可以根据目标格式读取用户界面的截图图片中的audio或thumbnail字段，获取对应的音频和图片内容；可以通过用户界面的截图图片中包含的关联目标元素，获取对应的目标元素；上述几种方式获取目标元素时，都可以获取代表目标元素的显示元素的大小、形状、位置，以便于在显示用户界面的截图图片时，给用户以提示。
S1502，根据目标元素与用户界面的的截图的关联关系确定触发点位于至少一个目标元素中的一个目标元素所在的区域时，则呈现至少一个目标元素中的一个目标元素所对应的内容。
对应图2和/或图10所述的接收用户界面的截图图片。其中，该触发点可以是用户触发触控模板131上的用户触点，例如，鼠标光标。通过显示单元140显示选中的用户界面的截图图片，打开并显示对应的用户界面的截图图片；显示的方式可以是全屏显示，或半屏显示，或显示为任意大小；在显示用户界面的截图图片之前，可以对用户界面的截图图片进行裁剪，或扩充，或添加背景。
结合图16对上述操作作进一步解释，用户触发张三发送的用户界面的截图图片之后，该第二终端会弹出一个提示框，该提示框提示用户选择获取查看图片元素或视频元素还是语音元素。若选择图片元素则获取图片元素。其中，若该图片元素或视频元素还是语音元素是为布局文件(例如：网页的连接等)，用户可以选择是否从网页上下载该图片。
在一个可实现的实施例中，终端可以将用户界面的截图图片中的目标元素识别出的目标元素突出显示出来，如用户界面的截图图片中包含音频，则可以将音频对应的图标突出显示，突出显示的方式包括但不限于加粗边框，改变边框颜色，改变边框形状，改变图标大小，动画效果显示等。
接收用户对用户界面的截图图片的进行操作时，该第二终端判断当前用户界面的截图图片中是否包含目标元素。当通过触控面板131接收用户操作时，可以获取当前触摸位置坐标，根据当前触摸位置坐标，操作目标则为用户界面的截图图片中对应坐标位置处的内容。
当通过麦克风162接收用户的语音操作指令时，可以通过语音识别将用户的语音操作指令转换为文本，并通过文本和用户界面的截图图片中包含的内容查找对应的操作目 标，如语音操作指令为“播放第一个音频”，则可以查找用户界面的截图图片中包含的第一个音频，将找到的第一个音频作为操作目标。
如上述获取当前操作目标的方式，可以在获取到操作目标之后，对操作目标的属性进行判断，如通过触控面板131接收到用户操作，并获取到操作目标是图片，且能够查找到对应的图片文件时，则确定当前操作目标为目标元素，类似，当操作目标为音频，且能够找到对应的音频文件时，确定当前操作目标为目标元素。
如图17所述，若操作目标仅包括文本信息时，为用户提供文本操作选项；文本操作选项包括自由选择，复制，搜索文本等；文本内容可以通过OCR方式进行识别；对于非文本内容，按照现有的操作响应给予用户操作选项。
对应图14所述的接收用户界面的截图图片。因图14所示的实施例中，是将用户界面的截图图片和目标元素进行分别发送。所以接收时可以执行以下步骤：首先接收的为用户界面的截屏图片，其次接收至少一个目标元素。
如图18做进一步说明：因张三在发送截屏图片时，选择是将截屏图片与至少一个元素分别发送，所以接收时，可以为如图18所示，用户可以根据需要出发所需要的元素信息。接收时，可以接收一条消息，该消息包括图片元素和视屏元素。也可以分两条接收，第一条消息接收图片元素，第二条消息接收视频元素。上述至少一个目标元素可以包括：该目标元素的原始文件和/或布局文件(例如：网页的连接等)。
当操作目标不仅包括文本信息时，则在此处获取操作目标处对应的目标元素，对应于图2和图10所述的实施例，图14所述的实施例中的目标元素的存储方式，分别为从用户界面的截图图片中获取目标元素的文件，以及从用户界面的截图图片中的目标元素关联列表中查找目标元素的存储位置，并从存储位置查找对应的目标元素。
需要注意的是，根据当前操作目标输出对应内容：当前操作目标为音频时，使用扬声器161播放音频；当前操作目标为图片时，使用显示单元140显示图片；当前操作目标为视频时，使用扬声器161播放视频中的音频，使用显示单元140显示视频中的画面(视频帧)。
图19为本申请实施例中所涉及的一种终端的结构示意图。如图19所示，该终端包括：显示屏1901、接收器1902、处理器1903以及发送器1904。
其中，收发器可以包括接收器1902和发送器1904，该接收器和发送器可以集成在一起。发送器调节(例如，模拟转换、滤波、放大和上变频等)该输出采样并生成上行链路信号，该上行链路信号经由天线发射给网络设备。在下行链路上，天线接收上述实施例中网络设备发射的下行链路信号。接收器调节(例如，滤波、放大、下变频以及数字化等)从天线接收的信号并提供输入采样。终端还可以包括调制解调处理器，在调制解调处理器中，接收要在上行链路上发送的业务数据和信令消息，并对业务数据和信令消息进行处理(例如，格式化、编码和交织)。进一步处理(例如，符号映射和调制)编码后的业务数据和信令消息并提供输出采样。处理(例如，解调)该输入采样并提供符号估计。处理(例如，解交织和解码)该符号估计并提供发送给UE的已解码的数据和信令消息。这些单元根据无线接入网采用的无线接入技术(例如，LTE及其他演进系统的接入技术)来进行处理。
处理器对终端的动作进行控制管理，用于执行上述实施例中由终端进行的处理。例如用于控制屏幕截图和/或本发明所描述的技术的其他过程。以图19作为示例，对本申请 提供的终端进行详细解释，具体如下：
接收器，用于接收截屏指令，截屏指令用于指示截取第一终端的用户界面。
处理器，用于确定用户界面中的目标元素。
处理器还用于，确定目标元素与用户界面的截图的关联关系；确定用户界面的截图图片，用户界面的截图图片包括：用户界面的截图、目标元素以及目标元素与用户界面的截图的关联关系。
上述处理器，上述处理器，具体用于根据目标格式确定目标元素，目标格式包括图片格式、视频格式、音频格式、地图格式、或超链接的格式中的至少一种；目标格式中的每个目标格式包括至少一种格式。
上述处理器，具体用于确定目标元素的内容，内容包括布局文件和/或原始文件，布局文件包括：目标元素的源代码和源地址。
上述目标元素与用户界面的截图的关联关系，包括：目标元素与目标元素在用户界面的截图的位置、和目标元素与目标元素在用户界面的截图的比例之间的关联关系。
上述处理器，具体用于具体用于将截图、目标元素以及目标元素与用户界面的截图的关联关系嵌入用户界面的截图图片的元数据字段中。
上述接收器，具体用于接收截屏指令，截屏指令用于指示第一终端获取第一终端的用户界面的截图；上述处理器，具体用于根据截屏指令确定在第一终端前台运行的多个应用程序中的一个或多个的应用程序。
上述处理器，具体用于根据前台运行的至少一个应用程序以及目标格式确定在用户界面中的目标元素，目标格式包括图片格式、视频格式、音频格式、地图格式、或超链接的格式中的至少一种；目标格式中的每个目标格式包括至少一种格式。
上述处理器，具体用于根据前台运行的至少一个应用程序确定目标元素的内容，内容包括布局文件和/或原始文件，布局文件包括：目标元素的源代码和源地址。显示屏，用于显示目标元素的选择列表，以提示用户选择目标元素选择列表中的一个或多个目标元素；处理器，具体用于将用户选定之后界面的截图、用户选定的目标元素以及用户选定的目标元素与用户选定之后的界面的截图的关联关系嵌入用户界面的截图图片中。
上述“目标元素选择列表”可以包括：目标元素的编号和/或预览信息。
发送器，用于将用户界面的截图图片进行发送，用户界面的截图图片包括：用户界面的截图、目标元素以及目标元素与用户界面的截图的关联关系。
上述处理器，具体用于若第一终端的用户界面包括多个用户选定的目标元素，则将用户界面的截图和多个用户选定的目标元素分别发送；发送多个用户选定的目标元素包括，采用发送目标元素中的原始文件和/或布局文件的方法。
图20为本申请实施例中所涉及的另一种终端的结构示意图。如图20所示，该终端包括：显示屏2001、接收器2002以及处理器2003。需要说明的是，本申请提供的另一种终端与图19所提供的一种终端其结构与功能是相同的，只是为区别截屏和读取两个步骤所体现的界面不同。
处理器对终端的动作进行控制管理，用于执行上述实施例中由终端进行的处理。例如用于控制屏幕截图和/或本发明所描述的技术的其他过程。以图19作为示例，对本申请提供的另一终端进行详细解释，具体如下：
接收器，用于接收用户界面的截图图片，用户界面的截图图片包括：用户界面的截图、目标元素以及目标元素与用户界面的截图的关联关系。处理器，用于根据目标元素与用户界面的的截图的关联关系确定触发点位于至少一个目标元素中的一个所在的区域时；则显示至少一个目标元素中的一个所对应的原始文件，布局文件包括：目标元素的源代码和源地址。
上述终端还可以包括：显示屏，用于呈现一个目标元素，包括：显示屏呈现一个目标元素的内容，内容包括布局文件，布局文件包括：目标元素的源代码和源地址，布局文件对应应用程序；根据布局文件以及应用程序显示一个目标元素的内容。上述“目标元素”可以包括原始文件的源地址；根据原始文件的源地址获取原始文件，原始文件的源地址包括统一资源定位符。
专业人员应该还可以进一步意识到，结合本文中所公开的实施例描述的各示例的单元及算法步骤，能够以电子硬件、计算机软件或者二者的结合来实现，为了清楚地说明硬件和软件的可互换性，在上述说明中已经按照功能一般性地描述了各示例的组成及步骤。这些功能究竟以硬件还是软件方式来执行，取决于技术方案的特定应用和设计约束条件。专业技术人员可以对每个特定的应用来使用不同方法来实现所描述的功能，但是这种实现不应认为超出本发明的范围。
本领域普通技术人员可以理解实现上述实施例方法中的全部或部分步骤是可以通过程序来指令处理器完成，所述的程序可以存储于计算机可读存储介质中，所述存储介质是非短暂性(英文：non-trans itory)介质，例如随机存取存储器，只读存储器，快闪存储器，硬盘，固态硬盘，磁带(英文：magnetic tape)，软盘(英文：floppy disk)，光盘(英文：optical disc)及其任意组合。
以上所述，仅为本发明较佳的具体实施方式，但本发明的保护范围并不局限于此，任何熟悉本技术领域的技术人员在本发明揭露的技术范围内，可轻易想到的变化或替换，都应涵盖在本发明的保护范围之内。因此，本发明的保护范围应该以权利要求的保护范围为准。

Claims (32)

  1. 一种屏幕截图的方法，其特征在于，包括：
    第一终端接收截屏指令，所述截屏指令用于指示所述第一终端获取第一终端的用户界面的截图；
    所述第一终端确定所述用户界面中的目标元素；
    所述第一终端确定所述目标元素与所述用户界面的截图的关联关系；
    所述第一终端生成所述用户界面的截图图片，所述用户界面的截图图片包括：所述用户界面的截图、所述目标元素以及所述目标元素与所述用户界面的截图的关联关系。
  2. 根据权利要求1所述的方法，其特征在于，所述第一终端确定所述用户界面中的目标元素，包括：
    所述第一终端根据目标格式确定所述目标元素，所述目标格式包括图片格式、视频格式、音频格式、地图格式、或超链接的格式中的至少一种；所述目标格式中的每个目标格式包括至少一种格式。
  3. 根据权利要求1或2所述的方法，其特征在于，所述第一终端确定所述用户界面中的目标元素，包括：
    所述第一终端确定所述目标元素的内容，所述内容包括布局文件和/或原始文件，所述布局文件包括：所述目标元素的源代码和源地址。
  4. 根据权利要求1-3任意一项所述的方法，其特征在于，所述目标元素与所述用户界面的截图的关联关系，包括：
    所述目标元素与所述目标元素在所述用户界面的截图的位置、和所述目标元素与所述目标元素在所述用户界面的截图的比例之间的关联关系。
  5. 根据权利要求1-4任意一项所述的方法，其特征在于，所述第一终端确定所述用户界面的截图图片，包括：
    将所述用户界面的截图、所述目标元素以及所述目标元素与所述用户界面的截图的关联关系嵌入所述用户界面的截图图片的元数据字段中。
  6. 根据权利要求1所述的方法，其特征在于，所述第一终端接收截屏指令，包括：
    所述第一终端接收截屏指令，所述第一终端根据所述截屏指令确定在所述第一终端前台运行的多个应用程序中的一个或多个所述应用程序。
  7. 根据权利要求6所述的方法，其特征在于，所述第一终端确定在所述第一终端前台运行的多个应用程序中的一个或多个所述应用程序，包括：
    所述第一终端根据前台运行的至少一个应用程序以及目标格式确定在所述用户界面中的目标元素，所述目标格式包括图片格式、视频格式、音频格式、地图格式、或超链接的格式中的至少一种；所述目标格式中的每个目标格式包括至少一种格式。
  8. 根据权利要求7所述的方法，其特征在于，所述第一终端根据前台运行的至少一个应用程序获取所述目标元素，包括：
    所述第一终端根据前台运行的至少一个应用程序确定所述目标元素的内容，所述内容包括布局文件和/或原始文件，所述布局文件包括：所述目标元素的源代码和源地址。
  9. 根据权利要求1或6-8任意一项所述的方法，其特征在于，所述第一终端确定所 述用户界面的截图图片，包括：
    所述第一终端显示所述目标元素的选择列表，以提供用户选择所述目标元素的选择列表中包括一个或多个目标元素；
    将所述用户选定之后界面的截图、所述用户选定的目标元素以及所述用户选定的目标元素与所述用户选定之后的界面的截图的关联关系嵌入所述用户界面的截图图片中。
  10. 根据权利要求6-9任意一项所述的方法，其特征在于，所述目标元素的选择列表包括：
    所述目标元素的编号和/或预览信息。
  11. 根据权利要求9或10所述的方法，其特征在于，所述将所述用户选定之后界面的截图、所述用户选定的目标元素以及所述用户选定的目标元素与所述用户选定之后的界面的截图的关联关系嵌入所述用户界面的截图图片中之后，还包括：
    所述第一终端将所述用户界面的截图图片进行发送。
  12. 根据权利要求9-11任意一项所述的方法，其特征在于，所述第一终端将所述用户界面的截图图片进行发送，包括：
    若所述第一终端的用户界面包括多个所述用户选定的目标元素，则将所述用户界面的截图和多个所述用户选定的目标元素分别发送；
    发送多个所述用户选定的目标元素包括：采用发送所述用户选定的目标元素中的原始文件和/或布局文件的方法。
  13. 一种读取截图的方法，其特征在于，包括：
    第二终端接收用户界面的截图图片，所述用户界面的截图图片包括：所述用户界面的截图、所述目标元素以及所述目标元素与所述用户界面的截图的关联关系；
    所述第二终端根据所述目标元素与所述用户界面的的截图的关联关系确定用户触发位置位于所述至少一个目标元素中的一个目标元素所在的区域时，则第二终端呈现所述一个目标元素。
  14. 根据权利要求13所述的方法，其特征在于，所述第二终端呈现所述一个目标元素，包括：
    所述第二终端呈现所述一个目标元素的内容，所述内容包括布局文件，所述布局文件包括：所述目标元素的源代码和源地址，所述布局文件对应应用程序；
    根据所述布局文件以及所述应用程序显示所述一个目标元素的内容。
  15. 根据权利要求13或14所述的方法，其特征在于，所述目标元素包括原始文件的源地址；
    根据所述原始文件的源地址获取所述原始文件，所述原始文件的源地址包括统一资源定位符。
  16. 一种屏幕截图的终端，其特征在于，包括：
    接收器，用于接收截屏指令，所述截屏指令用于指示所述第一终端获取第一终端的用户界面；
    处理器，用于确定所述用户界面中的目标元素；
    所述处理器还用于，确定所述目标元素与所述用户界面的截图的关联关系；
    所述处理器还用于，确定所述用户界面的截图图片，所述用户界面的截图图片包括： 所述用户界面的截图、所述目标元素以及所述目标元素与所述用户界面的截图的关联关系。
  17. 根据权利要求16所述的终端，其特征在于，所述处理器，具体用于：
    根据目标格式确定所述目标元素，所述目标格式包括图片格式、视频格式、音频格式、地图格式、或超链接的格式中的至少一种；所述目标格式中的每个目标格式包括至少一种格式。
  18. 根据权利要求16或17所述的方法，其特征在于，所述处理器还用于，确定所述目标元素的内容，所述内容包括布局文件和/或原始文件，所述布局文件包括：所述目标元素的源代码和源地址。
  19. 根据权利要求16-18任意一项所述的终端，其特征在于，所述目标元素与所述用户界面的截图的关联关系，包括：
    所述目标元素与所述目标元素在所述用户界面的截图的位置、和所述目标元素与所述目标元素在所述用户界面的截图的比例之间的关联关系。
  20. 根据权利要求16-19任意一项所述的终端，其特征在于，所述处理器，具体用于：将所述截图、所述目标元素以及所述目标元素与所述用户界面的截图的关联关系嵌入所述用户界面的截图图片的元数据字段中。
  21. 根据权利要求16所述的终端，其特征在于，包括：
    所述接收器，具体用于接收截屏指令，所述截屏指令用于指示所述第一终端获取第一终端的用户界面的截图；
    所述处理器，具体用于根据所述截屏指令确定在所述第一终端前台运行的多个应用程序中的一个或多个的所述应用程序。
  22. 根据权利要求21所述的终端，其特征在于，所述处理器，具体用于：
    根据前台运行的至少一个应用程序以及目标格式确定在所述用户界面中的目标元素，所述目标格式包括图片格式、视频格式、音频格式、地图格式、或超链接的格式中的至少一种；所述目标格式中的每个目标格式包括至少一种格式。
  23. 根据权利要求21或22所述的终端，其特征在于，所述处理器，具体用于：
    根据前台运行的至少一个应用程序确定所述目标元素的内容，所述内容包括布局文件和/或原始文件，所述布局文件包括：所述目标元素的源代码和源地址。
  24. 根据权利要求16或21-23任意一项所述的终端，其特征在于，还包括：
    显示屏，用于显示所述目标元素的选择列表，以提供用户选择所述目标元素选择列表中包括一个或多个目标元素；
    所述处理器，具体用于将所述用户选定之后界面的截图、所述用户选定的目标元素以及所述用户选定的目标元素与所述用户选定之后的界面的截图的关联关系嵌入所述用户界面的截图图片中。
  25. 根据权利要求21-24任意一项所述的终端，其特征在于，所述目标元素的选择列表包括：
    所述目标元素的编号和/或预览信息。
  26. 根据权利要求24或25所述的终端，其特征在于，还包括：
    发送器，用于将所述用户界面的截图图片进行发送，所述用户界面的截图图片包括： 所述用户界面的截图、所述目标元素以及所述目标元素与所述用户界面的截图的关联关系。
  27. 根据权利要求24-26任意一项所述的终端，其特征在于，包括：
    所述处理器，具体用于若所述第一终端的用户界面包括多个所述用户选定的目标元素，则将所述用户界面的截图和多个所述用户选定的目标元素分别发送；
    所述发送多个所述用户选定的目标元素包括：采用发送所述用户选定的目标元素中的原始文件和/或布局文件的方法。
  28. 一种读取截图的终端，其特征在于，包括：
    接收器，用于接收用户界面的截图图片，所述用户界面的截图图片包括：所述用户界面的截图、所述目标元素以及所述目标元素与所述用户界面的截图的关联关系；
    处理器，用于根据所述目标元素与所述用户界面的的截图的关联关系确定触发点位于所述至少一个目标元素中的一个所在的区域时；则显示至少一个目标元素中的一个所对应的原始文件。
  29. 根据权利要求28所述的终端，其特征在于，该终端还包括：显示屏，用于呈现所述一个目标元素，包括：
    所述显示屏呈现所述一个目标元素的内容，所述内容包括布局文件，所述布局文件包括：所述目标元素的源代码和源地址，所述布局文件对应应用程序；
    根据所述布局文件以及所述应用程序显示所述一个目标元素的内容。
  30. 根据权利要求28或29所述的终端，其特征在于，所述目标元素包括原始文件的源地址；
    根据所述原始文件的源地址获取所述原始文件，所述原始文件的源地址包括统一资源定位符。
  31. 一种计算机可读存储介质，包括指令，当其在计算机上运行时，使得计算机执行如权利要求1-12任意一项所述的方法。
  32. 一种包含指令的计算机程序产品，当其在计算机上运行时，使得计算机执行如权利要求1-12任意一项所述的方法。
PCT/CN2017/088129 2016-10-18 2017-06-13 一种屏幕截图和读取的方法及终端 Ceased WO2018072459A1 (zh)

Priority Applications (2)

Application Number Priority Date Filing Date Title
US16/342,717 US11003331B2 (en) 2016-10-18 2017-06-13 Screen capturing method and terminal, and screenshot reading method and terminal
CN201780005428.7A CN108496150B (zh) 2016-10-18 2017-06-13 一种屏幕截图和读取的方法及终端

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201610908768 2016-10-18
CN201610908768.8 2016-10-18

Publications (1)

Publication Number Publication Date
WO2018072459A1 true WO2018072459A1 (zh) 2018-04-26

Family

ID=62018190

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/088129 Ceased WO2018072459A1 (zh) 2016-10-18 2017-06-13 一种屏幕截图和读取的方法及终端

Country Status (3)

Country Link
US (1) US11003331B2 (zh)
CN (1) CN108496150B (zh)
WO (1) WO2018072459A1 (zh)

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109343769A (zh) * 2018-09-27 2019-02-15 维沃移动通信有限公司 一种屏幕截取方法及移动终端
CN110780795A (zh) * 2019-10-30 2020-02-11 维沃移动通信有限公司 一种截屏方法及电子设备
CN110896405A (zh) * 2018-09-12 2020-03-20 西安中兴新软件有限责任公司 一种远程控制交互的方法、装置、设备及存储介质
KR20200034354A (ko) * 2018-09-21 2020-03-31 삼성전자주식회사 멀티미디어 콘텐트를 캡쳐하는 전자 장치 및 방법
CN111143015A (zh) * 2019-12-31 2020-05-12 维沃移动通信有限公司 一种截屏方法及电子设备
CN111522613A (zh) * 2020-04-16 2020-08-11 维沃移动通信有限公司 截屏方法及电子设备
CN115022268A (zh) * 2022-06-24 2022-09-06 深圳市六度人和科技有限公司 一种会话识别方法及装置、可读存储介质、计算机设备
US20230259696A1 (en) * 2017-05-16 2023-08-17 Apple Inc. Device, method, and graphical user interface for editing screenshot images

Families Citing this family (25)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105144175A (zh) * 2013-04-24 2015-12-09 皇家飞利浦有限公司 图像可视化
CN109660762B (zh) * 2018-12-21 2020-12-11 深圳英飞拓智能技术有限公司 智能抓拍装置中大小图关联方法及装置
CN111914563A (zh) * 2019-04-23 2020-11-10 广东小天才科技有限公司 一种结合语音的意图识别方法及装置
CN110187205A (zh) * 2019-05-20 2019-08-30 广州朗国电子科技有限公司 屏幕运行状态检测方法、装置及数字标牌
CN112015634A (zh) * 2019-05-31 2020-12-01 百度在线网络技术（北京）有限公司 页面结构信息生成方法、装置和电子设备
CN110456956A (zh) * 2019-08-05 2019-11-15 腾讯科技（深圳）有限公司 截图方法、装置、计算机设备和存储介质
CN110532056B (zh) * 2019-09-05 2024-04-26 腾讯科技（深圳）有限公司 一种应用于用户界面中的控件识别方法及装置
CN110781385A (zh) * 2019-10-09 2020-02-11 支付宝(杭州)信息技术有限公司 应用操作推荐方法、装置、设备及存储介质
CN113139370B (zh) * 2020-01-16 2025-01-10 京东方科技集团股份有限公司 一种表格提取方法、装置及触控显示装置
CN111443967B (zh) * 2020-03-23 2021-11-16 联想(北京)有限公司 图像处理方法及装置
CN112148162B (zh) 2020-09-18 2021-11-16 珠海格力电器股份有限公司 图标排列方法、装置、用户终端及存储介质
CN112596848B (zh) * 2020-12-30 2024-06-04 北京达佳互联信息技术有限公司 一种录屏方法、装置、电子设备、存储介质及程序产品
CN112843685A (zh) * 2020-12-31 2021-05-28 上海米哈游天命科技有限公司 拍摄方法、装置、电子设备及存储介质
CN112861612A (zh) * 2020-12-31 2021-05-28 上海米哈游天命科技有限公司 拍摄图像的方法、装置、电子设备及存储介质
CN112717378A (zh) * 2021-01-04 2021-04-30 厦门梦加网络科技股份有限公司 一种游戏动画发送系统
CN113176844B (zh) * 2021-04-09 2025-11-11 北京百舸飞驰科技有限公司 一种题目智能截图方法、装置、电子设备及存储介质
CN113139090A (zh) * 2021-04-16 2021-07-20 北京字节跳动网络技术有限公司 交互方法、装置、电子设备及计算机可读存储介质
CN113225603B (zh) * 2021-04-23 2023-08-18 深圳创维－Rgb电子有限公司 基于背光驱动的图片共享系统及方法
CN113407096A (zh) * 2021-06-30 2021-09-17 青岛海信移动通信技术股份有限公司 终端设备和图片处理方法
CN115712340B (zh) * 2021-08-20 2025-11-18 华为技术有限公司 电子设备及人机交互方法
CN113885765B (zh) * 2021-09-10 2025-12-09 维沃移动通信有限公司 截屏图片关联方法、装置及电子设备
CN113835582B (zh) * 2021-09-27 2024-03-15 青岛海信移动通信技术有限公司 一种终端设备、信息显示方法和存储介质
CN113961526B (zh) * 2021-11-22 2024-10-25 北京达佳互联信息技术有限公司 截屏图片的检测方法和装置
CN116755597A (zh) * 2023-05-05 2023-09-15 维沃移动通信有限公司 截图文件控制方法、装置、电子设备及存储介质
CN117892698B (zh) * 2024-03-14 2024-06-07 成都数之联科技股份有限公司 一种文字渐变渲染方法、设备及存储介质

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104090716A (zh) * 2014-07-25 2014-10-08 广东欧珀移动通信有限公司 一种移动终端快速截屏的方法及装置
CN105278833A (zh) * 2015-06-30 2016-01-27 维沃移动通信有限公司 信息的处理方法及终端
CN105302442A (zh) * 2015-10-30 2016-02-03 深圳市艾酷通信软件有限公司 一种图片信息的处理方法及终端

Family Cites Families (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
AU2000278962A1 (en) * 2000-10-19 2002-04-29 Copernic.Com Text extraction method for html pages
JP2007310327A (ja) * 2006-05-22 2007-11-29 Seiko Epson Corp 画像表示装置、画像表示方法およびプログラム
US7752575B2 (en) * 2007-02-06 2010-07-06 International Business Machines Corporation Attachment activation in screen captures
JP5417185B2 (ja) * 2010-01-07 2014-02-12 １ｓｔホールディングス株式会社 オブジェクト処理装置およびオブジェクト選択方法
CN102663793B (zh) * 2012-03-27 2015-11-11 上海量明科技发展有限公司 一种截图载入文档的方法、客户端及系统
US20130326352A1 (en) 2012-05-30 2013-12-05 Kyle Douglas Morton System For Creating And Viewing Augmented Video Experiences
US9076130B2 (en) * 2012-09-10 2015-07-07 International Business Machines Corporation Identifying a webpage from which an E-mail address is obtained
CN104461474A (zh) 2013-09-12 2015-03-25 北京三星通信技术研究有限公司 用于移动终端的截屏方法和截屏装置以及移动终端
CN104978117B (zh) * 2014-04-11 2018-11-09 阿里巴巴集团控股有限公司 一种实现截屏的方法和装置
KR102252448B1 (ko) * 2014-09-12 2021-05-14 삼성전자주식회사 제어 방법 및 그 방법을 처리하는 전자장치
KR102364085B1 (ko) * 2015-08-11 2022-02-17 엘지전자 주식회사 이동 단말기 및 그것의 제어방법
CN105242827A (zh) 2015-09-28 2016-01-13 小米科技有限责任公司 屏幕截图方法、装置及系统
CN106020608A (zh) * 2016-05-20 2016-10-12 北京小米移动软件有限公司 截图控制方法及装置
CN106371727A (zh) * 2016-08-30 2017-02-01 上海卓易科技股份有限公司 指纹截屏的方法及装置

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104090716A (zh) * 2014-07-25 2014-10-08 广东欧珀移动通信有限公司 一种移动终端快速截屏的方法及装置
CN105278833A (zh) * 2015-06-30 2016-01-27 维沃移动通信有限公司 信息的处理方法及终端
CN105302442A (zh) * 2015-10-30 2016-02-03 深圳市艾酷通信软件有限公司 一种图片信息的处理方法及终端

Cited By (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20230259696A1 (en) * 2017-05-16 2023-08-17 Apple Inc. Device, method, and graphical user interface for editing screenshot images
US12050857B2 (en) * 2017-05-16 2024-07-30 Apple Inc. Device, method, and graphical user interface for editing screenshot images
CN110896405A (zh) * 2018-09-12 2020-03-20 西安中兴新软件有限责任公司 一种远程控制交互的方法、装置、设备及存储介质
CN110896405B (zh) * 2018-09-12 2023-09-15 西安中兴新软件有限责任公司 一种远程控制交互的方法、装置、设备及存储介质
KR20200034354A (ko) * 2018-09-21 2020-03-31 삼성전자주식회사 멀티미디어 콘텐트를 캡쳐하는 전자 장치 및 방법
KR102629139B1 (ko) 2018-09-21 2024-01-26 삼성전자주식회사 멀티미디어 콘텐트를 캡쳐하는 전자 장치 및 방법
CN109343769A (zh) * 2018-09-27 2019-02-15 维沃移动通信有限公司 一种屏幕截取方法及移动终端
CN110780795A (zh) * 2019-10-30 2020-02-11 维沃移动通信有限公司 一种截屏方法及电子设备
CN111143015A (zh) * 2019-12-31 2020-05-12 维沃移动通信有限公司 一种截屏方法及电子设备
CN111522613A (zh) * 2020-04-16 2020-08-11 维沃移动通信有限公司 截屏方法及电子设备
CN111522613B (zh) * 2020-04-16 2024-03-22 维沃移动通信有限公司 截屏方法及电子设备
CN115022268A (zh) * 2022-06-24 2022-09-06 深圳市六度人和科技有限公司 一种会话识别方法及装置、可读存储介质、计算机设备
CN115022268B (zh) * 2022-06-24 2023-05-12 深圳市六度人和科技有限公司 一种会话识别方法及装置、可读存储介质、计算机设备

Also Published As

Publication number Publication date
CN108496150A (zh) 2018-09-04
US11003331B2 (en) 2021-05-11
CN108496150B (zh) 2020-12-08
US20200042148A1 (en) 2020-02-06

Similar Documents

Publication Publication Date Title
CN108496150B (zh) 一种屏幕截图和读取的方法及终端
KR102013331B1 (ko) 듀얼 카메라를 구비하는 휴대 단말기의 이미지 합성 장치 및 방법
CN116055610B (zh) 显示图形用户界面的方法和移动终端
US10775979B2 (en) Buddy list presentation control method and system, and computer storage medium
US12143747B2 (en) Subtitle presentation based on volume control
CN104462128A (zh) 多媒体文件处理的方法、装置和终端设备
CN111274416A (zh) 聊天信息查找方法及电子设备
CN104113787A (zh) 基于节目的评论方法、终端、服务器和系统
US11481357B2 (en) Album display method, electronic device, and storage medium
WO2018072149A1 (zh) 图片处理方法、装置、电子设备及图形用户界面
WO2019104478A1 (zh) 一种识别截图文字的方法及终端
US20190012320A1 (en) Multimedia File Management Method, Electronic Device, And Graphical User Interface
CN107193451B (zh) 信息展示方法、装置、计算机设备及计算机可读存储介质
WO2018196588A1 (zh) 一种信息分享方法、装置和系统
CN113127773A (zh) 页面处理方法、装置、存储介质及终端设备
US11908489B2 (en) Tap to advance by subtitles
CN108062390A (zh) 推荐用户的方法、装置和可读存储介质
CN111104380A (zh) 应用文件管理方法、装置、移动终端及存储介质
CN107506112A (zh) 数据处理方法、装置及终端设备
US20250039505A1 (en) Video notification system
CN111610909A (zh) 一种截图方法、装置及电子设备
WO2017032213A1 (zh) 信息处理方法、终端及电子设备
US20240251136A1 (en) Video sharing system
CN106598469A (zh) 一种优化存储方式的方法和装置及移动终端
KR20130125949A (ko) 사용자 라이프타임 관리 방법 및 장치

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17863138

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17863138

Country of ref document: EP

Kind code of ref document: A1