[go: up one dir, main page]

WO2017076039A1 - 一种智能设备多屏幕运行实现方法及其系统 - Google Patents

一种智能设备多屏幕运行实现方法及其系统 Download PDF

Info

Publication number
WO2017076039A1
WO2017076039A1 PCT/CN2016/088820 CN2016088820W WO2017076039A1 WO 2017076039 A1 WO2017076039 A1 WO 2017076039A1 CN 2016088820 W CN2016088820 W CN 2016088820W WO 2017076039 A1 WO2017076039 A1 WO 2017076039A1
Authority
WO
WIPO (PCT)
Prior art keywords
screen
image buffer
smart device
sub
virtual
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2016/088820
Other languages
English (en)
French (fr)
Inventor
程永忠
赖明权
周峻峰
时翠平
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huizhou TCL Mobile Communication Co Ltd
Original Assignee
Huizhou TCL Mobile Communication Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huizhou TCL Mobile Communication Co Ltd filed Critical Huizhou TCL Mobile Communication Co Ltd
Priority to EP16861309.9A priority Critical patent/EP3373130A4/en
Priority to US15/552,499 priority patent/US20180046368A1/en
Publication of WO2017076039A1 publication Critical patent/WO2017076039A1/zh
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1423—Digital output to display device ; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display
    • G06F3/1431—Digital output to display device ; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display using a single graphics controller
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04845—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range for image manipulation, e.g. dragging, rotation, expansion or change of colour
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04886—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G09G5/14—Display of multiple viewports
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G09G5/36—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the display of a graphic pattern, e.g. using an all-points-addressable [APA] memory
    • G09G5/39—Control of the bit-mapped memory
    • G09G5/393—Arrangements for updating the contents of the bit-mapped memory
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G09G5/36—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the display of a graphic pattern, e.g. using an all-points-addressable [APA] memory
    • G09G5/39—Control of the bit-mapped memory
    • G09G5/395—Arrangements specially adapted for transferring the contents of the bit-mapped memory to the screen
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04B—TRANSMISSION
    • H04B1/00—Details of transmission systems, not covered by a single one of groups H04B3/00 - H04B13/00; Details of transmission systems not characterised by the medium used for transmission
    • H04B1/38—Transceivers, i.e. devices in which transmitter and receiver form a structural unit and in which at least one part is used for functions of transmitting and receiving
    • H04B1/3827—Portable transceivers
    • H04B1/3833—Hand-held transceivers
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/048—Indexing scheme relating to G06F3/048
    • G06F2203/04803—Split screen, i.e. subdividing the display area or the window area into separate subareas
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/048—Indexing scheme relating to G06F3/048
    • G06F2203/04806—Zoom, i.e. interaction techniques or interactors for controlling the zooming operation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44—Arrangements for executing specific programs
    • G06F9/445—Program loading or initiating
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2340/00—Aspects of display data processing
    • G09G2340/04—Changes in size, position or resolution of an image
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2340/00—Aspects of display data processing
    • G09G2340/10—Mixing of images, i.e. displayed pixel being the result of an operation, e.g. adding, on the corresponding input pixels
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2340/00—Aspects of display data processing
    • G09G2340/12—Overlay of images, i.e. displayed pixel being the result of switching between the corresponding input pixels
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2360/00—Aspects of the architecture of display systems
    • G09G2360/12—Frame memory handling
    • G09G2360/121—Frame memory handling using a cache memory

Definitions

  • the present invention relates to the field of smart device display interaction technologies, and in particular, to a smart device multi-screen operation implementation method and system thereof.
  • the existing smart device display usually only realizes the output of one application display interface, and does not have the ability to reduce or enlarge the display interface (ie, virtual screen).
  • the display interface ie, virtual screen.
  • the existing Ubuntu system workspaces technology has similar functions, but it can only be divided into four virtual screens and cannot operate independently on the virtual screen.
  • Other multi-interface display systems such as the four-leaf clover interface used by Lenovo Music Phone, the tab bar of the Android operating system, etc., because of its multi-interface display operation method, can also not run simultaneously in one display. Multiple applications have large limitations.
  • the present invention aims to provide a method for implementing multi-screen operation of a smart device and a system thereof, which aim to solve the problem that the display screen of the smart device in the prior art is inconvenient for the user to simultaneously perform multi-application control. problem.
  • a smart device multi-screen running implementation method comprising:
  • A. Pre-set the number and layout of virtual screens running on the physical display of the smart device
  • the smart device multi-screen running implementation method wherein the method further includes:
  • the touch screen is divided into a plurality of corresponding independent regions to independently acquire the user for different virtual screens.
  • step D specifically includes:
  • D1 when the smart device is an Android operating system, setting a first sub-image buffer area and a second sub-image buffer area in the image buffer area;
  • the physical display of the smart device displays data of the second sub-image buffer; when the spliced application
  • the physical display of the smart device displays the data of the first sub-image buffer.
  • the smart device multi-screen running implementation method wherein the method further includes:
  • the smart device resources are sequentially used according to the startup sequence of the application.
  • the smart device multi-screen running implementation method wherein a handover area for receiving a user instruction and adjusting a size of each virtual screen is disposed between the virtual screens.
  • a smart device multi-screen running implementation method comprising:
  • A. Pre-set the number and layout of virtual screens running on the physical display of the smart device
  • the touch screen is divided into a plurality of corresponding independent regions to independently acquire the user for different virtual screens.
  • the step D specifically includes:
  • D1 when the smart device is an Android operating system, setting a first sub-image buffer area and a second sub-image buffer area in the image buffer area;
  • the physical display of the smart device displays data of the second sub-image buffer; when the spliced application
  • the physical display of the smart device displays the data of the first sub-image buffer.
  • a smart device multi-screen running implementation method comprising:
  • A. Pre-set the number and layout of virtual screens running on the physical display of the smart device
  • the touch screen is divided into a plurality of corresponding independent regions to independently acquire the user for different virtual screens.
  • the step D specifically includes:
  • D1 when the smart device is an Android operating system, setting a first sub-image buffer area and a second sub-image buffer area in the image buffer area;
  • the physical display of the smart device displays data of the second sub-image buffer;
  • the physical display of the smart device displays the data of the first sub-image buffer;
  • a handover area for receiving user commands and adjusting the size of each virtual screen is disposed between the virtual screens.
  • a smart device multi-screen operating system wherein the system comprises:
  • a setting module for presetting the number and layout of virtual screens running on a physical display of the smart device
  • a pixel area calculation module configured to calculate, according to the preset number of virtual screens and a layout, a pixel area of a physical display screen occupied by each virtual screen;
  • a zooming module configured to scale the display interface of the application corresponding to the virtual screen according to the ratio of the pixel area to the physical display screen;
  • a splicing module configured to splicing display interfaces of the plurality of applications into the image buffer area
  • a physical display that displays the display interface of the spliced application to run multiple virtual screens simultaneously on the physical display.
  • the smart device multi-screen running system further includes:
  • the control module is configured to divide the touch screen into a plurality of corresponding independent areas according to the layout of the virtual screen to independently acquire a touch operation instruction of the user in an application displayed in different virtual screens.
  • the smart device multi-screen running system wherein the splicing module specifically includes:
  • An image buffer setting unit configured to set a first sub-image buffer area and a second sub-image buffer area in the image buffer area
  • a cache display unit configured to: when the first sub-image buffer is written on the display interface of the spliced application, the physical display of the smart device displays data of the second sub-image buffer; When the display interface of the spliced application is written into the second sub-image buffer, the physical display of the smart device displays the data of the first sub-image buffer.
  • the smart device multi-screen running system wherein the system further comprises:
  • the startup timing module is configured to sequentially use the smart device resource according to an application startup sequence when two or more applications acquire user instructions and simultaneously invoke the same smart device resource.
  • the smart device multi-screen running system wherein a virtualized screen is provided with a handover area for receiving user instructions and adjusting the size of each virtual screen.
  • a smart device multi-screen operating system wherein the system comprises:
  • a setting module for presetting the number and layout of virtual screens running on a physical display of the smart device
  • a pixel area calculation module configured to calculate, according to the preset number of virtual screens and a layout, a pixel area of a physical display screen occupied by each virtual screen;
  • a zooming module configured to scale the display interface of the application corresponding to the virtual screen according to the ratio of the pixel area to the physical display screen;
  • a splicing module configured to splicing display interfaces of the plurality of applications into the image buffer area
  • a physical display screen displaying a display interface of the spliced application to simultaneously run a plurality of virtual screens on the physical display screen;
  • control module configured to divide the touch screen into a plurality of corresponding independent areas according to the layout of the virtual screen, so as to independently acquire a touch operation instruction of the application displayed by the user on different virtual screens;
  • the splicing module specifically includes:
  • An image buffer setting unit configured to set a first sub-image buffer area and a second sub-image buffer area in the image buffer area
  • a cache display unit configured to: when the first sub-image buffer is written on the display interface of the spliced application, the physical display of the smart device displays data of the second sub-image buffer; When the display interface of the spliced application is written into the second sub-image buffer, the physical display of the smart device displays the data of the first sub-image buffer.
  • a smart device multi-screen operating system wherein the system comprises:
  • a setting module for presetting the number and layout of virtual screens running on a physical display of the smart device
  • a pixel area calculation module configured to calculate, according to the preset number of virtual screens and a layout, a pixel area of a physical display screen occupied by each virtual screen;
  • a zooming module configured to scale the display interface of the application corresponding to the virtual screen according to the ratio of the pixel area to the physical display screen;
  • a splicing module configured to splicing display interfaces of the plurality of applications into the image buffer area
  • a physical display screen displaying a display interface of the spliced application to simultaneously run a plurality of virtual screens on the physical display screen;
  • control module configured to divide the touch screen into a plurality of corresponding independent areas according to the layout of the virtual screen, so as to independently acquire a touch operation instruction of the application displayed by the user on different virtual screens;
  • the startup timing module is configured to sequentially use the smart device resource according to an application startup sequence when two or more application programs acquire user instructions and simultaneously invoke the same smart device resource;
  • the splicing module specifically includes:
  • An image buffer setting unit configured to set a first sub-image buffer area and a second sub-image buffer area in the image buffer area
  • a cache display unit configured to: when the first sub-image buffer is written on the display interface of the spliced application, the physical display of the smart device displays data of the second sub-image buffer; When the display interface of the spliced application is written into the second sub-image buffer, the physical display of the smart device displays the data of the first sub-image buffer.
  • the present invention provides a smart device multi-screen running implementation method and system thereof, and realizes simultaneous display of multiple virtual screens on one physical display screen by setting a specific virtual screen running implementation method, and the above multiple
  • the virtual screens can be operated independently, so that the user can control multiple applications independently, which greatly facilitates the user's complicated operations that need to be called by multiple applications, and effectively simplifies the use of the smart devices by the user. Good application prospects.
  • FIG. 1 is a flowchart of a method for implementing a multi-screen operation of a smart device according to an embodiment of the present invention.
  • step S400 is a flowchart of a method of step S400 of a method for implementing multi-screen operation of a smart device according to an embodiment of the present invention.
  • FIG. 3 is a schematic diagram of a method for implementing multi-screen operation of a smart device by using two sub-image buffer areas according to an embodiment of the present invention.
  • FIG. 4 is a structural block diagram of a multi-screen operation system of a smart device according to an embodiment of the present invention.
  • FIG. 5 is a schematic diagram of an operation example of a method for implementing multi-screen operation of a smart device according to an embodiment of the present invention.
  • the invention provides a method and a system for implementing multi-screen operation of a smart device.
  • the present invention will be further described in detail below with reference to the accompanying drawings and embodiments. It is understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
  • FIG. 1 a method for implementing multi-screen operation of a smart device according to a specific embodiment of the present invention is shown.
  • the method includes the following steps:
  • S100 preset the number and layout of virtual screens running on a physical display of the smart device.
  • the virtual screen refers to a display interface of a specific application (ie, an interface with the user).
  • the smart device can only display the display interface of an application on the screen.
  • the quantity and layout can be personalized by the user or set by the manufacturer at the factory.
  • the application may specifically include a third party application, a desktop launcher, a built-in app, and the like.
  • the step S400 specifically includes:
  • the physical display of the smart device displays data of the second sub-image buffer; when the spliced application
  • the physical display of the smart device displays the data of the first sub-image buffer.
  • the above-mentioned setting of the two sub-image buffer areas (the first and second sub-image buffer areas) for the display interface of the spliced application can effectively avoid the problem that the display buffer is simultaneously written and displayed on the physical display screen.
  • a specific application example is shown in FIG. 3.
  • the physical display 500 displays only the image of the second sub-image buffer 2A, when the first After the sub-picture buffer 1A is written, when the physical display 500 is displayed, the application 1 writes the display data to the second sub-picture buffer 2A.
  • S500 Display a display interface of the spliced application through a physical display screen to simultaneously run a plurality of virtual screens on the physical display screen.
  • the method when the physical display of the smart device is a touch screen, the method further includes:
  • Step S600 According to the layout of the virtual screen, the touch screen is divided into a plurality of corresponding independent areas to independently acquire touch operation instructions of the user for the application displayed in different virtual screens.
  • the input device (touch screen) of the smart device is correspondingly divided into multiple independent regions corresponding to the virtual screen, thereby facilitating the user to operate on different applications on the same touch screen and obtain feedback of the application.
  • the initial settings or the user set the number and layout of the virtual screens.
  • the touch screen (touch screen) then drives the pixel area and scale of the virtual screen.
  • the touch screen acquires a user's instruction (touched position information, etc.), drives the corresponding trigger event and is processed by the control system of the smart device, for example, when the calling resource conflicts.
  • the method further includes: when two or more applications acquire user instructions and simultaneously invoke the same smart device resource, the smart device resources are sequentially used according to the startup sequence of the application.
  • the first screen that opens the camera takes precedence over the camera, and the second screen that opens the camera cannot use the camera until the first screen is pushed out of the camera. If the user instructs to turn on the camera in three virtual screens, then it is executed in the order of the first, second, and third.
  • the following describes the specific implementation method of the multi-screen running implementation method of the present invention by taking the screen resolution of 1280 ⁇ 720 and setting the number of virtual screens as two.
  • the application 10 and the application 20 are compressed into a resolution of 640 ⁇ 720 according to a ratio of one-half in the operation module “image splicing area” K1 of the smart device, and then two applications are applied.
  • the stitching forms an image of 1280 x 720 resolution corresponding to the physical display screen.
  • the stitched image is first written into the first buffer area 1B, and the physical display screen reads the data of the second buffer area 2B. After the first buffer area 1B is written, when the physical display device displays, the spliced image writes the display data to the second buffer area 2B to avoid the problem of the flower screen and the like caused by the simultaneous writing and reading operations.
  • a handover area for receiving user commands and adjusting the size of each virtual screen is disposed between the plurality of virtual screens.
  • the handover area is also the boundary line between the two virtual screens. The user can change the size and layout of the virtual screen in real time by moving or pulling the boundary line, which is very convenient for the user to use.
  • the entire physical display area can simultaneously display multiple virtual screens, including but not limited to two, three, four or more. It is also possible for the user to set the number and layout of the virtual screens.
  • the program running in any one virtual screen does not affect the programs of other virtual screens in terms of display.
  • the same program can also be run in different virtual screens.
  • any virtual screen cannot overlap for guaranteed use.
  • a program in any virtual screen is full screen, it can only be covered with the virtual screen where it is located, and the interface displayed by any program in the virtual screen can only be displayed on the virtual screen where it is located, and cannot be displayed on a virtual screen.
  • Another part is displayed in one or more virtual screens.
  • the interface displayed by the program in any of the virtual screens cannot cover the intersection of the virtual screens.
  • This multi-screen run is only done in one operating system, and any virtual screen has one and only one operating system interface. Moreover, the content displayed by the operating system interface displayed in any one virtual screen and the entire display interface only show that the content displayed on one virtual screen is consistent.
  • the present invention also provides a smart device multi-screen running system.
  • the system includes:
  • the setting module 100 is configured to preset the number and layout of the virtual screens running on the physical display screen of the smart device.
  • the pixel area calculation module 200 is configured to calculate, according to the preset number of virtual screens and the layout, a pixel area that generates a physical display screen occupied by each virtual screen.
  • the scaling module 300 is configured to scale the display interface of the application corresponding to the virtual screen according to the ratio of the pixel area to the physical display screen.
  • a splicing module 400 configured to splicing display interfaces of the plurality of applications into respective image buffers
  • the physical display 500 displays a display interface of the spliced application to simultaneously run a plurality of virtual screens on the physical display.
  • the system further includes a control module, configured to divide the touch screen into corresponding ones according to a layout of the virtual screen.
  • the independent area thus independently acquires touch operation instructions of the user for applications displayed in different virtual screens.
  • the splicing module specifically includes:
  • An image buffer setting unit configured to set a first sub-image buffer area and a second sub-image buffer area in the image buffer area
  • a cache display unit configured to: when the first sub-image buffer is written on the display interface of the spliced application, the physical display of the smart device displays data of the second sub-image buffer; When the display interface of the spliced application is written into the second sub-image buffer, the physical display of the smart device displays the data of the first sub-image buffer.
  • system further includes:
  • the startup timing module is configured to sequentially use the smart device resource according to an application startup sequence when two or more applications acquire user instructions and simultaneously invoke the same smart device resource.
  • a handover area for receiving a user instruction and adjusting a size of each virtual screen is disposed between the plurality of virtual screens. Specifically as described above.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Computer Hardware Design (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Computer Graphics (AREA)
  • User Interface Of Digital Computer (AREA)
  • Controls And Circuits For Display Device (AREA)

Abstract

一种智能设备多屏幕运行实现方法及其系统，其通过设置特定的虚拟屏幕运行实现方法，在一个物理显示屏上实现了多个虚拟屏幕的同时显示，而且多个虚拟屏幕之间可以独立运行。

Description

一种智能设备多屏幕运行实现方法及其系统 技术领域
本发明涉及智能设备显示交互技术领域，尤其涉及一种智能设备多屏幕运行实现方法及其系统。
背景技术
随着智能设备的不断发展，智能设备的多进程同时能力得到了很到的提高，在智能设备，例如手机、平板电脑上同时运行多个应用程序已经非常普遍。
而且随着应用程序数量的爆炸性增长，用户在完成一系列动作时，普遍需要同时启动多个应用进行操作才能得到满意的结果。但现有的智能设备显示屏通常仅能实现一个应用程序显示界面的输出，也不具有缩小或者放大显示界面（亦即虚拟屏幕）的能力。在用户需要使用不同的应用程序时，需要来回的切换智能设备显示屏显示的应用程序显示界面来实现对不同的应用程序的控制，这使得用户的使用非常的不便。
现有的Ubuntu系统workspaces技术拥有类似的功能，但是其仅能实现将显示屏分为4个虚拟屏幕而无法分别独立对虚拟屏幕进行操作。其他一些例如联想乐phone所采用的四叶草界面、安卓操作系统自带的标签栏等等的一些多界面显示系统由于其多界面显示运行的方法，导致其同样无法在一个显示屏内同时运行多个应用程序，具有较大的局限性。
因此，现有技术还有待发展。
 技术问题
鉴于上述现有技术的不足之处，本发明的目的在于提供一种智能设备多屏幕运行实现方法及其系统，旨在解决现有技术中智能设备显示屏不便于用户同时进行多应用程序控制的问题。
 技术解决方案
为了达到上述目的，本发明采取了以下技术方案：
一种智能设备多屏幕运行实现方法，其中，所述方法包括：
A、预先设定在智能设备的物理显示屏上运行的虚拟屏幕的数量及布局；
B、根据所述预先设定的虚拟屏幕数量及布局，计算生成每一虚拟屏幕占据的物理显示屏的像素区域；
C、根据所述像素区域与物理显示屏的比例，等比例的缩放与虚拟屏幕对应的应用程序的显示界面；
D、将所述多个应用程序的显示界面进行拼接并写入图像缓存区中；
E、通过物理显示屏显示所述拼接的应用程序的显示界面从而在所述物理显示屏上同时运行多个虚拟屏幕。
所述的智能设备多屏幕运行实现方法，其中，所述方法还包括：
F、当所述智能设备的物理显示屏为触控屏时，根据所述虚拟屏幕的布局，将所述触控屏分为若干个相对应的独立区域从而独立的获取用户在对于不同虚拟屏幕中显示的应用程序的触控操作指令。
所述的智能设备多屏幕运行实现方法，其中，所述步骤D具体包括：
D1、当所述智能设备为安卓操作系统时，在图像缓存区内设置第一子图像缓存区及第二子图像缓存区；
D2、当在所述拼接的应用程序的显示界面写入第一子图像缓存区时，则所述智能设备的物理显示屏显示第二子图像缓存区的数据；当在所述拼接的应用程序的显示界面写入第二子图像缓存区时，则所述智能设备的物理显示屏显示第一子图像缓存区的数据。。
所述的智能设备多屏幕运行实现方法，其中，所述方法还包括：
G、当两个或以上应用程序获取用户指令，同时调用同一智能设备资源时，根据应用程序的启动顺序，依次使用所述智能设备资源。
所述的智能设备多屏幕运行实现方法，其中，所述虚拟屏幕之间设置有用于接收用户指令，调整各虚拟屏幕大小的交接区域。
一种智能设备多屏幕运行实现方法，其中，所述方法包括：
A、预先设定在智能设备的物理显示屏上运行的虚拟屏幕的数量及布局；
B、根据所述预先设定的虚拟屏幕数量及布局，计算生成每一虚拟屏幕占据的物理显示屏的像素区域；
C、根据所述像素区域与物理显示屏的比例，等比例的缩放与虚拟屏幕对应的应用程序的显示界面；
D、将所述多个应用程序的显示界面进行拼接并写入图像缓存区中；
E、通过物理显示屏显示拼接的应用程序的显示界面从而在所述物理显示屏上同时运行多个虚拟屏幕；
F、当所述智能设备的物理显示屏为触控屏时，根据所述虚拟屏幕的布局，将所述触控屏分为若干个相对应的独立区域从而独立的获取用户在对于不同虚拟屏幕中显示的应用程序的触控操作指令；
所述步骤D具体包括：
D1、当所述智能设备为安卓操作系统时，在图像缓存区内设置第一子图像缓存区及第二子图像缓存区；
D2、当在所述拼接的应用程序的显示界面写入第一子图像缓存区时，则所述智能设备的物理显示屏显示第二子图像缓存区的数据；当在所述拼接的应用程序的显示界面写入第二子图像缓存区时，则所述智能设备的物理显示屏显示第一子图像缓存区的数据。
一种智能设备多屏幕运行实现方法，其中，所述方法包括：
A、预先设定在智能设备的物理显示屏上运行的虚拟屏幕的数量及布局；
B、根据所述预先设定的虚拟屏幕数量及布局，计算生成每一虚拟屏幕占据的物理显示屏的像素区域；
C、根据所述像素区域与物理显示屏的比例，等比例的缩放与虚拟屏幕对应的应用程序的显示界面；
D、将所述多个应用程序的显示界面进行拼接并写入图像缓存区中；
E、通过物理显示屏显示拼接的应用程序的显示界面从而在所述物理显示屏上同时运行多个虚拟屏幕；
F、当所述智能设备的物理显示屏为触控屏时，根据所述虚拟屏幕的布局，将所述触控屏分为若干个相对应的独立区域从而独立的获取用户在对于不同虚拟屏幕中显示的应用程序的触控操作指令；
所述步骤D具体包括：
D1、当所述智能设备为安卓操作系统时，在图像缓存区内设置第一子图像缓存区及第二子图像缓存区；
D2、当在所述拼接的应用程序的显示界面写入第一子图像缓存区时，则所述智能设备的物理显示屏显示第二子图像缓存区的数据；当在所述拼接的应用程序的显示界面写入第二子图像缓存区时，则所述智能设备的物理显示屏显示第一子图像缓存区的数据；
所述虚拟屏幕之间设置有用于接收用户指令，调整各虚拟屏幕大小的交接区域。
一种智能设备多屏幕运行系统，其中，所述系统包括：
设定模块，用于预先设定在智能设备的物理显示屏上运行的虚拟屏幕的数量及布局；
像素区域计算模块，用于根据所述预先设定的虚拟屏幕数量及布局，计算生成每一虚拟屏幕占据的物理显示屏的像素区域；
缩放模块，用于根据所述像素区域与物理显示屏的比例，等比例的缩放与虚拟屏幕对应的应用程序的显示界面；
拼接模块，用于将所述多个应用程序的显示界面进行拼接并写入图像缓存区中；
物理显示屏，显示所述拼接的应用程序的显示界面从而在物理显示屏上同时运行多个虚拟屏幕。
所述的智能设备多屏幕运行系统，其中，还包括：
控制模块，用于根据所述虚拟屏幕的布局，将所述触控屏分为若干个相对应的独立区域从而独立的获取用户在对于不同虚拟屏幕中显示的应用程序的触控操作指令。
所述的智能设备多屏幕运行系统，其中，所述拼接模块具体包括：
图像缓存区设置单元，用于在图像缓存区内设置第一子图像缓存区及第二子图像缓存区；
缓存显示单元，用于当在所述拼接的应用程序的显示界面写入第一子图像缓存区时，则所述智能设备的物理显示屏显示第二子图像缓存区的数据；当在所述拼接的应用程序的显示界面写入第二子图像缓存区时，则所述智能设备的物理显示屏显示第一子图像缓存区的数据。。
所述的智能设备多屏幕运行系统，其中，所述系统还包括：
启动时序模块，用于当两个或以上应用程序获取用户指令，同时调用同一智能设备资源时，根据应用程序的启动顺序，依次使用所述智能设备资源。
所述的智能设备多屏幕运行系统，其中，虚拟屏幕之间设置有用于接收用户指令，调整各虚拟屏幕大小的交接区域。
一种智能设备多屏幕运行系统，其中，所述系统包括：
设定模块，用于预先设定在智能设备的物理显示屏上运行的虚拟屏幕的数量及布局；
像素区域计算模块，用于根据所述预先设定的虚拟屏幕数量及布局，计算生成每一虚拟屏幕占据的物理显示屏的像素区域；
缩放模块，用于根据所述像素区域与物理显示屏的比例，等比例的缩放与虚拟屏幕对应的应用程序的显示界面；
拼接模块，用于将所述多个应用程序的显示界面进行拼接并写入图像缓存区中；
物理显示屏，显示所述拼接的应用程序的显示界面从而在物理显示屏上同时运行多个虚拟屏幕；
控制模块，用于根据所述虚拟屏幕的布局，将所述触控屏分为若干个相对应的独立区域从而独立的获取用户在对于不同虚拟屏幕中显示的应用程序的触控操作指令；
所述拼接模块具体包括：
图像缓存区设置单元，用于在图像缓存区内设置第一子图像缓存区及第二子图像缓存区；
缓存显示单元，用于当在所述拼接的应用程序的显示界面写入第一子图像缓存区时，则所述智能设备的物理显示屏显示第二子图像缓存区的数据；当在所述拼接的应用程序的显示界面写入第二子图像缓存区时，则所述智能设备的物理显示屏显示第一子图像缓存区的数据。
一种智能设备多屏幕运行系统，其中，所述系统包括：
设定模块，用于预先设定在智能设备的物理显示屏上运行的虚拟屏幕的数量及布局；
像素区域计算模块，用于根据所述预先设定的虚拟屏幕数量及布局，计算生成每一虚拟屏幕占据的物理显示屏的像素区域；
缩放模块，用于根据所述像素区域与物理显示屏的比例，等比例的缩放与虚拟屏幕对应的应用程序的显示界面；
拼接模块，用于将所述多个应用程序的显示界面进行拼接并写入图像缓存区中；
物理显示屏，显示所述拼接的应用程序的显示界面从而在物理显示屏上同时运行多个虚拟屏幕；
控制模块，用于根据所述虚拟屏幕的布局，将所述触控屏分为若干个相对应的独立区域从而独立的获取用户在对于不同虚拟屏幕中显示的应用程序的触控操作指令；
启动时序模块，用于当两个或以上应用程序获取用户指令，同时调用同一智能设备资源时，根据应用程序的启动顺序，依次使用所述智能设备资源；
所述拼接模块具体包括：
图像缓存区设置单元，用于在图像缓存区内设置第一子图像缓存区及第二子图像缓存区；
缓存显示单元，用于当在所述拼接的应用程序的显示界面写入第一子图像缓存区时，则所述智能设备的物理显示屏显示第二子图像缓存区的数据；当在所述拼接的应用程序的显示界面写入第二子图像缓存区时，则所述智能设备的物理显示屏显示第一子图像缓存区的数据。
 有益效果
有益效果：本发明提供的一种智能设备多屏幕运行实现方法及其系统，通过设置特定的虚拟屏幕运行实现方法，在一个物理显示屏上实现了多个虚拟屏幕的同时显示，而且上述多个虚拟屏幕之间可以独立运行，使得用户在独立的控制多个应用程序，其极大的方便了用户对于需要调用多个应用程序完成的复杂操作，有效的简化了用户对于智能设备的使用，具有良好的应用前景。
 附图说明
图1为本发明具体实施例的智能设备多屏幕运行实现方法的方法流程图。
图2为本发明具体实施例的智能设备多屏幕运行实现方法的步骤S400的方法流程图。
图3为本发明具体实施例的智能设备多屏幕运行实现方法应用两个子图像缓存区的示意图。
图4为本发明具体实施例的智能设备多屏幕运行系统的结构框图。
图5为本发明具体实施例的智能设备多屏幕运行实现方法的运行实例的示意图。
 本发明的最佳实施方式
本发明提供一种智能设备多屏幕运行实现方法及其系统。为使本发明的目的、技术方案及效果更加清楚、明确，以下参照附图并举实施例对本发明进一步详细说明。应当理解，此处所描述的具体实施例仅用以解释本发明，并不用于限定本发明。
如图1所示，为本发明具体实施例的一种智能设备多屏幕运行实现方法。所述方法包括如下步骤：
S100、预先设定在智能设备的物理显示屏上运行的虚拟屏幕的数量及布局。所述虚拟屏幕是指一个特定的应用程序的显示界面（即与用户的交互界面）一般的，智能设备仅能在屏幕上显示一个应用程序的显示界面。
所述数量及布局均可以由用户进行个性化设置，或者由厂商在出厂时进行设置。
S200、根据所述预先设定的虚拟屏幕数量及布局，计算生成每一虚拟屏幕占据的物理显示屏的像素区域。
S300、根据所述像素区域与物理显示屏的比例，等比例的缩放与虚拟屏幕对应的应用程序的显示界面。应当说明的是，所述应用程序具体可以包括第三方应用、桌面Launcher以及内置app等等。
S400、将所述多个应用程序的显示界面进行拼接并写入图像缓存区中。
由于在安卓系统中，程序在写入显示缓存（即所述图像缓存区）时，如果同时在物理显示屏显示，会导致闪屏、花屏和闪烁等问题。因此，较佳的时，如图2所示，所述步骤S400具体包括：
S410、当所述智能设备为安卓操作系统时，在图像缓存区内设置第一子图像缓存区及第二子图像缓存区。
S420、当在所述拼接的应用程序的显示界面写入第一子图像缓存区时，则所述智能设备的物理显示屏显示第二子图像缓存区的数据；当在所述拼接的应用程序的显示界面写入第二子图像缓存区时，则所述智能设备的物理显示屏显示第一子图像缓存区的数据。
上述为拼接的应用程序的显示界面设置两个子图像缓存区（第一及第二子图像缓存区）的设置，能够有效的避免显示缓存同时进行写入及物理显示屏显示的问题。具体应用实例如图3所示，例如，特定的应用程序1在写入显示数据到第一子图像缓存区1A时，物理显示屏500只显示第二子图像缓存区2A的图像，当第一子图像缓存区1A写入完成后，在物理显示屏500显示时，应用程序1再往第二子图像缓存区2A写入显示数据。
S500、通过物理显示屏显示所述拼接的应用程序的显示界面从而在所述物理显示屏上同时运行多个虚拟屏幕。
在本发明的具体实施例中，当所述智能设备的物理显示屏为触控屏时，所述方法还包括：
步骤S600、根据所述虚拟屏幕的布局，将所述触控屏分为若干个相对应的独立区域从而独立的获取用户在对于不同虚拟屏幕中显示的应用程序的触控操作指令。
亦即将智能设备的输入设备（触控屏）相应地划分为与虚拟屏幕对应的多个独立区域，从而便于用户在同一触控屏上对于不同的应用程序进行操作并获取应用程序的反馈。
所述具体实现的逻辑运算过程如下（以存在三个应用为例）：
首先，初始设置或者用户设定虚拟屏幕的数量和布局。然后触控屏（触摸屏）驱动计算虚拟屏幕的像素区域及缩放比例。
触摸屏获取用户的指令（触摸的位置信息等），驱动处理相对应的触发事件并由智能设备的控制系统进行处理，例如在调用资源出现冲突时的处理。
由于本发明所述运行实现方法可以在同一个物理触控屏幕上同时进行多个应用程序的操作。因此，很有可能出现当多个虚拟屏幕的程序同时抢占同一资源（智能设备硬件资源，如扬声器、麦克风等等）的情况。
为有效的解决上述冲突，所述方法还包括：当两个或以上应用程序获取用户指令，同时调用同一智能设备资源时，根据应用程序的启动顺序，依次使用所述智能设备资源。
例如，当用户在两个虚拟屏幕中打开摄像头时，第一个打开摄像头的屏幕优先使用摄像头，第二个打开摄像头的屏幕无法使用摄像头，直到第一个屏幕推出摄像头为止。若用户在三个虚拟屏幕中指示打开摄像头，那么，则根据第一、第二、第三的次序执行。
以下以屏幕分辨率1280×720，设置虚拟屏幕数量为两个为例，对本发明所述的多屏幕运行实现方法的具体实现方法进行阐述。
如图5所示，在所述智能设备额外增设的运算模块“图像拼接区”K1内根据二分之一的比例对应用10及应用20压缩成640×720的分辨率，然后将两个应用拼接形成与物理显示屏相对应的1280×720的分辨率的图像。
拼接后的图像首先写入第一缓存区1B中，物理显示屏则读取第二缓存区2B的数据。当第一缓存区1B写入完成后，在物理显示设备显示时，拼接后的图像再往第二缓存区2B写入显示数据从而避免同时写入和读取操作时造成的花屏等问题。
较佳的是，在所述多个虚拟屏幕之间设置有用于接收用户指令，调整各虚拟屏幕大小的交接区域。所述交接区域亦即两个虚拟屏幕之间的交界线。用户可以通过移动或者拉动所述交界线来实时的改变虚拟屏幕的大小及布局，非常便于用户的使用。
综上所述，本发明所述的多屏幕运行实现方法的具体实施中，一般的能够满足如下的需求：
首先、整个物理显示区域可以同时显示多个虚拟屏幕，包括但不仅限于2个，3个，4个或更多。也可以由用户设定虚拟屏幕的数量和布局。
其中，在应用程序运行上，任何一个虚拟屏幕内运行的程序在显示方面不影响其他虚拟屏幕的程序。同一个程序也可以在不同的虚拟屏幕内运行。
而当面临多个虚拟屏幕的程序同时抢占同一资源的冲突时，以启动顺序优先使用。
在物理显示屏幕（触摸屏）上，拉动虚拟屏幕的交接处，可以调节虚拟屏幕的大小。而无论整个显示界面被分割成多少个虚拟屏幕，这些虚拟屏幕必须铺满整个显示界面。
应当注意的都是，为保证使用，任何一个虚拟屏幕都不可以重叠。任何一个虚拟屏幕内的程序全屏时，只能铺满它所在的虚拟屏幕，并且任何一个虚拟屏幕内的程序显示的界面，只能在它所在的虚拟屏幕，不能在一个虚拟屏幕显示一部分，在另一个或多个虚拟屏幕内显示另一个部分。
在任何一个虚拟屏幕内的程序显示的界面，不能覆盖虚拟屏幕的交接处。
该多屏幕运行仅在一个操作系统中进行，任何一个虚拟屏幕有且仅有显示一个操作系统界面。而且任何一个虚拟屏幕内显示的操作系统界面显示的内容和整个显示界面只显示一个虚拟屏幕所显示的内容是一致的。
如图4所示，本发明还提供了一种智能设备多屏幕运行系统。所述系统包括：
设定模块100，用于预先设定在智能设备的物理显示屏上运行的虚拟屏幕的数量及布局。
像素区域计算模块200，用于根据所述预先设定的虚拟屏幕数量及布局，计算生成每一虚拟屏幕占据的物理显示屏的像素区域。
缩放模块300，用于根据所述像素区域与物理显示屏的比例，等比例的缩放与虚拟屏幕对应的应用程序的显示界面。
拼接模块400，用于将所述多个应用程序的显示界面进行拼接并分别写入对应的图像缓存区中
物理显示屏500，显示所述拼接的应用程序的显示界面从而在物理显示屏上同时运行多个虚拟屏幕。
具体的，当所述智能设备的物理显示屏为触控屏时，所述系统还包括一控制模块，用于根据所述虚拟屏幕的布局，将所述触控屏分为若干个相对应的独立区域从而独立的获取用户在对于不同虚拟屏幕中显示的应用程序的触控操作指令。
较佳的是，当所述智能设备为安卓操作系统时，所述拼接模块具体包括：
图像缓存区设置单元，用于在图像缓存区内设置第一子图像缓存区及第二子图像缓存区；
缓存显示单元，用于当在所述拼接的应用程序的显示界面写入第一子图像缓存区时，则所述智能设备的物理显示屏显示第二子图像缓存区的数据；当在所述拼接的应用程序的显示界面写入第二子图像缓存区时，则所述智能设备的物理显示屏显示第一子图像缓存区的数据。
更具体的，所述系统还包括：
启动时序模块，用于当两个或以上应用程序获取用户指令，同时调用同一智能设备资源时，根据应用程序的启动顺序，依次使用所述智能设备资源。
具体的，多个虚拟屏幕之间设置有用于接收用户指令，调整各虚拟屏幕大小的交接区域。具体如上所述。
可以理解的是，对本领域普通技术人员来说，可以根据本发明的技术方案及本发明构思加以等同替换或改变，而所有这些改变或替换都应属于本发明所附的权利要求的保护范围。

Claims (14)

  1. 一种智能设备多屏幕运行实现方法，其中，所述方法包括：
    A、预先设定在智能设备的物理显示屏上运行的虚拟屏幕的数量及布局；
    B、根据所述预先设定的虚拟屏幕数量及布局，计算生成每一虚拟屏幕占据的物理显示屏的像素区域；
    C、根据所述像素区域与物理显示屏的比例，等比例的缩放与虚拟屏幕对应的应用程序的显示界面；
    D、将所述多个应用程序的显示界面进行拼接并写入图像缓存区中；
    E、通过物理显示屏显示拼接的应用程序的显示界面从而在所述物理显示屏上同时运行多个虚拟屏幕。
  2. 根据权利要求1所述的智能设备多屏幕运行实现方法，其中，所述方法还包括：
    F、当所述智能设备的物理显示屏为触控屏时，根据所述虚拟屏幕的布局，将所述触控屏分为若干个相对应的独立区域从而独立的获取用户在对于不同虚拟屏幕中显示的应用程序的触控操作指令。
  3. 根据权利要求1所述的智能设备多屏幕运行实现方法，其中，所述步骤D具体包括：
    D1、当所述智能设备为安卓操作系统时，在图像缓存区内设置第一子图像缓存区及第二子图像缓存区；
    D2、当在所述拼接的应用程序的显示界面写入第一子图像缓存区时，则所述智能设备的物理显示屏显示第二子图像缓存区的数据；当在所述拼接的应用程序的显示界面写入第二子图像缓存区时，则所述智能设备的物理显示屏显示第一子图像缓存区的数据。
  4. 根据权利要求1所述的智能设备多屏幕运行实现方法，其中，所述方法还包括：
    G、当两个或以上应用程序获取用户指令，同时调用同一智能设备资源时，根据应用程序的启动顺序，依次使用所述智能设备资源。
  5. 根据权利要求1所述的智能设备多屏幕运行实现方法，其中，所述虚拟屏幕之间设置有用于接收用户指令，调整各虚拟屏幕大小的交接区域。
  6. 一种智能设备多屏幕运行实现方法，其中，所述方法包括：
    A、预先设定在智能设备的物理显示屏上运行的虚拟屏幕的数量及布局；
    B、根据所述预先设定的虚拟屏幕数量及布局，计算生成每一虚拟屏幕占据的物理显示屏的像素区域；
    C、根据所述像素区域与物理显示屏的比例，等比例的缩放与虚拟屏幕对应的应用程序的显示界面；
    D、将所述多个应用程序的显示界面进行拼接并写入图像缓存区中；
    E、通过物理显示屏显示拼接的应用程序的显示界面从而在所述物理显示屏上同时运行多个虚拟屏幕；
    F、当所述智能设备的物理显示屏为触控屏时，根据所述虚拟屏幕的布局，将所述触控屏分为若干个相对应的独立区域从而独立的获取用户在对于不同虚拟屏幕中显示的应用程序的触控操作指令；
    所述步骤D具体包括：
    D1、当所述智能设备为安卓操作系统时，在图像缓存区内设置第一子图像缓存区及第二子图像缓存区；
    D2、当在所述拼接的应用程序的显示界面写入第一子图像缓存区时，则所述智能设备的物理显示屏显示第二子图像缓存区的数据；当在所述拼接的应用程序的显示界面写入第二子图像缓存区时，则所述智能设备的物理显示屏显示第一子图像缓存区的数据。
  7. 一种智能设备多屏幕运行实现方法，其中，所述方法包括：
    A、预先设定在智能设备的物理显示屏上运行的虚拟屏幕的数量及布局；
    B、根据所述预先设定的虚拟屏幕数量及布局，计算生成每一虚拟屏幕占据的物理显示屏的像素区域；
    C、根据所述像素区域与物理显示屏的比例，等比例的缩放与虚拟屏幕对应的应用程序的显示界面；
    D、将所述多个应用程序的显示界面进行拼接并写入图像缓存区中；
    E、通过物理显示屏显示拼接的应用程序的显示界面从而在所述物理显示屏上同时运行多个虚拟屏幕；
    F、当所述智能设备的物理显示屏为触控屏时，根据所述虚拟屏幕的布局，将所述触控屏分为若干个相对应的独立区域从而独立的获取用户在对于不同虚拟屏幕中显示的应用程序的触控操作指令；
    所述步骤D具体包括：
    D1、当所述智能设备为安卓操作系统时，在图像缓存区内设置第一子图像缓存区及第二子图像缓存区；
    D2、当在所述拼接的应用程序的显示界面写入第一子图像缓存区时，则所述智能设备的物理显示屏显示第二子图像缓存区的数据；当在所述拼接的应用程序的显示界面写入第二子图像缓存区时，则所述智能设备的物理显示屏显示第一子图像缓存区的数据；
    所述虚拟屏幕之间设置有用于接收用户指令，调整各虚拟屏幕大小的交接区域。
  8. 一种智能设备多屏幕运行系统，其中，所述系统包括：
    设定模块，用于预先设定在智能设备的物理显示屏上运行的虚拟屏幕的数量及布局；
    像素区域计算模块，用于根据所述预先设定的虚拟屏幕数量及布局，计算生成每一虚拟屏幕占据的物理显示屏的像素区域；
    缩放模块，用于根据所述像素区域与物理显示屏的比例，等比例的缩放与虚拟屏幕对应的应用程序的显示界面；
    拼接模块，用于将所述多个应用程序的显示界面进行拼接并写入图像缓存区中；
    物理显示屏，显示所述拼接的应用程序的显示界面从而在物理显示屏上同时运行多个虚拟屏幕。
  9. 根据权利要求8所述的智能设备多屏幕运行系统，其中，还包括：
    控制模块，用于根据所述虚拟屏幕的布局，将所述触控屏分为若干个相对应的独立区域从而独立的获取用户在对于不同虚拟屏幕中显示的应用程序的触控操作指令。
  10. 根据权利要求8所述的智能设备多屏幕运行系统，其中，所述拼接模块具体包括：
    图像缓存区设置单元，用于在图像缓存区内设置第一子图像缓存区及第二子图像缓存区；
    缓存显示单元，用于当在所述拼接的应用程序的显示界面写入第一子图像缓存区时，则所述智能设备的物理显示屏显示第二子图像缓存区的数据；当在所述拼接的应用程序的显示界面写入第二子图像缓存区时，则所述智能设备的物理显示屏显示第一子图像缓存区的数据。
  11. 根据权利要求8所述的智能设备多屏幕运行系统，其中，所述系统还包括：
    启动时序模块，用于当两个或以上应用程序获取用户指令，同时调用同一智能设备资源时，根据应用程序的启动顺序，依次使用所述智能设备资源。
  12. 根据权利要求8所述的智能设备多屏幕运行系统，其中，虚拟屏幕之间设置有用于接收用户指令，调整各虚拟屏幕大小的交接区域。
  13. 一种智能设备多屏幕运行系统，其中，所述系统包括：
    设定模块，用于预先设定在智能设备的物理显示屏上运行的虚拟屏幕的数量及布局；
    像素区域计算模块，用于根据所述预先设定的虚拟屏幕数量及布局，计算生成每一虚拟屏幕占据的物理显示屏的像素区域；
    缩放模块，用于根据所述像素区域与物理显示屏的比例，等比例的缩放与虚拟屏幕对应的应用程序的显示界面；
    拼接模块，用于将所述多个应用程序的显示界面进行拼接并写入图像缓存区中；
    物理显示屏，显示所述拼接的应用程序的显示界面从而在物理显示屏上同时运行多个虚拟屏幕；
    控制模块，用于根据所述虚拟屏幕的布局，将所述触控屏分为若干个相对应的独立区域从而独立的获取用户在对于不同虚拟屏幕中显示的应用程序的触控操作指令；
    所述拼接模块具体包括：
    图像缓存区设置单元，用于在图像缓存区内设置第一子图像缓存区及第二子图像缓存区；
    缓存显示单元，用于当在所述拼接的应用程序的显示界面写入第一子图像缓存区时，则所述智能设备的物理显示屏显示第二子图像缓存区的数据；当在所述拼接的应用程序的显示界面写入第二子图像缓存区时，则所述智能设备的物理显示屏显示第一子图像缓存区的数据。
  14. 一种智能设备多屏幕运行系统，其中，所述系统包括：
    设定模块，用于预先设定在智能设备的物理显示屏上运行的虚拟屏幕的数量及布局；
    像素区域计算模块，用于根据所述预先设定的虚拟屏幕数量及布局，计算生成每一虚拟屏幕占据的物理显示屏的像素区域；
    缩放模块，用于根据所述像素区域与物理显示屏的比例，等比例的缩放与虚拟屏幕对应的应用程序的显示界面；
    拼接模块，用于将所述多个应用程序的显示界面进行拼接并写入图像缓存区中；
    物理显示屏，显示所述拼接的应用程序的显示界面从而在物理显示屏上同时运行多个虚拟屏幕；
    控制模块，用于根据所述虚拟屏幕的布局，将所述触控屏分为若干个相对应的独立区域从而独立的获取用户在对于不同虚拟屏幕中显示的应用程序的触控操作指令；
    启动时序模块，用于当两个或以上应用程序获取用户指令，同时调用同一智能设备资源时，根据应用程序的启动顺序，依次使用所述智能设备资源；
    所述拼接模块具体包括：
    图像缓存区设置单元，用于在图像缓存区内设置第一子图像缓存区及第二子图像缓存区；
    缓存显示单元，用于当在所述拼接的应用程序的显示界面写入第一子图像缓存区时，则所述智能设备的物理显示屏显示第二子图像缓存区的数据；当在所述拼接的应用程序的显示界面写入第二子图像缓存区时，则所述智能设备的物理显示屏显示第一子图像缓存区的数据。
PCT/CN2016/088820 2015-11-03 2016-07-06 一种智能设备多屏幕运行实现方法及其系统 Ceased WO2017076039A1 (zh)

Priority Applications (2)

Application Number Priority Date Filing Date Title
EP16861309.9A EP3373130A4 (en) 2015-11-03 2016-07-06 METHOD FOR OPERATING MULTIPLE SCREENS OF AN INTELLIGENT DEVICE AND SYSTEM THEREFOR
US15/552,499 US20180046368A1 (en) 2015-11-03 2016-07-06 Method for operating multiple screens in smart device and system thereof

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201510735374.2A CN105389149A (zh) 2015-11-03 2015-11-03 一种智能设备多屏幕运行实现方法及其系统
CN201510735374.2 2015-11-03

Publications (1)

Publication Number Publication Date
WO2017076039A1 true WO2017076039A1 (zh) 2017-05-11

Family

ID=55421459

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2016/088820 Ceased WO2017076039A1 (zh) 2015-11-03 2016-07-06 一种智能设备多屏幕运行实现方法及其系统

Country Status (4)

Country Link
US (1) US20180046368A1 (zh)
EP (1) EP3373130A4 (zh)
CN (1) CN105389149A (zh)
WO (1) WO2017076039A1 (zh)

Families Citing this family (23)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105389149A (zh) * 2015-11-03 2016-03-09 惠州Tcl移动通信有限公司 一种智能设备多屏幕运行实现方法及其系统
CN106200897B (zh) * 2016-06-23 2019-02-01 青岛海信智慧家居系统股份有限公司 一种显示控制菜单的方法和装置
CN107508886A (zh) * 2017-08-24 2017-12-22 西安万像电子科技有限公司 应用显示方法及装置
CN109089070A (zh) * 2018-09-26 2018-12-25 福建星网智慧科技股份有限公司 一种视讯会议终端的布局切换方法及系统
KR102716974B1 (ko) * 2018-12-19 2024-10-15 삼성전자 주식회사 증강 장치를 제어하는 방법 및 이를 수행하는 전자 장치
CN110471734B (zh) * 2019-08-19 2023-01-13 东软集团股份有限公司 一种显示控制方法及装置
CN110716705A (zh) * 2019-09-18 2020-01-21 广州魅视电子科技有限公司 坐席系统屏幕分配管理方法
CN111273883A (zh) * 2020-01-20 2020-06-12 北京远特科技股份有限公司 多操作系统的同屏显示方法、装置和终端设备
CN111538468A (zh) * 2020-04-27 2020-08-14 威创集团股份有限公司 一种可视化界面的操控方法及系统
CN112121415B (zh) * 2020-09-30 2025-06-27 腾讯科技（深圳）有限公司 一种控制界面显示的方法、装置、设备及存储介质
CN114661257A (zh) * 2020-12-22 2022-06-24 深圳Tcl新技术有限公司 一种设备信息显示方法、智能终端及计算机可读存储介质
CN113055615B (zh) * 2021-02-01 2024-05-03 广州朗国电子科技股份有限公司 会议一体机、屏幕切分显示方法以及存储装置
CN113296662A (zh) * 2021-04-14 2021-08-24 惠州市德赛西威汽车电子股份有限公司 一种单物理屏实现多屏虚拟显示的方法及存储介质
CN113220195B (zh) * 2021-04-27 2023-10-27 中天智领（北京）科技有限公司 可显示虚拟窗口的屏幕交互系统
CN113452931B (zh) * 2021-06-25 2022-05-03 深圳康佳电子科技有限公司 一种基于图像识别的拼屏互动方法、系统及智慧屏
CN114020375A (zh) * 2021-09-22 2022-02-08 联想(北京)有限公司 一种显示方法及装置
CN114327723A (zh) * 2021-12-28 2022-04-12 阿波罗智联(北京)科技有限公司 基于虚拟屏幕的应用处理方法、装置、设备及存储介质
CN114610426B (zh) * 2022-03-04 2023-09-08 腾讯科技（深圳）有限公司 一种调整界面布局的方法、装置、设备及存储介质
CN115729502B (zh) * 2022-03-23 2024-02-27 博泰车联网(南京)有限公司 投屏端和显示端的响应方法、电子设备及存储介质
CN114610434A (zh) * 2022-03-28 2022-06-10 联想(北京)有限公司 输出控制方法及电子设备
CN115061620B (zh) * 2022-06-17 2024-05-17 重庆长安汽车股份有限公司 触摸屏分屏方法、系统、电子设备及可读存储介质
CN115914710B (zh) * 2022-08-25 2025-11-11 惠州市德赛西威汽车电子股份有限公司 一种单文件多屏录制方法、电子设备及其存储介质
CN117116230B (zh) * 2023-08-02 2025-11-14 惠州市德赛西威汽车电子股份有限公司 一种多屏刷新系统、方法及存储介质

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102033729A (zh) * 2010-10-27 2011-04-27 广东威创视讯科技股份有限公司 一种异构图像拼接方法及其系统
CN103455292A (zh) * 2012-05-28 2013-12-18 展讯通信（上海）有限公司 业务数据显示处理方法与装置、用户设备
CN103809845A (zh) * 2012-11-13 2014-05-21 上海斐讯数据通信技术有限公司 一种支持多应用显示的移动终端及多应用显示方法
CN104951271A (zh) * 2015-07-03 2015-09-30 上海与德通讯技术有限公司 分屏显示方法及电子设备
CN105389149A (zh) * 2015-11-03 2016-03-09 惠州Tcl移动通信有限公司 一种智能设备多屏幕运行实现方法及其系统

Family Cites Families (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7215345B1 (en) * 1999-04-09 2007-05-08 Sun Microsystems, Inc. Method and apparatus for clipping video information before scaling
JP2005005909A (ja) * 2003-06-10 2005-01-06 Sony Ericsson Mobilecommunications Japan Inc 競合管理プログラム，競合管理プログラムが記憶された記憶媒体，競合管理方法及び電子機器
US20050097620A1 (en) * 2003-10-30 2005-05-05 Honeywell International Inc. Architecture for multi-channel video processing
CN100468345C (zh) * 2004-07-28 2009-03-11 松下电器产业株式会社 冲突解决装置
US8108791B2 (en) * 2009-02-27 2012-01-31 Microsoft Corporation Multi-screen user interface
KR101636570B1 (ko) * 2009-10-28 2016-07-20 엘지전자 주식회사 출력표시영역 제어 장치 및 방법
US9104307B2 (en) * 2011-05-27 2015-08-11 Microsoft Technology Licensing, Llc Multi-application environment
CN103842943A (zh) * 2011-06-20 2014-06-04 亚历山大·布宁 设有触摸显示屏的设备的应用程序管理系统及其方法
KR101888457B1 (ko) * 2011-11-16 2018-08-16 삼성전자주식회사 복수 개의 어플리케이션을 실행하는 터치스크린을 가지는 장치 및 그 제어 방법
KR101905038B1 (ko) * 2011-11-16 2018-10-08 삼성전자주식회사 다중 어플리케이션 환경 하에서 터치스크린을 가지는 장치 및 그 제어 방법
US9298511B2 (en) * 2013-03-15 2016-03-29 International Business Machines Corporation Resolving deployment conflicts in heterogeneous environments
US20180173540A1 (en) * 2014-08-07 2018-06-21 Mitsubishi Electric Corporation Program execution system and method for launching resident programs

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102033729A (zh) * 2010-10-27 2011-04-27 广东威创视讯科技股份有限公司 一种异构图像拼接方法及其系统
CN103455292A (zh) * 2012-05-28 2013-12-18 展讯通信（上海）有限公司 业务数据显示处理方法与装置、用户设备
CN103809845A (zh) * 2012-11-13 2014-05-21 上海斐讯数据通信技术有限公司 一种支持多应用显示的移动终端及多应用显示方法
CN104951271A (zh) * 2015-07-03 2015-09-30 上海与德通讯技术有限公司 分屏显示方法及电子设备
CN105389149A (zh) * 2015-11-03 2016-03-09 惠州Tcl移动通信有限公司 一种智能设备多屏幕运行实现方法及其系统

Also Published As

Publication number Publication date
EP3373130A1 (en) 2018-09-12
CN105389149A (zh) 2016-03-09
EP3373130A4 (en) 2019-08-14
US20180046368A1 (en) 2018-02-15

Similar Documents

Publication Publication Date Title
WO2017076039A1 (zh) 一种智能设备多屏幕运行实现方法及其系统
WO2017096924A1 (zh) 一种基于移动终端的页面连续截图方法、系统及移动终端
WO2014104472A1 (en) Method and apparatus for dual display
WO2018120245A1 (zh) 一种显示控制方法及电子设备
WO2015178541A1 (en) Display device and method for controlling the same
WO2012108715A2 (en) Method and apparatus for inputting user commands using relative movements of device panels
WO2014204047A1 (en) Foldable display device and method of controlling therefor
WO2017119664A1 (en) Display apparatus and control methods thereof
WO2011078540A2 (en) Mobile device and related control method for external output depending on user interaction based on image sensing module
WO2018151505A1 (en) Electronic device and method for displaying screen thereof
WO2014157914A1 (en) Apparatus and method of controlling screens in a device
EP3011425A1 (en) Portable device and method for controlling the same
WO2017211054A1 (zh) 蓝牙智能手表、智能终端、及其spp远程控制拍照的方法和系统
WO2014058144A1 (ko) 고속 스크롤 컨텐츠와 스크롤바 표시 방법 및 시스템
WO2016186463A1 (en) Method for launching a second application using a first application icon in an electronic device
WO2014171580A1 (en) Digital device and method of controlling therefor
WO2015041436A1 (en) Method of managing control right, client device therefor, and master device therefor
WO2014012498A1 (zh) 桌面控制方法和装置、计算机存储介质
WO2020241975A1 (en) Electronic device and method for controlling the same
WO2016035899A1 (ko) 플렉서블 디스플레이에 복수의 어플리케이션을 표시하는 디스플레이 디바이스 및 그 제어 방법
WO2016093506A1 (ko) 이동 단말기 및 그 제어 방법
WO2018155824A1 (en) Display apparatus and control method thereof
WO2020213886A1 (en) Electronic apparatus and controlling method thereof
WO2010143888A2 (ko) 사용자 리스트 제공방법 및 이를 적용한 디바이스
WO2019160347A1 (ko) 터치 입력 처리 방법 및 이를 지원하는 전자 장치

Legal Events

Date Code Title Description
REEP Request for entry into the european phase

Ref document number: 2016861309

Country of ref document: EP

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16861309

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 15552499

Country of ref document: US

NENP Non-entry into the national phase

Ref country code: DE