[go: up one dir, main page]

WO2018166173A1 - 远程协作方法及系统 - Google Patents

远程协作方法及系统 Download PDF

Info

Publication number
WO2018166173A1
WO2018166173A1 PCT/CN2017/103782 CN2017103782W WO2018166173A1 WO 2018166173 A1 WO2018166173 A1 WO 2018166173A1 CN 2017103782 W CN2017103782 W CN 2017103782W WO 2018166173 A1 WO2018166173 A1 WO 2018166173A1
Authority
WO
WIPO (PCT)
Prior art keywords
computer
split screen
interaction information
information
cursor
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2017/103782
Other languages
English (en)
French (fr)
Inventor
田楠
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangzhou Shiyuan Electronics Thecnology Co Ltd
Guangzhou Shizhen Information Technology Co Ltd
Original Assignee
Guangzhou Shiyuan Electronics Thecnology Co Ltd
Guangzhou Shizhen Information Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangzhou Shiyuan Electronics Thecnology Co Ltd, Guangzhou Shizhen Information Technology Co Ltd filed Critical Guangzhou Shiyuan Electronics Thecnology Co Ltd
Priority to US16/319,767 priority Critical patent/US11243737B2/en
Publication of WO2018166173A1 publication Critical patent/WO2018166173A1/zh
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1454—Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/02—Input arrangements using manually operated switches, e.g. using keyboards or dials
    • G06F3/023—Arrangements for converting discrete items of information into a coded form, e.g. arrangements for interpreting keyboard generated codes as alphanumeric codes, operand codes or instruction codes
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0354—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
    • G06F3/03543—Mice or pucks
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/038—Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/04812—Interaction techniques based on cursor appearance or behaviour, e.g. being affected by the presence of displayed objects
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1423—Digital output to display device ; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display
    • G06F3/1446—Digital output to display device ; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display display composed of modules, e.g. video walls
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46—Multiprogramming arrangements
    • G06F9/54—Interprogram communication
    • G06F9/547—Remote procedure calls [RPC]; Web services
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G09G5/08—Cursor circuits
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G09G5/14—Display of multiple viewports

Definitions

  • the present invention relates to the field of computer information processing technologies, and in particular, to a remote collaboration method and system.
  • the wireless transmission technology mainly realizes the synchronization of the content and sound displayed on the screen of the source device to the receiving terminal device such as a projector, a television and a conference tablet, and the wireless transmission technology can process the source device (such as a computer). It is widely used in combination with the receiving terminal device (such as a TV set or a conference tablet) to display good effects.
  • the existing wireless screen transmission technology is mainly implemented by using the screen transmission software, and the corresponding screen transmission software is installed on the source device and the receiving terminal device, and the source device and the receiving terminal device are ensured to be in the same wireless network.
  • Wireless transmission of multimedia information including pictures, audio, video, etc.
  • multi-source on-screen display can be realized, that is, multiple source devices can display the content distribution of the respective screens in the receiving terminal device.
  • there are 4 computers that simultaneously transmit wirelessly with a conference tablet and the desktops of the 4 computers can be displayed in the conference tablet in the form of a quad screen.
  • the user of each computer can only control his own computer and then display it in the corresponding split screen.
  • user 1 can only operate his own computer 1 and in the corresponding split screen 1 In the middle of the screen display.
  • user 2 needs user 1 to perform certain operations on his computer 2, and the screen is displayed on the conference tablet.
  • the existing software transmission scheme cannot achieve this effect.
  • the embodiment of the present invention provides a remote collaboration method capable of realizing remote collaboration in wireless screen transmission.
  • a remote cooperation method is applied to a receiving terminal, and the receiving terminal Simultaneously performing wireless screen transmission with a master computer and at least one controlled computer, wherein the screens of the master computer and all the controlled computers are respectively displayed in the master split screen and other split screens of the receiving terminal,
  • the method includes:
  • the information is information that the master computer detects and intercepts when the user initiates an interaction with the master computer.
  • the main control computer first captures the mouse operation information of the user and sends it to the receiving terminal, and then the receiving terminal detects the position of the cursor of the mouse, and when the cursor reaches one of the main control sub-screens
  • the receiving terminal detects a current split screen connected to the boundary, and displays the cursor in the current split screen, after which the host computer continues Acquiring and intercepting the interaction information of the user, and transmitting the interaction information to the controlled computer corresponding to the split screen currently located by the mouse through the receiving terminal, and finally the controlled computer executes the interaction information, thereby displaying the multi-source on the same screen
  • the collaboration function is realized, which enables a user to control the screen of other people using his own computer.
  • the operation is convenient.
  • remote cooperation method according to the above embodiment of the present invention may further have the following additional technical features:
  • the method further includes:
  • the transmitting the interaction information to the The steps of the current controlled computer corresponding to the front split screen include:
  • the step of causing the currently controlled computer to execute the interaction information specifically includes:
  • the current controlled computer acquires the interaction information and its own interaction information, and the currently controlled computer executes the interaction information and its own interaction information according to the sequence.
  • the interaction information includes one or more of mouse movement information, mouse click information, and keyboard operation information
  • the current controlled computer is caused to execute the interaction information.
  • the steps include:
  • the current controlled computer is caused to execute the interaction information through a system interface.
  • Another embodiment of the present invention provides a remote collaboration system that enables remote collaboration in wireless screencasting.
  • a remote collaboration system is applied to a receiving terminal, wherein the receiving terminal simultaneously performs wireless screen transmission with a master computer and at least one controlled computer, and the master computer and all of the controlled computers
  • the screens are respectively displayed in the main control split screen and other split screens of the receiving terminal, and the system includes:
  • a receiving module configured to receive mouse operation information of a user captured and sent by the main control computer in the main control computer
  • a detecting module configured to detect, according to the mouse operation information, a position of a cursor of the mouse in the main control split screen, when the cursor reaches one of the boundaries of the main control split screen and continues away from the main When the direction of the split screen is moved, detecting a current split screen connected to the boundary, and displaying the cursor in the current split screen;
  • a relay module configured to receive interaction information sent by the host computer, and deliver the interaction information to a current controlled computer corresponding to the current split screen, so that the current controlled computer executes the interaction information
  • the interaction information is information that the master computer detects and intercepts when the user initiates an interaction with the master computer.
  • remote collaboration system may further have the following additional technical features:
  • system further includes:
  • a hidden instruction sending module configured to send a hidden instruction to the host computer after the detecting module displays the cursor in the current split screen, so that the master computer sends the hidden command according to the hidden command
  • the cursor is hidden in the master computer while the cursor is hidden in the master split screen.
  • the relay module is specifically configured to:
  • the relay module is further configured to:
  • the current controlled computer acquires the interaction information and its own interaction information, and the currently controlled computer executes the interaction information and its own interaction information according to the sequence.
  • the interaction information includes one or more of mouse movement information, mouse click information, and keyboard operation information
  • the relay module is further configured to:
  • the current controlled computer is caused to execute the interaction information through a system interface.
  • FIG. 1 is a flow chart of a remote collaboration method in accordance with an embodiment of the present invention.
  • FIG. 2 is a schematic diagram showing a distribution of a quadrant of a conference tablet in a remote collaboration method according to an embodiment of the invention
  • FIG. 3 is a flow chart of hiding a cursor in a remote collaboration method according to an embodiment of the invention.
  • FIG. 4 is a schematic structural diagram of a remote cooperation system according to another embodiment of the present invention.
  • a remote cooperation method is applied to a receiving terminal, where the receiving terminal simultaneously performs wireless screen transmission with a host computer and at least one controlled computer, and the master computer and all The screens of the controlled computer are respectively displayed in the main control split screen and other split screens of the receiving terminal.
  • the receiving terminal uses a conference tablet with windows or Android system as an example for description, controlled
  • the number of computers is described as an example.
  • the screens of the main control computer and the three controlled computers are displayed in a quadruple screen in a conference screen. The distribution of the quadrants can be seen in FIG.
  • the remote collaboration method includes at least the following steps:
  • S101 Receive mouse operation information of a user captured and sent by the master computer in the master computer.
  • the main control computer first captures the mouse operation information of the user 1 in the main control computer, and the main control computer captures the mouse operation information and sends the mouse operation information to the conference tablet.
  • the mouse operation information mainly includes the movement information of the mouse.
  • the conference tablet detects the position of the mouse cursor in the first split screen according to the mouse operation information.
  • the conference tablet A split screen connected to the boundary is detected.
  • the conference panel detects that the split screen connected to the right border is the second split screen, and the cursor continues toward the second split screen.
  • the conference tablet will display the cursor on the second split screen.
  • the conference panel detects that the connected split screen includes the second split screen, the third split screen, and the fourth split screen.
  • the conference tablet determines that the cursor actually moves toward the split screen so that the cursor is displayed in the corresponding split screen.
  • the conference panel detects that the connected split screen includes the second split screen, the third split screen, and the fourth split screen.
  • the conference tablet determines that the mouse actually moves toward the split screen so that the mouse is displayed in the corresponding split screen.
  • S103 Receive interaction information sent by the master control computer, and transmit the interaction information to a current controlled computer corresponding to the current split screen, so that the currently controlled computer executes the interaction information, where
  • the interaction information is information that the master computer detects and intercepts when the user initiates an interaction with the master computer.
  • the master computer continues to obtain the interaction information of the user 1 to the master computer, and after the interaction information is obtained, the host information is first intercepted to ensure that the master computer does not perform the interaction information.
  • the master computer The interaction information includes one or more of mouse movement information, mouse click information, and keyboard operation information.
  • step S102 after the cursor in the conference tablet exceeds the range of the first split screen, it will enter one of the second split screen, the third split screen, or the fourth split screen, if the cursor enters the range of the second split screen.
  • the cursor will be displayed in the second sub-screen, and at this time, the main control computer will transmit the interactive information to the first controlled computer corresponding to the second sub-screen through the conference tablet.
  • the master computer may first send the interaction information to the conference tablet through the wireless network, and then the conference tablet forwards the interaction information to the first controlled computer through the wireless network.
  • the interaction information is mouse movement information, specifically, the user 1 moves the mouse (50, 50), indicating that the user controls the mouse to move 50 pixels to the lower right direction, and the mouse movement information can be encoded and transmitted to the first subject.
  • the first controlled computer may perform the interaction information transferred from the conference tablet through a system interface (API).
  • API system interface
  • the first controlled computer performs corresponding Keyboard operation information; if the interaction information is for mouse movement (50, 50), the first controlled computer will control the mouse to move 50 pixels to the lower right direction, and display it in the second sub-screen, thereby realizing The user 1 can perform cooperative control on the first controlled computer on the host computer.
  • the main control computer first captures the mouse operation information of the user and sends it to the receiving terminal, and then the receiving terminal detects the position of the cursor of the mouse, and when the cursor reaches one of the main control sub-screens
  • the receiving terminal detects a current split screen connected to the boundary, and displays the cursor in the current split screen, after which the host computer continues Acquiring and intercepting the interaction information of the user, and transmitting the interaction information to the controlled computer corresponding to the split screen currently located by the mouse through the receiving terminal, and finally the controlled computer executes the interaction information, thereby displaying the multi-source on the same screen
  • the collaboration function is realized, which enables a user to control the screen of other people using his own computer.
  • the operation is convenient.
  • the remote collaboration method further includes:
  • the conference tablet when the conference tablet control cursor is displayed on the second split screen, the conference tablet sends a hidden instruction to the master computer, so that the master computer hides the cursor, and the cursor in the master computer is hidden.
  • the cursor in the corresponding first split screen is also hidden. It should be pointed out that in order to achieve better cooperation effect, at this time, the cursor of the mouse in the first controlled computer can also be hidden, and the hiding principle is also realized by the relay of the conference tablet, so that the first controlled first Only one cursor will appear on the computer and the corresponding second split screen, and the cursor can be controlled by the user 1.
  • step S103 specifically includes:
  • S1031 Receive, by the host computer, acquiring and intercepting the interaction information by using an operating system API HOOK technology;
  • S1032 Send the interaction information to a current controlled computer corresponding to the current split screen.
  • the main control computer acquires and intercepts the interaction information of the user 1 through the operating system API HOOK technology, and then sends the intercepted acquired interaction information to the conference tablet through a wireless network, such as wifi, and the conference tablet receives the interaction information.
  • the interaction information is sent to the controlled computer corresponding to the split screen where the mouse is currently located, thereby implementing the relay of the interactive information.
  • step S104 specifically includes:
  • the current controlled computer acquires the interaction information and its own interaction information, and the currently controlled computer executes the interaction information and its own interaction information according to the sequence.
  • the first controlled computer When the user 1 controls the first controlled computer through the master computer, if the user 2 simultaneously sends the interaction information to the first controlled computer, the first controlled computer performs the interaction information of the user 1 according to the sequence.
  • User 2's interaction information for example, user 1 inputs "s" on the keyboard of the host computer, and then user 2 inputs "d” on the keyboard of the first controlled computer, then the second screen will be displayed. "sd”.
  • the operation result of the cursor is the sum of the operations of the two users. This process is consistent with the prior art QQ remote assistance and will not be described here.
  • a remote collaboration system is applied to a receiving terminal, where the receiving terminal simultaneously performs wireless transmission with a host computer and at least one controlled computer.
  • the screens of the master computer and all of the controlled computers are respectively displayed in the master split screen and other split screens of the receiving terminal, and the system includes:
  • the receiving module 10 is configured to receive mouse operation information of a user captured and sent by the main control computer in the main control computer;
  • the detecting module 20 is configured to detect, according to the mouse operation information, a position of the cursor of the mouse in the master split screen, when the cursor reaches one of the boundaries of the master split screen and continues to move away from the When the direction of the main split screen moves, detecting a current split screen connected to the boundary, and displaying the cursor in the current split screen;
  • the relay module 30 is configured to receive interaction information sent by the host computer, and deliver the interaction information to a current controlled computer corresponding to the current split screen, so that the currently controlled computer executes the interaction information.
  • the interaction information is information that the master computer detects and intercepts when the user initiates an interaction with the master computer. .
  • system further includes:
  • a hidden instruction sending module 40 configured to send a hidden instruction to the host computer after the detecting module 20 displays the cursor in the current split screen, so that the master computer according to the hidden command The cursor is hidden in the master computer while the cursor is hidden in the master split screen.
  • the relay module 30 is specifically configured to:
  • the relay module 30 is further configured to:
  • the current controlled computer acquires the interaction information and its own interaction information, and the currently controlled computer executes the interaction information and its own interaction information according to the sequence.
  • the interaction information includes one or more of mouse movement information, mouse click information, and keyboard operation information
  • the relay module 30 is further configured to:
  • the current controlled computer is caused to execute the interaction information through a system interface.
  • a "computer-readable medium” can be any apparatus that can contain, store, communicate, propagate, or transport a program for use in an instruction execution system, apparatus, or device, or in conjunction with such an instruction execution system, apparatus, or device.
  • Non-exhaustive list of computer readable media include the following: electrical connections (electronic devices) having one or more wires, portable computer disk cartridges (magnetic devices), random access memory (RAM), Read only memory (ROM), erasable editable read only memory (EPROM or flash memory), fiber optic devices, and portable compact disk read only memory (CDROM).
  • electrical connections electronic devices
  • portable computer disk cartridges magnetic devices
  • RAM random access memory
  • ROM Read only memory
  • EPROM or flash memory erasable editable read only memory
  • CDROM portable compact disk read only memory
  • the computer The readable medium may even be paper or other suitable medium on which the program may be printed, as it may be optically scanned, for example by paper or other medium, followed by editing, interpretation or, if necessary, processing in other suitable manners.
  • the program is obtained electronically and then stored in computer memory.
  • portions of the invention may be implemented in hardware, software, firmware or a combination thereof.
  • multiple steps or methods may be implemented in software or firmware stored in a memory and executed by a suitable instruction execution system.
  • a suitable instruction execution system For example, if implemented in hardware, as in another embodiment, it can be implemented by any one or combination of the following techniques well known in the art: having logic gates for implementing logic functions on data signals. Discrete logic circuits, application specific integrated circuits with suitable combinational logic gates, programmable gate arrays (PGAs), field programmable gate arrays (FPGAs), etc.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Software Systems (AREA)
  • Multimedia (AREA)
  • Computer Hardware Design (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

一种远程协作方法及系统，所述方法包括：接收主控计算机捕获并发送过来的用户在主控计算机中的鼠标操作信息（S101）；根据所述鼠标操作信息检测鼠标的光标在所述主控分屏中的位置，当所述光标到达所述主控分屏的其中一边界且继续朝远离所述主控分屏的方向移动时，检测与所述边界连接的当前分屏，并将所述光标显示在所述当前分屏中（S102）；接收所述主控计算机发送的交互信息，并将所述交互信息传递至所述当前分屏对应的当前受控计算机，以使所述当前受控计算机执行所述交互信息，其中，所述交互信息为所述主控计算机检测到用户向所述主控计算机发起交互时所获取和拦截的信息（S103）。该方法能在无线传屏中多源同屏显示的基础上实现协作功能，且操作便捷。

Description

远程协作方法及系统 技术领域
本发明涉及计算机信息处理技术领域，特别是涉及一种远程协作方法及系统。
背景技术
无线传屏技术主要实现将源端装置屏幕上显示的内容和声音同步到投影仪、电视机和会议平板等接收终端装置进行展示，无线传屏技术能够将源端装置(如计算机)处理能力强和接收终端装置(如电视机或会议平板)展示效果好的特点结合起来，因此得到了广泛应用。
现有的无线传屏技术主要采用传屏软件实现，在源端装置和接收终端装置上均安装相应的传屏软件，同时保证源端装置和接收终端装置在同一个无线网络中，即可实现多媒体信息(包括图片、音频、视频等)的无线传屏。当有多个源端装置同时与一个接收终端装置进行无线传屏时，可以实现多源同屏显示，即多个源端装置可以将各自屏幕的内容分配显示在接收终端装置中。例如有4台计算机同时与1台会议平板进行无线传屏，该4台计算机的桌面可以以四分屏的形式显示在会议平板中。
现有的软件传屏方案中，每个计算机的用户只能控制自己的计算机，然后在对应的分屏中进行显示，例如，用户1只能操作自己的计算机1，并在对应的分屏1中进行传屏显示。但会议中有时有协作的需要，如用户2需要用户1对自己的计算机2进行某些操作，并传屏显示在会议平板中，现有的软件传屏方案无法实现这一效果。
发明内容
为此，本发明实施例提出一种能够实现无线传屏中远程协作的远程协作方法。
根据本发明一实施例的远程协作方法，应用于接收终端中，所述接收终端 同时与一主控计算机和至少一个受控计算机进行无线传屏，所述主控计算机和所有所述受控计算机的画面分别对应显示在所述接收终端的主控分屏和其它分屏中，所述方法包括：
接收所述主控计算机捕获并发送过来的用户在所述主控计算机中的鼠标操作信息；
根据所述鼠标操作信息检测所述鼠标的光标在所述主控分屏中的位置，当所述光标到达所述主控分屏的其中一边界且继续朝远离所述主控分屏的方向移动时，检测与所述边界连接的当前分屏，并将所述光标显示在所述当前分屏中；
接收所述主控计算机发送的交互信息，并将所述交互信息传递至所述当前分屏对应的当前受控计算机，以使所述当前受控计算机执行所述交互信息，其中，所述交互信息为所述主控计算机检测到用户向所述主控计算机发起交互时所获取和拦截的信息。
根据本发明实施例的远程协作方法，主控计算机首先捕获用户的鼠标操作信息并发送至接收终端，然后接收终端检测鼠标的光标的位置，当所述光标到达所述主控分屏的其中一边界且继续朝远离所述主控分屏的方向移动时，所述接收终端检测与所述边界连接的当前分屏，并将所述光标显示在所述当前分屏中，之后主控计算机继续获取和拦截用户的交互信息，并通过接收终端将该交互信息传递给所述鼠标当前所在分屏对应的受控计算机，最终该受控计算机执行所述交互信息，从而在多源同屏显示的基础上通过对鼠标移动的判断实现了协作功能，可以使一个用户使用自己计算机对其他人投屏的计算机进行控制，此外，由于用户只需要移动鼠标即可实现这一功能，因此操作便捷。
另外，根据本发明上述实施例的远程协作方法，还可以具有如下附加的技术特征：
进一步地，在本发明的一个实施例中，所述将所述光标显示在所述当前分屏中的步骤之后，所述方法还包括：
向所述主控计算机发送隐藏指令，以使所述主控计算机根据所述隐藏指令将所述光标在所述主控计算机中隐藏，同时使所述光标在所述主控分屏中隐藏。
进一步地，在本发明的一个实施例中，所述将所述交互信息传递至所述当 前分屏对应的当前受控计算机的步骤包括：
接收所述主控计算机通过操作系统API HOOK技术获取和拦截所述交互信息；
将所述交互信息发送给所述当前分屏对应的当前受控计算机。
进一步地，在本发明的一个实施例中，所述使当前受控计算机执行所述交互信息的步骤具体包括：
使所述当前受控计算机同时获取所述交互信息及来着自身的交互信息，所述当前受控计算机根据时序执行所述交互信息及来着自身的交互信息。
进一步地，在本发明的一个实施例中，所述交互信息包括鼠标移动信息、鼠标点击信息、键盘操作信息中的一种或多种，所述使所述当前受控计算机执行所述交互信息的步骤包括：
使所述当前受控计算机通过系统接口执行所述交互信息。
本发明的另一个实施例提出一种能够实现无线传屏中远程协作的远程协作系统。
根据本发明实施例的远程协作系统，应用于接收终端中，所述接收终端同时与一主控计算机和至少一个受控计算机进行无线传屏，所述主控计算机和所有所述受控计算机的画面分别对应显示在所述接收终端的主控分屏和其它分屏中，所述系统包括：
接收模块，用于接收所述主控计算机捕获并发送过来的用户在所述主控计算机中的鼠标操作信息；
检测模块，用于根据所述鼠标操作信息检测所述鼠标的光标在所述主控分屏中的位置，当所述光标到达所述主控分屏的其中一边界且继续朝远离所述主控分屏的方向移动时，检测与所述边界连接的当前分屏，并将所述光标显示在所述当前分屏中；
中转模块，用于接收所述主控计算机发送的交互信息，并将所述交互信息传递至所述当前分屏对应的当前受控计算机，以使所述当前受控计算机执行所述交互信息，其中，所述交互信息为所述主控计算机检测到用户向所述主控计算机发起交互时所获取和拦截的信息。
另外，根据本发明上述实施例的远程协作系统，还可以具有如下附加的技术特征：
进一步地，在本发明的一个实施例中，所述系统还包括：
隐藏指令发送模块，用于在所述检测模块将所述光标显示在所述当前分屏中之后，向所述主控计算机发送隐藏指令，以使所述主控计算机根据所述隐藏指令将所述光标在所述主控计算机中隐藏，同时使所述光标在所述主控分屏中隐藏。
进一步地，在本发明的一个实施例中，所述中转模块具体用于：
接收所述主控计算机通过操作系统API HOOK技术获取和拦截所述交互信息；
将所述交互信息发送给所述当前分屏对应的当前受控计算机。
进一步地，在本发明的一个实施例中，所述中转模块还用于：
使所述当前受控计算机同时获取所述交互信息及来着自身的交互信息，所述当前受控计算机根据时序执行所述交互信息及来着自身的交互信息。
进一步地，在本发明的一个实施例中，所述交互信息包括鼠标移动信息、鼠标点击信息、键盘操作信息中的一种或多种，所述中转模块还用于：
使所述当前受控计算机通过系统接口执行所述交互信息。
本发明的附加方面和优点将在下面的描述中部分给出，部分将从下面的描述中变得明显，或通过本发明的实施例了解到。
附图说明
本发明实施例的上述和/或附加的方面和优点从结合下面附图对实施例的描述中将变得明显和容易理解，其中：
图1是根据本发明一实施例的远程协作方法的流程图；
图2是根据本发明一实施例的远程协作方法中会议平板的四分屏的分布示意图；
图3是根据本发明一实施例的远程协作方法中隐藏光标的流程图；
图4是根据本发明另一实施例的远程协作系统的结构示意图。
具体实施方式
为使本发明实施例的目的、技术方案和优点更加清楚，下面将结合本发明实施例中的附图，对本发明实施例中的技术方案进行清楚、完整地描述，显然，所描述的实施例是本发明一部分实施例，而不是全部的实施例。基于本发明中的实施例，本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例，都属于本发明保护的范围。
请参阅图1，本发明一实施例提出的远程协作方法，应用于接收终端中，所述接收终端同时与一主控计算机和至少一个受控计算机进行无线传屏，所述主控计算机和所有所述受控计算机的画面分别对应显示在所述接收终端的主控分屏和其它分屏中，本实施例中，该接收终端以具有windows或安卓系统的会议平板为例进行说明，受控计算机的数量为3个为例进行说明，该主控计算机和3个受控计算机的画面以四分屏的方式无线传屏显示在会议平板中，四分屏的分布可参阅图2，其中，第1分屏、第2分屏、第3分屏和第4分屏分布对应主控计算机、第1受控计算机、第2受控计算机和第3受控计算机，主控计算机、第1受控计算机、第2受控计算机和第3受控计算机分布由用户1、用户2、用户3和用户4操作控制，本实施例中，所述远程协作方法至少包括以下步骤：
S101，接收所述主控计算机捕获并发送过来的用户在所述主控计算机中的鼠标操作信息；
其中，主控计算机首先捕获用户1在主控计算机中的鼠标操作信息，主控计算机捕获到该鼠标操作信息后将该鼠标操作信息发送至会议平板，该鼠标操作信息主要包括鼠标的移动信息。
S102，根据所述鼠标操作信息检测所述鼠标的光标在所述主控分屏中的位置，当所述光标到达所述主控分屏的其中一边界且继续朝远离所述主控分屏的方向移动时，检测与所述边界连接的当前分屏，并将所述光标显示在所述当前分屏中；
其中，会议平板会根据鼠标操作信息检测鼠标的光标在第1分屏中位置，当光标到达第1分屏的边界，且继续朝远离第1分屏的方向移动时，会议平板 会检测与该边界连接的分屏，例如，当光标到达第1分屏的右边界，会议平板检测到与该右边界连接的分屏为第2分屏，当光标朝该第2分屏继续移动时，会议平板会将该光标在第2分屏中进行显示。此外，还需要指出一个特例，当光标到达第1分屏的右下角端点时，此时，会议平板检测到相连的分屏包括第2分屏、第3分屏和第4分屏，对于此情况，需要由会议平板判断光标实际是朝向那个分屏继续移动，以使光标显示在相应的分屏中。此外，还需要指出一个特例，当鼠标到达第1分屏的右下角端点时，此时，会议平板检测到相连的分屏包括第2分屏、第3分屏和第4分屏，对于此情况，需要由会议平板判断鼠标实际是朝向那个分屏继续移动，以使鼠标显示在相应的分屏中。
S103，接收所述主控计算机发送的交互信息，并将所述交互信息传递至所述当前分屏对应的当前受控计算机，以使所述当前受控计算机执行所述交互信息，其中，所述交互信息为所述主控计算机检测到用户向所述主控计算机发起交互时所获取和拦截的信息。
其中，主控计算机会继续获取用户1对所述主控计算机的交互信息，且在获取到该交互信息后会首先对其进行拦截，保证主控计算机不会执行该交互信息，具体的，该交互信息包括鼠标移动信息、鼠标点击信息、键盘操作信息中的一种或多种。步骤S102中，会议平板中的光标超出所述第1分屏的范围后会进入第2分屏、第3分屏或第4分屏中的其中一个，假如光标进入了第2分屏的范围，光标会在第2分屏中显示出来，且此时主控计算机会通过会议平板将该交互信息传递第2分屏对应的第1受控计算机。具体实施时，主控计算机可以首先通过无线网络将交互信息发送至会议平板，然后会议平板再通过无线网络将交互信息转发至第1受控计算机。例如，该交互信息为鼠标移动信息，具体为用户1对鼠标移动了(50，50)，表示用户控制鼠标向右下方向各移动了50像素，该鼠标移动信息可以经过编码传递给第1受控计算机。第1受控计算机接收到该所述交互信息后，可以通过调用通过系统接口(API)执行从会议平板中转过来的交互信息，若交互信息为键盘操作信息，则第1受控计算机会执行相应的键盘操作信息；若交互信息为对鼠标移动(50，50)，则第1受控计算机会控制鼠标向右下方向各移动50像素，同时在第2分屏中显示出来，从而实现 用户1在主控计算机上就可以对第1受控计算机进行协作控制。
根据本发明实施例的远程协作方法，主控计算机首先捕获用户的鼠标操作信息并发送至接收终端，然后接收终端检测鼠标的光标的位置，当所述光标到达所述主控分屏的其中一边界且继续朝远离所述主控分屏的方向移动时，所述接收终端检测与所述边界连接的当前分屏，并将所述光标显示在所述当前分屏中，之后主控计算机继续获取和拦截用户的交互信息，并通过接收终端将该交互信息传递给所述鼠标当前所在分屏对应的受控计算机，最终该受控计算机执行所述交互信息，从而在多源同屏显示的基础上通过对鼠标移动的判断实现了协作功能，可以使一个用户使用自己计算机对其他人投屏的计算机进行控制，此外，由于用户只需要移动鼠标即可实现这一功能，因此操作便捷。
此外，根据本发明的一个示例，步骤S102之后，该远程协作方法还包括：
向所述主控计算机发送隐藏指令，以使所述主控计算机根据所述隐藏指令将所述光标在所述主控计算机中隐藏，同时使所述光标在所述主控分屏中隐藏。
其中，当会议平板控制光标在第2分屏显示后，会议平板会向所述主控计算机发送隐藏指令，以使所述主控计算机隐藏所述光标，此时主控计算机中的光标被隐藏，对应的第1分屏中的光标也被隐藏。需要指出的是，为了更好的实现协作效果，此时，第1受控计算机中自身的鼠标的光标也可以被隐藏，其隐藏原理也通过会议平板的中转实现，因此，最终第1受控计算机和对应的第2分屏只会出现一个光标，且该光标可以由用户1控制。
此外，根据本发明的一个示例，请参阅图3，步骤S103具体包括：
S1031，接收所述主控计算机通过操作系统API HOOK技术获取和拦截所述交互信息；
S1032，将所述交互信息发送给所述当前分屏对应的当前受控计算机。
其中，主控计算机通过操作系统API HOOK技术对用户1的交互信息进行获取和拦截，然后将拦截获取到的交互信息通过无线网络，如wifi，发送至会议平板，会议平板接收该交互信息后，会将该交互信息发送给所述鼠标当前所在分屏对应的受控计算机，从而实现交互信息的中转。
此外，根据本发明的一个示例，步骤S104具体包括：
使所述当前受控计算机同时获取所述交互信息及来着自身的交互信息，所述当前受控计算机根据时序执行所述交互信息及来着自身的交互信息。
其中，在用户1通过主控计算机控制第1受控计算机时，若用户2同时向第1受控计算机发出交互信息，则此时，第1受控计算机会根据时序执行用户1的交互信息和用户2的交互信息，例如，用户1在主控计算机的键盘上输入“s”，之后用户2在第1受控计算机的键盘上输入“d”，则此时第2分屏上会显示出“sd”。需要指出的是，由于第1受控计算机和对应第2分屏上中只有一个光标，因此，若用户1和用户2同时操作鼠标，此时该光标的操作结果为两个用户的操作之和，此过程与现有技术中QQ远程协助一致，在此不予赘述。
下面给出一个具体应用环境，会议中，用户1、用户2、用户3和用户4在各自的电脑上启动传屏软件进行桌面传送(无线传屏)，每台电脑上的桌面内容都被传送至会议平板中进行分屏显示。展示中，如用户2需要用户1对自己的电脑进行某些操作，此时，用户1只需将自身的鼠标从自己的分屏移动到用户2的分屏中即可实现远程协作。
请参阅图4，基于同一发明构思，本发明另一实施例提出的远程协作系统，应用于接收终端中，所述接收终端同时与一主控计算机和至少一个受控计算机进行无线传屏，所述主控计算机和所有所述受控计算机的画面分别对应显示在所述接收终端的主控分屏和其它分屏中，所述系统包括：
接收模块10，用于接收所述主控计算机捕获并发送过来的用户在所述主控计算机中的鼠标操作信息；
检测模块20，用于根据所述鼠标操作信息检测所述鼠标的光标在所述主控分屏中的位置，当所述光标到达所述主控分屏的其中一边界且继续朝远离所述主控分屏的方向移动时，检测与所述边界连接的当前分屏，并将所述光标显示在所述当前分屏中；
中转模块30，用于接收所述主控计算机发送的交互信息，并将所述交互信息传递至所述当前分屏对应的当前受控计算机，以使所述当前受控计算机执行所述交互信息，其中，所述交互信息为所述主控计算机检测到用户向所述主控计算机发起交互时所获取和拦截的信息。。
本实施例中，所述系统还包括：
隐藏指令发送模块40，用于在所述检测模块20将所述光标显示在所述当前分屏中之后，向所述主控计算机发送隐藏指令，以使所述主控计算机根据所述隐藏指令将所述光标在所述主控计算机中隐藏，同时使所述光标在所述主控分屏中隐藏。
本实施例中，所述中转模块30具体用于：
接收所述主控计算机通过操作系统API HOOK技术获取和拦截所述交互信息；
将所述交互信息发送给所述当前分屏对应的当前受控计算机。
本实施例中，所述中转模块30还用于：
使所述当前受控计算机同时获取所述交互信息及来着自身的交互信息，所述当前受控计算机根据时序执行所述交互信息及来着自身的交互信息。
本实施例中，所述交互信息包括鼠标移动信息、鼠标点击信息、键盘操作信息中的一种或多种，所述中转模块30还用于：
使所述当前受控计算机通过系统接口执行所述交互信息。
本发明实施例提出的远程协作系统的技术特征和技术效果与本发明实施例提出的方法相同，在此不予赘述。
在流程图中表示或在此以其他方式描述的逻辑和/或步骤，例如，可以被认为是用于实现逻辑功能的可执行指令的定序列表，可以具体实现在任何计算机可读介质中，以供指令执行系统、装置或设备(如基于计算机的系统、包括处理器的系统或其他可以从指令执行系统、装置或设备取指令并执行指令的系统)使用，或结合这些指令执行系统、装置或设备而使用。就本说明书而言，“计算机可读介质”可以是任何可以包含、存储、通信、传播或传输程序以供指令执行系统、装置或设备或结合这些指令执行系统、装置或设备而使用的装置。
计算机可读介质的更具体的示例(非穷尽性列表)包括以下：具有一个或多个布线的电连接部(电子装置)，便携式计算机盘盒(磁装置)，随机存取存储器(RAM)，只读存储器(ROM)，可擦除可编辑只读存储器(EPROM或闪速存储器)，光纤装置，以及便携式光盘只读存储器(CDROM)。另外，计算机 可读介质甚至可以是可在其上打印所述程序的纸或其他合适的介质，因为可以例如通过对纸或其他介质进行光学扫描，接着进行编辑、解译或必要时以其他合适方式进行处理来以电子方式获得所述程序，然后将其存储在计算机存储器中。
应当理解，本发明的各部分可以用硬件、软件、固件或它们的组合来实现。在上述实施方式中，多个步骤或方法可以用存储在存储器中且由合适的指令执行系统执行的软件或固件来实现。例如，如果用硬件来实现，和在另一实施方式中一样，可用本领域公知的下列技术中的任一项或他们的组合来实现：具有用于对数据信号实现逻辑功能的逻辑门电路的离散逻辑电路，具有合适的组合逻辑门电路的专用集成电路，可编程门阵列(PGA)，现场可编程门阵列(FPGA)等。
在本说明书的描述中，参考术语“一个实施例”、“一些实施例”、“示例”、“具体示例”、或“一些示例”等的描述意指结合该实施例或示例描述的具体特征、结构、材料或者特点包含于本发明的至少一个实施例或示例中。在本说明书中，对上述术语的示意性表述不一定指的是相同的实施例或示例。而且，描述的具体特征、结构、材料或者特点可以在任何的一个或多个实施例或示例中以合适的方式结合。
尽管已经示出和描述了本发明的实施例，本领域的普通技术人员可以理解：在不脱离本发明的原理和宗旨的情况下可以对这些实施例进行多种变化、修改、替换和变型，本发明的范围由权利要求及其等同物限定。

Claims (10)

  1. 一种远程协作方法，其特征在于，应用于接收终端中，所述接收终端同时与一主控计算机和至少一个受控计算机进行无线传屏，所述主控计算机和所有所述受控计算机的画面分别对应显示在所述接收终端的主控分屏和其它分屏中，所述方法包括：
    接收所述主控计算机捕获并发送过来的用户在所述主控计算机中的鼠标操作信息；
    根据所述鼠标操作信息检测所述鼠标的光标在所述主控分屏中的位置，当所述光标到达所述主控分屏的其中一边界且继续朝远离所述主控分屏的方向移动时，检测与所述边界连接的当前分屏，并将所述光标显示在所述当前分屏中；
    接收所述主控计算机发送的交互信息，并将所述交互信息传递至所述当前分屏对应的当前受控计算机，以使所述当前受控计算机执行所述交互信息，其中，所述交互信息为所述主控计算机检测到用户向所述主控计算机发起交互时所获取和拦截的信息。
  2. 根据权利要求1所述的远程协作方法，其特征在于，所述将所述光标显示在所述当前分屏中的步骤之后，所述方法还包括：
    向所述主控计算机发送隐藏指令，以使所述主控计算机根据所述隐藏指令将所述光标在所述主控计算机中隐藏，同时使所述光标在所述主控分屏中隐藏。
  3. 根据权利要求2所述的远程协作方法，其特征在于，所述将所述交互信息传递至所述当前分屏对应的当前受控计算机的步骤包括：
    接收所述主控计算机通过操作系统API HOOK技术获取和拦截的所述交互信息；
    将所述交互信息发送给所述当前分屏对应的当前受控计算机。
  4. 根据权利要求3所述的远程协作方法，其特征在于，所述使当前受控计算机执行所述交互信息的步骤具体包括：
    使所述当前受控计算机同时获取所述交互信息及来着自身的交互信息，所述当前受控计算机根据时序执行所述交互信息及来着自身的交互信息。
  5. 根据权利要求1至4任意一项所述的远程协作方法，其特征在于，所述交互信息包括鼠标移动信息、鼠标点击信息、键盘操作信息中的一种或多种， 所述使所述当前受控计算机执行所述交互信息的步骤包括：
    使所述当前受控计算机通过系统接口执行所述交互信息。
  6. 一种远程协作系统，其特征在于，应用于接收终端中，所述接收终端同时与一主控计算机和至少一个受控计算机进行无线传屏，所述主控计算机和所有所述受控计算机的画面分别对应显示在所述接收终端的主控分屏和其它分屏中，所述系统包括：
    接收模块，用于接收所述主控计算机捕获并发送过来的用户在所述主控计算机中的鼠标操作信息；
    检测模块，用于根据所述鼠标操作信息检测所述鼠标的光标在所述主控分屏中的位置，当所述光标到达所述主控分屏的其中一边界且继续朝远离所述主控分屏的方向移动时，检测与所述边界连接的当前分屏，并将所述光标显示在所述当前分屏中；
    中转模块，用于接收所述主控计算机发送的交互信息，并将所述交互信息传递至所述当前分屏对应的当前受控计算机，以使所述当前受控计算机执行所述交互信息，其中，所述交互信息为所述主控计算机检测到用户向所述主控计算机发起交互时所获取和拦截的信息。
  7. 根据权利要求6所述的远程协作系统，其特征在于，所述系统还包括：
    隐藏指令发送模块，用于在所述检测模块将所述光标显示在所述当前分屏中之后，向所述主控计算机发送隐藏指令，以使所述主控计算机根据所述隐藏指令将所述光标在所述主控计算机中隐藏，同时使所述光标在所述主控分屏中隐藏。
  8. 根据权利要求7所述的远程协作系统，其特征在于，所述中转模块具体用于：
    接收所述主控计算机通过操作系统API HOOK技术获取和拦截所述交互信息；
    将所述交互信息发送给所述当前分屏对应的当前受控计算机。
  9. 根据权利要求8所述的远程协作系统，其特征在于，所述中转模块还用于：
    使所述当前受控计算机同时获取所述交互信息及来着自身的交互信息，所述当前受控计算机根据时序执行所述交互信息及来着自身的交互信息。
  10. 根据权利要求6至9任意一项所述的远程协作系统，其特征在于，所述交互信息包括鼠标移动信息、鼠标点击信息、键盘操作信息中的一种或多种，所述中转模块还用于：
    使所述当前受控计算机通过系统接口执行所述交互信息。
PCT/CN2017/103782 2017-03-17 2017-09-27 远程协作方法及系统 Ceased WO2018166173A1 (zh)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US16/319,767 US11243737B2 (en) 2017-03-17 2017-09-27 Method and system for remote collaboration

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201710161867.9 2017-03-17
CN201710161867.9A CN107122148B (zh) 2017-03-17 2017-03-17 远程协作方法及系统

Publications (1)

Publication Number Publication Date
WO2018166173A1 true WO2018166173A1 (zh) 2018-09-20

Family

ID=59717426

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/103782 Ceased WO2018166173A1 (zh) 2017-03-17 2017-09-27 远程协作方法及系统

Country Status (3)

Country Link
US (1) US11243737B2 (zh)
CN (1) CN107122148B (zh)
WO (1) WO2018166173A1 (zh)

Families Citing this family (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107122148B (zh) * 2017-03-17 2020-05-12 广州视源电子科技股份有限公司 远程协作方法及系统
CN108037972B (zh) * 2017-12-14 2021-06-08 威创集团股份有限公司 一种完全隐藏光标的方法及装置
CN109451141B (zh) * 2018-09-26 2021-06-04 维沃移动通信有限公司 一种操作控制方法及相关终端
CN112527174B (zh) * 2019-09-19 2022-10-11 华为技术有限公司 一种信息处理方法及电子设备
CN111258423B (zh) * 2020-01-15 2021-10-22 惠州Tcl移动通信有限公司 组件显示方法、装置、存储介质及增强现实显示设备
CN111324248A (zh) * 2020-01-21 2020-06-23 维达力实业(深圳)有限公司 终端控制方法、装置、终端、计算机设备和存储介质
CN117215697A (zh) * 2020-07-21 2023-12-12 联想(北京)有限公司 一种控制方法及装置
CN111880759A (zh) * 2020-08-05 2020-11-03 深圳市嘉润原新显科技有限公司 多分屏显示画面的操控方法、装置、显示器及存储介质
CN115268807A (zh) * 2021-04-30 2022-11-01 华为技术有限公司 一种跨设备内容分享方法及电子设备
CN114816624A (zh) * 2022-04-02 2022-07-29 厦门亿联网络技术股份有限公司 一种双系统的显示交互方法及装置

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101276253A (zh) * 2007-03-30 2008-10-01 联想(北京)有限公司 一种多屏显示系统及多屏显示设置方法
CN102520850A (zh) * 2011-11-29 2012-06-27 青岛海信移动通信技术股份有限公司 一种无线传屏中输入操作的处理方法及设备
CN103268208A (zh) * 2013-05-06 2013-08-28 北京神州彩虹科技发展有限公司 一种对多个显示屏进行交互式操作的无线控制系统及其控制方法
US9170661B2 (en) * 2006-01-31 2015-10-27 Jerry Moscovitch Cursor management system
CN107122148A (zh) * 2017-03-17 2017-09-01 广州视源电子科技股份有限公司 远程协作方法及系统

Family Cites Families (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI289765B (en) * 2005-07-20 2007-11-11 Quanta Comp Inc Devices a methods for signal switching and processing
JP2010288117A (ja) * 2009-06-12 2010-12-24 Sharp Corp 画面データ送信端末、画面データ受信端末、画面データ伝送システム、画面データ送信プログラム、画面データ受信プログラム、画面データ送信方法および画面データ受信方法
GB0910186D0 (en) * 2009-06-15 2009-07-29 Adder Tech Ltd Computer input switching device
US8289293B2 (en) * 2010-06-22 2012-10-16 Dell Products L.P. Information handling system dual mode touch enabled secondary display
US9684424B2 (en) * 2010-07-08 2017-06-20 Red Hat Israel, Ltd. Transforming cursor graphics information
CN102710778B (zh) * 2012-06-05 2014-12-31 山东大学 一种协作无线传屏系统及其工作方法
CN103049191B (zh) * 2012-12-14 2016-04-13 广东威创视讯科技股份有限公司 在拼接墙显示系统上实现鼠标交互操作的方法及装置
CN105323616A (zh) * 2014-08-01 2016-02-10 珠海金山办公软件有限公司 一种跨屏控制方法、装置及系统
CN105373217A (zh) * 2014-09-02 2016-03-02 鸿富锦精密工业（深圳）有限公司 多屏显示装置
CN104506907B (zh) * 2014-11-25 2018-03-13 上海众应信息科技有限公司 控制端与多个远程被控终端之间的交互操作方法及系统
JP6417894B2 (ja) * 2014-11-26 2018-11-07 コニカミノルタ株式会社 文字入力システム、文字入力方法、携帯端末装置及び文字入力プログラム
CN106325717A (zh) * 2015-06-30 2017-01-11 天津三星电子有限公司 一种移动终端的操作控制方法及其操作控制系统
CN105160951B (zh) * 2015-08-31 2019-04-30 深圳信息职业技术学院 一种基于移动设备的白板教学方法及系统
US20170351396A1 (en) * 2016-06-03 2017-12-07 Logitech Europe S.A. Automatic application launching in a multi-host flow-enabled system

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9170661B2 (en) * 2006-01-31 2015-10-27 Jerry Moscovitch Cursor management system
CN101276253A (zh) * 2007-03-30 2008-10-01 联想(北京)有限公司 一种多屏显示系统及多屏显示设置方法
CN102520850A (zh) * 2011-11-29 2012-06-27 青岛海信移动通信技术股份有限公司 一种无线传屏中输入操作的处理方法及设备
CN103268208A (zh) * 2013-05-06 2013-08-28 北京神州彩虹科技发展有限公司 一种对多个显示屏进行交互式操作的无线控制系统及其控制方法
CN107122148A (zh) * 2017-03-17 2017-09-01 广州视源电子科技股份有限公司 远程协作方法及系统

Also Published As

Publication number Publication date
CN107122148A (zh) 2017-09-01
US20210294559A1 (en) 2021-09-23
US11243737B2 (en) 2022-02-08
CN107122148B (zh) 2020-05-12

Similar Documents

Publication Publication Date Title
WO2018166173A1 (zh) 远程协作方法及系统
US20130346858A1 (en) Remote Control of Audio Application and Associated Sub-Windows
US9912724B2 (en) Moving objects of a remote desktop in unstable network environments
US11262968B2 (en) Method and system for wireless screen transmission
US20100231556A1 (en) Device, system, and computer-readable medium for an interactive whiteboard system
US11412012B2 (en) Method, apparatus, and computer-readable medium for desktop sharing over a web socket connection in a networked collaboration workspace
US10931733B2 (en) Method, apparatus, and computer-readable medium for transmission of files over a web socket connection in a networked collaboration workspace
WO2018233122A1 (zh) 无线传屏的展示方法、装置及存储介质
CN105556495A (zh) 用于屏幕镜像的方法及其源设备
JP2017538178A (ja) デバイス間でのアプリケーションの分割提示
US20200326846A1 (en) Method and System of Enhanced Interaction with a Shared Screen
CN107479957A (zh) 一种多系统应用的切换方法、装置、设备和存储介质
CN103279314B (zh) 具有虚拟设备窗口操作的传输装置及其的传输系统
JP2014035670A (ja) 画像処理装置、画像処理システム、画像処理方法およびプログラム
US20170228137A1 (en) Local zooming of a workspace asset in a digital collaboration environment
WO2018090729A1 (zh) 智能交互平板内多通道切换方法及装置
CN102890595B (zh) 主屏幕与延伸屏幕的互动控制方法及系统
TW201546656A (zh) 平板式投影裝置之手勢辨識系統及其辨識方法
CN114237481A (zh) 书写笔迹显示处理方法、系统、装置、设备和存储介质
CN110692036B (zh) 演示服务器、数据中继方法和用于生成虚拟指针的方法
US11557065B2 (en) Automatic segmentation for screen-based tutorials using AR image anchors
JP2014149579A (ja) データ制御装置、データ共有システムおよびプログラム
CN113366442B (zh) 视频会议中的显示冲突消除
CN107390981B (zh) 一种全局菜单的控制方法、装置、设备和存储介质
CN113495703B (zh) 一种显示控制方法及显示控制系统

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17900748

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 21/01/2020)

122 Ep: pct application non-entry in european phase

Ref document number: 17900748

Country of ref document: EP

Kind code of ref document: A1