CN1910548A - Multiscreen display system - Google Patents

Abstract

A system including two or more devices that are enabled for screen sharing. A screen connect function is resident on at least one of the devices. Activation of the screen connect function initiates the screen sharing between the devices. The screen sharing may include a sharing of a display capability of one device with the other device. Additionally or in place of the sharing of the display capability, other functionality such as processing capabilities, touch screen control, etc. may be shared between devices. The screen sharing may include a transfer of a user interface or portion thereof from a first device to a second device. This user interface or portion thereof operated on the second device functions as a user interface of the first device. The screen sharing may be enabled when the devices are brought into proximity with each other. A screen connect function may initiate the screen sharing.

Description

Multi-Screen Display System

The present invention relates generally to methods and devices for utilizing a distributed screen system to facilitate the operation of a given device, and in particular to methods and systems for sharing functionality between devices with limited display capabilities.

Conventional systems are known that enable a host device to display a given display area on multiple displays. For example, many current video cards for conventional computers allow the display area to be shared by two or more computer monitors. For example, an ATI Radeon 980Pro ^™ video card can share the display area across two monitors. The left border of the monitor to the right of the user's field of view shares the right border of the monitor to the left of the user's field of view. Both monitors together display a single display area. In this way, for example an object cut off by the left border of the monitor lying on the right continues past the right border of the monitor lying on the left, giving the effect of sharing a single display area across both monitors. This functionality is provided by a video card that spans the split display area of the two monitors. The monitor itself is unaware of the result, since each only displays the image data given to it by the video card.

In US Patent Publication Nos. US 2002/0197993 and US 2002/0196196, a client/server system is described where a centralized server communicates with multiple devices over a network (eg wired, wireless). In operation, the centralized server distributes portions of the image across multiple devices. These devices work as clients of the centralized server. In these systems, the server operates similarly to the ATI Radeon 9800Pro ^(TM) video card described above, in that the server also determines how to distribute the image across multiple wireless devices. In this system, it is also shown that multiple wireless devices can also share a single user interface, the functionality of which is distributed among the wireless devices. However, again, these devices operate in a server/client environment, so the relationship between devices is determined by the server.

Sametime ^™ is an IBM Corporation product that enables users to share a display experience across multiple distributed computer systems. In the Sametime ^(TM) environment, the display of an action on one computer system is mirrored on one or more other computer systems, allowing visualization of the action across distributed computer systems. In a portion of the screen of one or more other computer systems, for example, typing a question is reflected back to the individual computers of the distributed computer system, thereby allowing an ongoing chat environment. Furthermore, in Sametime ^(TM) , one computer functions as a master computer display while other computers function as slave displays.

In another system such as that shown in British Patent Application Publication No. GB 2384064A, a mobile phone is used by another device to allow a smart device to connect to a network through the mobile phone and the mobile phone network. In this system, the phone is the device used to enable the smart device to access the wireless network.

A problem with this system is that none of these systems allow devices to operate without at least one server system to coordinate and manage the distribution of images across multiple devices. Furthermore, even the distribution of a single user interface across multiple devices does not increase the capabilities of a given device.

Accordingly, it is an object of the present invention to overcome these and/or other disadvantages of the prior art.

These and other objects of the present invention are achieved by a system comprising two or more devices enabled for screen sharing. In operation, a screen connection function resides on at least one of the devices. Activation of the screen connection feature enables screen sharing between devices. According to the present invention, screen sharing may involve one device sharing display capabilities with another device. In addition to or instead of sharing display capabilities, other functions such as processing power, touch screen control, etc. may be shared between devices.

The screen sharing may include transferring the user interface or a portion thereof from the first device to the second device. The user interface running on the second device or a part thereof functions as the user interface or together with the user interface of the first device. This screen sharing may be allowed when the devices are brought into close proximity to each other. The screen connection feature initiates screen sharing.

In either event, by initiating screen sharing, functionality on one of the devices is used to enhance or add functionality to the other device.

These and other features and advantages of the present invention will become more apparent from the accompanying drawings and the ensuing detailed description.

The following is a description of illustrative embodiments of the present invention which, when taken in conjunction with the following figures, will demonstrate the above and other features and advantages. It should be clearly understood that the drawings are included for illustrative purposes and do not represent the scope of the invention. In the figures, like parts of the system are indicated by like numerals.

The present invention is best understood with reference to the accompanying drawings, in which:

Figure 1 shows a schematic system according to an embodiment of the invention; and

Figure 2 shows a flowchart illustrating the operation of a system according to an embodiment of the present invention.

For purposes of illustration, the invention will be described below with reference to an exemplary system. It should not be construed as limiting the appended claims. The system of the present invention is applicable to various alternative embodiments, which will be readily apparent to those of ordinary skill in the art. It should be understood that the appended claims cover these alternative systems.

FIG. 1 shows a schematic embodiment of a system 100 including a portable wireless device 110 and a portable wireless device 150 according to an embodiment of the present invention.

Device 110 includes a display portion 120 , one or more control buttons 130 , and an antenna 140 . Device 110 is shown schematically in the form of a personal digital assistant (PDA). Device 150 includes a display portion 160 , one or more control buttons 170 , and an antenna 180 . Device 150 is shown schematically in the form of a cellular telephone. It is clear that any of the forms of devices 110, 150 may be substituted for other known devices and still be within the scope of the invention. Furthermore, the devices 110, 150 need not be different types of devices. For example, both devices could be cellular phones. In some embodiments according to the invention, one of the devices may have a better display or other capability than another of the devices. However, it should be clearly understood that even when two devices have the same capabilities, the sharing of capabilities according to the present invention will enhance the capabilities of either of the individual devices. Clearly, other devices can also operate in accordance with the present invention, such as portable multimedia players, portable storage devices, digital cameras, digital video cameras, watches, other wearable microdisplays such as embedded in eyeglasses, and the like. Each of these devices has limitations in capabilities including display (eg, size, functionality, etc.) of images, which capabilities will be enhanced by use of the present invention as will be discussed further schematically below.

It should be understood that, in one environment, one of the devices may have capabilities (display, processing, functionality, etc.) that are superior to those of the other of the devices. However, in another environment, a less capable device may be better than or equal to another device. For example, in the case of illustrative devices 110, 150, device 150, which is a telephone device, may have lower capabilities than device 110, which is illustratively shown as a PDA. However, if device 150 is placed near another device (not shown), which may be, for example, a portable multimedia player, device 150 may have superior capabilities relative to the portable multimedia player, so as device 110 is included in Works as in the schematic description of . It should thus be understood that capabilities may be transferred to or from one device in a given combination of devices, and from or to that device in another combination of devices.

One aspect of the invention is that devices 110, 150 each have the ability to communicate with each other. This can be achieved by a communication system, in particular a communication system adapted to operate according to the invention, or it can be implemented as a by-product of a communication system which also has other functions. Intuitively, this communication can be performed through a short-range communication system, such as the Bluetooth communication protocol. The system aspects and protocols used to allow communication between devices 110, 150 are beyond the scope of the present invention and should not be construed as limiting the invention unless specific elements are required. Clearly, other means for allowing communication between devices, such as infrared communication (IR), other radio frequency (RF) communication protocols, etc., will readily occur to those of ordinary skill in the art. Intuitively, the devices 110, 150 are shown with antennas 140, 180, respectively, which can be used for standard operation and/or can be used for communication between the devices 110, 150. However, in some embodiments, clearly, the antennas 110, 150 may not be necessary, or may be eliminated.

Further operation of the present invention is described herein with respect to the exemplary system 100 shown in FIG. 1 and with respect to FIG. 2 showing a flowchart 200 according to an embodiment of the present invention.

As shown within flowchart 200, during act 210, two devices, such as mobile devices, are located in the vicinity of each other. The proximity condition may have occurred during act 210, or may have existed prior to act 210. In fact there is not even any specific proximity requirement between the devices, such as no mutual adjacency requirement. In one embodiment of the invention, it may be useful for devices to be in close proximity to each other. However, all that is actually required is that the devices 110, 150 be in close enough proximity to allow communication between the devices 110, 150.

Thereafter, during act 220, the device 110, 150 is enabled for screen sharing which occurs during act 240 in accordance with the present invention due to proximity, depression of a control button 130, 170, or other means, operating as a screen connection button. Screen sharing according to the present invention means that the display, functions, user interface or parts thereof of one device, eg device 110 , can be used to operate functions on another device, eg device 150 . For example, device 150 is shown schematically as a cellular telephone. Cellular phones typically have very limited display capabilities. Device 110 is shown schematically as a PDA. Today's PDAs generally have greater capabilities, including better processing capabilities and better display capabilities such as larger displays, better resolution, more functions such as touch screens, and the like. Although, clearly, the capabilities of the devices may also be the same, performing operations by sharing capabilities will still enhance the capabilities of any of the devices.

According to one embodiment of the invention, during act 240 at least one function, operation, etc. of one device is enabled to be manipulated on another device. For example, during act 240, the phonebook and dialing capabilities of device 150 (shown as a cell phone) can now be manipulated on the PDA. It should be understood that this is not intended to show a conventional PDA which is also a cell phone, whereby communication according to the present invention does not add any functionality. According to the invention, it is intended to enable or implement a hitherto non-existing function on one device, eg device 110 , by direct communication between the devices 110 , 150 .

Thus, prior to communication between the devices 110, 150, there is no capability on the device 110, for example, to manage the address book of the device 150 on the device 110. However, following the communication between the devices 110, 150 according to the invention, there exists on the device 110 the ability to manage, for example, the address book of the device 150 on the device 110 . According to the present invention, however, this is not the only function that can be enhanced. Other capabilities may also be allowed between devices 110, 150, such as the ability to view images stored on device 150 on one device, such as device 110, for example.

Screen sharing in accordance with the present invention may also allow further functionality, for example, perhaps by communicating in accordance with the present invention between devices 110, 150, device 110 may be manipulated so as to utilize the display and manipulation capabilities of device 110 and the calling of device 150 ability to make phone calls. In this embodiment, the display and functionality of device 110 may now exhibit the display and functionality of device 150 via act 220 . In other words, the display 120 of the device 110 can now present a virtual keyboard that can be manipulated, for example, to initiate a phone call. In one embodiment, the display 120 may also be enabled for touch input, as is typically the case for PDA devices. Through operation in accordance with the present invention, the touch input capability of display 120 is used to manipulate the dialing feature of device 150 to initiate a phone call. Furthermore, perhaps even the microphone and speaker capabilities of device 110 are operable to further facilitate the use of the calling capabilities of device 150 . These capabilities can also be truly shared, operations that hitherto reside and/or run on one of the devices now operate through the use of both devices. For example, it may be useful on device 110 to edit the text portion of a phonebook entry resident on device 150 . However, for that same phonebook entry, it may be useful to enter the voice identification for that entry directly on device 150 . Therefore, the term "screen sharing" as used herein should be understood to cover any one or combination of these sharing capabilities according to the present invention.

In one embodiment, the functionality may simply facilitate operation of a device with limited display capabilities, such as device 150 , by displaying the same or a similar display on a device with less limited display capabilities, such as device 110 . In this way, the typical display of device 150 may only be displayed on device 110 in a larger format. In this operation, device 150 may transmit complete display information to device 110 . Of course, simple screen-like descriptions, such as HTML descriptions, may be shared by device 150 and device 110 in other embodiments. Other methods of screen sharing can also be utilized, such as XML, HAVi-DDI (HAVi Data Driven Input), VNC, etc. There are other known technologies that allow devices to recognize each other, operate together, communicate together, and/or exchange capabilities, etc., suitable for operation in accordance with the present invention, including UPnP, XML-RPC, UPnP Remote I/O, etc. It should be understood that these and other methods are within the scope of the present invention.

In another embodiment, device 110 is operable to augment the capabilities of device 150, such as through the use of a touch screen as described above, or through other additional functionality borrowed from a display device (eg, device 110). For example, in one embodiment, the processing capabilities of device 110 may be used to further enhance the functionality of device 150 to allow for more complex or configurable displays and functions of device 150 through operation of device 110 .

In one embodiment, these features may be implemented by transferring the user interface (UI) of device 150 , or a portion thereof, to device 110 . In this way, operation of other parts of device 110, such as control button 130, may also manipulate features of device 150, according to embodiments of the present invention.

These transfers of display capabilities, UI capabilities, etc. may optionally occur during act 230 as shown in FIG. 2 . In other embodiments, device 110 may be enabled by having program portions that reside on device 110 and are commanded to provide functionality to other devices, such as device 150 . In these embodiments, the program portion resides on the device 110, however, is not allowed to run until a proximity condition exists between the devices 110, 150 or until a screen connection command is initiated on one of the devices 110, 150.

In these or other embodiments, proximity between devices 110, 150 may initiate the appearance of screen connection icon 125 on device 110 or on device 150 (not shown). The screen connection icon 125 may thereafter be used to allow operation in accordance with the present invention as described above, for example as previously discussed with respect to the control button 130 . The proximity condition may actually be a contact of one device with another device. This contact or other instantiation (eg activation of a screen connection function) may also control what functionality is transferred from a first of the devices to another of the devices. For example, in associating device 150 with device 110, the editing capabilities of device 110 (larger screen, touch display, etc.) may be allowed to be used to edit phonebook entries residing on device 150 as described above. However, by associating device 110 with device 150 , the speech input capabilities of device 150 may be allowed to be used for the operation of functions resident on device 110 .

Among other operations, text input on one device (eg, device 110) may support functionality on another device (eg, device 150). Other features allow drag-and-drop between devices, and actually act as drag-and-drop on a single device. A color display on one device may be useful to an application on another device. For example, the display on a PDA may only support grayscale images, while the display on a telephone may support color images. Thus, the color display on the phone can be used in accordance with the present invention to view, edit, manipulate, etc. photos residing on the PDA. A scroll wheel resident on the phone can be very useful in finding lists stored on the PDA. As noted above and as should be clear from these examples, screen sharing capabilities can be migrated from either device to another. This may be selected by the user, or may be a function of a screen sharing capability shared between devices.

Another example of a screen sharing capability may be to utilize the processing capabilities of device 110 to edit images residing on device 150 . This can be very useful since many telephone devices today have the ability to take pictures using a camera resident on the phone. However, these photos often have poor display quality because of camera limitations. However, in accordance with the present invention, screen sharing can be used to allow device 110 to edit and enhance photos, thereby making photos available on device 150 of better quality than would otherwise be available.

Those of ordinary skill in the art will easily understand that there are many ways to realize the above functions. Accordingly, the described embodiments should be understood not to be limited to any particular alternative.

The embodiments of the present invention described above are for illustrative purposes only, and should not be construed to limit the appended claims to any particular embodiment or group of embodiments. Various alternative embodiments can be devised by those skilled in the art without departing from the spirit and scope of the following claims.

In interpreting the appended claims, it should be understood that:

a) the word "comprising" does not exclude the presence of elements or acts other than those listed in a given claim;

b) the word "a" preceding an element does not exclude the presence of a plurality of such elements;

c) any reference signs in the claims do not limit the scope of those claims;

d) Several "means" can be represented by the same item or structure or function realized by hardware or software;

e) each of the disclosed elements may comprise hardware components (e.g. including discrete and integrated electronic circuits), software components (e.g. computer programs), and any combination thereof;

f) the hardware part may include one or both of analog and digital parts;

g) any of the disclosed devices or parts thereof may be combined together or separated into further parts, unless expressly stated otherwise; and

h) Unless explicitly stated, no specific sequence of actions is required.

Claims (15)

1. A system comprising: a plurality of devices, wherein each of the plurality of devices is configured to allow screen sharing from one of the devices to another of the devices; and a screen connection function resident on at least one of the plurality of devices, wherein activation of the screen connection function initiates the screen sharing among the plurality of devices. 2. The system of claim 1, wherein the screen sharing includes sharing at least one of display capabilities and functionality from one of the plurality of devices to another of the plurality of devices. 3. The system of claim 2, wherein said one of said plurality of devices has more limited display capabilities than said other of said plurality of devices. 4. The system of claim 2, wherein one of the plurality of devices has a more limited processing capability than the other of the plurality of devices. 5. The system of claim 1, wherein one of said plurality of devices is a cellular telephone. 6. The system of claim 1, wherein one of the plurality of devices is a personal digital assistant device. 7. The system of claim 2, wherein the display of the one of the plurality of devices is transferred to the display of the other of the plurality of devices. 8. The system of claim 7, wherein said display of said one of said plurality of devices is transferred as at least one of an HTML, XML, or HAVi-DDI screen description. 9. The system of claim 2, wherein a portion of the user interface of the one of the plurality of devices is transferred to the other of the plurality of devices as a part of the user interface of the one device. 10. The system of claim 1, wherein the screen connection function is enabled when each of the plurality of devices is in the vicinity of each other of the plurality of devices. 11. The system of claim 10, wherein proximity between each of the plurality of devices allows a screen connection icon on one of the plurality of devices, thereby allowing activation of the screen connection function. 12. A portable device comprising: means for allowing screen sharing from said portable device to another device; and a screen link function, wherein activation of said screen link function initiates said screen sharing between the devices. 13. The portable device of claim 12, wherein the screen sharing includes sharing at least one of display capabilities and functions. 14. The portable device of claim 12, wherein the device is configured for a user to selectively allow operations residing on the device to be transferred for operation on another device. 15. The portable device of claim 12, wherein the device is configured such that the selected operation determines which part of the operation is transferred for manipulation on another device.

Images