TWI416389B - Display system for displaying virtual keyboard and method thereof - Google Patents

Abstract

The present invention provides a display system for displaying a virtual keyboard and a display method adapted for the display system. The method includes: (a) projecting a virtual keyboard on a plane vertically; (b) sending IR signals to the virtual keyboard and receiving IR signals from the virtual keyboard; (c) calculating the time of each IR signal from sending to receiving at real time; (d) determining whether the time of an IR signal becomes shorter; (e) if yes, acquiring a keyboard content corresponding to an IR send-receive unit transmitting the IR signal; (f) sending a signal of the keyboard content; and (g) performing a function corresponding to the keyboard content or displaying the keyboard content.

Description

Virtual keyboard display system and implementation method thereof

The present invention relates to a display system, and more particularly to a display system of a virtual keyboard and an implementation method thereof.

With the development of information technology, many display device manufacturers, such as mobile terminal manufacturers, have integrated various functions in mobile terminals, such as virtual keyboards and touch screens, to bring convenience to users. The user can enter characters through a virtual keyboard displayed on the screen. In most cases, the virtual keyboard is used on the touch screen for fast input. However, since the virtual keyboard needs to occupy a large display space, and the prior art displays the virtual keyboard on the screen, the size of the virtual keyboard is fixed, the display position is fixed, and the keys of the virtual keyboard are fixed, thereby giving the user a better operation when operating the mobile terminal. The inconvenience; and, the touch screen is also relatively expensive, bringing a certain cost to the manufacturer.

In order to solve the above problems, an object of the present invention is to provide a display system for a virtual keyboard, comprising a projection device and a display device, the projection device being communicable with the display device, the projection device comprising: a projection a unit for vertically projecting a virtual keyboard on a plane; at least one infrared emission a receiving unit, configured to transmit an infrared signal to the virtual keyboard and receive an infrared signal reflected by the virtual keyboard, each infrared transmitting receiving unit is provided with an identifier to distinguish other infrared transmitting receiving units; and a storage unit is configured to store each The infrared transmitting receiving unit with the identifier and the corresponding button content information; an instant clock unit for calculating the time for each infrared transmitting and receiving unit to transmit the infrared signal to the virtual keyboard and receiving the infrared signal reflected by the virtual keyboard; It is used to determine whether the infrared signal transmitting and receiving time of each infrared transmitting and receiving unit becomes smaller, and when the infrared signal transmitting and receiving time of the infrared transmitting and receiving unit becomes smaller, it is determined that all the infrared transmitting and receiving units of the infrared signal transmitting and receiving time become smaller in the infrared. The infrared transmitting and receiving unit having the largest signal receiving and receiving time; and a communication unit for transmitting the signal to the display device; wherein the processing unit is further configured to acquire, from the storage unit, the infrared transmitting and receiving unit with the largest receiving time of the infrared signal Button content And the communication unit transmits the control information containing a content key to the information signal to the display device, the display device recognizes the radio signal, performing a function corresponding to the key content or displays the key content.

The invention also provides a method for implementing a display system of a virtual keyboard, the method comprising the steps of: (a) storing each of the infrared transmitting and receiving units with the identifier and corresponding key content information; (b) vertically projecting a virtual keyboard in the first (c) each infrared transmitting and receiving unit transmits an infrared signal to the virtual keyboard and receives the infrared signal reflected by the virtual keyboard; (d) instantaneously calculates the transmitting and receiving time of the infrared signal of each infrared transmitting receiving unit; (e) judging one of them Whether the transmission and reception time of the infrared signal of the infrared transmitting and receiving unit becomes small; (f) The infrared signal receiving and receiving time of the infrared transmitting and receiving unit becomes smaller, and the infrared transmitting and receiving unit with the largest infrared signal receiving and receiving time in all the infrared transmitting and receiving units whose infrared signal transmitting and receiving time becomes small is judged; (g) acquiring and transmitting the infrared signal Transmitting the button content information corresponding to the infrared transmitting receiving unit with the largest receiving time; (h) transmitting a signal containing the content information of the button; and (i) performing a function corresponding to the content of the button or displaying the content of the button.

A display system of a virtual keyboard and a method for implementing the same, the display system projecting a virtual keyboard on a plane for user input operation, thereby releasing a certain display space for the display screen, and calculating the transmission and reception time of the infrared signal Quickly recognize the input of virtual button points.

1‧‧‧Projector

2‧‧‧virtual keyboard

3‧‧‧Display device

4‧‧‧Display system

10‧‧‧ square

11‧‧‧Infrared transmitting and receiving unit

12‧‧‧Projection unit

13‧‧‧First Processing Unit

14‧‧‧ Instant Clock Unit

15‧‧‧ storage unit

16‧‧‧First communication unit

17‧‧‧Second communication unit

18‧‧‧Second processing unit

19‧‧‧Display unit

20‧‧‧Virtual button points

31‧‧‧ long arm

32‧‧‧ shaft

1 is a schematic view of a projection apparatus of the present invention; FIG. 2 is a schematic diagram of an application of a virtual keyboard of the projection apparatus of the present invention; FIG. 4 is a schematic diagram of a hardware module of a display system of the virtual keyboard of the present invention; And FIG. 5 is a flow chart of a method for implementing the display system of the virtual keyboard of the present invention.

BRIEF DESCRIPTION OF THE DRAWINGS Figure 1 is a schematic illustration of a projection apparatus of the present invention. A projection device 1 is a square electronic device composed of squares 10. In other embodiments of the invention, the projection device 1 may also have other shapes, such as a circle, other polygons. An infrared radiation receiving unit 11 is disposed at the apex of the squares. In other embodiments of the invention, the infrared transmit receiving unit 11 may be arranged at other locations on the square. The The infrared transmitting and receiving unit 11 is composed of an infrared transmitting module and an infrared receiving module. The distance between two adjacent infrared transmitting and receiving units 11 is L, and the value of L is greater than a predetermined value, such as the predetermined value being the width of one finger.

The projection device 1 projects to produce a virtual keyboard 2 as shown in FIG. The shape of the virtual keyboard 2 is the same as that of the projection device 1. The virtual button point 20 for guiding the user to touch is displayed at the vertices of the squares, that is, the position corresponding to the vertical direction of the infrared emission receiving unit 11, such as a virtual button. Points 7, 8, 9, etc. Therefore, the distance between two adjacent virtual button points 20 is equal to L, thereby preventing the user's finger from touching other virtual button points when the virtual keyboard 2 touches a certain virtual button point. In other embodiments of the invention, the projection device 1 can also project a virtual keyboard 2 that includes other virtual button points.

3 is a schematic diagram of an application of a projection virtual keyboard of the projection apparatus of the present invention. The projection device 1 is connected to a rotating shaft 32 on a display device 3 via a long arm 31. The projection device 1 vertically projects the virtual keyboard 2 on a plane. The infrared emission receiving unit 11 on the projection device 1 vertically transmits the infrared signal to the corresponding virtual button point 20 on the virtual keyboard 2 and receives the infrared signal reflected back from the virtual button point 20. When the user touches the virtual button point on the virtual keyboard 2, the display device 3 controls the output of the button content corresponding to the virtual button point and the display output result. The long arm 31 can adjust the position of the projection device 1 by moving the rotating shaft 32 back and forth and the rotating shaft 32 can drive the long arm 31 to rotate left and right, thereby adjusting the position of the virtual keyboard 2.

4 is a hardware block diagram of a display system of the virtual keyboard of the present invention. A display system 4 includes the projection device 1 and the display device 3. The projection device 1 and the display The device 3 communicates by means of a wired or wireless communication, such as the projection device 1 being connected to the display device 3 via a USB interface (not shown) or via a Bluetooth communication connection. In the embodiment, the projection device 1 and the display device 3 communicate by a wireless communication method. The projection device 1 includes at least one infrared transmitting and receiving unit 11, a projection unit 12, a first processing unit 13, an instant clock (RTC) unit 14, a storage unit 15, and a first communication unit 16.

The projection unit 12 is configured to vertically project the virtual keyboard 2 on a plane. The infrared transmitting and receiving unit 11 is configured to vertically transmit the infrared signal to the virtual button point corresponding to the virtual keyboard 2 and receive the infrared signal reflected by the virtual button point. Each of the infrared transmitting and receiving units 11 has a different identifier. The storage unit 15 is configured to store each button content information corresponding to the infrared transmitting receiving unit 11 with the identifier. The RTC unit 14 is configured to calculate the time when the infrared transmitting and receiving unit 11 transmits the infrared signal to the virtual keyboard 2 and receives the infrared signal reflected by the virtual keyboard 2 (hereinafter referred to as the transmitting and receiving time). The formula for calculating the time of the RTC unit 14 is t=2 s/v, where s is the distance from the infrared signal of the infrared transmitting and receiving unit 11 to the corresponding virtual button point on the virtual keyboard 2, and v is the speed of light. The first processing unit 13 is configured to determine whether the infrared signal transmission and reception time of each of the infrared transmission receiving units becomes small.

When the first processing unit 13 determines that the infrared signal transmitting and receiving times of all the infrared transmitting and receiving units 11 have not changed, it indicates that no touch is generated on the virtual keyboard 2, all the infrared signals are not blocked, and s is not changed. When the first processing unit 13 determines the infrared signal of one of the infrared transmitting and receiving units 11 The first processing unit 13 is further configured to determine the infrared transmitting receiving unit 11 that has the largest infrared signal receiving and receiving time in all the infrared transmitting and receiving units 11 whose infrared signal transmitting and receiving time becomes smaller, and the virtual keyboard 2 is illustrated. The virtual button point corresponding to the infrared transmitting and receiving unit 11 generates a touch, and the infrared signal received by the infrared transmitting and receiving unit 11 is blocked, s becomes small, and the user touches a virtual area due to a large back area of the user. At the button point, the back of the user's hand will block other virtual button points, and the s of the other blocked virtual button points become smaller, and the distance of the touch virtual button point to the infrared transmitting and receiving unit 11 is the largest among all the smaller s. of.

For example, when the user touches a virtual button point "7" on the virtual keyboard 2 with one finger, the infrared signal of the virtual button point "7" is blocked by the finger, and the virtual button points "4", "5", The infrared signals of "1" and "2" are blocked, the infrared signals are transmitted back to the fingers and the back of the hands and the infrared signals on the backs of the fingers and hands are reflected back. The infrared signals are transmitted to "4", "5", "1" and "2". The distances are reduced, that is, s decreases, v does not change, and the infrared signal receiving and receiving time of the infrared transmitting and receiving unit 11 corresponding to the virtual button points "7", "4", "5", "1", and "2" t is reduced, it is obvious that the distance from the infrared signal to "7" is the largest. Therefore, the infrared signal receiving and receiving unit 11 corresponding to the virtual button point "7" transmits the receiving time of the infrared signal relative to the virtual button point "4", "5". "," "1" and "2" are the largest.

Then, the first processing unit 13 acquires, from the storage unit 15, the key content information corresponding to the infrared transmitting and receiving unit 11 with the largest transmitting and receiving time in the infrared transmitting and receiving unit 11 with the reduced infrared signal transmitting and receiving time, and the control unit A communication unit 16 transmits a wireless signal containing the content of the button to the display device 3. The display device 3 includes a second communication unit 17, a second processing unit 18, and a display unit 19. The second communication unit 17 is configured to receive a wireless signal from the projection device 1 containing the content of the button. The second processing unit 18 identifies the wireless signal, performs a function corresponding to the key content, or controls the display unit 19 to display the key content.

Therefore, the display system 4 realizes that when the virtual keyboard 2 touches a virtual button point, the infrared signal receiving and receiving unit 11 corresponding to the plurality of virtual button points has a smaller infrared signal receiving and receiving time, and the transmitting and receiving time is determined. The largest infrared transmitting and receiving unit 11 and the corresponding key content information are obtained, so that the display device 3 performs a function corresponding to the key content or controls the display unit 19 to display the key content.

FIG. 5 is a flow chart of a method for implementing a display system of a virtual keyboard of the present invention. The projection unit 12 of the projection apparatus 1 vertically projects a virtual keyboard 2 on a plane (step S500). All of the infrared transmitting and receiving units 11 immediately transmit the infrared signal to the virtual keyboard 2 and receive the infrared signal reflected by the virtual keyboard 2 (step S510). The RTC unit 14 instantly calculates the infrared signal transmission reception time of each of the infrared transmission receiving units 11 (step S520). The first processing unit 13 determines whether the infrared signal transmission reception time of the infrared transmission receiving unit 11 becomes small (step S530). If the infrared signal transmitting and receiving times of all the infrared transmitting and receiving units 11 have not changed, indicating that no touch is generated on the virtual keyboard 2, the flow returns to step S520.

If the first processing unit 13 determines one of the infrared transmitting and receiving units 11 The infrared signal transmitting and receiving time becomes smaller, indicating that a touch is generated on the virtual button point on the virtual keyboard 2, and the first processing unit 13 determines that the infrared signal transmitting and receiving in all the infrared transmitting and receiving units 11 in which the infrared signal transmitting and receiving time becomes small becomes small. The infrared emission receiving unit 11 having the largest time (step S540). The first processing unit 13 acquires the button content information corresponding to the infrared transmitting and receiving unit 11 having the largest transmission receiving time from the storage unit 15 (step S550). The first processing unit 13 controls the first communication unit 16 to transmit a wireless signal containing the content information of the button to the display device 3 (step S560).

The second communication unit 17 of the display device 3 receives the wireless signal, and the second processing unit 18 identifies the wireless signal, performs a function corresponding to the key content, or controls the display unit 19 to display the key content (step S570).

1‧‧‧Projector

2‧‧‧virtual keyboard

3‧‧‧Display device

31‧‧‧ long arm

32‧‧‧ shaft

Claims (9)

A display system of a virtual keyboard, comprising a projection device and a display device, the projection device being communicable with the display device, wherein the projection device comprises: a projection unit for vertically projecting a virtual keyboard a plane; at least one infrared transmitting and receiving unit is disposed on the projection unit, and the infrared transmitting and receiving unit is configured to vertically transmit an infrared signal to the plane to form the virtual keyboard and receive the infrared signal reflected by the virtual keyboard, and each infrared emitting The receiving unit is provided with an identifier to distinguish other infrared transmitting and receiving units; a storage unit for storing each of the infrared transmitting and receiving units with the identifier and corresponding key content information; an instant clock unit for instantly calculating each infrared The transmitting and receiving unit transmits the infrared signal to the virtual keyboard and receives the infrared signal reflected back by the virtual keyboard; a processing unit is configured to determine whether the infrared signal transmitting and receiving time of each infrared transmitting receiving unit becomes smaller, when there is an infrared transmitting and receiving unit Infrared signal transmission and reception time becomes small An infrared transmitting receiving unit having the largest infrared signal receiving and receiving time in all infrared transmitting and receiving units in which the infrared signal transmitting and receiving time becomes small; and a communication unit for transmitting signals to the display device; wherein the processing unit is further used for the slave storage unit Obtaining information and control of the button content corresponding to the infrared transmitting and receiving unit with the largest receiving time of the infrared signal The communication unit sends a signal containing the content information of the button to the display device, and the display device recognizes the signal, performs a function corresponding to the button content, or displays the button content. The display system of the virtual keyboard according to claim 1, wherein each of the infrared transmitting and receiving units comprises an infrared transmitting module and an infrared receiving module. The display system of the virtual keyboard according to claim 1, wherein the projection device is a square composed of squares, and an infrared ray receiving unit is located at a common vertex of the adjacent squares. The display system of the virtual keyboard according to claim 3, wherein the distance between two adjacent infrared transmitting and receiving units is greater than the width of one finger. The display system of the virtual keyboard according to claim 1, wherein the projection device is connected to the display device through a long arm and a rotating shaft, and the projection device is movable forward and backward. A method for implementing a display system of a virtual keyboard, the display system comprising a projection device and a display device, the projection device being communicable with the display device, the projection device comprising at least one infrared transmitting and receiving unit, the infrared transmitting and receiving The unit is configured to vertically transmit an infrared signal to a plane to form a virtual keyboard and receive an infrared signal reflected by the virtual keyboard. Each of the infrared transmitting and receiving units is provided with an identifier to distinguish other infrared transmitting and receiving units. The improvement is that the method includes Step: storing information of each button content corresponding to the infrared transmitting receiving unit with the identifier; Vertically projecting a virtual keyboard on a plane; each infrared transmitting and receiving unit transmits an infrared signal to the virtual keyboard and receives an infrared signal reflected by the virtual keyboard; and instantaneously calculates a transmission and reception time of the infrared signals of each infrared transmitting and receiving unit; and determines one of the infrared emitting Whether the transmitting and receiving time of the infrared signal of the receiving unit becomes smaller; when the infrared signal transmitting and receiving time of the infrared transmitting and receiving unit becomes smaller, it is judged that the infrared signal receiving and receiving time is the largest among all the infrared transmitting and receiving units in which the infrared signal transmitting and receiving time becomes small. The infrared transmitting and receiving unit obtains the button content information corresponding to the infrared transmitting receiving unit that transmits the infrared signal receiving and receiving time; sends a signal containing the button content information; and performs a function corresponding to the button content or displays the button content. The method for implementing the display system of the virtual keyboard according to claim 6, wherein each of the infrared transmitting and receiving units comprises an infrared transmitting module and an infrared receiving module. The method for realizing the display system of the virtual keyboard according to claim 6, wherein the projection device is a square composed of squares, and an infrared ray receiving unit is located at a common apex of the adjacent squares. The method for implementing a display system of a virtual keyboard according to claim 8, wherein the distance between two adjacent infrared transmitting and receiving units is greater than the width of one finger.